Panic Mode On (50) Server problems?

Message boards : Number crunching : Panic Mode On (50) Server problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 10 · Next

AuthorMessage
Profile Link
Avatar

Send message
Joined: 18 Sep 03
Posts: 834
Credit: 1,807,369
RAC: 0
Germany
Message 1126957 - Posted: 12 Jul 2011, 7:33:00 UTC - in response to Message 1126955.  

In that case.. I can easily see why jocelyn can't keep up. She was the best server we had before the new ones arrived, and is why new servers were acquired.

No, the best server in terms of speed was Mork, but it was crashing all the time and that's why it was replaced.
ID: 1126957 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19060
Credit: 40,757,560
RAC: 67
United Kingdom
Message 1126958 - Posted: 12 Jul 2011, 7:36:52 UTC

AAAAgggghhhh!!!
run computer with MB on GPU and AP on CPU. Had run out of AP tasks but got some allocated this morning, (UK time) took two hours for first two to d/load,

and then the first one bombed out after 20 secs, too much blanking.
http://setiathome.berkeley.edu/workunit.php?wuid=781713248
ID: 1126958 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1126980 - Posted: 12 Jul 2011, 11:20:21 UTC


Inbound network traffic took a little dip a while ago. Since then neither of my systems has been able to get a response from the Scheduler.
Grant
Darwin NT
ID: 1126980 · Report as offensive
B-Man
Volunteer tester

Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1126986 - Posted: 12 Jul 2011, 11:45:42 UTC - in response to Message 1126980.  
Last modified: 12 Jul 2011, 11:47:09 UTC


Inbound network traffic took a little dip a while ago. Since then neither of my systems has been able to get a response from the Scheduler.

Yeah I'm seeing the same thing. I can't contact SETI and SETI Beta. Now that I wrote that I go one to got through. Oh well. Contact is definitely slow. SETI BETA is still unreachable.
ID: 1126986 · Report as offensive
Radford Bunker

Send message
Joined: 12 Mar 09
Posts: 8
Credit: 6,073,787
RAC: 0
United States
Message 1127205 - Posted: 13 Jul 2011, 14:44:22 UTC

All:

Suddenly, well over the last two days, I'm only getting one work unit at a time when requesting new work. Any idea why?

Rad
ID: 1127205 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1127219 - Posted: 13 Jul 2011, 15:19:31 UTC - in response to Message 1127205.  

All:

Suddenly, well over the last two days, I'm only getting one work unit at a time when requesting new work. Any idea why?

Rad

Sunday night-Monday we had server problems, and Tuesday is a scheduled maintanence outage, so new work was hard to get for everybody during that period.

If the problem persists, and for any similar problems, the place to ask about it is in the Number Crunching section.
Donald
Infernal Optimist / Submariner, retired
ID: 1127219 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1127300 - Posted: 13 Jul 2011, 17:59:40 UTC


Just noticed the inbound traffic is slowly climbing upwards. Had a look at the Ready to Send buffer & it's shrunk to nothing again. Once again the splitters just aren't cranking up to meet demand.
There's data to split, but the demand's just not being met.
Grant
Darwin NT
ID: 1127300 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1127319 - Posted: 13 Jul 2011, 19:07:53 UTC - in response to Message 1127300.  


Just noticed the inbound traffic is slowly climbing upwards. Had a look at the Ready to Send buffer & it's shrunk to nothing again. Once again the splitters just aren't cranking up to meet demand.
There's data to split, but the demand's just not being met.

YAY! Now maybe all those pending downloads will be able to finish.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1127319 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1127463 - Posted: 14 Jul 2011, 5:41:59 UTC - in response to Message 1127319.  


YAY! Now maybe all those pending downloads will be able to finish.


This time yesterday, when I checked after getting home from work, had processed about 300 downloaded 50 and added another 500 to pending download queue:-(

download queue is now empty, still a little short of optimum on GPU work, but have been flooded with VLAR's, at a rough gestimate 4 weeks work.


Kevin


ID: 1127463 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1127465 - Posted: 14 Jul 2011, 5:58:58 UTC - in response to Message 1127463.  


Whatever it is, it's back with a vengance. Most requests for work result in "No work available" messages.
Grant
Darwin NT
ID: 1127465 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1127618 - Posted: 14 Jul 2011, 17:55:17 UTC - in response to Message 1127465.  


Overnight my systems got a total of about 20 Work Units between them, so at this rate i should be out of work in a couple of days.
Grant
Darwin NT
ID: 1127618 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1127758 - Posted: 15 Jul 2011, 6:04:42 UTC

This is not looking good at the moment...
My top cruncher is tearing through the work at a good pace.
But it has only managed to snag 9 WUs in the last 6 hours in return.

Some caches gonna be suffrin'.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1127758 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22200
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1127762 - Posted: 15 Jul 2011, 6:22:03 UTC

WU delivery from the project seams very random. No queue awaiting delivery, just the odd one or two pop out. Saying that I've just snagged an AP on one of my crunchers, but once its crunched and returned when will it get validated with the ongoing AP validation problems (read - not working at all). I join the queue of those waiting for the AP validator to be fixed properly as there are a few of my "offering" await. They'll get there.....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1127762 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1127763 - Posted: 15 Jul 2011, 6:33:37 UTC - in response to Message 1127758.  

WU's few and far between ATM.

Got about 5 days GPU and enough VLAR's for a month.

Had a quick look around and some are suffering already.



Kevin


ID: 1127763 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1127764 - Posted: 15 Jul 2011, 6:37:28 UTC - in response to Message 1127763.  

WU's few and far between ATM.

Got about 5 days GPU and enough VLAR's for a month.

Had a quick look around and some are suffering already.



Might be the glut of unvalidated AP work filling up storage and quashing full MB production....but that is just a guess.
Thought they might have sorted it today whilst I was at work.....but, not.

We'll just crunch up what we have and wait for the pipes to roar again.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1127764 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1127765 - Posted: 15 Jul 2011, 6:58:53 UTC - in response to Message 1127764.  

Might be the glut of unvalidated AP work filling up storage and quashing full MB production....but that is just a guess.
Thought they might have sorted it today whilst I was at work.....but, not.

We'll just crunch up what we have and wait for the pipes to roar again.


I would have liked some of that AP work, I am having problems with estimated completion times with the VLAR's.

The times keep dropping when GPU's are processing and it keeps asking for more CPU work, when it finishes a VLAR it increases the estimated processing time for GPU work and then only asks for CPU work.

It would not matter too much if they were standard or shorties, soon reschedule them, but most seem to be more VLAR's.


Kevin


ID: 1127765 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1127766 - Posted: 15 Jul 2011, 7:07:53 UTC - in response to Message 1127765.  

Might be the glut of unvalidated AP work filling up storage and quashing full MB production....but that is just a guess.
Thought they might have sorted it today whilst I was at work.....but, not.

We'll just crunch up what we have and wait for the pipes to roar again.


I would have liked some of that AP work, I am having problems with estimated completion times with the VLAR's.

The times keep dropping when GPU's are processing and it keeps asking for more CPU work, when it finishes a VLAR it increases the estimated processing time for GPU work and then only asks for CPU work.

It would not matter too much if they were standard or shorties, soon reschedule them, but most seem to be more VLAR's.


Well, I'll happily crunch anything that the servers send.
My rigs are set for MB only, but to accept AP when no MB is available.
And the Frozen 920 just snagged 2 AP WUs in the absence of any MB to send.
But little else.
I hope the boyz in the lab can shore things up a bit before the weekend.

"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1127766 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1127770 - Posted: 15 Jul 2011, 7:33:04 UTC - in response to Message 1127766.  


Well, I'll happily crunch anything that the servers send.
My rigs are set for MB only, but to accept AP when no MB is available.
And the Frozen 920 just snagged 2 AP WUs in the absence of any MB to send.
But little else.
I hope the boyz in the lab can shore things up a bit before the weekend.


If I run dry on GPU I will drop to 1 wu per card and reschedule a few over but can only let them run when not using this machine, they cause too much lag with anything else running.


Kevin


ID: 1127770 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1127780 - Posted: 15 Jul 2011, 8:03:18 UTC - in response to Message 1127770.  


My caches continue to shrink.
If only the splitters would crank it up.
Grant
Darwin NT
ID: 1127780 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1127825 - Posted: 15 Jul 2011, 11:54:00 UTC

As of about 4:30 am Berkeley time the Hurricane Electric link went totally dead. Cross your fingers and hope it will be easily restored.
                                                                Joe
ID: 1127825 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 10 · Next

Message boards : Number crunching : Panic Mode On (50) Server problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.