Panic Mode On (49) Server problems?

Message boards : Number crunching : Panic Mode On (49) Server problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · Next

AuthorMessage
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1124059 - Posted: 2 Jul 2011, 21:24:11 UTC - in response to Message 1124058.  

Problems on the horizon. All sah_assimilators are down. MB Workunits waiting for assimilation is now 107,751.

That is no good, keeping in mind it's 4th of July on Monday, and staff isn't going to come back until Tuesday.

Prepare yourselves folks. Prepare for PANIC, PANIC, PANIC!!!


Ruh roh....
OK everybody....panic stations....alert alert alert....meow meow meow.
Hold yer caches, abandon the RAC, and for God's sake, somebody hide that ducky.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1124059 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 1124087 - Posted: 2 Jul 2011, 22:17:53 UTC - in response to Message 1124059.  


For the last several hours dfownloads have been getting more & more difficult. The work gets allocated, but the download often times out alost as soon as it starts. Those that do start often time out while downloading, and when they are downloading it's only at a couple of kB/s (if that).
Over the past week suspending & then re-enabling netwotk access would usually get them to download, but now even that isn't having much effect.
Grant
Darwin NT
ID: 1124087 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1124091 - Posted: 2 Jul 2011, 22:24:42 UTC - in response to Message 1124087.  
Last modified: 2 Jul 2011, 22:25:22 UTC


For the last several hours dfownloads have been getting more & more difficult. The work gets allocated, but the download often times out alost as soon as it starts. Those that do start often time out while downloading, and when they are downloading it's only at a couple of kB/s (if that).
Over the past week suspending & then re-enabling netwotk access would usually get them to download, but now even that isn't having much effect.

Downloads have been deathly slow for me all day.
We need a full day or two of full bandwidth and splitting to start filling caches before it will settle down, I think.
And with the MB assimilators down, I am doubtful that is gonna happen right now.
But, meowsigh, we carry on.
And hope for the best.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1124091 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 35212
Credit: 261,360,520
RAC: 489
Australia
Message 1124096 - Posted: 2 Jul 2011, 22:45:27 UTC - in response to Message 1124091.  
Last modified: 2 Jul 2011, 22:46:11 UTC

Ha ha ha, that's what happens when people mention that yellow thing. ;)

Cheers.
ID: 1124096 · Report as offensive
andybutt
Volunteer tester
Avatar

Send message
Joined: 18 Mar 03
Posts: 262
Credit: 164,205,187
RAC: 516
United Kingdom
Message 1124118 - Posted: 2 Jul 2011, 23:47:20 UTC - in response to Message 1124096.  

you mean duck!!!
ID: 1124118 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 1124154 - Posted: 3 Jul 2011, 1:38:53 UTC


Has anyone been able to get a Scheduler request through in the last 2 hours or so? I noticed the inbound traffic has been slowly dropping off, even though outbound is still at maximum.
Checked my log messages & none of the Scheduler requests have been going through for about 2 hours now. My client_state file is over 5MB in size, so could be because even uploads have gotten a bit flakey over the last couple of hours.
If it struggles with a 25kB file, 5MB could be a bit much for it.
Grant
Darwin NT
ID: 1124154 · Report as offensive
Profile Slavac
Volunteer tester
Avatar

Send message
Joined: 27 Apr 11
Posts: 1932
Credit: 17,952,639
RAC: 0
United States
Message 1124156 - Posted: 3 Jul 2011, 1:41:38 UTC - in response to Message 1124154.  


Has anyone been able to get a Scheduler request through in the last 2 hours or so? I noticed the inbound traffic has been slowly dropping off, even though outbound is still at maximum.
Checked my log messages & none of the Scheduler requests have been going through for about 2 hours now. My client_state file is over 5MB in size, so could be because even uploads have gotten a bit flakey over the last couple of hours.
If it struggles with a 25kB file, 5MB could be a bit much for it.


Just got one through 10 mins ago.


Executive Director GPU Users Group Inc. -
brad@gpuug.org
ID: 1124156 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 1124161 - Posted: 3 Jul 2011, 1:49:09 UTC - in response to Message 1124156.  
Last modified: 3 Jul 2011, 2:14:55 UTC

Just got one through 10 mins ago.

Yeah, 2+ hours and nothing goes through. 5 minutes after posting, it goes through.
Guess i should have posted earlier.


EDIT- it just tried to report another task & get more work- another HTTP internal server error.
Another EDIT- several more requests, still no joy. Looks like the works are somewhat gummed up.
Grant
Darwin NT
ID: 1124161 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 1124172 - Posted: 3 Jul 2011, 2:43:04 UTC


Just had a look at my Tasks.
So far i've got about 10 errors due to Download error- MD5 check failed.

The congestion is having a detrimental effect on things.
Grant
Darwin NT
ID: 1124172 · Report as offensive
Aurora Borealis
Volunteer tester
Avatar

Send message
Joined: 14 Jan 01
Posts: 3075
Credit: 5,631,463
RAC: 0
Canada
Message 1124201 - Posted: 3 Jul 2011, 5:54:43 UTC

I'm not seeing any major problems with U/DL. Utorrent is using 90% of my bandwidth leaving only 5 to 10 KB for Boinc. It takes a few retries but everything is getting through.
ID: 1124201 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 1124203 - Posted: 3 Jul 2011, 6:25:28 UTC - in response to Message 1124201.  


It's getting through, but it's taking more & more attempts to do so, both with uploads & downloads.
I suspect the problem with uploads is why so many Scheduler requests error out.
Grant
Darwin NT
ID: 1124203 · Report as offensive
Profile S@NL - XP_Freak

Send message
Joined: 10 Jul 99
Posts: 99
Credit: 6,248,265
RAC: 0
Netherlands
Message 1124205 - Posted: 3 Jul 2011, 7:19:10 UTC - in response to Message 1124142.  

OMG he said the word again!

And so the upload server bruno is down.


Goodbye Seti Classic
ID: 1124205 · Report as offensive
Profile S@NL - XP_Freak

Send message
Joined: 10 Jul 99
Posts: 99
Credit: 6,248,265
RAC: 0
Netherlands
Message 1124208 - Posted: 3 Jul 2011, 7:39:41 UTC
Last modified: 3 Jul 2011, 7:41:21 UTC

And up again :)

The duck has ducked.

Goodbye Seti Classic
ID: 1124208 · Report as offensive
Profile [B^S] madmac
Volunteer tester
Avatar

Send message
Joined: 9 Feb 04
Posts: 1175
Credit: 4,754,897
RAC: 0
United Kingdom
Message 1124238 - Posted: 3 Jul 2011, 11:53:42 UTC

I started today with 10 waiting to be downloaded this was at 6:00 UTC now I have got 15 waiting to be downloaded, well I will sit and wait and see what happens
ID: 1124238 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1124240 - Posted: 3 Jul 2011, 12:03:00 UTC - in response to Message 1124238.  

I started today with 10 waiting to be downloaded this was at 6:00 UTC now I have got 15 waiting to be downloaded, well I will sit and wait and see what happens


I've had 4 Mb WU's download in the last 2 hrs, plenty more in the queue, looks like its on a go slow:-(


Kevin


ID: 1124240 · Report as offensive
AndrewM
Volunteer tester

Send message
Joined: 5 Jan 08
Posts: 369
Credit: 34,275,196
RAC: 0
Australia
Message 1124495 - Posted: 4 Jul 2011, 3:00:16 UTC

Server Status page has stuck again. U/Ls too.
ID: 1124495 · Report as offensive
Profile George
Avatar

Send message
Joined: 14 Jan 00
Posts: 6
Credit: 2,619,741
RAC: 0
Virgin Islands
Message 1124497 - Posted: 4 Jul 2011, 3:22:22 UTC - in response to Message 1124496.  

I'm now in panic mode, (Please pass the beer and chip's), additionally I will be soon going into fret mode as I'm low on dip, and I've run out of Rum.
George from Over There.
ID: 1124497 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 1124498 - Posted: 4 Jul 2011, 3:30:22 UTC

Another Margarita should fix this up fine!
Boinc....Boinc....Boinc....Boinc....
ID: 1124498 · Report as offensive
Profile Akio
Avatar

Send message
Joined: 18 May 11
Posts: 375
Credit: 32,129,242
RAC: 0
United States
Message 1124561 - Posted: 4 Jul 2011, 12:15:35 UTC - in response to Message 1124498.  

whoops - Cricket graph took a nosedive.
ID: 1124561 · Report as offensive
Profile Khangollo
Avatar

Send message
Joined: 1 Aug 00
Posts: 245
Credit: 36,410,524
RAC: 0
Slovenia
Message 1124563 - Posted: 4 Jul 2011, 12:20:05 UTC
Last modified: 4 Jul 2011, 12:21:35 UTC

It was obvious that servers will grind to a halt again when MB assimilators stopped and no one intervened since. Oh well...
ID: 1124563 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · Next

Message boards : Number crunching : Panic Mode On (49) Server problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.