Panic Mode On (10) Server problems

Message boards : Number crunching : Panic Mode On (10) Server problems
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · Next

AuthorMessage
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 834476 - Posted: 26 Nov 2008, 12:44:22 UTC

[venting]Why does this system fail so often? I would have thought that after the weekly colonic each Tuesday, the system would be at its peak. Nope. Nothing but eratic connection success, leading to unwanted back-up project downloads replacing the seti downloads.[/venting]
ID: 834476 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 834478 - Posted: 26 Nov 2008, 12:47:49 UTC
Last modified: 26 Nov 2008, 12:48:13 UTC

Last night around 9 PM MST, the whole website was unavailable, I am guessing that something that directs traffic for the site went down.

Wed Nov 26 00:29:36 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 114 seconds of work, reporting 0 completed tasks
Wed Nov 26 00:30:51 2008||Project communication failed: attempting access to reference site
Wed Nov 26 00:30:53 2008|SETI@home|Scheduler request failed: Couldn't connect to server
Wed Nov 26 00:30:54 2008||Internet access OK - project servers may be temporarily down.
Wed Nov 26 00:31:54 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 264 seconds of work, reporting 0 completed tasks
Wed Nov 26 00:32:04 2008|SETI@home|Scheduler request succeeded: got 0 new tasks
Wed Nov 26 00:32:04 2008|SETI@home|Message from server: No work sent
Wed Nov 26 00:32:04 2008|SETI@home|Message from server: No work is available for SETI@home Enhanced
Wed Nov 26 00:32:04 2008|SETI@home|Message from server: No work available for the applications you have selected.  Please check your settings on the web site.
Wed Nov 26 00:33:06 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 342 seconds of work, reporting 0 completed tasks
Wed Nov 26 00:33:41 2008|SETI@home|Scheduler request succeeded: got 1 new tasks
Wed Nov 26 00:33:43 2008|SETI@home|Started download of 03no08af.27662.12747.9.8.211
Wed Nov 26 00:33:57 2008|SETI@home|Finished download of 03no08af.27662.12747.9.8.211
Wed Nov 26 00:37:46 2008|SETI@home|Computation for task 08oc08ab.3894.236523.10.8.246_1 finished
Wed Nov 26 00:37:46 2008|SETI@home|Starting 09oc08ab.2251.12738.10.8.232_0
Wed Nov 26 00:37:46 2008|SETI@home|Starting task 09oc08ab.2251.12738.10.8.232_0 using setiathome_enhanced version 603
Wed Nov 26 00:37:46 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 3426 seconds of work, reporting 0 completed tasks
Wed Nov 26 00:37:48 2008|SETI@home|Started upload of 08oc08ab.3894.236523.10.8.246_1_0
Wed Nov 26 00:38:02 2008|SETI@home|Finished upload of 08oc08ab.3894.236523.10.8.246_1_0
Wed Nov 26 00:38:02 2008|SETI@home|Scheduler request succeeded: got 0 new tasks
Wed Nov 26 00:39:03 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 3597 seconds of work, reporting 1 completed tasks
Wed Nov 26 00:44:12 2008||Project communication failed: attempting access to reference site
Wed Nov 26 00:44:13 2008||Internet access OK - project servers may be temporarily down.
Wed Nov 26 00:44:14 2008|SETI@home|Scheduler request failed: Timeout was reached
Wed Nov 26 00:45:15 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 4395 seconds of work, reporting 1 completed tasks
Wed Nov 26 00:45:30 2008|SETI@home|Scheduler request succeeded: got 0 new tasks
Wed Nov 26 00:45:30 2008|SETI@home|Message from server: Completed result 08oc08ab.3894.236523.10.8.246_1 refused: result already reported as success
Wed Nov 26 00:46:32 2008|SETI@home|Sending scheduler request: To fetch work.  Requesting 4547 seconds of work, reporting 0 completed tasks
Wed Nov 26 00:46:42 2008|SETI@home|Scheduler request succeeded: got 1 new tasks
Wed Nov 26 00:46:44 2008|SETI@home|Started download of 03no08ad.28571.22976.13.8.60


ID: 834478 · Report as offensive
Profile KWSN Ekky Ekky Ekky
Avatar

Send message
Joined: 25 May 99
Posts: 944
Credit: 52,956,491
RAC: 67
United Kingdom
Message 834491 - Posted: 26 Nov 2008, 13:55:19 UTC

Have a nice weekend! Download as much as you can, when you can!

ID: 834491 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24927
Credit: 3,081,182
RAC: 7
Ireland
Message 834507 - Posted: 26 Nov 2008, 14:44:38 UTC

Yep, the servers need a good kicking....:) At least I've got a dozen AP's to crunch...
ID: 834507 · Report as offensive
Profile skildude
Avatar

Send message
Joined: 4 Oct 00
Posts: 9541
Credit: 50,759,529
RAC: 60
Yemen
Message 834509 - Posted: 26 Nov 2008, 14:52:18 UTC

My main box couldn't connect to berkeley this morning.


In a rich man's house there is no place to spit but his face.
Diogenes Of Sinope
ID: 834509 · Report as offensive
Profile Leaps-from-Shadows
Volunteer tester
Avatar

Send message
Joined: 11 Aug 08
Posts: 323
Credit: 259,220
RAC: 0
United States
Message 834519 - Posted: 26 Nov 2008, 15:41:41 UTC

Same deal here - just tried my daily morning upload/download and was able to upload results, but couldn't report them or download new work units.

11/26/2008 9:25:37 AM|SETI@home|Sending scheduler request: Requested by user. Requesting 0 seconds of work, reporting 6 completed tasks
11/26/2008 9:25:59 AM||Project communication failed: attempting access to reference site
11/26/2008 9:26:00 AM||Internet access OK - project servers may be temporarily down.
11/26/2008 9:26:02 AM|SETI@home|Scheduler request failed: Couldn't connect to server
11/26/2008 9:26:17 AM|SETI@home Beta Test|Sending scheduler request: To fetch work. Requesting 14491 seconds of work, reporting 1 completed tasks
11/26/2008 9:26:38 AM||Project communication failed: attempting access to reference site
11/26/2008 9:26:39 AM||Internet access OK - project servers may be temporarily down.
11/26/2008 9:26:42 AM|SETI@home Beta Test|Scheduler request failed: Couldn't connect to server

Not that I'm panicking or anything - I still have plenty of work to do. If I really needed to, I could slow things down by crunching Astropulse units on all four cores instead of just two - Cruiser has 11 Astropulse units in its queues waiting, in addition to the two in progress.
Cruiser
Gateway GT5692 L-f-S Edition
-Phenom X4 9650 CPU
-4GB 667MHz DDR2 RAM
-500GB SATA HD
-Vista x64 SP1
-BOINC 6.2.19 32-bit client
-SSE3 optimized 32-bit apps
ID: 834519 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51523
Credit: 1,018,363,574
RAC: 1,004
United States
Message 834520 - Posted: 26 Nov 2008, 15:44:25 UTC

Same here folks....none of my rigs has been able to report any completed work for the last 3-1/2 hours or so....
Hopefully the boyz shall be arriving in the lab shortly with their server kicking boots laced up tight....LOL.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 834520 · Report as offensive
Profile KWSN Ekky Ekky Ekky
Avatar

Send message
Joined: 25 May 99
Posts: 944
Credit: 52,956,491
RAC: 67
United Kingdom
Message 834531 - Posted: 26 Nov 2008, 16:32:31 UTC

Server page speak with forked tongue.

ID: 834531 · Report as offensive
-Bert-

Send message
Joined: 23 Mar 02
Posts: 152
Credit: 412,754
RAC: 0
Netherlands
Message 834532 - Posted: 26 Nov 2008, 16:41:19 UTC - in response to Message 834531.  

Why aren't the problems mentioned on the server status page?
ID: 834532 · Report as offensive
BarryAZ

Send message
Joined: 1 Apr 01
Posts: 2580
Credit: 16,982,517
RAC: 0
United States
Message 834535 - Posted: 26 Nov 2008, 16:57:18 UTC - in response to Message 834532.  

Possibly because one of the symptoms *IS* the status page??

The servers seem to have limited margin for error or extra load on them (or at least some of the servers) and so the most likely time for problems to surface is after the weekly maintenance. The servers also need close attention on a constant basis, so often enough problems surface at overnight or during the weekends when there is less constant server nursing available.

Why aren't the problems mentioned on the server status page?


ID: 834535 · Report as offensive
Profile SATAN
Avatar

Send message
Joined: 27 Aug 06
Posts: 835
Credit: 2,129,006
RAC: 0
United Kingdom
Message 834537 - Posted: 26 Nov 2008, 17:03:55 UTC

Is it just me or does anyone else find it worrying, that the number of problems is slowly increasing. It seems that after the outage, the next three days are nothing but trouble. When the guys finally manage to sort those out it's time for the weekend. Which then bring the normal problems of one slip and the project is off until monday at least.

Hopefully this time it's a simple fix.


ID: 834537 · Report as offensive
BarryAZ

Send message
Joined: 1 Apr 01
Posts: 2580
Credit: 16,982,517
RAC: 0
United States
Message 834545 - Posted: 26 Nov 2008, 17:14:22 UTC - in response to Message 834537.  

Not just you - seems that way to me as well. This time we are headed for a holiday weekend with the server in an unhappy state. The longer any particular problem exists, the more stretched out the post fix server stress cycle is going to be. The thing is, the server maintenance cycle itself is a stressor.


Is it just me or does anyone else find it worrying, that the number of problems is slowly increasing. It seems that after the outage, the next three days are nothing but trouble. When the guys finally manage to sort those out it's time for the weekend. Which then bring the normal problems of one slip and the project is off until monday at least.

Hopefully this time it's a simple fix.



ID: 834545 · Report as offensive
Profile Ghery S. Pettit
Avatar

Send message
Joined: 7 Nov 99
Posts: 325
Credit: 28,109,066
RAC: 82
United States
Message 834546 - Posted: 26 Nov 2008, 17:15:10 UTC

11/26/2008 9:10:11 AM|SETI@home|Scheduler request failed: HTTP gateway timeout

I'm getting this all the time right now. I've got WU to report and need to download more. All is not well in Berkeley.
ID: 834546 · Report as offensive
Rudy
Volunteer tester

Send message
Joined: 23 Jun 99
Posts: 189
Credit: 794,998
RAC: 0
Canada
Message 834550 - Posted: 26 Nov 2008, 17:25:45 UTC - in response to Message 834532.  

Why aren't the problems mentioned on the server status page?


They are, it just not a bright red box.

If you look at the results recieved in the last hour it is down fom it's usual 50K to about 10K. People are having trouble downloading.

If you look at the astropulse read to send, the number is usualy close to zero. Since it is not people are not able to download work either.

Since the server statues look fine, it probably is some sort of network issue.

I find looking at the numbers on the status page (cricket, scarecrow graphs) much more useful that looking for red or orange boxes.
ID: 834550 · Report as offensive
Profile SATAN
Avatar

Send message
Joined: 27 Aug 06
Posts: 835
Credit: 2,129,006
RAC: 0
United Kingdom
Message 834569 - Posted: 26 Nov 2008, 18:25:40 UTC

Looks like things are slowly changing.

Wed Nov 26 18:48:27 2008|SETI@home|Sending scheduler request: Requested by user. Requesting 0 seconds of work, reporting 23 completed tasks
Wed Nov 26 18:49:32 2008|SETI@home|Scheduler request completed: got 0 new tasks
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08af.27662.8657.9.8.139_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08aa.31968.22158.6.8.103_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.199_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08af.27662.8657.9.8.166_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.161_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08aa.31968.22158.6.8.110_1 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08af.27662.8657.9.8.99_1 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.201_1 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.164_1 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08af.27662.8657.9.8.104_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08aa.31968.22158.6.8.113_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08ad.28571.12342.13.8.12_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.243_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 03no08af.27662.8657.9.8.201_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.193_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008|SETI@home|Message from server: Completed result 04no08ab.28936.2117.5.8.245_0 refused: result already reported as success
Wed Nov 26 18:49:32 2008||General prefs: from SETI@home (last modified 26-Nov-2008 17:11:14)
Wed Nov 26 18:49:32 2008||Host location: none
Wed Nov 26 18:49:32 2008||General prefs: using your defaults
Wed Nov 26 18:49:32 2008||Reading preferences override file
Wed Nov 26 18:49:32 2008||Preferences limit memory usage when active to 10240.00MB
Wed Nov 26 18:49:32 2008||Preferences limit memory usage when idle to 10240.00MB
Wed Nov 26 18:49:32 2008||Preferences limit disk usage to 200.00GB
Wed Nov 26 18:49:32 2008||Preferences limit # CPUs to 2

ID: 834569 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 834576 - Posted: 26 Nov 2008, 18:44:03 UTC



see here: Message boards : Technical News : Nefarious Designs, Inc. (Nov 25 2008)



Message 834562 - Posted 26 Nov 2008 17:49:42 UTC - in response to Message 834555.

Yeah.. we can collect up to 100s of gigabytes a day. We'd need to be transporting data at (very) roughly 20Mbits a second 24/7 to keep up.

We don't have that spare bandwidth, and Arecibo surely does not.

About 10 years ago the ENTIRE connection between Arecibo and the rest of the world was a single 56.6 modem.

It's much better now, but still not quite up to state-of-the-art speed.

- Matt




BOINC Wiki . . .

Science Status Page . . .
ID: 834576 · Report as offensive
Profile [B^S] madmac
Volunteer tester
Avatar

Send message
Joined: 9 Feb 04
Posts: 1175
Credit: 4,754,897
RAC: 0
United Kingdom
Message 834579 - Posted: 26 Nov 2008, 18:48:37 UTC

Now getting upload failures connect failed messages and also servers may be temporarily down
ID: 834579 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 834580 - Posted: 26 Nov 2008, 18:50:24 UTC - in response to Message 834579.  
Last modified: 26 Nov 2008, 18:50:47 UTC

Now getting upload failures connect failed messages and also servers may be temporarily down


> same here

. . . been like that for awhile now - Internet [My Side] is fine - though domebody's goin' to kick the box soon ;)

ed.sp
BOINC Wiki . . .

Science Status Page . . .
ID: 834580 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 834585 - Posted: 26 Nov 2008, 19:04:42 UTC - in response to Message 834582.  

Now getting upload failures connect failed messages and also servers may be temporarily down


> same here

. . . been like that for awhile now - Internet [My Side] is fine - though somebody's goin' to kick the box soon ;)

ed.sp

Well We can always threaten to feed some raw Turkey to the server
It might reset all on Its own(Turkeys are reputed to be the dumbest birds on earth). ;)


;)))

eh Joker - 'ave a good Holiday . . .


BOINC Wiki . . .

Science Status Page . . .
ID: 834585 · Report as offensive
Profile dnolan
Avatar

Send message
Joined: 30 Aug 01
Posts: 1228
Credit: 47,779,411
RAC: 32
United States
Message 834588 - Posted: 26 Nov 2008, 19:08:35 UTC - in response to Message 834582.  

(Turkeys are reputed to be the dumbest birds on earth). ;)


This is really just a myth, at least according to this guy...

-Dave
ID: 834588 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · Next

Message boards : Number crunching : Panic Mode On (10) Server problems


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.