Panic Mode On (10) Server problems

Message boards : Number crunching : Panic Mode On (10) Server problems
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 12 · Next

AuthorMessage
Profile The Fiend

Send message
Joined: 23 Sep 01
Posts: 6
Credit: 3,051,288
RAC: 0
Thailand
Message 827177 - Posted: 5 Nov 2008, 10:09:40 UTC

Uploads cleared now :)
ID: 827177 · Report as offensive
Profile [B^S] madmac
Volunteer tester
Avatar

Send message
Joined: 9 Feb 04
Posts: 1175
Credit: 4,754,897
RAC: 0
United Kingdom
Message 827184 - Posted: 5 Nov 2008, 12:05:32 UTC

Just done an update as I have got two WUS to report and it took nearly 2 minutes for it to do. Have to do an update when I have an AP waiting to be done.
ID: 827184 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 827196 - Posted: 5 Nov 2008, 13:03:14 UTC

Got a shorty flood here! Yay!
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 827196 · Report as offensive
Profile Blurf
Volunteer tester

Send message
Joined: 2 Sep 06
Posts: 8964
Credit: 12,678,685
RAC: 0
United States
Message 827340 - Posted: 5 Nov 2008, 21:53:18 UTC

Shorties don't bug me...they're still credits.


ID: 827340 · Report as offensive
BarryAZ

Send message
Joined: 1 Apr 01
Posts: 2580
Credit: 16,982,517
RAC: 0
United States
Message 827366 - Posted: 5 Nov 2008, 23:26:12 UTC - in response to Message 827184.  

The upload server is still very fragile -- then again it has only been 24 hours from the weekly 6 hour outage and these days full recovery from that outage takes between 2 and 20 times the length of the outage.

Just done an update as I have got two WUS to report and it took nearly 2 minutes for it to do. Have to do an update when I have an AP waiting to be done.


ID: 827366 · Report as offensive
Rudy
Volunteer tester

Send message
Joined: 23 Jun 99
Posts: 189
Credit: 794,998
RAC: 0
Canada
Message 827588 - Posted: 6 Nov 2008, 16:38:33 UTC - in response to Message 827168.  

Ready to send queue has work available, system does not seem to want to give me any. Down to my last result, starting to build debt.

06/11/2008 9:09:55 AM|SETI@home|Starting 14oc08ad.14270.10706.15.8.143_1
06/11/2008 9:09:55 AM|SETI@home|Starting task 14oc08ad.14270.10706.15.8.143_1 using setiathome_enhanced version 528
06/11/2008 9:17:58 AM|SETI@home|Sending scheduler request: To fetch work. Requesting 5185 seconds of work, reporting 0 completed tasks
06/11/2008 9:18:24 AM|SETI@home|Scheduler request succeeded: got 0 new tasks
ID: 827588 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 828455 - Posted: 8 Nov 2008, 22:48:14 UTC
Last modified: 8 Nov 2008, 22:50:26 UTC

Nothing appears to be broken as such (Scarecrow's Graphs show everything is good (and i notice there are now graphs there for Astropulse as well)), but the network graphs are showing a lot of inbound traffic, even though the outbound isn't very high. And it's been that way for a while now.
Grant
Darwin NT
ID: 828455 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 828988 - Posted: 10 Nov 2008, 17:45:15 UTC


Something's definately not right.
I'm getting more & more "No work available" messages, even though there is, and on the 2nd, 3rd or 4th attempt it will finally be allocated & download. And the inbound traffic continues to climb, even though the outbound still remains at quite low levels.
Grant
Darwin NT
ID: 828988 · Report as offensive
Profile [B^S] madmac
Volunteer tester
Avatar

Send message
Joined: 9 Feb 04
Posts: 1175
Credit: 4,754,897
RAC: 0
United Kingdom
Message 828991 - Posted: 10 Nov 2008, 17:48:44 UTC

I have had just downloaded it seems that we are in the 'shorties' again.
ID: 828991 · Report as offensive
Profile [B^S] madmac
Volunteer tester
Avatar

Send message
Joined: 9 Feb 04
Posts: 1175
Credit: 4,754,897
RAC: 0
United Kingdom
Message 829579 - Posted: 12 Nov 2008, 9:40:39 UTC - in response to Message 828991.  

I have had just downloaded it seems that we are in the 'shorties' again.

Spoken too soon now getting no new work messages will wait it is bound to clear up
ID: 829579 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51522
Credit: 1,018,363,574
RAC: 1,004
United States
Message 829594 - Posted: 12 Nov 2008, 12:19:24 UTC

There is a problem right now......
Server status shows 0 ready to send, and the Scarecrow Graphs also show ready to send has dwindled and the splitter activity has slowed way down......

Something has tanked again....probably until today's maintenance outage.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 829594 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 829606 - Posted: 12 Nov 2008, 13:39:26 UTC


. . . Database/file status [right cha' be Mark . . .]

Results ready to send 0 0 16m
Current result creation rate 12.8182/sec 0.0769/sec 7m
Results out in the field 3,531,444 172,540 16m
Results received in last hour 57,337 809 0m
Result turnaround time (last hour average) 53.49 hours 215.60 hours 0m
Results returned and awaiting validation 2,510,686 163,047 16m
Workunits waiting for validation 53 1 16m
Workunits waiting for assimilation 533 8 16m
Workunit files waiting for deletion 621,494 88 16m
Result files waiting for deletion 622,890 60 16m
Workunits waiting for db purging 274,889 9,035 16m
Results waiting for db purging 1,207,101 24,167 16m
Transitioner backlog (hours) 0 0m

BOINC Wiki . . .

Science Status Page . . .
ID: 829606 · Report as offensive
Rudy
Volunteer tester

Send message
Joined: 23 Jun 99
Posts: 189
Credit: 794,998
RAC: 0
Canada
Message 829633 - Posted: 12 Nov 2008, 16:03:46 UTC - in response to Message 829594.  

There is a problem right now......
Server status shows 0 ready to send, and the Scarecrow Graphs also show ready to send has dwindled and the splitter activity has slowed way down......

Something has tanked again....probably until today's maintenance outage.


The problem started on the 10th when something went wrong in the deletion process. It just took until now for the queues to fill and the splitters to slow down.

Server Bruno who has been acting up since his OS upgrade a few weeks back. All the details are in the tech news threads.

It likely will extend the shutdown since I recall reading that they like the queues to be empty before they do a backup during the shutdown.
ID: 829633 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51522
Credit: 1,018,363,574
RAC: 1,004
United States
Message 829634 - Posted: 12 Nov 2008, 16:11:10 UTC - in response to Message 829633.  

There is a problem right now......
Server status shows 0 ready to send, and the Scarecrow Graphs also show ready to send has dwindled and the splitter activity has slowed way down......

Something has tanked again....probably until today's maintenance outage.


The problem started on the 10th when something went wrong in the deletion process. It just took until now for the queues to fill and the splitters to slow down.

Server Bruno who has been acting up since his OS upgrade a few weeks back. All the details are in the tech news threads.

It likely will extend the shutdown since I recall reading that they like the queues to be empty before they do a backup during the shutdown.

You could indeed be correct on both counts......
The 7 Day Scarecrow Graphs do show the 'awaiting deletion' stats continuously rising since sometime on the 10th....and there is only so much storage space available....
Good observation.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 829634 · Report as offensive
Profile Byron S Goodgame
Volunteer tester
Avatar

Send message
Joined: 16 Jan 06
Posts: 1145
Credit: 3,936,993
RAC: 0
United States
Message 829689 - Posted: 13 Nov 2008, 1:14:43 UTC

Just curious if anyone has started getting work yet since after the outage?
ID: 829689 · Report as offensive
JohnAlton
Avatar

Send message
Joined: 28 Aug 01
Posts: 54
Credit: 164,417,653
RAC: 369
United States
Message 829719 - Posted: 13 Nov 2008, 2:33:24 UTC - in response to Message 829689.  

Not a drop here...
ID: 829719 · Report as offensive
JohnAlton
Avatar

Send message
Joined: 28 Aug 01
Posts: 54
Credit: 164,417,653
RAC: 369
United States
Message 829743 - Posted: 13 Nov 2008, 3:16:29 UTC - in response to Message 829719.  
Last modified: 13 Nov 2008, 3:16:46 UTC

Not a drop here...


UPDATE: 10 drops received. Well, it's a start.
ID: 829743 · Report as offensive
Profile Byron S Goodgame
Volunteer tester
Avatar

Send message
Joined: 16 Jan 06
Posts: 1145
Credit: 3,936,993
RAC: 0
United States
Message 829747 - Posted: 13 Nov 2008, 3:21:21 UTC - in response to Message 829743.  

Not a drop here...


UPDATE: 10 drops received. Well, it's a start.



Flowing here again.

ID: 829747 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 829755 - Posted: 13 Nov 2008, 4:32:25 UTC

Not a drop available for my iMac.

ID: 829755 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51522
Credit: 1,018,363,574
RAC: 1,004
United States
Message 829759 - Posted: 13 Nov 2008, 5:10:58 UTC

Just got a few for one of my rigs, and the demand shown on the Cricket Graph seems to be slowing a bit....

Sooooooooo....hopefully that means the splitters can play a little catch-up and WUs will be in a bit more abundant supply soon.....
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 829759 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 12 · Next

Message boards : Number crunching : Panic Mode On (10) Server problems


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.