Panic Mode On (12) Server problems

Message boards : Number crunching : Panic Mode On (12) Server problems
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next

AuthorMessage
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 865303 - Posted: 14 Feb 2009, 7:54:53 UTC - in response to Message 865165.  

Noticed something on the server page. It seems "Results ready to send" is varying between ~60k and ~120k. Seems a bit strange, you'd expect some variation but not this much. Don't know if this is a result or a reason or not related at all, just kinda odd.

If you look at Scarecrow's 30 day graphs you'll see it's not really unusual. The mb_splitter processes can produce more WUs than the download bandwidth can deliver, so they don't start new work when "Results ready to send" is above a set level, a lower level toggles work creation on again. Once a splitter has started on a channel it runs to completion, so the "Results ready to send" overshoots the high water mark somewhat.
                                                             Joe
ID: 865303 · Report as offensive
-Bert-

Send message
Joined: 23 Mar 02
Posts: 152
Credit: 412,754
RAC: 0
Netherlands
Message 865311 - Posted: 14 Feb 2009, 8:42:45 UTC - in response to Message 865303.  
Last modified: 14 Feb 2009, 9:12:38 UTC

If you look at Scarecrow's 30 day graphs you'll see it's not really unusual. The mb_splitter processes can produce more WUs than the download bandwidth can deliver, so they don't start new work when "Results ready to send" is above a set level, a lower level toggles work creation on again. Once a splitter has started on a channel it runs to completion, so the "Results ready to send" overshoots the high water mark somewhat.


I was wondering if there is a similar set of graphs for Astropulse?

Edit: Sorry, I already found them.
ID: 865311 · Report as offensive
Hans Kramer
Volunteer tester

Send message
Joined: 16 May 99
Posts: 61
Credit: 8,770,184
RAC: 0
Netherlands
Message 865315 - Posted: 14 Feb 2009, 9:23:58 UTC - in response to Message 865303.  


If you look at Scarecrow's 30 day graphs you'll see it's not really unusual........


Thanks Joe, bookmarked that one along with Cricket :-)). Conclusion, not related to the recent "no jobs" problem.


ID: 865315 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 865358 - Posted: 14 Feb 2009, 14:06:32 UTC

Server status hasn't updated in over 2 hours, Cricket graph shows almost no download traffic for the last half hour. Woe is me!
                                                                 Joe
ID: 865358 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 865418 - Posted: 14 Feb 2009, 17:28:33 UTC

New message on front page.

February 14, 2009
There is a known server problem that is currently preventing work form being sent.


ID: 865418 · Report as offensive
Profile Westsail and *Pyxey*
Volunteer tester
Avatar

Send message
Joined: 26 Jul 99
Posts: 338
Credit: 20,544,999
RAC: 0
United States
Message 865423 - Posted: 14 Feb 2009, 17:48:31 UTC - in response to Message 865418.  

been out of work all morning on both machines and been bummed. Usually you can get it in trickles here and there, but as of this posting nothing has come down. Good luck guys thanks for all your hard work and dedication!
"The most exciting phrase to hear in science, the one that heralds new discoveries, is not Eureka! (I found it!) but rather, 'hmm... that's funny...'" -- Isaac Asimov
ID: 865423 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 867652 - Posted: 21 Feb 2009, 10:49:29 UTC


People may have problems uploading & downloading at the moment. Network traffic is maxed out & has been that way for over 4 hours.
Grant
Darwin NT
ID: 867652 · Report as offensive
Tribble

Send message
Joined: 21 Feb 02
Posts: 65
Credit: 7,978,002
RAC: 0
Australia
Message 867718 - Posted: 21 Feb 2009, 18:33:04 UTC - in response to Message 867652.  

I am going to run out of work soon :)

Had internet troubles today and couldn't get any WUs, now it's working and I can't get any WUs :P

I would have increased my cache size but I was playing around with a few apps and didn't want to lose any WUs

Oh well.
ID: 867718 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 867722 - Posted: 21 Feb 2009, 18:56:02 UTC

Matt said this Thursday "As we move toward the weekend we're sticking with the current raw data storage workarounds, which means servers are loaded heavier than we'd like, but at least data is still flowing. I wouldn't be surprised if there are network hiccups or if the assimilator queue swells during the weekend."

http://setiathome.berkeley.edu/forum_thread.php?id=52108&nowrap=true#867158


PROUD MEMBER OF Team Starfire World BOINC
ID: 867722 · Report as offensive
Profile littlegreenmanfrommars
Volunteer tester
Avatar

Send message
Joined: 28 Jan 06
Posts: 1410
Credit: 934,158
RAC: 0
Australia
Message 867752 - Posted: 21 Feb 2009, 21:12:58 UTC

Just downloaded an 8 Meg AP WU, but uploading results seems to be a problem on all three of my rigs.
Once a WU has been uploaded, updating seems to take a little longer than usual.
ID: 867752 · Report as offensive
Profile James Sotherden
Avatar

Send message
Joined: 16 May 99
Posts: 10436
Credit: 110,373,059
RAC: 54
United States
Message 867755 - Posted: 21 Feb 2009, 21:35:20 UTC

my mac has no problems uploading but my pc does .
[/quote]

Old James
ID: 867755 · Report as offensive
Rob.B

Send message
Joined: 23 Jul 99
Posts: 157
Credit: 1,439,682
RAC: 0
United Kingdom
Message 867757 - Posted: 21 Feb 2009, 21:36:38 UTC

On the upload point, I too am having issues, although my CPU results are slowly filtering up, my CUDA results just keep retrying.
ID: 867757 · Report as offensive
Tribble

Send message
Joined: 21 Feb 02
Posts: 65
Credit: 7,978,002
RAC: 0
Australia
Message 867758 - Posted: 21 Feb 2009, 21:38:16 UTC - in response to Message 867755.  

I cannot download new WU's because my completed WUs don't upload thus it doesn't request more work.

I've changed my cache size but it still just requests 0 seconds of work.
ID: 867758 · Report as offensive
Profile Mike O
Avatar

Send message
Joined: 1 Sep 07
Posts: 428
Credit: 6,670,998
RAC: 0
United States
Message 867759 - Posted: 21 Feb 2009, 21:42:54 UTC

I'm stuck in limbo as far as uploading anything goes.
I too will be suffering the No WU Blues soon if things don't start flowing better.
If I run outta work, It'll be an excuse to clean the fans in the puters. yippy! (not really) ;)




Not Ready Reading BRAIN. Abort/Retry/Fail?
ID: 867759 · Report as offensive
Iona
Avatar

Send message
Joined: 12 Jul 07
Posts: 790
Credit: 22,438,118
RAC: 0
United Kingdom
Message 867763 - Posted: 21 Feb 2009, 21:58:07 UTC - in response to Message 867759.  
Last modified: 21 Feb 2009, 21:58:35 UTC

My CPU/HS fan speed has dropped by about 100 rpm, in the last 6 weeks. I've got WUs, but there is probably no sense in adding to the 'log jam'.
Don't take life too seriously, as you'll never come out of it alive!
ID: 867763 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 867766 - Posted: 21 Feb 2009, 22:10:32 UTC


From the looks of Scarecrow's graphs, a lot of people are having problems returning work (the number of results received in the last hour is steadily dropping), but still downloading in most cases.
The cause of all the traffic appears to be Astropulse. Heaps of work has started to be returned, and as it comes back it's sending out more. It's gone from receiving 100 in the last hour up to almost 3,000 in the last hour.

The result turnaround time has gone from 50 hours down to 20. Seti is pretty steady at 70. Something fishy maybe? I thought AP WUs took much longer to process than Seti?
Grant
Darwin NT
ID: 867766 · Report as offensive
Tribble

Send message
Joined: 21 Feb 02
Posts: 65
Credit: 7,978,002
RAC: 0
Australia
Message 867768 - Posted: 21 Feb 2009, 22:15:07 UTC - in response to Message 867766.  
Last modified: 21 Feb 2009, 22:17:56 UTC

my AP units crunch in about 8-9 hours so 20hrs isn't so bad.

Edit:

Result turnaround time (last hour average) 83.25 hours 15.31 hours

Ahh I see that too now ... Hmmm
ID: 867768 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 867769 - Posted: 21 Feb 2009, 22:18:23 UTC - in response to Message 867768.  
Last modified: 21 Feb 2009, 22:19:07 UTC

my AP units crunch in about 8-9 hours so 20hrs isn't so bad.

Is that running the stock application, or the optimised one? I'd expect AP is like Seti- most people are just running the stock application.
Grant
Darwin NT
ID: 867769 · Report as offensive
Profile Blurf
Volunteer tester

Send message
Joined: 2 Sep 06
Posts: 8964
Credit: 12,678,685
RAC: 0
United States
Message 867773 - Posted: 21 Feb 2009, 22:28:53 UTC

I messaged Eric to see if he could kick the Upload server remotely from home


ID: 867773 · Report as offensive
Tribble

Send message
Joined: 21 Feb 02
Posts: 65
Credit: 7,978,002
RAC: 0
Australia
Message 867774 - Posted: 21 Feb 2009, 22:29:22 UTC - in response to Message 867769.  

my AP units crunch in about 8-9 hours so 20hrs isn't so bad.

Is that running the stock application, or the optimised one? I'd expect AP is like Seti- most people are just running the stock application.



Running the optimised one.

Last one ready to be uploaded was done in 8hr 29mins.
the last one to be uploaded took 10hrs but I was messing around and it restarted part way in.
ID: 867774 · Report as offensive
Previous · 1 . . . 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next

Message boards : Number crunching : Panic Mode On (12) Server problems


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.