Panic Mode On (34) Server Problems

Message boards : Number crunching : Panic Mode On (34) Server Problems
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 9 · Next

AuthorMessage
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19518
Credit: 40,757,560
RAC: 67
United Kingdom
Message 1007721 - Posted: 24 Jun 2010, 11:06:30 UTC - in response to Message 1007720.  

I know the upload server is down, but shouldn't Boinc be able to connect to the project?

24/06/2010 12:58:17 Project communication failed: attempting access to reference site
24/06/2010 12:58:17 SETI@home Scheduler request failed: Couldn't connect to server
24/06/2010 12:58:18 Internet access OK - project servers may be temporarily down.

In Matt's latest Technical News posting yesterday the 23rd, he said;

In any case, the main culprit was our disks filling up, so as I write this we're keeping the project down until major queues drain and the constituent workunit/result files can be deleted.

ID: 1007721 · Report as offensive
Profile Gundolf Jahn

Send message
Joined: 19 Sep 00
Posts: 3184
Credit: 446,358
RAC: 0
Germany
Message 1007730 - Posted: 24 Jun 2010, 12:22:38 UTC - in response to Message 1007722.  

Both upload and download servers are down, as well as the feeder.i686. I guess you can't connect to the project when that happens.

No reason to be able to connect when you can't perform any actions I guess.

But both scheduling server and process are running (according to Server status), so I'd expect
23/06/2010 13:32:45|SETI@home|Scheduler request succeeded: got 0 new tasks
23/06/2010 13:32:45|SETI@home|Message from server: Project is temporarily shut down for maintenance
23/06/2010 13:32:45|SETI@home|Project requested delay of 3600.000000 seconds
as in the beginning of this outage. I like this message (and the delay) much more than the error messages and random delay.

Gruß,
Gundolf
Computer sind nicht alles im Leben. (Kleiner Scherz)

SETI@home classic workunits 3,758
SETI@home classic CPU time 66,520 hours
ID: 1007730 · Report as offensive
DJStarfox

Send message
Joined: 23 May 01
Posts: 1066
Credit: 1,226,053
RAC: 2
United States
Message 1007752 - Posted: 24 Jun 2010, 14:45:57 UTC
Last modified: 24 Jun 2010, 14:46:23 UTC

Neat aspect of having such a long downtime is that we can see how much bandwidth the forums and website alone use: avg 1.60 Mbits/sec
Cricket

I do hope they get the upload server enabled for a few hours before enabling the whole project... sort of a slow start-up. They'll easily max out bandwidth once fully online.
ID: 1007752 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51515
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1007753 - Posted: 24 Jun 2010, 14:49:21 UTC

I dunno where the bottleneck is, but unless they can temporarily get some more validator horsepower online, this is gonna take a while.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1007753 · Report as offensive
DJStarfox

Send message
Joined: 23 May 01
Posts: 1066
Credit: 1,226,053
RAC: 2
United States
Message 1007754 - Posted: 24 Jun 2010, 14:51:43 UTC - in response to Message 1007753.  
Last modified: 24 Jun 2010, 14:52:43 UTC

Looks like the assimilation queue is real the bottleneck:
Workunits waiting for validation	      0     0	9m
Workunits waiting for assimilation	963,789	5,141	9m
ID: 1007754 · Report as offensive
Profile Miep
Volunteer moderator
Avatar

Send message
Joined: 23 Jul 99
Posts: 2412
Credit: 351,996
RAC: 0
Message 1007758 - Posted: 24 Jun 2010, 14:59:41 UTC - in response to Message 1007754.  

Assimilation rate is some 50k/h, judging from scarecrow's graphs. So around 10 UTC on Friday till they've caught up.
Validation of WU rate seemed about 10 times higher.
On the upside there are more than 20k AP units ready to send.
Carola
-------
I'm multilingual - I can misunderstand people in several languages!
ID: 1007758 · Report as offensive
Scarecrow

Send message
Joined: 15 Jul 00
Posts: 4520
Credit: 486,601
RAC: 0
United States
Message 1007759 - Posted: 24 Jun 2010, 15:00:23 UTC - in response to Message 1007754.  
Last modified: 24 Jun 2010, 15:02:57 UTC

Looks like the assimilators are punching out ~55,000/hour.
Data Table, last 7 days
{edit: great minds think alike, Miep} ;)
ID: 1007759 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51515
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1007761 - Posted: 24 Jun 2010, 15:08:37 UTC

Ahhh....
So that horsepower needs to be launched in a little different direction then....

Meow meow.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1007761 · Report as offensive
Robert Ribbeck
Avatar

Send message
Joined: 7 Jun 02
Posts: 644
Credit: 5,283,174
RAC: 0
United States
Message 1007762 - Posted: 24 Jun 2010, 15:09:54 UTC - in response to Message 1007754.  

Looks like the assimilation queue is real the bottleneck:
Workunits waiting for validation	      0     0	9m
Workunits waiting for assimilation	963,789	5,141	9m


That Queue is dropping(939,681 now)and suspect it will be way done before they turn the upload server back on
ID: 1007762 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1007764 - Posted: 24 Jun 2010, 15:17:56 UTC

Wonder how many of those 4.6 million results out in the field will hit the upload server when it comes back online?

Ok everybody, fingers off the buttons!! Let BOINC and SETI do there job when it comes time!! :-)


PROUD MEMBER OF Team Starfire World BOINC
ID: 1007764 · Report as offensive
Scarecrow

Send message
Joined: 15 Jul 00
Posts: 4520
Credit: 486,601
RAC: 0
United States
Message 1007769 - Posted: 24 Jun 2010, 15:25:54 UTC - in response to Message 1007764.  

Wonder how many of those 4.6 million results out in the field will hit the upload server when it comes back online?

Today's word is "Avalanche".
ID: 1007769 · Report as offensive
Profile Leopoldo
Volunteer tester
Avatar

Send message
Joined: 4 Aug 99
Posts: 102
Credit: 3,051,091
RAC: 0
Russia
Message 1007782 - Posted: 24 Jun 2010, 16:02:07 UTC - in response to Message 1007764.  

Wonder how many of those 4.6 million results out in the field will hit the upload server when it comes back online?

This number slowly decreases also:

As of 24 Jun 2010 14:50:09 UTC
Results ready to send				158,484		21,179
Results out in the field			4,618,405	72,475
Results returned and awaiting validation	6,473,085	75,090
Workunits waiting for validation		0		0
Workunits waiting for assimilation		947,649		5,141
Workunit files waiting for deletion		46		0
Result files waiting for deletion		140		0
Workunits waiting for db purging		937,110		21
Results waiting for db purging			1,981,623	914

As of 24 Jun 2010 15:45:08 UTC
Results ready to send				161,415		22,761
Results out in the field			4,615,486	72,475
Results returned and awaiting validation	6,385,568	75,090
Workunits waiting for validation		0		0
Workunits waiting for assimilation		903,271		5,141
Workunit files waiting for deletion		11		0
Result files waiting for deletion		98		0
Workunits waiting for db purging		981,631		21
Results waiting for db purging			2,072,158	914

ID: 1007782 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1007805 - Posted: 24 Jun 2010, 17:13:07 UTC

Uploads going in Just now started flowing!


PROUD MEMBER OF Team Starfire World BOINC
ID: 1007805 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 1007807 - Posted: 24 Jun 2010, 17:18:06 UTC

Quick! Server Disk Space! Fill It Up!
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 1007807 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1007808 - Posted: 24 Jun 2010, 17:25:52 UTC
Last modified: 24 Jun 2010, 17:26:47 UTC

Results received in last hour 61,673 1,272 0m Wasn't this 0 just a couple of minutes ago?


PROUD MEMBER OF Team Starfire World BOINC
ID: 1007808 · Report as offensive
FiveHamlet
Avatar

Send message
Joined: 5 Oct 99
Posts: 783
Credit: 32,638,578
RAC: 0
United Kingdom
Message 1007817 - Posted: 24 Jun 2010, 17:50:27 UTC
Last modified: 24 Jun 2010, 17:50:53 UTC

Rig on a Bench just started to upload about 1000 jobs hope there is some left to dowmload when it has finished.
Going to put kettle on for a cuppa and wait.
Shame Italy are going home but it was a good match.

Dave
ID: 1007817 · Report as offensive
Profile Miep
Volunteer moderator
Avatar

Send message
Joined: 23 Jul 99
Posts: 2412
Credit: 351,996
RAC: 0
Message 1007819 - Posted: 24 Jun 2010, 17:52:43 UTC - in response to Message 1007814.  

So upload, and grab 'em while you can, this won't last for long.


'Jeder nur ein Kreuz' (everyone only one crucifix - Life of Brian, german translation. Sorry I don't know the original phrasing)

Astropulses, get 'em while they are hot!
Carola
-------
I'm multilingual - I can misunderstand people in several languages!
ID: 1007819 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1007823 - Posted: 24 Jun 2010, 18:12:52 UTC - in response to Message 1007819.  

So upload, and grab 'em while you can, this won't last for long.

Astropulses, get 'em while they are hot!

Well yes, but people are getting them instead of me... :) (that goes for all WUs)
ID: 1007823 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 1007825 - Posted: 24 Jun 2010, 18:26:12 UTC

24/06/2010 19:25:00 SETI@home Message from server: Your app_info.xml file doesn't have a usable version of Astropulse v505.
24/06/2010 19:25:00 SETI@home Message from server: No work available for the applications you have selected. Please check your project preferences on the web site.

How frightfully bizarresome.
ID: 1007825 · Report as offensive
Profile stephen Goodyer

Send message
Joined: 8 Oct 06
Posts: 37
Credit: 1,263,530
RAC: 3
United Kingdom
Message 1007832 - Posted: 24 Jun 2010, 18:49:24 UTC
Last modified: 24 Jun 2010, 19:36:01 UTC

Ok, whos hogging all the wu's.

I wish
ID: 1007832 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 9 · Next

Message boards : Number crunching : Panic Mode On (34) Server Problems


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.