Panic Mode On (80) Server Problems?

Message boards : Number crunching : Panic Mode On (80) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 25 · Next

AuthorMessage
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1323697 - Posted: 2 Jan 2013, 18:47:53 UTC - in response to Message 1323691.  

My 303 uploads spread across here an Beta disappeared in a flash!!

Unfortunately here has "No tasks available"

All my machines managed to report just after 1700 UTC but only two were able to get any new tasks before a tap was turned off somewhere.

None of mine asked for anything, but I realized one had a bunch of ghosts. I suspended Einstein on that one, then did another Seti update and they were resent.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1323697 · Report as offensive
bill

Send message
Joined: 16 Jun 99
Posts: 861
Credit: 29,352,955
RAC: 0
United States
Message 1323708 - Posted: 2 Jan 2013, 19:10:03 UTC - in response to Message 1323659.  


As I understand this, you have a bunch of CPU tasks and you're out of GPU tasks, and you want to reassign the CPU tasks to the GPU so they'll get done faster. What's the point? Let's say you have 80 hours' worth of work and you transfer it and it gets done in 12 hours instead, but the servers are still down and you still can't get any more work? What have you gained? Nothing that I can see.


Well, processing power is made available sooner to other projects. If you care about such things.
ID: 1323708 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1323714 - Posted: 2 Jan 2013, 19:26:39 UTC - in response to Message 1323683.  

The crickets live!

And have you seen the numbers of results ready to send?

"Results ready to send 4,738,529" [George Takei]Oh my.[/George Takei]
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1323714 · Report as offensive
mikeej42

Send message
Joined: 26 Oct 00
Posts: 109
Credit: 791,875,385
RAC: 9
United States
Message 1323718 - Posted: 2 Jan 2013, 19:31:35 UTC

The WEB page is reporting "Results ready to send 4,743,749" but I have over a hundred systems that only get
"1/2/2013 1:24:47 PM | SETI@home | Project has no tasks available".
Even if I query from the same server every 15 seconds I can not get any tasks. I never get the message that the request was too recent.

Anyone have an explanation or what I need to change?
ID: 1323718 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1323723 - Posted: 2 Jan 2013, 19:42:23 UTC - in response to Message 1323718.  
Last modified: 2 Jan 2013, 19:42:38 UTC

The WEB page is reporting "Results ready to send 4,743,749" but I have over a hundred systems that only get
"1/2/2013 1:24:47 PM | SETI@home | Project has no tasks available".
Even if I query from the same server every 15 seconds I can not get any tasks. I never get the message that the request was too recent.

Anyone have an explanation or what I need to change?

The work requests are fulfilled by the feeder. Which only holds a few hundred at a time. It also only refills every so few seconds. Originally I think it was 100 tasks every 60 seconds, but it has been estimated that it has to be much higher and faster these days.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1323723 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1323726 - Posted: 2 Jan 2013, 19:49:14 UTC - in response to Message 1323723.  

The WEB page is reporting "Results ready to send 4,743,749" but I have over a hundred systems that only get
"1/2/2013 1:24:47 PM | SETI@home | Project has no tasks available".
Even if I query from the same server every 15 seconds I can not get any tasks. I never get the message that the request was too recent.

Anyone have an explanation or what I need to change?

The work requests are fulfilled by the feeder. Which only holds a few hundred at a time. It also only refills every so few seconds. Originally I think it was 100 tasks every 60 seconds, but it has been estimated that it has to be much higher and faster these days.

The crickets seem to have reached a plateau, which is slightly but significantly lower than the pre-crash plateau.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1323726 · Report as offensive
Keith White
Avatar

Send message
Joined: 29 May 99
Posts: 392
Credit: 13,035,233
RAC: 22
United States
Message 1323734 - Posted: 2 Jan 2013, 19:54:56 UTC - in response to Message 1323726.  

The crickets seem to have reached a plateau, which is slightly but significantly lower than the pre-crash plateau.

"slightly but significantly" Is that like jumbo shrimp? :p

"Life is just nature's way of keeping meat fresh." - The Doctor
ID: 1323734 · Report as offensive
Profile Dorsai
Avatar

Send message
Joined: 7 Sep 04
Posts: 474
Credit: 4,504,838
RAC: 0
United Kingdom
Message 1323736 - Posted: 2 Jan 2013, 19:59:32 UTC - in response to Message 1323726.  

From a quick glance over the the above posts am I correct in assuming the situation can be summarized as follows:

There are plenty of work units to send, but they are not getting sent. (For whatever reason.)






Foamy is "Lord and Master".
(Oh, + some Classic WUs too.)
ID: 1323736 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1323743 - Posted: 2 Jan 2013, 20:18:07 UTC - in response to Message 1323736.  

From a quick glance over the the above posts am I correct in assuming the situation can be summarized as follows:

There are plenty of work units to send, but they are not getting sent. (For whatever reason.)


The situation is normal after a period of machines running down their caches. Thousands of machines all requesting all the work they can at the same time.

Looking at my list of all tasks I have been allocated around 150 tasks across my machines in the past 15 minutes. Doing a quick check looks like they are all downloaded without any ghosts being made in the process.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1323743 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1323746 - Posted: 2 Jan 2013, 20:24:39 UTC - in response to Message 1323736.  

From a quick glance over the the above posts am I correct in assuming the situation can be summarized as follows:

There are plenty of work units to send, but they are not getting sent. (For whatever reason.)

The number of ready to send has dropped by over 40,000.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1323746 · Report as offensive
mikeej42

Send message
Joined: 26 Oct 00
Posts: 109
Credit: 791,875,385
RAC: 9
United States
Message 1323749 - Posted: 2 Jan 2013, 20:29:38 UTC - in response to Message 1323723.  


Even if I query from the same server every 15 seconds I can not get any tasks. I never get the message that the request was too recent.

Anyone have an explanation or what I need to change?

The work requests are fulfilled by the feeder. Which only holds a few hundred at a time. It also only refills every so few seconds. Originally I think it was 100 tasks every 60 seconds, but it has been estimated that it has to be much higher and faster these days.


I have over 150 machines that have not got any tasks today and they are getting tasks from Einstein which has a resource of 0.

Any idea why polling less than 303 seconds does not return the normal error about the request being too recent?
ID: 1323749 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1323750 - Posted: 2 Jan 2013, 20:34:48 UTC - in response to Message 1323746.  

From a quick glance over the the above posts am I correct in assuming the situation can be summarized as follows:

There are plenty of work units to send, but they are not getting sent. (For whatever reason.)

The number of ready to send has dropped by over 40,000.

Yay! My out-of-work machine got one new GPU task!
ID: 1323750 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1323752 - Posted: 2 Jan 2013, 20:37:15 UTC - in response to Message 1323749.  


Even if I query from the same server every 15 seconds I can not get any tasks. I never get the message that the request was too recent.

Anyone have an explanation or what I need to change?

The work requests are fulfilled by the feeder. Which only holds a few hundred at a time. It also only refills every so few seconds. Originally I think it was 100 tasks every 60 seconds, but it has been estimated that it has to be much higher and faster these days.


I have over 150 machines that have not got any tasks today and they are getting tasks from Einstein which has a resource of 0.

Any idea why polling less than 303 seconds does not return the normal error about the request being too recent?

They must have switched that off, perhaps temporally. I am not getting that from BETA either.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1323752 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1323755 - Posted: 2 Jan 2013, 20:42:10 UTC - in response to Message 1323750.  


Yay! My out-of-work machine got one new GPU task!

...which took 7'34" to complete...

ID: 1323755 · Report as offensive
mikeej42

Send message
Joined: 26 Oct 00
Posts: 109
Credit: 791,875,385
RAC: 9
United States
Message 1323757 - Posted: 2 Jan 2013, 20:44:32 UTC - in response to Message 1323752.  

Okay Thanks.

One of my machines finally got a task. Too many machines with empty caches fighting at the same time.

Guess I will just have to find some alcohol to get some patience, :^}
ID: 1323757 · Report as offensive
Mark Lybeck

Send message
Joined: 9 Aug 99
Posts: 245
Credit: 216,677,290
RAC: 173
Finland
Message 1323763 - Posted: 2 Jan 2013, 20:56:04 UTC - in response to Message 1323749.  


I have over 150 machines that have not got any tasks today and they are getting tasks from Einstein which has a resource of 0.

Any idea why polling less than 303 seconds does not return the normal error about the request being too recent?


Um.. How do you fit all 150 machines at home? Or did you hijack a corporate server farm? How do you finance the powerbill for those 150 machines?

With a moderate assumption of 150W/machine would mean 22,5kW. At a 0,1€/kWh this would cost you 2,25€/hour -> 2,25€*24 = 54€/day -> 365* 54€/day = 19710€/year to run.

With the power youre spending you could trade in your car for a new one every year.

ID: 1323763 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1323765 - Posted: 2 Jan 2013, 21:02:00 UTC - in response to Message 1323763.  


I have over 150 machines that have not got any tasks today and they are getting tasks from Einstein which has a resource of 0.

Any idea why polling less than 303 seconds does not return the normal error about the request being too recent?


Um.. How do you fit all 150 machines at home? Or did you hijack a corporate server farm? How do you finance the powerbill for those 150 machines?

With a moderate assumption of 150W/machine would mean 22,5kW. At a 0,1€/kWh this would cost you 2,25€/hour -> 2,25€*24 = 54€/day -> 365* 54€/day = 19710€/year to run.

With the power youre spending you could trade in your car for a new one every year.

IIRC he owns a server farm. Which he runs projects on when he doesn't have it leased out.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1323765 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1323768 - Posted: 2 Jan 2013, 21:07:19 UTC - in response to Message 1323757.  

Guess I will just have to find some alcohol to get some patience, :^}

Yep, I know that feelin'... :-0!
ID: 1323768 · Report as offensive
mikeej42

Send message
Joined: 26 Oct 00
Posts: 109
Credit: 791,875,385
RAC: 9
United States
Message 1323773 - Posted: 2 Jan 2013, 21:22:28 UTC - in response to Message 1323763.  

LOL
Yes these are servers at my work that I can use when we are not doing their "real work". I use them in between test cycles. They are HP c7000 Blade Chassis mounted 4 to a rack and the company was actually experimenting with special cooling systems for the equipment racks that the company was going to sell. There are 3 160KW cooling systems in our lab. The cooling system alone could handle several large homes. The company has since abandoned the cooling project.

ID: 1323773 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1323789 - Posted: 2 Jan 2013, 21:38:23 UTC - in response to Message 1323773.  

LOL
Yes these are servers at my work that I can use when we are not doing their "real work". I use them in between test cycles. They are HP c7000 Blade Chassis mounted 4 to a rack and the company was actually experimenting with special cooling systems for the equipment racks that the company was going to sell. There are 3 160KW cooling systems in our lab. The cooling system alone could handle several large homes. The company has since abandoned the cooling project.

I'm working on a project that's tooling up to use carbon-dioxide mixed-phase cooling in its system (particle detectors, not CPUs) but I'd love to commercialise it for processor cooling. Probably too expensive for home computing (a hefty compressor is needed to liquify the CO2) but maybe for server farms?
ID: 1323789 · Report as offensive
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 25 · Next

Message boards : Number crunching : Panic Mode On (80) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.