"This Computer has Reached a Limit on Tasks in Progress"

Message boards : Number crunching : "This Computer has Reached a Limit on Tasks in Progress"
Message board moderation

To post messages, you must log in.

AuthorMessage
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1303110 - Posted: 7 Nov 2012, 14:05:06 UTC

We're back to that again, for the first time in a long time, IIRC.

What's up, what are the limits, and when is it anticipated to go back to no limits?
ID: 1303110 · Report as offensive
Profile Fred E.
Volunteer tester

Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 0
United States
Message 1303116 - Posted: 7 Nov 2012, 14:20:25 UTC
Last modified: 7 Nov 2012, 14:31:53 UTC

We're back to that again, for the first time in a long time, IIRC.

What's up, what are the limits, and when is it anticipated to go back to no limits?

I ave been looking into this for a day now, so I'll summarize what I've learned. Eric had to be called out Sunday to work the issue of Scheduler timeouts and excessive ghost tasks. "Results" in the field had swelled to 10.8 Mil, and 2 instances of runaway hosts with thousands of ghosts were reported in the forum. Eric's comment on Sunday was that limits were needed, and apparently they were installed during Monday's unscheduled downtime. From observations in the Panic Mode thread, the limits appear to be 100 cpu and 100 gpu.

How long? Guess that depends on a return to stability. My log show that we're not there yet.
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.
ID: 1303116 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22222
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1303149 - Posted: 7 Nov 2012, 15:37:38 UTC

Eric si most certainly one of those who goes "above and beyond the call of duty". We must give him thanks, along with his long suffering wife Angela.
Eric and Angela, step forward and receive our grateful thanks.





(If I know that pair, they are now trying to hide in the background somewhere, blushing)
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1303149 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1303177 - Posted: 7 Nov 2012, 17:44:41 UTC - in response to Message 1303116.  


I ave been looking into this for a day now, so I'll summarize what I've learned. Eric had to be called out Sunday to work the issue of Scheduler timeouts and excessive ghost tasks. "Results" in the field had swelled to 10.8 Mil, and 2 instances of runaway hosts with thousands of ghosts were reported in the forum. Eric's comment on Sunday was that limits were needed, and apparently they were installed during Monday's unscheduled downtime. From observations in the Panic Mode thread, the limits appear to be 100 cpu and 100 gpu.

How long? Guess that depends on a return to stability. My log show that we're not there yet.


Thanks for the feedback.

One of my hosts has about 1000 ghosts, the other, maybe a few hundred.

A question: since each of my machines has 2 GTX 460s running 2 threads each, does that count as 4 GPU? Or two? (or, to put it another way, are the servers aware when a user runs more GPU threads than he/she has GPUs?)
ID: 1303177 · Report as offensive
Profile Fred E.
Volunteer tester

Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 0
United States
Message 1303202 - Posted: 7 Nov 2012, 18:23:26 UTC

One of my hosts has about 1000 ghosts, the other, maybe a few hundred.

A question: since each of my machines has 2 GTX 460s running 2 threads each, does that count as 4 GPU? Or two? (or, to put it another way, are the servers aware when a user runs more GPU threads than he/she has GPUs?)

Don't think the count / # of instances will make a difference. Paul Bowyer's Post in Panic Mode said he's being held to 100 for a 660ti w/ optimized apps, so would think he's running more than one at a time. This is just my guess on counts. Sorry for guessing, but there has been no hard info on the limits.
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.
ID: 1303202 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22222
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1303204 - Posted: 7 Nov 2012, 18:24:57 UTC

Each GTX460 counts as one GPU.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1303204 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14653
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1303212 - Posted: 7 Nov 2012, 18:32:49 UTC

My GTX 470 (single card) is pegged at 100 in progress, even though I'm running two at a time (count=0.5)
ID: 1303212 · Report as offensive
Keith White
Avatar

Send message
Joined: 29 May 99
Posts: 392
Credit: 13,035,233
RAC: 22
United States
Message 1303244 - Posted: 7 Nov 2012, 19:32:13 UTC

When I got that message, when downloads were still getting through for me, I was hovering around 300-340 units pending with 3 CPU and 1 GPU task running with the tasks split 90 units in total for the 3 CPU and the rest for the 1 GPU but something like 95% of those were shorties. I was able to get new units on roughly a 1 to 1 basis as they were getting done and reported.

Of course this was during the short time before the scheduler got funky for me again.
"Life is just nature's way of keeping meat fresh." - The Doctor
ID: 1303244 · Report as offensive

Message boards : Number crunching : "This Computer has Reached a Limit on Tasks in Progress"


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.