WU In Progress Limit?

Message boards : Number crunching : WU In Progress Limit?
Message board moderation

To post messages, you must log in.

AuthorMessage
The Jedi Alliance - Ranger
Avatar

Send message
Joined: 27 Dec 00
Posts: 72
Credit: 60,982,863
RAC: 0
United States
Message 1662304 - Posted: 7 Apr 2015, 13:36:55 UTC

One or two of my computers, 7431929 for example, has been reporting 230 to 250 WK per day, mostly Cuda WU. I have noticed that the total number of WK In Progress never exceeds 200. I have the Minimum work buffer set to 10 days and the Max additional work buffer set to 10 days. On the Disk and Memory Usage tab I have it set to use at most 100Gb (actual is 180Mb), Leave 0.5Gb (actual is 150Gb), use at most 25% (actual is 0.04%). I would think these settings would allow more WU to be stored on the computer than 200 so that during the Weekly Outage and Initial Catch Up it will not be starved for WU. Does anyone know why there is such a low limit or how to overcome it?
ID: 1662304 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1662309 - Posted: 7 Apr 2015, 13:44:40 UTC - in response to Message 1662304.  

100 work units for your CPU and 100 for each GPU that you have. Total for your machines is 200.

If you had 2 GPUs and the CPU then it would be 300..

3 GPUs and cpu then 400....

You get the idea.
ID: 1662309 · Report as offensive
Profile S@NL Etienne Dokkum
Volunteer tester
Avatar

Send message
Joined: 11 Jun 99
Posts: 212
Credit: 43,822,095
RAC: 0
Netherlands
Message 1662311 - Posted: 7 Apr 2015, 13:48:17 UTC

First off : there is no way to overcome this. This limit was set by S@H a long time ago (100 tasks for the CPU and an additional 100 per GPU in your rig)

The theory behind this is the heavy duty crunchers were pounding the servers so hard they would collapse.

So you're not alone in this,everyone faces the same limits. The only workaround there is is to build a virtual machine, but this would only give you 100 more GPU tasks(and 100 more CPU of course, but that won't be a problem for anyone).

I hope I answered your question...
ID: 1662311 · Report as offensive
The Jedi Alliance - Ranger
Avatar

Send message
Joined: 27 Dec 00
Posts: 72
Credit: 60,982,863
RAC: 0
United States
Message 1662320 - Posted: 7 Apr 2015, 14:06:00 UTC - in response to Message 1662311.  

Thank you Etienne and Zalster for the explanation. Perhaps this limit was established in a time when processing power was much less capable than it is today, even for the servers which have been updated a few times since BOINC rolled out. I think I may look into building a VM or two.
ID: 1662320 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1662338 - Posted: 7 Apr 2015, 15:16:50 UTC - in response to Message 1662320.  

Try to run few BOINc client instances instead. It will be cheaper from overhead point of vew than full-scale VM.
ID: 1662338 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1662365 - Posted: 7 Apr 2015, 22:35:23 UTC - in response to Message 1662320.  

Thank you Etienne and Zalster for the explanation. Perhaps this limit was established in a time when processing power was much less capable than it is today, even for the servers which have been updated a few times since BOINC rolled out. I think I may look into building a VM or two.


Actually it is put in place to keep the servers from crashing and burning.

When the limits were not in place, several of the servers were crashing because their hard drives were full.

ID: 1662365 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1662389 - Posted: 8 Apr 2015, 0:13:46 UTC - in response to Message 1662309.  

100 work units for your CPU and 100 for each GPU that you have. Total for your machines is 200.

If you had 2 GPUs and the CPU then it would be 300..

3 GPUs and cpu then 400....

You get the idea.

Which is, in a way, annoying... I have two machines with 20 cores each (and I've seen some similar with HyperThreading(TM) turned on so they run 40 WUs at once) and they are by no means the biggest CPU-count machines around. If I could work out how to get S@H running on my Xeon Phi co-processor... It has 60 cores and 240 threads, so it could never be filled under the current regime (but realistically it has only 4-5 GB of memory for all those threads to share). The next-generation Xeon Phi will actually have the processor as the onboard CPU rather than a co-processor -- which makes it look a much better prospect for BOINC/S@H. I hope I'm not breaking any NDAs when I say that it will have between 60 and 72 cores, again each with four hardware threads, but this time it will have access to system memory (as well as 16 GB of fast on-board RAM) so running that many jobs will be feasible.
ID: 1662389 · Report as offensive

Message boards : Number crunching : WU In Progress Limit?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.