BOINC on a cluster

Questions and Answers : Getting started : BOINC on a cluster

To post messages, you must log in.

AuthorMessage
Jim Kusznir

Send message
Joined: 20 Apr 11
Posts: 1
Credit: 607,659
RAC: 0
United States
Message 1104717 - Posted: 9 May 2011, 20:07:07 UTC

Hi all:

I administer several HPC clusters; unfortunately, its quite often that a couple of them are unloaded (completely). I'd like to put that to use by doing boinc compute projects, but only until a "real job" is scheduled. (One of the clusters hasn't had a "real job" in 3 months! And its 196 AMD 2.4Ghz cores!; the other cluster has 4x the cores, but sees use for a few days a month on average.).

The only way I know about handling this presently would be to create 48 seperate BOINC directories (one for each node) with seperate installs or hard links for much of the installs; configure each install, then launch the boinc process for each node, such that it will suspend if non-boinc usage exceeds a set point.

This is possible, but this is a lot of work to donate cpu cycles...If there was a way to NOT have to create 48 seperate directories (i.e., allow BOINC to share a directory), that would be helpful. Is there an "easy way" to do this?

Thanks!
--Jim

ID: 1104717 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 754,585
RAC: 65
United States
Message 1104794 - Posted: 10 May 2011, 0:42:26 UTC - in response to Message 1104717.  
Last modified: 10 May 2011, 0:43:18 UTC

Hi all:

I administer several HPC clusters; unfortunately, its quite often that a couple of them are unloaded (completely). I'd like to put that to use by doing boinc compute projects, but only until a "real job" is scheduled. (One of the clusters hasn't had a "real job" in 3 months! And its 196 AMD 2.4Ghz cores!; the other cluster has 4x the cores, but sees use for a few days a month on average.).

The only way I know about handling this presently would be to create 48 seperate BOINC directories (one for each node) with seperate installs or hard links for much of the installs; configure each install, then launch the boinc process for each node, such that it will suspend if non-boinc usage exceeds a set point.

This is possible, but this is a lot of work to donate cpu cycles...If there was a way to NOT have to create 48 seperate directories (i.e., allow BOINC to share a directory), that would be helpful. Is there an "easy way" to do this?

Thanks!
--Jim

I am not certain about directories, but you are not the first to do this on a cluster, and there are some settings specifically designed to deal with clusters. First is that you have to set the flag that allows multiple BOINC instances to run on a single machine. Second, you can set "report results immediately", and last [edit] that I know about, I may have missed one [/edit] there is a setting that will halt BOINC execution for a given node once the task is done so that it can be assigned to the next task (whatever that happens to be).


BOINC WIKI

ID: 1104794 · Report as offensive

Questions and Answers : Getting started : BOINC on a cluster


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.