BOINC on a cluster


log in

Advanced search

Questions and Answers : Getting started : BOINC on a cluster

Author Message
Jim Kusznir
Send message
Joined: 20 Apr 11
Posts: 1
Credit: 607,659
RAC: 0
United States
Message 1104717 - Posted: 9 May 2011, 20:07:07 UTC

Hi all:

I administer several HPC clusters; unfortunately, its quite often that a couple of them are unloaded (completely). I'd like to put that to use by doing boinc compute projects, but only until a "real job" is scheduled. (One of the clusters hasn't had a "real job" in 3 months! And its 196 AMD 2.4Ghz cores!; the other cluster has 4x the cores, but sees use for a few days a month on average.).

The only way I know about handling this presently would be to create 48 seperate BOINC directories (one for each node) with seperate installs or hard links for much of the installs; configure each install, then launch the boinc process for each node, such that it will suspend if non-boinc usage exceeds a set point.

This is possible, but this is a lot of work to donate cpu cycles...If there was a way to NOT have to create 48 seperate directories (i.e., allow BOINC to share a directory), that would be helpful. Is there an "easy way" to do this?

Thanks!
--Jim

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24694
Credit: 522,659
RAC: 19
United States
Message 1104794 - Posted: 10 May 2011, 0:42:26 UTC - in response to Message 1104717.
Last modified: 10 May 2011, 0:43:18 UTC

Hi all:

I administer several HPC clusters; unfortunately, its quite often that a couple of them are unloaded (completely). I'd like to put that to use by doing boinc compute projects, but only until a "real job" is scheduled. (One of the clusters hasn't had a "real job" in 3 months! And its 196 AMD 2.4Ghz cores!; the other cluster has 4x the cores, but sees use for a few days a month on average.).

The only way I know about handling this presently would be to create 48 seperate BOINC directories (one for each node) with seperate installs or hard links for much of the installs; configure each install, then launch the boinc process for each node, such that it will suspend if non-boinc usage exceeds a set point.

This is possible, but this is a lot of work to donate cpu cycles...If there was a way to NOT have to create 48 seperate directories (i.e., allow BOINC to share a directory), that would be helpful. Is there an "easy way" to do this?

Thanks!
--Jim

I am not certain about directories, but you are not the first to do this on a cluster, and there are some settings specifically designed to deal with clusters. First is that you have to set the flag that allows multiple BOINC instances to run on a single machine. Second, you can set "report results immediately", and last [edit] that I know about, I may have missed one [/edit] there is a setting that will halt BOINC execution for a given node once the task is done so that it can be assigned to the next task (whatever that happens to be).
____________


BOINC WIKI

Questions and Answers : Getting started : BOINC on a cluster

Copyright © 2014 University of California