Clustering and Remote Management

Questions and Answers : Windows : Clustering and Remote Management
Message board moderation

To post messages, you must log in.

AuthorMessage
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 137302 - Posted: 16 Jul 2005, 18:49:54 UTC

Hey guys.

I apologize if this is a redundant question that has already been answered.
I have multiple systems in my area at school on the same LAN. Six of the systems have the exact same hardware specifications, about five of the other systems have different hardware specs. Is there a way that I can set these systems up in a "cluster" that the systems will work on a single work unit and communicate over the LAN to each other instead of each system working on an individual workunit? Wouldn't this be more efficient?

Also, is there a way I can setup remote management of the BOINC client. I currently use Remote Desktop and UltraVNC to manage the BOINC client and the system as a whole. I'd like to be able to manage just the BOINC client on the machines remotely if possible.

Thanks for your help!

Tavis
ID: 137302 · Report as offensive
Profile Saenger
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2452
Credit: 33,281
RAC: 0
Germany
Message 137311 - Posted: 16 Jul 2005, 19:04:43 UTC

Hello Tavis,

as even on hyperthreaded PCs, with only 2 virtual processors, it's considered as more efficient to crunch two WUs on each virtual CPU instead of 1 on both, I'd presume that it's even more so on real CPUs.

And as for the remote control of networks:
It's a build-in feature of boinc.
I've no need for it (and therefore no experience;), but perhaps the Wiki (link in my sig) and this thread can help you further.

And I've heard, that BoincView from the add-on page is good in the control area.

Gruesse vom Saenger

For questions about Boinc look in the BOINC-Wiki
ID: 137311 · Report as offensive
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 137571 - Posted: 17 Jul 2005, 3:32:54 UTC - in response to Message 137311.  

Hello Tavis,

as even on hyperthreaded PCs, with only 2 virtual processors, it's considered as more efficient to crunch two WUs on each virtual CPU instead of 1 on both, I'd presume that it's even more so on real CPUs.

And as for the remote control of networks:
It's a build-in feature of boinc.
I've no need for it (and therefore no experience;), but perhaps the Wiki (link in my sig) and this thread can help you further.

And I've heard, that BoincView from the add-on page is good in the control area.



Are there any guides to clustering just to see how well (or badly) clustering would work?

Thanks,

Tavis
ID: 137571 · Report as offensive
Profile USMC___KopfJäger

Send message
Joined: 17 May 03
Posts: 1
Credit: 110,409
RAC: 0
United States
Message 138075 - Posted: 18 Jul 2005, 3:05:16 UTC - in response to Message 137571.  

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger
ID: 138075 · Report as offensive
Profile Terry Ritchie

Send message
Joined: 14 May 99
Posts: 33
Credit: 1,626,729
RAC: 0
United States
Message 138144 - Posted: 18 Jul 2005, 6:25:39 UTC

A group of my students built a beowulf cluster about 3 years ago using 29 computers. They ran Linux and used Persistance of Vision (POV) raytracing rendering software to prove the technology. It worked slick.

The problem they ran into was that software must be specifically developed to utilize a cluster. You can't simply take any piece of software, load it into a cluster and expect it to work.

That was then - I hear that there is a new version of Linux out called Knoppix that is cluster ready. Furthermore, from what I've read, it will split work up between computers no matter what the software is. You might look into this.

A few drawbacks we found using clusters: Efficiency starting falling off dramatically after 20 computers. We found the most effective setup at 10 computers (through a 100Mbit switch). Many others that have created clusters report the same findings - less efficient the more computers added.

Also, I'm not sure a cluster would make processing work units any more effective. 10 computers each processing a work unit every 10 minutes or 10 computers together processing 1 work unit each minute for 10 mnutes. The result is the same. My students used the cluster to speed the process of raytracing an image to the screen. A single computer took 20 minutes to process each frame of their animation where their cluster could do each frame in 60 to 75 seconds. The end result being an animation finished in much less time.

Looks like a great project nonetheless for students to look into and and see if it can be done. My team called theirs "APOLLO" Accumulative Processing Over a Linked Linux Operation. I have a copy of their work on CD if you would like me to send you a copy.

-Terry

<img src="http://boinc.mundayweb.com/one/stats.php?userID=2263&amp;prj=1&amp;trans=off"><img src="http://seti.mundayweb.com/stats.php?userID=937&amp;trans=off">
ID: 138144 · Report as offensive
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 138231 - Posted: 18 Jul 2005, 13:27:03 UTC - in response to Message 138075.  

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger


Hey again.
I made the config files so I can use BOINCView. I tested this on one of my machines that's running BOINC. I placed the two cfg's in the c:\Program Files\BOINC folder and put the appropriate text into the cfg's then restarted BOINC. When I went into BOINCView to add a new location and hit apply, it says "There seems to be no BOINC client behind port 1043. Use port anyway?" If I hit OK and try to look at the client, I get no results or text from the location.
ID: 138231 · Report as offensive
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 138232 - Posted: 18 Jul 2005, 13:30:07 UTC - in response to Message 138144.  

A group of my students built a beowulf cluster about 3 years ago using 29 computers. They ran Linux and used Persistance of Vision (POV) raytracing rendering software to prove the technology. It worked slick.

The problem they ran into was that software must be specifically developed to utilize a cluster. You can't simply take any piece of software, load it into a cluster and expect it to work.

That was then - I hear that there is a new version of Linux out called Knoppix that is cluster ready. Furthermore, from what I've read, it will split work up between computers no matter what the software is. You might look into this.

A few drawbacks we found using clusters: Efficiency starting falling off dramatically after 20 computers. We found the most effective setup at 10 computers (through a 100Mbit switch). Many others that have created clusters report the same findings - less efficient the more computers added.

Also, I'm not sure a cluster would make processing work units any more effective. 10 computers each processing a work unit every 10 minutes or 10 computers together processing 1 work unit each minute for 10 mnutes. The result is the same. My students used the cluster to speed the process of raytracing an image to the screen. A single computer took 20 minutes to process each frame of their animation where their cluster could do each frame in 60 to 75 seconds. The end result being an animation finished in much less time.

Looks like a great project nonetheless for students to look into and and see if it can be done. My team called theirs "APOLLO" Accumulative Processing Over a Linked Linux Operation. I have a copy of their work on CD if you would like me to send you a copy.

-Terry


Very interesting! I'd like to check it out. Is there a way you could host and I could download an ISO of the CD?

Tavis
ID: 138232 · Report as offensive
Profile Terry Ritchie

Send message
Joined: 14 May 99
Posts: 33
Credit: 1,626,729
RAC: 0
United States
Message 138561 - Posted: 18 Jul 2005, 22:03:05 UTC - in response to Message 138232.  

A group of my students built a beowulf cluster about 3 years ago using 29 computers. They ran Linux and used Persistance of Vision (POV) raytracing rendering software to prove the technology. It worked slick.

The problem they ran into was that software must be specifically developed to utilize a cluster. You can't simply take any piece of software, load it into a cluster and expect it to work.

That was then - I hear that there is a new version of Linux out called Knoppix that is cluster ready. Furthermore, from what I've read, it will split work up between computers no matter what the software is. You might look into this.

A few drawbacks we found using clusters: Efficiency starting falling off dramatically after 20 computers. We found the most effective setup at 10 computers (through a 100Mbit switch). Many others that have created clusters report the same findings - less efficient the more computers added.

Also, I'm not sure a cluster would make processing work units any more effective. 10 computers each processing a work unit every 10 minutes or 10 computers together processing 1 work unit each minute for 10 mnutes. The result is the same. My students used the cluster to speed the process of raytracing an image to the screen. A single computer took 20 minutes to process each frame of their animation where their cluster could do each frame in 60 to 75 seconds. The end result being an animation finished in much less time.

Looks like a great project nonetheless for students to look into and and see if it can be done. My team called theirs "APOLLO" Accumulative Processing Over a Linked Linux Operation. I have a copy of their work on CD if you would like me to send you a copy.

-Terry


Very interesting! I'd like to check it out. Is there a way you could host and I could download an ISO of the CD?

Tavis


Our school's proxy blocks all FTP access. Send your mailing address to me at ritch-t (at) vscc.k12.oh.us and I'll send you a copy of the CD.

If you have access to a server I could FTP to from home I can upload the ISO if you like as well.

Either way, let me know.

-Terry
<img src="http://boinc.mundayweb.com/one/stats.php?userID=2263&amp;prj=1&amp;trans=off"><img src="http://seti.mundayweb.com/stats.php?userID=937&amp;trans=off">
ID: 138561 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 138778 - Posted: 19 Jul 2005, 2:55:33 UTC - in response to Message 138231.  

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger


Hey again.
I made the config files so I can use BOINCView. I tested this on one of my machines that's running BOINC. I placed the two cfg's in the c:Program FilesBOINC folder and put the appropriate text into the cfg's then restarted BOINC. When I went into BOINCView to add a new location and hit apply, it says "There seems to be no BOINC client behind port 1043. Use port anyway?" If I hit OK and try to look at the client, I get no results or text from the location.

Once the cfg files have been created (on each target for remote control) that instance of BOINC must be restarted to read the cfg files.


BOINC WIKI
ID: 138778 · Report as offensive
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 138982 - Posted: 19 Jul 2005, 11:56:02 UTC - in response to Message 138778.  
Last modified: 19 Jul 2005, 11:56:30 UTC

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger


Hey again.
I made the config files so I can use BOINCView. I tested this on one of my machines that's running BOINC. I placed the two cfg's in the c:Program FilesBOINC folder and put the appropriate text into the cfg's then restarted BOINC. When I went into BOINCView to add a new location and hit apply, it says "There seems to be no BOINC client behind port 1043. Use port anyway?" If I hit OK and try to look at the client, I get no results or text from the location.

Once the cfg files have been created (on each target for remote control) that instance of BOINC must be restarted to read the cfg files.


John - That's what I did and I still recieve the message from BOINCView.

Terry - OK, I have a private FTP already setup. I would think that would be better than hassling with email and an attachment size limit (even if you can hold 2GB of email). I will get back with you after classes today. Thanks!

ID: 138982 · Report as offensive
TC10284
Volunteer tester

Send message
Joined: 12 Jun 05
Posts: 6
Credit: 141,660
RAC: 0
United States
Message 139018 - Posted: 19 Jul 2005, 13:55:10 UTC - in response to Message 138982.  

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger


Hey again.
I made the config files so I can use BOINCView. I tested this on one of my machines that's running BOINC. I placed the two cfg's in the c:Program FilesBOINC folder and put the appropriate text into the cfg's then restarted BOINC. When I went into BOINCView to add a new location and hit apply, it says "There seems to be no BOINC client behind port 1043. Use port anyway?" If I hit OK and try to look at the client, I get no results or text from the location.

Once the cfg files have been created (on each target for remote control) that instance of BOINC must be restarted to read the cfg files.


John - That's what I did and I still recieve the message from BOINCView.

Terry - OK, I have a private FTP already setup. I would think that would be better than hassling with email and an attachment size limit (even if you can hold 2GB of email). I will get back with you after classes today. Thanks!


John - Actually, I went to their homepage and noticed that I needed a switch (-allow_remote_gui_rpc) when running the boinc.exe file. It's working great now! Thanks!
ID: 139018 · Report as offensive
Profile Terry Ritchie

Send message
Joined: 14 May 99
Posts: 33
Credit: 1,626,729
RAC: 0
United States
Message 139168 - Posted: 19 Jul 2005, 19:37:58 UTC - in response to Message 138982.  

Hello Tavis,

I am not sure about clusters but I use BonicView and it does the trick. It takes a couple extra files being placed in the BONIC folder to get it to work with RPC calls but it is very convienient.

The two files you will need to add to your BONIC folder are:


remote_hosts.cfg place the hostnames of the computers you would like to be able to connect to the BONIC client. 1 per line

gui_rpc_auth.cfg place a password to connect to the BONIC client in this one.

after that you should be good to go.

Semper Fi,
-USMC__KopfJäger


Hey again.
I made the config files so I can use BOINCView. I tested this on one of my machines that's running BOINC. I placed the two cfg's in the c:Program FilesBOINC folder and put the appropriate text into the cfg's then restarted BOINC. When I went into BOINCView to add a new location and hit apply, it says "There seems to be no BOINC client behind port 1043. Use port anyway?" If I hit OK and try to look at the client, I get no results or text from the location.

Once the cfg files have been created (on each target for remote control) that instance of BOINC must be restarted to read the cfg files.


John - That's what I did and I still recieve the message from BOINCView.

Terry - OK, I have a private FTP already setup. I would think that would be better than hassling with email and an attachment size limit (even if you can hold 2GB of email). I will get back with you after classes today. Thanks!


I'll look for your email shortly then.

-Terry

<img src="http://boinc.mundayweb.com/one/stats.php?userID=2263&amp;prj=1&amp;trans=off"><img src="http://seti.mundayweb.com/stats.php?userID=937&amp;trans=off">
ID: 139168 · Report as offensive

Questions and Answers : Windows : Clustering and Remote Management


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.