GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 28 · 29 · 30 · 31 · 32 · 33 · 34 . . . 37 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1856132 - Posted: 17 Mar 2017, 22:20:25 UTC - in response to Message 1856126.  
Last modified: 17 Mar 2017, 22:22:58 UTC

Still running Cuda50 here, 3 GPUs per PC, but when you have dual hexacore Xeons, with 24 threads you can keep all GPUs fully working and still crunch 11-18 CPU tasks pretty comfortably. Given the level of Guppis we're anticipating in future, it seems like a good compromise unless or until something better (Cuda80, Lunatics installer updated for SoG?) comes along.

?
I'm happy with the output from my i7 GTX 1070s running the SoG application from the Lunatics Beta6 installer till a better Windows application comes along.
Rescheduling would give a higher RAC, but it's doing pretty well without that effort.
Grant
Darwin NT
ID: 1856132 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1856162 - Posted: 18 Mar 2017, 0:52:57 UTC - in response to Message 1856126.  

. . But I must admit, I always run out of GPU work well before running out of CPU work.

Stephen

:)

Still running Cuda50 here, 3 GPUs per PC, but when you have dual hexacore Xeons, with 24 threads you can keep all GPUs fully working and still crunch 11-18 CPU tasks pretty comfortably. Given the level of Guppis we're anticipating in future, it seems like a good compromise unless or until something better (Cuda80, Lunatics installer updated for SoG?) comes along.


. . Well on La-Bamba, no CPU crunching (only 2 weak CPU cores to drive the 2 x GTX1060 GPUS). On Mi-Burrito one mediocre CPU core crunching, but even running CUDA50 or SoG the GPU always emptied it's queue first by a long way, with CUDA80 and SSSE3.0 the runtimes on the CPU have improved hugely but still cannot empty a full cache in less than a week, the GPU empties a full cache in 5 to 7 hours. And on the pride of the fleet, my i5-6400, with 3 respectable CPU cores crunching and one to drive the GTX950, the GPU empties its queue in about 2/3 to 3/4 of the time it takes the CPU. Ironically, the i5 system is now the weakest link in the armada, I wonder how well it might do with a GTX1060 in it :)

. . But as you say, with the projected deluge of guppy tasks lots and lots of CPU cores might be the way to go.

Stephen

:)
ID: 1856162 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1856679 - Posted: 19 Mar 2017, 23:17:30 UTC

. . @ Kevin

. . I hate to be the needy dude but sadly I am. I have run the rescheduler on my linux machine and it just says "to function there must be at least one CPU task on the machine - exiting" or words to that effect. There are 24 CPU tasks queued and most of them are Arecibo tasks. What can I do to get it to see the queue accurately? I have placed the executable in the BOINC folder and it runs up to that point..

. . Linux and I are not good friends.

Stephen

:(
ID: 1856679 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1856711 - Posted: 20 Mar 2017, 1:50:43 UTC
Last modified: 20 Mar 2017, 2:18:14 UTC

[Edit]

. . Forget this message, it does not exist :)
ID: 1856711 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1856716 - Posted: 20 Mar 2017, 2:00:15 UTC - in response to Message 1856711.  

. . Hi Kevin,

. . I tried again and this time I captured the error.

stephen@Mi-Burrito:~/BOINC$ ./GUPPIRescheduler
Mr. Kevvy's GUPPI Rescheduler v0.51 - (c)2016 Kevin Dorner

Reading configuration files...
Error: There must be at least one CPU workunit in sched_request_setiathome.berkeley.edu.xml
for this program to function. Program will terminate; no changes made.


. . I counted and there are 18 Arecibo tasks that can be moved as well as 18 Guppis in the GPU queue. An ideal setup. I also had a look at that .xml file and I cannot see any tasks listed in there :(

. . Hopefully we can get past this issue. Please?

Stephen

You are running this in the same path as the client_state file, right?
ID: 1856716 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1856720 - Posted: 20 Mar 2017, 2:26:07 UTC - in response to Message 1856716.  


You are running this in the same path as the client_state file, right?


. . Hi Jimbo,

. . This time I would have preferred if you were not so quick to reply :)

. . I was in the process of removing the text of that message but you were too quick for me. I forgot for the moment that on this rig BOINC is the repository version that lives in /var/lib/boinc-client. I had also installed the SETI version that lives in /home/Stephen/BOINC, which is where I have been working on the other Linux rig. So when I copied the rescheduler guess where I put it ... :(

. . I have moved it to the correct folder now and it works AOK. Aint Linux grand :)

. . BTW, I can shut down the BOINC client from the manager with no troubles, but I don't suppose you know how to start it again from the manager or anything else in Linux. I have had to reboot the computer to get BOINC boincing again.

Stephen

<blush>
ID: 1856720 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1856730 - Posted: 20 Mar 2017, 2:59:08 UTC - in response to Message 1856720.  


You are running this in the same path as the client_state file, right?


. . Hi Jimbo,

. . This time I would have preferred if you were not so quick to reply :)

Service with a smile :)

. . BTW, I can shut down the BOINC client from the manager with no troubles, but I don't suppose you know how to start it again from the manager or anything else in Linux. I have had to reboot the computer to get BOINC boincing again.

Stephen

<blush>

Should be something along the lines of this:

boinc.exe --detach_console
ID: 1856730 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857031 - Posted: 22 Mar 2017, 20:48:00 UTC - in response to Message 1856730.  


You are running this in the same path as the client_state file, right?


. . Hi Jimbo,

. . This time I would have preferred if you were not so quick to reply :)

Service with a smile :)

. . BTW, I can shut down the BOINC client from the manager with no troubles, but I don't suppose you know how to start it again from the manager or anything else in Linux. I have had to reboot the computer to get BOINC boincing again.

Stephen

<blush>

Should be something along the lines of this:

boinc.exe --detach_console


. . Nope that didn't work either.

Stephen

:(
ID: 1857031 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857124 - Posted: 23 Mar 2017, 0:22:08 UTC

. . @ Mr Kevvy

. . On the subject of not working. The rescheduler will not work for me on my Linux rig. Even though there are a dozen or more Arecibo non-VLAR tasks in the CPU queue it reports there aren't any and exits. Is it possible permissions do not allow it to process the file? Or maybe it is because I am running CUDA80? Though I believe it is OK for you and you are also running CUDA80 is that correct?

Stephen

<befuddled>
ID: 1857124 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857543 - Posted: 24 Mar 2017, 23:44:16 UTC - in response to Message 1855881.  


Anyone who want to tackle a task like that, I'll pass on the code ...


. . I would be keen to tackle that if I had any idea of what I was doing ...lol. But being very new to, and un-knowledgable of, Linux I doubt if I could make it work. And I wouldn't want to screw up in a big way.

. . I guess I can try to run the rescheduler raw and see how I go. :) Thanks.

Stephen

:)

I'd be glad to drop out a note detailing the task flow of QOpt, if that would help ...


. . Hi Jimbo,

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. So if I may, can I impose on you for that code and some form of task flow chart?

Stephen

?
ID: 1857543 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1857559 - Posted: 25 Mar 2017, 0:31:37 UTC - in response to Message 1857543.  
Last modified: 25 Mar 2017, 0:39:22 UTC

. . Hi Jimbo,

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. So if I may, can I impose on you for that code and some form of task flow chart?

Stephen

?

You got it, full code should be in your inbox. Task flow description to follow.
ID: 1857559 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1857573 - Posted: 25 Mar 2017, 1:46:26 UTC - in response to Message 1857543.  
Last modified: 25 Mar 2017, 2:01:31 UTC

I'd be glad to drop out a note detailing the task flow of QOpt, if that would help ...


. . some form of task flow chart?

Stephen

?

In your inbox also, and I'll be glad to pass it on to anyone else interested. Just didn't want to fill up a bunch of inboxes ...
Later, Jim ...
ID: 1857573 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857673 - Posted: 25 Mar 2017, 19:01:03 UTC - in response to Message 1857559.  

. . Hi Jimbo,

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. So if I may, can I impose on you for that code and some form of task flow chart?

Stephen

?

You got it, full code should be in your inbox. Task flow description to follow.


. . Thanks for that.

Stephen

.
ID: 1857673 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857723 - Posted: 26 Mar 2017, 19:46:12 UTC - in response to Message 1857573.  

I'd be glad to drop out a note detailing the task flow of QOpt, if that would help ...


. . some form of task flow chart?

Stephen

?

In your inbox also, and I'll be glad to pass it on to anyone else interested. Just didn't want to fill up a bunch of inboxes ...
Later, Jim ...


. . Ok got them now, thanks Jim.

. . The web servers took an awkward time to take the day off ... :)

Stephen

:)

P.S. That is a lot longer than I expected ... this could be a major headache translating to Linux, there are a lot of instructions to find equivalents for. Oh well I need to try ....

Stephen

?
ID: 1857723 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1857729 - Posted: 26 Mar 2017, 20:53:59 UTC - in response to Message 1857723.  

That is a lot longer than I expected ... this could be a major headache translating to Linux, there are a lot of instructions to find equivalents for. Oh well I need to try ....

Stephen

?

I put a lot of stuff in there that's not strictly needed, so I'm sure you can pare it down a bit if you wish.
Happy coding. I'll be interested in seeing what you come up with!
ID: 1857729 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1857730 - Posted: 26 Mar 2017, 20:55:47 UTC - in response to Message 1857673.  

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. .

If you can figure out how to "run it raw" you'll have the code written for that segment, yeah?
ID: 1857730 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857805 - Posted: 27 Mar 2017, 2:58:29 UTC - in response to Message 1857729.  

That is a lot longer than I expected ... this could be a major headache translating to Linux, there are a lot of instructions to find equivalents for. Oh well I need to try ....

Stephen

?

I put a lot of stuff in there that's not strictly needed, so I'm sure you can pare it down a bit if you wish.
Happy coding. I'll be interested in seeing what you come up with!


. . One of the first things I will need to work out is how to implement the routines in Linux that identify the versions of apps running and their installed locations. Because in Linux there have to be the correct permissions set that part may prove tricky. I can only promise one thing at this point and that is it won't be a quick result.

:(
ID: 1857805 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857806 - Posted: 27 Mar 2017, 3:00:03 UTC - in response to Message 1857730.  

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. .

If you can figure out how to "run it raw" you'll have the code written for that segment, yeah?


. .I have been doing that manually from command line. I have not yet tried creating any scripts or shell files.

<shiver>
ID: 1857806 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1668
Credit: 623,086,772
RAC: 156
Finland
Message 1857938 - Posted: 27 Mar 2017, 16:26:58 UTC - in response to Message 1857806.  

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. .

If you can figure out how to "run it raw" you'll have the code written for that segment, yeah?


. .I have been doing that manually from command line. I have not yet tried creating any scripts or shell files.

<shiver>


You can run shell scripts and commands from C.

Just google 'c run shell command' and you'll get a lot of information.
You do not have to reinvent the wheel. At least to try something that you know is working. Afterwards you can refine (to 'HiFi') you code.

Petri
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1857938 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1859490 - Posted: 4 Apr 2017, 14:06:56 UTC - in response to Message 1857938.  

. . Since I cannot get any joy running the re-scheduler raw I think I may have to have a crack at migrating your front end. .

If you can figure out how to "run it raw" you'll have the code written for that segment, yeah?


. .I have been doing that manually from command line. I have not yet tried creating any scripts or shell files.

<shiver>


You can run shell scripts and commands from C.

Just google 'c run shell command' and you'll get a lot of information.
You do not have to reinvent the wheel. At least to try something that you know is working. Afterwards you can refine (to 'HiFi') you code.

Petri


. . Hi Petri,

. . I am trying hard to learn how to modify this script to a Linux shell, but I cannot understand what I am reading when I look for information about certain instructions. I have found what appears to be a workable replacement for the pause command using read -rsp, and sleep 5 s instead of wait 5. But there is no equivalent for the simple GOTO command and I cannot find any source that offers a coherent alternative.

. . If you feel that this thread is unsuitable for this discussion can I pm you about this?

Stephen

??
ID: 1859490 · Report as offensive
Previous · 1 . . . 28 · 29 · 30 · 31 · 32 · 33 · 34 . . . 37 · Next

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.