GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 31 · 32 · 33 · 34 · 35 · 36 · 37 · Next

AuthorMessage
Profile scocam
Avatar

Send message
Joined: 28 Feb 17
Posts: 27
Credit: 15,120,999
RAC: 0
United States
Message 1872615 - Posted: 12 Jun 2017, 19:15:34 UTC - in response to Message 1872609.  
Last modified: 12 Jun 2017, 19:17:17 UTC

+1

I typically drain my GPU cache in about 3 hours and another 3-4 hours to deplete my CPU cache.
ID: 1872615 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2767
Credit: 575,919,639
RAC: 910,091
Canada
Message 1872617 - Posted: 12 Jun 2017, 19:22:27 UTC - in response to Message 1872615.  

Psssttt, If your 5th card was a 750Ti and not another 1070, your cache time would have increased :D
BTW, any pictures of the beast?
ID: 1872617 · Report as offensive
Profile scocam
Avatar

Send message
Joined: 28 Feb 17
Posts: 27
Credit: 15,120,999
RAC: 0
United States
Message 1872621 - Posted: 12 Jun 2017, 19:39:11 UTC - in response to Message 1872617.  

Haha! Why are we whispering?!

Yeah, at the moment, I use the cards that I have around. I've been robbing my less efficient windows machine. Gradually, I'll likely move the other 1070 over as well. My Linux box has a 1600w psu but my dinky 900w UPS is having a tough time keeping up even now so I'll need to do some swapping of those at at some point as well.

This box is pretty ugly right now. It looked great prior to adding the fifth 1070. Now, my remaining 1070s that I'm moving over are FTWs hybrids (not the gaming variant) and cannot easily be integrated into the existing cooling loop due to the difference in water block size. So, for the time being, I've got the side panel off because I'm using a riser that is running the GPU to the outside of the box. I'm not overly concerned with the appearance but it's nothing to show-off right now. That said, I may take a pic of two for those who are interested in non-glamour shots. :-)


scocam
ID: 1872621 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1444
Credit: 171,405,792
RAC: 350,372
United States
Message 1872627 - Posted: 12 Jun 2017, 19:58:09 UTC - in response to Message 1872591.  
Last modified: 12 Jun 2017, 20:23:16 UTC


Haven't seen any issues here ...

Do you in fact have any AP tasks on board, Jim?

>250 across all 5 boxes in the last 24 hours ...
I suspect I would not have commented about not having an issues with APs if I had none. :)
ID: 1872627 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9900
Credit: 934,916,488
RAC: 1,492,155
United States
Message 1872642 - Posted: 12 Jun 2017, 21:56:56 UTC

Ok, thanks for the confirmation. I've PM'ed Mr. Kevvy to ask what's up.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1872642 · Report as offensive
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4707
Credit: 151,823,935
RAC: 239,837
Australia
Message 1872657 - Posted: 12 Jun 2017, 23:13:56 UTC - in response to Message 1872606.  
Last modified: 12 Jun 2017, 23:20:44 UTC

I'm not rescheduling. I'm cheating. I fake I have a GTX 1080 Tu. That is a Tuesday edition. I get 400 tasks per GP.U.
Since the the day I started that my daily score has levelled out to a flat line. My GPUs were task-limited during the week. The TUesday will still hurt me. I'm not planning to do more harm. With shorties I'll run out of cache, with Guppi I can manage -- the Tuesdays.
I'm sorry if I have offeded anyone with my settings.
I feel (And I think that many Linux users are going to feel) that something must be done to the 100 WU limit.
I will not release the one/two line fix to this problem. It is the Administrations work to do.
--
p33
p.s. I recommend a cache that is somehow bound to the daily output/RAC.


. . Hi Petri,

. . Nice trick I wish I knew how :)

. . As Brent said, maybe 12 hours of normal production would be a sensible maximum limit. I am sure that when that limit was set most contributors were struggling to get through 100 WUs in a day, now most do many times that.

. . Even my modest 1060s run of work on maintenance day within about 4 to 5 hours :(

Stephen

:(
ID: 1872657 · Report as offensive
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4707
Credit: 151,823,935
RAC: 239,837
Australia
Message 1872659 - Posted: 12 Jun 2017, 23:18:09 UTC - in response to Message 1872627.  


Haven't seen any issues here ...

Do you in fact have any AP tasks on board, Jim?

>250 across all 5 boxes in the last 24 hours ...
I suspect I would not have commented about not having an issues with APs if I had none. :)


. . Out of 4 boxes only one is getting APs, but it has had about 20.

Stephen

?
ID: 1872659 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9900
Credit: 934,916,488
RAC: 1,492,155
United States
Message 1872667 - Posted: 12 Jun 2017, 23:55:11 UTC - in response to Message 1872659.  

Do the flip-flip toggle in your Preferences for projects. That seems to get the servers unstuck and send me work. Not sure why all systems are getting so much AP work other than the servers are seeing a multi-month deficit of ANY AP work on all my crunchers and are trying to make up for it.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1872667 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1872787 - Posted: 14 Jun 2017, 1:43:20 UTC

I know I missed something. How do you tell if it has switched files around again?

Sorry, just more than a little ignorant about file naming conventions etc.

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1872787 · Report as offensive
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4707
Credit: 151,823,935
RAC: 239,837
Australia
Message 1872797 - Posted: 14 Jun 2017, 2:14:12 UTC - in response to Message 1872787.  

I know I missed something. How do you tell if it has switched files around again?

Sorry, just more than a little ignorant about file naming conventions etc.

Tom


. . Hi Tom,

. . If you are using BOINC manager open the advanced view, select the Tasks tab and click on the heading for the column Application. This will re-arrange the list of tasks by application making it easier to see what tasks are assigned to which app.

. . You can then see if there are any Arecibo tasks (they have the file name format of day(2)month(2)year(2) at the beginning of the file name such as 02ap08....... or 28au16.......) assigned to the CPU. If the re-scheduler has worked properly there should not be any, they should all be assigned to the GPU queue (SoG?). Greenbank or GBT work has the name format of blc(Breakthrough Listen {Capture I think})and then a Julian date which I can never translate though there is a utility that will translate the numbers for you, then a longer designator. They may be assigned to either GPU or CPU. If there were more Arecibo tasks in the CPU Q than GBT tasks in the GPU Q it should have moved them all so that there are only the desired tasks in each Q. If there were less than you will still have GBT work in your GPU Q. And it is all like alphabet soup :) aren't acronyms wonderful :)

Stephen

:)
ID: 1872797 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1875305 - Posted: 27 Jun 2017, 0:00:45 UTC

Did we ever end up with a windows-based script to automate this completely? Or was that a Linux only one.

Thanks,
Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1875305 · Report as offensive
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4707
Credit: 151,823,935
RAC: 239,837
Australia
Message 1875307 - Posted: 27 Jun 2017, 0:26:42 UTC - in response to Message 1875305.  

..
. . Hi Tom,

. . The utilities here are the Windows versions. Try Jimbocous' QOpt. It is a front end to Mr Kevvy's rescheduler ....

Stephen

..
ID: 1875307 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9900
Credit: 934,916,488
RAC: 1,492,155
United States
Message 1875308 - Posted: 27 Jun 2017, 0:29:05 UTC - in response to Message 1875305.  

Not sure what you are asking. Do you mean automated running of the rescheduler? You can set a scheduled task in Windows. Sort of like a cron job in Linux. I just run it manually as needed.

Having said that I haven't run the rescheduler in a week because of the lack of any Arecibo shorties to move onto the gpus and BLCs over to the cpus. Not much point in automating the process when the task mix hasn't been accommodating.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1875308 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1875309 - Posted: 27 Jun 2017, 0:50:42 UTC - in response to Message 1875308.  

Not sure what you are asking. Do you mean automated running of the rescheduler? You can set a scheduled task in Windows. Sort of like a cron job in Linux. I just run it manually as needed.


I'm confused, I thought we had to shut down the tasks before we ran the rescheduler?

I can see how to run it as a scheduled task from windows. I missed the command line to disable the Y/N question or else I have to use a old batch file trick for that.

I am not sure how to shut down Boinc from the command line and then re-start it? Lets see where did that documentation go... OMG its only on the website which is about to perform its weakly (sic) vanishing act...

Hmmmmm......

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1875309 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9900
Credit: 934,916,488
RAC: 1,492,155
United States
Message 1875311 - Posted: 27 Jun 2017, 1:18:15 UTC

You would have to run the program with a batch file if you wanted to run it naked so that it would exit BOINC and restart it after the rescheduling. Or run Jimbocous QOpt front-end to Mr. Kevvy's rescheduler which automates the stopping and restarting of BOINC automatically if you use the -u and -l modifiers. I use Qopt version 1.02k.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1875311 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1875315 - Posted: 27 Jun 2017, 1:55:46 UTC

I got to the point where I have run it from the command line. I am getting the following error: "Error: could not determine CPU version_num from client state. Nothing changed."

I am assuming I need to look in the client_state.xml file. For a "version_num." Can't find "version_num" in the client_state file. Now this particular box is running Lunatics Beta6 with the later r3584 patched in manually into the app_info.xml file.

Does that make any differences?

Thanks,

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1875315 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9900
Credit: 934,916,488
RAC: 1,492,155
United States
Message 1875328 - Posted: 27 Jun 2017, 3:35:57 UTC - in response to Message 1875315.  

No, that is just one of the common messages when the rescheduler has nothing to do. No task in the client_state file meet the requirements necessary to move tasks. I haven't had the rescheduler do anything in a week because of nothing but Arecibo VLARs being sent by the scheduler. You must have a type of task on the CPU that can be run on Nvidia cards in your case. Arecibo VLARs are not allowed on Nvidia. There is nothing wrong with your client_state file.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1875328 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1881137 - Posted: 30 Jul 2017, 7:59:53 UTC - in response to Message 1803840.  
Last modified: 30 Jul 2017, 8:00:39 UTC

Great work!!!
Looking forward to see who finds it helpful :-D
Also, if anyone tries to integrate both scripts with Automated Tasks, please let others know how you did it...and how often/day it runs for your system.
Cheers,
RobG ;-}


Rob,
I just downloaded and tried out the windows .cmd file on a stock Seti setup.

It was "unable to find" the client and then reported the *.xml files were not equal.

Apparently it "crashed soft" so I didn't lose anything. When I re-ran the command it still didn't find the client.

So restarted the boinc manager and everything started right up.

I am also confused about the documentation saying that this command will only work for a Lunatics distro?

Help :) And thank you.

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1881137 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11659
Credit: 174,392,188
RAC: 118,060
Australia
Message 1881143 - Posted: 30 Jul 2017, 8:14:33 UTC - in response to Message 1881137.  
Last modified: 30 Jul 2017, 8:15:59 UTC

I am also confused about the documentation saying that this command will only work for a Lunatics distro?

It will only work on a system that had it's applications installed using the Lunatics Installer.

I just downloaded and tried out the windows .cmd file on a stock Seti setup.

So, naturally, it won't work.
Grant
Darwin NT
ID: 1881143 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3573
Credit: 212,876,372
RAC: 505,630
United States
Message 1881144 - Posted: 30 Jul 2017, 8:24:09 UTC - in response to Message 1881143.  

I am also confused about the documentation saying that this command will only work for a Lunatics distro?

It will only work on a system that had it's applications installed using the Lunatics Installer.

I just downloaded and tried out the windows .cmd file on a stock Seti setup.

So, naturally, it won't work.


So the problem is a lack of an app_info.xml file?

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
"If its Tourist Season why can't we shoot them?" (another bumper sticker)
ID: 1881144 · Report as offensive
Previous · 1 . . . 31 · 32 · 33 · 34 · 35 · 36 · 37 · Next

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU


 
©2019 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.