GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 24 · 25 · 26 · 27 · 28 · 29 · 30 . . . 37 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1827887 - Posted: 2 Nov 2016, 0:29:24 UTC - in response to Message 1827875.  

My BOINCTasks history file gets trimmed to 2 days automatically so I ended up with only 81 CPU tasks to average. Sample for GPU is larger at 275 tasks.

81 CPU Messier031 Tasks = 86.94 minutes average

275 GPU Messier031 Tasks = 10.14 minutes average



. . Ok, so how does that compare to other Green Bank tasks or Arecibo for that matter?

Stephen

.

I'm not going do the Arecibo analysis as it took all too long to do the Messier031 analysis. So, just some anecdotal comments. (In no way an expert in spreadsheets.)

Arecibo CPU tasks -normal 0.44 AR ~~ 2 hours to 2 hours ~10 minutes

Arecibo GPU tasks -normal 0.44 AR ~~ 6 - 8 minutes (two per card)
Arecibo GPU tasks >>0.44 - 2.5 AR ~~ 4 - 6 minutes (two per card)

And not really any difference in Green Bank GPU task length compared to similar Arecibo AR values if you ever get any non-VLAR Green Bank GPU tasks.

Doesn't make much difference the origins of the task (either telescope) as long as the AR values are similar.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1827887 · Report as offensive
Profile BilBg
Volunteer tester
Avatar

Send message
Joined: 27 May 07
Posts: 3720
Credit: 9,385,827
RAC: 0
Bulgaria
Message 1828030 - Posted: 2 Nov 2016, 22:06:48 UTC - in response to Message 1827835.  

My BOINCTasks history file gets trimmed to 2 days automatically ...

It is a matter of your Settings, my keeps 1 year:
(Currently:
history_long_CompName.cvs is 734 KB and have 3516 records
history_CompName.cvs is 25 KB and have 113 records
)



 
 


- ALF - "Find out what you don't do well ..... then don't do it!" :)
 
ID: 1828030 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1828049 - Posted: 2 Nov 2016, 23:50:52 UTC
Last modified: 2 Nov 2016, 23:51:30 UTC

Since we are off topic anyways, LOL, I noticed a program called BoincMonitor in my app folder - it records the results and keeps the stderr files.

EDIT: I'm running v1.66, haven't updated.
ID: 1828049 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1828068 - Posted: 3 Nov 2016, 1:17:47 UTC - in response to Message 1828030.  


It is a matter of your Settings, my keeps 1 year:
(Currently:
history_long_CompName.cvs is 734 KB and have 3516 records
history_CompName.cvs is 25 KB and have 113 records

How long does it take to load BOINCTasks with that many History records? I have mine trimmed down to 2 days because the default value caused it to load over many minutes. I debate whether even to enable the History logging because of how much impact it has on the responsiveness of BOINC and the Desktop. I occasionally find History useful but I could get along without it just as easily.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1828068 · Report as offensive
Profile BilBg
Volunteer tester
Avatar

Send message
Joined: 27 May 07
Posts: 3720
Credit: 9,385,827
RAC: 0
Bulgaria
Message 1828831 - Posted: 6 Nov 2016, 10:00:55 UTC - in response to Message 1828068.  


It is a matter of your Settings, my keeps 1 year:
(Currently:
history_long_CompName.cvs is 734 KB and have 3516 records
history_CompName.cvs is 25 KB and have 113 records

How long does it take to load BOINCTasks with that many History records?

~5 seconds.

"History records" in the tab are for 7 days (for me that is 100-200 tasks)
The other 360 days (3500 records) are only read if you click a button on the toolbar.
BoincTasks consumes ~1 minute CPU time per day (0.1% (1/1000) of a CPU core)


I have mine trimmed down to 2 days because the default value caused it to load over many minutes.

I don't know what is "the default value" and there are many values and checkboxes on the screenshot.
 


- ALF - "Find out what you don't do well ..... then don't do it!" :)
 
ID: 1828831 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1828948 - Posted: 7 Nov 2016, 1:41:15 UTC - in response to Message 1828831.  


It is a matter of your Settings, my keeps 1 year:
(Currently:
history_long_CompName.cvs is 734 KB and have 3516 records
history_CompName.cvs is 25 KB and have 113 records

How long does it take to load BOINCTasks with that many History records?

~5 seconds.

"History records" in the tab are for 7 days (for me that is 100-200 tasks)
The other 360 days (3500 records) are only read if you click a button on the toolbar.
BoincTasks consumes ~1 minute CPU time per day (0.1% (1/1000) of a CPU core)


I have mine trimmed down to 2 days because the default value caused it to load over many minutes.

I don't know what is "the default value" and there are many values and checkboxes on the screenshot.

On my BOINCTasks installation monitoring 3 systems, 2 days of History equals 6125 records. That goes up to about 40,000 records for a weeks worth of History. That takes a LONG time to load.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1828948 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1830983 - Posted: 17 Nov 2016, 3:43:28 UTC

. . hi Guys,

. . Has anyone considered an upgrade to the scheduler in preparation for SoG r3557 (V8.20) being accepted for release? I think it won't be long.

Stephen

.
ID: 1830983 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1831134 - Posted: 18 Nov 2016, 3:22:59 UTC - in response to Message 1830983.  

. . Has anyone considered an upgrade to the scheduler in preparation for SoG r3557 (V8.20) being accepted for release? I think it won't be long..

Haven't seen anything of Mr. Kevvy in forever; perhaps he got sick of the previous heat and now has this all on ignore. I know I sent him a couple PMs a while back but did not receive a response.
So I'll take a stab and make an educated guess that there would not be any requirement for changes to his app based on a new SoG release. Afaik, he does his selection based on WU naming convention. However, since I've not updated to the latest Lunatics releasew everything I'm running here is Cuda.
If you are successfully running any SoG presently with GR, that would reinforce my belief on this.
ID: 1831134 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1831158 - Posted: 18 Nov 2016, 7:01:08 UTC - in response to Message 1830983.  

. . hi Guys,

. . Has anyone considered an upgrade to the scheduler in preparation for SoG r3557 (V8.20) being accepted for release? I think it won't be long.

Stephen

.

Not necessary. Running the SOG r3557 from the Lunatics 0.45 Beta 6 already with no issues. The re-scheduler doesn't care about the app version, just whether its a VLAR or non-VLAR.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1831158 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1831165 - Posted: 18 Nov 2016, 7:40:10 UTC - in response to Message 1831158.  

Not necessary. Running the SOG r3557 from the Lunatics 0.45 Beta 6 already with no issues. The re-scheduler doesn't care about the app version, just whether its a VLAR or non-VLAR.

Hi, Keith. Thanks for the confirmation...
ID: 1831165 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1831189 - Posted: 18 Nov 2016, 12:54:58 UTC - in response to Message 1831134.  

. . Has anyone considered an upgrade to the scheduler in preparation for SoG r3557 (V8.20) being accepted for release? I think it won't be long..

Haven't seen anything of Mr. Kevvy in forever; perhaps he got sick of the previous heat and now has this all on ignore. I know I sent him a couple PMs a while back but did not receive a response.
So I'll take a stab and make an educated guess that there would not be any requirement for changes to his app based on a new SoG release. Afaik, he does his selection based on WU naming convention. However, since I've not updated to the latest Lunatics releasew everything I'm running here is Cuda.
If you are successfully running any SoG presently with GR, that would reinforce my belief on this.


. . On one machine with the rescheduler I an running CUDA50 and the other is running SoG r3430. The only machine running r3557 so far has no CPU crunching so no rescheduling .... I guess the proof of the pudding will be when r3557 gets certified for general release. Though if any nice GPU manufacturers decide to release the GTX1050ti in a low profile format then the Core2 Duo will be getting an upgrade and running r3557 to boot :)

. . I have an ear out for the least whisper of such a critter. Mad keen I am!

Stephen

.
ID: 1831189 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1831195 - Posted: 18 Nov 2016, 13:39:17 UTC

The sooner r3557 is released to the general public the happier I'll be as it will drop my inconclusives so much more.

Cheers.
ID: 1831195 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1831230 - Posted: 18 Nov 2016, 16:09:29 UTC - in response to Message 1831195.  

The sooner r3557 is released to the general public the happier I'll be as it will drop my inconclusives so much more.

Cheers.


. . Yeppo!

. . That is why La Bamba is slaving away in Beta_test :)

Stephen

.
ID: 1831230 · Report as offensive
Profile Rune Bjørge

Send message
Joined: 5 Feb 00
Posts: 45
Credit: 30,508,204
RAC: 5
Norway
Message 1832247 - Posted: 24 Nov 2016, 20:28:59 UTC - in response to Message 1831230.  

I have a question regarding the reschedule and maybe another way of using it. I know that there are some CPU cruncher with a lot of cores. During the outages those heavy lifting machines does run out of work.

Would it be possible to install a less powerful GPU to be able to get some more tasks to a multi core machine, and then reschedule some tasks from gpu to cpu, just to feed the hungry cores?
ID: 1832247 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1832262 - Posted: 24 Nov 2016, 21:31:18 UTC - in response to Message 1832247.  

Not as designed.

The rescheduler swaps tasks 1-to-1 between GPU and CPU. It was essentially made for getting vlar tasks off of NVIDIA GPUs and swapping them with Arecibo CPU tasks.
ID: 1832262 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1832267 - Posted: 24 Nov 2016, 21:49:31 UTC - in response to Message 1832247.  

I have a question regarding the reschedule and maybe another way of using it. I know that there are some CPU cruncher with a lot of cores. During the outages those heavy lifting machines does run out of work.

Would it be possible to install a less powerful GPU to be able to get some more tasks to a multi core machine, and then reschedule some tasks from gpu to cpu, just to feed the hungry cores?



. . Hi Rune

. . It certainly is. Just having a GPU will give you another cache which will take up to 100 WUs, and if it is a slow GPU then you will need to set your task limit to the full 10 days to fill it. But with the rescheduler, or a form of it, you would be able to top up your CPU cache when needed from the GPU cache.

Stephen

.

PS: Speak to Stubbles

.
ID: 1832267 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1832761 - Posted: 27 Nov 2016, 0:58:48 UTC - in response to Message 1832267.  

Interesting. Wonder how a 1050Ti might play with a 1080 and 2 980Ti's? ;-) Have to do some re-configuring if I am going to move in that direction, but then I'd need to figure out how to make that rescheduling business work before I even considered adding it. But interesting to know. Now if only EVGA could make their Precision software work with both the 10 series and 9 series cards in the same machine, I'd be Golden, but last time I spoke with them the week I got my 1080, they made it sound like that was just a pipe dream, so I don't have a lot of hope in that happening.

ID: 1832761 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1832765 - Posted: 27 Nov 2016, 1:18:40 UTC - in response to Message 1832761.  

Interesting. Wonder how a 1050Ti might play with a 1080 and 2 980Ti's? ;-) Have to do some re-configuring if I am going to move in that direction, but then I'd need to figure out how to make that rescheduling business work before I even considered adding it. But interesting to know. Now if only EVGA could make their Precision software work with both the 10 series and 9 series cards in the same machine, I'd be Golden, but last time I spoke with them the week I got my 1080, they made it sound like that was just a pipe dream, so I don't have a lot of hope in that happening.

Not quite the same deal, but fwiw most of my machines have a mix of 750tis and 980s, for power reasons.

As for Precision-X, so far very unimpressed with it; has been nothing but an issue and I never really can believe that it's properly setting things ...
ID: 1832765 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1832790 - Posted: 27 Nov 2016, 3:31:06 UTC - in response to Message 1832761.  

Interesting. Wonder how a 1050Ti might play with a 1080 and 2 980Ti's? ;-) Have to do some re-configuring if I am going to move in that direction, but then I'd need to figure out how to make that rescheduling business work before I even considered adding it. But interesting to know. Now if only EVGA could make their Precision software work with both the 10 series and 9 series cards in the same machine, I'd be Golden, but last time I spoke with them the week I got my 1080, they made it sound like that was just a pipe dream, so I don't have a lot of hope in that happening.


. . Hi Al,

. . As the proud(?) owner of an HP Core 2 Duo rig, currently running a GT730, I am waiting breathlessly for MSI to make their promised GTX 1050 ti low profile card a reality, then I can give that rig some teeth to chew guppis with. It won't give mind bending results but that should increase its output by at least a factor of 2. Then I will change over to SoG instead of CUDA50.

Stephen

.
ID: 1832790 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1832792 - Posted: 27 Nov 2016, 3:33:09 UTC - in response to Message 1832765.  


Not quite the same deal, but fwiw most of my machines have a mix of 750tis and 980s, for power reasons.

As for Precision-X, so far very unimpressed with it; has been nothing but an issue and I never really can believe that it's properly setting things ...


. . Have you downloaded Afterburner and given that a try?

Stephen

.
ID: 1832792 · Report as offensive
Previous · 1 . . . 24 · 25 · 26 · 27 · 28 · 29 · 30 . . . 37 · Next

Message boards : Number crunching : GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.