Increase the Units Cache amount

Message boards : Number crunching : Increase the Units Cache amount
Message board moderation

To post messages, you must log in.

AuthorMessage
t94xr
Avatar

Send message
Joined: 22 Mar 12
Posts: 2
Credit: 2,315,068
RAC: 1
New Zealand
Message 1923229 - Posted: 8 Mar 2018, 1:55:31 UTC

Hey, I've noticed the project down "under maintenance" lately - and my system runs out of units to process before the site goes online again.

Is there anyway I can increase the amount of cached units - my GPU processes them in like 9-10minutes per unit so I need a larger cache so the server doesnt process them all before the project is back online and sits idle for several hours.
t94xr - Taupo, New Zealand. | cameronwalker.nz - server
ID: 1923229 · Report as offensive
Profile Bill G Special Project $75 donor
Avatar

Send message
Joined: 1 Jun 01
Posts: 848
Credit: 135,858,703
RAC: 84,429
United States
Message 1923237 - Posted: 8 Mar 2018, 3:12:21 UTC - in response to Message 1923229.  

No. You can only bank 100 units for the CPU and 100 for each GPU that you might have.

SETI@home classic workunits 4,019
SETI@home classic CPU time 34,348 hours
ID: 1923237 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1605
Credit: 364,734,581
RAC: 385,029
Finland
Message 1923293 - Posted: 8 Mar 2018, 10:33:14 UTC

Hi,
My Titan V does guppi vlars in 39-48 seconds. I run out of work in 1 h 20 mins with a 100 WU cache. Shorties take 17 seconds.
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1923293 · Report as offensive
W3Perl Project Donor
Volunteer tester

Send message
Joined: 29 Apr 99
Posts: 191
Credit: 1,625,168,792
RAC: 2,842,276
France
Message 1923295 - Posted: 8 Mar 2018, 10:51:43 UTC - in response to Message 1923293.  

There are many ways to solve this problem :
- you can modify the boinc code to remove this 100 wu limit (as Petri did)
- you can use an old boinc version which don't have such limitation (boinc 6.10.58 as kittyman do)
- you can use a script to fill the cache before the maintenance (as I do)

You can download my perl tool cpu2gpu.pl at http://www.w3perl.com/seti/
Hope it helps !
ID: 1923295 · Report as offensive
t94xr
Avatar

Send message
Joined: 22 Mar 12
Posts: 2
Credit: 2,315,068
RAC: 1
New Zealand
Message 1923413 - Posted: 8 Mar 2018, 20:06:42 UTC
Last modified: 8 Mar 2018, 20:06:52 UTC

No. You can only bank 100 units for the CPU and 100 for each GPU that you might have.
So it will increase to 200 for my second GPU when that's installed. hmm thanks.

Hi,
My Titan V does guppi vlars in 39-48 seconds. I run out of work in 1 h 20 mins with a 100 WU cache. Shorties take 17 seconds.
You sir, I tip my hat. :)

There are many ways to solve this problem :
- you can modify the boinc code to remove this 100 wu limit (as Petri did)
- you can use an old boinc version which don't have such limitation (boinc 6.10.58 as kittyman do)
- you can use a script to fill the cache before the maintenance (as I do)
...
That's an excellent idea - find the 100 limit in the code.
I'll do some investigation about this.
t94xr - Taupo, New Zealand. | cameronwalker.nz - server
ID: 1923413 · Report as offensive
rob smith Special Project $250 donor
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 16387
Credit: 333,163,055
RAC: 239,099
United Kingdom
Message 1923417 - Posted: 8 Mar 2018, 20:21:25 UTC

Server side, not local. And it is not too obvious in its location....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1923417 · Report as offensive
W3Perl Project Donor
Volunteer tester

Send message
Joined: 29 Apr 99
Posts: 191
Credit: 1,625,168,792
RAC: 2,842,276
France
Message 1923430 - Posted: 8 Mar 2018, 20:57:13 UTC - in response to Message 1923417.  

Yes, I was wrong on a 100 wu limit in the code....you should increase the number of GPU detected in the code so
boinc will send 100 extra wu for each card you'll virtually add.
ID: 1923430 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 5310
Credit: 353,960,470
RAC: 1,091,356
United States
Message 1923437 - Posted: 8 Mar 2018, 21:42:50 UTC - in response to Message 1923430.  

Server side code still hard limits the number of tasks in your cache to 100 per device per scheduler work request. The other limitation is in the client side code that limits the number of tasks being held on any host to 1000 tasks for BOINC versions >> 7.2.0 when bunkering via rescheduling is being used.

The limit was put in place in work_fetch.cpp in this code:
 // don't request work from projects w/ > 1000 runnable jobs
    //
    int job_limit = 1000;
    for (unsigned int i=0; i<gstate.projects.size(); i++) {
        PROJECT* p = gstate.projects[i];
        if (p->pwf.n_runnable_jobs > job_limit && !p->pwf.cant_fetch_work_reason) {
            p->pwf.cant_fetch_work_reason = CANT_FETCH_WORK_TOO_MANY_RUNNABLE;

Earlier BOINC versions like the 6.10.58/60 mentioned or modified client code allows up to 3000 tasks to be held per host. "Bunkering" or rescheduling is the only way to have enough tasks to make it through our typical 10-12 hour maintenance period.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1923437 · Report as offensive
Chris Adamek
Volunteer tester

Send message
Joined: 15 May 99
Posts: 249
Credit: 373,761,497
RAC: 191,528
United States
Message 1923486 - Posted: 9 Mar 2018, 0:41:43 UTC - in response to Message 1923295.  

There are many ways to solve this problem :
- you can modify the boinc code to remove this 100 wu limit (as Petri did)
- you can use an old boinc version which don't have such limitation (boinc 6.10.58 as kittyman do)
- you can use a script to fill the cache before the maintenance (as I do)

You can download my perl tool cpu2gpu.pl at http://www.w3perl.com/seti/
Hope it helps !


This should work on a Mac right? I don’t know if the folder structure is the same before Linux and a Mac.

Thanks,

Chris
ID: 1923486 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 5310
Credit: 353,960,470
RAC: 1,091,356
United States
Message 1923513 - Posted: 9 Mar 2018, 1:42:29 UTC - in response to Message 1923486.  
Last modified: 9 Mar 2018, 1:51:06 UTC

Doesn't matter. The Perl script has a line where you input the BOINC folder location on your system. You just have to adjust Laurent's script, comment out some superfluous lines and uncomment another line to make the task move at the end of the script. You do have to install some version of Perl for your OS as a starter.
[Edit] You might want to begin here to learn the genesis of the various Reschedulers.
GUPPI Rescheduler for Linux and Windows - Move GUPPI work to CPU and non-GUPPI to GPU
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1923513 · Report as offensive
Chris Adamek
Volunteer tester

Send message
Joined: 15 May 99
Posts: 249
Credit: 373,761,497
RAC: 191,528
United States
Message 1923543 - Posted: 9 Mar 2018, 3:38:50 UTC - in response to Message 1923513.  

Thanks and sure, I used the rescheduler someone made on here years ago on Windows. I just hadn’t seen a fairly clean/easy option for the Mac. I installed Perl earlier today. I’ll give the script a look and see how it goes. The 1080ti is very thirsty on maintenance days...lol
ID: 1923543 · Report as offensive
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 50056
Credit: 931,098,440
RAC: 225,791
United States
Message 1923544 - Posted: 9 Mar 2018, 3:43:28 UTC

Just my opinion, but I think any further discussion of the subject should be via PM and this thread should be locked.

Meeeeeeeeeeeeeeeeeeeeeeeow.
Happy is the person who shares their life with a cat. (Or two or three or........) =^.^=

Have made friends here.
Most were cats.
ID: 1923544 · Report as offensive
rob smith Special Project $250 donor
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 16387
Credit: 333,163,055
RAC: 239,099
United Kingdom
Message 1923562 - Posted: 9 Mar 2018, 11:41:58 UTC

I'm with you Mark, a few are (fairly) responsible with their efforts to break the server limits on how many tasks they hoard, while others may be somewhat less so. All who do so forget that SETI has NEVER promised us full caches all the time.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1923562 · Report as offensive
Mithotar
Avatar

Send message
Joined: 11 Apr 01
Posts: 80
Credit: 50,480,205
RAC: 29,059
United States
Message 1923829 - Posted: 10 Mar 2018, 21:09:23 UTC - in response to Message 1923562.  

I'm still waiting on my toaster.............
ID: 1923829 · Report as offensive

Message boards : Number crunching : Increase the Units Cache amount


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.