I Thought BOINC Was Crazy But...

Message boards : Number crunching : I Thought BOINC Was Crazy But...
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1091181 - Posted: 28 Mar 2011, 14:42:03 UTC
Last modified: 28 Mar 2011, 14:44:51 UTC

Sheesh!

On one of my machines BOINC is running a bunch of APs due 4/21 - not in high priority mode. Meanwhile, it has stopped ("Waiting to Run") 3 APs due 4/10. Also waiting are another bunch in "ready to Start" that are due 4/11 - 4/17. Similarly, my other machine has 2 APs Waiting-to-Run due 4/9, and a bunch running due 4/21 also.

Say what?

Can anyone explain the logic of this to me under LIFO, FIFO or FEFIFOFUM?
ID: 1091181 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1091186 - Posted: 28 Mar 2011, 15:52:52 UTC - in response to Message 1091181.  

Imagine I'm your boss (scary thought, I know). Imagine I gave you some major work to do that I want on my desk by 4/10, which is two weeks away. You begin the project in earnest and get so far before I show up again and give you another major project that I want on my desk by 4/21, which is three and a half weeks away.

Somewhere in there I also gave you some work that I want on my desk by 4/11 through 4/17 respectively.

With the amount of work I've given you, you begin to wonder if you'll get it all done on time. So instead of just focusing on the ones with the earliest deadlines while possibly not having enough time afterward to complete the other tasks I gave you, you decide to dedicate small amounts of time to each task. Knowing that if you balance your time well, you'll be able to complete all tasks on time without having to stress yourself out, and change your priorities to Earliest Deadline First mode, which shouldn't be necessary given the amount of time due inbetween tasks.


That's all BOINC is doing. It's slowly giving CPU time to each task to ensure that it doesn't need to run in earliest deadline first / high priority mode.
ID: 1091186 · Report as offensive
Profile Helli_retiered
Volunteer tester
Avatar

Send message
Joined: 15 Dec 99
Posts: 707
Credit: 108,785,585
RAC: 0
Germany
Message 1091187 - Posted: 28 Mar 2011, 15:58:38 UTC - in response to Message 1091186.  

That's a very fine explanation, $o |>0/|/3. :-)


Helli
ID: 1091187 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1091189 - Posted: 28 Mar 2011, 16:11:52 UTC - in response to Message 1091186.  


That's all BOINC is doing. It's slowly giving CPU time to each task to ensure that it doesn't need to run in earliest deadline first / high priority mode.


Interesting.
I will check the elapsed times on the "Waiting to Run" 4/10 APs and see if they are really being run in a round-robin fashion with the 4/21s.
ID: 1091189 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1091255 - Posted: 28 Mar 2011, 20:48:28 UTC - in response to Message 1091186.  

Wait, you mean BOINC isn't crazy after all? But that would mean I'm.... Oh dear!!! :-(


PROUD MEMBER OF Team Starfire World BOINC
ID: 1091255 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1091262 - Posted: 28 Mar 2011, 21:10:11 UTC
Last modified: 28 Mar 2011, 21:11:25 UTC

Well, I went out for about 4 hours. When I came back, the "Waiting to Run" APs were exactly where they were before, to the second. So I don't think they are being run alternately with the later ones that are "Running" now.

So that theory is shot down.

NOW can someone explain the behavior of running ones due later while stopping ones due earlier? Isn't that counter-intuitive, not to mention WRONG? After all, if BOINC is afraid that the 4/21 APs aren't going to finish in time, why does he seem to think that the 4/10 ones will?

PS: Perry, take a deep breath and sit down. Don't get excited. Think about NICE things.
ID: 1091262 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34256
Credit: 79,922,639
RAC: 80
Germany
Message 1091268 - Posted: 28 Mar 2011, 21:23:53 UTC

I´m wondering about this behaviour for years.
Specially for APs on ATI it makes no sense.
The guys think way to complicated.
It will finnish exactly the same amount of work if running in FIFO.
You only have to wait longer for your wingman.
Running on huge caches its better to suspend WUs with later deadlines.
So i get what i want.

Maybe in 20 years those guys will wake up.



With each crime and every kindness we birth our future.
ID: 1091268 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1091269 - Posted: 28 Mar 2011, 21:24:07 UTC

The few times I've run Seti + backup projects with short deadlines, some of the backup work wouldn't have finished in time if I didn't pause the Seti WUs which Boinc insisted on running. Have no idea why it happens.
ID: 1091269 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1091276 - Posted: 28 Mar 2011, 21:35:25 UTC - in response to Message 1091262.  

Well, I went out for about 4 hours. When I came back, the "Waiting to Run" APs were exactly where they were before, to the second. So I don't think they are being run alternately with the later ones that are "Running" now.


I'm afraid your time sample may be too short. You may want to observe over a much longer time period.

NOW can someone explain the behavior of running ones due later while stopping ones due earlier? Isn't that counter-intuitive, not to mention WRONG? After all, if BOINC is afraid that the 4/21 APs aren't going to finish in time, why does he seem to think that the 4/10 ones will?


BOINC runs many simulations based upon available computing time and amount of time the computer is running and the cached workload on hand and resource share.

If it has sufficiently processed enough work from the 4/10 ones but now the simulation has shown that the 4/21s are in danger, it will start processing those, balancing the CPU time between all the aforementioned variables.
ID: 1091276 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1091281 - Posted: 28 Mar 2011, 22:10:33 UTC

If you want to know why BOINC makes the decisions it does then you should enable the logging flags that display the scheduler output.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1091281 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1091283 - Posted: 28 Mar 2011, 22:23:37 UTC - in response to Message 1091281.  

If you want to know why BOINC makes the decisions it does then you should enable the logging flags that display the scheduler output.


OK - how do I do that?
ID: 1091283 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34256
Credit: 79,922,639
RAC: 80
Germany
Message 1091284 - Posted: 28 Mar 2011, 22:28:26 UTC

I'm afraid your time sample may be too short. You may want to observe over a much longer time period.


It didn´t learn after 500 units i´ve finnished so i dont expect it would after 1 million.

It could be so easy.



With each crime and every kindness we birth our future.
ID: 1091284 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1091292 - Posted: 28 Mar 2011, 22:44:08 UTC - in response to Message 1091284.  

I'm afraid your time sample may be too short. You may want to observe over a much longer time period.


It didn´t learn after 500 units i´ve finnished so i dont expect it would after 1 million.

It could be so easy.


Interesting... it works as designed for me.

It is amazingly easy.
ID: 1091292 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34256
Credit: 79,922,639
RAC: 80
Germany
Message 1091294 - Posted: 28 Mar 2011, 22:48:59 UTC - in response to Message 1091292.  

I'm afraid your time sample may be too short. You may want to observe over a much longer time period.


It didn´t learn after 500 units i´ve finnished so i dont expect it would after 1 million.

It could be so easy.


Interesting... it works as designed for me.

It is amazingly easy.


It does so long you dont have a huge cache.
Running a 20 day cache is only possible in FIFO mode.
I finnished 512 APs in 20 days with GPU.

Yes it is possible to get such a cache.



With each crime and every kindness we birth our future.
ID: 1091294 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1091298 - Posted: 28 Mar 2011, 22:53:20 UTC - in response to Message 1091283.  

If you want to know why BOINC makes the decisions it does then you should enable the logging flags that display the scheduler output.


OK - how do I do that?


Do you know about the cc_config.xml file?
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1091298 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1091312 - Posted: 28 Mar 2011, 23:27:28 UTC - in response to Message 1091298.  

If you want to know why BOINC makes the decisions it does then you should enable the logging flags that display the scheduler output.


OK - how do I do that?


Do you know about the cc_config.xml file?


Tes I did, but not about debugging flags. I will investigate...
Thanks!
ID: 1091312 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1091314 - Posted: 28 Mar 2011, 23:35:02 UTC - in response to Message 1091294.  
Last modified: 28 Mar 2011, 23:39:25 UTC

I'm afraid your time sample may be too short. You may want to observe over a much longer time period.


It didn´t learn after 500 units i´ve finnished so i dont expect it would after 1 million.

It could be so easy.


Interesting... it works as designed for me.

It is amazingly easy.


It does so long you dont have a huge cache.
Running a 20 day cache is only possible in FIFO mode.
I finnished 512 APs in 20 days with GPU.

Yes it is possible to get such a cache.


Then don't run a large cache. I would fully support a decision to modify the code server-side that restricts the cache to 5 days max for all projects.
ID: 1091314 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1091316 - Posted: 29 Mar 2011, 0:02:32 UTC - in response to Message 1091314.  
Last modified: 29 Mar 2011, 0:15:19 UTC

Then don't run a large cache. I would fully support a decision to modify the code server-side that restricts the cache to 5 days max for all projects.

A 10 day max I would certainly support but not 5.

Cheers.
ID: 1091316 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1091344 - Posted: 29 Mar 2011, 1:32:49 UTC

I received a PM making the following suggestion to my original analogy:

You're my boss (shudder!) and you say "have these tasks on my desk by (deadline), each one will take 10 hours."

I start working on one, I'm breezing my way through it, and when it's clear they won't take ten hours and can be finished easily, I set that one aside and start on the tasks that may be late if the ten hours is accurate.

... because that's what I noticed. A unit that is expected to take ten hours might be 50% done after two hours processing.

You can experiment by editing DCF to a low number (to download LOTS of work) then changing DCF to a high number (10x what it should be). As BOINC does work, the "to completion" time will move nearly ten times faster than "wall" time.



My original analogy didn't properly convey DCF as this suggestion does.
ID: 1091344 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34256
Credit: 79,922,639
RAC: 80
Germany
Message 1091408 - Posted: 29 Mar 2011, 6:38:35 UTC - in response to Message 1091314.  

I'm afraid your time sample may be too short. You may want to observe over a much longer time period.


It didn´t learn after 500 units i´ve finnished so i dont expect it would after 1 million.

It could be so easy.


Interesting... it works as designed for me.

It is amazingly easy.


It does so long you dont have a huge cache.
Running a 20 day cache is only possible in FIFO mode.
I finnished 512 APs in 20 days with GPU.

Yes it is possible to get such a cache.


Then don't run a large cache. I would fully support a decision to modify the code server-side that restricts the cache to 5 days max for all projects.


Wouldn´t change anything.
You can run a 40 day cache if you know how.
I dont need server code for that.

Anyhow it seems you missed the point.
Running in FIFO mode would only make it easier.
But i know some guys like it complicated.
One of the reasons i quit Boinc alpha.



With each crime and every kindness we birth our future.
ID: 1091408 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : I Thought BOINC Was Crazy But...


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.