Download Limiting.

Message boards : Number crunching : Download Limiting.
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Scribe
Avatar

Send message
Joined: 4 Nov 00
Posts: 137
Credit: 35,235
RAC: 0
United Kingdom
Message 95279 - Posted: 5 Apr 2005, 14:52:04 UTC

I have just heard of this 'new' feature. It would be nice if someone could post all about it on the Technical pages so that other could be aware of it......or have I missed an announcement?
ID: 95279 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 95284 - Posted: 5 Apr 2005, 15:06:23 UTC - in response to Message 95279.  

> I have just heard of this 'new' feature. It would be nice if someone could
> post all about it on the Technical pages so that other could be aware of
> it......or have I missed an announcement?
>
Yes, I'd like to have it explained as well. I knew there was a limit, but didn't know what it was or how it was determined.

I haven't seen any announcement, maybe we both missed it.

tony
ID: 95284 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 95312 - Posted: 5 Apr 2005, 16:45:46 UTC
Last modified: 5 Apr 2005, 16:48:12 UTC

Mainly to make sure a bad host doesn't trash thousands of results in a short time, a daily_quota of how many "results" possible to download per computer per day was added during beta. How many downloads in a day is reset at midnight, server-time. This currently means 07:00 GMT for seti.
In seti this limit was 50, but increased to 100 some time ago.
Resently the daily quota also started to take #cpu's on a host into consideration, but uses an upper limit of 4 cpu's. For seti this means 100-400 wu/day.

Some computers seems to have permanent problems for different reasons, so another change was added:

1; For every error/past deadline, decrease the computers daily_quota by 1.
2; For every successfully reported result, double the computers daily_quota.
3; Never decrease below 1, or above the computers default daily_quota.

ID: 95312 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 95316 - Posted: 5 Apr 2005, 16:56:54 UTC - in response to Message 95284.  

> > I have just heard of this 'new' feature. It would be nice if someone
> could
> > post all about it on the Technical pages so that other could be aware of
> > it......or have I missed an announcement?
> >
> Yes, I'd like to have it explained as well. I knew there was a limit, but
> didn't know what it was or how it was determined.

Note Ingleside's explanation.

This is a very good feature for those who are active, dedicated crunchers because it reduces the delay caused by "bad" machines.

A broken machine that has been fixed should return to full quotas pretty quickly, and there is only a small penalty for an occasional hiccup.
ID: 95316 · Report as offensive
Profile Scribe
Avatar

Send message
Joined: 4 Nov 00
Posts: 137
Credit: 35,235
RAC: 0
United Kingdom
Message 95320 - Posted: 5 Apr 2005, 17:14:05 UTC

Surely something as important as this deserves a better 'press'. The explanation above is pretty comprehensive, but, this thread will sink into oblivion and be lost.

News of this magnitude deserves better treatment, either by being in the Technical pages on the Home Page, or, why not have a specific Read Only Members News Forum, instead of it being buried in here?
ID: 95320 · Report as offensive
Pascal, K G
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2343
Credit: 150,491
RAC: 0
United States
Message 95327 - Posted: 5 Apr 2005, 17:58:29 UTC - in response to Message 95320.  
Last modified: 5 Apr 2005, 17:58:52 UTC

> Surely something as important as this deserves a better 'press'. The
> explanation above is pretty comprehensive, but, this thread will sink into
> oblivion and be lost.
>
> News of this magnitude deserves better treatment, either by being in the
> Technical pages on the Home Page, or, why not have a specific Read Only
> Members News Forum, instead of it being buried in here?
>

Only .00005% of the volunteers will read the news......
Semper Eadem
So long Paul, it has been a hell of a ride.

Park your ego's, fire up the computers, Science YES, Credits No.
ID: 95327 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 95329 - Posted: 5 Apr 2005, 18:14:05 UTC - in response to Message 95327.  

> > Surely something as important as this deserves a better 'press'. The
> > explanation above is pretty comprehensive, but, this thread will sink
> into
> > oblivion and be lost.
> >
> > News of this magnitude deserves better treatment, either by being in the
> > Technical pages on the Home Page, or, why not have a specific Read Only
> > Members News Forum, instead of it being buried in here?
> >
>
> Only .00005% of the volunteers will read the news......

... and only .0001% will even notice the limit.
ID: 95329 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 95330 - Posted: 5 Apr 2005, 18:16:22 UTC - in response to Message 95320.  

> Surely something as important as this deserves a better 'press'. The
> explanation above is pretty comprehensive, but, this thread will sink into
> oblivion and be lost.

In Ingleside's post, he also covers how this policy has been tuned, and on the developer's list, there is a discussion of a whole new scheduler that will try to do a better job of assigning work.

So, the rules are not cast in concrete, they are at best cast in Jello.

Maybe sinking into oblivion isn't a bad thing.
ID: 95330 · Report as offensive
Profile Benher
Volunteer developer
Volunteer tester

Send message
Joined: 25 Jul 99
Posts: 517
Credit: 465,152
RAC: 0
United States
Message 95331 - Posted: 5 Apr 2005, 18:20:08 UTC
Last modified: 5 Apr 2005, 18:22:39 UTC

People who have found seeming problems in their # of WUs downloaded, but have not created many errored or overdue WUs should probably know the entire equation.

[Requested_work] = [connect_every_xx_days] * [secs_per_day] - [secs_in_queue_on_host]

Next, requested work is adjusted:

[Requested_work] = [Requested_work] * [percent_of_each_24_hours_this_host_runs_boinc]

So, if your computer is on 10 hours each day, and programs you are running (like games, etc) use 2 hours of those 10, the value would be 8 hours/24 hours or 33%.

The code that calculates this has some hiccups and may produce a really wrong value occasionally. The only way to fix this is to edit the file "client_state.xml" in your boinc folder.


Next it is adjusted again:

[Requested_work] = [Requested_work] * [project's_share_of_BOINC_time]

If there are more than one projets on the host, and one has 30% and the other 70% of the CPU time, this is the value used here.

ID: 95331 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 95335 - Posted: 5 Apr 2005, 18:33:46 UTC - in response to Message 95331.  

> People who have found seeming problems in their # of WUs downloaded, but have
> not created many errored or overdue WUs should probably know the entire
> equation.
>
> [Requested_work] = [connect_every_xx_days] * [secs_per_day] -
> [secs_in_queue_on_host]
>
> Next, requested work is adjusted:
>
> [Requested_work] = [Requested_work] *
> [percent_of_each_24_hours_this_host_runs_boinc]
>
> So, if your computer is on 10 hours each day, and programs you are running
> (like games, etc) use 2 hours of those 10, the value would be 8 hours/24 hours
> or 33%.
>
> The code that calculates this has some hiccups and may produce a really wrong
> value occasionally. The only way to fix this is to edit the file
> "client_state.xml" in your boinc folder.
>
>
> Next it is adjusted again:
>
> [Requested_work] = [Requested_work] * [project's_share_of_BOINC_time]
>
> If there are more than one projets on the host, and one has 30% and the other
> 70% of the CPU time, this is the value used here.

... and this is seperate from the server-side limits in Ingleside's post?

The equitable allocation of work is complex, isn't it.
ID: 95335 · Report as offensive
N/A
Volunteer tester

Send message
Joined: 18 May 01
Posts: 3718
Credit: 93,649
RAC: 0
Message 95342 - Posted: 5 Apr 2005, 19:20:57 UTC - in response to Message 95312.  

.o0(Smile and nod... admit no guilt... just walk away calmly... and don't mention the WU-killing box you've got...)
ID: 95342 · Report as offensive
Profile Fuzzy Hollynoodles
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 9659
Credit: 251,998
RAC: 0
Message 95346 - Posted: 5 Apr 2005, 19:39:59 UTC - in response to Message 95329.  

> >
> > Only .00005% of the volunteers will read the news......
>
> ... and only .0001% will even notice the limit.
>

And, if you have a welltuned box with no cache, no download, upload, and processing errors, you wouldn't notice at all!
"I'm trying to maintain a shred of dignity in this world." - Me

ID: 95346 · Report as offensive
Profile Benher
Volunteer developer
Volunteer tester

Send message
Joined: 25 Jul 99
Posts: 517
Credit: 465,152
RAC: 0
United States
Message 95452 - Posted: 6 Apr 2005, 0:03:36 UTC
Last modified: 6 Apr 2005, 0:07:35 UTC

>... and this is seperate from the server-side limits in Ingleside's post?

>The equitable allocation of work is complex, isn't it.

Yes, this is the number of seconds your machine "requests".

Will the server actually give you that much work??? -- refer to Ingleside's post ;)
------------------

>.o0(Smile and nod... admit no guilt... just walk away calmly... and don't mention the WU-killing box you've got...)

What you mean this old box?

Nah thats just the fruits of thousands of lines of optimized code ;)
ID: 95452 · Report as offensive
N/A
Volunteer tester

Send message
Joined: 18 May 01
Posts: 3718
Credit: 93,649
RAC: 0
Message 95458 - Posted: 6 Apr 2005, 0:48:46 UTC - in response to Message 95452.  
Last modified: 6 Apr 2005, 0:49:07 UTC

>>.o0(Smile and nod... admit no guilt... just walk away calmly... and don't mention the WU-killing box you've got...)
> What you mean this old box?
No... I mean this old box.

I guess I mentioned it, didn't I.

.o0(Danger, NeoAmsterdam! Change the subject! A distraction - Quickly!)

So... what's it like to have 4.2 perfect cobblestone machines??
ID: 95458 · Report as offensive
Profile Benher
Volunteer developer
Volunteer tester

Send message
Joined: 25 Jul 99
Posts: 517
Credit: 465,152
RAC: 0
United States
Message 95538 - Posted: 6 Apr 2005, 5:41:41 UTC - in response to Message 95458.  
Last modified: 6 Apr 2005, 5:43:01 UTC

> I guess I mentioned it, didn't I.
>
> .o0(Danger, NeoAmsterdam! Change the subject! A distraction - Quickly!)
>
> So... what's it like to have 4.2 perfect cobblestone machines??

Hmm, Im gonna guess that box has a very low max WU ;)

And that other machine is more like 7.5 cobblestones :P
ID: 95538 · Report as offensive

Message boards : Number crunching : Download Limiting.


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.