pending credits

Message boards : Number crunching : pending credits
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next

AuthorMessage
Shabado

Send message
Joined: 13 Dec 08
Posts: 1
Credit: 2,797,406
RAC: 0
United States
Message 888379 - Posted: 26 Apr 2009, 1:12:22 UTC - in response to Message 887720.  

I have a q6600 running at about 3.1 ghz and doing 100 percent AP. RAC is now about 8800 pending credits are about 9:1
ID: 888379 · Report as offensive
Andy Williams
Volunteer tester
Avatar

Send message
Joined: 11 May 01
Posts: 187
Credit: 112,464,820
RAC: 0
United States
Message 888605 - Posted: 26 Apr 2009, 22:53:17 UTC

Recent average credit 167,088.37

Pending credit: 1,314,126.57

7.86:1

Still hanging out near 8:1
--
Classic 82353 WU / 400979 h
ID: 888605 · Report as offensive
Nemesis

Send message
Joined: 14 Mar 07
Posts: 129
Credit: 31,295,655
RAC: 0
Canada
Message 888627 - Posted: 26 Apr 2009, 23:37:58 UTC

Yup, the RAC is starting to drop again and the pending is going up. Looks like I've picked up about another 12000 pending over the weekend...
ID: 888627 · Report as offensive
Profile KW2E
Avatar

Send message
Joined: 18 May 99
Posts: 346
Credit: 104,396,190
RAC: 34
United States
Message 888685 - Posted: 27 Apr 2009, 3:41:42 UTC - in response to Message 888627.  

Pending credit: 2,762,176.75

8.7:1
ID: 888685 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 888691 - Posted: 27 Apr 2009, 4:57:35 UTC

Mine's not that spectacular, but..

pending: 54,533.26
RAC: 5,656.20

9.64:1
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 888691 · Report as offensive
Profile Bob Mahoney Design
Avatar

Send message
Joined: 4 Apr 04
Posts: 178
Credit: 9,205,632
RAC: 0
United States
Message 888785 - Posted: 27 Apr 2009, 15:07:53 UTC

I'd like to propose a theory and a question:

I'm wondering if the new BOINC is causing some of the pending credit growth and temporary RAC decline?

To explain:

Old BOINC processed workunits in the 'natural' order they arrived. FIFO, except when some shorties came along and needed priority. Otherwise, FIFO.

New BOINC processes workunits in strict 'Report deadline' order, and this is not necessarily FIFO. This is a big change.

How does this affect RAC and pending credit? Well, if the majority of users are still on BOINC 6.4.x, and you are using 6.6.2x, then your processing is time-displaced from the processing of your wingmen. This will sort itself out in a short time, your RAC will eventually recover, but your pending credits will remain higher than in the past.

Example: You are using BOINC 6.6.20. Your wingman is using BOINC 6.4.7.

The following numbers WU's come into both of your worlds:

1,2,3,4,5,6,7,8,9

Wingman processes the WU's in this order:

Wingman, FIFO order: 1,2,3,4,5,6,7,8,9

If you did not switch to 6.6.20, you would process in the same order. However, you are now processing in a different order. I'll use the worst case example to test my argument:

You, Report Deadline order: 9,8,7,6,5,4,3,2,1

You see, WU number 9 is completed by you immediately, but will sit in your Pending Credit bucket until the wingman finally processes it, maybe 5 or 10 days from now! Also, your wingman will see an increase in pending credit and a temporary decrease in RAC since he or she is waiting for you to finish WU number 1.

RAC will eventually recover, but at a total loss over time, relative to the increase in everyone's pending credit, at least until every single user converts to the new non-FIFO processing order by upgrading their version of BOINC.

And that is why RAC is dropping or barely growing right now, and pending credits are on a big upswing. Thoughts?

Bob Mahoney
Opinion stated as fact? Who, me?
ID: 888785 · Report as offensive
Fred W
Volunteer tester

Send message
Joined: 13 Jun 99
Posts: 2524
Credit: 11,954,210
RAC: 0
United Kingdom
Message 888786 - Posted: 27 Apr 2009, 15:13:48 UTC - in response to Message 888785.  

From 6.6.23 the FIFO order for CUDA units is implemented. So however much of an effect this has, it will be temporary.

F.
ID: 888786 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 888928 - Posted: 27 Apr 2009, 22:40:52 UTC - in response to Message 888785.  

...
And that is why RAC is dropping or barely growing right now, and pending credits are on a big upswing. Thoughts?

Bob Mahoney

The default settings for "Connect interval" and "Extra work" are 0.1 and 0.25 days. I have a feeling that maybe half the users have never modified their preferences nor felt an obligation to install the latest post-alpha version of BOINC. Perhaps that's also the half running slower hosts and/or turning them off at night, though. Anyhow, hosts running in that fashion provide some buffer, they have both short queues and FIFO processing so have little effect on wingmates' pending.

OTOH, every time there's a server problem affecting work delivery that motivates more users to set long queues. The average turnaround time for Enhanced work may have grown somewhat though it is so affected by the current work mix that's hard to tell.

It would be interesting to compare the RAC curve of a strong host not running CUDA to yours with. That would be the best way to estimate the amount of effect using deadline order for CUDA is having. I know that _heinz non-CUDA 8 core system has also had a recent RAC decline and pending growth, for instance.
                                                                Joe
ID: 888928 · Report as offensive
Profile Sutaru Tsureku
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7105
Credit: 147,663,825
RAC: 5
Germany
Message 888965 - Posted: 27 Apr 2009, 23:35:46 UTC - in response to Message 885684.  
Last modified: 27 Apr 2009, 23:41:24 UTC


Pending credit: 49,248.49 [incl. CUDA overclaim! AFAIK: - ~ 26 % really]

36,443.88 pendings..


RAC 14,469.19


Ratio: 2.518722886353693606898520235065 ;-D


Current the RAC isn't stable.. because no stable tasks/cache..
Normally it was ~ 15,500 - 16,000 RAC


Current pending credit: 40,345.50
Subtraction CUDA overclaim: 29,855.67 [AFAIK: - ~ 26 %]

RAC 15,455.90

This would mean a ratio of: 1.9316681655549013645274620048008


The average turnaround time of the results are nearly similar to my tasks cache settings.
A well sign for stable RAC and stable pending credits.

ID: 888965 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 888995 - Posted: 28 Apr 2009, 0:36:17 UTC - in response to Message 888965.  

...
CUDA overclaim: 29,855.67 [AFAIK: - ~ 26 %]
...

I did some checking awhile ago, it seems to range from ~ 89% to -2%(underclaim) depending on AR. The 26% approximation seems fair, though.
                                                                Joe
ID: 888995 · Report as offensive
Profile Pappa
Volunteer tester
Avatar

Send message
Joined: 9 Jan 00
Posts: 2562
Credit: 12,301,681
RAC: 0
United States
Message 889034 - Posted: 28 Apr 2009, 2:53:35 UTC - in response to Message 888785.  
Last modified: 28 Apr 2009, 2:54:19 UTC

Bob, et al

The Server Status page tells alot. For a couple years since Matt implemented that section about

Result turnaround time (last hour average) 77.03 hours 168.97 hours 0m

It shows 3 days Average turnaround for MB and 7 days for Astropulse

From My own observations, I know that when the validators are clogged pending Credits rise fairly quickly. If you add stuck databases and the validator clogg it gets worse faster.

So While I do not know the actual percentage of users that have 10 Cache/buffers. It does appear that the 90+ percentile return workunits in 3 days. If I compare my RAC to my Pending Credits it is close to 3 days worth of work. The exception is Astropulse (but that is on a faster machine, which holds close to the 7 days). Mathmatically even that works out +or- within a percentage.

Hopefully Tues Server maintainence will reduce some of the latest Clogg in the pipes...

Regards


I'd like to propose a theory and a question:

I'm wondering if the new BOINC is causing some of the pending credit growth and temporary RAC decline?

To explain:

Old BOINC processed workunits in the 'natural' order they arrived. FIFO, except when some shorties came along and needed priority. Otherwise, FIFO.

New BOINC processes workunits in strict 'Report deadline' order, and this is not necessarily FIFO. This is a big change.

How does this affect RAC and pending credit?

Bob Mahoney

Please consider a Donation to the Seti Project.

ID: 889034 · Report as offensive
Chelski
Avatar

Send message
Joined: 3 Jan 00
Posts: 121
Credit: 8,979,050
RAC: 0
Malaysia
Message 889090 - Posted: 28 Apr 2009, 6:35:51 UTC - in response to Message 889034.  
Last modified: 28 Apr 2009, 6:38:21 UTC

It will be interesting if someone can generate a histogram for results turn around time. Is the data available in some xml file somewhere that all the sites used to generate the data?

The other interesting metric is the histogram for WU cache of host population. This I suppose will be harder to generate.

Without hard data it will be hard to try to statistically quantify the effects contributing to the long pending credits and turn around time.

Personally I'm on a 9 or 10 days WU cache, and my hosts sometimes do the strange thing of downloading shedloads of APs, run them until its about clean in 15+ days, so in effect will return results in a uniform distribution from times of 1-2 days to 15 day or so... apologies to wingmen of course, that you can only get validation with a 7 days mean if you caught one of mine.

Edit: BTW this thread is getting a little long in the tooth so perhaps the owner will consider turning it into a persistent thread with a new revision soon (e.g. Milestones or Panic threads)
ID: 889090 · Report as offensive
Profile Virtual Boss*
Volunteer tester
Avatar

Send message
Joined: 4 May 08
Posts: 417
Credit: 6,440,287
RAC: 0
Australia
Message 889113 - Posted: 28 Apr 2009, 10:07:36 UTC

The turnaround time for my mostly AP cruncher is 2.78 Days.

So to the other 90%+ out there doing AP slowly -

Lift your game, you're holding my RAC back . . . . LOL
ID: 889113 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19091
Credit: 40,757,560
RAC: 67
United Kingdom
Message 889122 - Posted: 28 Apr 2009, 10:50:06 UTC

On a very un-scientific survey of my Q6600 that only does AP, unless there are none available, shows that about 2/3's of them are validated within 6 days.
It has a 2.5 day cache.

It does about 6 tasks/day, and 9 tasks were completed over a month ago.

My RAC:pending is ~10:1
ID: 889122 · Report as offensive
Profile Allie in Vancouver
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 3949
Credit: 1,604,668
RAC: 0
Canada
Message 889170 - Posted: 28 Apr 2009, 14:17:58 UTC

My equally unscientific survey has me with a turn around time of 5.6 days, so about the same. I think that we are holding Virtual Boss back so we need to shovel more coal, step up our game, give 110% and other sports clichés. LOL.

Present RAC : pending is 7 : 1

My ratio has come down a lot. I guess it was just a blip caused by starting AP and using optimized apps.
Pure mathematics is, in its way, the poetry of logical ideas.

Albert Einstein
ID: 889170 · Report as offensive
Profile Virtual Boss*
Volunteer tester
Avatar

Send message
Joined: 4 May 08
Posts: 417
Credit: 6,440,287
RAC: 0
Australia
Message 889177 - Posted: 28 Apr 2009, 14:30:25 UTC - in response to Message 889170.  

Thanks kenzieB, my RAC jumped +150 almost as soon as you posted . . . LOL
ID: 889177 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 889231 - Posted: 28 Apr 2009, 16:25:23 UTC - in response to Message 889090.  

It will be interesting if someone can generate a histogram for results turn around time. Is the data available in some xml file somewhere that all the sites used to generate the data?
...

Scarecrow gathers and graphs the Server Status numbers, the 90 day version for Astropulse or S@H Enhanced gives the longest available view. I don't know of another source for historical data of tha kind.
                                                               Joe
ID: 889231 · Report as offensive
FiveHamlet
Avatar

Send message
Joined: 5 Oct 99
Posts: 783
Credit: 32,638,578
RAC: 0
United Kingdom
Message 889260 - Posted: 28 Apr 2009, 21:50:23 UTC - in response to Message 889113.  
Last modified: 28 Apr 2009, 21:53:16 UTC

I have some AP WU's in the Pending McGuffin from mid March.
A good proportion of my outstanding 90+ are with wingmen with no
chance of completing in alloted time.
There should be some kind of mechanism that only sends AP's to
proven AP crunchers. I.E. send 1 back in good time get another
send a second back in good time get 3 and build up.
Or fail to send back in good time reduce the ammount
of AP's sent to the host.
ID: 889260 · Report as offensive
Profile S@NL - Eesger - www.knoop.nl
Avatar

Send message
Joined: 7 Oct 01
Posts: 385
Credit: 50,200,038
RAC: 0
Netherlands
Message 889422 - Posted: 29 Apr 2009, 11:51:01 UTC

I thought my pending stabilized and that my RAC would now steadily increase.. but no..:
Pending:111,966.08 (got +10 within the week)
RAC : 12,785 (about stable the last few days..)

Ratio 8.8 : 1
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS
ID: 889422 · Report as offensive
Profile PaxV
Volunteer tester

Send message
Joined: 2 Dec 05
Posts: 5
Credit: 2,627,379
RAC: 0
Netherlands
Message 889995 - Posted: 30 Apr 2009, 22:31:46 UTC

Ah I'll see what keeps pending :)

My RAC is still climbing broke 3000 now and I have a pending amount of 42k+
so

I'd say I'm at 14:1 (If I crunched it ok.)

I'm using only astropulse v5.03 (SSE3 optimized by AK)
Turnaround is about 20-22hrs or so on my 1st system
Turnaround is about 52-56hrs or so on my 2nd system

my 1st system is a 2CPU QuadCore Opteron64 2.3 Ghz (2376 Shanghai) 8 threads
my 2nd system is a 1CPU Single Athlon64 3000+ 2.0Ghz, 1 thread

I expect to get to 9k RAC, maybe even 10k I'll see. I expect pending credit to normalize then.
ID: 889995 · Report as offensive
Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next

Message boards : Number crunching : pending credits


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.