Observation of CreditNew Impact

Message boards : Number crunching : Observation of CreditNew Impact
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 15 · Next

AuthorMessage
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1376811 - Posted: 5 Jun 2013, 2:59:36 UTC

I’ve had a look at the data around v7 and v6 WUs and below is a quick observational analysis of my data.

Under v6, I was roughly averaging 100 credits per Work Unit (WU).
Under v7, it seems that the average is sitting around 75-80 credits per WU.
In looking at run-times and taking the outliers out, cpu run time was around 600-660 seconds (10-11 minutes) per WU for v6, and appears to be around 800-1100 seconds (13+ to 18+ minutes) for a v7 WU. CPU time seems to have gone up by a factor of 2-3 from 50-60 seconds for v6 to 90-180 seconds for v7.

So doing a quick Back of the Envelope (10.5/15.83=0.66) shows that from a WU processing/throughput capability, I can expect to do roughly 66% of the volume of WUs that I did before (for example, if I was doing 400 WUs per day under v6, I can now expect to do around 264 WUs per day under v7).

Looking at the impact on credit gives 0.66*0.775 = 0.514 or 51.4%. In essence I can expect that daily credit for v7 will drop to circa 51% of what I was getting under v6.

I am aware of the comments around “that the system needs time to settle down” and that “it thinks all the WUs coming back at the moment are easy, hence the low credit” however, if the system continues to perform as is, then I can expect to see no change from current trajectory.

To test the assumption, I have looked at credit per day for the last 20 days. Below is the data:

2013.05.16 – 244,130
2013.05.17 – 220,168
2013.05.18 – 231,098
2013.05.19 – 226,353
2013.05.20 – 224,723
2013.05.21 – 210,477
2013.05.22 - 0
2013.05.23 – 431,485
2013.05.24 – 229,312
2013.05.25 – 228,767
2013.05.26 – 239,021
2013.05.27 – 231,271
2013.05.28 – 231,050
2013.05.29 – 0
2013.05.30 – 392,635
2013.05.31 – 209,556
2013.06.01 – 123,072
2013.06.02 – 94,061
2013.06.03 – 102,333
2013.06.04 – 99,896

The average daily credit prior to migration was 221,878. Following migration on 1st June, the average daily credit is showing as 104,841 which is circa 47% of the previous daily average under v6.

I suspect that many are starting to see their RAC decline, but as RAC is a lagging indicator and is currently composed of v6 and v7 numbers, the end effect is being masked. As this mask evaporates and RAC asymptotes towards the underlying v7 values, I suspect that the grumblings in the forum may get louder.










ID: 1376811 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11360
Credit: 29,581,041
RAC: 66
United States
Message 1376816 - Posted: 5 Jun 2013, 3:14:48 UTC - in response to Message 1376811.  
Last modified: 5 Jun 2013, 3:15:16 UTC

If you're crunching SETI you should not care about absolute credits only relative credit within the project because our credit system makes no sense to most of us.
ID: 1376816 · Report as offensive
Bill Butler
Avatar

Send message
Joined: 26 Aug 03
Posts: 101
Credit: 4,270,697
RAC: 0
United States
Message 1376819 - Posted: 5 Jun 2013, 3:19:06 UTC

I’ve had a look at the data around v7 and v6 WUs and below ....

Nice analysis. Contributes some reasonable explanation and understanding of the RAC problem. Further explanation of v7 is coming. Could be v7 will require more crunching to realize the goals of v7. That's what this analysis shows, it seems to me.
"It is often darkest just before it turns completely black."
ID: 1376819 · Report as offensive
Chris Oliver Project Donor
Avatar

Send message
Joined: 4 Jul 99
Posts: 72
Credit: 134,288,250
RAC: 15
United Kingdom
Message 1376882 - Posted: 5 Jun 2013, 6:14:57 UTC - in response to Message 1376819.  

Seems that less credit is a slap in the face to all the crunchers who have been competing against each other for a long time and we should probably look for more deserving projects.
ID: 1376882 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1376895 - Posted: 5 Jun 2013, 6:47:26 UTC - in response to Message 1376882.  

Seems that less credit is a slap in the face to all the crunchers who have been competing against each other for a long time and we should probably look for more deserving projects.

Why so? Both will recive less credits.
Continue to compete but with shortened сarrots :)

SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1376895 · Report as offensive
Les Binns
Volunteer tester
Avatar

Send message
Joined: 9 Oct 99
Posts: 62
Credit: 32,652,655
RAC: 1
United Kingdom
Message 1376909 - Posted: 5 Jun 2013, 7:22:58 UTC - in response to Message 1376895.  

yes all will get the same
ID: 1376909 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1376921 - Posted: 5 Jun 2013, 7:55:13 UTC

The only time I can see this as a problem is if different crunchers with similar rigs (I have an identical pair) see large differences between the two.

Over in beta Eric commented;

I think that we're having problem because the APR of the CPU versions of S@Hv7 hasn't stabilized yet. It's still strongly weighted toward fast CPUs, and that's reducing credit grants across the board. I'm hoping that a week from now things will be showing higher APRs.


I am going nowhere, but suggest that others give the project a chance to stablise.

For the few comments Eric has made I get the feeling he is quite busy.
ID: 1376921 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1377117 - Posted: 5 Jun 2013, 18:57:38 UTC
Last modified: 5 Jun 2013, 19:00:58 UTC

Lionel is right. The only times my RAC has fallen faster than it is now has been when the computers have been switched off.

The RAC of my main rig has dropped by 30k in the last week.

The "slower rigs" should be starting to check in by now, thus the system should be showing some sign of "stabilising". However, apart from one or two outriders, 80 credits per unit is the most I see, irrespective of AR or the number of flops contributed and most are below this. Not one V7 unit I've crunched has earned 100 credits.

"Credit New" is like the system they use in schools these days, where the top students are graded down and the poor students are graded up so that everyone is "average".

I know that in the real world SAH credits are worth zip, and I know that "it's all about the science", but until the scientists get up off their BFA's and start doing something with the data we have crunched, credits are all we have.

T.A.
ID: 1377117 · Report as offensive
Profile Gatekeeper
Avatar

Send message
Joined: 14 Jul 04
Posts: 887
Credit: 176,479,616
RAC: 0
United States
Message 1377125 - Posted: 5 Jun 2013, 19:29:58 UTC - in response to Message 1377117.  

Snip:
Not one V7 unit I've crunched has earned 100 credits.



I agree with everything being said. If my RAC graph line were a roller coaster, all the riders would black out from the G forces. But, I was able to find at least one v7 unit that earned over 100 points: here. Look quick before it disappears. (g)
ID: 1377125 · Report as offensive
Sleepy
Volunteer tester
Avatar

Send message
Joined: 21 May 99
Posts: 219
Credit: 98,947,784
RAC: 28,360
Italy
Message 1377205 - Posted: 5 Jun 2013, 23:21:23 UTC - in response to Message 1377125.  

Not that it should matter a lot, since we are supposedly looking for E.T. and not playing pinball for high scores, but, hey, they put the scores for some reason, I imagine.
To testify your work (possibly across the whole board of Boinc projects, this is supposed to happen) and also to put some positive competition among crunchers. This in turn helps optimise the rigs and increase the throughput of the project.

Back to the credit issue, suppose you are mentally engaged with someone well above you in credits. He has already got all that credit in the gold age of credits. You upgrade your equipment and begin to plan how things will get. That you may reach that cruncher in, say, 6 months.
Then V7 comes. You do the same work. Everybody gets the same reduction in RAC, but now you reach, if ever, the same cruncher in double of the time.

Because RAC may well be the same for all SETI crunchers, but the credit achieved before does not. And what could be achievable targets (in terms of points or rank) get an impossible mission. Also just inside SETI itself. Not across the board.
The social lift gets severely damaged. And this is not fair.

Not everybody is competing for RAC, some of us just like to keep their position or improve them. And halving the credits takes out energy from the system and crystallizes the situation.
We do not need credit inflation to feel well. But such a "credit crunch" makes no good as well.

If you tell me that we are just using our spare CPU cycle, at least most of the people around here, look into my eyes: we are not talking about spare cycle any more since long time. When I switch on optimised CPU applications, my power consumption goes up 100 W. If I put a powerful graphic card, this adds another 100-200 W to the bill.
Are we all here high end gamers that we need GTX690s or Titans?
I doubt this. So, competition is part of the game.
I like also this part of the game and it helps me keep my PC in order. Is the RAC falling? There must be something wrong in my PC.
Right yesterday there was something not convincing in my SETI crunching. I double checked, twisted a bit. Rebooted and... bang! My main HD was failing (not yet fully, just sending alarming alerts. I swapped it just in time. Lost a day to reconfigure everything (Boinc took just half an hour the pain was elsewhere), but I have not lost a single bit of precious data. Just in time before havoc would come unannounced.
Sorry wingpeople! In the emergency, I made a small mess in my WUs. Tomorrow I will see if I can recover some of them and give them a honourable end.

Sleepy

P.S.-It has been reported elsewhere that in Beta they talk about one week time for the credit to go back to normal values. I hope so and I trust who stated this.
ID: 1377205 · Report as offensive
(banished: ID 9878057)

Send message
Joined: 19 May 13
Posts: 156
Credit: 527,760
RAC: 0
Netherlands
Message 1377213 - Posted: 5 Jun 2013, 23:35:27 UTC

For anyone here who thinks that Credits have some merit you should realize that to Dr Anderson Credits are even more important.
Why else would he risk the ire of the seti@home base by writing the algorithm for CreditNew to approach from low->fair?
Dr Anderson likes Credits and he's stingy.
ID: 1377213 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1377226 - Posted: 6 Jun 2013, 0:04:48 UTC - in response to Message 1377213.  


Is it possible for me to edit my original post. There is more data that I wish to add.
ID: 1377226 · Report as offensive
Profile shizaru
Volunteer tester
Avatar

Send message
Joined: 14 Jun 04
Posts: 1130
Credit: 1,967,904
RAC: 0
Greece
Message 1377235 - Posted: 6 Jun 2013, 0:38:27 UTC - in response to Message 1377226.  


Is it possible for me to edit my original post. There is more data that I wish to add.


Unfortunately no. It's a fine idea and would make for some really useful threads (especially stickies) but no, can't be done. You only get an hour to edit any post. Titles can be changed though.

As for CreditNew, it's not a 'credit system' but rather an 'anti-cheating manifesto'. Well that's what it reads like anyway:)
ID: 1377235 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1377251 - Posted: 6 Jun 2013, 2:00:30 UTC - in response to Message 1377235.  


That is unfortunate. It means things are going to get long.







ID: 1377251 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1377256 - Posted: 6 Jun 2013, 2:11:59 UTC
Last modified: 6 Jun 2013, 2:12:50 UTC

Note: Unfortunately I cannot edit the original post so it is replicated here with additional text added in re: data for last two days, revised running average and Comment at end. Thankyou


I’ve had a look at the data around v7 and v6 WUs and below is a quick observational analysis of my data.

Under v6, I was roughly averaging 100 credits per Work Unit (WU).
Under v7, it seems that the average is sitting around 75-80 credits per WU.
In looking at run-times and taking the outliers out, cpu run time was around 600-660 seconds (10-11 minutes) per WU for v6, and appears to be around 800-1100 seconds (13+ to 18+ minutes) for a v7 WU. CPU time seems to have gone up by a factor of 2-3 from 50-60 seconds for v6 to 90-180 seconds for v7.

So doing a quick Back of the Envelope (10.5/15.83=0.66) shows that from a WU processing/throughput capability, I can expect to do roughly 66% of the volume of WUs that I did before (for example, if I was doing 400 WUs per day under v6, I can now expect to do around 264 WUs per day under v7).

Looking at the impact on credit gives 0.66*0.775 = 0.514 or 51.4%. In essence I can expect that daily credit for v7 will drop to circa 51% of what I was getting under v6.

I am aware of the comments around “that the system needs time to settle down” and that “it thinks all the WUs coming back at the moment are easy, hence the low credit” however, if the system continues to perform as is, then I can expect to see no change from current trajectory.

To test the assumption, I have looked at credit per day for the last 20 days. Below is the data:

    2013.05.16 – 244,130
    2013.05.17 – 220,168
    2013.05.18 – 231,098
    2013.05.19 – 226,353
    2013.05.20 – 224,723
    2013.05.21 – 210,477
    2013.05.22 - 0
    2013.05.23 – 431,485
    2013.05.24 – 229,312
    2013.05.25 – 228,767
    2013.05.26 – 239,021
    2013.05.27 – 231,271
    2013.05.28 – 231,050
    2013.05.29 – 0
    2013.05.30 – 392,635
    2013.05.31 – 209,556
    2013.06.01 – 123,072
    2013.06.02 – 94,061
    2013.06.03 – 102,333
    2013.06.04 – 99,896
    2013.06.05 - 65,653
    2013.06.06 - 112,209



The average daily credit prior to migration was 221,878. Following migration on 1st June, the average daily credit is showing as 99,537 which is circa 44.8% of the previous daily average under v6.

I suspect that many are starting to see their RAC decline, but as RAC is a lagging indicator and is currently composed of v6 and v7 numbers, the end effect is being masked. As this mask evaporates and RAC asymptotes towards the underlying v7 values, I suspect that the grumblings in the forum may get louder.


Comment on comments

Whilst some are focusing just on credit, the issue is not about credit as such. It’s about recognition.

There are many distributed computing projects to which people contribute resources. The manner and means in which those projects recognise individual contribution is through a system that is based on and allocates credits. Some projects choose to recognise a person’s contribution more than other projects, thus they grant a higher credit rate per contribution for that project. In short, credits are effectively an indication of a person’s contribution to a project.

In the case of "the New Credit System" implemented by Seti, recognition of personal contribution has been reduced. At present, the indication is that recognition for effort is effectively half that of what it was prior to the new recognition system being employed.


ID: 1377256 · Report as offensive
Profile MusicGod
Avatar

Send message
Joined: 7 Dec 02
Posts: 97
Credit: 24,782,870
RAC: 0
United States
Message 1377264 - Posted: 6 Jun 2013, 2:52:55 UTC - in response to Message 1377256.  

........and abandonment for another project!!!!!!
ID: 1377264 · Report as offensive
Profile MusicGod
Avatar

Send message
Joined: 7 Dec 02
Posts: 97
Credit: 24,782,870
RAC: 0
United States
Message 1377265 - Posted: 6 Jun 2013, 2:56:33 UTC - in response to Message 1377205.  

I will be ending all crunching when I hit the 20 mil mark. Electric bill is over 300 a month now with rigs blowing in the wind.....
ID: 1377265 · Report as offensive
Profile James Sotherden
Avatar

Send message
Joined: 16 May 99
Posts: 10436
Credit: 110,373,059
RAC: 54
United States
Message 1377320 - Posted: 6 Jun 2013, 6:00:19 UTC

Every time a new version comes out its the same story. Every time Dr A. changes the way credit is granted its still the same story. Some peolpe quit, Most complain.

The way I see it, Credit is just a usefull tool to see how your own rig is doing. I tweak this, add that, overclock this, And hey I just got a little better RAC.

It could be like the old classic days. You get one credit for each work unit you do.

As for myself, I will crunch till Seti@home turns off the power or I die first.

Screw the credit.
[/quote]

Old James
ID: 1377320 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1377326 - Posted: 6 Jun 2013, 6:12:54 UTC - in response to Message 1377265.  
Last modified: 6 Jun 2013, 6:15:19 UTC

I will be ending all crunching when I hit the 20 mil mark. Electric bill is over 300 a month now with rigs blowing in the wind.....

Your rigs are not 'blowing in the wind'...
They are doing as much valid science as they were before. The token credits awarded for that work are not what they were before, at the moment.

So, I guess it's a matter of what you care more about. Token credits, or the science of Seti.

And my last bill, due on Friday, was $620.00
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1377326 · Report as offensive
Keith White
Avatar

Send message
Joined: 29 May 99
Posts: 392
Credit: 13,035,233
RAC: 22
United States
Message 1377438 - Posted: 6 Jun 2013, 12:55:02 UTC - in response to Message 1377326.  
Last modified: 6 Jun 2013, 12:55:57 UTC

So what I'm seeing at my end in normalized credit per hour rates around 1/2 (45-48%) of what they were for MB V6.

Remember within seti@home, we are all experiencing the same credit "dilation" at the same time. Only users who somehow are sitting on a pile of unprocessed and unvalidated V6 WUs may be able hold on to their pre-V7 RAC a bit longer. But in the end we will all be dragged down together by the same amount and given enough time, our rankings between ourselves should stay approximately the same as they were two weeks ago.

And if weeks or months from now the home office decides to recalculate what "normal" is and adjust what credits we get from standard WU XYZ, we will all rise or fall together.

But if the Einstein or World Grid guys are giving you a hard time at the pub because you can't keep your RAC up anymore, then sorry to see you go.
"Life is just nature's way of keeping meat fresh." - The Doctor
ID: 1377438 · Report as offensive
1 · 2 · 3 · 4 . . . 15 · Next

Message boards : Number crunching : Observation of CreditNew Impact


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.