Too many Succes results

Message boards : Number crunching : Too many Succes results
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Bukken

Send message
Joined: 3 Apr 99
Posts: 50
Credit: 3,007,776
RAC: 0
Denmark
Message 94915 - Posted: 4 Apr 2005, 19:30:55 UTC
Last modified: 4 Apr 2005, 19:42:16 UTC

Well thought i had seen it all ??
Zero credit granted for a WU, caused by too many succes results ?

http://setiweb.ssl.berkeley.edu/workunit.php?wuid=11196405

Just wanted to share this

Bukken

Keep Crunching

ID: 94915 · Report as offensive
Profile MikeSW17
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 1603
Credit: 2,700,523
RAC: 0
United Kingdom
Message 94928 - Posted: 4 Apr 2005, 19:57:31 UTC

That one will miff a few. Credit should be granted.

We should start a campaign "No Credit, No Crunch" !

ID: 94928 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 94934 - Posted: 4 Apr 2005, 20:07:14 UTC - in response to Message 94928.  

> That one will miff a few. Credit should be granted.
>
> We should start a campaign "No Credit, No Crunch" !
>
Tony: "yeah.. chanting, NO Credit, No Crunch.....No credit, No crunch..... No credit, no Crunch"

Forum user: "tony, what's that crunching noise in the background?"

Tony: "Ummmm.. Errrrr... Never mind.. got to go, bye"
ID: 94934 · Report as offensive
Profile Digger
Volunteer tester

Send message
Joined: 4 Dec 99
Posts: 614
Credit: 21,053
RAC: 0
United States
Message 94937 - Posted: 4 Apr 2005, 20:10:36 UTC - in response to Message 94915.  

> Well thought i had seen it all ??
> Zero credit granted for a WU, caused by too many succes results ?
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=11196405
>
> Just wanted to share this
>
> Bukken
>

Dang! That really bites. I had a unit that got zero credit because i was the ONLY one to crunch it successfully, i had no idea you could lose credit if too MANY people were successful.

Yikes!

Dig
ID: 94937 · Report as offensive
ABT Chuck P
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 91
Credit: 316,669
RAC: 0
United States
Message 94950 - Posted: 4 Apr 2005, 20:28:50 UTC - in response to Message 94915.  

> Well thought i had seen it all ??
> Zero credit granted for a WU, caused by too many succes results ?
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=11196405
>
> Just wanted to share this
>
> Bukken
>
> Keep Crunching
=========================
Looking at the result ID's for the completed ones they all say workunit error - check skipped.



ID: 94950 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 94951 - Posted: 4 Apr 2005, 20:29:28 UTC

This sort of WU represents much less than 1% of the 158 results of my study. In fact, there was only one like occurrence. this one however WAS granted credit. WU ID 8229712. In 99% of the time ONE wu is issued each time a result gets back ONE error. This one like the one on this thread however reissued it two more times than I think it should have.

In other words, both should have validate with the sixth issue, the 7th and 8th appear to be unnecessary. it might be something in the Validator software.

In any case, it doesn't happen often enough to be a big deal.

(2 cents inserted)

tony


ID: 94951 · Report as offensive
Pascal, K G
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2343
Credit: 150,491
RAC: 0
United States
Message 94964 - Posted: 4 Apr 2005, 21:03:29 UTC

Problem was each WU was, Validate state Workunit error - check skipped



stderr out 4.19





Validate state Workunit error - check skipped
Claimed credit 43.6372467879204
Granted credit 0
application version 4.09

Semper Eadem
So long Paul, it has been a hell of a ride.

Park your ego's, fire up the computers, Science YES, Credits No.
ID: 94964 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 95030 - Posted: 4 Apr 2005, 22:42:14 UTC - in response to Message 94915.  

> Well thought i had seen it all ??
> Zero credit granted for a WU, caused by too many succes results ?
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=11196405
>
> Just wanted to share this
>

6 computers managed calculating 6 different answers, and the validator didn't manage finding a pair of results to be "similar enough". Since getting different answers every time can be due to buggy application or something in the wu, instead of trying an unlimited number of times the wu errored out instead.
Also, it's not certain the disrepancies is due to application/wu, it can be due to hardware-problems or cheaters or buggy OS or something.

Anyway, these wu seems to be few and far between, it's much bigger chance for getting zero credit due to other reasons.
ID: 95030 · Report as offensive
Profile Dr Grey

Send message
Joined: 27 May 99
Posts: 154
Credit: 104,147,344
RAC: 21
United Kingdom
Message 95038 - Posted: 4 Apr 2005, 22:52:31 UTC

Maybe the wu contains what we've all been looking for and the validator has fallen over with shock?
ID: 95038 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 95050 - Posted: 4 Apr 2005, 23:18:01 UTC - in response to Message 94951.  

> This sort of WU represents much less than 1% of the 158 results of my study.
> In fact, there was only one like occurrence. this one however WAS granted
> credit. WU ID 8229712.
> In 99% of the time ONE wu is issued each time a result gets back ONE error.
> This one like the one on this thread however reissued it two more times than I
> think it should have.

Going by the avarded credit, 6 results was used when deciding the crediting, meaning needed all results to validate the wu.

The 7th issue didn't get any credit since was returned after his deadline, and after all other results accounted for.

>
> In other words, both should have validate with the sixth issue, the 7th and
> 8th appear to be unnecessary. it might be something in the Validator
> software.

If only 6 issues had been enough, the 7th would never have been issued. Also, the 8th was only issued due to 7th didn't return before his deadline.

ID: 95050 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 95062 - Posted: 4 Apr 2005, 23:40:52 UTC - in response to Message 95050.  
Last modified: 4 Apr 2005, 23:44:15 UTC

> If only 6 issues had been enough, the 7th would never have been issued. Also,
> the 8th was only issued due to 7th didn't return before his deadline.
>
From looking at my results(my little study) it seemed that 4 successfully reported WUs (near same time anyway, and claimed credit)generally are enough to validate. I can't know what was really reported though. this is why I said "I can't understand why there was a 7th and 8th, it's also the reason it's strange.

The 7th WU reported back on 11 Mar 2005 17:58:56 UTC, but the 8th Wu was issued on 8 Mar 2005 1:18:28 UTC, so the 8th doesn't appear to have been triggered by the failure of the 7th..... Oh wait a minute, I see it, the 7th reported back late, but was still granted "over- success-done" status instead of "Over-no reply-new" as I would have suspected, So the 7ths' lateness caused the issuance of the 8th.

But again, why was there a need for either, or atleast any more?

thanks
tony

Anyway the reason for my previous post was to show they were statistical freaks and should be a cause for concern
ID: 95062 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 95254 - Posted: 5 Apr 2005, 13:01:57 UTC - in response to Message 95062.  
Last modified: 5 Apr 2005, 13:09:48 UTC

> From looking at my results(my little study) it seemed that 4 successfully
> reported WUs (near same time anyway, and claimed credit)generally are enough
> to validate. I can't know what was really reported though. this is why I
> said "I can't understand why there was a 7th and 8th, it's also the reason
> it's strange.

You needs 3 "success"-results before validation is tried, and the validator doesn't care whatever cpu-time and claimed credit are when it comes to validating a result or not.

>
> But again, why was there a need for either, or atleast any more?
>

For some reason 5 different computers managed producing 5 results so differently from eachother they didn't pass validation, and therefore a 6th result was sent out to try getting the wu validated.

This old example shows how it's possible 3 results fails validation while 4 passes validation, and is easily expanded to 4 failing/5 validated.
Since the seti-validator doesn't work exactly like this example-validator, 5 failing/6 validated is also possible. ;)
ID: 95254 · Report as offensive
Metod, S56RKO
Volunteer tester

Send message
Joined: 27 Sep 02
Posts: 309
Credit: 113,221,277
RAC: 9
Slovenia
Message 95557 - Posted: 6 Apr 2005, 7:54:41 UTC - in response to Message 95254.  
Last modified: 6 Apr 2005, 7:56:26 UTC

> > But again, why was there a need for either, or atleast any more?
> >
>
> For some reason 5 different computers managed producing 5 results so
> differently from eachother they didn't pass validation, and therefore a 6th
> result was sent out to try getting the wu validated.

Now I don't understand the validation anymore. From what you're saying I'd guess that validator is doing something like this:

- take 2 results and compare. If they are off by more than 1% (or whatever particular margin is), saj by 1.1%, it's not OK.
- take the third one, compare it to the first one. Say it's off by 0.6%, then it's OK.
- take the second one and compare it to either (first and third). If it's off by less than 1% from either of them (in this case it'd be something like 0.5% off from the third), then it's OK.

Is this it?

My initial guess was that the vaildator only OKs results which are not more than whatever margin is apart and any results that fall in between. On the second thaught you can't really say which group of results is more correct if you have some even distribution of errors ...
Metod ...
ID: 95557 · Report as offensive

Message boards : Number crunching : Too many Succes results


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.