Validation although result is not correct

Questions and Answers : GPU applications : Validation although result is not correct
Message board moderation

To post messages, you must log in.

AuthorMessage
alpina

Send message
Joined: 18 Dec 08
Posts: 22
Credit: 32,011
RAC: 0
Belgium
Message 849991 - Posted: 6 Jan 2009, 4:25:52 UTC

I just returned my result for this interesting workunit where you seem to have all kind of errors in one single workunit. My result is the last one and it was run on my 8800gts, thus using CUDA. My result validated fine against the first result. Then there are 2 CUDA results wich finished with an overflow and there is 1 result which is different but reported no errors, this ran on a MAC.

I can understand that credits are granted for users who are running the very beta-ish performing CUDA and returning invalid results because it's not really their responsibility but I can't quite understand why you would grant credit to a non-CUDA host which returns invalid results(I think it is an invalid result by looking at the stderr out).

I found another strange situation with this workunit where the 3 tasks were granted credit although there doesn't seem to be a matching result between any of them.

Can anyone explain what is going on here?


BOINC.BE: The team for Belgians and their friends who love the smell of glowing red cpu's in the morning
ID: 849991 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 850245 - Posted: 6 Jan 2009, 23:26:06 UTC - in response to Message 849991.  

Jeff said that he found the bug that was causing this. Don't know if he has put the fix into production yet.

Eric
@SETIEric@qoto.org (Mastodon)

ID: 850245 · Report as offensive
Maik

Send message
Joined: 15 May 99
Posts: 163
Credit: 9,208,555
RAC: 0
Germany
Message 850381 - Posted: 7 Jan 2009, 4:49:29 UTC - in response to Message 849991.  

8999224 (alpina) wrote:
... I can understand that credits are granted for users who are running the very beta-ish performing CUDA and returning invalid results ...

8999224 (alpina) wrote:
... Then there are 2 CUDA results wich finished with an overflow ...

It seems you think that this two and all other people with this error are responsible for the errors comming up. How do you know this? Please explain that.
ID: 850381 · Report as offensive
alpina

Send message
Joined: 18 Dec 08
Posts: 22
Credit: 32,011
RAC: 0
Belgium
Message 850448 - Posted: 7 Jan 2009, 13:46:50 UTC - in response to Message 850381.  
Last modified: 7 Jan 2009, 13:47:39 UTC

8999224 (alpina) wrote:
... I can understand that credits are granted for users who are running the very beta-ish performing CUDA and returning invalid results ...

8999224 (alpina) wrote:
... Then there are 2 CUDA results wich finished with an overflow ...

It seems you think that this two and all other people with this error are responsible for the errors comming up. How do you know this? Please explain that.

No, I did not imply that. I said that it's understandable that people who return false results running CUDA get credit since the CUDA application(and every CUDA application) is not yet stable.

Whereas the situation is different with the other applications(windows, mac,linux..) which have been proven to be stable.


BOINC.BE: The team for Belgians and their friends who love the smell of glowing red cpu's in the morning
ID: 850448 · Report as offensive
Maik

Send message
Joined: 15 May 99
Posts: 163
Credit: 9,208,555
RAC: 0
Germany
Message 850469 - Posted: 7 Jan 2009, 16:05:26 UTC
Last modified: 7 Jan 2009, 16:07:40 UTC

I'm sorry! I had lay wrongly.
ID: 850469 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 850470 - Posted: 7 Jan 2009, 16:12:15 UTC


In every scientific project their is an extremely high priority set on maintaining the integrity of the data. Under no circumstances should bad data be allowed into the data base. But that is in fact what has happened here.

Now nearly 3 weeks after CUDA was released it is proven that bad data from CUDA can and is getting into the scientific master data base. Cuda should have been withdrawn long ago as it never was ready for release. That it is still in use is the responsibility of the project.

Those of us who have used or are currently using CUDA are at some fault also. All of us know the problems with CUDA and many are still using it. We all know that bad data could enter the data base but many continue to use CUDA. To continue to use CUDA would not be what a true scientist would advise.

Returned work that is not valid should not receive credit. Period, end of statement.

Boinc....Boinc....Boinc....Boinc....
ID: 850470 · Report as offensive
Profile Gundolf Jahn

Send message
Joined: 19 Sep 00
Posts: 3184
Credit: 446,358
RAC: 0
Germany
Message 850499 - Posted: 7 Jan 2009, 17:52:26 UTC - in response to Message 850470.  

...Under no circumstances should bad data be allowed into the data base. But that is in fact what has happened here...

What leads you to that assumption? The fact that credits have been granted doesn't mean that the results are transferred to the database.

Gruß,
Gundolf
Computer sind nicht alles im Leben. (Kleiner Scherz)

SETI@home classic workunits 3,758
SETI@home classic CPU time 66,520 hours
ID: 850499 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 850524 - Posted: 7 Jan 2009, 18:30:59 UTC

I am talking about several instances where Cuda work was paired with another cruncher using Cuda and a third using the stock app. The stock app came up with a different answer than the two Cuda work units. The Cuda work was granted credit and one of those made it as the canonical result and went into the master science data base. The exact work unit number has now been removed by the file deleter and cannot be found.

The fact that the Cuda work went into the master science data base is what I am talking about.
Boinc....Boinc....Boinc....Boinc....
ID: 850524 · Report as offensive
Profile Gundolf Jahn

Send message
Joined: 19 Sep 00
Posts: 3184
Credit: 446,358
RAC: 0
Germany
Message 850643 - Posted: 8 Jan 2009, 0:49:06 UTC - in response to Message 850524.  

I am talking about several instances where Cuda work was paired with another cruncher using Cuda and a third using the stock app. The stock app came up with a different answer than the two Cuda work units. The Cuda work was granted credit and one of those made it as the canonical result and went into the master science data base...

Okay, that scenario could cause the wrong result to be stored, but only if the both CUDA hosts return the same erroneous result (not very likely IMO).

What I was saying is that just the fact of credit being granted doesn't mean that the result was accepted, because the granting was possibly done by a script.

Gruß,
Gundolf
Computer sind nicht alles im Leben. (Kleiner Scherz)

SETI@home classic workunits 3,758
SETI@home classic CPU time 66,520 hours
ID: 850643 · Report as offensive

Questions and Answers : GPU applications : Validation although result is not correct


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.