Umm, 3 results returned for one work unit, but no credit granted

Message boards : Number crunching : Umm, 3 results returned for one work unit, but no credit granted
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 57959 - Posted: 28 Dec 2004, 12:47:10 UTC

What gives here, and when will I get credit?

http://setiweb.ssl.berkeley.edu/workunit.php?wuid=5661638

Why isn't credit being allocated with 3 results in already, and when will I get it?

ID: 57959 · Report as offensive
STE\/E
Volunteer tester

Send message
Joined: 29 Mar 03
Posts: 1137
Credit: 5,334,063
RAC: 0
United States
Message 57962 - Posted: 28 Dec 2004, 13:31:29 UTC

All 3 Pending WU's show "Checked, but no consensus yet", so the Validator didn't like something about them I would take it and the WU was sent out again for another person to do to see if it matched the other returned results better ...
ID: 57962 · Report as offensive
mikep
Volunteer tester

Send message
Joined: 12 Aug 01
Posts: 2
Credit: 15,509,650
RAC: 0
United Kingdom
Message 57963 - Posted: 28 Dec 2004, 13:36:48 UTC - in response to Message 57959.  

If there is an answer I'd appreciate the same for work units 347949,162257,909934 all of which show three sucessful results but still showing as pending in my account. And even stranger units 5796714,877653,8909744,8909744 which all show 4 sucessful results and nothing credited and showing pending still.


> What gives here, and when will I get credit?
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=5661638
>
> Why isn't credit being allocated with 3 results in already, and when will I
> get it?
>
ID: 57963 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 57965 - Posted: 28 Dec 2004, 14:02:22 UTC - in response to Message 57963.  

> If there is an answer I'd appreciate the same for work units
> 347949,162257,909934 all of which show three sucessful results but still
> showing as pending in my account.

"Too many total results", in other words these wu have errored-out and will not give credit.

> And even stranger units
> 5796714

The same as in 1st. post in this thread, "No consensus yet". These wu is re-issued to either a consensus is reached, or errors out. It means, the validator didn't find a pair of results to be "nearly similar".

> 877653

This wu should have been re-surrected then the fix for re-issuing inconclusive wu was added beginning of December. But since from August, it's possible got permanently corrupted in one of the crashes...

> 8909744,8909744 which all show 4 sucessful results and nothing
> credited and showing pending still.
>

Unknown wu..., sure it's not a typing-error, especially since repeated the same wu twice, and currently only at around 7M wu?
ID: 57965 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 58003 - Posted: 28 Dec 2004, 20:57:47 UTC

At least in run time the first 2, my Athlon XP 1900+ and the other PC are close. It taking slightly less time makes sense, as it was a dual Pentium 4 2.8 GHz... Not sure about Apple's off the top of my head so can't comment. People not returning results (was addressed in other threads with people setting their queues too high and stuff).

Are we essentially screwed for getting credit, will we ever see it, what's going on?

ID: 58003 · Report as offensive
Scott Brown

Send message
Joined: 5 Sep 00
Posts: 110
Credit: 59,739
RAC: 0
United States
Message 58005 - Posted: 28 Dec 2004, 21:13:48 UTC - in response to Message 58003.  

> At least in run time the first 2, my Athlon XP 1900+ and the other PC are
> close. It taking slightly less time makes sense, as it was a dual Pentium 4
> 2.8 GHz... Not sure about Apple's off the top of my head so can't comment.
> People not returning results (was addressed in other threads with people
> setting their queues too high and stuff).

The run time is not relevant to validation. What matters is how similar the actual calculations from the unit are from machine to machine. Thus, it is not unusual to have units done by machines with very different run times that all receive credit.

> Are we essentially screwed for getting credit, will we ever see it, what's
> going on?

On the "errored out" units (those sent to the limit of number of hosts), you will never see credits as these units will never be resent.
ID: 58005 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 58050 - Posted: 28 Dec 2004, 23:31:15 UTC - in response to Message 58003.  

> At least in run time the first 2, my Athlon XP 1900+ and the other PC are
> close. It taking slightly less time makes sense, as it was a dual Pentium 4
> 2.8 GHz... Not sure about Apple's off the top of my head so can't comment.
> People not returning results (was addressed in other threads with people
> setting their queues too high and stuff).
>
> Are we essentially screwed for getting credit, will we ever see it, what's
> going on?
>

Your wu have been re-distributed, so you can still get credit for this.

Looking more closely on the 3 computers, Amd, Intel & Apple. The powermac is mostly returning garbage and only on a very limited supply of his results is validation passed, so it's not unreasonable to expect his result isn't comparable with either of the 2 others for your wu.

Both the Amd & Intel seems to be performing correctly, but differences in cpu & os can sometimes gives so large difference that fails validation against eachother.
But, another p4 have now got this wu to crunch, and most likely this result then returned will be "similar enough" so wu now validated, and these 3 will get credit.

The powermac on the other hand very likely will fail validation for this wu also...
ID: 58050 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 58166 - Posted: 29 Dec 2004, 9:12:27 UTC - in response to Message 58005.  

> > At least in run time the first 2, my Athlon XP 1900+ and the other PC
> are
> > close. It taking slightly less time makes sense, as it was a dual
> Pentium 4
> > 2.8 GHz... Not sure about Apple's off the top of my head so can't
> comment.
> > People not returning results (was addressed in other threads with people
> > setting their queues too high and stuff).
>
> The run time is not relevant to validation. What matters is how similar the
> actual calculations from the unit are from machine to machine. Thus, it is
> not unusual to have units done by machines with very different run times that
> all receive credit.
>

There is some relevence in a round about way. It indicates how long a given comp (in relation to each other) took to complete the given work unit (aka a given amount of work).

When one looks at performance benchmarks, pretty much any which can be used on a CPU, video card, etc...it has a given job to complete, and it measures how long it takes each competitive product to complete the work given. The use of standardized tests is how many review sites compare Intel vs. AMD's lattest gen processors, nVidia vs. ATI's lattest is compared, etc.

This said, it would give one reason to scratch their head if a Pentium 4 3 GHz took substantially longer to complete a given unit of work, then a 300 MHz Celeron, given what we know about the relative performance differences between these products. True to form with this, the computers that usually claim less credit then mine are either high GHz Pentium 4s (like P4 3.0as), and I'd expect Athlon 64s. Usually Celerons, Pentiums (have seen a couple) take a lot longer to complete then my AXP 1900+

Though it's differences in results that do matter, oddities in the time to completion can be indication of something. This is what I was taking into account, though I'm not familiar enough with Macs and how they stack up performance wise (in benchmarks for instance) to know if his was out of whack...

ID: 58166 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 58167 - Posted: 29 Dec 2004, 9:21:24 UTC - in response to Message 58050.  

> Your wu have been re-distributed, so you can still get credit for this.
>
> Looking more closely on the 3 computers, Amd, Intel & Apple. The powermac
> is mostly returning garbage and only on a very limited supply of his results
> is validation passed, so it's not unreasonable to expect his result isn't
> comparable with either of the 2 others for your wu.

Yeah, it's just been redistributed. Thanks for the heads up. Hopefully all will turn out well for both this work unit, and the rest of us who processed it/will...

I wonder if they have a means to notify the user of that Mac concerning a problem with his results... Not sure what's going on, but obviously if he wants to contribute to the project he'll need to address his PC.

Anyhow, thx again...

ID: 58167 · Report as offensive
mikep
Volunteer tester

Send message
Joined: 12 Aug 01
Posts: 2
Credit: 15,509,650
RAC: 0
United Kingdom
Message 58399 - Posted: 30 Dec 2004, 14:32:29 UTC - in response to Message 57965.  


Sorry was a misstype should be 890974 and 802411 both of which show 4 results all with no errors

> > If there is an answer I'd appreciate the same for work units
> > 347949,162257,909934 all of which show three sucessful results but still
> > showing as pending in my account.
>
> "Too many total results", in other words these wu have errored-out and will
> not give credit.
>
> > And even stranger units
> > 5796714
>
> The same as in 1st. post in this thread, "No consensus yet". These wu is
> re-issued to either a consensus is reached, or errors out. It means, the
> validator didn't find a pair of results to be "nearly similar".
>
> > 877653
>
> This wu should have been re-surrected then the fix for re-issuing inconclusive
> wu was added beginning of December. But since from August, it's possible got
> permanently corrupted in one of the crashes...
>
> > 8909744,8909744 which all show 4 sucessful results and nothing
> > credited and showing pending still.
> >
>
> Unknown wu..., sure it's not a typing-error, especially since repeated the
> same wu twice, and currently only at around 7M wu?
>
ID: 58399 · Report as offensive
Profile littleBouncer
Volunteer tester
Avatar

Send message
Joined: 28 May 99
Posts: 151
Credit: 666,283
RAC: 0
Switzerland
Message 58417 - Posted: 30 Dec 2004, 16:26:36 UTC - in response to Message 58399.  
Last modified: 30 Dec 2004, 16:58:17 UTC

> Sorry was a misstype should be 890974 and 802411 both of which show 4 results
> all with no errors
>
> > > And even stranger units
> > > 5796714
> >
> > The same as in 1st. post in this thread, "No consensus yet". These wu is
> > re-issued to either a consensus is reached, or errors out. It means, the
> > validator didn't find a pair of results to be "nearly similar".
> >
> > > 877653
> >
> > This wu should have been re-surrected then the fix for re-issuing
> inconclusive
> > wu was added beginning of December. But since from August, it's possible
> got
> > permanently corrupted in one of the crashes...
> >
> > > 8909744,8909744 which all show 4 sucessful results and nothing
> > > credited and showing pending still.
> > >

======

Since 2 days (12.28.04) every result returns with "pending" on two different machines (host: 368059 and 360502); at least three results per WU was success.
What is wrong, what is going on?
How can I see that two results are "enough similar"???

See here for those pending results (over 40 the last two days):
http://setiweb.ssl.berkeley.edu/results.php?userid=7806448&offset=40
For example this: http://setiweb.ssl.berkeley.edu/workunit.php?wuid=6884054
or: http://setiweb.ssl.berkeley.edu/workunit.php?wuid=6837692
on this results-page (there are more...).

Before (12.28.04) all was running fine with Seti, no changes was taken, and now...???
thanks for reply


ID: 58417 · Report as offensive
SURVEYOR
Volunteer tester

Send message
Joined: 19 Oct 02
Posts: 375
Credit: 608,422
RAC: 0
United States
Message 58427 - Posted: 30 Dec 2004, 17:15:42 UTC

In progress 1,837,168 wu
so lets say 4 hr per wu, but we will use 1 per day.
Thats 1,837,168 wu return per day devide by three - 612
So the validater has to process at least 612 wu per day looking at three results each. It just takes time. What if the above wu are the third results for a wu, now thats makes 5511504 wu it's has to review per day. the last result was only received today.

Fred
BOINC Alpha, BOINC Beta, LHC Alpha, Einstein Alpha
ID: 58427 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 58430 - Posted: 30 Dec 2004, 17:21:35 UTC - in response to Message 58417.  
Last modified: 30 Dec 2004, 17:24:48 UTC

> > Sorry was a misstype should be 890974 and 802411 both of which show 4
> results
> > all with no errors

Hmm, ah, see the problem, these should be re-sent, but don't expect this to happen before the new database is up and running. ;)

>
> ======
>
> Since 2 days (12.28.04) every result returns with "pending" on two different
> machines (host: 368059 and 360502); at least three results per WU was
> success.
> What is wrong, what is going on?
> How can I see that two results are "enough similar"???
>

Even the status-page says otherwise, either the transitioner or the validator or both is backlogged, so these wu haven't been through the validator yet. Or, the replicate-database is lagging behind, so even the wu already is validated this isn't showing up on the status-pages yet.

For a little more info, look at the Technical News.
ID: 58430 · Report as offensive
Profile littleBouncer
Volunteer tester
Avatar

Send message
Joined: 28 May 99
Posts: 151
Credit: 666,283
RAC: 0
Switzerland
Message 58443 - Posted: 30 Dec 2004, 19:04:51 UTC - in response to Message 58430.  
Last modified: 30 Dec 2004, 19:05:56 UTC


> For a little more info, look at the Technical News.
>
=====

I didn't right unterstand (or missunterstood)the statements there; Thanks for reply ;-)
(now I got it!)

ID: 58443 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 59000 - Posted: 1 Jan 2005, 12:47:50 UTC

Lets hope a new database would fix the issue with the validator falling behind (something that has been happening for several days now). If it's consistently unable to validate as quickly as people send the results up...and people don't back off the processing of SETI units (a problem that could get worse as more people transition from SETI classic), this is only a problem that could get worse.

Following your example (and of course all our computers having different performing processors can complete units in dif amounts of time, but for simplification), lets say the validator processes 500 units per day, but 613 are being uploaded.

Now on day 2, the day would start with 113 (613 - 500 units) un-validated. It would validate another 500 units, except another 613 would be added. As a result there would be 113 unvalidated work units from the previous day + another 613 to be validated. This would bring the total to validate up to 726. But only 500 get validated again, leaving now 226 units left to be validated on day 3, etc... This is a problem that could grow ever worse, with more unvalidated units left on the dBase to yet be validated. This is without even adding an increasing number of SETI classic users migrating over.

Hopefully more validators will be added to the mix or something?

ID: 59000 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 59312 - Posted: 2 Jan 2005, 14:56:14 UTC

Well, as Matt said ...

He is working on new hardware to stand up and hopefully this will ease the burden.
ID: 59312 · Report as offensive
98251

Send message
Joined: 3 Mar 04
Posts: 15
Credit: 7,955
RAC: 0
Netherlands
Message 59332 - Posted: 2 Jan 2005, 17:11:59 UTC

there is something wrong with this wu: 7107925 just look at the CPU times and at the CPU's mine pentium M is by far the slowest of the three, but returned the wu a lot faster than the other two so I guess this one won't get credit when number four turns in hs results.
ID: 59332 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 59339 - Posted: 2 Jan 2005, 18:10:45 UTC - in response to Message 59332.  

> there is something wrong with this wu: 7107925 just look at the CPU times and
> at the CPU's mine pentium M is by far the slowest of the three, but returned
> the wu a lot faster than the other two so I guess this one won't get credit
> when number four turns in hs results.
>

How fast a computer crunches seti-wu isn't only dependend on how fast the cpu is running, but also on other components like memory, mainboard and OS, and for a lesser extent on other processes running at the same time.

Taking a little look on this wu, it's one of the new wu initially sent out to 4 users, but is tried validated after 3 results. Since the results still shows validation-state "initial", they've not been tried validated yet but is waiting in the backlogged validator-queue. So atleast for the moment, nothing indicates there's anything wrong with this wu, and all current result seems consistent since they're showing "-9 too many signals".

ID: 59339 · Report as offensive
Hans Dorn
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2262
Credit: 26,448,570
RAC: 0
Germany
Message 59593 - Posted: 3 Jan 2005, 2:10:56 UTC - in response to Message 59332.  

> there is something wrong with this wu: 7107925 just look at the CPU times and
> at the CPU's mine pentium M is by far the slowest of the three, but returned
> the wu a lot faster than the other two so I guess this one won't get credit
> when number four turns in hs results.
>

The pentium-m, especially the new dothan with 2MB L2 cache, is a pretty fast cruncher.
Don't let the low GHz fool you.
It's doing a lot more work per clock cycle than a P4, for example.

Regards Hans

ID: 59593 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 136
Credit: 1,703,351
RAC: 0
United States
Message 59697 - Posted: 3 Jan 2005, 7:14:07 UTC - in response to Message 59339.  

> How fast a computer crunches seti-wu isn't only dependend on how fast the cpu
> is running, but also on other components like memory, mainboard and OS, and
> for a lesser extent on other processes running at the same time.
>

BTW, it seems other processes running might have a minimal effect. After I started running BOINC, I also started running folding@home in parallel. I have f@h set to a slightly higher CPU utilization (so it runs) but set back to only use 50% of the CPU so seti can also run.

Before and after, the amount of time SETI work units takes to complete is as follows:

- Naturally it takes them longer to complete, however
- the time boinc says it was running for does not increase at all In this case, when it says 1 sec has gone by, more time has passed in real time. I can only imagine this is taking into account time it ran on the CPU, else it should be showing much longer running times for a SETI work unit in the interface with folding taking half the CPU. It doesn't.

Also the claimed credit is still rather consistent (doesn't show any breaks from the former trend) with or without folding running.

And for the other poster, clock isn't everything. The Athlon 64, I'd have to check this again, but for a given performance rating (aka 3000+ etc), the actual clock might be below some of the higher clocked Athlon XPs, but the Athlon 64 is a real processing power house. It's not all clock...

ID: 59697 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : Umm, 3 results returned for one work unit, but no credit granted


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.