BIIIIIGGGG!!!!! PENALTY!

Message boards : Number crunching : BIIIIIGGGG!!!!! PENALTY!
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile LarryB56
Volunteer tester
Avatar

Send message
Joined: 22 Apr 02
Posts: 73
Credit: 4,402,310
RAC: 0
United States
Message 115079 - Posted: 26 May 2005, 10:09:12 UTC

3.0 GHz Xeon 11,648 Seconds Claimed Credit=12.78
1.8 GHz G5-Single Proc. 11,756 Seconds Claimed Credit=23.87

Now, That's what I call a PENALTY!!!!!

Work Unit: 02fe05aa.20326.11378.86072.25
Here: http://setiweb.ssl.berkeley.edu/workunit.php?wuid=16029260
LarryB56
ID: 115079 · Report as offensive
Profile Bruno G. Olsen & ESEA @ greenholt
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 875
Credit: 4,386,984
RAC: 0
Denmark
Message 115080 - Posted: 26 May 2005, 10:15:14 UTC

One of the reasons is different boinc cc versions.


ID: 115080 · Report as offensive
Profile Tigher
Volunteer tester

Send message
Joined: 18 Mar 04
Posts: 1547
Credit: 760,577
RAC: 0
United Kingdom
Message 115084 - Posted: 26 May 2005, 10:22:29 UTC
Last modified: 26 May 2005, 10:28:33 UTC

They are optimised clients....boinc and seti?
What are the benchmarks for each system? You may have to install an optimised boinc client to get the benchmarks up perhaps? Looking at your bench marks they are low. Re-run them with nothing else going on in the system. Try an optimised clinet for boinc and then re-run. I get ~5% extra just through turning off virus scanner during benchnark.

ID: 115084 · Report as offensive
Profile MattDavis
Volunteer tester
Avatar

Send message
Joined: 11 Nov 99
Posts: 919
Credit: 934,161
RAC: 0
United States
Message 115089 - Posted: 26 May 2005, 11:32:06 UTC

The science gets done accurately since they can compare results on different systems. That's a penalty? 8)
-----
ID: 115089 · Report as offensive
Profile spacemeat
Avatar

Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 115108 - Posted: 26 May 2005, 13:11:56 UTC

xeons are lousy at seti. my 2.8's get spanked by my Pentium-M 1400
ID: 115108 · Report as offensive
Profile Thierry Van Driessche
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3083
Credit: 150,096
RAC: 0
Belgium
Message 115124 - Posted: 26 May 2005, 14:02:11 UTC - in response to Message 115079.  
Last modified: 26 May 2005, 14:02:47 UTC

3.0 GHz Xeon 11,648 Seconds Claimed Credit=12.78
1.8 GHz G5-Single Proc. 11,756 Seconds Claimed Credit=23.87

Now, That's what I call a PENALTY!!!!!

Not really.
The Xeon is crunching 4 WU's at the same time, thus that host is getting
4X12.78=51.12 credits for a certain time frame, the G5-Single Proc. get only 23.87 credits for roughly the same time frame.
ID: 115124 · Report as offensive
Profile spacemeat
Avatar

Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 115129 - Posted: 26 May 2005, 14:28:31 UTC - in response to Message 115124.  

3.0 GHz Xeon 11,648 Seconds Claimed Credit=12.78
1.8 GHz G5-Single Proc. 11,756 Seconds Claimed Credit=23.87

Now, That's what I call a PENALTY!!!!!

Not really.
The Xeon is crunching 4 WU's at the same time, thus that host is getting
4X12.78=51.12 credits for a certain time frame, the G5-Single Proc. get only 23.87 credits for roughly the same time frame.


doesn't matter, the xeons should still be either going faster or claiming more credit. by your argument, the xeon should be claiming around 4 x 23.87 = 95.48 credits in the same time frame as a single CPU. at just over half that now, it is falling well short of its potential. with optimized clients, my slower 2.8 xeons take only 6-8k seconds per unit and claim 12-14 credits.
ID: 115129 · Report as offensive
Profile Thierry Van Driessche
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3083
Credit: 150,096
RAC: 0
Belgium
Message 115135 - Posted: 26 May 2005, 15:37:17 UTC - in response to Message 115129.  
Last modified: 26 May 2005, 15:40:36 UTC

doesn't matter, the xeons should still be either going faster or claiming more credit. by your argument, the xeon should be claiming around 4 x 23.87 = 95.48 credits in the same time frame as a single CPU. at just over half that now, it is falling well short of its potential. with optimized clients, my slower 2.8 xeons take only 6-8k seconds per unit and claim 12-14 credits.

It is not that easy to compare your Xeon with the 3.0GHz one.

Your Xeon has 1GB RAM, the other 4. Your is a 2 CPU, the other a 4 CPU host.

Your host is running Microsoft Windows XP Professional Edition, Service Pack 2, (05.01.2600.00), the other is running Linux 2.4.21-27.0.4.ELsmp.

Your has a Measured floating point speed of 1510.74 million ops/sec and a Measured integer speed of 1385.37 million ops/sec, the other has a Measured floating point speed of 634.94 million ops/sec and a Measured integer speed of 1262.3 million ops/sec.

As a result, you host has a lower CPU time but finally both are nearly equal in claimed credit.

ID: 115135 · Report as offensive
Profile spacemeat
Avatar

Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 115203 - Posted: 26 May 2005, 20:32:55 UTC - in response to Message 115135.  


Your has a Measured floating point speed of 1510.74 million ops/sec and a Measured integer speed of 1385.37 million ops/sec, the other has a Measured floating point speed of 634.94 million ops/sec and a Measured integer speed of 1262.3 million ops/sec.


and thats what i think indicates a problem. OS and RAM should not make that significant a difference in CPU benchmarks, especially on a faster CPU. maybe the BOINC client has something to do with it, but its a major performance drop if so.

if the benchmarks are higher, his WU time would claim a more normal credit number
ID: 115203 · Report as offensive
Profile The Pirate
Volunteer tester
Avatar

Send message
Joined: 14 Apr 00
Posts: 191
Credit: 4,929,008
RAC: 0
United States
Message 115268 - Posted: 27 May 2005, 1:44:45 UTC

With the default linux Boinc, the bench marks are only about 1/2 the bench marks for windows. On my linux boinc boxes, after I upgraded to one of the optmised boinc cc my bench marks and requested credits doubled. So far in the Boinc world, linux is getting the short end of the stick.

ID: 115268 · Report as offensive
Profile Tigher
Volunteer tester

Send message
Joined: 18 Mar 04
Posts: 1547
Credit: 760,577
RAC: 0
United Kingdom
Message 115830 - Posted: 28 May 2005, 20:32:22 UTC - in response to Message 115268.  

With the default linux Boinc, the bench marks are only about 1/2 the bench marks for windows. On my linux boinc boxes, after I upgraded to one of the optmised boinc cc my bench marks and requested credits doubled. So far in the Boinc world, linux is getting the short end of the stick.


Agreed. Did the same and now my fc3 box is just slower than windows on average.


ID: 115830 · Report as offensive
Profile ilyanep

Send message
Joined: 16 Nov 04
Posts: 90
Credit: 3,172,949
RAC: 9
United States
Message 115990 - Posted: 29 May 2005, 0:08:14 UTC - in response to Message 115089.  

The science gets done accurately since they can compare results on different systems. That's a penalty? 8)


xeon's are lousy at just about anything.
<a href="http://tinyurl.com/9hemz"><img src="http://www.boincsynergy.com/images/stats/comb-1441.jpg"></img></a>
ID: 115990 · Report as offensive
N/A
Volunteer tester

Send message
Joined: 18 May 01
Posts: 3718
Credit: 93,649
RAC: 0
Message 116088 - Posted: 29 May 2005, 8:34:00 UTC

[font="fixedsys,courier"]Maybe I haven't been in Numbers as often as I should have, but could you explain what you meant by "penalty"?[/font]
ID: 116088 · Report as offensive
Cameron
Avatar

Send message
Joined: 27 Nov 02
Posts: 110
Credit: 5,082,471
RAC: 17
Australia
Message 116137 - Posted: 29 May 2005, 13:13:24 UTC

To determine the credit that should be granted SETI uses the first three returned units [The Quorum] to determine the credit value to be granted.
(I am unsure if more than 3 units are sent out in total)

SETI discards both the upper and lower Values of this Quorum so the value in between is used as the Granted credit value.

so if the first three units have credit values of (from lowest to highest)

15.6 22.4 26.1 SETI will use the value of 22.4

now if you return a unit and you wish to get 34.2 Credit for it SETI will only grant you the 22.4 it determined from the Quorum. (a loss of 11.8)

While you gain on some you lose on others and some think such a large loss of potential credit a bit of a Penalty
ID: 116137 · Report as offensive
N/A
Volunteer tester

Send message
Joined: 18 May 01
Posts: 3718
Credit: 93,649
RAC: 0
Message 116166 - Posted: 29 May 2005, 15:33:07 UTC - in response to Message 116137.  

[font="fixedsys,courier"]Ah. To me "penalty" implies "infraction", like a red card at a soccer match.

I think a better term would be "screwed by the system", but that'll be sure to tick off the Devs.

Thanks for the clarification![/font]
ID: 116166 · Report as offensive
Bill & Patsy
Avatar

Send message
Joined: 6 Apr 01
Posts: 141
Credit: 508,875
RAC: 0
United States
Message 116174 - Posted: 29 May 2005, 16:11:58 UTC
Last modified: 29 May 2005, 16:26:36 UTC

Yeah. The THEORY is that different work units (WU's) require different amounts of computing effort, so the points awarded should reflect that. But within the SAME single WU, the amount of computation required is exactly the same regardless of machine type or speed. So the points claimed and awarded for doing a single particular WU should be exactly the same, regardless of how fast or slow a particular machine is, since the total amount of computation, and hence the total contribution to the project and to the science, will be exactly equal for that particular WU.

But the reality is very different, and the awards are very far from the same. The system does NOT work as advertised, and therefore some machines are really getting "screwed" or "penalized", as you said. The Devs must surely be aware of this, so I wouldn't worry about ticking them off. It's the participants like us who should be ticked off, since this has been going on for so long without a fix, while the Devs have been concentrating on fixing other stuff like bugs that crash people's systems, or getting BOINC to the point that Classic SETI can be shut down, etc., etc... ;-)

You might enjoy this related thread, which provides a partial way to compensate:

Here's how to Get More Credit

Enjoy!

--Bill

ID: 116174 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 116238 - Posted: 29 May 2005, 20:54:30 UTC - in response to Message 116166.  

[font="fixedsys,courier"]Ah. To me "penalty" implies "infraction", like a red card at a soccer match.

I think a better term would be "screwed by the system", but that'll be sure to tick off the Devs.

Thanks for the clarification![/font]

If everyone gets the same credit for the same work unit, how is that getting "screwed"?

Equal pay for equal work seems imminently fair.
ID: 116238 · Report as offensive
Cameron
Avatar

Send message
Joined: 27 Nov 02
Posts: 110
Credit: 5,082,471
RAC: 17
Australia
Message 116344 - Posted: 30 May 2005, 5:10:40 UTC - in response to Message 116238.  


If everyone gets the same credit for the same work unit, how is that getting "screwed"?

Equal pay for equal work seems imminently fair.


It is fair as far as I'm concerned.

This credit system is more equatable system for comparing our overall contrabution by measuring measuring our contrabution against a common reference system as opposed to a work count completed

I'm not sure how some long term contributers felt to see later entents with faster hosts overtake them on ranks they had spent years climbing in months or weeks even

It is fairer then adding all the seconds of all the hosts cycles that went towards SETIs Application (as in Classic) as the hosts will get faster and it will skew over time ranking on the older system.


ID: 116344 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 116359 - Posted: 30 May 2005, 7:45:22 UTC - in response to Message 116238.  

[font="fixedsys,courier"]Ah. To me "penalty" implies "infraction", like a red card at a soccer match.

I think a better term would be "screwed by the system", but that'll be sure to tick off the Devs.

Thanks for the clarification![/font]

If everyone gets the same credit for the same work unit, how is that getting "screwed"?

Equal pay for equal work seems imminently fair.


You are correct that every one that processes the Work Unit correctly is awarded the same Credit. However, the point that is trying to be made is that the claims made by the computers have a wide spread of values. Though the same total amount of processing is done, the mechanism for calculating the claim does not work properly.

If you process the work unit in 8 hours and claim 15 Cobblestones, and I do it in 4 hours and our answers agree; my claim should be withing 1 Cobblestone of your claim of 15. If my claim is off by more than that ... there is a severe problem ... The "throw away the top & bottom, average the rest" is a bandaid on top of somethint that is not working as expected.

YOu can see similar effects if you change to an optimized client... or a multi-CPU system. The top producing system for SETI@Home is a 64 processor cluster and it calims 0.1 to 0.3 Cobblestones per work unit...
ID: 116359 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 116546 - Posted: 30 May 2005, 19:27:03 UTC - in response to Message 116359.  


Equal pay for equal work seems imminently fair.


You are correct that every one that processes the Work Unit correctly is awarded the same Credit. However, the point that is trying to be made is that the claims made by the computers have a wide spread of values. Though the same total amount of processing is done, the mechanism for calculating the claim does not work properly.

If you process the work unit in 8 hours and claim 15 Cobblestones, and I do it in 4 hours and our answers agree; my claim should be withing 1 Cobblestone of your claim of 15. If my claim is off by more than that ... there is a severe problem ... The "throw away the top & bottom, average the rest" is a bandaid on top of somethint that is not working as expected.

YOu can see similar effects if you change to an optimized client... or a multi-CPU system. The top producing system for SETI@Home is a 64 processor cluster and it calims 0.1 to 0.3 Cobblestones per work unit...

Under no circumstances should the benchmarks be optimized.

The problem with the existing benchmark is that it doesn't handle the variation between different CPU architectures -- something that is incredibly hard to do.
ID: 116546 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : BIIIIIGGGG!!!!! PENALTY!


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.