Impact of S@H enhanced on Berkeley server load?

Message boards : Number crunching : Impact of S@H enhanced on Berkeley server load?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Speedy67 & Friends
Volunteer tester
Avatar

Send message
Joined: 14 Jul 99
Posts: 335
Credit: 1,178,138
RAC: 0
Netherlands
Message 319562 - Posted: 28 May 2006, 21:43:51 UTC

Maybe someone at Berkeley could give an indication on this question? The servers were barely keeping up before seti@home enhanced was released.... seems to me it must be a big load-reduction already!

Greetings,
Sander


ID: 319562 · Report as offensive
Profile John Clark
Volunteer tester
Avatar

Send message
Joined: 29 Sep 99
Posts: 16515
Credit: 4,418,829
RAC: 0
United Kingdom
Message 319574 - Posted: 28 May 2006, 22:22:06 UTC

Although the Cogent Link still shows a good level of use, the SETI Server Status page now shows a number of major changes -

* Results ready to send hovering steadily at 550K to 650K; down from 1.1 million
* Results creaion seem to average ~8.5WUs/sec; down from over 18
* Results in progress steady at about 1..1 million; down from 2.7 million

In all respects the introduction of Enhanced has reduced the load on the servers by nearly 50%, or, perhaps, more.
It's good to be back amongst friends and colleagues



ID: 319574 · Report as offensive
Profile Fuzzy Hollynoodles
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 9659
Credit: 251,998
RAC: 0
Message 319911 - Posted: 29 May 2006, 12:29:28 UTC - in response to Message 319574.  



...

In all respects the introduction of Enhanced has reduced the load on the servers by nearly 50%, or, perhaps, more.


This is good news. :-D



"I'm trying to maintain a shred of dignity in this world." - Me

ID: 319911 · Report as offensive
Metod, S56RKO
Volunteer tester

Send message
Joined: 27 Sep 02
Posts: 309
Credit: 113,221,277
RAC: 9
Slovenia
Message 319943 - Posted: 29 May 2006, 13:15:57 UTC - in response to Message 319574.  

Although the Cogent Link still shows a good level of use


Also Cogent link has been releived a bit - it went down from 40Mbps+ to about 20Mbps.

Metod ...
ID: 319943 · Report as offensive
Profile Clyde C. Phillips, III

Send message
Joined: 2 Aug 00
Posts: 1851
Credit: 5,955,047
RAC: 0
United States
Message 320160 - Posted: 29 May 2006, 19:27:58 UTC

So, in a nutshell, traffic has been halved by Enhanced. I wonder if there are any non-Enhanced yet being crunched (?)
ID: 320160 · Report as offensive
WendyR
Volunteer tester
Avatar

Send message
Joined: 1 Aug 05
Posts: 44
Credit: 1,962,140
RAC: 0
United States
Message 320177 - Posted: 29 May 2006, 19:52:15 UTC - in response to Message 320160.  

So, in a nutshell, traffic has been halved by Enhanced. I wonder if there are any non-Enhanced yet being crunched (?)

There are at least some left out there. My husband's computer still has about a dozen that are waiting for someone (else) to return results. About 2/3 of those are waiting for this computer. Didn't check to see what percentage of this host's 200+ units are "old" and which are enhanced units. Of those that I did look at (maybe a dozen), I found 2 "old" units that were waiting on 2 computers.

So, there are definately still a few but most will probably reach their due date in the next couple of days. Some of those might get resent out, but most of them have probably reached their quorum and will be deleted after those straggler's time out.
ID: 320177 · Report as offensive
Patrick Fowler

Send message
Joined: 3 Jun 99
Posts: 3
Credit: 6,264
RAC: 0
Canada
Message 320199 - Posted: 29 May 2006, 20:33:09 UTC

fewer users = less load
http://bluenorthernsoftware.com/scarecrow/sahstats/activeusers.html
ID: 320199 · Report as offensive
Profile John Clark
Volunteer tester
Avatar

Send message
Joined: 29 Sep 99
Posts: 16515
Credit: 4,418,829
RAC: 0
United Kingdom
Message 320341 - Posted: 29 May 2006, 22:50:49 UTC - in response to Message 320160.  

So, in a nutshell, traffic has been halved by Enhanced. I wonder if there are any non-Enhanced yet being crunched (?)


The effects of Enhanced can be seen on those crunchers with large RACs. These have mostly gone down by at least 35% and in many cases by over 50%. This is due to the lower credit per hour given and the calculations on the average RAC.

It is my belief that the RAC will settle a little above 50% of the one produced by the 4.18 client.
It's good to be back amongst friends and colleagues



ID: 320341 · Report as offensive
KWSN Sir Clark
Volunteer tester

Send message
Joined: 17 Aug 02
Posts: 139
Credit: 1,002,493
RAC: 8
United Kingdom
Message 320394 - Posted: 30 May 2006, 0:20:23 UTC - in response to Message 320199.  

fewer users = less load
http://bluenorthernsoftware.com/scarecrow/sahstats/activeusers.html


It looks like there's been a mass exodus but I'm sure it's the number of hosts connecting per day :)

If it really has dropped by 6000 connections that's good news for the SETI servers as already shown.

If I'm completely wrong and it's users leaving SETI, that's rather unfortunate

ID: 320394 · Report as offensive
Profile The MariahNet Network
Avatar

Send message
Joined: 14 Jul 99
Posts: 173
Credit: 2,469,357
RAC: 0
United States
Message 320463 - Posted: 30 May 2006, 1:38:08 UTC - in response to Message 320394.  


If I'm completely wrong and it's users leaving SETI, that's rather unfortunate


I over heard a couple people mention at work that they know about a dozen of their friends have stopped running SETI@Home because of all the problems they had. One mentioned having to do an "enhanced reformat" for their hard drive. I have no idea what that means.

As for me, SETI keeps crashing/rebooting my computer when nothing is even running; aka windows safe mode, but just SETI running. Once I'm done with this one work unit, this one computer of mine is outtie. And I most likely will pull out all together once I can UPLOAD all my work! That's probably another reason why uploads should be kept down and not working, but only to allow work units to be uploaded that are about to hit the deadline. LOL TRICKY trick to trick tricked users tricking tricks with tricky tricks during tricky times that are tricky!!!* ROFL!!!


* humor... laugh


ID: 320463 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 320946 - Posted: 31 May 2006, 2:33:07 UTC - in response to Message 320394.  

fewer users = less load
http://bluenorthernsoftware.com/scarecrow/sahstats/activeusers.html


It looks like there's been a mass exodus but I'm sure it's the number of hosts connecting per day :)

If it really has dropped by 6000 connections that's good news for the SETI servers as already shown.

If I'm completely wrong and it's users leaving SETI, that's rather unfortunate

I don't know if there is a way to measure this short of just waiting for the stats, but at least in theory there have to be a number of the really long work units out there -- the ones with 2 month deadlines.

Those machines aren't going to check in for a while, so the stats sites may see them as "gone" -- once there has been time to "fill the pipeline" that may go away.

Then again, there are lies, damn lies, and in this case, statistics.
ID: 320946 · Report as offensive
Alinator
Volunteer tester

Send message
Joined: 19 Apr 05
Posts: 4178
Credit: 4,647,982
RAC: 0
United States
Message 320955 - Posted: 31 May 2006, 2:40:38 UTC - in response to Message 320946.  


Then again, there are lies, damn lies, and in this case, statistics.


LOL, ain't that the truth! :-)

Alinator
ID: 320955 · Report as offensive
Swibby Bear

Send message
Joined: 1 Aug 01
Posts: 246
Credit: 7,945,093
RAC: 0
United States
Message 329489 - Posted: 7 Jun 2006, 5:30:45 UTC

Scarecrow's graphs seem to have disappeared. I hope this isn't permanent. They are (were) great graphs.

As for crunching, this old computer was producing about 3 results per day using Crunch3r's 4.18 optimized app. Now, it is taking about 22 hours to do a single enhanced result, using Crunch3r's optimized 5.12 app.

Crunch3r, you are thanked and missed by many, and so are your optimizations. If you feel you must leave Seti and stay away, we have to respect your decision. However, it would be appreciated by many if you would again make available the optimized apps and clients for download. It would be unfortunate to lose the fruits of all your labors over recent years. It would be such a waste. Thanks for reconsidering this.

Whit
ID: 329489 · Report as offensive
Synister1
Volunteer tester
Avatar

Send message
Joined: 26 Jan 03
Posts: 20
Credit: 742,293
RAC: 5
United States
Message 329513 - Posted: 7 Jun 2006, 6:23:15 UTC - in response to Message 320341.  
Last modified: 7 Jun 2006, 6:32:42 UTC

[quote]
The effects of Enhanced can be seen on those crunchers with large RACs. These have mostly gone down by at least 35% and in many cases by over 50%. This is due to the lower credit per hour given and the calculations on the average RAC.

It is my belief that the RAC will settle a little above 50% of the one produced by the 4.18 client.


Try going higher. I'm seeing a 72% loss....

My P4 had a RAC of 950 before the upgrade to enhanced, it now has a RAC of 230. The processing time went from 41 minutes to almost 6 hours.

With those losses I'm not going to move my x64 machine over. I'm betting a good deal of the lost traffic were people who decided the same thing.
Theres a Fine Line between Hobby and Mental Illness.
ID: 329513 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 20078
Credit: 40,757,560
RAC: 67
United Kingdom
Message 329520 - Posted: 7 Jun 2006, 6:42:38 UTC - in response to Message 329489.  

Scarecrow's graphs seem to have disappeared. I hope this isn't permanent. They are (were) great graphs.
......
Whit

I can still see Scarecrow's graphs

Andy
ID: 329520 · Report as offensive
Profile Mark A. Craig
Volunteer tester

Send message
Joined: 16 Jan 01
Posts: 71
Credit: 103,077
RAC: 0
United States
Message 329546 - Posted: 7 Jun 2006, 7:19:24 UTC

I've seen a loss of about 36% from a high of about 910. My RAC had still been climbing at that point, so the eventual "stable" RAC (if there is such a thing) might have been a bit higher than that. Currently it's down to about 580.

Prior to Enhanced I was using Crunch3r's optimized SSE3 app on my A64 3000+ and the optimized SSE app on my (OC'ed) XP 2500+. There's no question that they made the systems more productive and consequently worked them harder, too. I was using the optimized clients along with those, because that seemed necessary to maintain proportional values to credit, but that never seemed to be the case. The claimed and granted credits I got back then were consistently below the magic value of 32 that I'd heard was the baseline; they'd get somewhere between 15 and 25 most of the time. Of course the systems were getting more work done, so there was some compensation, but none of it ever made sense to me. I felt the system should have been much more transparent.

Currently I'm still using the last 5.12/5.5.0 optimized software, but as you can see it's doing little if anything to offset the irrepressible slide. I'm trying really hard not to care, reminding myself that it's only abstract numbers and that indeed nothing tangible has been taken from me, but still....
Mark
ID: 329546 · Report as offensive
Swibby Bear

Send message
Joined: 1 Aug 01
Posts: 246
Credit: 7,945,093
RAC: 0
United States
Message 329707 - Posted: 7 Jun 2006, 14:10:32 UTC - in response to Message 329520.  

Scarecrow's graphs seem to have disappeared. I hope this isn't permanent. They are (were) great graphs.
......
Whit

I can still see Scarecrow's graphs

Andy

Ah, yes! I now see that the graphs are back. I guess Scarecrow was doing some maintenance on them. Thanks, Andy
ID: 329707 · Report as offensive
Profile [SETI.USA] OneChicken
Avatar

Send message
Joined: 3 Apr 04
Posts: 70
Credit: 906,887
RAC: 0
United States
Message 329737 - Posted: 7 Jun 2006, 15:00:13 UTC
Last modified: 7 Jun 2006, 15:01:57 UTC

I don't know if losing users is a SETI@HOME-only phenomenon or something else (even with all of the recent issues).

If you look at any of the larger projects on BOINC STATS (Einstein, Predictor, etc...), you'll see that they've had a drop in active participants as well (almost at the same rate).

I believe that as they add new projects to the BOINC grouping of projects, users are diversifying their crunching to a larger extent than ever before. As they do this, there is just not enough BOINC users to sustain the level of activity S@H once had. Basically the S@H project is becoming a victim of BOINC's success.

As these users crunch for these other projects, the BOINC community is not adding new users at a fast enough rate to keep the same level of active users on all projects (at least not what they were). Because of this trend to crunch elsewhere, we're actualy seeing a drain of active users on the larger/more popular projects.

If you look at some of the other smaller/newer projects, you'll see that they're gaining new members andhave a high percentage of active users at this point in time.

I don't know if this is true or not, but a theory is usually put out for the sole purpose of motivating others into to action to disprove it.

[edit]typos[/edit]


Proud member of SETI.USA
ID: 329737 · Report as offensive
nick
Volunteer tester
Avatar

Send message
Joined: 22 Jul 05
Posts: 284
Credit: 3,902,174
RAC: 0
United States
Message 332821 - Posted: 10 Jun 2006, 4:47:00 UTC

i think that is has reduceded it to a piont where they could start turning some of the severs off
nick


ID: 332821 · Report as offensive

Message boards : Number crunching : Impact of S@H enhanced on Berkeley server load?


 
©2026 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.