Observation of Effect

Message boards : Number crunching : Observation of Effect
Message board moderation

To post messages, you must log in.

AuthorMessage
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1013377 - Posted: 8 Jul 2010, 7:42:09 UTC

Having had the machines run virtually dry last week and on life support over the weekend till the flood gates were opened, i thought i might share some observations.

1. Total work that went into queue, circa 2800 wus.
2. At the time of the outage swith on, circa 50% of wus had still not been downloaded (they are pending)
3. It's now 5:30pm on Thursday in Oz and 20% of wus have been processed and are now pending upload.

Not sure how many others have had a similar experience however it will be interesting to see what happens when things come back up...

L.





ID: 1013377 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1013380 - Posted: 8 Jul 2010, 8:09:34 UTC

On this system, which is a virtual machine running OpenSolaris, I have 2 WUs in progress (but one has finished and is trying to upload) and 2 awaiting validation, notwithstanding the fact that this is a slow machine. On the real machine, which is a Linux box, I have one in progress and 4 awaiting validation, but this was true even before the outage. People load too many WUs, in my humble opinion.
Tullio
ID: 1013380 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6497
Credit: 34,134,168
RAC: 0
United States
Message 1013381 - Posted: 8 Jul 2010, 8:14:29 UTC - in response to Message 1013377.  

Hopefully they will allow uploads to settle in a bit before the downloads are enabled. While I may be have an empty machine or two by then, I would hate to see everything falling into error and crashing things in too much of a rush.

The initial "20" limit last time really was a good idea.. It just left a lot of people with empty GPU's or CPU's. Hopefully it will be squared away, and moderate increases in it will not crash systems.




Janice
ID: 1013381 · Report as offensive
Cameron
Avatar

Send message
Joined: 27 Nov 02
Posts: 110
Credit: 5,082,471
RAC: 17
Australia
Message 1013385 - Posted: 8 Jul 2010, 9:49:16 UTC - in response to Message 1013381.  

I would agree about the rolling 20 unit process queue being a good idea.

I think the problems were that it seemed to ignore the GPU serving on a first basis the Host CPU and the other problem being 20 units was unlikely to provide enough work to cover the new 3 day schedule.

the advantages every machine has work to process either already queued. or are given up to the magic number* of workunits so they have something to do. Outstanding work is hopefully reduced as people with queues above this limit return completed work and are not replenished until the magic number* is involved.

I survived the first 3 day knock-down round having 78 WUs approximately 2 dozen of these were shorties (~1 hr processing time) connected during Friday Berkeley Time and got a top up to approximately 60 and then over the weekend actually worked the queue down to 19 and got a top up from this rolling 20 unit queue a few hours before they lifted it so everyone could get enough to last this second 3 day knock-down.

I lowered my queue from 6 days to 5 and got a total processing queue of 61 WUs only 6 short WUs in these. Currently have processed 29WUs (includes shorties) so I've enough to see me through round 2. May or may not lower queue further depends on estimates and shortie spread.

BTW I'm pleased to see you still around soft^spirit having moved beyond 100K.

* magic number may or may not be 20.
ID: 1013385 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6497
Credit: 34,134,168
RAC: 0
United States
Message 1013388 - Posted: 8 Jul 2010, 10:47:29 UTC - in response to Message 1013385.  

I do not think anyone really WANTS 10 days+ of work.. But people have been creative to try and get enough to last through the outage.

It looks like I will start running dry soon.. but not badly before tomorrow.
And yes.. still crunching away for now.

We all have limits on the torpedos we can take. Mine got stretched. Still at it to see what the new normal will be.
Janice
ID: 1013388 · Report as offensive
Profile Bill Walker
Avatar

Send message
Joined: 4 Sep 99
Posts: 3868
Credit: 2,697,267
RAC: 0
Canada
Message 1013399 - Posted: 8 Jul 2010, 11:51:59 UTC - in response to Message 1013388.  
Last modified: 8 Jul 2010, 11:55:20 UTC

Still at it to see what the new normal will be.


That pretty much sums up life these days - as well as S@H. Grinding through a bunch of shorties right now, but it looks like I will make through the outrage with WUs to spare. I agree that the upload rush when they turn back on will be interesting.

An interesting side effect: my S@H queue was one or two WUs right up to 18 hours before the outage, and my other projects seemed to take this as an opportunity to overstock. Once I got a whack of S@H work, WCG started jumping in and out of high priority mode.

ID: 1013399 · Report as offensive
Profile Odan

Send message
Joined: 8 May 03
Posts: 91
Credit: 15,331,177
RAC: 0
United Kingdom
Message 1013415 - Posted: 8 Jul 2010, 13:38:57 UTC - in response to Message 1013380.  

On this system, which is a virtual machine running OpenSolaris, I have 2 WUs in progress (but one has finished and is trying to upload) and 2 awaiting validation, notwithstanding the fact that this is a slow machine. On the real machine, which is a Linux box, I have one in progress and 4 awaiting validation, but this was true even before the outage. People load too many WUs, in my humble opinion.
Tullio


I have a comparatively slow machine by modern standards, certainly not a super cruncher, with a Q6600 & a GTX8800 that is mildly overclocked. This gets through around 6-10 MB WU an hour depending on type. This means it needs around 240 WU per day to survive a 3+ day outage I need around 500-700 WU - fewer if I snag some AP or the WU are longer but I still need hundreds of units.

Are you saying I should only have a cache of 10 or so :)?

ID: 1013415 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1013419 - Posted: 8 Jul 2010, 13:57:02 UTC - in response to Message 1013415.  


I have a comparatively slow machine by modern standards, certainly not a super cruncher, with a Q6600 & a GTX8800 that is mildly overclocked. This gets through around 6-10 MB WU an hour depending on type. This means it needs around 240 WU per day to survive a 3+ day outage I need around 500-700 WU - fewer if I snag some AP or the WU are longer but I still need hundreds of units.

Are you saying I should only have a cache of 10 or so :)?


I am simply asking why my two machines, an average CPU (Opteron 1210 at 1.8 GHz running Linux) and a much slower virtual machine running Solaris must always wait for their wingmen, who usually have much faster CPUs. I can only think that my wingmen have downloaded too many WUs. And yes, I am running 5 other projects on the Linux box, only SETI on Solaris, so I am not even running SETI all the time. All my projects are equally shared.
Tullio


ID: 1013419 · Report as offensive
Profile skildude
Avatar

Send message
Joined: 4 Oct 00
Posts: 9541
Credit: 50,759,529
RAC: 60
Yemen
Message 1013422 - Posted: 8 Jul 2010, 14:00:03 UTC - in response to Message 1013419.  

it's all about the cache. those with small caches will always complete their work faster than those with a large cache. I like to think I hit it at a medium sized cache. That way folks with small a small cache like yourself don't have to wait long and I dont have to wait long for the folks with a large cache


In a rich man's house there is no place to spit but his face.
Diogenes Of Sinope
ID: 1013422 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1014094 - Posted: 10 Jul 2010, 2:32:41 UTC - in response to Message 1013422.  

its now Sat 12:30pm in Oz. Just looked at Pending Credits, they now sit at 345k+, whereas before the changes they sat around 140k...
ID: 1014094 · Report as offensive

Message boards : Number crunching : Observation of Effect


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.