Waiting for Validation...

Message boards : Number crunching : Waiting for Validation...
Message board moderation

To post messages, you must log in.

AuthorMessage
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 144159 - Posted: 28 Jul 2005, 20:21:10 UTC

Looks like command central targets about 500K wu's ready to send, 1M wu's in progress, and 0h transitioner backlog.

What is the desired target for 'waiting for validation'?

Yes, things will change as classic transitions and if there is possibly more/better hardware. But what would be the desired target under today's configuration?
May this Farce be with You
ID: 144159 · Report as offensive
ampoliros
Volunteer tester
Avatar

Send message
Joined: 24 Sep 99
Posts: 152
Credit: 3,542,579
RAC: 5
United States
Message 144163 - Posted: 28 Jul 2005, 20:37:55 UTC

Target for 'waiting for validation' should be zero. However this is unreasonable. Following any outage there will be a bottleneck in the process (ie one or more numbers or services out of whack).

This bloat will travle through the system and end at 'waiting for valicaation'. A realistic number for this process should be less than 100 I guess, and before all these latest outages (however short) it had been kept down. But now all that lag has been slumped into the validators.

Ealier this week the number was close to 500,000 and it had slowly crept back to about 20K as the validators started catching up. But the outage yesterday pushed another bubble through the system and it's back to 40K.

This will take a day or two to work through but it will return to a low number.

7,049 S@H Classic Credits
ID: 144163 · Report as offensive
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 144510 - Posted: 29 Jul 2005, 17:23:10 UTC

So the system seems to have been glitch free recently and therefore the queues should then be trending toward nominal. Instead, the validation queue is growing. Is there a reason the gradient isn't negative yet?
May this Farce be with You
ID: 144510 · Report as offensive
Profile Neil Walker
Volunteer tester
Avatar

Send message
Joined: 23 May 99
Posts: 288
Credit: 18,101,056
RAC: 0
United Kingdom
Message 144552 - Posted: 29 Jul 2005, 19:06:23 UTC - in response to Message 144510.  

So the system seems to have been glitch free recently and therefore the queues should then be trending toward nominal. Instead, the validation queue is growing. Is there a reason the gradient isn't negative yet?


Actually, the "Waiting for validation" value has been up and down like a yo-yo for a while now. I haven't got a clue why that is happening. :(


Be lucky

Neil



ID: 144552 · Report as offensive
ampoliros
Volunteer tester
Avatar

Send message
Joined: 24 Sep 99
Posts: 152
Credit: 3,542,579
RAC: 5
United States
Message 144570 - Posted: 29 Jul 2005, 20:05:41 UTC
Last modified: 29 Jul 2005, 20:11:26 UTC

Yeah it seems to me that it should be going down... (It did after the latest big outage.) It did work through half a million in backlog as well as what was currently moving in.

I would think that the WFV cue would continue to shrink after outage spikes as it had done before.

Perhaps this is a result of recent upgrades. Previously the bottleneck had been that upload/downloads and/or lack of split data (work units) had kept the process of issueing/crunching and returning work slowed down enough. Now that work is being sent, processed and returned much more smoothly, the number of validators is not large enough to handle the quantity of successfully returned units.

Another thing to consider is that the SETIBOINC staff is in the process of moving all of the servers to a 1000Mbs switch to provide faster NFS access to the master data server (can't remember its name). Perhaps the validators are not yet on that switch and are communicating through the old (100Mbs or even 10Mbs-half) switch.

What we can say is that they are working. They are slowly losing ground, but they are working. The SETIBOINC staff is probably aware of this fact and may be waiting for the next big outage (planned for mid-to-late August) to move things around as the validators are not essential to getting work done, only to granting credit and preparing units to be moved to the master science database. The only concern if they can't catch up would be disk space. And by mid-to-late August we could be looking at millions of WUs in the WFV cue. (eep!)

7,049 S@H Classic Credits
ID: 144570 · Report as offensive

Message boards : Number crunching : Waiting for Validation...


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.