Waiting for Validation

Message boards : Number crunching : Waiting for Validation
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profile Captain Avatar
Volunteer tester
Avatar

Send message
Joined: 17 May 99
Posts: 15133
Credit: 529,088
RAC: 0
United States
Message 80295 - Posted: 17 Feb 2005, 15:02:27 UTC - in response to Message 80289.  

> Ready to send 458,233
> In progress 2,038,080
> Waiting for validation 12,292
>


Yup the pooper is stopped up!
ID: 80295 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 80289 - Posted: 17 Feb 2005, 14:56:14 UTC

Ready to send 458,233
In progress 2,038,080
Waiting for validation 12,292
ID: 80289 · Report as offensive
Profile Captain Avatar
Volunteer tester
Avatar

Send message
Joined: 17 May 99
Posts: 15133
Credit: 529,088
RAC: 0
United States
Message 80275 - Posted: 17 Feb 2005, 14:47:15 UTC - in response to Message 80270.  
Last modified: 17 Feb 2005, 14:48:57 UTC

> Come on baby, get to Zero.
>
> Ready to send 458,233
> In progress 613,888
> Waiting for validation 16,835
>
>

If 20% of units crunched overnight and cant upload, then the servers actually have 200,000 or so for validation! Expect more fun today!

BTW better than on a Friday afternoon!





ID: 80275 · Report as offensive
Profile Saenger
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2452
Credit: 33,281
RAC: 0
Germany
Message 80274 - Posted: 17 Feb 2005, 14:45:22 UTC - in response to Message 80270.  

> Come on baby, get to Zero.

Best chance yet, as atm no further upload possible ;-)
Gruesse vom Saenger

For questions about Boinc look in the BOINC-Wiki
ID: 80274 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 80270 - Posted: 17 Feb 2005, 14:39:29 UTC

Come on baby, get to Zero.

Ready to send 458,233
In progress 613,888
Waiting for validation 16,835


ID: 80270 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 80259 - Posted: 17 Feb 2005, 13:53:28 UTC

Ready to send 458,233
In progress 1,666,258
Waiting for validation 20,121
ID: 80259 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 80242 - Posted: 17 Feb 2005, 13:06:14 UTC

Look at these numbers baby:

Ready to send 475,027
In progress 1,278,078
Waiting for validation 24,170

I wonder if they'll actually get to Zero?

ID: 80242 · Report as offensive
B-Roy

Send message
Joined: 4 May 03
Posts: 220
Credit: 260,955
RAC: 2
Austria
Message 79706 - Posted: 15 Feb 2005, 22:56:31 UTC

Ready to send 653,060
In progress 1,677,358
Waiting for validation 78,833

i think the new servers worked well all the time, and they just added old waiting wus when the queue was decreasing in size. So from my point of view the migration was a complete success. The site is much faster (forums) and the database seems to be very quick responding. As Son Goku said: "Let's keep fingers crossed!"
And i would add: let us hope that LHC starts soon again and that Seti Classic users will start to switch to Boinc.
ID: 79706 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 79596 - Posted: 15 Feb 2005, 13:17:28 UTC

Ready to send 763,854
In progress 781,116
Waiting for validation 89,445
ID: 79596 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 79559 - Posted: 15 Feb 2005, 6:51:57 UTC

it's chewing through the old WU now, baby.

Ready to send 829,789
In progress 562,100
Waiting for validation 107,117
ID: 79559 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 131
Credit: 1,703,351
RAC: 0
United States
Message 79533 - Posted: 15 Feb 2005, 4:31:05 UTC - in response to Message 79321.  
Last modified: 15 Feb 2005, 4:32:09 UTC

> > as of that page right now. It was steadily dropping since the new
> servers
> > came up. Does make me wonder if another validator (perhaps on another
> server
> > or CPU) might help with getting these validated, especially as we now
> have a
> > new server that according to the SETI team is under-utilized and not
> likely to
> > not be up to the task itself...
>
> "under-utilized" means it could do more so it is up to the task. The
> "waiting for validation" queue has been dropping at up to 6,000 per hour from
> what I have seen. This means that the validator is validating all the results
> as they come in PLUS 6,000 per hour so there is still room for growth here.
> Add to that the fact that they can add another 2 CPUs and several GB more RAM
> to the thing and I think it is more than up to the task. Besides, the
> validator itself may not be the bottleneck. For some time now it has always
> been the database that has been the bottleneck in the system so adding another
> validator wouldn't even help. I'm not sure if this has changed with the new
> hardware or not.
>

Oh, BTW, the comments in this thread were because after the new server came in, the waiting for validation *was* going down, but then yesterday there was a blip where it went back up again... The 176,000 was after I had seen a 143,000 or so earlier. The new hardware for the dBase server is why I was wondering if another validator would help given the under-utilization of the dBase server.

But in any case, it's a thing of the past, with the server page now showing 114,000 waiting for validation. I guess we can write it off as a fluke, temporary thing, whatever it can be chalked up to. But doesn't look to be something we'll continue to look at. If things go as is now, we might be down to very few WUs waiting validation by weekend or next week some time. Lets keep fingers crossed :)

> the waiting for validation queue only shows WU's that are ready for
> validation. The transistioner only sends WU's that have a quorum to the
> validator for validation. So WU's that are waiting on results would not be in
> that list

OK, thx, wasn't previously sure whether they included them or not

ID: 79533 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 79515 - Posted: 15 Feb 2005, 2:55:59 UTC

The status page is still working, the validator is working, and is lower than I've noticed in weeks.

Ready to send 867,184
In progress 635,378
Waiting for validation 120,555
ID: 79515 · Report as offensive
virex
Volunteer tester

Send message
Joined: 14 Jul 01
Posts: 17
Credit: 294,731
RAC: 0
United States
Message 79366 - Posted: 14 Feb 2005, 14:32:28 UTC - in response to Message 79313.  

> How many of those WUs with a possible increase, might be waiting
> for the quorum? Honestly couldn't say, and not inclined to take a tabulation
> on every user's account for how many WUs they have pending, for which a quorum
> hasn't been reached.

the waiting for validation queue only shows WU's that are ready for validation. The transistioner only sends WU's that have a quorum to the validator for validation. So WU's that are waiting on results would not be in that list
ID: 79366 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 79364 - Posted: 14 Feb 2005, 14:18:22 UTC
Last modified: 14 Feb 2005, 14:19:45 UTC

The server status page seems to be stuck. It's not updated since 14 Feb 05:10 UTC. (10:10 pm eastern, Feb 13).

[As of 14 Feb 2005 5:10:07 UTC]

Ready to send 1,087,643
In progress 920,822
Waiting for validation 176,821

Patiently waiting
ID: 79364 · Report as offensive
Profile Toby
Volunteer tester
Avatar

Send message
Joined: 26 Oct 00
Posts: 1005
Credit: 6,366,949
RAC: 0
United States
Message 79321 - Posted: 14 Feb 2005, 8:22:04 UTC - in response to Message 79313.  

> as of that page right now. It was steadily dropping since the new servers
> came up. Does make me wonder if another validator (perhaps on another server
> or CPU) might help with getting these validated, especially as we now have a
> new server that according to the SETI team is under-utilized and not likely to
> not be up to the task itself...

"under-utilized" means it could do more so it is up to the task. The "waiting for validation" queue has been dropping at up to 6,000 per hour from what I have seen. This means that the validator is validating all the results as they come in PLUS 6,000 per hour so there is still room for growth here. Add to that the fact that they can add another 2 CPUs and several GB more RAM to the thing and I think it is more than up to the task. Besides, the validator itself may not be the bottleneck. For some time now it has always been the database that has been the bottleneck in the system so adding another validator wouldn't even help. I'm not sure if this has changed with the new hardware or not.
A member of The Knights Who Say NI!
For rankings, history graphs and more, check out:
My BOINC stats site
ID: 79321 · Report as offensive
Nuadormrac
Volunteer tester
Avatar

Send message
Joined: 7 Apr 00
Posts: 131
Credit: 1,703,351
RAC: 0
United States
Message 79313 - Posted: 14 Feb 2005, 7:46:11 UTC
Last modified: 14 Feb 2005, 7:48:03 UTC

I noticed the increase in "number to be validated" as it's listed by the counter on the server status page, myself.

http://setiweb.ssl.berkeley.edu/sah_status.html

Waiting for validation 176,821

as of that page right now. It was steadily dropping since the new servers came up. Does make me wonder if another validator (perhaps on another server or CPU) might help with getting these validated, especially as we now have a new server that according to the SETI team is under-utilized and not likely to not be up to the task itself...

Then again, someone does bring up a point with people having perhaps increased their cache sizes due to the difficulty people were having in getting WUs last week and so. How many of those WUs with a possible increase, might be waiting for the quorum? Honestly couldn't say, and not inclined to take a tabulation on every user's account for how many WUs they have pending, for which a quorum hasn't been reached. The people at Berkely probably have a better way to query their own database, to find such things out anyhow, then such a method which we could utilize... And yes, I know we're looking at an estimate while following the trend it displays as well.

ID: 79313 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 79144 - Posted: 13 Feb 2005, 18:51:22 UTC

here's Roms' answer:

Rom Walton
Forum moderator
Project developer

Joined: Apr 27, 2000
Posts: 283
ID: 85465
Posted: 13 Feb 2005 18:47:17 UTC

The disk array that was holding the log files for the backend componentss, became full and caused all the components to stop.

Jeff went in and manully cycled the log files and moved them to a different array.

----- Rom

BOINC Development Team, U.C. Berkeley

ID: 79144 · Report as offensive
Divide Overflow
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 365
Credit: 131,684
RAC: 0
United States
Message 79105 - Posted: 13 Feb 2005, 17:04:11 UTC - in response to Message 79059.  
Last modified: 13 Feb 2005, 17:04:45 UTC

> Remember that count was out by around 150k to start with. I think it's found
> those "missing" WUs. A few hours ago, it looked like it was going very slowly
> yet I was getting credit at a phenominal rate. ;)

I agree, S-C. The "waiting for validation" queue is an estimate, and that counter was zeroed out a few times over the past week or two. I'm still seeing a steady flow of credits being validated, so I think that the validator is working fine, it's just this counter that's adjusting itself to now account for WU's that it's rediscovered. As I look at results records, many old "stuck" units have now been validated properly or had another WU sent out.

Paul's theory is certainly accurate too. There will always be fluctuations in the volume of WU's returned. With many people out there increasing their cache sizes recently, some of these results are coming home to roost in large numbers!

ID: 79105 · Report as offensive
Iztok s52d (and friends)

Send message
Joined: 12 Jan 01
Posts: 136
Credit: 393,469,375
RAC: 263
Slovenia
Message 79082 - Posted: 13 Feb 2005, 16:21:15 UTC - in response to Message 79064.  

> > Remember that count was out by around 150k to start with. I think it's
> found
> > those "missing" WUs. A few hours ago, it looked like it was going very
> slowly
> > yet I was getting credit at a phenominal rate. ;)
> >
> Yesterday the count hovered around 140K, 143K, 144K, for most the day. so you
> think that's some "Baseline"(for some reason), and then that would be the
> theoretical zero? Todays climb by 70K would be some normal fluctuation?
>
> I think Paul's closer to the truth, and that the DB is undergoing some kind of
> internal function, and that the 70K is the inbound returns not being
> validated.
>
> What do you think? anyone?
>
Hi! Looks like missing WUs (look at thread about missing 150k: http://setiweb.ssl.berkeley.edu/forum_thread.php?id=11303 ) are found.
It used to be wrong number in stats before.

On the other hand: I am getting less credits per hour last few hours,
compared to yesterday.

It might be related with validating of 3 result/4 result WUs?
WUs with no proper flag in dB?

Whatever. Few more days of fast credit flow does not hurt.

73
Iztok


ID: 79082 · Report as offensive
Profile Pooh Bear 27
Volunteer tester
Avatar

Send message
Joined: 14 Jul 03
Posts: 3222
Credit: 4,603,826
RAC: 0
United States
Message 79080 - Posted: 13 Feb 2005, 16:17:02 UTC

Could Berkeley have taken some of the WU offline for a while, when the servers were going nuts, and have over the weekend slowly incorporated them back in, and today they dumped the last of the load in?

It's going in the correct direction again, and I have seen a couple of my older WU that had all the correct responses etc., finally get validated.

And I hit 100K today! WOO!


ID: 79080 · Report as offensive
Previous · 1 · 2 · 3 · Next

Message boards : Number crunching : Waiting for Validation


 
©2020 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.