Validator queue keeps growing......

Message boards : Number crunching : Validator queue keeps growing......
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
Jos Ouddeken
Avatar

Send message
Joined: 7 Apr 05
Posts: 18
Credit: 99,304
RAC: 0
Netherlands
Message 152346 - Posted: 16 Aug 2005, 22:16:03 UTC

Has anybody got any idea when this problem will be fixed ? I have >100 results waiting for validation....
<img border="0" src="http://boinc.mundayweb.com/one/stats.php?userID=1691&amp;prj=1&amp;trans=off" />
<img src="http://mysite.wanadoo-members.co.uk/thefinalfrontear/babysm.JPG" />
ID: 152346 · Report as offensive
Profile SunMicrosystemsLLG

Send message
Joined: 4 Jul 05
Posts: 102
Credit: 1,360,617
RAC: 0
United Kingdom
Message 152351 - Posted: 16 Aug 2005, 22:35:49 UTC

Lucky you, in the last 3-4 days I've racked up around 5500 WUs (well over 150,000 requested credits) and had less then 30 WUs validated and less than 900 credits granted.

Obviously many of those work units will be waiting for other machines to return results before validation but last time I had the grid running SETI the granted credit seemed to be increasing everytime I hit refresh on the browser ...

Hang fire I'm sure it's in the process of getting fixed.


ID: 152351 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 152353 - Posted: 16 Aug 2005, 22:43:07 UTC

We're planning on doing some rigorous file deleting during the database outage tomorrow. I hope we can turn the corner before the validation queue hits 1M!

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 152353 · Report as offensive
Profile Sir Ulli
Volunteer tester
Avatar

Send message
Joined: 21 Oct 99
Posts: 2246
Credit: 6,136,250
RAC: 0
Germany
Message 152354 - Posted: 16 Aug 2005, 22:43:08 UTC

Waiting for validation 888,176

until Berkeley is not be able to fix this, we have to wait..

Greetings from Germany NRW
Ulli


ID: 152354 · Report as offensive
Profile Sir Ulli
Volunteer tester
Avatar

Send message
Joined: 21 Oct 99
Posts: 2246
Credit: 6,136,250
RAC: 0
Germany
Message 152359 - Posted: 16 Aug 2005, 22:50:00 UTC - in response to Message 152353.  

We're planning on doing some rigorous file deleting during the database outage tomorrow. I hope we can turn the corner before the validation queue hits 1M!

- Matt


hope this will help, but i dont think so...

Greetings from Germany NRW
Ulli
ID: 152359 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21233
Credit: 7,508,002
RAC: 20
United Kingdom
Message 152365 - Posted: 16 Aug 2005, 23:04:44 UTC - in response to Message 152353.  
Last modified: 16 Aug 2005, 23:05:07 UTC

We're planning on doing some rigorous file deleting during the database outage tomorrow. ...

Matt, are you caught by this possibly unexpected filesystem effect?

Regards,
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 152365 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 152379 - Posted: 16 Aug 2005, 23:49:48 UTC - in response to Message 152365.  

Matt, are you caught by this possibly unexpected filesystem effect?


Of course we thought of this. During our mini outage yesterday we shut enough things down to quickly access a single result directory, and created a new directory, and moved all the files there, etc. in order to "compress" the directory. The resulting directory had the same size as the old one. So this had no effect.

We'll see what the file deletion does, then go from there.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 152379 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9549
Credit: 3,308,926
RAC: 2
United States
Message 152391 - Posted: 17 Aug 2005, 0:35:10 UTC
Last modified: 17 Aug 2005, 0:35:51 UTC

:-(

Waiting for validation 895,216 as of 0134hrs UTC time.

From the status page. Its growing, but slowly. Hopefully tomorrow the outage will clear some of that up.

Jeremy
ID: 152391 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21233
Credit: 7,508,002
RAC: 20
United Kingdom
Message 152392 - Posted: 17 Aug 2005, 0:37:26 UTC - in response to Message 152379.  
Last modified: 17 Aug 2005, 0:38:17 UTC

Matt, are you caught by this possibly unexpected filesystem effect?

Of course we thought of this. ... The resulting directory had the same size as the old one. So this had no effect.

We'll see what the file deletion does, then go from there.

- Matt

This looks like it should be nicely interesting when you discover/uncover the full story.

Good luck, and thanks for suffering the feedback :)

Regards,
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 152392 · Report as offensive
Profile Christian Seti (user)
Avatar

Send message
Joined: 31 May 99
Posts: 38
Credit: 73,899,402
RAC: 62
Australia
Message 152415 - Posted: 17 Aug 2005, 1:50:38 UTC

I also have watched with interest as the validator queue has grown but it's not as bad as it looks. If you go to your account info and click "results" you'll see that results returned have "pending" credit back to about the 6th of August (as at this time- 17th August). Results for workunits prior to the 6th seem to all have credit granted. That's only 11 days lag between a workunit being sent to you (not sent, processed and returned) and credit being granted for it. Not so bad.

In the BOINC system there are bound to be small disparities between the rate at which WU's can be generated, returned, validated etc. We're just seeing one. Of course we don't want to see this queue grow forever, but the BOINC people will add more capacity for validation as the project grows. Hopefully soon.
---------------------------------
Nathan Zamprogno
http://baliset.blogspot.com
ID: 152415 · Report as offensive
Profile tournamentmaster2000_au

Send message
Joined: 3 Jun 05
Posts: 5
Credit: 8,165
RAC: 0
Australia
Message 152516 - Posted: 17 Aug 2005, 8:21:33 UTC - in response to Message 152415.  

I also have watched with interest as the validator queue has grown but it's not as bad as it looks. If you go to your account info and click "results" you'll see that results returned have "pending" credit back to about the 6th of August (as at this time- 17th August). Results for workunits prior to the 6th seem to all have credit granted. That's only 11 days lag between a workunit being sent to you (not sent, processed and returned) and credit being granted for it. Not so bad.

In the BOINC system there are bound to be small disparities between the rate at which WU's can be generated, returned, validated etc. We're just seeing one. Of course we don't want to see this queue grow forever, but the BOINC people will add more capacity for validation as the project grows. Hopefully soon.

I hope so. Ihave a huge bcklog od WU's to be validated, and it's a heck of a lot of credit in there

ID: 152516 · Report as offensive
Profile D.J. Schweitz
Volunteer tester
Avatar

Send message
Joined: 29 Oct 02
Posts: 157
Credit: 871,078
RAC: 0
United States
Message 152653 - Posted: 17 Aug 2005, 16:14:36 UTC

I have discovered that the trick for me to handling the weekly outage is to pack the camper and take off to the Sierra's for a week of fishing. There by I can not see my "pending" and only feel frustrated when the fish are not biting. Of-course with a weekly shut down for maintenance, I would be out on the streams all the time, hmmmmm, sounding better already.
Click below for our Team Website
ID: 152653 · Report as offensive
Profile Sir Ulli
Volunteer tester
Avatar

Send message
Joined: 21 Oct 99
Posts: 2246
Credit: 6,136,250
RAC: 0
Germany
Message 152723 - Posted: 17 Aug 2005, 21:44:38 UTC

Waiting for validation 932,889 WUs

somethink new @Matt

did you find somethink...

Greetings from Germany NRW
Ulli
ID: 152723 · Report as offensive
Divide Overflow
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 365
Credit: 131,684
RAC: 0
United States
Message 152747 - Posted: 17 Aug 2005, 22:59:53 UTC

Waiting for validation 940,293

I guess not. Or at least nothing that has taken effect right away... :(


ID: 152747 · Report as offensive
Profile Crunch3r
Volunteer tester
Avatar

Send message
Joined: 15 Apr 99
Posts: 1546
Credit: 3,438,823
RAC: 0
Germany
Message 152754 - Posted: 17 Aug 2005, 23:11:49 UTC - in response to Message 152747.  

Waiting for validation 940,293

I guess not. Or at least nothing that has taken effect right away... :(


Nothing happens nothing helps. Maybe it&#180;s time to face the fact that there&#180;s nothing to be done to get rid of this mess.

Maybe stopping the project and deleting all the directories containing the results waiting for validation is the only option.

This whole thing is getting to suck... :-)

Join BOINC United now!
ID: 152754 · Report as offensive
chrisjohnston
Volunteer tester

Send message
Joined: 31 Aug 99
Posts: 385
Credit: 91,410
RAC: 0
United States
Message 152756 - Posted: 17 Aug 2005, 23:13:46 UTC

I wanna know how the weekly outage went. What they did, what effect it has shown yet if any.
- cJ

ID: 152756 · Report as offensive
Profile Qui-Gon
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 2940
Credit: 19,199,902
RAC: 11
United States
Message 152758 - Posted: 17 Aug 2005, 23:17:54 UTC - in response to Message 152754.  

Waiting for validation 940,293

I guess not. Or at least nothing that has taken effect right away... :(


Nothing happens nothing helps. Maybe it´s time to face the fact that there´s nothing to be done to get rid of this mess.

Maybe stopping the project and deleting all the directories containing the results waiting for validation is the only option.


That's hardly necessary. A few weeks ago (6-8) the validator queue was growing and someone did something to fix it. Then the backlog shifted somewhere else, but nonetheless it was fixed.

Last time I looked there were six "hosts" assigned as transitioners with no backlog reported for that process, but only four assigned as validators, though there are 940K results waiting for validation.
ID: 152758 · Report as offensive
Divide Overflow
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 365
Credit: 131,684
RAC: 0
United States
Message 152760 - Posted: 17 Aug 2005, 23:25:43 UTC - in response to Message 152754.  
Last modified: 17 Aug 2005, 23:26:49 UTC

Nothing happens nothing helps. Maybe it´s time to face the fact that there´s nothing to be done to get rid of this mess.


I hardly think that such a defeatist attitude is called for. We still don't know what actions were implemented during the outage or what else was learned. At the moment all we know is the backlog is still increasing.

ID: 152760 · Report as offensive
Profile [B@H] Ray
Volunteer tester
Avatar

Send message
Joined: 1 Sep 00
Posts: 485
Credit: 45,275
RAC: 0
United States
Message 152762 - Posted: 17 Aug 2005, 23:35:07 UTC - in response to Message 152760.  

Nothing happens nothing helps. Maybe it´s time to face the fact that there´s nothing to be done to get rid of this mess.


I hardly think that such a defeatist attitude is called for. We still don't know what actions were implemented during the outage or what else was learned. At the moment all we know is the backlog is still increasing.


Dave I have to agree with you about that remark.

Crunch3r it will be fixed in due time, just be patient. If you can't be patient you can work on another program until it is running better.


Pizza@Home Rays Place Rays place Forums
ID: 152762 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21233
Credit: 7,508,002
RAC: 20
United Kingdom
Message 152763 - Posted: 17 Aug 2005, 23:36:42 UTC

Watching:
http://teamseti.com/status/status.phtml
http://bluenorthernsoftware.com/scarecrow/sahstats/

and interestingly, the WFV queue sometimes slows to a stop, but it never decreases...

Cheers,
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 152763 · Report as offensive
1 · 2 · 3 · 4 · Next

Message boards : Number crunching : Validator queue keeps growing......


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.