In another thread, I started recording how many results were leaving the "Waiting for validation" queue. Soon I realized that a table report might be better, so here goes:

--------------------------------------------------------------------
|Obs|Timestamp |In queue|Rate |Overall rate|ETA @ 0
--------------------------------------------------------------------
|001|28AUG 06:20| 785K|??.?K/hr| ??.?K/hr|????? ??:??
|002|28AUG 07:00| 766K|28.5K/hr| 28.5K/hr|29AUG 10:00
|003|28AUG 07:30| 752K|28.0K/hr| 28.3K/hr|29AUG 10:00
|004|28AUG 08:00| 737K|30.0K/hr| 28.8K/hr|29AUG 09:30
|005|28AUG 08:40| 718K|28.5K/hr| 28.7K/hr|29AUG 09:40
--------------------------------------------------------------------

I will try to keep this info updated through continuously updating it, editing this message.

---

"Are you suggesting coconuts migrate?"

In another thread, I started recording how many results were leaving the "Waiting for validation" queue.

A longer record is available here.

---

Metod ...

From Scarecros's graph (http://bluenorthernsoftware.com/scarecrow/sahstats/) the WFV queue is clearing in a linear fashion.
Around 36 hours from now looks likely (say 14:00 29/08 UTC)

---

Thanks go out to Martin and Metod for their efforts in monitoring status ...

---

Thanks go out to Martin and Metod for their efforts in monitoring status ...

Not to me, rather to Scarecrow. I merely pointed out to his nice table.

---

Metod ...

In another thread, I started recording how many results were leaving the "Waiting for validation" queue.

A longer record is available here.

Cool! Thanks!

---

"Are you suggesting coconuts migrate?"

29/08/05 @ 13-15h UTC

if the progress keeps running (100k results are validated in around 4h)

---

___________________________________________________________
|Obs|Timestamp |In queue|Rate |Overall rate|ETA @ 0
___________________________________________________________
|001|28AUG 06:20| 785K|??.?K/hr| ??.?K/hr|????? ??:??
|002|28AUG 07:00| 766K|28.5K/hr| 28.5K/hr|29AUG 10:00
|003|28AUG 07:30| 752K|28.0K/hr| 28.3K/hr|29AUG 10:00
|004|28AUG 08:00| 737K|30.0K/hr| 28.8K/hr|29AUG 09:30
|005|28AUG 08:40| 718K|28.5K/hr| 28.7K/hr|29AUG 09:40
|006|28AUG 12:40| 626K|23.0K/hr| 25.1K/hr|29AUG 13:40
|007|28AUG 13:10| 609K|34.0K/hr| 25.8K/hr|29AUG 12:40
___________________________________________________________

92K have been validated in the 4hr period from 8:40 to 12:40, which is a bit slower than the 100K/4 hours mentioned earlier.
Anyhow, the overall rate suggests that 100K are in fact validated in a 4 hour period.

---

"Are you suggesting coconuts migrate?"

Hi

Not correct at all.

Came home from lunch at 12 UTC 648000 left to validate 13.20 UTC 609000 left.
Its over 30000 an hour.

greetz Mike

---

With each crime and every kindness we birth our future.

As the file system drains, we might see some acceleration of the validator, since it will have fewer files to deal with on the server. Maybe that accounts for that faster speed in the period you noticed.

---

Validation stopped at 595K. Maybe it can't get lover, because rest of WU only have one or two results to compare to, and three is needed?

EDIT: If that is the case they should accept uploads to further purge the system!

HÃ¥kon

---

Validation stopped at 595K. Maybe it can't get lover, because rest of WU only have one or two results to compare to, and three is needed?

EDIT: If that is the case they should accept uploads to further purge the system!

HÃ¥kon

You can take a look at the status screen and see that validators are off... :)
You can read that Waiting for validation is counting only WU-s that have 3 results in.... :)

And now you know why validation stopped at 595k. . . Just take a look at the news (rarely updated, but sometimes are news and not "news") and status screen before posting next time. :)


EDIT- and when I was writing post, they turned them back on... it is 590k now.

---

Great tracking of database stats. For myself I would peroidicly copy and paste into notepad the database section of server page.

It's dropping quick.

Great tracking of database stats. For myself I would peroidicly copy and paste into notepad the database section of server page.

It's dropping quick.

Here is my copy and paste of last 2 hours,it's down about 58,000 in 2 hours.And added one more from last night.This makes it down about 457,000 in about 19 hours.

Database status 1600 UTC 28th August 2005
State Approximate #results
Ready to send 280,772
In progress 963,160
Waiting for validation 559,508
Transitioner backlog 0 hours

Database status 1800 UTC 28th August 2005
State Approximate #results
Ready to send 281,219
In progress 960,748
Waiting for validation 501,425
Transitioner backlog 0 hours

Database status 2310 UTC 27th august 2005
State Approximate #results
Ready to send 277,979
In progress 983,274
Waiting for validation 958,500
Transitioner backlog 0 hours

___________________________________________________________
|Obs|Timestamp |In queue|Rate |Overall rate|ETA @ 0
___________________________________________________________
|001|28AUG 06:20| 785K|??.?K/hr| ??.?K/hr|????? ??:??
|002|28AUG 07:00| 766K|28.5K/hr| 28.5K/hr|29AUG 10:00
|003|28AUG 07:30| 752K|28.0K/hr| 28.3K/hr|29AUG 10:00
|004|28AUG 08:00| 737K|30.0K/hr| 28.8K/hr|29AUG 09:30
|005|28AUG 08:40| 718K|28.5K/hr| 28.7K/hr|29AUG 09:40
|006|28AUG 12:40| 626K|23.0K/hr| 25.1K/hr|29AUG 13:40
|007|28AUG 13:10| 609K|34.0K/hr| 25.8K/hr|29AUG 12:40
|008|28AUG 19:20| 462K|23.8K/hr| 24.8K/hr|29AUG 13:50
___________________________________________________________


As I understand one of the other posts, validators have been turn off for a period. This would explain the drop in the "short-term" validation rate, but overall validation rate still remains close to 25K/h, or 100K validated per 4 hours.

---

"Are you suggesting coconuts migrate?"

All these numbers that keep being posted here are more readily available at

http://members.cox.net/thescarecrow/sstat.shtml

The average hourly decrease in the WFV queue since 8/27 13:50 UTC is -24753.

If anyone really needs them, I have the numbers from Scarecrow's page going back to 8/10.

All these numbers that keep being posted here are more readily available at

http://members.cox.net/thescarecrow/sstat.shtml

The average hourly decrease in the WFV queue since 8/27 13:50 UTC is -24753.

If anyone really needs them, I have the numbers from Scarecrow's page going back to 8/10.

These numbers seem to be drawn on an hourly basis, but are updated here at S@H every 10 minutes.
Starting out with a small time-span, I preferred to draw immediately as a change occurred.
Now I just duplicate the info in order to show what is the basis of my estimate at when we hit 0 WFV.

---

"Are you suggesting coconuts migrate?"

These numbers seem to be drawn on an hourly basis, but are updated here at S@H every 10 minutes.
Starting out with a small time-span, I preferred to draw immediately as a change occurred.
Now I just duplicate the info in order to show what is the basis of my estimate at when we hit 0 WFV.

No problem, I'm not complaining at all about what you're doing - just pointing out for those who want to see "farther back", etc., that there's an automated routine capturing the numbers hourly for your viewing pleasure... :-)

These numbers seem to be drawn on an hourly basis, but are updated here at S@H every 10 minutes.
Starting out with a small time-span, I preferred to draw immediately as a change occurred.
Now I just duplicate the info in order to show what is the basis of my estimate at when we hit 0 WFV.

Just FYI, while the page is updated every 10 minutes, not all the numbers on the page are. They're generated separately with their own automated processes. So, even if no change is reported, the process may still be running and the page still behind.

MJ

---

Going back on topic.

Estimated time = 17 hours

I make that 13:00 UTC Monday 29th August 2005

---