Status / Credit (Nov 03 2010)


log in

Advanced search

Message boards : Technical News : Status / Credit (Nov 03 2010)

Previous · 1 · 2 · 3 · 4 · 5 · Next
Author Message
Richard HaselgroveProject donor
Volunteer tester
Send message
Joined: 4 Jul 99
Posts: 8630
Credit: 51,442,081
RAC: 47,365
United Kingdom
Message 1046335 - Posted: 5 Nov 2010, 22:00:51 UTC - in response to Message 1046275.

...
Observation: the backlog of results 'ready to send' ran out, for both MB and AP, around 10:00 UTC, or a few minutes before. There's still a trickle, but effectively no new downloads will have been added to the download server queue since then.

The download pipe remained saturated at 93 Mbit/sec until about 10:50 UTC, the best part of an hour later. That gives us some idea of the relative speeds of the various project components: I think we need to use the remaining time before the new servers arrive to work out some way of helping the scheduler request/reply messages get through (and hence avoid creating a new set of ghosts), while Oscar and friend keep the pipe full.

The 1148513 MB and 26888 AP in "ready to send" at the start plus about 12000 MB and 5000 AP reissues created during the saturation period would have taken nearly 19 hours of download with an actual throughput of 90 Mbps. I suspect ghost creation of 100000 or more.

With the queues drained as much as possible by other means, I hope the staff will try <resend_lost_results>1</resend_lost_results> in the project config.xml at least for short periods. Bursts of activity caused by that should be tolerable, and go a long way toward having the server "in progress" actually match what is on participants' hosts. This being Friday, I expect whoever is in the lab has other plans, but maybe next week?
Joe

I was surprised that the query loading on Jocelyn showed no sign of abating when the backlog of work available for allocation ran dry - with downloads a mere 20% of what they were this morning, what are all those other queries?


(static copy taken from http://bluenorthernsoftware.com/scarecrow/sahstats/db.php?t=48)

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5864
Credit: 60,442,675
RAC: 45,990
Australia
Message 1046359 - Posted: 5 Nov 2010, 23:43:28 UTC - in response to Message 1046335.

I was surprised that the query loading on Jocelyn showed no sign of abating when the backlog of work available for allocation ran dry - with downloads a mere 20% of what they were this morning, what are all those other queries?

Validations, assimilations, deletions?

____________
Grant
Darwin NT.

David J. Moritz
Send message
Joined: 15 Aug 99
Posts: 21
Credit: 1,700,380
RAC: 957
United States
Message 1046420 - Posted: 6 Nov 2010, 3:49:33 UTC

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave
____________
David Moritz

Sten-Arne
Volunteer tester
Send message
Joined: 1 Nov 08
Posts: 3513
Credit: 20,681,880
RAC: 22,872
Sweden
Message 1046425 - Posted: 6 Nov 2010, 4:14:44 UTC - in response to Message 1046420.

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave


Expect the online date to be at least 4 weeks from now. Installing, config, and burn in will take lots and lots of time.

____________

Josef W. SegurProject donor
Volunteer developer
Volunteer tester
Send message
Joined: 30 Oct 99
Posts: 4299
Credit: 1,068,238
RAC: 990
United States
Message 1046429 - Posted: 6 Nov 2010, 5:00:36 UTC - in response to Message 1046420.

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave

The first line of Jeff Cobb's October 28 post on the new server specs reads:

The order is out the door and we expect to have the new machines in hand in 2 weeks.

A little later in from now (Oct 28, 2010) until "new server time" he wrote:

The time line we are looking at is about one month - two weeks for the servers to arrive and another two to get them going. We'll see as time goes on whether or not that's too aggressive.
Joe

David J. Moritz
Send message
Joined: 15 Aug 99
Posts: 21
Credit: 1,700,380
RAC: 957
United States
Message 1046693 - Posted: 7 Nov 2010, 2:32:08 UTC - in response to Message 1046429.

Thanks much for the information. I just didn't see the specifics in the original posts. Thanks Again.
____________
David Moritz

Profile soft^spirit
Avatar
Send message
Joined: 18 May 99
Posts: 6374
Credit: 28,631,148
RAC: 2
United States
Message 1046713 - Posted: 7 Nov 2010, 3:27:26 UTC

ghost resend time maybe?
____________

Janice

Big Bang
Send message
Joined: 7 Jan 10
Posts: 670
Credit: 28,481
RAC: 0
Message 1046720 - Posted: 7 Nov 2010, 4:02:30 UTC - in response to Message 1046240.
Last modified: 7 Nov 2010, 4:04:21 UTC

Right on.
____________

Profile S@NL - Eesger - www.knoop.nl
Avatar
Send message
Joined: 7 Oct 01
Posts: 384
Credit: 37,153,340
RAC: 13,772
Netherlands
Message 1046788 - Posted: 7 Nov 2010, 11:12:38 UTC

I am quite happy to read that most people are so understanding :)

All in all, I think this outage is good for the project for a great many reasons.

Untill we crunch again ;)

Eesger

____________
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS

Marco Motta
Send message
Joined: 2 Feb 10
Posts: 1
Credit: 617,236
RAC: 444
Italy
Message 1047620 - Posted: 11 Nov 2010, 17:39:19 UTC - in response to Message 1045846.

In the last 2-3 weeks both my pc do not receive any workunit, and then Boinc is not working for seti. Only seti@home does not work. Why? Seti is halted?
____________

Profile platium
Avatar
Send message
Joined: 5 Jul 10
Posts: 212
Credit: 262,426
RAC: 0
United Kingdom
Message 1047623 - Posted: 11 Nov 2010, 17:48:09 UTC

Someone has about 1.5 million WU's looking at server, Must be very slow returning, I run out and my pc is slow

B-Man
Volunteer tester
Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1047637 - Posted: 11 Nov 2010, 18:36:15 UTC - in response to Message 1047620.

In the last 2-3 weeks both my pc do not receive any workunit, and then Boinc is not working for seti. Only seti@home does not work. Why? Seti is halted?


Seti has had problems with servers and is offline until 2 new ones come in. They hope to be back online around the end of november.
____________

rob smithProject donor
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8526
Credit: 59,131,877
RAC: 79,346
United Kingdom
Message 1047670 - Posted: 11 Nov 2010, 21:11:45 UTC - in response to Message 1047623.

Someone has about 1.5 million WU's looking at server, Must be very slow returning, I run out and my pc is slow

Or they are only able to compute for a few hours a day, or they've had PC problems.
Or seti has been "sidelined" by other BOINC projects which give shorter turnaround times - one of my crunchers still has a couple of SETI WU to run, but is quite happy crunching the milkyway at high priority because that project's WU only have a few days turnaround compared to SETI's weeks.
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

Profile platium
Avatar
Send message
Joined: 5 Jul 10
Posts: 212
Credit: 262,426
RAC: 0
United Kingdom
Message 1047672 - Posted: 11 Nov 2010, 21:32:27 UTC - in response to Message 1047670.

yes you maybe right i cleared all ny seti before starting new programme

Oddbjornik
Volunteer tester
Avatar
Send message
Joined: 15 May 99
Posts: 74
Credit: 87,198,234
RAC: 58,867
Norway
Message 1047692 - Posted: 11 Nov 2010, 23:11:05 UTC

Just an idea for possibly speeding up the database size reduction: How about distributing more copies of pending results already before they expire? That way the project could utilize some of its current massive overcapacity to add redundancy and thus accelerate the decline in "Results returned and awaiting validation".

Normally the resending of timed-out WUs works in a fairly stretched-out way (timewise). This gives the best resource utilization when the project is up and running - we only resend results that really have timed out and need to be resent.

But these weeks, with capacity to burn, I guess a more parallel work-mode might come in handy. If one or two extra results were distributed already today, and returned tomorrow, then that old result that was sent out in October and times out next week will no longer need to be resent (and thus kept active), because the WU will already have the required quorum of two results and can be finalized.
____________

Metod, S56RKO
Volunteer tester
Send message
Joined: 27 Sep 02
Posts: 309
Credit: 34,760,442
RAC: 21,575
Slovenia
Message 1047753 - Posted: 12 Nov 2010, 8:05:49 UTC - in response to Message 1047692.

But these weeks, with capacity to burn, I guess a more parallel work-mode might come in handy. If one or two extra results were distributed already today, and returned tomorrow, then that old result that was sent out in October and times out next week will no longer need to be resent (and thus kept active), because the WU will already have the required quorum of two results and can be finalized.


This would speed up things a bit but not entirely. WU can not be finalized until quorum has been met and results have been validated and all outstanding WUs have either been reported or timed out. If WUs get re-issued prior to expiration of existing results, WUs would still need to live until all remaining results of same WU expire. But not longer as hopefully there would already be a quorum created by faster crunchers.
____________
Metod ...

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1958
Credit: 10,433,916
RAC: 8,055
United States
Message 1047826 - Posted: 12 Nov 2010, 16:20:10 UTC

Just a query - while we're waiting for the new servers, how about Beta granting credit for returned WU's? I returned 85 when Beta finally came up, and received another 40 or so from the built-up un-crunched queue - I've been steadily returning those as they've crunched, but my Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??
____________
.

Profile Fred J. Verster
Volunteer tester
Avatar
Send message
Joined: 21 Apr 04
Posts: 3250
Credit: 31,883,377
RAC: 3,779
Netherlands
Message 1047840 - Posted: 12 Nov 2010, 17:20:36 UTC - in response to Message 1047826.
Last modified: 12 Nov 2010, 17:24:44 UTC

Just a query - while we're waiting for the new servers, how about Beta granting credit for returned WU's? I returned 85 when Beta finally came up, and received another 40 or so from the built-up un-crunched queue - I've been steadily returning those as they've crunched, but my Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??



Now that you mention it, I've crunched a few hundred MB WU's and got some new work, afew days ago, too.
But haven't seen any credit update, since 2 month's.
Well with the weekend ahead, it'll be monday or later ;-)

Hmmm could be updated already, try to check.
____________

Speedy
Volunteer tester
Avatar
Send message
Joined: 26 Jun 04
Posts: 678
Credit: 5,920,434
RAC: 4,127
New Zealand
Message 1048083 - Posted: 13 Nov 2010, 5:39:27 UTC - in response to Message 1047826.

My Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??

Beta validators are off at Beta there are 43,610 waiting validation as of 13 Nov 2010 4:48:08 UTC. data-driven web pages & vote_monitor are the only things running
____________

Live in NZ y not join Smile City?

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1958
Credit: 10,433,916
RAC: 8,055
United States
Message 1048174 - Posted: 13 Nov 2010, 17:11:37 UTC - in response to Message 1048083.

My Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??

Beta validators are off at Beta there are 43,610 waiting validation as of 13 Nov 2010 4:48:08 UTC. data-driven web pages & vote_monitor are the only things running


The "waiting for validation" number is the number of WU's that have been returned by one cruncher and are waiting for a wingman's result...
____________
.

Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Technical News : Status / Credit (Nov 03 2010)

Copyright © 2014 University of California