Status / Credit (Nov 03 2010)

Message boards : Technical News : Status / Credit (Nov 03 2010)

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,501,500
RAC: 41,154
United Kingdom
Message 1046335 - Posted: 5 Nov 2010, 22:00:51 UTC - in response to Message 1046275.

...
Observation: the backlog of results 'ready to send' ran out, for both MB and AP, around 10:00 UTC, or a few minutes before. There's still a trickle, but effectively no new downloads will have been added to the download server queue since then.

The download pipe remained saturated at 93 Mbit/sec until about 10:50 UTC, the best part of an hour later. That gives us some idea of the relative speeds of the various project components: I think we need to use the remaining time before the new servers arrive to work out some way of helping the scheduler request/reply messages get through (and hence avoid creating a new set of ghosts), while Oscar and friend keep the pipe full.

The 1148513 MB and 26888 AP in "ready to send" at the start plus about 12000 MB and 5000 AP reissues created during the saturation period would have taken nearly 19 hours of download with an actual throughput of 90 Mbps. I suspect ghost creation of 100000 or more.

With the queues drained as much as possible by other means, I hope the staff will try <resend_lost_results>1</resend_lost_results> in the project config.xml at least for short periods. Bursts of activity caused by that should be tolerable, and go a long way toward having the server "in progress" actually match what is on participants' hosts. This being Friday, I expect whoever is in the lab has other plans, but maybe next week?
                                                                  Joe

I was surprised that the query loading on Jocelyn showed no sign of abating when the backlog of work available for allocation ran dry - with downloads a mere 20% of what they were this morning, what are all those other queries?


(static copy taken from http://bluenorthernsoftware.com/scarecrow/sahstats/db.php?t=48)

ID: 1046335 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 7474
Credit: 90,865,217
RAC: 45,141
Australia
Message 1046359 - Posted: 5 Nov 2010, 23:43:28 UTC - in response to Message 1046335.

I was surprised that the query loading on Jocelyn showed no sign of abating when the backlog of work available for allocation ran dry - with downloads a mere 20% of what they were this morning, what are all those other queries?

Validations, assimilations, deletions?

Grant
Darwin NT

ID: 1046359 · Report as offensive
David J. Moritz

Send message
Joined: 15 Aug 99
Posts: 21
Credit: 2,469,267
RAC: 1,216
United States
Message 1046420 - Posted: 6 Nov 2010, 3:49:33 UTC

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave


David Moritz

ID: 1046420 · Report as offensive
Tutankhamon "Communist"
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 6081
Credit: 37,600,804
RAC: 15,171
Sweden
Message 1046425 - Posted: 6 Nov 2010, 4:14:44 UTC - in response to Message 1046420.

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave


Expect the online date to be at least 4 weeks from now. Installing, config, and burn in will take lots and lots of time.

This is a test of the Emergency Moron System. Had there been a real moron in the room, there would've been a small mushroom cloud in the place where the idiot had been standing.

ID: 1046425 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1046429 - Posted: 6 Nov 2010, 5:00:36 UTC - in response to Message 1046420.

The one item of information that I have not seen is "When will the new servers arrive?" I understand that the PO has been placed, but there has been no mention of an arrival date or an estimated "On Line" date. Thanks,
Dave

The first line of Jeff Cobb's October 28 post on the new server specs reads:

The order is out the door and we expect to have the new machines in hand in 2 weeks.

A little later in from now (Oct 28, 2010) until "new server time" he wrote:

The time line we are looking at is about one month - two weeks for the servers to arrive and another two to get them going. We'll see as time goes on whether or not that's too aggressive.
                                                               Joe

ID: 1046429 · Report as offensive
David J. Moritz

Send message
Joined: 15 Aug 99
Posts: 21
Credit: 2,469,267
RAC: 1,216
United States
Message 1046693 - Posted: 7 Nov 2010, 2:32:08 UTC - in response to Message 1046429.

Thanks much for the information. I just didn't see the specifics in the original posts. Thanks Again.


David Moritz

ID: 1046693 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6438
Credit: 31,805,559
RAC: 6,508
United States
Message 1046713 - Posted: 7 Nov 2010, 3:27:26 UTC

ghost resend time maybe?



Janice

ID: 1046713 · Report as offensive
Big Bang

Send message
Joined: 7 Jan 10
Posts: 670
Credit: 28,481
RAC: 0
Message 1046720 - Posted: 7 Nov 2010, 4:02:30 UTC - in response to Message 1046240.
Last modified: 7 Nov 2010, 4:04:21 UTC

Right on.


ID: 1046720 · Report as offensive
Profile S@NL - Eesger - www.knoop.nl
Avatar

Send message
Joined: 7 Oct 01
Posts: 384
Credit: 47,539,438
RAC: 9,311
Netherlands
Message 1046788 - Posted: 7 Nov 2010, 11:12:38 UTC

I am quite happy to read that most people are so understanding :)

All in all, I think this outage is good for the project for a great many reasons.

Untill we crunch again ;)

Eesger


The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS

ID: 1046788 · Report as offensive
Marco Motta

Send message
Joined: 2 Feb 10
Posts: 1
Credit: 822,221
RAC: 337
Italy
Message 1047620 - Posted: 11 Nov 2010, 17:39:19 UTC - in response to Message 1045846.

In the last 2-3 weeks both my pc do not receive any workunit, and then Boinc is not working for seti. Only seti@home does not work. Why? Seti is halted?


ID: 1047620 · Report as offensive
Profile platium
Avatar

Send message
Joined: 5 Jul 10
Posts: 212
Credit: 262,426
RAC: 0
United Kingdom
Message 1047623 - Posted: 11 Nov 2010, 17:48:09 UTC

Someone has about 1.5 million WU's looking at server, Must be very slow returning, I run out and my pc is slow

ID: 1047623 · Report as offensive
B-Man
Volunteer tester

Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1047637 - Posted: 11 Nov 2010, 18:36:15 UTC - in response to Message 1047620.

In the last 2-3 weeks both my pc do not receive any workunit, and then Boinc is not working for seti. Only seti@home does not work. Why? Seti is halted?


Seti has had problems with servers and is offline until 2 new ones come in. They hope to be back online around the end of november.

ID: 1047637 · Report as offensive
rob smithProject Donor
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 13300
Credit: 154,136,637
RAC: 112,392
United Kingdom
Message 1047670 - Posted: 11 Nov 2010, 21:11:45 UTC - in response to Message 1047623.

Someone has about 1.5 million WU's looking at server, Must be very slow returning, I run out and my pc is slow

Or they are only able to compute for a few hours a day, or they've had PC problems.
Or seti has been "sidelined" by other BOINC projects which give shorter turnaround times - one of my crunchers still has a couple of SETI WU to run, but is quite happy crunching the milkyway at high priority because that project's WU only have a few days turnaround compared to SETI's weeks.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

ID: 1047670 · Report as offensive
Profile platium
Avatar

Send message
Joined: 5 Jul 10
Posts: 212
Credit: 262,426
RAC: 0
United Kingdom
Message 1047672 - Posted: 11 Nov 2010, 21:32:27 UTC - in response to Message 1047670.

yes you maybe right i cleared all ny seti before starting new programme

ID: 1047672 · Report as offensive
Oddbjornik
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 106
Credit: 127,339,919
RAC: 47,042
Norway
Message 1047692 - Posted: 11 Nov 2010, 23:11:05 UTC

Just an idea for possibly speeding up the database size reduction: How about distributing more copies of pending results already before they expire? That way the project could utilize some of its current massive overcapacity to add redundancy and thus accelerate the decline in "Results returned and awaiting validation".

Normally the resending of timed-out WUs works in a fairly stretched-out way (timewise). This gives the best resource utilization when the project is up and running - we only resend results that really have timed out and need to be resent.

But these weeks, with capacity to burn, I guess a more parallel work-mode might come in handy. If one or two extra results were distributed already today, and returned tomorrow, then that old result that was sent out in October and times out next week will no longer need to be resent (and thus kept active), because the WU will already have the required quorum of two results and can be finalized.


ID: 1047692 · Report as offensive
Metod, S56RKO
Volunteer tester

Send message
Joined: 27 Sep 02
Posts: 309
Credit: 64,228,898
RAC: 45,899
Slovenia
Message 1047753 - Posted: 12 Nov 2010, 8:05:49 UTC - in response to Message 1047692.

But these weeks, with capacity to burn, I guess a more parallel work-mode might come in handy. If one or two extra results were distributed already today, and returned tomorrow, then that old result that was sent out in October and times out next week will no longer need to be resent (and thus kept active), because the WU will already have the required quorum of two results and can be finalized.


This would speed up things a bit but not entirely. WU can not be finalized until quorum has been met and results have been validated and all outstanding WUs have either been reported or timed out. If WUs get re-issued prior to expiration of existing results, WUs would still need to live until all remaining results of same WU expire. But not longer as hopefully there would already be a quorum created by faster crunchers.
Metod ...

ID: 1047753 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2577
Credit: 34,649,208
RAC: 20,069
United States
Message 1047826 - Posted: 12 Nov 2010, 16:20:10 UTC

Just a query - while we're waiting for the new servers, how about Beta granting credit for returned WU's? I returned 85 when Beta finally came up, and received another 40 or so from the built-up un-crunched queue - I've been steadily returning those as they've crunched, but my Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??


.

ID: 1047826 · Report as offensive
Profile Fred J. Verster
Volunteer tester
Avatar

Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,903,643
RAC: 0
Netherlands
Message 1047840 - Posted: 12 Nov 2010, 17:20:36 UTC - in response to Message 1047826.
Last modified: 12 Nov 2010, 17:24:44 UTC

Just a query - while we're waiting for the new servers, how about Beta granting credit for returned WU's? I returned 85 when Beta finally came up, and received another 40 or so from the built-up un-crunched queue - I've been steadily returning those as they've crunched, but my Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??



Now that you mention it, I've crunched a few hundred MB WU's and got some new work, afew days ago, too.
But haven't seen any credit update, since 2 month's.
Well with the weekend ahead, it'll be monday or later ;-)

Hmmm could be updated already, try to check.

ID: 1047840 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 900
Credit: 7,844,938
RAC: 937
New Zealand
Message 1048083 - Posted: 13 Nov 2010, 5:39:27 UTC - in response to Message 1047826.

My Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??

Beta validators are off at Beta there are 43,610 waiting validation as of 13 Nov 2010 4:48:08 UTC. data-driven web pages & vote_monitor are the only things running

ID: 1048083 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2577
Credit: 34,649,208
RAC: 20,069
United States
Message 1048174 - Posted: 13 Nov 2010, 17:11:37 UTC - in response to Message 1048083.

My Beta stats line is flat since sometime in September! Or would this be too much on the substitute database server??

Beta validators are off at Beta there are 43,610 waiting validation as of 13 Nov 2010 4:48:08 UTC. data-driven web pages & vote_monitor are the only things running


The "waiting for validation" number is the number of WU's that have been returned by one cruncher and are waiting for a wingman's result...
.

ID: 1048174 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Technical News : Status / Credit (Nov 03 2010)


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.