Almost out of Work...

Message boards : Number crunching : Almost out of Work...
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Jason Safoutin
Volunteer tester
Avatar

Send message
Joined: 8 Sep 05
Posts: 1386
Credit: 200,389
RAC: 0
United States
Message 227950 - Posted: 8 Jan 2006, 14:27:55 UTC

As you can see on the Server Status Page there are just over 70,000 WU's left to send. The updates are hours old in some cases and the splitters etc seem to be in the GREEN but we are almost out of work. Bad news is, it's Sunday...Will anyone be around to "fix" this (if needed)....or are we going to have to wait until Monday...Hmmm....*wonders* :-/
"By faith we understand that the universe was formed at God's command, so that what is seen was not made out of what was visible". Hebrews 11.3

ID: 227950 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19012
Credit: 40,757,560
RAC: 67
United Kingdom
Message 227954 - Posted: 8 Jan 2006, 14:38:09 UTC

There wer less than 60,000 about 8 hrs ago so they're going up.
See Scarecrows graphs
ID: 227954 · Report as offensive
Profile Jakesnake5
Volunteer tester

Send message
Joined: 14 May 99
Posts: 65
Credit: 18,370,396
RAC: 0
United States
Message 227972 - Posted: 8 Jan 2006, 15:49:44 UTC

Look at the tape (splitter) positions. each tape holds 33000 blocks, each read is 48 blocks that are split into 256 WU's.

It's logical that they wouldnt keep a couple million WU's ready to send you know. :)
ID: 227972 · Report as offensive
Swibby Bear

Send message
Joined: 1 Aug 01
Posts: 246
Credit: 7,945,093
RAC: 0
United States
Message 227984 - Posted: 8 Jan 2006, 17:00:20 UTC - in response to Message 227950.  

As you can see on the Server Status Page there are just over 70,000 WU's left to send. The updates are hours old in some cases and the splitters etc seem to be in the GREEN but we are almost out of work. Bad news is, it's Sunday...Will anyone be around to "fix" this (if needed)....or are we going to have to wait until Monday...Hmmm....*wonders* :-/



Read, Jason, Read!

Matt said he might do an outage to again compress the db on Sunday or Monday.

70,000 is GREAT, considering that there were none available just a day or two ago. The splitters are doing fine, and there is nothing about the splitters that needs to be fixed. The deleters could sure use some help, though. The enhanced version will sure help all the processes when it is released.

Whit
ID: 227984 · Report as offensive
Jack Gulley

Send message
Joined: 4 Mar 03
Posts: 423
Credit: 526,566
RAC: 0
United States
Message 228024 - Posted: 8 Jan 2006, 18:14:31 UTC

I hope he runs into the lab today and does the compression and backup.

The up/down/up/down of the Network link from the main site to the SSL lab is getting worse (been failing as of about midnight Friday night) and could go out at any time.

Berkeley campus Network support will not even look at their "ticket" on this problem until 8:00 am Monday their time. And it could be at least four hours before they even start to look into the problem. If it is a Cogent link problem, then there could be a delay in getting them involved.

So it would be best if he ran in today and started the process and just shut everything down now. Then hopefully when he is done after an over night run, the Network problem will be fixed and we can use the outage recovery as a test to see if this failing network hardware has been causing problem all along.
ID: 228024 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 228028 - Posted: 8 Jan 2006, 18:32:19 UTC

My best guess is that the DB issues are causing the slowness in getting work, the Splitters are probably more than capable of making work, but the data server is where the bottleneck is. The campus network is seperate from the Cogent link. This time it appears Cogent is working fine, but the SSL/campus network line is troubled.

So, The Existing DB issues seem to still be with us, and the new Berkeley network line is having troubles. two seperate issues

ID: 228028 · Report as offensive
Swibby Bear

Send message
Joined: 1 Aug 01
Posts: 246
Credit: 7,945,093
RAC: 0
United States
Message 228051 - Posted: 8 Jan 2006, 19:29:56 UTC

Actually, my thinking would be to wait until either the Berkeley router fails completely or the campus staff takes it down for repair/replacement. Then Matt can do the 3-hour or so outage to compress and reorganize the db while the line is down. That way, both problems will be worked on concurrently, rather than two separate outages for two different reasons.

Matt, don'tcha love all the armchair advice?

Whit
ID: 228051 · Report as offensive
Profile Jakesnake5
Volunteer tester

Send message
Joined: 14 May 99
Posts: 65
Credit: 18,370,396
RAC: 0
United States
Message 228074 - Posted: 8 Jan 2006, 20:26:24 UTC

Having been the Admin for an ISP, I know how coordinating that would be.

The IT guys wouldnt tell the lab guys WHEN their going to do work like that, so synchronizing would be a serious issue. Matt would have to be watching the network monitor just to GUESS it was down hard, and call IT to find out if their working on it.

When I dealt with the providers here, it was worse than pulling hens teeth to get a straight answer from them.
ID: 228074 · Report as offensive
Profile Mr.Pernod
Volunteer tester
Avatar

Send message
Joined: 8 Feb 04
Posts: 350
Credit: 1,015,988
RAC: 0
Netherlands
Message 228088 - Posted: 8 Jan 2006, 21:07:30 UTC
Last modified: 8 Jan 2006, 21:08:56 UTC

let me do some simple math here.

I average at around 17.6 granted credits per result (average over 270 results).
SETI grants around 16~17M credits daily (see BOINCStats)
This means they validate around 1M returned results per day.
To replenish those, they need to create 1M results/day,
which is close to a result creation rate of 11.6 results/second.
The current creation rate, according to the serverstatus page, is around 12.8 results/second (1.1M results/day).
If they can keep this up, they can even run up a few spare results to send out.
ID: 228088 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 228196 - Posted: 9 Jan 2006, 1:12:33 UTC

But, the data rate of the telescope is only about 1 Million results per day.


BOINC WIKI
ID: 228196 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 228350 - Posted: 9 Jan 2006, 7:01:47 UTC - in response to Message 228196.  

But, the data rate of the telescope is only about 1 Million results per day.

Well, Matt still has a few spare tapes built up from the past ...
ID: 228350 · Report as offensive
Profile Mr.Pernod
Volunteer tester
Avatar

Send message
Joined: 8 Feb 04
Posts: 350
Credit: 1,015,988
RAC: 0
Netherlands
Message 228371 - Posted: 9 Jan 2006, 9:36:18 UTC - in response to Message 228196.  

But, the data rate of the telescope is only about 1 Million results per day.

The most recent tape I have seen being split so far dates back to march 2005,
so I think there's plenty of work waiting in the closet to keep us fed for a long time,
even if there a lot of noisy results and maybe even a couple of blank tapes.
Besides, once Enhanced hits, they better get some more closetspace to store the new tapes ;)
ID: 228371 · Report as offensive
Profile Jason Safoutin
Volunteer tester
Avatar

Send message
Joined: 8 Sep 05
Posts: 1386
Credit: 200,389
RAC: 0
United States
Message 228405 - Posted: 9 Jan 2006, 12:58:32 UTC - in response to Message 228371.  

But, the data rate of the telescope is only about 1 Million results per day.

The most recent tape I have seen being split so far dates back to march 2005,
so I think there's plenty of work waiting in the closet to keep us fed for a long time,
even if there a lot of noisy results and maybe even a couple of blank tapes.
Besides, once Enhanced hits, they better get some more closetspace to store the new tapes ;)


I just crunched a WU yesterday from I think march of 03.
"By faith we understand that the universe was formed at God's command, so that what is seen was not made out of what was visible". Hebrews 11.3

ID: 228405 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 228431 - Posted: 9 Jan 2006, 15:56:45 UTC

The reason the most recent tape was split was around March 05 is not because we have a huge backlog of data - it's because we couldn't afford any more DLT tapes and stopped recording data around that time. Plus all our old DLT drives are broken - we have only one left up here at the lab that reasonably works - that's what I use to read these old data tapes.

I think I have about 50 tapes left in my pile to split. At the current "burn rate" this should last about a month.

However! We are releasing SETI enhanced, which should slow everything down, and this current set of data should last many more months - hopefully long enough to get the new data recorder down to Arecibo and get that all working.

And! Due to one reason or another we do have many tapes that were split and sent out but we have only about 10% scientific return - so we may throw those back into the pipeline if we otherwise run out of workunits to send out.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 228431 · Report as offensive
Profile Mr.Pernod
Volunteer tester
Avatar

Send message
Joined: 8 Feb 04
Posts: 350
Credit: 1,015,988
RAC: 0
Netherlands
Message 228537 - Posted: 9 Jan 2006, 21:41:59 UTC

Taking into account the higher sensitivity of the upcoming Enhanced Application, why not recycle some old tapes with a "large" number of likely candidates? (assuming you kept the old tapes)
ID: 228537 · Report as offensive
kevint
Volunteer tester

Send message
Joined: 17 May 99
Posts: 414
Credit: 11,680,240
RAC: 0
United States
Message 239513 - Posted: 29 Jan 2006, 21:30:20 UTC - in response to Message 228431.  

. Plus all our old DLT drives are broken - we have only one left up here at the lab that reasonably works - that's what I use to read these old data tapes.
- Matt


Matt -

I have a Compaq DLT 40/80 series 3306 unit - it is not doing anything but collecting dust here - How can I get it to you ?

ID: 239513 · Report as offensive
Profile MJKelleher
Volunteer tester
Avatar

Send message
Joined: 1 Jul 99
Posts: 2048
Credit: 1,575,401
RAC: 0
United States
Message 239520 - Posted: 29 Jan 2006, 21:40:04 UTC - in response to Message 239513.  
Last modified: 29 Jan 2006, 21:40:45 UTC

. Plus all our old DLT drives are broken - we have only one left up here at the lab that reasonably works - that's what I use to read these old data tapes.
- Matt


Matt -

I have a Compaq DLT 40/80 series 3306 unit - it is not doing anything but collecting dust here - How can I get it to you ?
From Donate Hardware to SETI@Home:If you have any interest in making such a donation, please send questions/comments to: donors@ssl.berkeley.edu.

MJ

ID: 239520 · Report as offensive

Message boards : Number crunching : Almost out of Work...


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.