Spring Cleaning (Jun 19 2013)


log in

Advanced search

Message boards : Technical News : Spring Cleaning (Jun 19 2013)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1382796 - Posted: 19 Jun 2013, 19:12:40 UTC

Here's a (long overdue) status report. I've was out of the lab for all of May. During that time Eric, Jeff, and company got V7 out the door. Outside of that, operations were pretty much normal (weekly outages, a couple server hiccups, and slow but steady scientific analysis and software development). V7 gives us, among other things, a new ET signature to look for: autocorrelations. Eric described this and more in his thread here.

I think it's safe to say the move to the colocation facility is looking to be a success. The extra bandwidth alone is a huge improvement (yes?). Having less mental clutter involving system admin is another gain. Thus far we had only one minor crisis that required us to actually go there and fix things in person. That's not the worst problem, as the facility is easy enough to get to and near a good cafe. I still spend a lot of time doing admin, but definitely less than before, and with the warm fuzzy feeling that if there are power or heating issues somebody else will deal with it.

Server-news-wise, we did acquire another donated box - a 3U monster that actually contains four motherboards, each with 2 hexa-core Xeon CPUs and 72GB of memory, and 3 SATA drives. Despite being in one box, they are four distinct machines: muarae1, muarae2, muarae3, and muarae4. You may have noticed (or not) that muarae1 has already been employed to replace thinman as the main SETI@home web site server. We hope to retire thinman soon, if only because it is physically too large by today's standards (3U, 4 cpus, 28GB) and thus costing us too much money (as the colocation facility charges us by the rack space unit). It is also too deep for its current rack by a couple inches and hindering air flow. The plans for the remaining muaraes are still being debated. Eric is already using another as a GALFA compute server. By the way, as I write this thinman is still around and getting web hits from the few people/robots out there that have IP addresses hard wired or really stubborn DNS caches.

The current big behind-the-scenes push involves cleaning up the database to get all the different data "epochs" (classic, enchanced, multibeam, non-blanked, hardware-blanked, software-blanked, V7, etc.) into one unified format, while (finally) closing in on a giant programming library to reduce and analyze data from any time or source. Part of the motivation is the acquisition of data from the Green Bank Telescope, and folding that data into our current suite of tools. In particular, my current task is porting the drifiting RFI detection algorithm (which I last touched 14 years ago!) from the hard-wired SERENDIP IV version to a generalized version.

Oh yeah there is a current dearth of work as I am about to post this message. We are on it. We burned through the last batch much quicker than expected.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile morpheus
Avatar
Send message
Joined: 5 Jun 99
Posts: 59
Credit: 23,122,313
RAC: 29,614
Germany
Message 1382799 - Posted: 19 Jun 2013, 19:33:36 UTC - in response to Message 1382796.

Thank you for the heads up.

Btw:
Hosts (http://setiathome.berkeley.edu/sah_status.html)
[...]
muarae1: Intel Server (2 x hexa-core 3.07Hz Xeon, 76 GB RAM)
should be
muarae1: Intel Server (2 x hexa-core 3.07GHz Xeon, 76 GB RAM)

;)
____________
.:morpheus:.

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1382801 - Posted: 19 Jun 2013, 19:35:39 UTC - in response to Message 1382799.


Hosts (http://setiathome.berkeley.edu/sah_status.html)
[...]
muarae1: Intel Server (2 x hexa-core 3.07Hz Xeon, 76 GB RAM)
should be
muarae1: Intel Server (2 x hexa-core 3.07GHz Xeon, 76 GB RAM)


Ha! Yes. Seemed a little less impressive than it was.

- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4141
Credit: 33,582,355
RAC: 26,602
United Kingdom
Message 1382802 - Posted: 19 Jun 2013, 19:37:13 UTC - in response to Message 1382801.

Welcome back Matt, and thanks for the update.

Claggy

Ulrich Metzner
Volunteer tester
Avatar
Send message
Joined: 3 Jul 02
Posts: 993
Credit: 8,746,071
RAC: 10,325
Germany
Message 1382808 - Posted: 19 Jun 2013, 19:57:38 UTC

Thanks for the update, much appreciated!
____________
Aloha, Uli

Profile mr.mac52Project donor
Avatar
Send message
Joined: 18 Mar 03
Posts: 29
Credit: 85,617,700
RAC: 105,491
United States
Message 1382845 - Posted: 19 Jun 2013, 21:51:45 UTC

Understanding the backstory about SETI@home helps make sense of what we volunteers experience on a daily basis.

Thanks for keeping this line of communications open and functional Matt!

John
____________

Rolf
Send message
Joined: 16 Jun 09
Posts: 114
Credit: 7,817,146
RAC: 1
Switzerland
Message 1382850 - Posted: 19 Jun 2013, 22:09:37 UTC

Thanks Matt for the News!
Just one small question: What about the Server named "khan"?

Tom*
Send message
Joined: 12 Aug 11
Posts: 114
Credit: 4,815,274
RAC: 248
United States
Message 1382860 - Posted: 19 Jun 2013, 22:37:30 UTC

What about the Server named "khan"?


An appropriate name for a server thats been asleep for 300 cycles and now

has woken up causing mischief in the universe of SETI.

"The Wrath of Khan"!!

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1382867 - Posted: 19 Jun 2013, 23:13:41 UTC

Oh yeah, khan... I mean... KHAN!!!!

That's an older server that the Berkeley Wireless Research Center was getting rid of so we took it. It was the first thing we installed at the colo facility (to test the waters) and apparently we are now employing it as a NTPCkr/RFI test server. I added it to the server status page machine list.

- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile {BDC} Thomas DupontProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Dec 11
Posts: 3896
Credit: 1,325,539
RAC: 202
France
Message 1383053 - Posted: 20 Jun 2013, 15:11:53 UTC - in response to Message 1382796.

Thanks so much for the heads-up Matt !
Very appreciated ! :)

The extra bandwidth alone is a huge improvement (yes?)

YEEEEESSSSSSSS !!!!
Good luck for cleaning up the database...
____________
Founder of team BRIGADE DU COSMOS
Ranked 55th !

JohnDKProject donor
Volunteer tester
Avatar
Send message
Joined: 28 May 00
Posts: 862
Credit: 46,720,906
RAC: 73,916
Denmark
Message 1383085 - Posted: 20 Jun 2013, 16:04:35 UTC - in response to Message 1383053.

The extra bandwidth alone is a huge improvement (yes?)

YEEEEESSSSSSSS !!!!

+1000

Profile Michael Hoffmann
Volunteer tester
Send message
Joined: 4 Jun 08
Posts: 14
Credit: 1,536,573
RAC: 0
Germany
Message 1383430 - Posted: 21 Jun 2013, 17:45:02 UTC

Just out of curiosity: What is the reason for the reprocessing of data from 2008/2009? Or is this unprocessed data from this epoche which someone found in the corner of a dark cellar room?
____________
Om mani padme hum.

Profile Donald L. JohnsonProject donor
Avatar
Send message
Joined: 5 Aug 02
Posts: 6261
Credit: 738,293
RAC: 1,148
United States
Message 1383492 - Posted: 21 Jun 2013, 21:44:56 UTC - in response to Message 1383430.

Just out of curiosity: What is the reason for the reprocessing of data from 2008/2009? Or is this unprocessed data from this epoche which someone found in the corner of a dark cellar room?

I suspect that the answer might be here.
____________
Donald
Infernal Optimist / Submariner, retired

Profile Chris SProject donor
Volunteer tester
Avatar
Send message
Joined: 19 Nov 00
Posts: 32089
Credit: 13,772,387
RAC: 25,486
United Kingdom
Message 1383862 - Posted: 23 Jun 2013, 7:17:42 UTC

A late thank you to Matt!

Profile Michael Hoffmann
Volunteer tester
Send message
Joined: 4 Jun 08
Posts: 14
Credit: 1,536,573
RAC: 0
Germany
Message 1384001 - Posted: 23 Jun 2013, 19:03:28 UTC - in response to Message 1383492.

Just out of curiosity: What is the reason for the reprocessing of data from 2008/2009? Or is this unprocessed data from this epoche which someone found in the corner of a dark cellar room?

I suspect that the answer might be here.


Thank you, Donald! That was exactly what I was looking for.
____________
Om mani padme hum.

Profile Michel448a
Volunteer tester
Avatar
Send message
Joined: 27 Oct 00
Posts: 1201
Credit: 2,891,635
RAC: 0
Canada
Message 1384373 - Posted: 24 Jun 2013, 21:33:45 UTC

whats about the Near Time Persistency Checker ?
____________

Profile Wiggo
Avatar
Send message
Joined: 24 Jan 00
Posts: 7345
Credit: 96,847,160
RAC: 66,945
Australia
Message 1384382 - Posted: 24 Jun 2013, 22:16:47 UTC - in response to Message 1384373.

whats about the Near Time Persistency Checker ?

http://setiathome.berkeley.edu/forum_thread.php?id=72057&postid=1382867

Cheers.

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1961
Credit: 10,479,194
RAC: 10,516
United States
Message 1384916 - Posted: 26 Jun 2013, 19:22:44 UTC
Last modified: 26 Jun 2013, 19:24:02 UTC

Since the SETI team seems to have more "time on their hands" since the move to the co-location facility, I mention again that:

The "Multi-Beam Data Recorder Status" hasn't updated in 2 years. (and counting)

and

The "SETI@home Data Distribution History" hasn't updated since August 2008.

Just wanted to draw the staff's attention, in case they've forgotten: I know these items are low-priority — but they shouldn't be forgotten!
____________
.

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1384963 - Posted: 26 Jun 2013, 23:06:02 UTC

Ah, yes - those web pages are a little embarrassing... But FYI...

The multi-beam data recorder status broke after a server crash at AO, followed by an increase in stricter network security policies at both AO and UCB. Fair enough, but to get this working again requires a whole new rewrite of code and poking holes in the firewall which we aren't exactly comfortable with. So this just sits there, and I admit it's unsightly.

The data distribution history.. I forgot about why this was broken and recompiled the code and tried running it again, and then remembered: around 2008 we got some corrupted data in the database that breaks several scripts/programs trying to access these corrupt areas including the script that generates this page. It's the kind of corruption that isn't breaking anything important, and would get fixed after we tackle some global database housecleaning projects that are (obviously) still ongoing. Also unsightly...

Thanks for the reminders, though.

- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

1 · 2 · Next

Message boards : Technical News : Spring Cleaning (Jun 19 2013)

Copyright © 2014 University of California