Results (Dec 29 2010)

Message boards : Technical News : Results (Dec 29 2010)
Message board moderation

To post messages, you must log in.

1 · 2 · Next

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 1061045 - Posted: 29 Dec 2010, 21:18:22 UTC
Last modified: 29 Dec 2010, 21:19:15 UTC

Last post of the year!

I understand the SETI@home/BOINC back-end is a bit confusing. I think there are only a handful of people who understand all the relationships between every step of the BOINC finite state machine, the SETI@home data pipeline, and every server in our closet. I can only really scratch the surface of these details during these relatively pithy missives.

So let me try my best to quickly answer the general question: "did those two brand new servers (oscar and carolyn) help?"

First of all, there are about 100 known problems with our systems at any given time. Most of these are low priority and "time out" on their own. There are still a bunch of high priority issues, of which these new servers addressed *some*.

One easy problem to fix was replacing mork (the randomly crashing master mysql database server) with carolyn. This has been great... and I think we just (as of this morning) solved the current batch of disk i/o problems (by properly tweaking the write cache settings). Carolyn also has a lot more disks and memory than mork had, so there's still a lot of room to grow as needed.

The other new server, oscar, is taking care of two major problems. First, the science database on thumper was abysmally slow - so now this is on oscar. That's great, however it's not running as fast as we'd like. We still haven't fully benchmarked this, though. Maybe at worst we'll need to add more disks to the system - we shall see. The second major problem oscar is helping to resolve is ptolemy - our internal administrative file server - which, like mork, also randomly crashes from time to time locking everything up. Now that thumper is off the hook as a science database server, it can take over and easily handle ptolemy's current functionality, and then we can retire ptolemy. There's actually a third minor problem that's also getting fixed: thumper's root partition is on a messed-up software RAID device which kinda works but has been scaring us for way too long. It'll be great to have this server-shuffle opportunity to have a quiet moment to reinstall the OS on thumper and fix that RAID.

But that's pretty much it for now. Other major problems exist with no clear solutions. In fact, many of them are data driven, or network infrastucture driven, and therefore out of our sysadmin hands - no server upgrades will solve them.

That said, I hardly want to sound hopeless (and definitely not ungrateful). We're pros at working through our various struggles, and gaining oscar and carolyn has been the largest improvement in years, with still more benefits to come as we get rolling full bore in the new year and more aggressively shake out the remaining configuration problems. Plus a third new donated server (synergy) is coming down the pike, which we'll use to address other current shortcomings. When oscar, carolyn, and synergy are all being used to their fullest potential (a month or two from now?) let's revisit what our biggest system needs are. It may very well be that these new machines did in fact shake out the bulk of our current issues, and we'll be in good shape for years to come.

Happy new year! May we have actually publishable results in 2011 - positive or negative I don't care - it's science either way. We certainly could stand to get something meaningful in the journals concerning all the data we've been reducing for 11 years.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1061045 · Report as offensive
Profile Jim_S

Send message
Joined: 23 Feb 00
Posts: 4705
Credit: 64,560,357
RAC: 31
United States
Message 1061048 - Posted: 29 Dec 2010, 21:22:20 UTC

Thanks for taking the time Matt...Most of us realize how Hard You All work in the Labs and at Home.

I Desire Peace and Justice, Jim Scott (Mod-Ret.)
ID: 1061048 · Report as offensive
Profile perryjay
Volunteer tester

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1061056 - Posted: 29 Dec 2010, 21:37:20 UTC - in response to Message 1061045.  

Thank you for the update Matt. May all of you there have a very Happy New Year!!

ID: 1061056 · Report as offensive
Profile skildude

Send message
Joined: 4 Oct 00
Posts: 9541
Credit: 50,759,529
RAC: 60
Message 1061060 - Posted: 29 Dec 2010, 21:39:47 UTC - in response to Message 1061048.  

Sounds like S@h is doing pretty well on its firm diet of shoe strings. Congrats one and all for all your work

In a rich man's house there is no place to spit but his face.
Diogenes Of Sinope
ID: 1061060 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 25 Dec 00
Posts: 30803
Credit: 53,134,872
RAC: 32
United States
Message 1061066 - Posted: 29 Dec 2010, 21:53:28 UTC

Thanks for the words. Go Home! Have a happy and prosperous new year.
ID: 1061066 · Report as offensive
Profile Geek@Play
Volunteer tester

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 1061092 - Posted: 29 Dec 2010, 22:20:39 UTC

Thanks for the info Matt. Your taking the time to post these short notes is commendable indeed. These notes are what keep a lot of crunchers here at Seti, believe it or not.

Happy New Year to all the crew at Seti/Boinc. Hope next year we get published also. It would be nice after all these years to see some results in print.

ID: 1061092 · Report as offensive

Send message
Joined: 25 Aug 01
Posts: 77
Credit: 386,336
RAC: 0
United States
Message 1061138 - Posted: 30 Dec 2010, 0:23:27 UTC

Happy New Year to you and the rest of the Crew!

ID: 1061138 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 9 Jul 00
Posts: 51470
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1061145 - Posted: 30 Dec 2010, 0:38:09 UTC

Thank you for that post, Matt.
Some don't realize that a couple of servers don't make the project.
We shall continue to bolster the hardware for you when and where needed.

Here's to all of the boyz in da lab and a great coming Seti New Year.
I pray you have worked through the worst.

"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1061145 · Report as offensive
Profile Taxman59

Send message
Joined: 9 Feb 00
Posts: 13
Credit: 3,940,341
RAC: 3
United States
Message 1061146 - Posted: 30 Dec 2010, 0:39:07 UTC

With all of the good work you have done this year with less than "stellar" equipment, I hope that the project leaders have seen fit to give you a year end performance reward. I know that you are not in this for the $, but with what you have managed to do this year, there should be something for you. Maybe there is some kibble for you somewhere. If not, then you are building up one heck of a positive karma.

thanks for all you have done

ID: 1061146 · Report as offensive
Profile James Sotherden

Send message
Joined: 16 May 99
Posts: 10436
Credit: 110,373,059
RAC: 54
United States
Message 1061157 - Posted: 30 Dec 2010, 1:16:35 UTC

Thanks for the update Matt. May you and the rest of the Crew have a happy new year.

Old James
ID: 1061157 · Report as offensive
Profile Bill G Special Project $75 donor

Send message
Joined: 1 Jun 01
Posts: 1282
Credit: 187,688,550
RAC: 182
United States
Message 1061180 - Posted: 30 Dec 2010, 3:04:56 UTC - in response to Message 1061157.  

Thanks for posting. And have a Happy New Year....all of you.

SETI@home classic workunits 4,019
SETI@home classic CPU time 34,348 hours
ID: 1061180 · Report as offensive
Volunteer tester

Send message
Joined: 11 Jun 08
Posts: 732
Credit: 20,635,586
RAC: 5
New Zealand
Message 1061185 - Posted: 30 Dec 2010, 3:10:41 UTC

Most of us understand that 10% of the machines in any system cause 90% of the problems. Fix or replace those, and 90% of your problems go away.

Sounds like that is what you've done. There will still be other issues and random gremlins, now and in the future, but it seems you have wiped out a lot the gremlins with the new servers.

Onwards and Upwards :-)

ID: 1061185 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester

Send message
Joined: 17 Feb 01
Posts: 34305
Credit: 79,922,639
RAC: 80
Message 1061331 - Posted: 30 Dec 2010, 8:42:53 UTC

Happy new year Matt and the rest of the crew.

Thanks for the hard work.
Its much apreciated.

With each crime and every kindness we birth our future.
ID: 1061331 · Report as offensive

Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1061506 - Posted: 30 Dec 2010, 16:52:38 UTC

Just to repeat everyone else, thanks for the post Matt. It's nice knowing what's up behind the scenes when possible. It's a lot of hard pain in the butt work at time and most of us know it, but rarely recognize it. Typical IT department stuff I suppose, always gets taken for granted! Either way nice job fellas, have an enjoyable new years and come in fresh for the 2011 year! It's going to be a hell of a ride.
Traveling through space at ~67,000mph!
ID: 1061506 · Report as offensive
Volunteer tester

Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1061552 - Posted: 30 Dec 2010, 18:35:14 UTC

Thanks for the update on the servers. I always like more insight into how the project is run.
Have a wonderful new years and see you next year.
ID: 1061552 · Report as offensive
Volunteer tester

Send message
Joined: 23 May 99
Posts: 166
Credit: 3,450,910
RAC: 0
United States
Message 1061796 - Posted: 31 Dec 2010, 4:55:58 UTC

Thank you for the update, Matt. Happy New Year.
ID: 1061796 · Report as offensive
Profile Igogo Project Donor
Volunteer tester

Send message
Joined: 18 Dec 04
Posts: 125
Credit: 65,303,299
RAC: 44
Message 1061845 - Posted: 31 Dec 2010, 9:15:59 UTC - in response to Message 1061796.  

Happy New Year!!!!!
SETI forever. I want to belive..
ID: 1061845 · Report as offensive
Profile Fred J. Verster
Volunteer tester

Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,903,643
RAC: 0
Message 1061850 - Posted: 31 Dec 2010, 9:44:49 UTC - in response to Message 1061845.  

Thanks Matt, for the clear explanation of the situation in the lab and
ofcoarse a Happy new 2011...

ID: 1061850 · Report as offensive
Profile Shilo Haapala

Send message
Joined: 8 Dec 07
Posts: 1
Credit: 270,156
RAC: 0
Message 1062362 - Posted: 1 Jan 2011, 13:17:30 UTC

Good stuff! Keep up the excellent work and Happy New Year to all.
ID: 1062362 · Report as offensive

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 1062398 - Posted: 1 Jan 2011, 16:21:07 UTC

Nothing cleaver here from me, Matt. Just a complement to you and your team for your perseverence on so many levels last year. Hopefully, there will be a good science publication in 2011, which will make it a very happy new year indeed!
ID: 1062398 · Report as offensive
1 · 2 · Next

Message boards : Technical News : Results (Dec 29 2010)

©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.