Nested Problems (Feb 28 2007)


log in

Advanced search

Message boards : Technical News : Nested Problems (Feb 28 2007)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 524748 - Posted: 28 Feb 2007, 23:52:17 UTC

A day of nested problems, starting with Eric's desktop computer going on the fritz. Normally he would deal with it himself but he was out of the office. Usually when systems just suddenly crash without warning, my initial gut reaction is insufficient cooling. I checked out his system and sure enough found the hard drives inside (a pair, mounted in the front of the case away from all fans) were hot to the touch. Nobody had time to transplant any hardware - we just needed the system up and running. So I kept the case open and searched the lab for a table-top fan to blow air inside the system. We had two of them back up in my lab. One simply didn't work. Great. The other worked, but due to previous wear and tear immediately the blade flew off (not enough tension). I had to perform surgery to jury rig the thing back together. An uncommon use of bubble wrap was employed during this procedure. I brought the fan back down to Eric's office followed by a few minutes of following and yanking out dusty unused power cables (to free up an outlet) and placing the right upside-down garbage can on the right box to perfectly perch the fan to blow air right on the hot drives.

Oh yeah.. I'm supposed to be getting isaac back on line. The OS portion was more or less done yesterday, but the initial yum update took all night, pushing the remaining configuration to this morning. It was like pulling teeth getting mysql and httpd working. It's bad enough hammering out configuration problems. But at one point suddenly the ethernet stopped working and we had to figure that out. And then another point we suddenly couldn't mount the system which held the database backup. Oy. By mid afternoon I cobbled together enough functionality to turn the web site back on.

Meanwhile (there's always a meanwhile) there's a bunch of testing going on to figure out what's causing blips in our data (there are threads in the staff blog about all this). Jeff's been collecting test data the past day or so, but then the data recorder crashed last night. Turns out multiple instances of the data recorder process were running which caused the system to panic. My script (350 lines of perl) controls all the wacky logic to keep the thing running smoothly 24/7 without intervention. So I was called in to fix the damn thing. This was a simple tweak - it wasn't a bug as much as a new special case requiring different logic.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile Dr. C.E.T.I.
Avatar
Send message
Joined: 29 Feb 00
Posts: 15993
Credit: 690,597
RAC: 1
United States
Message 524749 - Posted: 1 Mar 2007, 0:00:17 UTC


To a Job Well Done - busy eh . . . Glad things turned out alright Sir!

> will now proceed to start BOINC again . . .

Thanks for the Update Matt

Profile Keith T.
Volunteer tester
Avatar
Send message
Joined: 23 Aug 99
Posts: 738
Credit: 231,700
RAC: 18
United Kingdom
Message 524903 - Posted: 1 Mar 2007, 8:08:45 UTC

Happy SETI Birthday Matt, 8 years today, and nobody, 7 years.

Profile Dr. C.E.T.I.
Avatar
Send message
Joined: 29 Feb 00
Posts: 15993
Credit: 690,597
RAC: 1
United States
Message 524938 - Posted: 1 Mar 2007, 12:55:13 UTC - in response to Message 524903.


Happy SETI Birthday Matt, 8 years today, and nobody, 7 years.


Thank You Keith . . . Happy Anniversary to You Also . . .

'Off Topic' Note: seen this ?

Q. Anybody take NOTE of the Following Individuals that Joined that same Day (PST - Los Angeles, California) X-Files . . . ;)


The SETI@home Class of Feb 29 2000


1492) FoxMulder Tue Feb 29 18:13:32 2000 Thu May 25 18:16:48 2000 14 881 hr 58 min 62 hr 59 min 51.6 sec United States

2011) Scully Tue Feb 29 18:08:59 2000 Thu Jul 6 01:44:35 2000 3 153 hr 59 min 51 hr 19 min 56.6 sec United States

2154) Bill Gates Tue Feb 29 20:38:59 2000 Tue Apr 4 03:37:36 2000 2 112 hr 44 min 56 hr 22 min 25.6 sec United States

2455) Richard W Lubrich Jr - Tue Feb 29 05:57:06 2000 Wed Feb 19 12:23:37 2003 - 0 - 0 hr 00 min United States

'Back - on - Topic' - Again - Great Post Matt . . .

Message boards : Technical News : Nested Problems (Feb 28 2007)

Copyright © 2014 University of California