Crashola (Oct 22 2009)

Message boards : Technical News : Crashola (Oct 22 2009)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 942034 - Posted: 22 Oct 2009, 20:52:51 UTC

Eeewww. Last night ptolemy (an internal-use file server) crashed. Eric rebooted it this morning, and I still had a bunch of cleanup to do after that which took me until just about now. Other systems had to be rebooted, nfs/autofs daemons kicked, stale trigger files removed, etc. I also bounced informix as it seems like the science database was locked, but this happened to be two different coincident problems, one affecting the splitters, one affected the assimilators, and making it seem like both were hanging on the science database.

The latter problem was a real nuisance. I had to reboot vader, mess around with iptables/network configs, /etc/exports, etc. all of which seemed to do nothing. The problem was that vader couldn't mount the result storage device (which is exported from bruno) while all other systems had no trouble mounting it. I never figured out the exact problem, but yum'ing in the latest nfs-utils package seemed to massage the right muscle and suddenly it was visible on vader. Fine. Everything is sort of catching up now. Bob also got the mysql replica in working order again, so that's good.

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 942034 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 942055 - Posted: 22 Oct 2009, 23:42:31 UTC - in response to Message 942034.  

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


ID: 942055 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 942076 - Posted: 23 Oct 2009, 0:32:20 UTC - in response to Message 942055.  

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


It is usually a dead chicken that is being waved.


BOINC WIKI
ID: 942076 · Report as offensive
zpm
Volunteer tester
Avatar

Send message
Joined: 25 Apr 08
Posts: 284
Credit: 1,659,024
RAC: 0
United States
Message 942096 - Posted: 23 Oct 2009, 2:13:48 UTC - in response to Message 942076.  

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


It is usually a dead chicken that is being waved.


depends on the culture. LOL!


I recommend Secunia PSI: http://secunia.com/vulnerability_scanning/personal/
Go Georgia Tech.
ID: 942096 · Report as offensive
.clair.

Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 55,390,408
RAC: 69
United Kingdom
Message 942355 - Posted: 23 Oct 2009, 20:30:37 UTC

ref Monty Python

The knight in shining armour would walk in,
and give it a thunk on the head with the chicken,
I don`t know what affect that has on server`s :)
ID: 942355 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 942406 - Posted: 23 Oct 2009, 22:48:38 UTC

Erm...


...what?
ID: 942406 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 942429 - Posted: 24 Oct 2009, 0:29:42 UTC - in response to Message 942406.  

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.


BOINC WIKI
ID: 942429 · Report as offensive
Wembley
Volunteer tester
Avatar

Send message
Joined: 16 Sep 09
Posts: 429
Credit: 1,844,293
RAC: 0
United States
Message 942434 - Posted: 24 Oct 2009, 0:49:00 UTC - in response to Message 942429.  
Last modified: 24 Oct 2009, 0:50:52 UTC

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.


Or by sacrificing an intern. (and people wonder why we go through so many ....)
ID: 942434 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 31010
Credit: 53,134,872
RAC: 32
United States
Message 942495 - Posted: 24 Oct 2009, 5:25:29 UTC - in response to Message 942429.  

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.

You mean the burning sage and chanting is all a front and its really the chicken?

ID: 942495 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 942506 - Posted: 24 Oct 2009, 7:48:01 UTC - in response to Message 942495.  

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.

You mean the burning sage and chanting is all a front and its really the chicken?

Yes, it is.
ID: 942506 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 942510 - Posted: 24 Oct 2009, 8:31:32 UTC

Nothing to do with wearing a gigantic purple pineapple on your head whilst singing the Bolivian national anthem backwards then...
ID: 942510 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22534
Credit: 416,307,556
RAC: 380
United Kingdom
Message 942544 - Posted: 24 Oct 2009, 14:07:31 UTC

How did you know about my incantation?


Might not work on all systems, but certainly cured a few *b* 36s over the years.....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 942544 · Report as offensive
WendyR
Volunteer tester
Avatar

Send message
Joined: 1 Aug 05
Posts: 44
Credit: 1,962,140
RAC: 0
United States
Message 942555 - Posted: 24 Oct 2009, 15:04:16 UTC - in response to Message 942544.  

Someone's membership is going to be revoked for letting the secrets out!!
ID: 942555 · Report as offensive
Profile rebest Project Donor
Volunteer tester
Avatar

Send message
Joined: 16 Apr 00
Posts: 1296
Credit: 45,357,093
RAC: 0
United States
Message 942629 - Posted: 24 Oct 2009, 19:59:50 UTC - in response to Message 942434.  

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.


Or by sacrificing an intern. (and people wonder why we go through so many ....)


We call them graduate students.

Join the PACK!
ID: 942629 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 31010
Credit: 53,134,872
RAC: 32
United States
Message 942639 - Posted: 24 Oct 2009, 21:32:49 UTC - in response to Message 942555.  

Someone's membership is going to be revoked for letting the secrets out!!

I think there is an incantation to stop that ...

ID: 942639 · Report as offensive
Profile Bill Walker
Avatar

Send message
Joined: 4 Sep 99
Posts: 3868
Credit: 2,697,267
RAC: 0
Canada
Message 942662 - Posted: 24 Oct 2009, 23:47:02 UTC

Reminds me of a learned co-worker years ago, who when faced with a large and difficult task, would solemnly say "this will take a while, somebody go get me a few candles and a six pack of chicken blood".

ID: 942662 · Report as offensive
.clair.

Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 55,390,408
RAC: 69
United Kingdom
Message 942799 - Posted: 25 Oct 2009, 20:03:13 UTC

Across ssl and silverlight night,
Thunder cracks an flash from psu
Thyme sage and willow stick.
and burnt essence of diode will do the trick :)

ID: 942799 · Report as offensive
CryptokiD
Avatar

Send message
Joined: 2 Dec 00
Posts: 150
Credit: 3,216,632
RAC: 0
United States
Message 942864 - Posted: 26 Oct 2009, 4:51:42 UTC

sounds like you had you're hands full. thanks for getting us ship shape matt.
ID: 942864 · Report as offensive

Message boards : Technical News : Crashola (Oct 22 2009)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.