Crashola (Oct 22 2009)


log in

Advanced search

Message boards : Technical News : Crashola (Oct 22 2009)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1391
Credit: 74,079
RAC: 10
United States
Message 942034 - Posted: 22 Oct 2009, 20:52:51 UTC

Eeewww. Last night ptolemy (an internal-use file server) crashed. Eric rebooted it this morning, and I still had a bunch of cleanup to do after that which took me until just about now. Other systems had to be rebooted, nfs/autofs daemons kicked, stale trigger files removed, etc. I also bounced informix as it seems like the science database was locked, but this happened to be two different coincident problems, one affecting the splitters, one affected the assimilators, and making it seem like both were hanging on the science database.

The latter problem was a real nuisance. I had to reboot vader, mess around with iptables/network configs, /etc/exports, etc. all of which seemed to do nothing. The problem was that vader couldn't mount the result storage device (which is exported from bruno) while all other systems had no trouble mounting it. I never figured out the exact problem, but yum'ing in the latest nfs-utils package seemed to massage the right muscle and suddenly it was visible on vader. Fine. Everything is sort of catching up now. Bob also got the mysql replica in working order again, so that's good.

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile Ageless
Avatar
Send message
Joined: 9 Jun 99
Posts: 12461
Credit: 2,690,003
RAC: 1,209
Netherlands
Message 942055 - Posted: 22 Oct 2009, 23:42:31 UTC - in response to Message 942034.

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


____________
Jord

Fighting for the correct use of the apostrophe, together with Weird Al Yankovic

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 529,853
RAC: 329
United States
Message 942076 - Posted: 23 Oct 2009, 0:32:20 UTC - in response to Message 942055.

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


It is usually a dead chicken that is being waved.
____________


BOINC WIKI

zpm
Volunteer tester
Avatar
Send message
Joined: 25 Apr 08
Posts: 284
Credit: 1,616,384
RAC: 401
United States
Message 942096 - Posted: 23 Oct 2009, 2:13:48 UTC - in response to Message 942076.

Hopefully this isn't a sign that ptolemy is on its way out... Ugh.

Have you tried letting a Voodoo lady with a naked chicken dance around it? :-)


It is usually a dead chicken that is being waved.


depends on the culture. LOL!

____________

I recommend Secunia PSI: http://secunia.com/vulnerability_scanning/personal/
Go Georgia Tech.

.clair.
Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 23,569,242
RAC: 29,726
United Kingdom
Message 942355 - Posted: 23 Oct 2009, 20:30:37 UTC

ref Monty Python

The knight in shining armour would walk in,
and give it a thunk on the head with the chicken,
I don`t know what affect that has on server`s :)

Dave
Avatar
Send message
Joined: 29 Mar 02
Posts: 774
Credit: 23,193,139
RAC: 0
United Kingdom
Message 942406 - Posted: 23 Oct 2009, 22:48:38 UTC

Erm...


...what?

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 529,853
RAC: 329
United States
Message 942429 - Posted: 24 Oct 2009, 0:29:42 UTC - in response to Message 942406.

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.
____________


BOINC WIKI

Wembley
Volunteer tester
Avatar
Send message
Joined: 16 Sep 09
Posts: 415
Credit: 888,257
RAC: 0
United States
Message 942434 - Posted: 24 Oct 2009, 0:49:00 UTC - in response to Message 942429.
Last modified: 24 Oct 2009, 0:50:52 UTC

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.


Or by sacrificing an intern. (and people wonder why we go through so many ....)

Profile Gary CharpentierProject donor
Volunteer tester
Avatar
Send message
Joined: 25 Dec 00
Posts: 13174
Credit: 7,905,601
RAC: 14,202
United States
Message 942495 - Posted: 24 Oct 2009, 5:25:29 UTC - in response to Message 942429.

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.

You mean the burning sage and chanting is all a front and its really the chicken?

____________

Profile Ageless
Avatar
Send message
Joined: 9 Jun 99
Posts: 12461
Credit: 2,690,003
RAC: 1,209
Netherlands
Message 942506 - Posted: 24 Oct 2009, 7:48:01 UTC - in response to Message 942495.

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.

You mean the burning sage and chanting is all a front and its really the chicken?

Yes, it is.
____________
Jord

Fighting for the correct use of the apostrophe, together with Weird Al Yankovic

Dave
Avatar
Send message
Joined: 29 Mar 02
Posts: 774
Credit: 23,193,139
RAC: 0
United Kingdom
Message 942510 - Posted: 24 Oct 2009, 8:31:32 UTC

Nothing to do with wearing a gigantic purple pineapple on your head whilst singing the Bolivian national anthem backwards then...

rob smithProject donor
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8809
Credit: 62,890,289
RAC: 75,394
United Kingdom
Message 942544 - Posted: 24 Oct 2009, 14:07:31 UTC

How did you know about my incantation?


Might not work on all systems, but certainly cured a few *b* 36s over the years.....
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

WendyR
Volunteer tester
Avatar
Send message
Joined: 1 Aug 05
Posts: 44
Credit: 1,962,140
RAC: 0
United States
Message 942555 - Posted: 24 Oct 2009, 15:04:16 UTC - in response to Message 942544.

Someone's membership is going to be revoked for letting the secrets out!!
____________

Profile rebestProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Apr 00
Posts: 1296
Credit: 33,484,355
RAC: 15,009
United States
Message 942629 - Posted: 24 Oct 2009, 19:59:50 UTC - in response to Message 942434.

Erm...


...what?

Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken.


Or by sacrificing an intern. (and people wonder why we go through so many ....)


We call them graduate students.
____________

Join the PACK!

Profile Gary CharpentierProject donor
Volunteer tester
Avatar
Send message
Joined: 25 Dec 00
Posts: 13174
Credit: 7,905,601
RAC: 14,202
United States
Message 942639 - Posted: 24 Oct 2009, 21:32:49 UTC - in response to Message 942555.

Someone's membership is going to be revoked for letting the secrets out!!

I think there is an incantation to stop that ...

____________

Profile Bill Walker
Avatar
Send message
Joined: 4 Sep 99
Posts: 3456
Credit: 2,211,241
RAC: 875
Canada
Message 942662 - Posted: 24 Oct 2009, 23:47:02 UTC

Reminds me of a learned co-worker years ago, who when faced with a large and difficult task, would solemnly say "this will take a while, somebody go get me a few candles and a six pack of chicken blood".
____________

.clair.
Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 23,569,242
RAC: 29,726
United Kingdom
Message 942799 - Posted: 25 Oct 2009, 20:03:13 UTC

Across ssl and silverlight night,
Thunder cracks an flash from psu
Thyme sage and willow stick.
and burnt essence of diode will do the trick :)

CryptokiD
Avatar
Send message
Joined: 2 Dec 00
Posts: 134
Credit: 2,814,936
RAC: 0
United States
Message 942864 - Posted: 26 Oct 2009, 4:51:42 UTC

sounds like you had you're hands full. thanks for getting us ship shape matt.

Message boards : Technical News : Crashola (Oct 22 2009)

Copyright © 2014 University of California