Crashola (Oct 22 2009)

Message boards : Technical News : Crashola (Oct 22 2009)

Author	Message
Matt Lebofsky Volunteer moderator Project administrator Project developer Project scientist Send message Joined: 1 Mar 99 Posts: 1375 Credit: 74,079 RAC: 0	Message 942034 - Posted: 22 Oct 2009, 20:52:51 UTC
	Eeewww. Last night ptolemy (an internal-use file server) crashed. Eric rebooted it this morning, and I still had a bunch of cleanup to do after that which took me until just about now. Other systems had to be rebooted, nfs/autofs daemons kicked, stale trigger files removed, etc. I also bounced informix as it seems like the science database was locked, but this happened to be two different coincident problems, one affecting the splitters, one affected the assimilators, and making it seem like both were hanging on the science database. The latter problem was a real nuisance. I had to reboot vader, mess around with iptables/network configs, /etc/exports, etc. all of which seemed to do nothing. The problem was that vader couldn't mount the result storage device (which is exported from bruno) while all other systems had no trouble mounting it. I never figured out the exact problem, but yum'ing in the latest nfs-utils package seemed to massage the right muscle and suddenly it was visible on vader. Fine. Everything is sort of catching up now. Bob also got the mysql replica in working order again, so that's good. Hopefully this isn't a sign that ptolemy is on its way out... Ugh. - Matt ____________ -- BOINC/SETI@home network/web/science/development person -- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
	ID: 942034 ·

Ageless Send message Joined: 9 Jun 99 Posts: 11635 Credit: 1,999,148 RAC: 4,222	Message 942055 - Posted: 22 Oct 2009, 23:42:31 UTC - in response to Message 942034.
	Hopefully this isn't a sign that ptolemy is on its way out... Ugh. Have you tried letting a Voodoo lady with a naked chicken dance around it? :-) ____________ Jord - BOINC FAQ Service - BOINC User Wiki Real is just a matter of perception.
	ID: 942055 ·

John McLeod VII Volunteer developer Volunteer tester Send message Joined: 15 Jul 99 Posts: 22343 Credit: 439,209 RAC: 396	Message 942076 - Posted: 23 Oct 2009, 0:32:20 UTC - in response to Message 942055.
	Hopefully this isn't a sign that ptolemy is on its way out... Ugh. Have you tried letting a Voodoo lady with a naked chicken dance around it? :-) It is usually a dead chicken that is being waved. ____________ BOINC WIKI
	ID: 942076 ·

zpm Volunteer tester Send message Joined: 25 Apr 08 Posts: 284 Credit: 975,677 RAC: 0	Message 942096 - Posted: 23 Oct 2009, 2:13:48 UTC - in response to Message 942076.
	Hopefully this isn't a sign that ptolemy is on its way out... Ugh. Have you tried letting a Voodoo lady with a naked chicken dance around it? :-) It is usually a dead chicken that is being waved. depends on the culture. LOL! ____________ I recommend Secunia PSI: http://secunia.com/vulnerability_scanning/personal/ Go Georgia Tech.
	ID: 942096 ·

clive G1FYE Volunteer moderator Send message Joined: 4 Nov 04 Posts: 1284 Credit: 14,941,395 RAC: 2,739	Message 942355 - Posted: 23 Oct 2009, 20:30:37 UTC
	ref Monty Python The knight in shining armour would walk in, and give it a thunk on the head with the chicken, I don`t know what affect that has on server`s :)
	ID: 942355 ·

Dave Send message Joined: 29 Mar 02 Posts: 774 Credit: 23,193,139 RAC: 0	Message 942406 - Posted: 23 Oct 2009, 22:48:38 UTC
	Erm... ...what?
	ID: 942406 ·

John McLeod VII Volunteer developer Volunteer tester Send message Joined: 15 Jul 99 Posts: 22343 Credit: 439,209 RAC: 396	Message 942429 - Posted: 24 Oct 2009, 0:29:42 UTC - in response to Message 942406.
	Erm... ...what? Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken. ____________ BOINC WIKI
	ID: 942429 ·

Wembley Volunteer tester Send message Joined: 16 Sep 09 Posts: 415 Credit: 879,818 RAC: 0	Message 942434 - Posted: 24 Oct 2009, 0:49:00 UTC - in response to Message 942429. Last modified: 24 Oct 2009, 0:50:52 UTC
	Erm... ...what? Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken. Or by sacrificing an intern. (and people wonder why we go through so many ....)
	ID: 942434 ·

Gary Charpentier Volunteer tester Send message Joined: 25 Dec 00 Posts: 10317 Credit: 5,080,740 RAC: 5,985	Message 942495 - Posted: 24 Oct 2009, 5:25:29 UTC - in response to Message 942429.
	Erm... ...what? Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken. You mean the burning sage and chanting is all a front and its really the chicken? ____________
	ID: 942495 ·

Ageless Send message Joined: 9 Jun 99 Posts: 11635 Credit: 1,999,148 RAC: 4,222	Message 942506 - Posted: 24 Oct 2009, 7:48:01 UTC - in response to Message 942495.
	Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken. You mean the burning sage and chanting is all a front and its really the chicken? Yes, it is. ____________ Jord - BOINC FAQ Service - BOINC User Wiki Real is just a matter of perception.
	ID: 942506 ·

Dave Send message Joined: 29 Mar 02 Posts: 774 Credit: 23,193,139 RAC: 0	Message 942510 - Posted: 24 Oct 2009, 8:31:32 UTC
	Nothing to do with wearing a gigantic purple pineapple on your head whilst singing the Bolivian national anthem backwards then...
	ID: 942510 ·

rob smith Volunteer moderator Send message Joined: 7 Mar 03 Posts: 5447 Credit: 20,599,580 RAC: 126,455	Message 942544 - Posted: 24 Oct 2009, 14:07:31 UTC
	How did you know about my incantation? Might not work on all systems, but certainly cured a few b 36s over the years..... ____________ Bob Smith Member of Seti PIPPS (Pluto is a Planet Protest Society) Somewhere in the (un)known Universe?
	ID: 942544 ·

WendyR Volunteer tester Send message Joined: 1 Aug 05 Posts: 44 Credit: 1,953,578 RAC: 2,059	Message 942555 - Posted: 24 Oct 2009, 15:04:16 UTC - in response to Message 942544.
	Someone's membership is going to be revoked for letting the secrets out!! ____________
	ID: 942555 ·

rebest Volunteer tester Send message Joined: 16 Apr 00 Posts: 1291 Credit: 25,337,894 RAC: 27,078	Message 942629 - Posted: 24 Oct 2009, 19:59:50 UTC - in response to Message 942434.
	Erm... ...what? Obviously you have never worked with a really senior SysAdmin that can fix any problem with the correct incantation, occasionally this must also be accompanied by waving a dead chicken. Or by sacrificing an intern. (and people wonder why we go through so many ....) We call them graduate students. ____________ Join the PACK!
	ID: 942629 ·

Gary Charpentier Volunteer tester Send message Joined: 25 Dec 00 Posts: 10317 Credit: 5,080,740 RAC: 5,985	Message 942639 - Posted: 24 Oct 2009, 21:32:49 UTC - in response to Message 942555.
	Someone's membership is going to be revoked for letting the secrets out!! I think there is an incantation to stop that ... ____________
	ID: 942639 ·

Bill Walker Send message Joined: 4 Sep 99 Posts: 2861 Credit: 1,778,689 RAC: 216	Message 942662 - Posted: 24 Oct 2009, 23:47:02 UTC
	Reminds me of a learned co-worker years ago, who when faced with a large and difficult task, would solemnly say "this will take a while, somebody go get me a few candles and a six pack of chicken blood". ____________
	ID: 942662 ·

clive G1FYE Volunteer moderator Send message Joined: 4 Nov 04 Posts: 1284 Credit: 14,941,395 RAC: 2,739	Message 942799 - Posted: 25 Oct 2009, 20:03:13 UTC
	Across ssl and silverlight night, Thunder cracks an flash from psu Thyme sage and willow stick. and burnt essence of diode will do the trick :)
	ID: 942799 ·

CryptokiD Send message Joined: 2 Dec 00 Posts: 134 Credit: 2,814,936 RAC: 0	Message 942864 - Posted: 26 Oct 2009, 4:51:42 UTC
	sounds like you had you're hands full. thanks for getting us ship shape matt.
	ID: 942864 ·

Message boards : Technical News : Crashola (Oct 22 2009)