Cleo (Apr 08 2009)

log in

Advanced search

Message boards : Technical News : Cleo (Apr 08 2009)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 1 Mar 99
Posts: 1441
Credit: 213,689
RAC: 1
United States
Message 883493 - Posted: 8 Apr 2009, 20:00:28 UTC

The science database choked last night. Nothing terrible - it was just unable to deal with the pulse index rebuilds as well as the usual outage recovery. So the assimilators got a little hung up for a while until the current index build was finished. It's still a mystery why this was as big an issue as it was - we've built indexes before on live, fully functional databases. Hmm. Apparently we have to be a little less cavalier about it.

Turning off a server for good always has unintended consequences. Shutting down milkyway yesterday caused mail from the web server to fail. A couple red herrings later I found the problem - the milkyway mail server replacement (clarke) wasn't configured to allow relaying from the web server machine. Easy squeezy problem to fix. Now reset password requests, forum moderation notices, private message alerts, etc. are being sent.

Spent way too much time hunting down the cause of a seg fault in my NTPCker web page code. It's kinda hard when it's a C program that's being executed within a c-shell script, which in turn is being called by a php script, and which is all running under apache. It's frustrating when everything works on a command line, but not within apache. Anyway I finally figured it out, or at least got it working. The irony is this code was to produce a tiny close-up waterfall plot around any given signal (to immediately spot symptoms of RFI), and once it was running Jeff and I realized our database query logic was slightly wrong, and the correct logic would take too long to be of any use in a dynamically generated plot on the web anyway. Sigh. Looks like we'll have to batch job it or something like that.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Send message
Joined: 23 May 01
Posts: 1056
Credit: 782,676
RAC: 246
United States
Message 883585 - Posted: 9 Apr 2009, 0:28:13 UTC - in response to Message 883493.

Having an approximation (plot) on the web would be fine, unless you want a table of values. Then, you're right: do the query offline and later have results on the web just read answers from a summary table.

Profile [KWSN]John Galt 007Project Donor
Volunteer tester
Send message
Joined: 9 Nov 99
Posts: 2444
Credit: 22,950,821
RAC: 24,960
United States
Message 883613 - Posted: 9 Apr 2009, 2:22:55 UTC

That dang clarke...gave me problems also...

More of the noise and power requirement type...

Glad to see the old boy up and running!!!

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Send message
Joined: 20 Dec 05
Posts: 2531
Credit: 33,579,370
RAC: 20,784
United States
Message 885131 - Posted: 13 Apr 2009, 22:42:39 UTC
Last modified: 13 Apr 2009, 22:43:30 UTC

Query - if the pulse database is re-built, why does the Science page state that there's been -506m pulses in the last 24 hrs?

Profile Virtual Boss*
Volunteer tester
Send message
Joined: 4 May 08
Posts: 417
Credit: 6,346,350
RAC: 111
Message 885284 - Posted: 14 Apr 2009, 10:18:10 UTC - in response to Message 885131.

Query - if the pulse database is re-built, why does the Science page state that there's been -506m pulses in the last 24 hrs?

Maybe ET(s) stole all the pulses to try to stop us finding him/her/it/them.

Profile Andy Lee Robinson
Send message
Joined: 8 Dec 05
Posts: 630
Credit: 55,288,523
RAC: 10,768
Message 885715 - Posted: 16 Apr 2009, 3:23:24 UTC - in response to Message 883493.

Matt, are you making any use of memcached?

Read-caching queries is one of its excellent uses. If you have a lot of cacheable queries, you may be able to drastically reduce QPS on the database. If you give that query an hour lifetime, then it'll behave like an offline query with an occasional unlucky person having to wait a few more seconds for the result.
The cache memory can be automatically distributed among available servers too.

Profile arkaynProject Donor
Volunteer tester
Send message
Joined: 14 May 99
Posts: 4087
Credit: 51,542,134
RAC: 1,610
United States
Message 885826 - Posted: 16 Apr 2009, 16:35:18 UTC

I am guessing that Matt is taking a week of vacation.

Bob Merrill
Send message
Joined: 7 Jun 99
Posts: 114
Credit: 5,162,691
RAC: 2,299
United States
Message 885844 - Posted: 16 Apr 2009, 17:33:30 UTC - in response to Message 885826.

So it would seem...

Profile Allie in Vancouver
Volunteer tester
Send message
Joined: 16 Mar 07
Posts: 3949
Credit: 1,604,668
RAC: 0
Message 885872 - Posted: 16 Apr 2009, 19:18:23 UTC
Last modified: 16 Apr 2009, 19:18:51 UTC

A well earned vacation.
Pure mathematics is, in its way, the poetry of logical ideas.

Albert Einstein

Message boards : Technical News : Cleo (Apr 08 2009)

Copyright © 2016 University of California