Lapsit Exillis (Dec 08 2011)


log in

Advanced search

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1384
Credit: 74,079
RAC: 0
United States
Message 1176625 - Posted: 9 Dec 2011, 0:14:48 UTC

Had a couple server mishaps yesterday afternoon and this morning. For no apparent reason (at the time) carolyn wedged pretty hard. That's our mysql database server, so when that gets locked up, everything BOINC/SETI@home related does as well. I was able to recover it by the early evening without too much ado, except - as it always happens when a master mysqld database suddenly crashes - the replica database on jocelyn is all out of whack. I'll sort that out next week. During the recovery though, and continuing through today, I'm seeing weird kernel messages relating to power. From what I've read this is likely due to faulty (or unseated) memory, but may be worse - like a CPU or motherboard problem. Great. Anyway, this is all on my radar.

This morning Jeff came in and found bruno (the main BOINC admin machine and upload server) was now wedged. This happens from time to time on these busy servers due to non-hardware reasons, and a quick reboot usually fixes it, which it did in this case. All systems seem to be go for now (except for the replica db mentioned earlier).

Otherwise, smooth sailing... I guess. In the background Jeff's actually been working on some time-critical non-SETI work and I've been immersed in the usual dozen-or-so mini projects. However, we're making progress on streamlining the science database - a first pass at improving the NTPCkr throughput and then determining what hardware we may need (if any) beyond that.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Claggy
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 3966
Credit: 31,940,430
RAC: 13,305
United Kingdom
Message 1176627 - Posted: 9 Dec 2011, 0:19:23 UTC - in response to Message 1176625.

Thanks for the update Matt, and for all the efforts from everyone,

Claggy

Profile SciManStev
Volunteer tester
Avatar
Send message
Joined: 20 Jun 99
Posts: 4673
Credit: 77,462,774
RAC: 43,319
United States
Message 1176632 - Posted: 9 Dec 2011, 0:27:58 UTC

Thank you for the update Matt. It is much appreciated. Is any work being done to get to the goal of increasing or eliminating the current wu limits? The most productive hosts have been crippled for several months, as they can burn throuh full limits in a very short time.

Steve
____________
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website

Profile Jim_S
Avatar
Send message
Joined: 23 Feb 00
Posts: 4457
Credit: 17,542,542
RAC: 8,005
United States
Message 1176661 - Posted: 9 Dec 2011, 2:16:37 UTC

Thanks for the update Matt.
We like NEWS. ;-]
____________

I Desire Peace and Justice, Jim Scott

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 7,084,421
RAC: 1,174
United States
Message 1176691 - Posted: 9 Dec 2011, 5:51:08 UTC

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Profile Uli
Volunteer tester
Avatar
Send message
Joined: 6 Feb 00
Posts: 9360
Credit: 4,943,185
RAC: 3,315
Germany
Message 1176719 - Posted: 9 Dec 2011, 8:52:12 UTC - in response to Message 1176691.

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Are you sure it is not a Dudette?
____________
Pluto will always be a planet to me.

Cash Donation Specialist

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 7,084,421
RAC: 1,174
United States
Message 1176762 - Posted: 9 Dec 2011, 13:52:36 UTC - in response to Message 1176719.

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

N9JFE
Volunteer tester
Avatar
Send message
Joined: 4 Oct 99
Posts: 9399
Credit: 11,997,159
RAC: 14,556
United States
Message 1176785 - Posted: 9 Dec 2011, 15:30:47 UTC

Thanks for the report on what happened this week. We're all less upset by problems if we know what they are.

I suppose you working on the ntpckr process is why one of them is running today.

I see the crickets had a very brief snooze at 2am (I assume the time on the Cricket graphs is Berkeley local).

____________
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.


zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44600
Credit: 35,458,036
RAC: 8,786
Message 1176799 - Posted: 9 Dec 2011, 16:12:27 UTC - in response to Message 1176762.
Last modified: 9 Dec 2011, 16:12:54 UTC

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

Oh no! curses...

Matt thanks for the update.
____________

Profile Chris S
Volunteer tester
Avatar
Send message
Joined: 19 Nov 00
Posts: 29638
Credit: 9,138,293
RAC: 32,384
United Kingdom
Message 1176805 - Posted: 9 Dec 2011, 16:37:45 UTC

Thanks for the update Matt, appreciated as usual.
____________
Damsel Rescuer, Kitty Patron, Uli Fan, Julie Supporter, CAMRA
ES99 Admirer, Raccoon Friend, IFAW, PETA, 5% Badge


Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,239
RAC: 0
United States
Message 1176810 - Posted: 9 Dec 2011, 16:50:59 UTC - in response to Message 1176632.

Downloads! Need more WUs. Four empty 10-day queues. I don't like running Einstein (although it does have a lot faster downloads--500K/s vs 2.5K/s on SETI). What's the holdup?
____________

Profile eaglescouter
Send message
Joined: 28 Dec 02
Posts: 162
Credit: 42,012,553
RAC: 129
United States
Message 1176856 - Posted: 9 Dec 2011, 19:33:36 UTC - in response to Message 1176810.

Something is 'wedged' again.

"Internet access OK - project servers may be temporarily down.

11:30:04 AM Pacific time.


____________
It's not too many computers, it's a lack of circuit breakers for this room. But we can fix it :)

musicplayer
Send message
Joined: 17 May 10
Posts: 1368
Credit: 619,420
RAC: 1,880
Message 1176946 - Posted: 10 Dec 2011, 1:20:22 UTC
Last modified: 10 Dec 2011, 1:21:14 UTC

So what is in the science database, if I may ask?

When do we know whether we are getting "local numbers", coming from within our solar system, possibly being "RFI" - and oppositely, getting numbers from the distances of the stars?

The pulses (and most likely the spikes as well) are not telling me anything?

But what about those triplets? Is there some "test flying" going on?

I probably have seen it better in the past, but what about the possible exactness of that?

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1832
Credit: 7,605,402
RAC: 18,576
United States
Message 1177116 - Posted: 10 Dec 2011, 18:52:46 UTC

Stats export from both the main project and beta appear to be down on all the stats sites...
____________
.

msattler
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 37453
Credit: 502,659,544
RAC: 567,890
United States
Message 1177118 - Posted: 10 Dec 2011, 18:54:25 UTC - in response to Message 1177116.

Stats export from both the main project and beta appear to be down on all the stats sites...

Probably because the replica DB is offline.
____________
******************
Just a kittyman kinda guy.

Crunching Seti, loving all of God's kitties.

I have met a few friends in my life.
Most were cats.

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44600
Credit: 35,458,036
RAC: 8,786
Message 1177186 - Posted: 11 Dec 2011, 4:55:20 UTC

Hey Matt, How about the DCF problem with Seti???
____________

Profile Donald L. Johnson
Avatar
Send message
Joined: 5 Aug 02
Posts: 5704
Credit: 565,892
RAC: 596
United States
Message 1177400 - Posted: 12 Dec 2011, 5:56:26 UTC - in response to Message 1177186.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.
____________
Donald
Infernal Optimist / Submariner, retired

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44600
Credit: 35,458,036
RAC: 8,786
Message 1177401 - Posted: 12 Dec 2011, 6:10:58 UTC - in response to Message 1177400.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.

Ok, Well could Matt then please pass It on to Dr. A?
____________

Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,239
RAC: 0
United States
Message 1177940 - Posted: 14 Dec 2011, 3:48:40 UTC - in response to Message 1176856.

My upload started working very well when I set the HTTP Proxy to 69.163.96.2:8080. Downloads....well they suck to say the least.

The server status page shows that the download servers are up, pinging them yields a 35ms average, and I still have had no downloads for over a week.

So, are the download servers UP or DOWN?

____________

ChrisSibbald
Send message
Joined: 23 Jul 11
Posts: 18
Credit: 23,582,502
RAC: 0
Canada
Message 1177942 - Posted: 14 Dec 2011, 3:55:03 UTC - in response to Message 1176625.

Hi Matt,

It's been six days with no stats propagated to Boincstats. Any idea when that will be resolved?

Cheers,
Chris

1 · 2 · Next

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

Copyright © 2014 University of California