Lapsit Exillis (Dec 08 2011)


log in

Advanced search

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1176625 - Posted: 9 Dec 2011, 0:14:48 UTC

Had a couple server mishaps yesterday afternoon and this morning. For no apparent reason (at the time) carolyn wedged pretty hard. That's our mysql database server, so when that gets locked up, everything BOINC/SETI@home related does as well. I was able to recover it by the early evening without too much ado, except - as it always happens when a master mysqld database suddenly crashes - the replica database on jocelyn is all out of whack. I'll sort that out next week. During the recovery though, and continuing through today, I'm seeing weird kernel messages relating to power. From what I've read this is likely due to faulty (or unseated) memory, but may be worse - like a CPU or motherboard problem. Great. Anyway, this is all on my radar.

This morning Jeff came in and found bruno (the main BOINC admin machine and upload server) was now wedged. This happens from time to time on these busy servers due to non-hardware reasons, and a quick reboot usually fixes it, which it did in this case. All systems seem to be go for now (except for the replica db mentioned earlier).

Otherwise, smooth sailing... I guess. In the background Jeff's actually been working on some time-critical non-SETI work and I've been immersed in the usual dozen-or-so mini projects. However, we're making progress on streamlining the science database - a first pass at improving the NTPCkr throughput and then determining what hardware we may need (if any) beyond that.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4058
Credit: 32,806,174
RAC: 5,208
United Kingdom
Message 1176627 - Posted: 9 Dec 2011, 0:19:23 UTC - in response to Message 1176625.

Thanks for the update Matt, and for all the efforts from everyone,

Claggy

Profile SciManStevProject donor
Volunteer tester
Avatar
Send message
Joined: 20 Jun 99
Posts: 4817
Credit: 80,584,277
RAC: 34,803
United States
Message 1176632 - Posted: 9 Dec 2011, 0:27:58 UTC

Thank you for the update Matt. It is much appreciated. Is any work being done to get to the goal of increasing or eliminating the current wu limits? The most productive hosts have been crippled for several months, as they can burn throuh full limits in a very short time.

Steve
____________
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website

Profile Jim_S
Avatar
Send message
Joined: 23 Feb 00
Posts: 4485
Credit: 18,409,476
RAC: 4,515
United States
Message 1176661 - Posted: 9 Dec 2011, 2:16:37 UTC

Thanks for the update Matt.
We like NEWS. ;-]
____________

I Desire Peace and Justice, Jim Scott (Mod-Ret.)

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 7,275,432
RAC: 1,147
United States
Message 1176691 - Posted: 9 Dec 2011, 5:51:08 UTC

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Profile UliProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Feb 00
Posts: 9697
Credit: 5,407,090
RAC: 4,569
Germany
Message 1176719 - Posted: 9 Dec 2011, 8:52:12 UTC - in response to Message 1176691.

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Are you sure it is not a Dudette?
____________
Pluto will always be a planet to me.
Order your 15th Seti Anniversary Shirt today. Just PM me for details.
Cash Donation Specialist

Seti Ambassador

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 7,275,432
RAC: 1,147
United States
Message 1176762 - Posted: 9 Dec 2011, 13:52:36 UTC - in response to Message 1176719.

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

N9JFE David S
Volunteer tester
Avatar
Send message
Joined: 4 Oct 99
Posts: 11031
Credit: 13,838,667
RAC: 15,200
United States
Message 1176785 - Posted: 9 Dec 2011, 15:30:47 UTC

Thanks for the report on what happened this week. We're all less upset by problems if we know what they are.

I suppose you working on the ntpckr process is why one of them is running today.

I see the crickets had a very brief snooze at 2am (I assume the time on the Cricket graphs is Berkeley local).

____________
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.


zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46008
Credit: 36,538,859
RAC: 5,397
Message 1176799 - Posted: 9 Dec 2011, 16:12:27 UTC - in response to Message 1176762.
Last modified: 9 Dec 2011, 16:12:54 UTC

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

Oh no! curses...

Matt thanks for the update.
____________
My Facebook, War Commander, 2015

Profile Chris SProject donor
Volunteer tester
Avatar
Send message
Joined: 19 Nov 00
Posts: 31329
Credit: 11,835,474
RAC: 22,513
United Kingdom
Message 1176805 - Posted: 9 Dec 2011, 16:37:45 UTC

Thanks for the update Matt, appreciated as usual.
____________
Damsel Rescuer, Kitty Patron, Uli Devotee, Julie Supporter
ES99 Admirer, Raccoon Friend, Anniet fan, RJ45 rulz OK!


Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,239
RAC: 0
United States
Message 1176810 - Posted: 9 Dec 2011, 16:50:59 UTC - in response to Message 1176632.

Downloads! Need more WUs. Four empty 10-day queues. I don't like running Einstein (although it does have a lot faster downloads--500K/s vs 2.5K/s on SETI). What's the holdup?
____________

Profile eaglescouter
Send message
Joined: 28 Dec 02
Posts: 162
Credit: 42,012,553
RAC: 0
United States
Message 1176856 - Posted: 9 Dec 2011, 19:33:36 UTC - in response to Message 1176810.

Something is 'wedged' again.

"Internet access OK - project servers may be temporarily down.

11:30:04 AM Pacific time.


____________
It's not too many computers, it's a lack of circuit breakers for this room. But we can fix it :)

musicplayer
Send message
Joined: 17 May 10
Posts: 1431
Credit: 687,186
RAC: 5
Message 1176946 - Posted: 10 Dec 2011, 1:20:22 UTC
Last modified: 10 Dec 2011, 1:21:14 UTC

So what is in the science database, if I may ask?

When do we know whether we are getting "local numbers", coming from within our solar system, possibly being "RFI" - and oppositely, getting numbers from the distances of the stars?

The pulses (and most likely the spikes as well) are not telling me anything?

But what about those triplets? Is there some "test flying" going on?

I probably have seen it better in the past, but what about the possible exactness of that?

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1916
Credit: 9,570,102
RAC: 14,591
United States
Message 1177116 - Posted: 10 Dec 2011, 18:52:46 UTC

Stats export from both the main project and beta appear to be down on all the stats sites...
____________
.

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38676
Credit: 573,374,037
RAC: 546,443
United States
Message 1177118 - Posted: 10 Dec 2011, 18:54:25 UTC - in response to Message 1177116.

Stats export from both the main project and beta appear to be down on all the stats sites...

Probably because the replica DB is offline.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46008
Credit: 36,538,859
RAC: 5,397
Message 1177186 - Posted: 11 Dec 2011, 4:55:20 UTC

Hey Matt, How about the DCF problem with Seti???
____________
My Facebook, War Commander, 2015

Profile Donald L. JohnsonProject donor
Avatar
Send message
Joined: 5 Aug 02
Posts: 6092
Credit: 663,618
RAC: 1,225
United States
Message 1177400 - Posted: 12 Dec 2011, 5:56:26 UTC - in response to Message 1177186.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.
____________
Donald
Infernal Optimist / Submariner, retired

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46008
Credit: 36,538,859
RAC: 5,397
Message 1177401 - Posted: 12 Dec 2011, 6:10:58 UTC - in response to Message 1177400.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.

Ok, Well could Matt then please pass It on to Dr. A?
____________
My Facebook, War Commander, 2015

Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,239
RAC: 0
United States
Message 1177940 - Posted: 14 Dec 2011, 3:48:40 UTC - in response to Message 1176856.

My upload started working very well when I set the HTTP Proxy to 69.163.96.2:8080. Downloads....well they suck to say the least.

The server status page shows that the download servers are up, pinging them yields a 35ms average, and I still have had no downloads for over a week.

So, are the download servers UP or DOWN?

____________

ChrisSibbald
Send message
Joined: 23 Jul 11
Posts: 18
Credit: 23,582,502
RAC: 0
Canada
Message 1177942 - Posted: 14 Dec 2011, 3:55:03 UTC - in response to Message 1176625.

Hi Matt,

It's been six days with no stats propagated to Boincstats. Any idea when that will be resolved?

Cheers,
Chris

1 · 2 · Next

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

Copyright © 2014 University of California