Lapsit Exillis (Dec 08 2011)


log in

Advanced search

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1375
Credit: 74,079
RAC: 0
United States
Message 1176625 - Posted: 9 Dec 2011, 0:14:48 UTC

Had a couple server mishaps yesterday afternoon and this morning. For no apparent reason (at the time) carolyn wedged pretty hard. That's our mysql database server, so when that gets locked up, everything BOINC/SETI@home related does as well. I was able to recover it by the early evening without too much ado, except - as it always happens when a master mysqld database suddenly crashes - the replica database on jocelyn is all out of whack. I'll sort that out next week. During the recovery though, and continuing through today, I'm seeing weird kernel messages relating to power. From what I've read this is likely due to faulty (or unseated) memory, but may be worse - like a CPU or motherboard problem. Great. Anyway, this is all on my radar.

This morning Jeff came in and found bruno (the main BOINC admin machine and upload server) was now wedged. This happens from time to time on these busy servers due to non-hardware reasons, and a quick reboot usually fixes it, which it did in this case. All systems seem to be go for now (except for the replica db mentioned earlier).

Otherwise, smooth sailing... I guess. In the background Jeff's actually been working on some time-critical non-SETI work and I've been immersed in the usual dozen-or-so mini projects. However, we're making progress on streamlining the science database - a first pass at improving the NTPCkr throughput and then determining what hardware we may need (if any) beyond that.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Claggy
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 3368
Credit: 25,952,740
RAC: 1,201
United Kingdom
Message 1176627 - Posted: 9 Dec 2011, 0:19:23 UTC - in response to Message 1176625.

Thanks for the update Matt, and for all the efforts from everyone,

Claggy

Profile SciManStev
Volunteer tester
Avatar
Send message
Joined: 20 Jun 99
Posts: 4297
Credit: 63,002,675
RAC: 73,304
United States
Message 1176632 - Posted: 9 Dec 2011, 0:27:58 UTC

Thank you for the update Matt. It is much appreciated. Is any work being done to get to the goal of increasing or eliminating the current wu limits? The most productive hosts have been crippled for several months, as they can burn throuh full limits in a very short time.

Steve
____________
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website

Profile Jim_S
Volunteer moderator
Avatar
Send message
Joined: 23 Feb 00
Posts: 4416
Credit: 13,737,676
RAC: 20,428
United States
Message 1176661 - Posted: 9 Dec 2011, 2:16:37 UTC

Thanks for the update Matt.
We like NEWS. ;-]
____________

I Desire Peace and Justice, Jim Scott

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 6,581,296
RAC: 3,262
United States
Message 1176691 - Posted: 9 Dec 2011, 5:51:08 UTC

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Profile uli
Volunteer tester
Avatar
Send message
Joined: 6 Feb 00
Posts: 8028
Credit: 3,755,356
RAC: 3,581
Germany
Message 1176719 - Posted: 9 Dec 2011, 8:52:12 UTC - in response to Message 1176691.

Thanks, Matt. I've been astonished at how well the MB assimilator has been keeping up. Usually, with a high volume of shorties, the queue to be assimilated has built up to high levels, but recently (except for today), the queue has been near zero. Is that speedup attributable to the transitioners running on Synergy? It look like half of the project is running on Synergy. That dude is a beast!

Are you sure it is not a Dudette?
____________
Pluto will always be a planet to me.

Cash Donation Specialist

Swibby Bear
Send message
Joined: 1 Aug 01
Posts: 236
Credit: 6,581,296
RAC: 3,262
United States
Message 1176762 - Posted: 9 Dec 2011, 13:52:36 UTC - in response to Message 1176719.

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

N9JFE
Send message
Joined: 4 Oct 99
Posts: 2559
Credit: 8,442,757
RAC: 14,834
United States
Message 1176785 - Posted: 9 Dec 2011, 15:30:47 UTC

Thanks for the report on what happened this week. We're all less upset by problems if we know what they are.

I suppose you working on the ntpckr process is why one of them is running today.

I see the crickets had a very brief snooze at 2am (I assume the time on the Cricket graphs is Berkeley local).

____________
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.


VBobier
Avatar
Send message
Joined: 30 Nov 03
Posts: 40841
Credit: 32,125,866
RAC: 18,779
United States
Message 1176799 - Posted: 9 Dec 2011, 16:12:27 UTC - in response to Message 1176762.
Last modified: 9 Dec 2011, 16:12:54 UTC

ROFL! If he's a she, then she has a really hairy, ah, "chest" and a beard!

Oh no! curses...

Matt thanks for the update.
____________
BSG Anthem
My Facebook page


Profile Chris S
Volunteer tester
Avatar
Send message
Joined: 19 Nov 00
Posts: 22775
Credit: 4,524,089
RAC: 5,733
United Kingdom
Message 1176805 - Posted: 9 Dec 2011, 16:37:45 UTC

Thanks for the update Matt, appreciated as usual.
____________
Damsel Rescuer, Kitty Patron, Raccoon Friend, Uli Fan,
Julie Supporter, ES99 Admirer, PETA Member, 1st Childhood


Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,120
RAC: 0
United States
Message 1176810 - Posted: 9 Dec 2011, 16:50:59 UTC - in response to Message 1176632.

Downloads! Need more WUs. Four empty 10-day queues. I don't like running Einstein (although it does have a lot faster downloads--500K/s vs 2.5K/s on SETI). What's the holdup?
____________

Profile eaglescouter
Send message
Joined: 28 Dec 02
Posts: 162
Credit: 40,935,640
RAC: 19,260
United States
Message 1176856 - Posted: 9 Dec 2011, 19:33:36 UTC - in response to Message 1176810.

Something is 'wedged' again.

"Internet access OK - project servers may be temporarily down.

11:30:04 AM Pacific time.


____________
It's not too many computers, it's a lack of circuit breakers for this room. But we can fix it :)

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1595
Credit: 4,429,955
RAC: 4,128
United States
Message 1177116 - Posted: 10 Dec 2011, 18:52:46 UTC

Stats export from both the main project and beta appear to be down on all the stats sites...
____________
.

msattler
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 34161
Credit: 344,950,428
RAC: 548,410
United States
Message 1177118 - Posted: 10 Dec 2011, 18:54:25 UTC - in response to Message 1177116.

Stats export from both the main project and beta appear to be down on all the stats sites...

Probably because the replica DB is offline.
____________
******

"Ask not, what your kitty can do for you. Ask what you can do for your kitty."

As it is kitten, so shall it be done.



VBobier
Avatar
Send message
Joined: 30 Nov 03
Posts: 40841
Credit: 32,125,866
RAC: 18,779
United States
Message 1177186 - Posted: 11 Dec 2011, 4:55:20 UTC

Hey Matt, How about the DCF problem with Seti???
____________
BSG Anthem
My Facebook page


Profile Donald L. Johnson
Send message
Joined: 5 Aug 02
Posts: 3914
Credit: 360,073
RAC: 783
United States
Message 1177400 - Posted: 12 Dec 2011, 5:56:26 UTC - in response to Message 1177186.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.
____________
Donald
Infernal Optimist / Submariner, retired

VBobier
Avatar
Send message
Joined: 30 Nov 03
Posts: 40841
Credit: 32,125,866
RAC: 18,779
United States
Message 1177401 - Posted: 12 Dec 2011, 6:10:58 UTC - in response to Message 1177400.

Hey Matt, How about the DCF problem with Seti???

Vic, that issue is Dr. Anderson's, not Matt's.

Ok, Well could Matt then please pass It on to Dr. A?
____________
BSG Anthem
My Facebook page


Mooncalf
Send message
Joined: 5 Jan 11
Posts: 19
Credit: 20,196,120
RAC: 0
United States
Message 1177940 - Posted: 14 Dec 2011, 3:48:40 UTC - in response to Message 1176856.

My upload started working very well when I set the HTTP Proxy to 69.163.96.2:8080. Downloads....well they suck to say the least.

The server status page shows that the download servers are up, pinging them yields a 35ms average, and I still have had no downloads for over a week.

So, are the download servers UP or DOWN?

____________

ChrisSibbald
Send message
Joined: 23 Jul 11
Posts: 18
Credit: 23,582,211
RAC: 146
Canada
Message 1177942 - Posted: 14 Dec 2011, 3:55:03 UTC - in response to Message 1176625.

Hi Matt,

It's been six days with no stats propagated to Boincstats. Any idea when that will be resolved?

Cheers,
Chris

1 · 2 · Next

Message boards : Technical News : Lapsit Exillis (Dec 08 2011)

Copyright © 2013 University of California