Borderland (Nov 23 2011)

Message boards : Technical News : Borderland (Nov 23 2011)

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1441
Credit: 213,689
RAC: 0
United States
Message 1173377 - Posted: 23 Nov 2011, 23:59:58 UTC

Before we disappear for the long Thanksgiving holiday weekend I figure I'd catch you up on a couple things.

Keeping up with good security practices I'm in OS upgrade mode around here. So far so good getting our machines up to the latest rev of Fedora (FC16) but I hit a couple snags with vader yesterday. Vader is one of the two download servers, as well as a general BOINC backend server - you may have noticed I moved some assimilators/splitters/etc. off of it yesterday before the upgrade.

Anyway, there was a bunch of tiny annoyances during the whole process that ate up my whole day. Things like messed of network configurations and such. I'm kind of peeved how much Fedora and linux has changed over the past couple of years. I don't need job security in the form of relearning fundamental changes to OSes that worked just fine a month ago. Long story short it seemed like the only way I could truly configure the network was to yum in an old version of the network configuration GUI and use that to create the proper startup scripts.

I had to reboot vader a lot during all this, and some more again this morning, but downloads are now back to normal (albeit dropping packets as usual since we're constantly maxed out). I also got some of the BOINC backend processes running on it again.

Meanwhile after the last couple of Tuesday outages we've had a hard time recovering in general. Those watching the traffic graphs may have noticed how depressed they were upon coming back on line. This was mostly mysql's fault. It's doing some kind of mysterious i/o and/or internal bookkeeping causing queries to take forever after our weekly outages. My suspicion is that we just need to reboot the mysql server to clear some pipes. It's been a while. We'll do that next Tuesday.

- Matt


-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ID: 1173377 · Report as offensive
Profile SciManStev
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 5840
Credit: 105,982,724
RAC: 3,379
United States
Message 1173378 - Posted: 24 Nov 2011, 0:25:23 UTC

Thank you so much for the update! These little tidbits of information mean the world to us. Have a very Happy Thanksgiving!

Steve


Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website

ID: 1173378 · Report as offensive
ClaggyProject Donor
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4622
Credit: 46,333,979
RAC: 3,020
United Kingdom
Message 1173384 - Posted: 24 Nov 2011, 1:08:03 UTC - in response to Message 1173377.

Thanks for the update Matt, have a good Thanksgivings,

Claggy

ID: 1173384 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45856
Credit: 814,513,547
RAC: 121,983
United States
Message 1173426 - Posted: 24 Nov 2011, 6:56:04 UTC

As always Matt, thanks for the background insights.

Have yourself a fine holiday...

And all the rest of the Seti staff as well.

Meow!


Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1173426 · Report as offensive
Profile Mike
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 29557
Credit: 49,004,070
RAC: 16,868
Germany
Message 1173437 - Posted: 24 Nov 2011, 8:44:34 UTC

Thanks for the update Matt.

Happy Thanksgiving.


With each crime and every kindness we birth our future.

ID: 1173437 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9467
Credit: 3,112,738
RAC: 0
United States
Message 1173448 - Posted: 24 Nov 2011, 9:47:48 UTC

Thanks for the news Matt, its greatly appreciated! I hope all of you guys in the lab have a wonderful holiday!


ID: 1173448 · Report as offensive
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,468,684
RAC: 40,739
United Kingdom
Message 1173477 - Posted: 24 Nov 2011, 15:26:57 UTC

@ Matt,

Interesting post by Oliver Bock - project administrator at Einstein, managing their (very busy) GPU download server:

A few months ago we noticed that Apache wasn't able to handle the BRP/FGRP download requests anymore and switched to lighttpd which turned to be more suitable for our specific setup, data type and access pattern. The load increased even further and we seem to have crossed a crucial threshold last week such that lighttpd also wasn't up to the task anymore. Various filesystem/network/daemon tests have revealed that the web server was in fact the bottleneck and we now moved to nginx, the very efficient web server that powers Facebook, WordPress, SourceForge and GitHub for instance (third, almost second, most popular web server).

ID: 1173477 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45856
Credit: 814,513,547
RAC: 121,983
United States
Message 1173478 - Posted: 24 Nov 2011, 15:41:36 UTC - in response to Message 1173477.
Last modified: 24 Nov 2011, 15:47:45 UTC

@ Matt,

Interesting post by Oliver Bock - project administrator at Einstein, managing their (very busy) GPU download server:

A few months ago we noticed that Apache wasn't able to handle the BRP/FGRP download requests anymore and switched to lighttpd which turned to be more suitable for our specific setup, data type and access pattern. The load increased even further and we seem to have crossed a crucial threshold last week such that lighttpd also wasn't up to the task anymore. Various filesystem/network/daemon tests have revealed that the web server was in fact the bottleneck and we now moved to nginx, the very efficient web server that powers Facebook, WordPress, SourceForge and GitHub for instance (third, almost second, most popular web server).

It would be interesting if you could convey this information directly to Matt.
And even more interesting to see what his response would be.....

EDIT...
And I wonder what the price tag on the software is.
Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1173478 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2576
Credit: 34,627,409
RAC: 19,282
United States
Message 1173481 - Posted: 24 Nov 2011, 15:53:10 UTC
Last modified: 24 Nov 2011, 16:10:14 UTC

I realize that it's low priority, but... are the client connection stats ever going to get back online? it's been a year and a month (plus...) since they went off-line!

And (while I'm writing...) how about getting the "Multi-Beam Data Recorder Status" back online? - that's been off since May, IIRC...


.

ID: 1173481 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7229
Credit: 87,234,928
RAC: 8,087
Australia
Message 1173483 - Posted: 24 Nov 2011, 15:56:43 UTC - in response to Message 1173478.

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason
"It is not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is the most adaptable to change."
Charles Darwin

ID: 1173483 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45856
Credit: 814,513,547
RAC: 121,983
United States
Message 1173484 - Posted: 24 Nov 2011, 16:09:14 UTC - in response to Message 1173483.

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.
Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1173484 · Report as offensive
Profile kaseychief
Avatar

Send message
Joined: 3 Dec 07
Posts: 1643
Credit: 417,577
RAC: 0
United States
Message 1173486 - Posted: 24 Nov 2011, 16:15:07 UTC

Matt, thanks for all the hard work you do to
keep things runnin smoothly, It's time now
for you to go home & enjoy your turkey day.

Best Regards

Tom & Jo H.


ID: 1173486 · Report as offensive
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,468,684
RAC: 40,739
United Kingdom
Message 1173672 - Posted: 25 Nov 2011, 17:09:03 UTC - in response to Message 1173484.

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.

Oliver Bock has just posted an expanded version of his message board answer, to the "BOINC Projects" mailing list which is used for announcements to project administrators (not that they all read it). Hopefully, that might prompt some feedback/experiences from other BOINC server-minders.

ID: 1173672 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2576
Credit: 34,627,409
RAC: 19,282
United States
Message 1173791 - Posted: 26 Nov 2011, 2:49:34 UTC

Irregardless of what the "server status" page reads, I can't report... but I can upload, though...


.

ID: 1173791 · Report as offensive
Profile arkaynProject Donor
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4097
Credit: 51,575,896
RAC: 1,692
United States
Message 1173796 - Posted: 26 Nov 2011, 3:17:57 UTC - in response to Message 1173484.

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.


I know another forum that I visit also just changed over to it, loading much faster now.

ID: 1173796 · Report as offensive
Neil L. CarterProject Donor
Volunteer tester

Send message
Joined: 6 Dec 99
Posts: 62
Credit: 8,150,270
RAC: 4,872
United States
Message 1174004 - Posted: 27 Nov 2011, 3:58:45 UTC

Interesting that you're having the same experience with Fedora that caused me to basically abandon it, too many changes too fast.

You might want to consider Oracle Enterprise Linux (OEL), which is what I've moved to in my server room.

FAQ for Oracle Enterprise Linux
Main Web Site

It's completely free unless you need to buy a support contract. Since you've been using Fedora, that doesn't sound like a problem.

OEL is basically a clone of Red Hat Enterprise Linux, tweaked by Oracle. (see the URLs)

Hope this helps with your OS woes.

Happy Holidays!

Neil

ID: 1174004 · Report as offensive
David SProject Donor
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 17034
Credit: 20,912,034
RAC: 5,983
United States
Message 1174273 - Posted: 28 Nov 2011, 14:46:25 UTC - in response to Message 1173378.

Thank you so much for the update! These little tidbits of information mean the world to us. Have a very Happy Thanksgiving!

Steve is absolutely right.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.


ID: 1174273 · Report as offensive

Message boards : Technical News : Borderland (Nov 23 2011)


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.