Borderland (Nov 23 2011)

Message boards : Technical News : Borderland (Nov 23 2011)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 1173377 - Posted: 23 Nov 2011, 23:59:58 UTC

Before we disappear for the long Thanksgiving holiday weekend I figure I'd catch you up on a couple things.

Keeping up with good security practices I'm in OS upgrade mode around here. So far so good getting our machines up to the latest rev of Fedora (FC16) but I hit a couple snags with vader yesterday. Vader is one of the two download servers, as well as a general BOINC backend server - you may have noticed I moved some assimilators/splitters/etc. off of it yesterday before the upgrade.

Anyway, there was a bunch of tiny annoyances during the whole process that ate up my whole day. Things like messed of network configurations and such. I'm kind of peeved how much Fedora and linux has changed over the past couple of years. I don't need job security in the form of relearning fundamental changes to OSes that worked just fine a month ago. Long story short it seemed like the only way I could truly configure the network was to yum in an old version of the network configuration GUI and use that to create the proper startup scripts.

I had to reboot vader a lot during all this, and some more again this morning, but downloads are now back to normal (albeit dropping packets as usual since we're constantly maxed out). I also got some of the BOINC backend processes running on it again.

Meanwhile after the last couple of Tuesday outages we've had a hard time recovering in general. Those watching the traffic graphs may have noticed how depressed they were upon coming back on line. This was mostly mysql's fault. It's doing some kind of mysterious i/o and/or internal bookkeeping causing queries to take forever after our weekly outages. My suspicion is that we just need to reboot the mysql server to clear some pipes. It's been a while. We'll do that next Tuesday.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1173377 · Report as offensive
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6658
Credit: 121,090,076
RAC: 0
United States
Message 1173378 - Posted: 24 Nov 2011, 0:25:23 UTC

Thank you so much for the update! These little tidbits of information mean the world to us. Have a very Happy Thanksgiving!

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1173378 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1173384 - Posted: 24 Nov 2011, 1:08:03 UTC - in response to Message 1173377.  

Thanks for the update Matt, have a good Thanksgivings,

Claggy
ID: 1173384 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1173426 - Posted: 24 Nov 2011, 6:56:04 UTC

As always Matt, thanks for the background insights.

Have yourself a fine holiday...

And all the rest of the Seti staff as well.

Meow!
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1173426 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34380
Credit: 79,922,639
RAC: 80
Germany
Message 1173437 - Posted: 24 Nov 2011, 8:44:34 UTC

Thanks for the update Matt.

Happy Thanksgiving.



With each crime and every kindness we birth our future.
ID: 1173437 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9549
Credit: 3,308,926
RAC: 2
United States
Message 1173448 - Posted: 24 Nov 2011, 9:47:48 UTC

Thanks for the news Matt, its greatly appreciated! I hope all of you guys in the lab have a wonderful holiday!
ID: 1173448 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1173477 - Posted: 24 Nov 2011, 15:26:57 UTC

@ Matt,

Interesting post by Oliver Bock - project administrator at Einstein, managing their (very busy) GPU download server:

A few months ago we noticed that Apache wasn't able to handle the BRP/FGRP download requests anymore and switched to lighttpd which turned to be more suitable for our specific setup, data type and access pattern. The load increased even further and we seem to have crossed a crucial threshold last week such that lighttpd also wasn't up to the task anymore. Various filesystem/network/daemon tests have revealed that the web server was in fact the bottleneck and we now moved to nginx, the very efficient web server that powers Facebook, WordPress, SourceForge and GitHub for instance (third, almost second, most popular web server).
ID: 1173477 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1173478 - Posted: 24 Nov 2011, 15:41:36 UTC - in response to Message 1173477.  
Last modified: 24 Nov 2011, 15:47:45 UTC

@ Matt,

Interesting post by Oliver Bock - project administrator at Einstein, managing their (very busy) GPU download server:

A few months ago we noticed that Apache wasn't able to handle the BRP/FGRP download requests anymore and switched to lighttpd which turned to be more suitable for our specific setup, data type and access pattern. The load increased even further and we seem to have crossed a crucial threshold last week such that lighttpd also wasn't up to the task anymore. Various filesystem/network/daemon tests have revealed that the web server was in fact the bottleneck and we now moved to nginx, the very efficient web server that powers Facebook, WordPress, SourceForge and GitHub for instance (third, almost second, most popular web server).

It would be interesting if you could convey this information directly to Matt.
And even more interesting to see what his response would be.....

EDIT...
And I wonder what the price tag on the software is.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1173478 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 1173481 - Posted: 24 Nov 2011, 15:53:10 UTC
Last modified: 24 Nov 2011, 16:10:14 UTC

I realize that it's low priority, but... are the client connection stats ever going to get back online? it's been a year and a month (plus...) since they went off-line!

And (while I'm writing...) how about getting the "Multi-Beam Data Recorder Status" back online? - that's been off since May, IIRC...
.

Hello, from Albany, CA!...
ID: 1173481 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 1173483 - Posted: 24 Nov 2011, 15:56:43 UTC - in response to Message 1173478.  

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 1173483 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1173484 - Posted: 24 Nov 2011, 16:09:14 UTC - in response to Message 1173483.  

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1173484 · Report as offensive
Profile kaseychief
Avatar

Send message
Joined: 3 Dec 07
Posts: 1643
Credit: 480,503
RAC: 1
United States
Message 1173486 - Posted: 24 Nov 2011, 16:15:07 UTC

Matt, thanks for all the hard work you do to
keep things runnin smoothly, It's time now
for you to go home & enjoy your turkey day.

Best Regards

Tom & Jo H.
ID: 1173486 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1173672 - Posted: 25 Nov 2011, 17:09:03 UTC - in response to Message 1173484.  

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.

Oliver Bock has just posted an expanded version of his message board answer, to the "BOINC Projects" mailing list which is used for announcements to project administrators (not that they all read it). Hopefully, that might prompt some feedback/experiences from other BOINC server-minders.
ID: 1173672 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 1173791 - Posted: 26 Nov 2011, 2:49:34 UTC

Irregardless of what the "server status" page reads, I can't report... but I can upload, though...
.

Hello, from Albany, CA!...
ID: 1173791 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1173796 - Posted: 26 Nov 2011, 3:17:57 UTC - in response to Message 1173484.  

EDIT...
And I wonder what the price tag on the software is.


Nginx is free & open source

Jason

Cool beans....
Now if Matt would just consider it. See if it is compatible with the Seti server setup. And be willing to endure just a little more hair pulling to do a conversion if it would be a good fit.


I know another forum that I visit also just changed over to it, loading much faster now.

ID: 1173796 · Report as offensive
Neil L. Carter Project Donor
Volunteer tester

Send message
Joined: 6 Dec 99
Posts: 62
Credit: 16,385,509
RAC: 27
United States
Message 1174004 - Posted: 27 Nov 2011, 3:58:45 UTC

Interesting that you're having the same experience with Fedora that caused me to basically abandon it, too many changes too fast.

You might want to consider Oracle Enterprise Linux (OEL), which is what I've moved to in my server room.

FAQ for Oracle Enterprise Linux
Main Web Site

It's completely free unless you need to buy a support contract. Since you've been using Fedora, that doesn't sound like a problem.

OEL is basically a clone of Red Hat Enterprise Linux, tweaked by Oracle. (see the URLs)

Hope this helps with your OS woes.

Happy Holidays!

Neil
ID: 1174004 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1174273 - Posted: 28 Nov 2011, 14:46:25 UTC - in response to Message 1173378.  

Thank you so much for the update! These little tidbits of information mean the world to us. Have a very Happy Thanksgiving!

Steve is absolutely right.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1174273 · Report as offensive

Message boards : Technical News : Borderland (Nov 23 2011)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.