More Shuffling (Jul 19 2012)


log in

Advanced search

Message boards : Technical News : More Shuffling (Jul 19 2012)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1262266 - Posted: 19 Jul 2012, 18:30:56 UTC

Well, the database shuffles continue. We decided that, hey, oscar is no longer the master science database server, and has the same configuration as our master mysql database server (carolyn) so it could easily take over the replica mysql duties from jocelyn (which had been failing at keeping up over the past few weeks). We think jocelyn finally reached its limit at this front, and thus oscar is now the replica mysql database, and jocelyn may be retired soon. Well, jocelyn may be an ample compute server but honestly oscar, even after taken on all the mysql duties, still has more memory and cpu cycles left over than jocelyn has doing nothing. It has 28GB of memory, which is a lot for being a compute server, but not a database. Plus jocelyn's storage is an external fibre channel jbod using software RAID. We can pretty much remove 4U of gear from the closet today if we wanted to. Or jocelyn will become another web server. Many options. It's great to see these server upgrades finally moving forward after certain dams were broken.

Also for the record jocelyn had been doing such a non-perfect job of keeping up in general over the past year that we have been aiming all queries (except maybe a scant one or two stastical queries per day) at carolyn. In other words, jocelyn was mostly just an up-to-date (or close-to-up-to-date) live backup of carolyn for a while. This may change, now that oscar's "seconds behind master" has pretty much been pegged at zero since it started up. Not that carolyn needs any extra help.

Oh yeah - thanks for spotting the "robots.txt" issue in the last thread. I added "/sah/" to the disallow list. We have been hit pretty hard by spiders lately and the /sah/ portion of the URLs were getting lost in the log noise - anyway we'll see if adding that line helps.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile arkaynProject donor
Volunteer tester
Avatar
Send message
Joined: 14 May 99
Posts: 3688
Credit: 48,722,369
RAC: 6,799
United States
Message 1262272 - Posted: 19 Jul 2012, 18:56:46 UTC

Thanks for the update Matt.
____________

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4139
Credit: 33,517,832
RAC: 24,058
United Kingdom
Message 1262289 - Posted: 19 Jul 2012, 19:55:30 UTC - in response to Message 1262266.

Thanks for the update too Matt,

Claggy

Juha
Volunteer tester
Send message
Joined: 7 Mar 04
Posts: 184
Credit: 143,295
RAC: 42
Finland
Message 1262321 - Posted: 19 Jul 2012, 21:41:59 UTC - in response to Message 1262266.

Oh yeah - thanks for spotting the "robots.txt" issue in the last thread. I added "/sah/" to the disallow list. We have been hit pretty hard by spiders lately and the /sah/ portion of the URLs were getting lost in the log noise - anyway we'll see if adding that line helps.

You missed /beta// (double slashes). Not that it's going to make much difference - there's not much content there compared to Main.

Profile Graham Middleton
Send message
Joined: 1 Sep 00
Posts: 466
Credit: 46,481,563
RAC: 32,724
United Kingdom
Message 1262332 - Posted: 19 Jul 2012, 22:28:24 UTC

Many thanks for the update, Matt. Also it is really great to see paddym in use & doing such a great job.

Well done all.
____________
Happy Crunching,

Graham

GPUUG Officer




graham@gpuug.org

Profile arkaynProject donor
Volunteer tester
Avatar
Send message
Joined: 14 May 99
Posts: 3688
Credit: 48,722,369
RAC: 6,799
United States
Message 1263093 - Posted: 21 Jul 2012, 21:26:17 UTC - in response to Message 1262321.

Oh yeah - thanks for spotting the "robots.txt" issue in the last thread. I added "/sah/" to the disallow list. We have been hit pretty hard by spiders lately and the /sah/ portion of the URLs were getting lost in the log noise - anyway we'll see if adding that line helps.

You missed /beta// (double slashes). Not that it's going to make much difference - there's not much content there compared to Main.


But something feels like it is hitting the site hard once again.
____________

Message boards : Technical News : More Shuffling (Jul 19 2012)

Copyright © 2014 University of California