Staycation (Jul 01 2010)


log in

Advanced search

Message boards : Technical News : Staycation (Jul 01 2010)

1 · 2 · 3 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1388
Credit: 74,079
RAC: 0
United States
Message 1010461 - Posted: 1 Jul 2010, 22:39:33 UTC

Barring unexpected incident, we'll be turning the spigots back on tomorrow (Friday) morning as planned. Thanks for your patience as we sort out what kind of server outage schedule ends up being the most productive - a definite work in progress. So what did we accomplish this week during the downtime?

Programming wise, Jeff was able to tackle some longstanding datarecorder issues. You may have noticed our results-to-send queue has been growing rather large - these are some test tapes Jeff's been splitting which will be sent out rather quickly once the floodgates open (the status page already shows the schedulers are up which is wrong - that's a bug I need to fix). I did some cleanup of our various internal libraries - stuff that would never get done under normal-operation circumstances but has been bugging us for a long time. I also fixed a web site bug here, a donation processing bug there.

Server wise, I got to upgrade the OS/mysql versions on the BOINC database servers - another thing that's been bothering me for a while. We also were able to do some testing/planning for some major server shuffling - trying to get the right services on the right servers, and the most important services on the most reliable servers. We still may have to get new hardware. I'll let you know.

Data wise, we were able to get back to merging our various spike tables together full bore - doing so while the project was up was causing all kinds of headaches. We'll have to turn the merge off over the weekend, of course. I also was able to do a whole bunch of data integrity testing - it's nice to be able to pull 1 Gbyte of signals out of the science database without the query getting blocked, or worrying about blocking other queries.

In short, it may not seem like much this first week given the extended downtime, but the mood around here is a lot better when we have the time and resources to take care of longstanding projects without worrying about squeezing them in edgewise. I think general productivity will vastly improve over time, and we'll adjust the outage schedules accordingly.

Speaking of time, I'm actually outta here - going on a three week vacation for various reasons. It'll actually be a "staycation" so I'll be on call to help in case of a crisis...

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile SciManStev
Volunteer tester
Avatar
Send message
Joined: 20 Jun 99
Posts: 4789
Credit: 79,495,315
RAC: 29,712
United States
Message 1010462 - Posted: 1 Jul 2010, 22:43:07 UTC - in response to Message 1010461.

Awesome job you are doing! I'm very happy you got the chance to address some of these issues. I understand completely!

Steve
____________
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website

Profile Byron Leigh Hatch @ team Carl Sagan
Volunteer tester
Avatar
Send message
Joined: 5 Jul 99
Posts: 3405
Credit: 11,811,328
RAC: 459
Canada
Message 1010465 - Posted: 1 Jul 2010, 22:44:20 UTC - in response to Message 1010461.

Thank you for the update,

Best Wishes
Byron
____________

KB7RZF
Volunteer tester
Avatar
Send message
Joined: 15 Aug 99
Posts: 9463
Credit: 3,023,554
RAC: 1,928
United States
Message 1010468 - Posted: 1 Jul 2010, 22:47:13 UTC

Sounds awesome Matt! Thank you to you all for the hard work! Glad to hear you guys were able to get so much done. Hopefully this outage schedule works for you guys.
____________

msattler
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38153
Credit: 555,989,838
RAC: 595,346
United States
Message 1010469 - Posted: 1 Jul 2010, 22:47:43 UTC

Some great bits of news there, Matt.

I am glad that the outage has enabled you to do some otherwise hard to accomplish tasks...

And, do enjoy the 'staycation'.

Mark and the kitties
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Claggy
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4039
Credit: 32,691,382
RAC: 712
United Kingdom
Message 1010471 - Posted: 1 Jul 2010, 22:58:03 UTC - in response to Message 1010461.
Last modified: 1 Jul 2010, 22:58:39 UTC

Thanks for the update Matt, have a good holiday,

Claggy

Profile perryjay
Volunteer tester
Avatar
Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 14,846,360
RAC: 11,664
United States
Message 1010478 - Posted: 1 Jul 2010, 23:14:52 UTC - in response to Message 1010471.

Here's hoping you get to enjoy your staycation without us bothering you. Glad you guys managed to get so much done and hope everything goes well this weekend. Guess we'll find out in the morning! :-)
____________


PROUD MEMBER OF Team Starfire World BOINC

Profile hiamps
Volunteer tester
Avatar
Send message
Joined: 23 May 99
Posts: 4292
Credit: 72,971,319
RAC: 0
United States
Message 1010486 - Posted: 1 Jul 2010, 23:43:49 UTC

Thanks for the update but did you guys fix any of the showstopper bugs like completion time estimates that make everything go into high priority and stop all downloads even if you are almost dry? Thanks again....
____________
Official Abuser of Boinc Buttons...
And no good credit hound!

msattler
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38153
Credit: 555,989,838
RAC: 595,346
United States
Message 1010490 - Posted: 1 Jul 2010, 23:52:34 UTC - in response to Message 1010486.

Thanks for the update but did you guys fix any of the showstopper bugs like completion time estimates that make everything go into high priority and stop all downloads even if you are almost dry? Thanks again....

That's a Boinc thingy....under DA's control.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Cameron
Avatar
Send message
Joined: 27 Nov 02
Posts: 69
Credit: 1,013,957
RAC: 363
Australia
Message 1010524 - Posted: 2 Jul 2010, 2:28:27 UTC - in response to Message 1010461.

Wonderful News Matt.

Week 1 Sounds like a success.
Enjoy your "Staycation".

Profile Hellsheep
Volunteer tester
Send message
Joined: 12 Sep 08
Posts: 428
Credit: 784,780
RAC: 0
Australia
Message 1010564 - Posted: 2 Jul 2010, 4:34:27 UTC

Thanks a heap Matt. You are all doing a great job. It's good to see that the extra time gave the SETI team the ability to perform some tasks that were really needed.
____________
- Jarryd

Earendil's Star
Send message
Joined: 1 Jun 03
Posts: 13
Credit: 6,493,876
RAC: 0
Zimbabwe
Message 1010567 - Posted: 2 Jul 2010, 4:40:02 UTC

Friday is here and still unable to upload and download? Is there a problem with turning the squiggoths back on?
____________

rmichel
Send message
Joined: 22 Jun 00
Posts: 1
Credit: 5,323,994
RAC: 0
United States
Message 1010570 - Posted: 2 Jul 2010, 4:44:35 UTC - in response to Message 1010567.

Friday is here and still unable to upload and download? Is there a problem with turning the squiggoths back on?

LOL! It's still Thursday at Berkeley. Patience, my friend!

Profile edjcox
Avatar
Send message
Joined: 20 May 99
Posts: 63
Credit: 3,967,004
RAC: 1,081
United States
Message 1010599 - Posted: 2 Jul 2010, 6:46:37 UTC

Matt

Thanks. Enjoy the time off.. I hope it has nothing to do with SETI funding.

Guess we won't know what's happening for a while again...

The dearth of information when your not around is striking...

Perhaps we can get a SETI schedule and plug it into our PC's so the the work we do will not just sit idle for weeks and weeks and weeks...

Adios Muchacho

____________
Never engage stupid people at their level, they then have the home court advantage.....

ToxicTBag
Send message
Joined: 5 Feb 10
Posts: 101
Credit: 57,197,902
RAC: 0
United Kingdom
Message 1010600 - Posted: 2 Jul 2010, 6:58:46 UTC

Thanks for the update Matt it's appreciated, good to know you got some problems sorted enjoy your staycation you've earned it!
____________

Profile S@NL - Eesger - www.knoop.nl
Avatar
Send message
Joined: 7 Oct 01
Posts: 384
Credit: 35,522,507
RAC: 18,474
Netherlands
Message 1010606 - Posted: 2 Jul 2010, 7:54:16 UTC

I have no idea how much resources are gone during the new 'server outage schedule' with stats-requests, but I may have some ideas about it:

1) The export (in /stats/)
I think you (guys) already thought of this, but I'll mention it, just to be safe. As far as I can see the '29th export' was the last complete one, after the systems went down. But there was a '30th export' with some very marginal new data. It might be a good idea to also completely lock down the export routine in your 'server outage schedule' (no resources lost on creating the export, no bandwidth lost with all those stats guys downloading the new info etc.. ;) )

2) caching the Berkeley-stats-pages
As far as I know the 'userw-data' has a caching of two hours, the team, hosts and user stats have a similar caching system. The various "personal stats pages" are real time. When the 'server outage schedule' kicks in, could caching be set to "indefinitely"? And can the personal stats be cached as well (no use in updating a page when you know the result is the same)?

And as always thanks for the info :)

Best regards,

Eesger

PS: I really hope there is some real vacation in your staycation, you've earned it..
____________
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS

Profile toffuuu
Volunteer tester
Send message
Joined: 30 Mar 00
Posts: 87
Credit: 1,395,913
RAC: 587
United States
Message 1010667 - Posted: 2 Jul 2010, 13:35:40 UTC - in response to Message 1010570.

if ur on the other side of the earth opposite of USA, it'll be sometime in ur day of Saturday hopefully lol
____________

Profile Peter van Houts
Send message
Joined: 14 Jan 04
Posts: 3
Credit: 29,876,456
RAC: 14,246
Netherlands
Message 1010671 - Posted: 2 Jul 2010, 13:41:06 UTC

He guys, I think you are doing a great job. Mostly admins are highly under appreciated. I watch as the services are coming online and wait until the new work comes available.
Have a nice holiday :-)
____________

Profile perryjay
Volunteer tester
Avatar
Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 14,846,360
RAC: 11,664
United States
Message 1010674 - Posted: 2 Jul 2010, 13:47:23 UTC - in response to Message 1010671.

For those of you wondering, it's 6:45AM in Berkeley right now. That's UTC -7 It was posted elsewhere that they are shooting for a 9AM start time (Berkeley time)
____________


PROUD MEMBER OF Team Starfire World BOINC

Profile Peter van Houts
Send message
Joined: 14 Jan 04
Posts: 3
Credit: 29,876,456
RAC: 14,246
Netherlands
Message 1010677 - Posted: 2 Jul 2010, 13:50:30 UTC - in response to Message 1010674.

Thanks, I live in The Netherlands, Europe. I can wait some hours :-) Keep up the good work.
____________

1 · 2 · 3 · Next

Message boards : Technical News : Staycation (Jul 01 2010)

Copyright © 2014 University of California