Staycation (Jul 01 2010)

Message boards : Technical News : Staycation (Jul 01 2010)
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 1010461 - Posted: 1 Jul 2010, 22:39:33 UTC

Barring unexpected incident, we'll be turning the spigots back on tomorrow (Friday) morning as planned. Thanks for your patience as we sort out what kind of server outage schedule ends up being the most productive - a definite work in progress. So what did we accomplish this week during the downtime?

Programming wise, Jeff was able to tackle some longstanding datarecorder issues. You may have noticed our results-to-send queue has been growing rather large - these are some test tapes Jeff's been splitting which will be sent out rather quickly once the floodgates open (the status page already shows the schedulers are up which is wrong - that's a bug I need to fix). I did some cleanup of our various internal libraries - stuff that would never get done under normal-operation circumstances but has been bugging us for a long time. I also fixed a web site bug here, a donation processing bug there.

Server wise, I got to upgrade the OS/mysql versions on the BOINC database servers - another thing that's been bothering me for a while. We also were able to do some testing/planning for some major server shuffling - trying to get the right services on the right servers, and the most important services on the most reliable servers. We still may have to get new hardware. I'll let you know.

Data wise, we were able to get back to merging our various spike tables together full bore - doing so while the project was up was causing all kinds of headaches. We'll have to turn the merge off over the weekend, of course. I also was able to do a whole bunch of data integrity testing - it's nice to be able to pull 1 Gbyte of signals out of the science database without the query getting blocked, or worrying about blocking other queries.

In short, it may not seem like much this first week given the extended downtime, but the mood around here is a lot better when we have the time and resources to take care of longstanding projects without worrying about squeezing them in edgewise. I think general productivity will vastly improve over time, and we'll adjust the outage schedules accordingly.

Speaking of time, I'm actually outta here - going on a three week vacation for various reasons. It'll actually be a "staycation" so I'll be on call to help in case of a crisis...

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1010461 · Report as offensive
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6658
Credit: 121,090,076
RAC: 0
United States
Message 1010462 - Posted: 1 Jul 2010, 22:43:07 UTC - in response to Message 1010461.  

Awesome job you are doing! I'm very happy you got the chance to address some of these issues. I understand completely!

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1010462 · Report as offensive
Profile Byron Leigh Hatch @ team Carl Sagan
Volunteer tester
Avatar

Send message
Joined: 5 Jul 99
Posts: 4548
Credit: 35,667,570
RAC: 4
Canada
Message 1010465 - Posted: 1 Jul 2010, 22:44:20 UTC - in response to Message 1010461.  

Thank you for the update,

Best Wishes
Byron
ID: 1010465 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9549
Credit: 3,308,926
RAC: 2
United States
Message 1010468 - Posted: 1 Jul 2010, 22:47:13 UTC

Sounds awesome Matt! Thank you to you all for the hard work! Glad to hear you guys were able to get so much done. Hopefully this outage schedule works for you guys.
ID: 1010468 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1010469 - Posted: 1 Jul 2010, 22:47:43 UTC

Some great bits of news there, Matt.

I am glad that the outage has enabled you to do some otherwise hard to accomplish tasks...

And, do enjoy the 'staycation'.

Mark and the kitties
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1010469 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1010471 - Posted: 1 Jul 2010, 22:58:03 UTC - in response to Message 1010461.  
Last modified: 1 Jul 2010, 22:58:39 UTC

Thanks for the update Matt, have a good holiday,

Claggy
ID: 1010471 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1010478 - Posted: 1 Jul 2010, 23:14:52 UTC - in response to Message 1010471.  

Here's hoping you get to enjoy your staycation without us bothering you. Glad you guys managed to get so much done and hope everything goes well this weekend. Guess we'll find out in the morning! :-)


PROUD MEMBER OF Team Starfire World BOINC
ID: 1010478 · Report as offensive
Profile hiamps
Volunteer tester
Avatar

Send message
Joined: 23 May 99
Posts: 4292
Credit: 72,971,319
RAC: 0
United States
Message 1010486 - Posted: 1 Jul 2010, 23:43:49 UTC

Thanks for the update but did you guys fix any of the showstopper bugs like completion time estimates that make everything go into high priority and stop all downloads even if you are almost dry? Thanks again....
Official Abuser of Boinc Buttons...
And no good credit hound!
ID: 1010486 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1010490 - Posted: 1 Jul 2010, 23:52:34 UTC - in response to Message 1010486.  

Thanks for the update but did you guys fix any of the showstopper bugs like completion time estimates that make everything go into high priority and stop all downloads even if you are almost dry? Thanks again....

That's a Boinc thingy....under DA's control.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1010490 · Report as offensive
Cameron
Avatar

Send message
Joined: 27 Nov 02
Posts: 110
Credit: 5,082,471
RAC: 17
Australia
Message 1010524 - Posted: 2 Jul 2010, 2:28:27 UTC - in response to Message 1010461.  

Wonderful News Matt.

Week 1 Sounds like a success.
Enjoy your "Staycation".
ID: 1010524 · Report as offensive
Profile Hellsheep
Volunteer tester

Send message
Joined: 12 Sep 08
Posts: 428
Credit: 784,780
RAC: 0
Australia
Message 1010564 - Posted: 2 Jul 2010, 4:34:27 UTC

Thanks a heap Matt. You are all doing a great job. It's good to see that the extra time gave the SETI team the ability to perform some tasks that were really needed.
- Jarryd
ID: 1010564 · Report as offensive
Earendil's Star

Send message
Joined: 1 Jun 03
Posts: 13
Credit: 6,542,706
RAC: 0
Zimbabwe
Message 1010567 - Posted: 2 Jul 2010, 4:40:02 UTC

Friday is here and still unable to upload and download? Is there a problem with turning the squiggoths back on?
ID: 1010567 · Report as offensive
rmichel
Volunteer tester

Send message
Joined: 22 Jun 00
Posts: 1
Credit: 8,390,194
RAC: 0
United States
Message 1010570 - Posted: 2 Jul 2010, 4:44:35 UTC - in response to Message 1010567.  

Friday is here and still unable to upload and download? Is there a problem with turning the squiggoths back on?

LOL! It's still Thursday at Berkeley. Patience, my friend!
ID: 1010570 · Report as offensive
Profile edjcox
Avatar

Send message
Joined: 20 May 99
Posts: 96
Credit: 5,878,353
RAC: 0
United States
Message 1010599 - Posted: 2 Jul 2010, 6:46:37 UTC

Matt

Thanks. Enjoy the time off.. I hope it has nothing to do with SETI funding.

Guess we won't know what's happening for a while again...

The dearth of information when your not around is striking...

Perhaps we can get a SETI schedule and plug it into our PC's so the the work we do will not just sit idle for weeks and weeks and weeks...

Adios Muchacho

Never engage stupid people at their level, they then have the home court advantage.....
ID: 1010599 · Report as offensive
ToxicTBag

Send message
Joined: 5 Feb 10
Posts: 101
Credit: 57,197,902
RAC: 0
United Kingdom
Message 1010600 - Posted: 2 Jul 2010, 6:58:46 UTC

Thanks for the update Matt it's appreciated, good to know you got some problems sorted enjoy your staycation you've earned it!
ID: 1010600 · Report as offensive
Profile S@NL - Eesger - www.knoop.nl
Avatar

Send message
Joined: 7 Oct 01
Posts: 385
Credit: 50,200,038
RAC: 0
Netherlands
Message 1010606 - Posted: 2 Jul 2010, 7:54:16 UTC

I have no idea how much resources are gone during the new 'server outage schedule' with stats-requests, but I may have some ideas about it:

1) The export (in /stats/)
I think you (guys) already thought of this, but I'll mention it, just to be safe. As far as I can see the '29th export' was the last complete one, after the systems went down. But there was a '30th export' with some very marginal new data. It might be a good idea to also completely lock down the export routine in your 'server outage schedule' (no resources lost on creating the export, no bandwidth lost with all those stats guys downloading the new info etc.. ;) )

2) caching the Berkeley-stats-pages
As far as I know the 'userw-data' has a caching of two hours, the team, hosts and user stats have a similar caching system. The various "personal stats pages" are real time. When the 'server outage schedule' kicks in, could caching be set to "indefinitely"? And can the personal stats be cached as well (no use in updating a page when you know the result is the same)?

And as always thanks for the info :)

Best regards,

Eesger

PS: I really hope there is some real vacation in your staycation, you've earned it..
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS
ID: 1010606 · Report as offensive
Profile toffuuu
Volunteer tester

Send message
Joined: 30 Mar 00
Posts: 87
Credit: 1,887,469
RAC: 0
United States
Message 1010667 - Posted: 2 Jul 2010, 13:35:40 UTC - in response to Message 1010570.  

if ur on the other side of the earth opposite of USA, it'll be sometime in ur day of Saturday hopefully lol
ID: 1010667 · Report as offensive
Profile Peter van Houts

Send message
Joined: 14 Jan 04
Posts: 3
Credit: 69,762,407
RAC: 7
Netherlands
Message 1010671 - Posted: 2 Jul 2010, 13:41:06 UTC

He guys, I think you are doing a great job. Mostly admins are highly under appreciated. I watch as the services are coming online and wait until the new work comes available.
Have a nice holiday :-)
ID: 1010671 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1010674 - Posted: 2 Jul 2010, 13:47:23 UTC - in response to Message 1010671.  

For those of you wondering, it's 6:45AM in Berkeley right now. That's UTC -7 It was posted elsewhere that they are shooting for a 9AM start time (Berkeley time)


PROUD MEMBER OF Team Starfire World BOINC
ID: 1010674 · Report as offensive
Profile Peter van Houts

Send message
Joined: 14 Jan 04
Posts: 3
Credit: 69,762,407
RAC: 7
Netherlands
Message 1010677 - Posted: 2 Jul 2010, 13:50:30 UTC - in response to Message 1010674.  

Thanks, I live in The Netherlands, Europe. I can wait some hours :-) Keep up the good work.
ID: 1010677 · Report as offensive
1 · 2 · 3 · Next

Message boards : Technical News : Staycation (Jul 01 2010)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.