Mid May Update (May 21 2015)

Message boards : Technical News : Mid May Update (May 21 2015)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1441
Credit: 217,165
RAC: 0
United States
Message 1682196 - Posted: 21 May 2015, 17:50:33 UTC
Last modified: 22 May 2015, 20:58:09 UTC

It's been a busy bunch of weeks of behind-the-scenes stuff. I'll catch up on at least a few things.

So the data center (where most of our servers are housed, along with most of the important servers on campus) had a big network migration over to a new infrastructure this past week. This was mostly to bring the center up to 10Gbe potential (and beyond), but being we are still constrained by various other bottlenecks (our own Hurricane Electric route, our various 1Gb NICs, our ability to create workunits, etc.) we're not going to see any change in our traffic levels. Anyway, it went according to plan for the most part, though the next day I had to do some cleanup to get all the servers rolling again.

Yes, the cricket traffic graphs have changed during the migration. Did any of you find the new one yet? I haven't actually looked - we have our own internal graphs so this isn't a pressing need - but I did ping campus just now about it. Oh - just as I was typing that last sentence campus responded saying they are still evaluating options for how to gather/present this information. Looks like changes are afoot.

There is a push to finish getting our SERENDIP VI technology installed at Green Bank Telescope. Maybe as soon as mid-June, though nothing is set in stone (until we buy our flights). So the whole team is a bit preoccupied with preparing for that. A GBT splitter is already in the works.

We're well beyond the annoying wave of science database hangups for now (that were plaguing us last month as I was trying to migrate a full table into new database spaces). Now we're back to plotting the next big thing (or several things) to clean up the database, make it faster, etc.. A mixture of removing redundant data and obtaining new server hardware. I know I've mentioned all this before. We do progress on this front but at glacial speeds due to incredible caution, lack of resources, and balancing priorities. For example one priority was an NSF proposal round that pretty much occupied me and Dan and several others for the entire past week.

The whole Astropulse database cleanup project continues. As predicted, it's taking a long time to merge/reload all the data into the temporary database (current prediction: it'll complete in early June). Meanwhile we're still using server marvin (as normal) to collect current results. Once the merge/reload completes (all fingers/toes crossed) we will stop the database on marvin for a few days - merge them both together, and reload it all back on marvin. Note: if any of this fails at any time, we won't lose any data (we just have to try again in a different manner). We also aren't constrained by any this - we are splitting/assimilating AP workunits as fast we can as during normal operations.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1682196 · Report as offensive
Profile Akio
Avatar

Send message
Joined: 18 May 11
Posts: 374
Credit: 29,583,371
RAC: 684
United States
Message 1682207 - Posted: 21 May 2015, 18:17:39 UTC - in response to Message 1682196.  

Thank you for the update ;)
ID: 1682207 · Report as offensive
Profile [SETI.Germany] Sutaru Tsureku (aka Dirk :-)
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7084
Credit: 121,490,199
RAC: 258
Germany
Message 1682729 - Posted: 22 May 2015, 19:13:52 UTC - in response to Message 1682196.  

Matt, thanks for the news.
ID: 1682729 · Report as offensive
Profile Gary CharpentierCrowdfunding Project Donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 20263
Credit: 27,623,849
RAC: 28,191
United States
Message 1682947 - Posted: 23 May 2015, 3:55:56 UTC

Thanks for posting news. Have a good three day weekend.
ID: 1682947 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2729
Credit: 40,266,017
RAC: 21,891
United States
Message 1687739 - Posted: 4 Jun 2015, 15:04:51 UTC

If everthing's working, how about getting the science page back online? - or if that's too low priority, how about taking that page down altogether?
.
ID: 1687739 · Report as offensive
Profile KC5VDJ - Jim the Enchanter
Avatar

Send message
Joined: 17 May 99
Posts: 81
Credit: 4,083,597
RAC: 64
United States
Message 1692796 - Posted: 17 Jun 2015, 20:08:36 UTC - in response to Message 1682196.  

What's happening? I noticed that I have no tasks. I thought the database cleanup was over?
Delidded i7-4790K (CLU/CLU) at 4.7GHz @ 1.310Vcore 24/7, 32GB DDR3-2400, Corsair H100i v2, Gigabyte Z97X-Gaming G1 WIFI-BK, MSI Radeon RX 480 Gaming 4G, HX-650 PSU, Corsair 750D

ID: 1692796 · Report as offensive
Profile Donald L. JohnsonProject Donor
Avatar

Send message
Joined: 5 Aug 02
Posts: 8211
Credit: 5,787,350
RAC: 7,103
United States
Message 1692928 - Posted: 18 Jun 2015, 4:50:07 UTC - in response to Message 1692796.  

What's happening? I noticed that I have no tasks. I thought the database cleanup was over?

You are more likely to get answers to such questions in the Number Crunching Forum, specifically the current Panic Mode: Server Problems thread.
Donald
Infernal Optimist / Submariner, retired
ID: 1692928 · Report as offensive

Message boards : Technical News : Mid May Update (May 21 2015)


 
©2017 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.