Main web server crash / migration.

Message boards : News : Main web server crash / migration.
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Jeff Cobb Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist

Send message
Joined: 1 Mar 99
Posts: 122
Credit: 40,367
RAC: 0
United States
Message 1766308 - Posted: 19 Feb 2016, 21:54:14 UTC

Our main web server machine became inoperative this morning. We have migrated web service to another machine.
ID: 1766308 · Report as offensive
Profile JaundicedEye
Avatar

Send message
Joined: 14 Mar 12
Posts: 5375
Credit: 30,870,693
RAC: 1
United States
Message 1766329 - Posted: 19 Feb 2016, 22:51:47 UTC - in response to Message 1766308.  

Thanks Jeff, and good on the ones who fix the broken bits. You keep us together.

"Sour Grapes make a bitter Whine." <(0)>
ID: 1766329 · Report as offensive
Profile Jordan Desilets

Send message
Joined: 27 Sep 13
Posts: 2
Credit: 19,930,794
RAC: 14
United States
Message 1767654 - Posted: 26 Feb 2016, 3:34:14 UTC - in response to Message 1766308.  

Is there any reason you haven't moved everything over to Amazon AWS servers? My entire company sits on there and we can do some pretty amazing things and it's very cost effective.
ID: 1767654 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1767707 - Posted: 26 Feb 2016, 7:41:26 UTC - in response to Message 1767654.  
Last modified: 26 Feb 2016, 7:42:09 UTC

Is there any reason you haven't moved everything over to Amazon AWS servers? My entire company sits on there and we can do some pretty amazing things and it's very cost effective.

As I recall, this has been asked several times in the past, and the answers were:
1) This is a University research project.. For reasons of data security and scientific integrity, the project will remain on university-controlled computers, and
2) This is a low-budget (shoe-string, volunteer-funded) project, and the money isn't there to move to a commercial cloud service, even if 1) did notr apply.
Donald
Infernal Optimist / Submariner, retired
ID: 1767707 · Report as offensive
Profile Jordan Desilets

Send message
Joined: 27 Sep 13
Posts: 2
Credit: 19,930,794
RAC: 14
United States
Message 1767893 - Posted: 26 Feb 2016, 21:22:00 UTC - in response to Message 1767707.  

Has anyone actually calculated the costs? http://s3.amazonaws.com/calculator/index.html I wouldn't know what to put in.

As for security how would AWS be any less secure. We process around $120 million dollars using this service...again I have no IT background. I am happy to look into this more if it would helps. AWS is supposed to be more cost effective than using a home box.
ID: 1767893 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22442
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1767904 - Posted: 26 Feb 2016, 22:05:37 UTC

First shot, based on the current server models and data transfers - in excess of $50k per month, and that excludes the storage size!!!!

As Donald said - cost (I understand SETI@Home's annual budget is about $150k, and most of that goes on salaries.)
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1767904 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11408
Credit: 29,581,041
RAC: 66
United States
Message 1767920 - Posted: 26 Feb 2016, 23:06:22 UTC

SETI@home Budget - Winter 2011
Project/Task Subtotals Total
SETI@home 166,200
Database normalization (in order to co-analyze multiple project data sets) 10,000
NTPCker development
Candidate production code - $20000
Scoring - $10000
Presentation (web development for both internal/external purposes) - $10000 40,000
RFI rejection (algorithms, analysis, implementation) 20,000
Multiple frequency observing (requires client and backend modifications) 30,000
Continued radar blanking development 30,000
Client maintenance/development 30,000
Preparation for followup observations 6,200

Astropulse 60,000
Continued maintenance 10,000
Further development 20,000
Data analysis 30,000

Systems/Day-to-day operations 250,000
Internet bandwidth (monthly costs and improvements) 40,000
Database administration and support 60,000
Systems administration and support 120,000
Server maintenance and performance monitoring 20,000
Web site development/maintenance 10,000

Total: $476,200
ID: 1767920 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22442
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1768035 - Posted: 27 Feb 2016, 8:54:10 UTC

Thanks - my memory was only the headline figure for SETI - and even that was low.
So we are talking about S@H's total being $500k, or about $42k per month - and most of those costs are staff costs, not "hardware". A quick look suggests that the only area for savings by transferring the database to Amazon's care would be in the last block of $250k, and even then there are a lot of costs that would still be needed for staff at Berkeley, my first guess would be that only half of the $250k could be offset against the Amazon charges - say $125k (or slightly over $10k per month).
So pay $50k per month to Amazon and still have to spend $32k per month means a total expenditure of $82k per month against $42k per month - that's not a saving that is nearly doubling the budget......
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1768035 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1768036 - Posted: 27 Feb 2016, 9:00:29 UTC

SETI@home was started with the idea of exploiting "unused cycles" on PCs. Then it generated BOINC, and the paradigm of distributed volunteer computing took off, with Einstein@home discovering new pulsars, both in the radio and the gamma-ray ranges. The computing power of ATLAS@home (ATLAS is a big CERN particle experiment) rivals that of the CERN GRID. So taking our computations to Amazon or IBM or Google clouds would be a step backwards.
Tullio
ID: 1768036 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1768105 - Posted: 27 Feb 2016, 16:41:37 UTC - in response to Message 1768036.  

SETI@home was started with the idea of exploiting "unused cycles" on PCs. Then it generated BOINC, and the paradigm of distributed volunteer computing took off, with Einstein@home discovering new pulsars, both in the radio and the gamma-ray ranges. The computing power of ATLAS@home (ATLAS is a big CERN particle experiment) rivals that of the CERN GRID. So taking our computations to Amazon or IBM or Google clouds would be a step backwards.
Tullio

Tullio, I read his question as about moving the Seti@Home project server functions to Amazon or Google Cloud, rather than the actual crunching that we do.
Donald
Infernal Optimist / Submariner, retired
ID: 1768105 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1768360 - Posted: 28 Feb 2016, 15:27:23 UTC - in response to Message 1768105.  

I think you are right, but that would be only a part of SETI@home and it would drain all the money SETI has, with no money for development and other tasks. SETI@home works on a shoestring budget, with little financing except by volunteers like us.
Tullio
ID: 1768360 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1768362 - Posted: 28 Feb 2016, 15:37:33 UTC - in response to Message 1768360.  

I think you are right, but that would be only a part of SETI@home and it would drain all the money SETI has, with no money for development and other tasks. SETI@home works on a shoestring budget, with little financing except by volunteers like us.
Tullio

Exactly the points we've made.
Donald
Infernal Optimist / Submariner, retired
ID: 1768362 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1768375 - Posted: 28 Feb 2016, 16:55:09 UTC

It's dimes and nickels, nickels and dimes..."All my sons" by Arthur Miller, a Greek tragedy written in Midwestern English.
Tullio
ID: 1768375 · Report as offensive
Peter Lutz

Send message
Joined: 25 Aug 99
Posts: 6
Credit: 2,102,999
RAC: 0
United States
Message 1768452 - Posted: 28 Feb 2016, 21:52:40 UTC - in response to Message 1766308.  

I guess the work server is out too? I have a 2nd computer dedicated to SETI@home and it hasn't uploaded completed work in about a week, just get Communication Deferred in the status. any idea when that'll be back up?
Thanks[/quote]
ID: 1768452 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1768516 - Posted: 29 Feb 2016, 2:43:42 UTC - in response to Message 1768452.  
Last modified: 29 Feb 2016, 2:44:05 UTC

I guess the work server is out too? I have a 2nd computer dedicated to SETI@home and it hasn't uploaded completed work in about a week, just get Communication Deferred in the status. any idea when that'll be back up?
Thanks

The place to address that issue is the Number Crunching section of the Forums, or the Q & A area..
Donald
Infernal Optimist / Submariner, retired
ID: 1768516 · Report as offensive
Profile Dr. Ronald C. Spencer

Send message
Joined: 7 Apr 02
Posts: 37
Credit: 350,605
RAC: 0
United States
Message 1769313 - Posted: 3 Mar 2016, 19:36:26 UTC - in response to Message 1766308.  

Thanks for the heads up, I was wondering why I wasn't getting any work. I look forward to new work real soon. Have a great day and upcoming weekend.

Dr. Spencer
Astronomer Emeritus
People's Republic of Taxachusetts
ID: 1769313 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13835
Credit: 208,696,464
RAC: 304
Australia
Message 1769351 - Posted: 3 Mar 2016, 23:08:57 UTC - in response to Message 1769313.  
Last modified: 3 Mar 2016, 23:09:24 UTC

Thanks for the heads up, I was wondering why I wasn't getting any work. I look forward to new work real soon. Have a great day and upcoming weekend.

Dr. Spencer
Astronomer Emeritus
People's Republic of Taxachusetts

The web server issue occurred on the 19th of February, and had no effect on the availability of work.

You might want to check your system to see what the issue is.
If you can't sort it out, I'd suggest un-hiding your computers & posting in the Number Crunching or Question and Answers forums for assistance.
Grant
Darwin NT
ID: 1769351 · Report as offensive
Profile Willi Kretzschmar
Volunteer tester

Send message
Joined: 23 Mar 00
Posts: 7
Credit: 562,441
RAC: 0
Germany
Message 1769768 - Posted: 5 Mar 2016, 16:36:06 UTC - in response to Message 1766308.  

so you have no units for this time?
ID: 1769768 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 1769809 - Posted: 5 Mar 2016, 18:13:11 UTC - in response to Message 1769768.  
Last modified: 5 Mar 2016, 18:13:31 UTC

There are no SETI@home v7 or AstroPulse workunits as of this moment, but there's plenty of SETI@home v8. You should get version 8 automatically unless you're using a third-party program and haven't updated, or you haven't selected v8 in your preferences.
ID: 1769809 · Report as offensive
Jesse Viviano

Send message
Joined: 27 Feb 00
Posts: 100
Credit: 3,949,583
RAC: 0
United States
Message 1771275 - Posted: 12 Mar 2016, 23:31:36 UTC - in response to Message 1767893.  

Amazon has a poor reputation for security in its cloud computing services. See https://www.washingtonpost.com/news/the-switch/wp/2014/01/16/amazon-is-a-hornets-nest-of-malware/ for how it became a top malware and botnet host in 2014. See https://www.spamhaus.org/sbl/listings/amazon.com for a list of spammers, phishing sites, and Angler Exploit Kit redirectors that it hosts. (The Angler Exploit Kit is malware used to install other criminals' malware on victim computers as a service.) Amazon apparently does not ask enough questions on what its cloud computing customers are doing. This shows that Amazon's cloud computing services probably cannot be trusted if security is a top priority.
ID: 1771275 · Report as offensive
1 · 2 · Next

Message boards : News : Main web server crash / migration.


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.