Arecibo telescope closed by earthquake - no new data for a while

Message boards : Number crunching : Arecibo telescope closed by earthquake - no new data for a while
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471073 - Posted: 31 Jan 2014, 10:55:49 UTC

Bernd Machenschalk of Einstein (which uses data from Arecibo, in much the same way that we do) has just posted this:

There isn't any, and there probably won't be for some time. AFAIK Arecibo is still busy inspecting and fixing the damage from the recent earthquake. Not taking new or even shipping old data.

BM
ID: 1471073 · Report as offensive
Profile Tim
Volunteer tester
Avatar

Send message
Joined: 19 May 99
Posts: 211
Credit: 278,575,259
RAC: 0
Greece
Message 1471074 - Posted: 31 Jan 2014, 11:02:48 UTC

Time to clean the pc :-)
ID: 1471074 · Report as offensive
Profile Link
Avatar

Send message
Joined: 18 Sep 03
Posts: 834
Credit: 1,807,369
RAC: 0
Germany
Message 1471083 - Posted: 31 Jan 2014, 11:43:06 UTC

Would be nice to know from SETI staff what that means for us, i.e. if and how soon we have to expect, that the project runs out of work.
ID: 1471083 · Report as offensive
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 1471112 - Posted: 31 Jan 2014, 12:53:00 UTC

And Green Bank, according to "Nature", is in danger for lack of funds from the National Science Foundation.
Tullio
ID: 1471112 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471120 - Posted: 31 Jan 2014, 13:06:07 UTC - in response to Message 1471112.  

And Green Bank, according to "Nature", is in danger for lack of funds from the National Science Foundation.
Tullio

So is Arecibo, if you read the rest of that Caribbean Business article on the earthquake.
ID: 1471120 · Report as offensive
Batter Up
Avatar

Send message
Joined: 5 May 99
Posts: 1946
Credit: 24,860,347
RAC: 0
United States
Message 1471190 - Posted: 31 Jan 2014, 16:35:07 UTC

That is old news; there is nothing to see here so move along.
ID: 1471190 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471210 - Posted: 31 Jan 2014, 17:28:42 UTC - in response to Message 1471190.  

That is old news; there is nothing to see here so move along.

It was new news when I posted: a way of drawing the attention of SETI crunchers who run Einstein as a backup project to their forthcoming lack of data.
ID: 1471210 · Report as offensive
Profile William
Volunteer tester
Avatar

Send message
Joined: 14 Feb 13
Posts: 2037
Credit: 17,689,662
RAC: 0
Message 1471212 - Posted: 31 Jan 2014, 17:34:57 UTC - in response to Message 1471190.  

That is old news; there is nothing to see here so move along.

You a mod now?
A person who won't read has no advantage over one who can't read. (Mark Twain)
ID: 1471212 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1471381 - Posted: 31 Jan 2014, 22:23:10 UTC

I have a feeling that unless it has a long-term effect of say.. 3-4 months, we likely won't be affected. My understanding is that there are hundreds of "tapes" in off-site storage, and also further understanding.. old data tapes that were split years ago before AP came along or the sensitivity of MB was increased are still kicking around somewhere and can be re-processed if needed.

All of this is gathered from reading the tech news posts for the past 6 years. There hasn't ever been an actual figure for how many tapes are in off-site storage, but I've read Matt say once before that we can weather a dry spell of new tapes for quite a while. I'm not going to use quotes since I don't recall the rough amount, but it was suggested that it could be several months.

Of course, that was before GPU crunching got as good as it is now.. so I don't know how relevant the old figures are anymore. But I still feel like we'll be fine for at least 2 months without new data arriving.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1471381 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471395 - Posted: 31 Jan 2014, 23:06:25 UTC

And later news reports suggested that the damage wasn't fatal.

Take your pick of

Fox News
New York Daily News
ID: 1471395 · Report as offensive
Filipe

Send message
Joined: 12 Aug 00
Posts: 218
Credit: 21,281,677
RAC: 20
Portugal
Message 1471521 - Posted: 1 Feb 2014, 10:33:03 UTC

Not sure there is a lot of new tapes available off-site for crunching.

Anyway, sure there is a lot fo pré-2008 data waiting to be re-processed with Astropulse, the new RFI technics and the new autocorrelation.
ID: 1471521 · Report as offensive
Juha
Volunteer tester

Send message
Joined: 7 Mar 04
Posts: 388
Credit: 1,857,738
RAC: 0
Finland
Message 1471565 - Posted: 1 Feb 2014, 13:11:39 UTC

There's the SETI@home Data Distribution History page. It says it was updated last summer and the dates goes to this January but I'll let somebody else guess when it was really updated.
ID: 1471565 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1471604 - Posted: 1 Feb 2014, 15:33:26 UTC - in response to Message 1471565.  
Last modified: 1 Feb 2014, 15:37:39 UTC

There's the SETI@home Data Distribution History page. It says it was updated last summer and the dates goes to this January but I'll let somebody else guess when it was really updated.

I read the update as 26 January 2013, one year ago. But whenever it was updated, if all the original raw data is still in storage, there is plenty to work/rework on.

Edit] Okay, need new glasses. 26 Jun 2013. But main point, plenty of data in storage to work.
Donald
Infernal Optimist / Submariner, retired
ID: 1471604 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1471616 - Posted: 1 Feb 2014, 15:51:28 UTC - in response to Message 1471604.  

There's the SETI@home Data Distribution History page. It says it was updated last summer and the dates goes to this January but I'll let somebody else guess when it was really updated.

I read the update as 26 January 2013, one year ago. But whenever it was updated, if all the original raw data is still in storage, there is plenty to work/rework on.

Edit] Okay, need new glasses. 26 Jun 2013. But main point, plenty of data in storage to work.

I think what was being hinted at was that the last actual entry was May 2007!!
ID: 1471616 · Report as offensive
Juha
Volunteer tester

Send message
Joined: 7 Mar 04
Posts: 388
Credit: 1,857,738
RAC: 0
Finland
Message 1471655 - Posted: 1 Feb 2014, 16:54:38 UTC - in response to Message 1471616.  

There's the SETI@home Data Distribution History page. It says it was updated last summer and the dates goes to this January but I'll let somebody else guess when it was really updated.

I read the update as 26 January 2013, one year ago. But whenever it was updated, if all the original raw data is still in storage, there is plenty to work/rework on.

Edit] Okay, need new glasses. 26 Jun 2013. But main point, plenty of data in storage to work.

I think what was being hinted at was that the last actual entry was May 2007!!

Yep
ID: 1471655 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471677 - Posted: 1 Feb 2014, 18:16:40 UTC - in response to Message 1471655.  
Last modified: 1 Feb 2014, 18:34:59 UTC

Well, this conversation has prompted me to spend the afternoon trying out a project I've been thinking about for some time.

Working from the job log from just one machine, I've sliced and diced the 125,551 completed task records, to get a list of 4,785 tapes, recorded on 1,248 distinct dates, between 8 February 2000 and 3 December 2013. I'm not sure when the job log was introduced into BOINC, but it's looking like July 2007 - so that looks like the tape history of the last six and a half years.

Now that I've got it (or maybe when I've filled in any gaps from my three other long-serving rigs), how on earth should I display it in a manageable format?

Edit, still playing with the data. We processed a number of recordings from the year 2000 in that summer of 2007, but apart from that, the oldest tape I've got records for is 05jl06ef.

And the quickest turnround, from telescope to crunch, was in the summer of 2012. I processed a task from 09jl12ab just a week later, on 16 July.
ID: 1471677 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1471680 - Posted: 1 Feb 2014, 19:05:29 UTC - in response to Message 1471677.  

That's a great resource you've preserved there, with those old logs. I'm not sure how you'd display it, but just the fact that you have it makes me curious about something. After the switch from v6 to v7 we spent several months processing "tapes" from 2008 and 2009 before jumping ahead to 2013. Can you tell from your logs whether those files were actually being dug out of the vault for the first time or were they files that had been previously processed under v6, say, back closer to when they actually were collected? Since I wasn't active during that time period, I have nothing to go on but it does pique my curiosity!
ID: 1471680 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1471685 - Posted: 1 Feb 2014, 19:28:07 UTC - in response to Message 1471680.  

That's a great resource you've preserved there, with those old logs. I'm not sure how you'd display it, but just the fact that you have it makes me curious about something. After the switch from v6 to v7 we spent several months processing "tapes" from 2008 and 2009 before jumping ahead to 2013. Can you tell from your logs whether those files were actually being dug out of the vault for the first time or were they files that had been previously processed under v6, say, back closer to when they actually were collected? Since I wasn't active during that time period, I have nothing to go on but it does pique my curiosity!

OK then, let's see what this turns up. My app_info for SETI on this machine is dated 13 June 2013, so let's call that my final 'go live' date for v7.

I can offer you records like:

Tapedate	Tape		First processed	Last processed	Diff (days)
01/03/2009	01mr09ad	16-Jun-2009	22-Jun-2013	1467
04/01/2012	04ja12ad	18-Apr-2012	22-Jun-2013	430
14/01/2012	14ja12ab	11-Mar-2012	22-Jun-2013	468
05/03/2008	05mr08ab	08-Jun-2008	23-Jun-2013	1841
14/01/2012	14ja12ac	11-Mar-2012	23-Jun-2013	469
03/12/2008	03dc08ac	20-Dec-2008	24-Jun-2013	1647
10/12/2008	10dc08af	23-Jan-2009	24-Jun-2013	1613
12/08/2009	12au09ad	03-Oct-2009	24-Jun-2013	1360
23/08/2009	23au09ac	24-Sep-2009	25-Jun-2013	1370
10/09/2009	10se09ag	27-Oct-2009	26-Jun-2013	1338
14/03/2008	14mr08ab	10-Sep-2009	27-Jun-2013	1386
24/04/2008	24ap08af	05-Jun-2008	27-Jun-2013	1848
02/09/2008	02se08ab	07-Jul-2009	27-Jun-2013	1451
30/10/2008	30oc08ag	06-Dec-2008	27-Jun-2013	1664
25/02/2009	25fe09aa	12-May-2009	27-Jun-2013	1507
14/07/2009	14jl09ab	23-Aug-2009	27-Jun-2013	1404
04/09/2008	04se08ad	01-Nov-2008	29-Jun-2013	1701
15/02/2009	15fe09ac	16-May-2009	29-Jun-2013	1505
19/04/2011	19ap11ac	05-Sep-2011	29-Jun-2013	663
05/03/2009	05mr09aa	21-Jun-2009	30-Jun-2013	1470
13/03/2008	13mr08ab	16-Apr-2008	01-Jul-2013	1902
05/09/2008	05se08aa	02-Nov-2008	01-Jul-2013	1702
02/03/2008	02mr08ae	25-Jul-2008	02-Jul-2013	1803
20/08/2008	20au08ac	16-Sep-2008	02-Jul-2013	1750
03/03/2008	03mr08aa	06-May-2008	03-Jul-2013	1884

from which it very much appears that we did go round for a second look.
ID: 1471685 · Report as offensive
Filipe

Send message
Joined: 12 Aug 00
Posts: 218
Credit: 21,281,677
RAC: 20
Portugal
Message 1471688 - Posted: 1 Feb 2014, 19:39:50 UTC
Last modified: 1 Feb 2014, 19:40:14 UTC

Don´t forget that multibeam recorder was only introduced in 2007!

Which,on best case scenario, record 14 times the amout of the old receiver.


Meaning the data from 2000 to 2006 is really not much data for our current processing capabilities.
ID: 1471688 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1471694 - Posted: 1 Feb 2014, 20:14:33 UTC - in response to Message 1471685.  

from which it very much appears that we did go round for a second look.

I pretty much suspected that's what was happening. It had more or less been hinted that it might happen, but I don't think it was ever confirmed that that's what they were actually doing.

I certainly understood the benefit of running old files through AP, especially since that was a separate app from MB. And applying the new autocorrelation search to the old MB files made a lot of sense, too. What I was wondering about, though, was whether it was also necessary to redo all the other signal processing (spikes, pulses, triplets, gaussians) just to add the autocorrelation stuff or whether perhaps those old tapes could have been reprocessed more efficiently by a separate, stand-alone "autocorrelation-only" app and just having the "all-in-one" v7 MB app process "new" data. Anybody know if that sort of approach was ever considered?
ID: 1471694 · Report as offensive
1 · 2 · 3 · Next

Message boards : Number crunching : Arecibo telescope closed by earthquake - no new data for a while


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.