SETI data distribution history

Message boards : Number crunching : SETI data distribution history
Message board moderation

To post messages, you must log in.

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483744 - Posted: 2 Mar 2014, 19:41:25 UTC

Users have been commenting that SETI's own Data Distribution History is no longer being updated. This thread will be my personal attempt to fill that gap.

I'm recording the 'tapes' which I've seen processed by MultiBeam (only) apps on my own machines. I'll post a snapshot of the tapes I'd seen by the end of each year, plus monthly updates from here on.

The colour coding will be:



The numbers in each cell are the number of distinct tapes (aa, ab, ...) I've seen for each day's Arecibo recordings.
ID: 1483744 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483750 - Posted: 2 Mar 2014, 19:44:37 UTC

December 31st, 2008 - effectively the start of the GPU revolution.

ID: 1483750 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483752 - Posted: 2 Mar 2014, 19:46:00 UTC

December 31st, 2009

ID: 1483752 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483753 - Posted: 2 Mar 2014, 19:47:30 UTC

December 31st, 2010



ID: 1483753 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483754 - Posted: 2 Mar 2014, 19:48:26 UTC

December 31st, 2011

ID: 1483754 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483755 - Posted: 2 Mar 2014, 19:49:36 UTC

December 31st, 2012

ID: 1483755 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1483757 - Posted: 2 Mar 2014, 19:52:05 UTC

December 31st, 2013



ID: 1483757 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1534436 - Posted: 1 Jul 2014, 11:41:48 UTC

Sorry I didn't do one of these last month, but May and June were almost entirely spent re-processing old tapes from 2008 and 2009.

No point in posting those, so here's a summary of what we achieved in the first half of the year (January-June 2014 inclusive):



That's 361 new tapes in all, of which just a handful were tapes from earlier years that I hadn't seen before.

A reminder of the chart explanation, from the initial post in this thread:



The numbers in each cell are the number of distinct tapes (aa, ab, ...) I've seen for each day's Arecibo recordings.
ID: 1534436 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1565676 - Posted: 1 Sep 2014, 10:36:09 UTC

I haven't forgotten about the data distribution history, but we've been exclusively re-processing the old tapes for several months now.

For the record, we've now looked again at some 1086 old tapes so far this year.

ID: 1565676 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1596517 - Posted: 3 Nov 2014, 17:33:33 UTC

We have some new data to report! These new tapes were processed during October 2014.



76 new tapes in all. There were a few final resends from earlier years too, but most new tapes were from this year.
ID: 1596517 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1608119 - Posted: 2 Dec 2014, 12:05:17 UTC

Well, we managed to get through some new data during November.



I've added all the tapes currently shown on the SSP (131 new tapes in all), even though many of them are so short that there is little or no crunchable data on them. The full chart shows that the lab house-keeping has turned up data from every year since the multibeam antenna and recorder came into full use in January 2007.
ID: 1608119 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1621848 - Posted: 1 Jan 2015, 18:03:07 UTC

Final tally for 2014. The disks Jeff received on 5 December (~5 TB of data) turned out to be 97 new 'tapes':



None of the earlier tapes from 2012 and 2013 which showed up at the end were 'new', according to my database - we must have processed them before. Perhaps the staff wanted to re-check the MB processing - we certainly got MB tasks from them - but decided not to repeat the AP runs.
ID: 1621848 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1707287 - Posted: 1 Aug 2015, 10:33:16 UTC

With the new data from Arecibo that Jeff threw into the hopper on 23 June, it's time to pick up this thread again.



That's 113 new tapes so far, and counting.

Since it's been a while, a reminder of what I'm displaying. These are Multibeam tasks, processed so far on my machines and recorded in my SETI logs. Because I'm only recording MB, and only completed tasks, I run a little way behind the splitters - there will be at least 50 more tapes to report next month, and perhaps we'll fill in some of those gaps as well.

And here's a reminder of the colour coding.

ID: 1707287 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1720906 - Posted: 1 Sep 2015, 11:59:15 UTC

117 'first time seen' tapes this month - 78 in Jeff's June shipment from Arecibo, and a scattering from 2008 onwards which have turned up as part of the ongoing reprocessing. I thought we might see some from the March-April gap, but evidently not.

ID: 1720906 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1730658 - Posted: 1 Oct 2015, 15:25:30 UTC

No addition to the Data Distribution History charts this month. All except two of the 2011 tapes (one each from 05oc and 23no) were in my database already - though I can't tell if we possibly crunched new areas from other tapes, which might have had an error the first time round.
ID: 1730658 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1761853 - Posted: 3 Feb 2016, 10:14:27 UTC

In the middle of the v8 excitment, we almost forgot about the arrival of a new shipment of tapes from Arecibo:



Here's a reminder of the colour coding.

ID: 1761853 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1768817 - Posted: 1 Mar 2016, 13:35:49 UTC

The 2015 recordings aren't finished yet - 76 new ones processed this month.

ID: 1768817 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1775571 - Posted: 1 Apr 2016, 15:41:33 UTC

But they are now - only 19 left to do after last month.

ID: 1775571 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1937911 - Posted: 1 Jun 2018, 11:44:29 UTC

Well, now Photobucket has given me my images back, we've finished reprocessing all the old work, and it's the first of the month, it's time to restart this project.

Picking up where we left off:


That shows what we've done since 1st January 2018 - some big blocks of VLARs held back from 2016 and 2017. We now have a slow-but-steady throttled internet link from Arecibo, replacing the old boxes of disks shipped by air-freight, so we're almost processing in real time. I'd prefer it if the Puerto Ricans had more help in repairing their own power lines (and water supplies, come to that) before the start of the new hurricane season today, but at least I hope we're not making things worse for them.
ID: 1937911 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12347
Credit: 127,007,782
RAC: 36,391
United Kingdom
Message 1947713 - Posted: 3 Aug 2018, 15:36:52 UTC

Since I have at least one reader, here are the Arecibo tapes for June and July 2018.

ID: 1947713 · Report as offensive

Message boards : Number crunching : SETI data distribution history


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.