All in the timing

Message boards : Nebula : All in the timing
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile David Anderson
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 13 Feb 99
Posts: 173
Credit: 502,653
RAC: 0
Message 2017828 - Posted: 4 Nov 2019, 21:42:16 UTC

Signal times and multiplet scores

The biggest issue recently involves timing: specifically, how the times of the signals in a multiplet should affect the multiplet's score.

Dan W. observed that many of the high-scoring multiplets in recent scoring runs consist of two signals separated by a second or less. These could be ET, and we don't want to discard them completely. But SETI@home is designed to find faint "beacons": transmitters that are constantly on, and for which we'd expect to find signals spanning years (assuming that the sky location is one that we've observed repeatedly).

One of our scientific goals is to quantify the sensitivity of the SETI@home "instrument" by seeing whether we detect birdies with various powers and other parameters. By "detect" we mean that a multiplet with signals from that birdie is in the top-scoring 1000 (or so) multiplets. If the multiplet list is clogged with these 2-signal multiplets, it will interfere with our sensitivity estimates.

Our first attempt at dealing with this issue was to add a "time factor" to multiplet scores, penalizing multiplets whose signals were clumped together in time. I won't describe this in detail because I never fully understood it (Eric came up with the formula). In any case, we eventually decided that it wasn't doing what we wanted.

Then we went to something simpler: penalize multiplets whose time range (i.e. the time from first signal to last signal) is less than 60 seconds. That got rid of the 1-second multiplets, but now there were a lot of high-scoring 65-second multiplets.

As a stop-gap measure, I got rid of the time factor in scoring, and changed the web interface so you can specify limits on time range; e.g. you can look at the high-scoring multiplets with time range at least a day, or a year.

I think that to address this issue we'll need to have a time factor that takes into account observation time. A 1-second multiplet shouldn't be penalized if we observed that sky position for only 1 second. But if we observed it for hours, over a period of years, then it should not have a high score.

Drifting RFI and birdies

I noticed that some birdies were having most of their signals flagged as RFI. Some amount of removal is normal - e.g., if a birdie's frequency range happens to overlap an RFI "zone". But I was seeing a lot of removal by the drifting algorithm. In some cases the algorithm was being too aggressive. Specifically, the signals in one of the triangular "bins" were clumped at one or two times, rather than being spread out over the bin's time range, as we'd expect for drifting RFI. Here's an example:



To address this, I refined the drifting algorithm so that it computes the time entropy of the signals in each bin, and flags bins only if this entropy is above a threshold. This seems to work in some but not all cases. More work is needed.


Web interface additions

I added some things to the web interface:

  • "Mega waterfall plots" that show the spikes in a birdie (or in a multiplet, or in both) over their entire time and frequency range. This makes it easy to check whether a birdie multiplet contains as many signals as it should. These plots can be accessed via "plot" links on birdie and multiplet pages.
  • The option to display waterfall plots with period (for pulses and triplets) and delay (for autocorrs) rather than frequency. This is useful because a group of pulses can be from the same source only if their periods are similar.
  • The ability to bookmark birdies.
  • Links from multiplet pages to birdie pages.

ID: 2017828 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30981
Credit: 53,134,872
RAC: 32
United States
Message 2017839 - Posted: 4 Nov 2019, 23:07:05 UTC - in response to Message 2017828.  

David:

I hope your changes would not reject an old style CW Morse code like signal which would essentially be a narrow band switched beacon, the switching carrying the data. Or perhaps a civilization using a planetary radar as we do where the signal is narrow band short pulses that the galactic medium will transform. That I know will be a tough one as we have to reject our own radar signals. Depending on the receiver you might have some luck looking at the rise and fall times. Our signals should be much quicker rise and fall were as a signal that has traveled some light years will have a much slower rise and fall but otherwise be identical.

Gary
ID: 2017839 · Report as offensive
Falken
Volunteer tester

Send message
Joined: 18 May 99
Posts: 21
Credit: 1,457,137
RAC: 4
United Kingdom
Message 2017922 - Posted: 5 Nov 2019, 21:44:17 UTC - in response to Message 2017828.  

What the hell is a Birdie ?
ID: 2017922 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 36613
Credit: 261,360,520
RAC: 489
Australia
Message 2017925 - Posted: 5 Nov 2019, 22:08:21 UTC - in response to Message 2017922.  

What the hell is a Birdie ?
Birdies. ;-)

Cheers.
ID: 2017925 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30981
Credit: 53,134,872
RAC: 32
United States
Message 2017934 - Posted: 5 Nov 2019, 23:01:02 UTC - in response to Message 2017925.  

What the hell is a Birdie ?
Birdies. ;-).

Or more properly http://www.naic.edu/~phil/rfi/rfilist.html
ID: 2017934 · Report as offensive
Profile Eliovich Alexander & Yan

Send message
Joined: 25 May 99
Posts: 5
Credit: 35,925,567
RAC: 300
Spain
Message 2020503 - Posted: 25 Nov 2019, 14:57:47 UTC
Last modified: 25 Nov 2019, 15:08:06 UTC

1) How to join to Nebula?

2) Perhaps it is better to use a neural network for very fast reliable RFI removal?
ID: 2020503 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22504
Credit: 416,307,556
RAC: 380
United Kingdom
Message 2020505 - Posted: 25 Nov 2019, 15:31:57 UTC - in response to Message 2020503.  

Nebula is not a project that we can join in the same we we join SETI@Home, for more information I suggest you read the various papers and posts by Dr Anderson:
https://setiathome.berkeley.edu/nebula_web/
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 2020505 · Report as offensive

Message boards : Nebula : All in the timing


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.