What's new about SETI@home v7

Message boards : SETI@home Staff Blog : What's new about SETI@home v7
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 5 · Next

AuthorMessage
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1379579 - Posted: 10 Jun 2013, 21:04:38 UTC
Last modified: 19 Jun 2013, 17:08:04 UTC

The easy things to describe are things to describe are the (conceptually, if not effort wise) small changes.

SETI@home v7 now supports the AVX instruction set used on Intel Sandybridge and later processors. That gives a significant speedup on those processors. For GPUs SETI@home enhanced used to support 3 different versions of CUDA, CUDA 2.2, CUDA 2.3, and CUDA 3, which we called cuda_fermi, because it was the only version that would run on Fermi and later GPUs. Now we have 5 versions for NVIDIA GPUs (CUDA 2.2, CUDA 2.3, CUDA 3.2, CUDA 4.2 and CUDA 5.0) under windows, two versions for AMD/ATI GPUs under windows, and two versions for AMD/ATI GPUs under linux.

Don't be surprised if you get more than one of these early on. We can tell that CUDA 2.2 and 2.3 won't run on Fermi and later cards, but we can't tell, for example, if CUDA 3.2 will be faster than CUDA 4.2 on your card. So we'll be sending you some of each in order to see which is faster. The server was supposed to be doing this all along, but there was a bug in it that I only discovered a few weeks ago. If you think the server is behaving incorrectly, let me know. There may be further bugs to squash.

The big deal, and it is a big deal, is something known as autocorrelation. Now autocorrelation isn't a new thing. It's been in the radio astronomer's tool box for a long time. In fact the original SERENDIP was an analog autocorrelator. What's different is the way we're using it.

Autocorrelation is different than the standard FFT in that the FFT looks for sine waves. That makes it great for looking for signals that have very narrow bandwidth, because anything with narrow bandwidth looks like a sine wave. But once you put information into a transmission, its bandwidth gets wider and it looks less like a sine wave. The more information you add, the wider the bandwidth and harder it is to detect using an FFT.

Autocorrelation, on the other hand, looks for anything that looks like itself. I know that doesn't make a lot of sense at first glance because everything looks like itself. And an autocorrelation will tell you that if you didn't already know it. But it will also tell you if the same signal waveform shows up half a second later.

Why is that important? One way an ET civilization could send a signal that contains information, but is still easily detectable would be to send a signal, and then send exactly the same signal delayed by a small amount of time (say half a second). You could pack in a lot of information, and the signal would still be easily detected using autocorrelation. Theoretically, its nearly as sensitive to wide band signals as the FFT is to narrow band signals, and it only uses a little bit more than twice the computation.

No, this wasn't my idea, although I wish it was. Autocorrelation was brought back to the forefront of our minds by Gerry Harp, the current Director of SETI at the SETI Institute.
@SETIEric@qoto.org (Mastodon)

ID: 1379579 · Report as offensive
ExchangeMan
Volunteer tester

Send message
Joined: 9 Jan 00
Posts: 115
Credit: 157,719,104
RAC: 0
United States
Message 1379621 - Posted: 10 Jun 2013, 23:36:58 UTC - in response to Message 1379579.  

The easy things to describe are things to describe are the small changes.

SETI@home v7 now supports the AVX instruction set used on Intel Sandybridge and later processors. That gives a significant speedup on those processors. For GPUs SETI@home enhanced used to support 3 different versions of CUDA, CUDA 2.2, CUDA 2.3, and CUDA 3, which we called cuda_fermi, because it was the only version that would run on Fermi and later GPUs. Now we have 5 versions for NVIDIA GPUs (CUDA 2.2, CUDA 2.3, CUDA 3.2, CUDA 4.2 and CUDA 5.0) under windows, two versions for AMD/ATI GPUs under windows, and two versions for AMD/ATI GPUs under

Don't be surprised if you get more than one of these early on. We can tell that CUDA 2.2 and 2.3 won't run on Rermi and later cards, but we can't tell, for example, if CUDA 3.2 will be faster than CUDA 4.2 on your card. So we'll be sending you some of each in order to see which is faster. The server was supposed to be doing this all along, but there was a bug in it that I only discovered a few weeks ago. If you think the server is behaving incorrectly, let me know. There may be further bugs to squash.

The big deal, and it is a big deal, is something known as autocorrelation. Now autocorrelation isn't a new thing.

If's been in the radio astronomer's tool box for a long time. In fact the original SERENDIP was an analog autocorrelator. What's different is the way we're using it.

Autocorrelation is different than the standard FFT in that the FFT looks for sine waves. That makes it great for looking for signals that have very narrow bandwidth, because anything with narrow bandwidth looks like a sine wave. But once you put information into a transmission, its bandwidth gets wider and it looks less like a sine wave. The more information you add, the wider the bandwidth and harder it is to detect using an FFT.

Autocorrelation, on the other hand, looks for anything that looks like itself. I know that doesn't make a lot of sense at first glance because everything looks like itself. And an autocorrelation will tell you that if you didn't already know it. But it will also tell you if the same signal waveform shows up half a second later.

Why is that important? One way an ET civilization could send a signal that contains information, but is still easily detectable would be to send a signal, and then send exactly the same signal delayed by a small amount of time (say half a second). You could pack in a lot of information, and the signal would still be easily detected using autocorrelation. Theoretically, its nearly as sensitive to wide band signals as the FFT is to narrow band signals, and it only uses a little bit more than twice the computation.

No, this wasn't my idea, although I wish it was. Autocorrelation was brought back to the forefront of our minds by Gerry Harp, the current Director of SETI at the SETI Institute.

Thanks Eric for the explanation. I do have 1 question and please forgive my ignorance if it sounds stupid. Is the autocorrelation running throughout the duration of processing the work unit file or does it occur at the end of processing? I've noticed that many, if not all work units seem to start out moving at a slow rate and speed up as percentage completed increases. I can't recall whether this also occurred with V6 seti.

ID: 1379621 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1379637 - Posted: 11 Jun 2013, 0:36:57 UTC - in response to Message 1379621.  
Last modified: 11 Jun 2013, 0:40:35 UTC

Good question, and good observing.

The autocorrelation runs throughout the processing, whenever we are working at the finest spectral resolution (0.075 Hz which is an FFT length of 128k points.) Those transforms are not performed at every Doppler drift rate, but are concentrated on the low Doppler drift rate. (<30 Hz/s) So that does result in increased processing for the first third of the result. In theory the progress bar is supposed to be adjusted for that, but the adjustment isn't nearly as good as it could be.

That's what we do for now anyway. Depending on how clean the results are of interference, we may expand them to cover the full range. But we don't want to do that until we're sure the probably less interesting results won't swamp the more interesting ones.
@SETIEric@qoto.org (Mastodon)

ID: 1379637 · Report as offensive
TauSigma
Avatar

Send message
Joined: 15 May 99
Posts: 1
Credit: 7,393,814
RAC: 0
Niue
Message 1379707 - Posted: 11 Jun 2013, 6:01:59 UTC

I have a question, too. How comes that AstroPulse is still on V6?
ID: 1379707 · Report as offensive
HireMe.geek.nz
Volunteer tester

Send message
Joined: 22 May 99
Posts: 29
Credit: 286,765
RAC: 0
New Zealand
Message 1379708 - Posted: 11 Jun 2013, 6:08:47 UTC - in response to Message 1379637.  
Last modified: 11 Jun 2013, 6:19:33 UTC

Why is that important? One way an ET civilization could send a signal that contains information, but is still easily detectable would be to send a signal, and then send exactly the same signal delayed by a small amount of time (say half a second).


You could pack in a lot of information, and the signal would still be easily detected using autocorrelation. Theoretically, its nearly as sensitive to wide band signals as the FFT is to narrow band signals, and it only uses a little bit more than twice the computation.


So, in TELECOMMUNICATIONS ENGINEERING terms Autocorralation detects Error Correction by time delay dispersion.

I am involved with a telecommunications project myself that involves Morse Code and RTTY.

If any of the readers of this thread are Java programmers, feel free to ask me to join the project as it is in need of programmers.

I hope to in future use Voyager type Error Correction.

-- http://sourceforge.net/projects/codegroup/
ID: 1379708 · Report as offensive
Thomas
Volunteer tester

Send message
Joined: 9 Dec 11
Posts: 1499
Credit: 1,345,576
RAC: 0
France
Message 1379733 - Posted: 11 Jun 2013, 7:19:45 UTC - in response to Message 1379579.  

Thanks so much Eric for the heads-up that everyone looked forward to.
I'm trying to write a statement in french for my team about it.
Not easy to popularize these ideas ! ;)
I have a small question : does the processing units work focuses exclusively on the detection of a signal using the autocorrelation ?
ID: 1379733 · Report as offensive
Profile Jon connell

Send message
Joined: 21 Mar 00
Posts: 6
Credit: 15,708,730
RAC: 26
United States
Message 1379734 - Posted: 11 Jun 2013, 7:21:06 UTC - in response to Message 1379621.  

Many thanks for the update. I like the sound of the new detection function lots.
Over the years I have been concerned that we were perhaps searching in too narrow an envelope. ...The best we could do at the time of course. Volumes have been written about advanced compression algorithms and their impact on broadcast waveform. With this extension I suspect that you are looking in the right place.

Optimistically speaking, to date we may have been doing a good job searching only for what we expected - and doing so based on the past (and presumed future) 100 years or so of broadcast technology. Fingers crossed.
I hope the upgrade goes peacefully for you.

Thanks and keep up the good work.

Jon Connell, Brooklyn, NY
ID: 1379734 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1379736 - Posted: 11 Jun 2013, 7:32:55 UTC

Thank you very much, Eric.

Appreciate the explanation about the new Seti adventure...LOL.

Anything that you think provides better science or better chances of catching another WOW signal is quite alright by me.

The kitties are with you all the way.

Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1379736 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1379783 - Posted: 11 Jun 2013, 9:04:13 UTC - in response to Message 1379733.  


I have a small question : does the processing units work focuses exclusively on the detection of a signal using the autocorrelation ?

Autocorrelation search added along with already existed ones.
There are 4 types of search in v6 and now 5 in v7.


SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1379783 · Report as offensive
Thomas
Volunteer tester

Send message
Joined: 9 Dec 11
Posts: 1499
Credit: 1,345,576
RAC: 0
France
Message 1379789 - Posted: 11 Jun 2013, 9:14:44 UTC - in response to Message 1379783.  

Autocorrelation search added along with already existed ones.
There are 4 types of search in v6 and now 5 in v7.

Thanks so much Raistmer ! :)
ID: 1379789 · Report as offensive
Profile Adam Weichel

Send message
Joined: 30 Jul 02
Posts: 22
Credit: 25,877,509
RAC: 46
Canada
Message 1379844 - Posted: 11 Jun 2013, 11:51:14 UTC

I love getting new toys! :)

Thanks for the heads-up, Eric.

I'm planning on getting a GeForce Titan this summer to throw into the mix, both for gaming and DC purposes. Can't wait to see how it does with CUDA units.

And as mentioned above, congrats on cracking 20M!


Adam
Computer nut, Distributed Computing freak, Jeeper and Dodge Ram driver.

Life is worth living... and worth discovering.

I run VMWare ESXi Free - why don't you?
ID: 1379844 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1379864 - Posted: 11 Jun 2013, 12:49:48 UTC - in response to Message 1379707.  

I have a question, too. How comes that AstroPulse is still on V6?


The version numbers in SETI@home and AstroPulse aren't synchronized either to each other or to BOINC. It's mainly an accident that SETI@home and BOINC have the same major version.

But that does raise the question about why we haven't put autocorrelation in AstroPulse. It's not that I haven't thought about it, it's that I haven't finished thinking about it. A signal from an extraterrestrial civilization is chirped by accelerations, dispersed by interstellar gas and then chirped again by the Earth's accelerations. In SETI@home the signals are so narrow that the chirps are additive and the dispersion is essentially zero. For astropulse the signals are so wide that the chirping doesn't matter. For autocorrelation you don't really know how wide the signal is so you need to dedisperse and dechirp, which means you need to do N times as much work, where N is the number of Doppler drift rates you compute. So I need to think about whether its possible to get N down to a manageable number.
@SETIEric@qoto.org (Mastodon)

ID: 1379864 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1379873 - Posted: 11 Jun 2013, 13:24:06 UTC - in response to Message 1379864.  

The version numbers in SETI@home and AstroPulse aren't synchronized either to each other or to BOINC. It's mainly an accident that SETI@home and BOINC have the same major version.

Yeah, I was about to request that a next update does a double check at what the BOINC version of the time is and then do a different version number. If BOINC 8, make Seti v13. That way all of the easily confused won't be so confused. :)
ID: 1379873 · Report as offensive
charles

Send message
Joined: 6 Apr 12
Posts: 1
Credit: 1,037,943
RAC: 0
United States
Message 1379889 - Posted: 11 Jun 2013, 14:06:46 UTC - in response to Message 1379579.  

Hi My computer crashes and restarts after 3 min. running seti@home 7.2 on my screen saver I have a FX 8150 AMD processor,ATI 6950 video card and 16gb. of 2133 running at 1866 ram windows 8 pro my processor was running very hot when the screen saver would come on and shut off so I installed a very large heat sink and fans and the temp. decreased about 25deg. went from 68.c to 38.c I would like to run program but forced to opt out.Thank You
ID: 1379889 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1379908 - Posted: 11 Jun 2013, 14:57:39 UTC - in response to Message 1379889.  

Hi My computer crashes and restarts after 3 min. running seti@home 7.2 on my screen saver I have a FX 8150 AMD processor,ATI 6950 video card and 16gb. of 2133 running at 1866 ram windows 8 pro my processor was running very hot when the screen saver would come on and shut off so I installed a very large heat sink and fans and the temp. decreased about 25deg. went from 68.c to 38.c I would like to run program but forced to opt out.Thank You

Charles, check in the Number Crunching Forum, there are folks who hang out there that are much better at helping diagnose and solve hardware problems than most of us who read this section.
Donald
Infernal Optimist / Submariner, retired
ID: 1379908 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1639
Credit: 12,921,799
RAC: 89
New Zealand
Message 1380094 - Posted: 12 Jun 2013, 1:22:33 UTC

Hi Eric, thanks for letting us know what is going on with the new application version. I have one question. Sometime ago Matt said that the run time the work units was going to be extended. I have noticed the average work unit on my 660 TI is running around 18 minutes was was this the intention with version 7 or was this a pleasant side-effect, are there still claims to pack more than one job into a task?
ID: 1380094 · Report as offensive
Profile Borgholio
Avatar

Send message
Joined: 2 Aug 99
Posts: 654
Credit: 18,623,738
RAC: 45
United States
Message 1380118 - Posted: 12 Jun 2013, 3:51:34 UTC

Thanks for the heads up! Question about the future of SETI@home, if you have a moment.

Every so often a new version of S@H comes out with increased sensitivity or a new type of search. Wouldn't it be easier to simply release a version of S@H that has it's sensitivity cranked up to the limits of the sensitivity of Arecibo, rather than ratcheting it up every couple years?
You will be assimilated...bunghole!

ID: 1380118 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1380126 - Posted: 12 Jun 2013, 4:42:57 UTC - in response to Message 1380094.  

Sometime ago Matt said that the run time the work units was going to be extended. I have noticed the average work unit on my 660 TI is running around 18 minutes was was this the intention with version 7 or was this a pleasant side-effect, are there still claims to pack more than one job into a task?


Hi Speedy,

There used to be a four processor DEC VAX-6000 with that name at the University of Wisconsin. It was impressively fast in 1988, but most peoples' cell phones could probably outrun it now. :)

The longer run time is a side effect of the autocorrelation. The longer term plan was to increase the size of workunits to keep the number of request on our server down to a reasonable value. The move to the colocation facility seems to have helped somewhat, so there less pressure to do that at this point.

But when it comes to the Kepler/GBT observations workunits, a larger size and run time is unavoidable. So we are working on that development as rapidly as we can.
@SETIEric@qoto.org (Mastodon)

ID: 1380126 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1380129 - Posted: 12 Jun 2013, 5:08:17 UTC - in response to Message 1380118.  
Last modified: 12 Jun 2013, 5:09:28 UTC

Wouldn't it be easier to simply release a version of S@H that has it's sensitivity cranked up to the limits of the sensitivity of Arecibo, rather than ratcheting it up every couple years?


In most cases we can alter the signal threshold by changing parameters in the work unit without releasing a new version. For example, we could do the autocorrelation out to 100Hz/s or change the autocorrelation detection threshold without releasing a new version. That sort of change wasn't possible for a lot of parameters in the early versions of SETI@home.

Most of the recent versions have been to add new analyses and signal types (pulses, triplets, autocorrelation) or to change how the analysis is done (optimizations for specific instruction sets and bug fixes for problems that reduced our sensitivity) or to add new types of applications (GPU, android). In the cases where a new version improved sensitivity it's probably because there was a bug in the way we were performing the analysis.

But the real reason that changes to the science take a couple years rather than a couple months is manpower related. Even simple changes like autocorrelation take long time for me to test and deploy because I can't devote a large fraction of my time to it.

There is a sensitivity boost we got recently by changing the data splitter on the server side to use a different algorithm to generate the workunits. Nobody expect the people who watch the server status page probably noticed the change.

We are close to the limits of what Arecibo can provide for us with this data recorder. There's really only a couple knobs left to turn. In theory, I was considering those knobs when I was writing SETI@home enhanced and no changes should be required if those knobs are turned. But if I made a mistake, we may never turn them. By the time I got it fixed we might have a new and better data recorder (cough, SERENDIP VI, cough) capable of recording much wider bandwidth on every receiver Arecibo and GBT have. But that's a different story.
@SETIEric@qoto.org (Mastodon)

ID: 1380129 · Report as offensive
Greg Ruffell

Send message
Joined: 14 Oct 02
Posts: 3
Credit: 11,920,265
RAC: 0
Canada
Message 1380144 - Posted: 12 Jun 2013, 6:29:51 UTC - in response to Message 1379579.  

After updating SETI app to Boinc 7.0.65 at the end of May, the app wouldn't run any more due to an issue with AstroPulse. I removed Astropulse from my settings June 5 and it started working again but MUCH slower. For example, previously my daily host average was showing about 7600 but it is now starting to level off about 4200.

Any thoughts on why it's so much slower?
ID: 1380144 · Report as offensive
1 · 2 · 3 · 4 . . . 5 · Next

Message boards : SETI@home Staff Blog : What's new about SETI@home v7


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.