Back and Forth (Oct 28 2009)

Message boards : Technical News : Back and Forth (Oct 28 2009)
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 943458 - Posted: 28 Oct 2009, 22:43:56 UTC

Jeff is back in town and back in action here at the lab. He's now working on the NTPCkr/RFI stuff (which has been languishing due to lack of effort and the science database throughput woes which I've been alluding to lately).

As predicted, I did finally get the astropulse version of the splitter to compile (just some library/linking bugs that had to be hunted down and exterminated). So astropulse workunits using the software radar blanking system are going out! Meanwhile, I hit some more management snags with the multibeam stuff - I'm trying to blank/split really old files which we recorded before we had all the kinks worked out. Long story short, some files I spent a lot of time (days) pulling up from our archives and doing the first stages of radar analysis are unsplittable. Darn. I was hoping to just get beyond the dearth of data in the nick of time, but it looks like I got to pull more files up from the archives, and we'll run a bit dry before they are splittable.

Today is a particularly windy day, which means it's fairly clear. Here's a picture taken from my iPhone looking out from the lab patio onto the Bay. That the Lawrence Hall of science directly below me, then downtown Berkeley, then the Bay itself, then San Francisco, the Golden Gate Bridge, and the Marin Headlands in the distance. The detail isn't so great, so you can't see that the Bay Bridge is completely devoid of cars right now (it's shut down due to technically difficulties), which is quite rare and quite odd.



- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 943458 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 943463 - Posted: 28 Oct 2009, 23:02:49 UTC - in response to Message 943458.  

Thanks for the update Matt,

Claggy
ID: 943463 · Report as offensive
Profile LiliKrist
Volunteer tester
Avatar

Send message
Joined: 12 Aug 09
Posts: 333
Credit: 143,167
RAC: 0
Indonesia
Message 943469 - Posted: 28 Oct 2009, 23:20:56 UTC

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...


N = R x fp x ne x fl x fi x fc x L
ID: 943469 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30608
Credit: 53,134,872
RAC: 32
United States
Message 943475 - Posted: 28 Oct 2009, 23:51:11 UTC - in response to Message 943469.  

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...

Golden Gate, Right side about 1/3 way from edge between the two land masses at water line, you can see the two towers that hold the suspension cables.

Thanks for the update.

Hope they can get the Bay Bridge mess sorted out. Not good when multi ton parts fall off the emergency repair job of a couple months ago.

ID: 943475 · Report as offensive
Profile LiliKrist
Volunteer tester
Avatar

Send message
Joined: 12 Aug 09
Posts: 333
Credit: 143,167
RAC: 0
Indonesia
Message 943508 - Posted: 29 Oct 2009, 2:00:37 UTC - in response to Message 943475.  

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...

Golden Gate, Right side about 1/3 way from edge between the two land masses at water line, you can see the two towers that hold the suspension cables.


Thanks Gary for the guide =) yup...I see the bridge, and the Bay Bridge too =)




N = R x fp x ne x fl x fi x fc x L
ID: 943508 · Report as offensive
Profile 52 Aces
Avatar

Send message
Joined: 7 Jan 02
Posts: 497
Credit: 14,261,068
RAC: 67
United States
Message 943518 - Posted: 29 Oct 2009, 2:45:53 UTC - in response to Message 943458.  

Thx Matt,

Unless I'm misunderstanding, the blanking process basically gives us a second crunch run of 7 months of data from 2006 and 4 months of data from 2007.

So my question is, once we've run thru those tapes (which might not take all that long given present burn rates), do these new software blanking functions have future uses (since Arecibo is presently hardware blanked). ex: Can you use this in a modified form to re-purpose other kinds of data feeds from other radio telescopes?

PS: Feel free to give a quick Cpt Pike response, one iPhone pic for Yes, two iPhone pics for no.

ID: 943518 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 943636 - Posted: 29 Oct 2009, 17:00:50 UTC - in response to Message 943518.  

The current burn rate is roughly 2-3 "tapes" a day (really files but we still call them tapes too), and we have about 500 of these to send through the software blanker pipeline (some already processed, i.e. a "second crunch" like you state).

Meanwhile, ALFA will be back on line next week, so we'll have plenty of data again to chew on before too long - it's just low now as ALFA has been off for a month and the software blanker pipeline is slow to get revved up.

Nevertheless, we'll probably just software blank *ALL* data from now on as it seems like it works a lot better. I should really optimize the algorithm - it's way too slow now and I know I can speed it up. But to answer your question we may want to publish this somehow to other Arecibo-related projects as it cleans up a bunch of garbage the hardware blanker misses.

Unless I'm misunderstanding, the blanking process basically gives us a second crunch run of 7 months of data from 2006 and 4 months of data from 2007.

So my question is, once we've run thru those tapes (which might not take all that long given present burn rates), do these new software blanking functions have future uses (since Arecibo is presently hardware blanked). ex: Can you use this in a modified form to re-purpose other kinds of data feeds from other radio telescopes?


- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 943636 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 943643 - Posted: 29 Oct 2009, 17:55:28 UTC - in response to Message 943636.  

always good news Matt. I see you've got some more newly blanked WUs running in the system. I haven't got one yet but it's good to see them coming out. Hopefully it will be enough to hold us over till ALFA gets up and running again.

I bet any other Arecibo-related projects will eat this software up. It should be really great for any type of project running their data. Good luck on the optimizing, we need as much work as you can throw at us. :-)


PROUD MEMBER OF Team Starfire World BOINC
ID: 943643 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30608
Credit: 53,134,872
RAC: 32
United States
Message 943660 - Posted: 29 Oct 2009, 19:38:45 UTC - in response to Message 943636.  

But to answer your question we may want to publish this somehow to other Arecibo-related projects as it cleans up a bunch of garbage the hardware blanker misses.

The question is, do you give it free or charge for it and perhaps get the development cost back?

ID: 943660 · Report as offensive
Profile 52 Aces
Avatar

Send message
Joined: 7 Jan 02
Posts: 497
Credit: 14,261,068
RAC: 67
United States
Message 943688 - Posted: 29 Oct 2009, 21:26:56 UTC - in response to Message 943660.  
Last modified: 29 Oct 2009, 21:27:41 UTC

free or charge


It would be free (w/proper credit to the dev), just the way the community works.

If we got charged back for reasonable costs of piggy backing at Arecibo, S@H would have shuttered years ago. Plus, if this helps clean up some other science, then that science won't need to re-survey thus S@H likely benefits indirectly by a greater variety of sky points).

I was kind of hoping other radio telescopes had similar blanking woes thus we could get welcome invitations to meaningfully sized sites (ie: Russia's Ratan-600 or the under-construction Chinese FAST).
ID: 943688 · Report as offensive
Profile Jon Golding
Avatar

Send message
Joined: 20 Apr 00
Posts: 105
Credit: 841,861
RAC: 0
United Kingdom
Message 943698 - Posted: 29 Oct 2009, 22:03:07 UTC - in response to Message 943688.  

I was kind of hoping other radio telescopes had similar blanking woes thus we could get welcome invitations to meaningfully sized sites (ie: Russia's Ratan-600 or the under-construction Chinese FAST).

Especially nice if these telescopes can see parts of the sky that Aricebo can't, and the scientists involved reciprocated by agreeing to ship some of their blanked data to Berkeley for splitting into WUs (for appropriately modified client apps).
ID: 943698 · Report as offensive
Profile Johnney Guinness
Volunteer tester
Avatar

Send message
Joined: 11 Sep 06
Posts: 3093
Credit: 2,652,287
RAC: 0
Ireland
Message 943720 - Posted: 29 Oct 2009, 23:13:43 UTC

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.
ID: 943720 · Report as offensive
Sonny Matic

Send message
Joined: 27 Mar 00
Posts: 2
Credit: 4,970,485
RAC: 0
Serbia
Message 943725 - Posted: 29 Oct 2009, 23:25:34 UTC

I Would Like to Help Project

I would like to help your project, I have a very fast unlimited traffic DSL2 connection and ive just upgraded all my hardware. how can I help.

my username is Sonny Matic

ID: 943725 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19012
Credit: 40,757,560
RAC: 67
United Kingdom
Message 943819 - Posted: 30 Oct 2009, 8:04:57 UTC - in response to Message 943720.  

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.

There are a few more pictures of the surrounding area in photo albums on the http://setiathome.berkeley.edu/sah_photos.php page. Plus others of the crew working hard.
ID: 943819 · Report as offensive
Profile Johnney Guinness
Volunteer tester
Avatar

Send message
Joined: 11 Sep 06
Posts: 3093
Credit: 2,652,287
RAC: 0
Ireland
Message 943948 - Posted: 30 Oct 2009, 22:12:05 UTC - in response to Message 943819.  

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.

There are a few more pictures of the surrounding area in photo albums on the http://setiathome.berkeley.edu/sah_photos.php page. Plus others of the crew working hard.

WinterKnight,
There are some great pictures in the SETI@home photo album, i look at them from time to time. Incredible view from that hill in Berkeley.

John.

ID: 943948 · Report as offensive
Dudeman

Send message
Joined: 29 Oct 06
Posts: 1
Credit: 3,010,920
RAC: 0
United States
Message 944139 - Posted: 31 Oct 2009, 5:40:53 UTC

You forgot to mention the Sutro Tower.
ID: 944139 · Report as offensive
Profile I C U Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 4 Apr 07
Posts: 5
Credit: 277,443
RAC: 0
Canada
Message 944526 - Posted: 2 Nov 2009, 1:39:53 UTC

Incredible picture of SF, thanks for posting it.

Someone mentioned other projects also using Arecibo. Einstien@home also uses Arecibo too as one example. I'd guess there are other projects too.
I never thought about that...
Do you swap tapes with each other (bigger pool), everyone use the same tape data (for different purposes), or are they just different (everyone has their own separate tape data).
ID: 944526 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 944549 - Posted: 2 Nov 2009, 4:32:39 UTC - in response to Message 944526.  

Incredible picture of SF, thanks for posting it.

Someone mentioned other projects also using Arecibo. Einstien@home also uses Arecibo too as one example. I'd guess there are other projects too.
I never thought about that...
Do you swap tapes with each other (bigger pool), everyone use the same tape data (for different purposes), or are they just different (everyone has their own separate tape data).

I believe that the data is coming from different receivers near the main antenna focus. It is also likely that the data is formatted differently.


BOINC WIKI
ID: 944549 · Report as offensive
P. J. Crabtree

Send message
Joined: 17 Jan 07
Posts: 22
Credit: 1,847,766
RAC: 0
United States
Message 944564 - Posted: 2 Nov 2009, 5:38:48 UTC

Where is Government Island in the picture ( If in frame)?
ID: 944564 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30608
Credit: 53,134,872
RAC: 32
United States
Message 944572 - Posted: 2 Nov 2009, 6:54:43 UTC - in response to Message 944564.  

Where is Government Island in the picture ( If in frame)?


I don't promise the labels are right, but it should orient anyone.
ID: 944572 · Report as offensive
1 · 2 · Next

Message boards : Technical News : Back and Forth (Oct 28 2009)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.