Back and Forth (Oct 28 2009)


log in

Advanced search

Message boards : Technical News : Back and Forth (Oct 28 2009)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1391
Credit: 74,079
RAC: 10
United States
Message 943458 - Posted: 28 Oct 2009, 22:43:56 UTC

Jeff is back in town and back in action here at the lab. He's now working on the NTPCkr/RFI stuff (which has been languishing due to lack of effort and the science database throughput woes which I've been alluding to lately).

As predicted, I did finally get the astropulse version of the splitter to compile (just some library/linking bugs that had to be hunted down and exterminated). So astropulse workunits using the software radar blanking system are going out! Meanwhile, I hit some more management snags with the multibeam stuff - I'm trying to blank/split really old files which we recorded before we had all the kinks worked out. Long story short, some files I spent a lot of time (days) pulling up from our archives and doing the first stages of radar analysis are unsplittable. Darn. I was hoping to just get beyond the dearth of data in the nick of time, but it looks like I got to pull more files up from the archives, and we'll run a bit dry before they are splittable.

Today is a particularly windy day, which means it's fairly clear. Here's a picture taken from my iPhone looking out from the lab patio onto the Bay. That the Lawrence Hall of science directly below me, then downtown Berkeley, then the Bay itself, then San Francisco, the Golden Gate Bridge, and the Marin Headlands in the distance. The detail isn't so great, so you can't see that the Bay Bridge is completely devoid of cars right now (it's shut down due to technically difficulties), which is quite rare and quite odd.



- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4251
Credit: 34,991,477
RAC: 20,742
United Kingdom
Message 943463 - Posted: 28 Oct 2009, 23:02:49 UTC - in response to Message 943458.

Thanks for the update Matt,

Claggy
____________


Profile LiliKrist
Volunteer tester
Avatar
Send message
Joined: 12 Aug 09
Posts: 333
Credit: 143,167
RAC: 0
Indonesia
Message 943469 - Posted: 28 Oct 2009, 23:20:56 UTC

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...
____________


N = R x fp x ne x fl x fi x fc x L

Profile Gary CharpentierProject donor
Volunteer tester
Avatar
Send message
Joined: 25 Dec 00
Posts: 13205
Credit: 7,984,040
RAC: 16,200
United States
Message 943475 - Posted: 28 Oct 2009, 23:51:11 UTC - in response to Message 943469.

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...

Golden Gate, Right side about 1/3 way from edge between the two land masses at water line, you can see the two towers that hold the suspension cables.

Thanks for the update.

Hope they can get the Bay Bridge mess sorted out. Not good when multi ton parts fall off the emergency repair job of a couple months ago.

____________

Profile LiliKrist
Volunteer tester
Avatar
Send message
Joined: 12 Aug 09
Posts: 333
Credit: 143,167
RAC: 0
Indonesia
Message 943508 - Posted: 29 Oct 2009, 2:00:37 UTC - in response to Message 943475.

thank you for update Master Matt and welcome back Master Jeff. Btw...nice pic =) but where is Golden Gate? Can't see it...

Golden Gate, Right side about 1/3 way from edge between the two land masses at water line, you can see the two towers that hold the suspension cables.


Thanks Gary for the guide =) yup...I see the bridge, and the Bay Bridge too =)


____________


N = R x fp x ne x fl x fi x fc x L

Profile 52 AcesProject donor
Avatar
Send message
Joined: 7 Jan 02
Posts: 497
Credit: 13,347,416
RAC: 111
United States
Message 943518 - Posted: 29 Oct 2009, 2:45:53 UTC - in response to Message 943458.

Thx Matt,

Unless I'm misunderstanding, the blanking process basically gives us a second crunch run of 7 months of data from 2006 and 4 months of data from 2007.

So my question is, once we've run thru those tapes (which might not take all that long given present burn rates), do these new software blanking functions have future uses (since Arecibo is presently hardware blanked). ex: Can you use this in a modified form to re-purpose other kinds of data feeds from other radio telescopes?

PS: Feel free to give a quick Cpt Pike response, one iPhone pic for Yes, two iPhone pics for no.

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1391
Credit: 74,079
RAC: 10
United States
Message 943636 - Posted: 29 Oct 2009, 17:00:50 UTC - in response to Message 943518.

The current burn rate is roughly 2-3 "tapes" a day (really files but we still call them tapes too), and we have about 500 of these to send through the software blanker pipeline (some already processed, i.e. a "second crunch" like you state).

Meanwhile, ALFA will be back on line next week, so we'll have plenty of data again to chew on before too long - it's just low now as ALFA has been off for a month and the software blanker pipeline is slow to get revved up.

Nevertheless, we'll probably just software blank *ALL* data from now on as it seems like it works a lot better. I should really optimize the algorithm - it's way too slow now and I know I can speed it up. But to answer your question we may want to publish this somehow to other Arecibo-related projects as it cleans up a bunch of garbage the hardware blanker misses.

Unless I'm misunderstanding, the blanking process basically gives us a second crunch run of 7 months of data from 2006 and 4 months of data from 2007.

So my question is, once we've run thru those tapes (which might not take all that long given present burn rates), do these new software blanking functions have future uses (since Arecibo is presently hardware blanked). ex: Can you use this in a modified form to re-purpose other kinds of data feeds from other radio telescopes?


- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile perryjay
Volunteer tester
Avatar
Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 16,404,012
RAC: 9,648
United States
Message 943643 - Posted: 29 Oct 2009, 17:55:28 UTC - in response to Message 943636.

always good news Matt. I see you've got some more newly blanked WUs running in the system. I haven't got one yet but it's good to see them coming out. Hopefully it will be enough to hold us over till ALFA gets up and running again.

I bet any other Arecibo-related projects will eat this software up. It should be really great for any type of project running their data. Good luck on the optimizing, we need as much work as you can throw at us. :-)
____________


PROUD MEMBER OF Team Starfire World BOINC

Profile Gary CharpentierProject donor
Volunteer tester
Avatar
Send message
Joined: 25 Dec 00
Posts: 13205
Credit: 7,984,040
RAC: 16,200
United States
Message 943660 - Posted: 29 Oct 2009, 19:38:45 UTC - in response to Message 943636.

But to answer your question we may want to publish this somehow to other Arecibo-related projects as it cleans up a bunch of garbage the hardware blanker misses.

The question is, do you give it free or charge for it and perhaps get the development cost back?

____________

Profile 52 AcesProject donor
Avatar
Send message
Joined: 7 Jan 02
Posts: 497
Credit: 13,347,416
RAC: 111
United States
Message 943688 - Posted: 29 Oct 2009, 21:26:56 UTC - in response to Message 943660.
Last modified: 29 Oct 2009, 21:27:41 UTC

free or charge


It would be free (w/proper credit to the dev), just the way the community works.

If we got charged back for reasonable costs of piggy backing at Arecibo, S@H would have shuttered years ago. Plus, if this helps clean up some other science, then that science won't need to re-survey thus S@H likely benefits indirectly by a greater variety of sky points).

I was kind of hoping other radio telescopes had similar blanking woes thus we could get welcome invitations to meaningfully sized sites (ie: Russia's Ratan-600 or the under-construction Chinese FAST).

Profile Jon Golding
Avatar
Send message
Joined: 20 Apr 00
Posts: 56
Credit: 365,460
RAC: 1
United Kingdom
Message 943698 - Posted: 29 Oct 2009, 22:03:07 UTC - in response to Message 943688.

I was kind of hoping other radio telescopes had similar blanking woes thus we could get welcome invitations to meaningfully sized sites (ie: Russia's Ratan-600 or the under-construction Chinese FAST).

Especially nice if these telescopes can see parts of the sky that Aricebo can't, and the scientists involved reciprocated by agreeing to ship some of their blanked data to Berkeley for splitting into WUs (for appropriately modified client apps).
____________

Profile Johnney Guinness
Volunteer tester
Avatar
Send message
Joined: 11 Sep 06
Posts: 3093
Credit: 2,651,836
RAC: 83
Ireland
Message 943720 - Posted: 29 Oct 2009, 23:13:43 UTC

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.
____________

Sonny Matic
Send message
Joined: 27 Mar 00
Posts: 2
Credit: 4,970,446
RAC: 0
Serbia
Message 943725 - Posted: 29 Oct 2009, 23:25:34 UTC

I Would Like to Help Project

I would like to help your project, I have a very fast unlimited traffic DSL2 connection and ive just upgraded all my hardware. how can I help.

my username is Sonny Matic

____________

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 8781
Credit: 25,972,273
RAC: 17,053
United Kingdom
Message 943819 - Posted: 30 Oct 2009, 8:04:57 UTC - in response to Message 943720.

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.

There are a few more pictures of the surrounding area in photo albums on the http://setiathome.berkeley.edu/sah_photos.php page. Plus others of the crew working hard.

Profile Johnney Guinness
Volunteer tester
Avatar
Send message
Joined: 11 Sep 06
Posts: 3093
Credit: 2,651,836
RAC: 83
Ireland
Message 943948 - Posted: 30 Oct 2009, 22:12:05 UTC - in response to Message 943819.

Its good to hear optimistic news about the radar blanking software working well. You worked hard on that, it was time well spent, well done Matt.

Matt you live in San Francisco and you probably take the city for granted. But to the rest of the world, San Francisco is a kinda magical place that we see all the time in Hollywood films and TV shows. So its just really cool to see cool photos of where you guys work in Berkeley. The view from the top of that hill is second to none. Wonderful picture Matt, thank you.

John.

There are a few more pictures of the surrounding area in photo albums on the http://setiathome.berkeley.edu/sah_photos.php page. Plus others of the crew working hard.

WinterKnight,
There are some great pictures in the SETI@home photo album, i look at them from time to time. Incredible view from that hill in Berkeley.

John.

____________

Dudeman
Send message
Joined: 29 Oct 06
Posts: 1
Credit: 3,010,876
RAC: 0
United States
Message 944139 - Posted: 31 Oct 2009, 5:40:53 UTC

You forgot to mention the Sutro Tower.

Profile I C U
Avatar
Send message
Joined: 4 Apr 07
Posts: 3
Credit: 141,209
RAC: 0
Canada
Message 944526 - Posted: 2 Nov 2009, 1:39:53 UTC

Incredible picture of SF, thanks for posting it.

Someone mentioned other projects also using Arecibo. Einstien@home also uses Arecibo too as one example. I'd guess there are other projects too.
I never thought about that...
Do you swap tapes with each other (bigger pool), everyone use the same tape data (for different purposes), or are they just different (everyone has their own separate tape data).

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 531,382
RAC: 345
United States
Message 944549 - Posted: 2 Nov 2009, 4:32:39 UTC - in response to Message 944526.

Incredible picture of SF, thanks for posting it.

Someone mentioned other projects also using Arecibo. Einstien@home also uses Arecibo too as one example. I'd guess there are other projects too.
I never thought about that...
Do you swap tapes with each other (bigger pool), everyone use the same tape data (for different purposes), or are they just different (everyone has their own separate tape data).

I believe that the data is coming from different receivers near the main antenna focus. It is also likely that the data is formatted differently.
____________


BOINC WIKI

P. J. Crabtree
Send message
Joined: 17 Jan 07
Posts: 20
Credit: 1,348,170
RAC: 1,654
United States
Message 944564 - Posted: 2 Nov 2009, 5:38:48 UTC

Where is Government Island in the picture ( If in frame)?

Profile Gary CharpentierProject donor
Volunteer tester
Avatar
Send message
Joined: 25 Dec 00
Posts: 13205
Credit: 7,984,040
RAC: 16,200
United States
Message 944572 - Posted: 2 Nov 2009, 6:54:43 UTC - in response to Message 944564.

Where is Government Island in the picture ( If in frame)?


I don't promise the labels are right, but it should orient anyone.
____________

1 · 2 · Next

Message boards : Technical News : Back and Forth (Oct 28 2009)

Copyright © 2014 University of California