On the Farm (Feb 03 2010)


log in

Advanced search

Message boards : Technical News : On the Farm (Feb 03 2010)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 967981 - Posted: 3 Feb 2010, 23:42:45 UTC

Nothing major to report, hence the lack of updates. We had our usual weekly outage yesterday for mysql maintenance. During that threw a newly compiled transitioner and scheduler into beta containing various bug fixes. The recovery was fine, though it's hard to tell as the network graphs (which are hosted by central campus, not us) seem to be broken at the moment.

We're actually having server closet temperature issues again as well. So I spent a chunk of time going around to various servers and implementing "sensors" to get more temperature data - want to make sure we're not being misled by a single server with a broken fan or something. Should have done this a while ago, but I can say that about pretty much everything I'm working on.

The science database is having a bit of a headache, mostly due to some extra Astropulse related analysis queries above and beyond the usual set of splitters/assimilators hitting the thing. We had to give it a kick an hour ago, and it recovered just fine (mostly since that kick killed the analysis query hogging all the i/o). We really need to improve this part of our server farm - when the NTPCkr is fully operational the science database is going to need all the juice it can get!

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4097
Credit: 33,050,118
RAC: 8,036
United Kingdom
Message 967982 - Posted: 3 Feb 2010, 23:49:04 UTC - in response to Message 967981.

Thanks for the update Matt.

Claggy

ront
Send message
Joined: 25 Aug 01
Posts: 77
Credit: 386,336
RAC: 0
United States
Message 968006 - Posted: 4 Feb 2010, 2:07:03 UTC

Thanks Matt

Question - Are the "astropulse" generally available to us yet? Would love to get some.

Thanks!


ront
____________

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 8644
Credit: 24,139,874
RAC: 21,491
United Kingdom
Message 968033 - Posted: 4 Feb 2010, 5:49:26 UTC - in response to Message 968006.

Thanks Matt

Question - Are the "astropulse" generally available to us yet? Would love to get some.

Thanks!


ront

They are available but only in the ratio of about, Enhanced Multibeam 40:1 Astropulse 505.

Therefore at any one time the download server only has a max of three AP tasks available. This means most of the heavy hitters have only seen a few, if any, since AP was switched back on last week.

ront
Send message
Joined: 25 Aug 01
Posts: 77
Credit: 386,336
RAC: 0
United States
Message 968116 - Posted: 4 Feb 2010, 18:18:14 UTC - in response to Message 968033.

Thanks for your response.

Will this improve in the forseeable future?

ront
____________

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 8644
Credit: 24,139,874
RAC: 21,491
United Kingdom
Message 968119 - Posted: 4 Feb 2010, 18:31:25 UTC - in response to Message 968116.

Thanks for your response.

Will this improve in the forseeable future?

ront

If and when the bandwidth of Berkeley's connection is increased, then it may be. But at the moment trying to get more 8MByte downloads to us just cloggs up the connection and we all suffer.

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24520
Credit: 521,562
RAC: 92
United States
Message 968155 - Posted: 4 Feb 2010, 22:20:26 UTC - in response to Message 968119.

Thanks for your response.

Will this improve in the forseeable future?

ront

If and when the bandwidth of Berkeley's connection is increased, then it may be. But at the moment trying to get more 8MByte downloads to us just cloggs up the connection and we all suffer.

If I recall, they are produced in a ratio of about 40:1 from the same tape.
____________


BOINC WIKI

1mp0£173
Volunteer tester
Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 968173 - Posted: 5 Feb 2010, 1:02:47 UTC - in response to Message 968116.

Thanks for your response.

Will this improve in the forseeable future?

ront

My understanding matches JM7's.

Multibeam is a narrowband search, and therefore slices nicely into nice small work units.

Astropulse is a broadband search, so the work units have to have a lot more data in them -- but once you search one, you've covered that whole slice of recorded time.

That's why there is a 40:1 ratio.
____________

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 8644
Credit: 24,139,874
RAC: 21,491
United Kingdom
Message 968177 - Posted: 5 Feb 2010, 1:36:01 UTC - in response to Message 968155.

Thanks for your response.

Will this improve in the forseeable future?

ront

If and when the bandwidth of Berkeley's connection is increased, then it may be. But at the moment trying to get more 8MByte downloads to us just cloggs up the connection and we all suffer.

If I recall, they are produced in a ratio of about 40:1 from the same tape.

What did I say in post 968033?

John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24520
Credit: 521,562
RAC: 92
United States
Message 968191 - Posted: 5 Feb 2010, 3:11:04 UTC - in response to Message 968177.

Thanks for your response.

Will this improve in the forseeable future?

ront

If and when the bandwidth of Berkeley's connection is increased, then it may be. But at the moment trying to get more 8MByte downloads to us just cloggs up the connection and we all suffer.

If I recall, they are produced in a ratio of about 40:1 from the same tape.

What did I say in post 968033?

You did not say why the ratio was there. You did say that they were given out in that ratio though.
____________


BOINC WIKI

1mp0£173
Volunteer tester
Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 968311 - Posted: 5 Feb 2010, 17:27:43 UTC - in response to Message 968177.
Last modified: 5 Feb 2010, 17:29:11 UTC

Thanks for your response.

Will this improve in the forseeable future?

ront

If and when the bandwidth of Berkeley's connection is increased, then it may be. But at the moment trying to get more 8MByte downloads to us just cloggs up the connection and we all suffer.

If I recall, they are produced in a ratio of about 40:1 from the same tape.

What did I say in post 968033?

What John said.

The fact that we don't get as much Astropulse as some would like is well established.

The idea that there is an "organic" reason (that it isn't really possible to make more) is important too.

Edit: it's also interesting that people talk about the science on one hand, and then complain about things like "not enough AP" which is a direct result of the science itself.
____________

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 8644
Credit: 24,139,874
RAC: 21,491
United Kingdom
Message 968314 - Posted: 5 Feb 2010, 17:53:50 UTC

I was under the impression that if the bandwidth was greater, that old data that has been processed with the enhanced MB app already, could be resurrected and put through the AP splitter using the s/ware filter. Including the data we have recently used when AP was switched off.
And in that case the organic reason of the 8 MByte and 350 KByte sizes would not apply.

1mp0£173
Volunteer tester
Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 968452 - Posted: 5 Feb 2010, 22:40:14 UTC - in response to Message 968314.

I was under the impression that if the bandwidth was greater, that old data that has been processed with the enhanced MB app already, could be resurrected and put through the AP splitter using the s/ware filter. Including the data we have recently used when AP was switched off.
And in that case the organic reason of the 8 MByte and 350 KByte sizes would not apply.

... and it's been my understanding that without the radar blanking signal the older data wasn't that useful.

But hey, we're all out here in the peanut gallery. We'll all see what happens, won't we. :-)
____________

Message boards : Technical News : On the Farm (Feb 03 2010)

Copyright © 2014 University of California