I'm Here (Sep 18 2012)

Message boards : Technical News : I'm Here (Sep 18 2012)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 1285216 - Posted: 18 Sep 2012, 21:12:27 UTC

Sorry I've was away for a while there then once again fallen out of the habit of making regular tech news reports. Then again it's a sign of some stability here that I haven't had that much to say.

Lately I've been largely working on this random noise data file (10ja10zz). We recently encountered more issues with how results are being reported - nothing we can't fix - but in order to recalibrate everything we felt the need to see what would happen when straight up random noise enters the system.

So I created this bogus file and it already passed through the system a couple times using the standard splitter and the new polyphase filter bank splitter (which creates workunits with a flatter frequency response). We have several more tests to do, so expect another pass or two (or ten) of this file.

A word about the name "10ja10zz" - as many of you know the naming convention for these tapes are DDMMYYNN where DD is the day of the month, MM is a two character abbreviation of the month, YY is the two digit year, and NN is the sequence "number" for that day, i.e. we start with "aa" then "ab" then "ac" etc. Usually we never get past something like "aj." I wanted to create a bogus name that fit in with this format. To make it easier I wanted the day-of-month and year to match, and "01" would make sense but "01" isn't really a valid value for multibeam format files (which this is, and multibeam started in '06) so I just flipped it and made it "10" for both. I picked "ja" for January as that seemed easy enough, and then "zz" as that's the last possible sequence "number" and highly unlikely. It was only after the fact that somebody pointed out to me that the "ja" in January and the bogus "zz" spell "jazz." So we've been since calling this the "jazz" file.

Meanwhile we have gotten a new switch in the closet - a nice Foundry X448 - once again donated by the GPU User's Group. We've been slowly physically moving things around to make room for this switch (in a logical place in the racks) and today I got a few servers plugged into it, including the web server. That means these very bits you are reading right now went through that switch.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1285216 · Report as offensive
Profile Jim_S
Avatar

Send message
Joined: 23 Feb 00
Posts: 4705
Credit: 64,560,357
RAC: 31
United States
Message 1285222 - Posted: 18 Sep 2012, 21:20:25 UTC

Thanks for the Updates Matt...Glad that things seem to be going well.

I Desire Peace and Justice, Jim Scott (Mod-Ret.)
ID: 1285222 · Report as offensive
.clair.

Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 55,390,408
RAC: 69
United Kingdom
Message 1285226 - Posted: 18 Sep 2012, 21:27:18 UTC

Very pleased to hear the new switch is in,
it will be interesting to see what happens.
ID: 1285226 · Report as offensive
Swibby Bear

Send message
Joined: 1 Aug 01
Posts: 246
Credit: 7,945,093
RAC: 0
United States
Message 1285362 - Posted: 19 Sep 2012, 5:49:03 UTC - in response to Message 1285226.  
Last modified: 19 Sep 2012, 5:51:35 UTC

...it will be interesting to see what happens.


Probably nothing will happen that we can see. The transfer speeds in the closet will pick up a "bit", or a lot, but we'll never see a difference, other than just a continuing smooth flow of data.

The thing we really would make a big difference that we could see would be if the coveted giga-pipe to the internet ever comes to pass. Now, that would be sweet. And hey, we need it now just to feed Multi-Beam and Astropulse work units simultaneously. If/when new applications from Green Bank or other sources are added to the mix, the current pipe is simply inadequate.

My 2 cents from a non-professional point of view.

Whit
ID: 1285362 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1285370 - Posted: 19 Sep 2012, 5:56:40 UTC
Last modified: 19 Sep 2012, 5:56:58 UTC

Thanks for the news bits, Matt.
As you said, in a way it's good that you didn't feel you HAD to post too much news, but the kitties and others are always happy to get your insights on what goes on behind the servers.

Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1285370 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1285398 - Posted: 19 Sep 2012, 7:43:26 UTC - in response to Message 1285370.  

Well I don't think that the new switch is doing very well ATM as the site and the pipeline is so slow that people would think that there are piles of AP's being being sent out but that is not the case at all. :(

Cheers.
ID: 1285398 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 1285535 - Posted: 19 Sep 2012, 16:45:51 UTC

The recently installed switch I'm mentioning is entirely internal to the server closet, and has nothing to do with workunits/results going in and out of the building.

So this new switch is working great. As mentioned elsewhere you probably won't notice much of a difference, except for maybe less of the very occasional internal network log jams that hamper workunit production and result upload i/o. What we gain is more ports, more internal throughput (for data analysis), more manageability, and much needed redundancy.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 1285535 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1285536 - Posted: 19 Sep 2012, 16:49:52 UTC - in response to Message 1285535.  

Thanks for the update Matt,

Claggy
ID: 1285536 · Report as offensive
Earendil's Star

Send message
Joined: 1 Jun 03
Posts: 13
Credit: 6,542,706
RAC: 0
Zimbabwe
Message 1288712 - Posted: 28 Sep 2012, 7:06:04 UTC

Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...

SETI IS BROKEN
AT LEAST IN ZIMBABWE.
ID: 1288712 · Report as offensive
Earendil's Star

Send message
Joined: 1 Jun 03
Posts: 13
Credit: 6,542,706
RAC: 0
Zimbabwe
Message 1288716 - Posted: 28 Sep 2012, 7:22:43 UTC

No problem downloading Einstein W/Us.

I think you guys should have some sort of system in place
that gives a level of download/upload preference to those who contribute the most to the project.

Hey wow, one of my Seti w/u's started to download at 0.62KB/s!

Einstein chugging along merrily @ 22kb/s.

Oh no, sorry, false alarm...

Downloading pending project back offf.........

Maybe if I stick at this all day I will get 5 W/Us for the weekend!

Yippeeee.



ID: 1288716 · Report as offensive
Rolf

Send message
Joined: 16 Jun 09
Posts: 114
Credit: 7,817,146
RAC: 0
Switzerland
Message 1288768 - Posted: 28 Sep 2012, 11:09:44 UTC - in response to Message 1288712.  

Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...
Downloading pending project back off...
Uploading pending project back off...

SETI IS BROKEN
AT LEAST IN ZIMBABWE.


Similar messages here in Switzerland!
ID: 1288768 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1288918 - Posted: 28 Sep 2012, 17:17:22 UTC

There is a "Number Crunching" forum where you can ask questions if you are having problems.

Some people are reporting problems, but personally I have full caches on two machines and the third one is just downloading 42 WU's to fill its cache. So it is not affecting everyone.
ID: 1288918 · Report as offensive
ChrisSibbald

Send message
Joined: 23 Jul 11
Posts: 18
Credit: 23,582,502
RAC: 0
Canada
Message 1288986 - Posted: 28 Sep 2012, 19:21:23 UTC - in response to Message 1288918.  

Well, if you have full caches you are lucky

I did post in number crunchibg but that hasn't helped

I cannot get enough GPU work.
Cheers
Chris
ID: 1288986 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9549
Credit: 3,308,926
RAC: 2
United States
Message 1289023 - Posted: 28 Sep 2012, 20:46:56 UTC

There are different issues that can cause the problems most are experiencing. It could be the download/upload servers are hiccuping, shorty work units clogging the pipe, astropulse work is being split so that will plug the pipe. SETI@HOME is running on a shoe string budget, barely able to pay the couple of guys that are still in the lab that try to keep things together. They are doing the best they can with what they have. We have a bunch of folks that have been kicking in different equipment and money to the GPU USER group, which has in turn sent that to SETI. This project simply relies on donors at this point, they don't get much outside help anymore, grant money is quickly fading, or non-existant. Be part of the solution and help. Visit the Number Crunching forums, donate money or equipment, thats the only way this project is going to keep growing and running.
ID: 1289023 · Report as offensive

Message boards : Technical News : I'm Here (Sep 18 2012)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.