Tinkertoys (Jun 04 2009)

Message boards : Technical News : Tinkertoys (Jun 04 2009)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 903751 - Posted: 4 Jun 2009, 22:27:11 UTC

A day full of troubleshooting. Still trying to get one of these Intel servers up - everything in the system works except the hardware RAID. We got the new drives in the mail today, but still can't get into the RAID bios. We do have a card we know works in another Intel server which we'll swap in sometime but we're tabling this project in general for now...

That's because Dan and a bunch of the CASPAR students are down at Arecibo to install their new SERENDIP V data recorder. They'd like to test it while they are there, of course, which means comparing its functionality with our recorder, as well as do some observations of the Crab Nebula to run through Astropulse, etc. What does that mean for us? That means we really need to get our SETI@home data recorder SATA drives/enclosures working. They have been off line for well over a month now, but now that we have our own people with immediate access to the machine it's speeding up the debugging process. Still, there are plenty of mysteries that seem impossible to figure out. Jeff's frustration with SATA/USB/drivers/linux is palpable coming all the way from the other side of the room. In fact I just heard him tell the gang down there to install a new OS on the system (the current OS is ancient, and quite possibly the source of our woes).

Meanwhile Jeff and I are continue to tinker with NTPCkr stuff. I've been trying to optimize the NTPCkr page, finding that it spends most of its time parsing the XML of the zillion multiplets (groups of similar signals) within each candidate. So at this late hour we may change how we divide the multiplets up into "barycentric" (tight in frequency space) and "non-barycentric" and just score them according to frequency tightness. This may not only yield far less multiplets, but they may be ranked better as far as how interesting they are. There's gonna be more tweaking/testing on that front.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 903751 · Report as offensive
Fred W
Volunteer tester

Send message
Joined: 13 Jun 99
Posts: 2524
Credit: 11,954,210
RAC: 0
United Kingdom
Message 903780 - Posted: 5 Jun 2009, 0:03:49 UTC

Matt: Thanks, as ever, for the update. The time you spend putting these pieces together is well justified, believe me.
This may be completely off the wall but the phrase "parsing XML" set alarm bells ringing with me. A couple of years ago I was using script to migrate XML data files between financial systems and using standard programming language to do this took over 3 days to process the file (well, actually, there were 14 max size Excel sheets of data). Using XSLT to do the same thing brought the whole process down to less than an hour. Just wondering if you are using transformation where appropriate - or it may not be appropriate at all and me talking out of the fundamental orifice?

F.
ID: 903780 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 903943 - Posted: 5 Jun 2009, 13:07:30 UTC


. . . Thanks for the Updates Matt - All shall go as planned [obviously]

> as in Zen: looking @ the most complex issue - one turns about & looks @ it in the most simplistic

and, there lies the answer . . .

All @ Berkeley - Enjoy Your Weekend . . .


BOINC Wiki . . .

Science Status Page . . .
ID: 903943 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 20084
Credit: 7,508,002
RAC: 20
United Kingdom
Message 905162 - Posted: 8 Jun 2009, 12:24:41 UTC - in response to Message 903751.  

... Jeff's frustration with SATA/USB/drivers/linux is palpable coming all the way from the other side of the room. In fact I just heard him tell the gang down there to install a new OS on the system (the current OS is ancient, and quite possibly the source of our woes). ...

Quite possibly and hopefully so... The USB subsystem has seen various changes before it settled.

Possibly an alternative... Use eSATA enclosures? You can get 4 bay hotswap enclosures for perhaps $200 or less including a PCIe eSATA controller (excluding the sata drives).

Good luck for getting the data flowing oncemore!

Regards,
Martin

See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 905162 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 905261 - Posted: 8 Jun 2009, 18:01:43 UTC - in response to Message 905162.  

... Jeff's frustration with SATA/USB/drivers/linux is palpable coming all the way from the other side of the room. In fact I just heard him tell the gang down there to install a new OS on the system (the current OS is ancient, and quite possibly the source of our woes). ...

Quite possibly and hopefully so... The USB subsystem has seen various changes before it settled.

Possibly an alternative... Use eSATA enclosures? You can get 4 bay hotswap enclosures for perhaps $200 or less including a PCIe eSATA controller (excluding the sata drives).

Good luck for getting the data flowing oncemore!

Regards,
Martin

I will agree, however, most enterprise server boards support hotswap on the onboard controllers, so all you would need is a US$5 PCI bracket that turns onboard SATA into an eSATA port.

However, the only problem with that if you use a multi-bay enclosure is that it has a port multiplier inside, and you need the host controller to be able to support port multipliers.

I lucked out with my server board since one of the SATA controllers was a SiI3132, which supports port multipliers on a hardware level, so no special drivers are needed. I'm using a 5-bay trayless enclosure with that setup and it is working beautifully. I have almost 3Tb in that external box presently.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 905261 · Report as offensive
Profile Francis Noel
Avatar

Send message
Joined: 30 Aug 05
Posts: 452
Credit: 142,832,523
RAC: 94
Canada
Message 905423 - Posted: 9 Jun 2009, 5:00:06 UTC

Tinkertoys...
I had those. They came in a cylinder.
Amazingly they are still being made today pretty much with the same materials and still come in a cylinder. I'm definitely getting some for my kid.
mambo
ID: 905423 · Report as offensive

Message boards : Technical News : Tinkertoys (Jun 04 2009)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.