Hard drive importance?

Message boards : Number crunching : Hard drive importance?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Alex

Send message
Joined: 9 Oct 00
Posts: 13
Credit: 3,766,221
RAC: 0
United States
Message 860976 - Posted: 2 Feb 2009, 3:32:46 UTC

Hi all, I can't seem to find much about this on the forums, so I thought I'd ask.

I'm looking to build a dedicated PC for SETI, and was wondering how important hard drive speed really is to the whole process. I know that BOINC caches some files to the drive, but if I put a slower drive in there (like, say, something as slow as a CF card), will I notice any difference in speed?
ID: 860976 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 860978 - Posted: 2 Feb 2009, 3:38:06 UTC - in response to Message 860976.  

Not much really. The hard drive is the least important aspect of the entire chain of performance as it relates to the SETI app. The most important is the CPU, then the L2 cache, then the RAM, then the hard drive.
ID: 860978 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 861009 - Posted: 2 Feb 2009, 6:29:53 UTC - in response to Message 860976.  

Hi all, I can't seem to find much about this on the forums, so I thought I'd ask.

I'm looking to build a dedicated PC for SETI, and was wondering how important hard drive speed really is to the whole process. I know that BOINC caches some files to the drive, but if I put a slower drive in there (like, say, something as slow as a CF card), will I notice any difference in speed?


As far as the actual processing of tasks the time is, as OzzFan says, is swamped by other factors. However, you will notice that the system as a whole will be more and more sluggish as the drive speed goes down.

FYI I have had drives from 5,400 to 15K in my systems and the run time of the tasks did not show any eyeball detectable difference. I am sure were I to have done a data search I could have found a difference, but it would likely have been in the seconds area for tasks that ran for more than a day ... minutes for those over a week and possibly as much as an hour for those that ran for several months.

Measurable, but hardly a killer.

I would only add a couple notes to his stream where CPU architecture and clock speed (newer architecture and faster speeds = better), L1, L2, and L3 cache size (speed is usually tied to system clock speed and is not independently controllable), RAM interleave (single channel, dual channel, tri-channel, etc. then architecture DDR2 vs DDR3 etc., then RAM speed), MB chipset and quality, then hard drive (bus speed/type then rotational speed, 5,400 worst, 7,200 good, 10K better, 15K best, but also hottest and most expensive)... Oh, and HDD cache is the same as CPU cache, bigger is better, but after 16M is not likely to show much difference ...

Then we have the GPU ... :)

If the computer is going to be a cruncher box you rarely need a drive bigger than 30-60G so you can trade size for higher speed. I got a 10K on sale for what a "normal" size 7,200 RPM drive would have cost ... still have 34G Free out of 40G HDD installed...

Of course I have my data files on a 2.38TB raid array so if you use the machine for other work, YMMV ...
ID: 861009 · Report as offensive
Profile Alex

Send message
Joined: 9 Oct 00
Posts: 13
Credit: 3,766,221
RAC: 0
United States
Message 861082 - Posted: 2 Feb 2009, 13:16:13 UTC

Ok, thanks for the responses! I'm mainly interested in ways to keep power consumption down (as down as a 24/7 cruncher can be, of course), and was toying with the idea of using a CF card or a USB stick as the hard drive because they have lower power draws.
ID: 861082 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 20265
Credit: 7,508,002
RAC: 20
United Kingdom
Message 861088 - Posted: 2 Feb 2009, 13:47:20 UTC - in response to Message 861082.  
Last modified: 2 Feb 2009, 13:48:21 UTC

Ok, thanks for the responses! I'm mainly interested in ways to keep power consumption down (as down as a 24/7 cruncher can be, of course), and was toying with the idea of using a CF card or a USB stick as the hard drive because they have lower power draws.

Very good summary from Paul there. And a good idea on going "diskless".

Best would be to get additional system RAM to max out whatever your motherboard (mainboard) can take (RAM is cheap!) and then use a RAM disk. Then set a scheduled task to copy the RAMdisk over to a USB memory stick say twice a day or so as a backup against power failure or Windows BSODs.

But then again... USB memory sticks are cheap enough and will last long enough (writes wear levelling) that they can almost be considered 'disposable'...

Do whichever you feel is the better, more interesting, or easier, whichever you wish.

(USB memory sticks have a limited number of writes, near infinte reads, and s@h writes state information out to disk every few seconds. Hence you can expect a USB memory stick to fail after a few months or so continuous use with s@h. Hence the RAMdisk idea to reduce USB memory wear.)


Happy fast crunchin',
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 861088 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 861116 - Posted: 2 Feb 2009, 15:50:31 UTC - in response to Message 861082.  

Ok, thanks for the responses! I'm mainly interested in ways to keep power consumption down (as down as a 24/7 cruncher can be, of course), and was toying with the idea of using a CF card or a USB stick as the hard drive because they have lower power draws.


If, for example, you add CUDA ... the draw of the disk drive is not even going to be noticeable ...
ID: 861116 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 861173 - Posted: 2 Feb 2009, 17:48:11 UTC - in response to Message 861082.  

Ok, thanks for the responses! I'm mainly interested in ways to keep power consumption down (as down as a 24/7 cruncher can be, of course), and was toying with the idea of using a CF card or a USB stick as the hard drive because they have lower power draws.

If you have enough RAM (so that the necessary parts of the OS all fit in RAM), including BOINC and the science application and data, then disk speed will be almost completely unimportant.

That said, a modern, fast (7200 rpm), 2.5" laptop SATA drive draws 3 watts or less. I haven't compared that to modern 3.5" drives, but I wouldn't be surprised to see that they're under 8 watts or so.

If you really want to save power, look to the CPU. If the CPU is using 90 watts, shaving a few watts off the hard drive consumption won't matter.
ID: 861173 · Report as offensive
Ianab
Volunteer tester

Send message
Joined: 11 Jun 08
Posts: 732
Credit: 20,635,586
RAC: 5
New Zealand
Message 861285 - Posted: 2 Feb 2009, 22:30:10 UTC

If it's a dedicated crunching box then any old disk thats big enough to hold the OS and work units will do the job fine. An old recycled 20gb from the spare parts box will work OK. The machine will take a few more seconds to boot and load big programs, but once it's running and crunching the disk has practically no effect.

An old 5400 rpm disk probably only draws 5 watts idling, compared to the 50-100 watts the CPU is sucking, it's nothing.

Extra ram also has little effect in a dedicated cruncher, as long as you have enough for the OS and Boinc tasks, then more doesn't help a lot. A normal PC, yes extra ram is good, on a dedicated cruncher, it's just not used for anything. Running the RAM as dual channel will give a small inprovement, so thats a good idea.

Graphics card, unless you are running CUDA, get a low power graphics card or use an integrated graphics chip. Using the onboard chip will use less power, but decrease performance sligthly. A dedicated card, a little more power, but no memory contention issues should increase performance a little. Even an old 2mb PCI graphics card would work, low power and moves the graphics ram off the system board.

But the CPU choice is the main thing, both for performance and power use. Everything else is just needed to keep the CPU running. So you can save $$ and power, and put that into a better CPU and you will get more bang for your buck.

Ian
ID: 861285 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 861314 - Posted: 2 Feb 2009, 23:11:26 UTC - in response to Message 861009.  

I would only add a couple notes to his stream ...


LOL I was actually going to type all that up - and indeed I did have it in the message box, but then I decided to keep it simple. Perhaps I should stay with my pedantic tendencies so that I keep accurate for everyone! :)
ID: 861314 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 861480 - Posted: 3 Feb 2009, 5:01:17 UTC - in response to Message 861314.  

I would only add a couple notes to his stream ...


LOL I was actually going to type all that up - and indeed I did have it in the message box, but then I decided to keep it simple. Perhaps I should stay with my pedantic tendencies so that I keep accurate for everyone! :)



Pedant, thats me ... :)

Plus the teacher bone ... or maybe bone head?

Anyway, when you are home and alone except for the two dogs and three GPU cards ... well, one starts to talk to the computer ... then you start to type too much ... and it is all downhill from there ...
ID: 861480 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 861483 - Posted: 3 Feb 2009, 5:06:32 UTC - in response to Message 861480.  

I would only add a couple notes to his stream ...


LOL I was actually going to type all that up - and indeed I did have it in the message box, but then I decided to keep it simple. Perhaps I should stay with my pedantic tendencies so that I keep accurate for everyone! :)



Pedant, thats me ... :)

Plus the teacher bone ... or maybe bone head?

Anyway, when you are home and alone except for the two dogs and three GPU cards ... well, one starts to talk to the computer ... then you start to type too much ... and it is all downhill from there ...

You are in trouble when you start having conversations with the computer.


BOINC WIKI
ID: 861483 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 861492 - Posted: 3 Feb 2009, 5:15:14 UTC - in response to Message 861483.  
Last modified: 3 Feb 2009, 5:15:30 UTC

You are in trouble when you start having conversations with the computer.


No, trouble is on the horizon when you start having arguments with the computers.

You are in trouble when you start to lose those arguments.
ID: 861492 · Report as offensive
Profile Fred J. Verster
Volunteer tester
Avatar

Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,903,643
RAC: 0
Netherlands
Message 861579 - Posted: 3 Feb 2009, 11:58:11 UTC - in response to Message 861492.  

You are in trouble when you start having conversations with the computer.


No, trouble is on the horizon when you start having arguments with the computers.

You are in trouble when you start to lose those arguments.


Or your computer is speech-driven, like these data-driven forum pages. ;^)

Just joking, though.

ID: 861579 · Report as offensive
Profile AlphaLaser
Volunteer tester

Send message
Joined: 6 Jul 03
Posts: 262
Credit: 4,430,487
RAC: 0
United States
Message 861999 - Posted: 4 Feb 2009, 20:28:43 UTC - in response to Message 861088.  

Ok, thanks for the responses! I'm mainly interested in ways to keep power consumption down (as down as a 24/7 cruncher can be, of course), and was toying with the idea of using a CF card or a USB stick as the hard drive because they have lower power draws.

Very good summary from Paul there. And a good idea on going "diskless".

Best would be to get additional system RAM to max out whatever your motherboard (mainboard) can take (RAM is cheap!) and then use a RAM disk. Then set a scheduled task to copy the RAMdisk over to a USB memory stick say twice a day or so as a backup against power failure or Windows BSODs.

But then again... USB memory sticks are cheap enough and will last long enough (writes wear levelling) that they can almost be considered 'disposable'...

Do whichever you feel is the better, more interesting, or easier, whichever you wish.

(USB memory sticks have a limited number of writes, near infinte reads, and s@h writes state information out to disk every few seconds. Hence you can expect a USB memory stick to fail after a few months or so continuous use with s@h. Hence the RAMdisk idea to reduce USB memory wear.)


Happy fast crunchin',
Martin


You can also adjust the 'write to disk every X seconds' parameter in the BOINC client, although AFAIK this affects the SETI client and not the BOINC daemon which writes its client state to disk fairly often.

ID: 861999 · Report as offensive
Profile Alex

Send message
Joined: 9 Oct 00
Posts: 13
Credit: 3,766,221
RAC: 0
United States
Message 862542 - Posted: 6 Feb 2009, 1:38:13 UTC

Ok, thanks for everyone's input. I'm going to try running the computer off of a 4GB flash drive for now, mainly because the spare hard drives I have are whiny and loud. Hopefully this will quiet it all up a bit, and save a little on power at the same time.

I'll post again if the drive dies in the next few months, but I hope it lasts at least a year to justify the cost and effort!
ID: 862542 · Report as offensive

Message boards : Number crunching : Hard drive importance?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.