New Octo GPU Cruncher build


log in

Advanced search

Message boards : Number crunching : New Octo GPU Cruncher build

1 · 2 · 3 · 4 . . . 9 · Next
Author Message
zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1242804 - Posted: 7 Jun 2012, 15:10:09 UTC

I've gotten an I7 940 2.93GHz cpu and an Rampage 3 Extreme x58 motherboard, the motherboard was tested with 8GB of G.Skill Ripjaws X DDR3 1333 ram. The current video cards pictured are really just for testing.

I've recently secured a case for the R3E, it's a used CoolerMaster HAF-X which I got for $119.99, it's being delivered by UPS as I speak. Of course Grace supervised the testing...
____________
My Facebook, War Commander, 2015

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1242805 - Posted: 7 Jun 2012, 15:10:48 UTC

Finally I know when My HAF-X case will get here by UPS, It'll be here on 6/13/2012. And yes the extra fans come with it.


____________
My Facebook, War Commander, 2015

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1242807 - Posted: 7 Jun 2012, 15:18:44 UTC

Now for the specs on this PC and My present PC, Parts that I have are in <> like so. Why am I using the 590 over the 690? Cost and such...

PC specs:
(Galactica)

<Coolermaster HAF-932 Case>,
<ASUS P7P55D Pro motherboard, Bios 2003>,
<i5-750 cpu @ 2.81GHz>,
1-EK-Supreme LTX CPU Waterblock - Intel,
1-EK-P7P55D Pro water block,
3-BitFenix Spectre Pro Blue 200mm 148cfm fans,
<16GB G.Skill Ripjaws X DDR3 1333 9-9-9-24-121-2T @ 1500.4MHz>,
16GB G.Skill DDR3 PC3-12800 1600MHz Ripjaws X Blue (9-9-9-24) 4x4GB 3-Dual Channel kits,
3-GTX590 cards<1>,
3-EK-FC590 GTX590 - Full Cover VGA Water-Block for Nvidia GTX590<I have 1 already>,
<XSPC X2O DC-750 - Dual 5.25" Bay-Res Pump/Reservoir Combo>,
<Coolgate 120x360 radiator>,
1-Phobya XTREME 200 Radiator Products Model: PH-35185 Radiator,
Bitpower Fittings(Not compression) to fit 1/2"ID Tubing,
2-DangerDen Black UV DreamFlex All-in-One "Retail Pack" - 1/2" ID Tubing Products Model: TUB-222B,
1-Enermax Gold 1350W PSU(replacement for the ST1500 below),
<1-DEMCiflex Magnetic Fan Dust Filter - Custom 4 Piece Set for CM HAF-932>,
<WD Scorpio Black 500GB hdd>,
<OCZ Rally2 4GB usb flash drive>,
<Optiarc AD-7170s DVD-/+R DL burner>,
<sata CD-rom drive>,
<Silverstone ST1500 1500W psu>,
<Windows 7 Premium x64(currently Pro x64 is running here)>.

(Pegasus)

<Coolermaster HAF-X Case>,
<Asus Rampage III Extreme motherboard>,
<i7-940 cpu @ 2.93GHz>,
<EK Red 1366 Cpu water block>,
1-EK-FB R3E water block,
4-BitFenix Spectre Pro Red 200mm 148cfm fans,
24GB G.Skill DDR3 PC3-12800 1600MHz Ripjaws X Red (9-9-9-24) 6x4GB 3-Dual Channel kits,
4-EVGA Classified 1596 or 1598 GTX590 cards,
4-XSPC Razor GTX590 - Full Cover VGA Water-Block for Nvidia GTX590,
1-XSPC X2O DC-750 - Dual 5.25" Bay-Res Pump/Reservoir Combo,
1-Phobya Xtreme 400 PH-35311 Radiator,
1-Phobya XTREME 200 PH-35185 Radiator,
Bitpower Fittings(Not compression) to fit 1/2"ID Tubing,
2-DangerDen Black UV DreamFlex All-in-One "Retail Pack" - 1/2" ID Tubing,
1-Enermax Lepa Gold 1600W PSU,
1-DEMCiflex Magnetic Fan Dust Filter - Custom 4 Piece Set for CM HAF-X,
1-WD Scorpio Black 500GB hdd,
<Sata DVD-Rom drive>,
<Windows 7 Pro x64>,
<LG W2053TX Monitor (1600x900)>,
Iogear Dual DVI-Monitor/usb/audio switcher.

____________
My Facebook, War Commander, 2015

Profile Fred J. Verster
Volunteer tester
Avatar
Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,895,140
RAC: 3,987
Netherlands
Message 1242863 - Posted: 7 Jun 2012, 16:42:47 UTC - in response to Message 1242807.

What can I say: Whaaaauww and we're gonna need data from yet another
radio-telescope ;-)

And maybe you can use the hot water to shower?!

All kidding aside, like to see the throughput or RAC. Very impressive, indeed.


____________

Profile Ex
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 12 Mar 12
Posts: 2895
Credit: 1,797,699
RAC: 1,325
United States
Message 1242876 - Posted: 7 Jun 2012, 16:50:36 UTC

What an addiction. ;-)

I'm jealous. It's been many years since I built a high-end performance rig.
____________
-Dave #2

3.2.0-33

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1243049 - Posted: 7 Jun 2012, 20:38:10 UTC
Last modified: 7 Jun 2012, 20:39:29 UTC

Thanks guys, Yeah in July I'm buying a 1350w Enermax psu for the Galactica and very little else. There won't be any major buying until October 2012 for a 1600w Lepa(Enermax is the OEM) psu for the Pegasus...
____________
My Facebook, War Commander, 2015

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1243052 - Posted: 7 Jun 2012, 20:41:21 UTC - in response to Message 1242863.

What can I say: Whaaaauww and we're gonna need data from yet another
radio-telescope ;-)

And maybe you can use the hot water to shower?!

All kidding aside, like to see the throughput or RAC. Very impressive, indeed.


About 50,000 per card as I don't use the cpu for crunching.
____________
My Facebook, War Commander, 2015

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1243057 - Posted: 7 Jun 2012, 20:57:26 UTC - in response to Message 1242876.

What an addiction. ;-)

I'm jealous. It's been many years since I built a high-end performance rig.

I don't have much else to do as I have lots of time on My hands, it's seti@home or tv or the net or food or the aquarium or saving up for a move into a house one day(maybe) or the car and I'm not a car guy and food can be a problem with My joints, just getting up to stand can be painful on My right knee, but I digress. It's not like I can go to Disneyland, I do like the house of the Mouse, but I don't really like going alone as it's usually a family outing, 3 women and 1 guy, plus I get to be the security guard for their stuff as the lockers are usually all rented out, plus they get good parking as I bring My placard along and Yes I've been on Space Mountain, once. Last time I had to use a Disney ECV to get around, better than having My Nieces push Me around in a wheelchair of course.
____________
My Facebook, War Commander, 2015

Profile Yanivicious
Avatar
Send message
Joined: 29 Mar 12
Posts: 157
Credit: 12,618,084
RAC: 7,677
United States
Message 1244534 - Posted: 10 Jun 2012, 23:24:30 UTC - in response to Message 1243057.

that is an awesome project you have going there VW Bobier! You will have 2 of the more productive systems on this project doing hard work.

I have spent the last month obsessing over a monster cruncher build i plan to do this summer, but as business has been extremely slow these past 6 months, the money is the problem right now. i'm planning to put 2 or 3 gtx 690's behind an i7 3930k, but i will need to start with just one and add the other GPU's in a couple months.

does anybody know what the RAC output on a gtx 690 dedicated to S@H 24/7 is compared to a gtx 590? (VW Bobier mentioned below a 590 does around 50K a day).

i have been assuming i will need to use a full size case for this build, if only for optimal airflow. do u think GPU and CPU cooling will be a must have, since i plan on have most of the cores and all of the GPU's crunching 24/7?

I would welcome any advice or feedback in this regard by the way if anybody has anything to suggest for my build. I have never worked with water cooling before so i'm a bit nervous about that part.

so far my plan is for: i7-3930K, a similar case to the haf-x (i have a number in my newegg wishlist but i'm not sure which i will go with, prob the one with the most 240mm fans and/or one that is on sale for around $100 at the time i order), 16GB ripjaw (1600 - 2133, not sure if its worth extra $50 for the higher one?), 160-180GB or so SSD for the OS/main programs to run off of, 80plus gold 1200W PSU, 2 or 3 GTX 690's eventually, liquid cooling for CPU and/or GPU's, and i'm not sure which motherboard i will need, so i'm open for input on those last 2 especially.

any pointers, advice, or even a redesign would be welcome. when spending this much money, i'm going to do a ton of research and make sure i'm doing it right.

I will make a new thread about this build as the time for ordering the parts draws more near in the next couple of weeks.

Profile Yanivicious
Avatar
Send message
Joined: 29 Mar 12
Posts: 157
Credit: 12,618,084
RAC: 7,677
United States
Message 1244538 - Posted: 10 Jun 2012, 23:32:23 UTC

Question for VW BObier:

On your currently running sytem, you have one GTX 590 right now, which shows up as 2 gtx 590 in your computer list, right?

I know that it works that way for the GTX 690 so i figure its the same for your 590 as well. (ie: if you have 2 GTX 690's, since they are dual GPU cards it shows up in your computer list as "[4] NVidia GeForce GTX 690"

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1244540 - Posted: 10 Jun 2012, 23:59:05 UTC - in response to Message 1244538.

Question for VW Bobier:

On your currently running system, you have one GTX 590 right now, which shows up as 2 gtx 590 in your computer list, right?

I know that it works that way for the GTX 690 so i figure its the same for your 590 as well. (ie: if you have 2 GTX 690's, since they are dual GPU cards it shows up in your computer list as "[4] NVidia GeForce GTX 690"

Windows 7 Pro x64 says:

Nvidia GeForce GTX 590
Nvidia GeForce GTX 590


As to the 690 that could be a potential RAC of maybe 100K per card, 3 cards is not too shabby, just really expensive and made of solid unobtainium practically. Newegg is a good source, then there's EVGA for $1050.00, but who knows how long that will last and ebay or amazon is nearer to $1500.00 each...

Your choice of psu is weak for 3 cards, for two it is fine, Try an Enermax Maxrevo 1350w which is Gold rated as It has 112A divided among 6 +12v rails and for three GTX690 cards You'll need every bit, the difference in power between the 590 and 690 from what I've is(it's from one website, others quote more and some less):

GTX590 396w
GTX690 321w


And that isn't a lot, As to motherboards an ASUS SABERTOOTH X79 - LGA2011 would go along with the i7-3930K cpu and mind you the HAF series like the X and 932 do not have any real dust filters, although You can buy some magnetic stick on DEMCi filters from Performance PCs, their under filters and they stick on to the steel of the case on the outside and their washable in warm soapy water, the border of the filters is magnetic, the filter itself isn't and they work really good as their medical grade filters.

Victor
____________
My Facebook, War Commander, 2015

loudbob
Volunteer tester
Send message
Joined: 2 Aug 04
Posts: 3
Credit: 56,525,078
RAC: 0
United Kingdom
Message 1244545 - Posted: 11 Jun 2012, 0:25:04 UTC
Last modified: 11 Jun 2012, 0:36:11 UTC

I did something similar - Only I wanted to see if I could fit a seperate loop for each GPU & CPU.......just to see if it could be done:














And I did - all in a Corsair 800D Case.

Specs:
Asus RE3 with Waterblock
i7 990x @ 4.3GHz
12Gb G.Skill Trident 2000Mhz RAM
4 x GTX680's
4 x 60Gb SATAII SSD's (Raid 0)
2 x 2Tb SATAII's (Raid 0)
2 x 2TB SATAII's (Raid 0)
1 x 60Gb SATAII SSD
1 x 1500w PSU
Five Water Cooled Loops each with seperate Pump, Res & Rad.

Using Lunatics App v0.40 it nets around 90 - 100k PPD
____________

Profile betregerProject donor
Avatar
Send message
Joined: 29 Jun 99
Posts: 2497
Credit: 5,233,153
RAC: 8,166
United States
Message 1244552 - Posted: 11 Jun 2012, 0:48:50 UTC - in response to Message 1244545.

Holy sh.....
____________

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1244554 - Posted: 11 Jun 2012, 0:58:32 UTC - in response to Message 1244545.
Last modified: 11 Jun 2012, 1:05:51 UTC

I plan to use the Phobya Xtreme 400 PH-35311 Radiator and the Phobya XTREME 200 PH-35185 Radiator, in one loop, as the idea of Yours I'm not crazy about, nice case though. Loudbob what were yer gpu temps like?


Phobya Xtreme 400 PH-35311 Radiator

Phobya Xtreme 200 PH-35185 Radiator
____________
My Facebook, War Commander, 2015

loudbob
Volunteer tester
Send message
Joined: 2 Aug 04
Posts: 3
Credit: 56,525,078
RAC: 0
United Kingdom
Message 1244555 - Posted: 11 Jun 2012, 1:04:57 UTC
Last modified: 11 Jun 2012, 1:07:19 UTC

Using a 120mm rad per gpu and a 360 rad for the cpu & mb.

GPU Temps are currently: 57, 41, 47, 46 Celcius

CPU Temps: 60, 63, 57, 60, 63, 66 Celcius

Room Temp: 22 Celcius

Thats with the side of the case off.

Temps rise about 15 degrees on each with side panel on.

I know its not the most cost effective and/or the best cooling solution - I just wanted to see if it could be done :D


Good luck with your build tho - you may need to run a dual PSU set-up to power four 690's as a 1600w psu would probably be borderline once you add in the cpu, hdd's, fans, pump etc etc
____________

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1244557 - Posted: 11 Jun 2012, 1:15:02 UTC - in response to Message 1244555.
Last modified: 11 Jun 2012, 1:23:30 UTC

That's why I run one hdd, a 500GB 2.5" WD Scorpio Black and a couple DVD drives, plus 1 pump in the dual bay reservoir, each rail can do 30A and that's continuous, peak I've read is 35A per rail, I'm looking at four GTX590 cards as I can get those, the 690 is just too hard to get, unless one wants to pay about $1200 or on ebay. The Lepa 1600w Gold psu(OEM is Enermax) has 133A distributed over 6 +12v rails, If I have to I have a 650w Thermaltake video card power psu with another 54A, but it takes up 2 drive bays.
____________
My Facebook, War Commander, 2015

loudbob
Volunteer tester
Send message
Joined: 2 Aug 04
Posts: 3
Credit: 56,525,078
RAC: 0
United Kingdom
Message 1244558 - Posted: 11 Jun 2012, 1:17:06 UTC
Last modified: 11 Jun 2012, 1:17:15 UTC

I'd be very interested in seeing the final build......

:D
____________

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,860,672
RAC: 5,164
United States
Message 1244562 - Posted: 11 Jun 2012, 1:35:35 UTC - in response to Message 1244558.
Last modified: 11 Jun 2012, 1:36:56 UTC

I'd be very interested in seeing the final build......

:D

I may need to add at least one 140x140 radiator, maybe, If one were running the 1500w Silverstone psu(mine is making a ticking sound, the fan) Silverstone said no more than two GTX590 cards, with adapters on the Molex connectors a 3rd 590, but that's it, there's a review of the Enermax 1350w psu Here that shows the 1350w and 2 GTX590 cards and a GTX580, the motherboard is an EVGA x58 4way sli Classified which is about the same as the R3E that You and I have, I have a 940 of course and It will run with G.Skill Ripjaws X 1333 ram, I tested mine with two 4GB dimms, I also read and saw a Youtube review of a Gigabyte G1.assassin x58 motherboard that could use 8GB dimms or 48GB total ram, Patriot of course, I did a Google search on that, take that X79.


Asus R3E, 2-GTX590 and 1-GTX580 cards with a 1350w Enermax Maxrevo psu...
____________
My Facebook, War Commander, 2015

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5864
Credit: 60,570,600
RAC: 47,627
Australia
Message 1244571 - Posted: 11 Jun 2012, 2:16:42 UTC - in response to Message 1244562.


I like that case.
____________
Grant
Darwin NT.

.clair.
Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 23,063,564
RAC: 596
United Kingdom
Message 1244574 - Posted: 11 Jun 2012, 2:35:11 UTC

Now that is the kind of`case` i can build myself,
Box tube and perspex, got them, hmm,
I already have most of the parts,
the previous attempt for a `full` case, stayed in my head :¬)

1 · 2 · 3 · 4 . . . 9 · Next

Message boards : Number crunching : New Octo GPU Cruncher build

Copyright © 2014 University of California