Share your Cruncher


log in

Advanced search

Message boards : Number crunching : Share your Cruncher

1 · 2 · Next
Author Message
Team kizb
Send message
Joined: 8 Mar 01
Posts: 219
Credit: 3,709,162
RAC: 0
Germany
Message 1311120 - Posted: 28 Nov 2012, 19:20:21 UTC
Last modified: 28 Nov 2012, 19:25:52 UTC

Since the scheduler isn't doing so well right now, how about a new thread showing your SETI cruncher?

I invite anyone to post pictures of there setup.

I'm really interested to see how the computers in the Top 20 are setup running 4 690s, 5 680s..etc, and the only rig (in the top 20) running 4 295's. All of these setups would put out some major heat!

This may also help others with ideas on how to deal with their own thermal management issues.
____________
My Computers:
Blue Offline
Green Offline
Red Offline

Profile Bill Turner
Send message
Joined: 29 Nov 10
Posts: 112
Credit: 37,989
RAC: 0
United States
Message 1311122 - Posted: 28 Nov 2012, 19:27:32 UTC - in response to Message 1311120.

Not sure if you wanna see a pic of a laptop, but I suppose I could post one when I get home! :)
____________
**Check out my wifes cupcakes**

Profile Tron
Send message
Joined: 16 Aug 09
Posts: 180
Credit: 2,236,055
RAC: 0
United States
Message 1311137 - Posted: 28 Nov 2012, 20:07:00 UTC
Last modified: 28 Nov 2012, 20:07:28 UTC

A work in progress :


Dell poweredge C6145 4X AMD opteron 16c = 64 core + C410X expansion chassis, 16 GPU (photo borrowed from dell since my unit is in pieces atm.)

still needed :
3 more Opteron 6276 2.3ghz 16c cpus

48 gb of ECC REG PC3-10600 1333MHz ram

12 nvidia gtx 680
14 tesla card sleds (for modifying)

Team kizb
Send message
Joined: 8 Mar 01
Posts: 219
Credit: 3,709,162
RAC: 0
Germany
Message 1311138 - Posted: 28 Nov 2012, 20:15:29 UTC - in response to Message 1311137.

Wow, sweet looking 5U setup! I wonder how well it does at cooling the cards, how many have you had in it so far?
____________
My Computers:
Blue Offline
Green Offline
Red Offline

Profile Tron
Send message
Joined: 16 Aug 09
Posts: 180
Credit: 2,236,055
RAC: 0
United States
Message 1311141 - Posted: 28 Nov 2012, 20:26:15 UTC - in response to Message 1311138.

Wow, sweet looking 5U setup! I wonder how well it does at cooling the cards, how many have you had in it so far?


Cooling is an issue, I have not yet had the privilege to solve.
I only have one tesla 2070 cards atm.
I am working on modifying the chassis sleds to physically accept gtx kepler cards instead of the tesla series that it is designed for. (power connectors and passive heatsinks are the main mods)
I have not fired up the c6145 as I don't have a single stick of ram for it yet
enterprize level components at this age are not yet what one might call "affordable"

Profile HAL9000
Volunteer tester
Avatar
Send message
Joined: 11 Sep 99
Posts: 3571
Credit: 98,047,457
RAC: 77,533
United States
Message 1311142 - Posted: 28 Nov 2012, 20:37:50 UTC
Last modified: 28 Nov 2012, 20:39:28 UTC

Cooling when consuming a large amount of power can be an issue. Here are a few of my machines. The total power consumption for the rack is 9.2 KW.


Which as you can see, from my temp monitoring, does generate a fair amount of heat.

So you don't have to do the C to F conversion.
25ºC = 77ºF & 41ºC = 105.8

Sometimes I put my coffee on the back side to keep it warm.
____________
SETI@home classic workunits: 93,865 CPU time: 863,447 hours

Join the BP6/VP6 User Group today!

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44555
Credit: 35,422,018
RAC: 9,190
Message 1311186 - Posted: 28 Nov 2012, 23:16:21 UTC
Last modified: 29 Nov 2012, 0:10:47 UTC

Remember You asked for this...

The Galactica(above)

The Pegasus(Under Construction, completion in about 2015)

PC specs:
[Coolermaster HAF-932 Case(Galactica),
[ASUS P7P55D Pro motherboard, Bios 2003, 12/14/2010
[EVGA Power Booster Card(not installed yet)
EK-Supreme LTX CPU Waterblock - Intel
EK-P7P55D Pro water blocks
[Corsair H70 in Push/Pull(aimed out to lower heat gpus are exposed to by 20C)
[2-Koolance 120x120x25mm 108cfm fans(2 on the H70, H70 is current replace with above parts)
[i5 750 cpu @ 2.84GHz(overclocked, stock is 2.66GHz)
i7 880 cpu @ 3.06GHz
XSPC X2O DC-750 - Dual 5.25" Bay-Res Pump/Reservoir Combo
Bitspower/Enzotech/Koolance Fittings(Not compression) to fit 1/2"ID Tubing
Tygon Black 1/2" ID Tubing
[Coolgate 120x360 radiator
1-Watercool MO-RA3 4 x 180mm PRO Extreme Radiator
[3-Koolance 120mm 108cfm fans
[4-Koolance 120mm 108cfm fans(for fan panel, not installed yet)
[Phobya 4-1 3pin fan power cable
4-Silverstone Penetrator fans 80-130cfm 180mm fans
[16GB G.Skill Ripjaws X DDR3 1333 9-9-9-24-121-2T @ 1339.6MHz,
3-GTX590 cards<have 1 already>
[3-EK-FC590 GTX590 - Full Cover VGA Water-Block for Nvidia GTX590,
3-EK 590 backplates(reinforcement)
[Silverstone ST1500 1500W PSU
[DEMCiflex Magnetic Fan Dust Filter - Custom 4 Piece Set for CM HAF-932,
[WD Scorpio Black 500GB hdd,
[OCZ Rally2 4GB usb flash drive>,
[Optiarc AD-7170s DVD-/+R DL burner>,
[Sata CD-rom drive>,
[D-link SuperG 108Mbps usb 2.0 wireless device w/encryption
[Windows 7 Pro x64, service pack 1
[Nvidia Driver 301.24 x64
[20" LCD LG W2053TX Monitor (1600x900)
[Windows 7 Pro x64.

Pump/reservoir > CPU waterblock > Motherboard waterblock > Radiator(360) > 6GPU waterblocks > Radiator(720) > Pump/reservoir

Pump/reservoir > CPU waterblock > Motherboard waterblock > Radiator(360) > Pump/reservoir
Pump/reservoir > 4GPU waterblocks > Radiator(720) > Pump/reservoir
Pump/reservoir > 4GPU waterblocks > Radiator(720) > Pump/reservoir

[Cooler Master HAF-X Case(Pegasus)
[ASUS Rampage 3 Extreme motherboard
[EK Rampage 3 Extreme full cover water block
[EK Red 1366 Cpu water block
[Intel i7-940 @ 2.93GHz cpu
[XSPC X2O DC-750 - Dual 5.25" Bay-Res Pump/Reservoir Combo
Koolance - Dual D5 - Dual 5.25 Bay Reservoir & 2 pumps
Koolance - Single D5 - Single 5.25 Bay Reservoir & 1 pump
Bitspower/Enzotech/Koolance Fittings(Not compression) to fit 1/2"ID Tubing
Tygon Black 1/2" ID Tubing
[Coolgate 120x360 radiator
2-Watercool MO-RA3 4 x 180mm PRO Extreme Radiators
[3-Koolance 120mm 108cfm fans
8-Silverstone Penetrator fans 80-130cfm 180mm fans
Corsair Black 24GB (6 x 4GB) DDR3 1600 ram 9-9-9-24 timing
4-EVGA Classified 1596 or 1598 GTX590 cards
4-XSPC Razor GTX590 - Full Cover VGA Water-Block for Nvidia GTX590
Rosewill Lightning 1300W psu(108A) or Silverstone Zeus 1350w psu(105A)
FSP 450w Booster X5 video card psu
DEMCiflex Magnetic Fan Dust Filter - Custom 4 Piece Set for CM HAF-X
[WD velociraptor 250GB hdd
[Sata DVD/CD-rom Drive
D-link SuperG 108Mbps usb 2.0 wireless device w/encryption
[Windows 7 Premium x64 upgrade to Pro, service pack 1
[Nvidia Driver 301.24 x64
[LG W2053TX Monitor (1600x900)
Iogear Dual DVI-Monitor/usb/audio switcher.

[ Denotes what I have already.

____________

Team kizb
Send message
Joined: 8 Mar 01
Posts: 219
Credit: 3,709,162
RAC: 0
Germany
Message 1311189 - Posted: 28 Nov 2012, 23:29:39 UTC

That's quiet some list of parts you have their, and cool idea using Battlestar Galactica names!

Great pictures so far, keep them coming!
____________
My Computers:
Blue Offline
Green Offline
Red Offline

Profile Sliver
Avatar
Send message
Joined: 18 May 11
Posts: 281
Credit: 6,584,583
RAC: 14,582
United States
Message 1311192 - Posted: 28 Nov 2012, 23:36:20 UTC - in response to Message 1311186.

@VW Bobier: I got that same case :D
____________

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44555
Credit: 35,422,018
RAC: 9,190
Message 1311198 - Posted: 29 Nov 2012, 0:07:24 UTC - in response to Message 1311189.

That's quiet some list of parts you have their, and cool idea using Battlestar Galactica names!

Great pictures so far, keep them coming!

Yeah, it's a good amount of parts, but I have time to burn, some of My relative could get the missing parts in a few months or maybe less, Me I have to take My time and yes I need a new keyboard as I almost can't see the keys without an led equipped flashlight...
I might eventually replace the Galactica's case with a HAF-XB case, as I have two towers and the desk can only hold one, so far their out of stock, so much for a $99.99 case. Those 360x360 radiators I've seen them cool 4 GTX580 cards, so 1 rad cooling a pair of GTX590 cards should be a piece of cake(a thing easily done). Oh and the 180 fans are Silverstone Penetrator fans that do 80-130cfm each.

____________

Team kizb
Send message
Joined: 8 Mar 01
Posts: 219
Credit: 3,709,162
RAC: 0
Germany
Message 1311205 - Posted: 29 Nov 2012, 0:25:39 UTC

I've read about the HAF-XB as well and it does look like a very interesting case. I like that it has a removable MB try that sits on the top, should allow a nice clean install by allowing you to bring most of the wires up from below the MB from the PSU below. Plus it looks like the two front 120 mm fans will blow right over the MB and GPUs and then straight out the back.
____________
My Computers:
Blue Offline
Green Offline
Red Offline

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44555
Credit: 35,422,018
RAC: 9,190
Message 1311208 - Posted: 29 Nov 2012, 0:33:10 UTC - in response to Message 1311205.

I've read about the HAF-XB as well and it does look like a very interesting case. I like that it has a removable MB try that sits on the top, should allow a nice clean install by allowing you to bring most of the wires up from below the MB from the PSU below. Plus it looks like the two front 120 mm fans will blow right over the MB and GPUs and then straight out the back.

And one can mount a 120x240mm radiator in the front, at least from what I've seen in 1 review.
____________

Profile ivan
Volunteer tester
Avatar
Send message
Joined: 5 Mar 01
Posts: 553
Credit: 120,291,453
RAC: 87,589
United Kingdom
Message 1311324 - Posted: 29 Nov 2012, 13:07:45 UTC
Last modified: 29 Nov 2012, 13:09:15 UTC

Here's my best machine, a Supermicro 1U server with a Tesla and a Palit GTX460. The fan on the video-card shattered when I brushed a finger against it, so it's running with just the heatsink and a little cardboard baffle to make sure all the airflow goes through the fins. Unfortunately the fan control has no feedback from the GPUs, just the dual-Xeon CPUs, so I have to run the fans (all 16 of them!) at full speed. Luckily we have a little-used air-conditioned small optics lab. I removed the cover temporarily for the photo.
____________

N9JFE
Volunteer tester
Avatar
Send message
Joined: 4 Oct 99
Posts: 9313
Credit: 11,921,696
RAC: 13,031
United States
Message 1311343 - Posted: 29 Nov 2012, 15:17:00 UTC - in response to Message 1311186.

The Pegasus(Under Construction, completion in about 2015)

It'll be obsolete by then!

____________
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.


zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44555
Credit: 35,422,018
RAC: 9,190
Message 1311350 - Posted: 29 Nov 2012, 16:03:37 UTC - in response to Message 1311343.

The Pegasus(Under Construction, completion in about 2015)

It'll be obsolete by then!

Can't be helped, technically all My hardware is obsolete now, so that's not a real problem and I can't buy 4 GTX690 cards and 2 GTX590 cards by 08/01/2014, I'll be lucky enough to get 6 GTX590 cards by then. I have lots of time and well not a lot to do, besides run a house and care for a big cat, besides I'm mostly a shut in.
____________

Profile Tim
Volunteer tester
Avatar
Send message
Joined: 19 May 99
Posts: 193
Credit: 220,300,557
RAC: 128,213
Greece
Message 1311762 - Posted: 6 Dec 2012, 14:27:04 UTC
Last modified: 6 Dec 2012, 14:32:30 UTC

http://s1343.beta.photobucket.com/user/Timol1/media/DSC_1920.jpg.html#/user/Timol1/media/DSC_1920.jpg.html?&_suid=135480346937103018404264700296

As many of you request it....
One day before the cleaning :-)

4 X 590
Computer ID: 6716400
____________

juan BFB
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 4616
Credit: 233,414,644
RAC: 343,135
Brazil
Message 1311764 - Posted: 6 Dec 2012, 14:47:12 UTC

Beautiful, Well ventilated, clean, organized assembly and with 2 Large PSU that´s the way the things work fine. Congrats. And thanks for share with us.
____________

Profile Matt Nowzari
Avatar
Send message
Joined: 13 Oct 12
Posts: 4
Credit: 803,595
RAC: 252
United States
Message 1314495 - Posted: 13 Dec 2012, 1:47:12 UTC

Damn, some of the rigs here are really impressive! I'm jealous hehe.

Here's my modest rig that I use for gaming and crunching. It's not a multi-GPU monster but it contributes its fair share haha.

Intel Core i7 3770K stock speeds
MSI Z77A-G43 motherboard
(1) EVGA GTX 670 2GB
8gb Corsair Vengeance RAM
Thermaltake TR2 650w PSU
Corsair Carbide 500R White


My beloved computer which I finally completed a few days ago. by Guitarhead429, on Flickr

zoom314
Avatar
Send message
Joined: 30 Nov 03
Posts: 44555
Credit: 35,422,018
RAC: 9,190
Message 1314497 - Posted: 13 Dec 2012, 2:17:10 UTC - in response to Message 1314495.

Damn, some of the rigs here are really impressive! I'm jealous hehe.

Here's my modest rig that I use for gaming and crunching. It's not a multi-GPU monster but it contributes its fair share haha.

Intel Core i7 3770K stock speeds
MSI Z77A-G43 motherboard
(1) EVGA GTX 670 2GB
8gb Corsair Vengeance RAM
Thermaltake TR2 650w PSU
Corsair Carbide 500R White


My beloved computer which I finally completed a few days ago. by Guitarhead429, on Flickr

That's a [Darth Vader]most impressive[/Darth Vader] looking PC no matter what. Mines just a work under construction, recently I'd changed out 2 fans, one of which was clicking and installed 6 Koolance 108cfm 120mm fans that I'd had on hand and an EVGA power booster x1 pcie card in the slot next to the the EVGA GTX590, which means I have the power booster under the 590!

____________

Profile Matt Nowzari
Avatar
Send message
Joined: 13 Oct 12
Posts: 4
Credit: 803,595
RAC: 252
United States
Message 1314503 - Posted: 13 Dec 2012, 2:52:46 UTC - in response to Message 1314497.

Thanks VW! Your rigs are just awesome, under construction or not. It was actually your forum post a while back with a title to the effect of "Octo-core GPU cruncher" that got me interested in SETI@Home and crunching applications in general. I was amazed to see people building amazing multi-GPU Sli behemoths for the sole purpose of providing the computing power to SETI and other projects.

Out of curiosity, does the EVGA PCI 1x Power Boost do much to improve card performance? This is the first time I've heard of such a device, I'm quite interested! :D
____________
With great power comes great electricity bill.

1 · 2 · Next

Message boards : Number crunching : Share your Cruncher

Copyright © 2014 University of California