8 GPUs

Message boards : Number crunching : 8 GPUs
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Dragokatzov
Volunteer tester
Avatar

Send message
Joined: 6 May 00
Posts: 45
Credit: 15,742,981
RAC: 5
Canada
Message 1084251 - Posted: 6 Mar 2011, 2:57:45 UTC

I've noticed some users have systems with 8 GPUs. I have been thinking of getting my own system with 8 GPUs but I am curious to anyone with such a setup. are these systems of a standard ATX configuration or what? Also if they are on an ATX box, what motherboards are being used? what cases? and is there anything special about the about the GPUs themselves? i noticed most of the are GTX 295's but they take two slots, and i don't think there is a 16 slot ATX case in existence. or does a single 295 register as two cards in boinc? thanks!
ID: 1084251 · Report as offensive
Profile skildude
Avatar

Send message
Joined: 4 Oct 00
Posts: 9541
Credit: 50,759,529
RAC: 60
Yemen
Message 1084252 - Posted: 6 Mar 2011, 3:01:30 UTC - in response to Message 1084251.  

I think what you are seeing are people with the Nvidia 295 card which reads as 2 cards.

so when someone installs 4 on one PC it looks like 8

however the Motherboards that take 4 GPUs are far from ordinary and cheap. Plus the need for an extremely large PSU and you are looking at somewhere around $3000US just to start.


In a rich man's house there is no place to spit but his face.
Diogenes Of Sinope
ID: 1084252 · Report as offensive
Profile Dragokatzov
Volunteer tester
Avatar

Send message
Joined: 6 May 00
Posts: 45
Credit: 15,742,981
RAC: 5
Canada
Message 1084254 - Posted: 6 Mar 2011, 3:14:04 UTC

Thats all what i figured! thanks for the clarification
ID: 1084254 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1084260 - Posted: 6 Mar 2011, 3:54:40 UTC - in response to Message 1084252.  
Last modified: 6 Mar 2011, 3:55:25 UTC

I think what you are seeing are people with the Nvidia 295 card which reads as 2 cards.

so when someone installs 4 on one PC it looks like 8

however the Motherboards that take 4 GPUs are far from ordinary and cheap. Plus the need for an extremely large PSU and you are looking at somewhere around $3000US just to start.

Plus one needs a case like the HAF-X(HAF-142?) from Coolermaster, Plus an EVGA Classified motherboard with 4 or 7 slots at the right spacing, A large psu is a must, Anywhere from 1250w to 1500w should do, Forget any MSI Big Bang Motherboards as they have the slots, But aren't dual gpu card compatible and they probably won't ever be compatible most likely do the Lucid Hydra chip using a driver that doesn't know how to talk to an NF200 chip as Nvidia is a competitor to Lucid in this area. ATi dual gpu cards also do not work with the Lucid Hydra chip either, Why I don't know of course, It may be the same problem as on the equivalent Nvidia cards.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1084260 · Report as offensive
J. Mileski
Volunteer tester
Avatar

Send message
Joined: 9 Jun 02
Posts: 632
Credit: 172,116,532
RAC: 572
United States
Message 1084304 - Posted: 6 Mar 2011, 12:04:41 UTC
Last modified: 6 Mar 2011, 12:05:52 UTC

There is a 8 GPU motherboard and case, made by Tyan and sold through http://www.velocitymicro.com/wizard.php?sr=0&iid=190. It is not cheap and I am guessing not cheap to run. It can be configured with either the Tesla cards or the GeForce cards. There are only two 2.5" bays for SATA laptop drives or SSDs. There are no external drive bays.
ID: 1084304 · Report as offensive
Profile Sutaru Tsureku
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7105
Credit: 147,663,825
RAC: 5
Germany
Message 1084305 - Posted: 6 Mar 2011, 12:42:11 UTC - in response to Message 1084251.  
Last modified: 6 Mar 2011, 12:44:14 UTC

The currently top_host_#1, Vypers 4x GTX295 machine, is with a MSI K9A2 Platinum mobo. + AMD CPU. Not very expensive, compared to the Intel stuff. ;-)

I have the same mobo, but with 4x GTX260 OC. 1250 W PSU. ~ 700 W full load SETI@home. ~ 75,000 S@h-RAC (currently offline for rebuild/maintenance).
ID: 1084305 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1084306 - Posted: 6 Mar 2011, 12:44:02 UTC - in response to Message 1084304.  
Last modified: 6 Mar 2011, 12:48:29 UTC

There is a 8 GPU motherboard and case, made by Tyan and sold through http://www.velocitymicro.com/wizard.php?sr=0&iid=190. It is not cheap and I am guessing not cheap to run. It can be configured with either the Tesla cards or the GeForce cards. There are only two 2.5" bays for SATA laptop drives or SSDs. There are no external drive bays.

Now if I ever won the lottery that system would be awesome spec'd with dual hex CPU's, triple 1200W PSU's and then fill it with eight GTX560's (just under $12,000). What a monster.

I'll go and buy a couple of tickets in the morning. :)

Cheers.
ID: 1084306 · Report as offensive
Profile Some1new
Volunteer tester
Avatar

Send message
Joined: 10 Jun 04
Posts: 52
Credit: 830,640
RAC: 0
Germany
Message 1084307 - Posted: 6 Mar 2011, 12:47:55 UTC

Up to 8TFLops?

That would be crunching like hell.
Awesome power bill, too.


All that we see or seem is but a dream within a dream.

ID: 1084307 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 1084360 - Posted: 6 Mar 2011, 16:19:37 UTC

If it's your passion & u can afford both purchase + kWh elec-consump it's yours.
ID: 1084360 · Report as offensive
Profile Todd Hebert
Volunteer tester
Avatar

Send message
Joined: 16 Jun 00
Posts: 648
Credit: 228,292,957
RAC: 0
United States
Message 1084924 - Posted: 8 Mar 2011, 8:22:01 UTC

You might see a rig such as described here but with 16 gpu's installed very soon!
ID: 1084924 · Report as offensive
Profile Sutaru Tsureku
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7105
Credit: 147,663,825
RAC: 5
Germany
Message 1084945 - Posted: 8 Mar 2011, 10:26:56 UTC - in response to Message 1084924.  
Last modified: 8 Mar 2011, 10:51:08 UTC

You might see a rig such as described here but with 16 gpu's installed very soon!


GTX590? So 8 cards installed?

Which mobo? ATX standard, so only 1 slot wide cards would fit?
One slot wide cards, with water cooling?

But, if I look to my GPU cruncher with MSI K9A2 Platinum mobo (ATX standard), there could be only 7 slots. (3 more slots between the 4, then the mobo is ended ;-)


Ohh.. if I would have money.. *sigh* *dreaming*
We're crazy, aren't we? ;-D


EDIT: 5,000. message from me here in the S@h forum. ;-)
ID: 1084945 · Report as offensive
Profile Sutaru Tsureku
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7105
Credit: 147,663,825
RAC: 5
Germany
Message 1084956 - Posted: 8 Mar 2011, 10:49:50 UTC - in response to Message 1084945.  
Last modified: 8 Mar 2011, 10:50:49 UTC

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each.

But maybe someone other know it for sure.
ID: 1084956 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1084968 - Posted: 8 Mar 2011, 12:16:50 UTC - in response to Message 1084945.  

You might see a rig such as described here but with 16 gpu's installed very soon!


GTX590? So 8 cards installed?

Which mobo? ATX standard, so only 1 slot wide cards would fit?
One slot wide cards, with water cooling?

But, if I look to my GPU cruncher with MSI K9A2 Platinum mobo (ATX standard), there could be only 7 slots. (3 more slots between the 4, then the mobo is ended ;-)


Ohh.. if I would have money.. *sigh* *dreaming*
We're crazy, aren't we? ;-D


EDIT: 5,000. message from me here in the S@h forum. ;-)

With one of these you can fit 8x2 slot cards, http://www.velocitymicro.com/wizard.php?sr=0&iid=190. ;)

Cheers.
ID: 1084968 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 1085007 - Posted: 8 Mar 2011, 14:23:25 UTC
Last modified: 8 Mar 2011, 14:25:36 UTC

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.



450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.


With each crime and every kindness we birth our future.
ID: 1085007 · Report as offensive
-BeNt-
Avatar

Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1085015 - Posted: 8 Mar 2011, 14:37:29 UTC - in response to Message 1084924.  

You might see a rig such as described here but with 16 gpu's installed very soon!


I don't like you very much Todd. ;) (I'm so jealous, if you do that you should have to give another one of your monsters to me!)
Traveling through space at ~67,000mph!
ID: 1085015 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1085027 - Posted: 8 Mar 2011, 14:52:23 UTC - in response to Message 1085007.  

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.

http://www.pcgameshardware.de/screenshots/medium/2011/03/AMD_Radeon_HD_6990_Antilles_02.JPG

450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.

Mike, that site is showing a sign requesting that you don't link their images. Changed to a url instead of an img.
ID: 1085027 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 1085034 - Posted: 8 Mar 2011, 15:02:30 UTC - in response to Message 1085027.  

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.

http://www.pcgameshardware.de/screenshots/medium/2011/03/AMD_Radeon_HD_6990_Antilles_02.JPG

450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.

Mike, that site is showing a sign requesting that you don't link their images. Changed to a url instead of an img.


Thanks Richard.



With each crime and every kindness we birth our future.
ID: 1085034 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 20140
Credit: 7,508,002
RAC: 20
United Kingdom
Message 1085038 - Posted: 8 Mar 2011, 15:12:56 UTC - in response to Message 1084956.  

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


In that case, just move over and use Linux. No problem.

Happy super-fast crunchin',
Martin


See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 1085038 · Report as offensive
Profile Fred J. Verster
Volunteer tester
Avatar

Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,903,643
RAC: 0
Netherlands
Message 1085046 - Posted: 8 Mar 2011, 15:37:43 UTC - in response to Message 1085015.  
Last modified: 8 Mar 2011, 15:48:06 UTC


OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


Another limitting factor, which I wasn't aware of...

A Super Computer at/on your Desk Top, nice if it's electrical use
don't exceed 3600*Watt/hour, which will force me to use, the 2nd or 3rd(unused phases) of my electrical wirering.
(Only my electrical stove, uses 3x 230-240V at 7500Watt/hour; maximum use of all 4 heaters, with the maximum allowed 16Amp circuit-breakers, which I already switched for 20Amp* breakers, wirering can handle 25Amp/phase).

It would require using an AC running, all the time.
*(Now 4400Watt/hour; in theory even 4800W/h)

I 'only' lack the necessary funds, a.t.m., but I'm 'working on it'.
(An 'extra advantage' is, my landlord is a starting computer user and my rent
now includes electricity, hopefully still after seeing his 'bill' ;^) )

While with the use of Optimized app.s and CUDA/OpenCL, crunching has only become more efficient, just have a look at the Top-Hosts, Credit v.s. (electricity-)use, is tipping the 'scale' in favor of Multi-GPU-use.
And CPU's are also getting more and more efficient, only my X9650 (OC'ed)
is capable of 3500 Whetstone FLOPS per core, which is quite common with i7's and
i5's, atleast the faster ones.

And I'm curious, how the latest (INTEL) i7's (CPU+GPU) compaire against a 'Dedicated GPU'!?
In Crunching Terms, I tend to stay/go for the PCI-E xZZ dedicated GPU's,
but these are hard to predict, IMHO.
Haven't heard anything from AMD, as to changes in their CPU and GPU's
Well, my 4 cents, before it gets a Novel, in 4 parts. :)

Anyway, Happy Crunching.
ID: 1085046 · Report as offensive
-BeNt-
Avatar

Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1085070 - Posted: 8 Mar 2011, 16:42:16 UTC - in response to Message 1085038.  

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


In that case, just move over and use Linux. No problem.

Happy super-fast crunchin',
Martin



What set of cards would you have in a computer that see's more than 8 gpus to begin with? Most motherboard only fit 4x dual slot cards of 6 single slots......4x dual slots with 295/590/6990 etc. will only be 8 gpu's and 6 single slot cards would only be 6 cpus. The only time you would probably run into that issue is if you have 6x 295's water cooled for single slot which would be 12 gpu's however the Nvidia drivers only support 4 cards to begin with, which would be 8 cores max. At least that's my understanding. (I may be talking about SLi max and not total max not really sure)
Traveling through space at ~67,000mph!
ID: 1085070 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : 8 GPUs


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.