8 GPUs


log in

Advanced search

Message boards : Number crunching : 8 GPUs

1 · 2 · Next
Author Message
Profile Dragokatzov
Volunteer tester
Avatar
Send message
Joined: 6 May 00
Posts: 43
Credit: 8,986,320
RAC: 9,653
Canada
Message 1084251 - Posted: 6 Mar 2011, 2:57:45 UTC

I've noticed some users have systems with 8 GPUs. I have been thinking of getting my own system with 8 GPUs but I am curious to anyone with such a setup. are these systems of a standard ATX configuration or what? Also if they are on an ATX box, what motherboards are being used? what cases? and is there anything special about the about the GPUs themselves? i noticed most of the are GTX 295's but they take two slots, and i don't think there is a 16 slot ATX case in existence. or does a single 295 register as two cards in boinc? thanks!
____________

Profile ignorance is no excuse
Avatar
Send message
Joined: 4 Oct 00
Posts: 9529
Credit: 44,433,321
RAC: 0
Korea, North
Message 1084252 - Posted: 6 Mar 2011, 3:01:30 UTC - in response to Message 1084251.

I think what you are seeing are people with the Nvidia 295 card which reads as 2 cards.

so when someone installs 4 on one PC it looks like 8

however the Motherboards that take 4 GPUs are far from ordinary and cheap. Plus the need for an extremely large PSU and you are looking at somewhere around $3000US just to start.
____________
In a rich man's house there is no place to spit but his face.
Diogenes Of Sinope

End terrorism by building a school

Profile Dragokatzov
Volunteer tester
Avatar
Send message
Joined: 6 May 00
Posts: 43
Credit: 8,986,320
RAC: 9,653
Canada
Message 1084254 - Posted: 6 Mar 2011, 3:14:04 UTC

Thats all what i figured! thanks for the clarification
____________

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46519
Credit: 36,865,982
RAC: 5,053
United States
Message 1084260 - Posted: 6 Mar 2011, 3:54:40 UTC - in response to Message 1084252.
Last modified: 6 Mar 2011, 3:55:25 UTC

I think what you are seeing are people with the Nvidia 295 card which reads as 2 cards.

so when someone installs 4 on one PC it looks like 8

however the Motherboards that take 4 GPUs are far from ordinary and cheap. Plus the need for an extremely large PSU and you are looking at somewhere around $3000US just to start.

Plus one needs a case like the HAF-X(HAF-142?) from Coolermaster, Plus an EVGA Classified motherboard with 4 or 7 slots at the right spacing, A large psu is a must, Anywhere from 1250w to 1500w should do, Forget any MSI Big Bang Motherboards as they have the slots, But aren't dual gpu card compatible and they probably won't ever be compatible most likely do the Lucid Hydra chip using a driver that doesn't know how to talk to an NF200 chip as Nvidia is a competitor to Lucid in this area. ATi dual gpu cards also do not work with the Lucid Hydra chip either, Why I don't know of course, It may be the same problem as on the equivalent Nvidia cards.
____________
My Facebook, War Commander, 2015

J. Mileski
Volunteer tester
Avatar
Send message
Joined: 9 Jun 02
Posts: 118
Credit: 23,318,657
RAC: 28
United States
Message 1084304 - Posted: 6 Mar 2011, 12:04:41 UTC
Last modified: 6 Mar 2011, 12:05:52 UTC

There is a 8 GPU motherboard and case, made by Tyan and sold through http://www.velocitymicro.com/wizard.php?sr=0&iid=190. It is not cheap and I am guessing not cheap to run. It can be configured with either the Tesla cards or the GeForce cards. There are only two 2.5" bays for SATA laptop drives or SSDs. There are no external drive bays.
____________

Profile [seti.international] Dirk SadowskiProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7102
Credit: 60,944,959
RAC: 17,278
Germany
Message 1084305 - Posted: 6 Mar 2011, 12:42:11 UTC - in response to Message 1084251.
Last modified: 6 Mar 2011, 12:44:14 UTC

The currently top_host_#1, Vypers 4x GTX295 machine, is with a MSI K9A2 Platinum mobo. + AMD CPU. Not very expensive, compared to the Intel stuff. ;-)

I have the same mobo, but with 4x GTX260 OC. 1250 W PSU. ~ 700 W full load SETI@home. ~ 75,000 S@h-RAC (currently offline for rebuild/maintenance).
____________
BR

SETI@home Needs your Help ... $10 & U get a Star!

Team seti.international

Das Deutsche Cafe. The German Cafe.

Profile Wiggo
Avatar
Send message
Joined: 24 Jan 00
Posts: 7358
Credit: 96,947,069
RAC: 66,568
Australia
Message 1084306 - Posted: 6 Mar 2011, 12:44:02 UTC - in response to Message 1084304.
Last modified: 6 Mar 2011, 12:48:29 UTC

There is a 8 GPU motherboard and case, made by Tyan and sold through http://www.velocitymicro.com/wizard.php?sr=0&iid=190. It is not cheap and I am guessing not cheap to run. It can be configured with either the Tesla cards or the GeForce cards. There are only two 2.5" bays for SATA laptop drives or SSDs. There are no external drive bays.

Now if I ever won the lottery that system would be awesome spec'd with dual hex CPU's, triple 1200W PSU's and then fill it with eight GTX560's (just under $12,000). What a monster.

I'll go and buy a couple of tickets in the morning. :)

Cheers.
____________

Profile Some1new
Volunteer tester
Avatar
Send message
Joined: 10 Jun 04
Posts: 52
Credit: 830,640
RAC: 0
Germany
Message 1084307 - Posted: 6 Mar 2011, 12:47:55 UTC

Up to 8TFLops?

That would be crunching like hell.
Awesome power bill, too.


____________
All that we see or seem is but a dream within a dream.

Dave
Avatar
Send message
Joined: 29 Mar 02
Posts: 774
Credit: 23,193,139
RAC: 0
United Kingdom
Message 1084360 - Posted: 6 Mar 2011, 16:19:37 UTC

If it's your passion & u can afford both purchase + kWh elec-consump it's yours.

Profile Todd Hebert
Volunteer tester
Avatar
Send message
Joined: 16 Jun 00
Posts: 647
Credit: 217,127,962
RAC: 0
United States
Message 1084924 - Posted: 8 Mar 2011, 8:22:01 UTC

You might see a rig such as described here but with 16 gpu's installed very soon!
____________

Profile [seti.international] Dirk SadowskiProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7102
Credit: 60,944,959
RAC: 17,278
Germany
Message 1084945 - Posted: 8 Mar 2011, 10:26:56 UTC - in response to Message 1084924.
Last modified: 8 Mar 2011, 10:51:08 UTC

You might see a rig such as described here but with 16 gpu's installed very soon!


GTX590? So 8 cards installed?

Which mobo? ATX standard, so only 1 slot wide cards would fit?
One slot wide cards, with water cooling?

But, if I look to my GPU cruncher with MSI K9A2 Platinum mobo (ATX standard), there could be only 7 slots. (3 more slots between the 4, then the mobo is ended ;-)


Ohh.. if I would have money.. *sigh* *dreaming*
We're crazy, aren't we? ;-D


EDIT: 5,000. message from me here in the S@h forum. ;-)

Profile [seti.international] Dirk SadowskiProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7102
Credit: 60,944,959
RAC: 17,278
Germany
Message 1084956 - Posted: 8 Mar 2011, 10:49:50 UTC - in response to Message 1084945.
Last modified: 8 Mar 2011, 10:50:49 UTC

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each.

But maybe someone other know it for sure.
____________
BR

SETI@home Needs your Help ... $10 & U get a Star!

Team seti.international

Das Deutsche Cafe. The German Cafe.

Profile Wiggo
Avatar
Send message
Joined: 24 Jan 00
Posts: 7358
Credit: 96,947,069
RAC: 66,568
Australia
Message 1084968 - Posted: 8 Mar 2011, 12:16:50 UTC - in response to Message 1084945.

You might see a rig such as described here but with 16 gpu's installed very soon!


GTX590? So 8 cards installed?

Which mobo? ATX standard, so only 1 slot wide cards would fit?
One slot wide cards, with water cooling?

But, if I look to my GPU cruncher with MSI K9A2 Platinum mobo (ATX standard), there could be only 7 slots. (3 more slots between the 4, then the mobo is ended ;-)


Ohh.. if I would have money.. *sigh* *dreaming*
We're crazy, aren't we? ;-D


EDIT: 5,000. message from me here in the S@h forum. ;-)

With one of these you can fit 8x2 slot cards, http://www.velocitymicro.com/wizard.php?sr=0&iid=190. ;)

Cheers.
____________

Profile MikeProject donor
Volunteer tester
Avatar
Send message
Joined: 17 Feb 01
Posts: 24558
Credit: 33,899,216
RAC: 24,132
Germany
Message 1085007 - Posted: 8 Mar 2011, 14:23:25 UTC
Last modified: 8 Mar 2011, 14:25:36 UTC

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.



450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.
____________

-BeNt-
Avatar
Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1085015 - Posted: 8 Mar 2011, 14:37:29 UTC - in response to Message 1084924.

You might see a rig such as described here but with 16 gpu's installed very soon!


I don't like you very much Todd. ;) (I'm so jealous, if you do that you should have to give another one of your monsters to me!)
____________
Traveling through space at ~67,000mph!

Richard HaselgroveProject donor
Volunteer tester
Send message
Joined: 4 Jul 99
Posts: 8634
Credit: 51,635,197
RAC: 49,132
United Kingdom
Message 1085027 - Posted: 8 Mar 2011, 14:52:23 UTC - in response to Message 1085007.

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.

http://www.pcgameshardware.de/screenshots/medium/2011/03/AMD_Radeon_HD_6990_Antilles_02.JPG

450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.

Mike, that site is showing a sign requesting that you don't link their images. Changed to a url instead of an img.

Profile MikeProject donor
Volunteer tester
Avatar
Send message
Joined: 17 Feb 01
Posts: 24558
Credit: 33,899,216
RAC: 24,132
Germany
Message 1085034 - Posted: 8 Mar 2011, 15:02:30 UTC - in response to Message 1085027.

HD 6990
I guess with 4 such monsters we would get trouble to find a good PSU.

http://www.pcgameshardware.de/screenshots/medium/2011/03/AMD_Radeon_HD_6990_Antilles_02.JPG

450 Watt with hidden Bios settings.
2 bios 375 - 450 Watt.
2-8 pin plugs.

Mike, that site is showing a sign requesting that you don't link their images. Changed to a url instead of an img.


Thanks Richard.

____________

Profile ML1
Volunteer tester
Send message
Joined: 25 Nov 01
Posts: 8502
Credit: 4,195,600
RAC: 1,756
United Kingdom
Message 1085038 - Posted: 8 Mar 2011, 15:12:56 UTC - in response to Message 1084956.

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


In that case, just move over and use Linux. No problem.

Happy super-fast crunchin',
Martin


____________
See new freedom: Mageia4
Linux Voice See & try out your OS Freedom!
The Future is what We make IT (GPLv3)

Profile Fred J. Verster
Volunteer tester
Avatar
Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,897,358
RAC: 3,735
Netherlands
Message 1085046 - Posted: 8 Mar 2011, 15:37:43 UTC - in response to Message 1085015.
Last modified: 8 Mar 2011, 15:48:06 UTC


OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


Another limitting factor, which I wasn't aware of...

A Super Computer at/on your Desk Top, nice if it's electrical use
don't exceed 3600*Watt/hour, which will force me to use, the 2nd or 3rd(unused phases) of my electrical wirering.
(Only my electrical stove, uses 3x 230-240V at 7500Watt/hour; maximum use of all 4 heaters, with the maximum allowed 16Amp circuit-breakers, which I already switched for 20Amp* breakers, wirering can handle 25Amp/phase).

It would require using an AC running, all the time.
*(Now 4400Watt/hour; in theory even 4800W/h)

I 'only' lack the necessary funds, a.t.m., but I'm 'working on it'.
(An 'extra advantage' is, my landlord is a starting computer user and my rent
now includes electricity, hopefully still after seeing his 'bill' ;^) )

While with the use of Optimized app.s and CUDA/OpenCL, crunching has only become more efficient, just have a look at the Top-Hosts, Credit v.s. (electricity-)use, is tipping the 'scale' in favor of Multi-GPU-use.
And CPU's are also getting more and more efficient, only my X9650 (OC'ed)
is capable of 3500 Whetstone FLOPS per core, which is quite common with i7's and
i5's, atleast the faster ones.

And I'm curious, how the latest (INTEL) i7's (CPU+GPU) compaire against a 'Dedicated GPU'!?
In Crunching Terms, I tend to stay/go for the PCI-E xZZ dedicated GPU's,
but these are hard to predict, IMHO.
Haven't heard anything from AMD, as to changes in their CPU and GPU's
Well, my 4 cents, before it gets a Novel, in 4 parts. :)

Anyway, Happy Crunching.
____________

-BeNt-
Avatar
Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1085070 - Posted: 8 Mar 2011, 16:42:16 UTC - in response to Message 1085038.

OTOH, IIRC, Windows see max 8 GPUs.. so the max is (currently) 8 cards with 1 GPU each, or 4 cards with 2 GPUs each. ...


In that case, just move over and use Linux. No problem.

Happy super-fast crunchin',
Martin



What set of cards would you have in a computer that see's more than 8 gpus to begin with? Most motherboard only fit 4x dual slot cards of 6 single slots......4x dual slots with 295/590/6990 etc. will only be 8 gpu's and 6 single slot cards would only be 6 cpus. The only time you would probably run into that issue is if you have 6x 295's water cooled for single slot which would be 12 gpu's however the Nvidia drivers only support 4 cards to begin with, which would be 8 cores max. At least that's my understanding. (I may be talking about SLi max and not total max not really sure)
____________
Traveling through space at ~67,000mph!

1 · 2 · Next

Message boards : Number crunching : 8 GPUs

Copyright © 2014 University of California