Message boards :
Number crunching :
Best GPU performance
Message board moderation
Previous · 1 · 2 · 3 · Next
Author | Message |
---|---|
HAL9000 Send message Joined: 11 Sep 99 Posts: 6534 Credit: 196,805,888 RAC: 57 |
[quote][quote] If the PCIe bus doesn't factor in that much. Then I would go with a 20 clot passive backplane system. Like this with this dual xeon single board computer. 18 295's should be enough right? :) SETI@home classic workunits: 93,865 CPU time: 863,447 hours Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[ |
Josef W. Segur Send message Joined: 30 Oct 99 Posts: 4504 Credit: 1,414,761 RAC: 0 |
[quote][quote] There isn't a huge amount of data transfer going on. That's why the multiple PCI-e channels aren't an absolute need, though you'd lose some small percentage. However, the latencies in the switched arrangement of that backplane system could detract a lot. While crunching a midrange ~0.42 angle range WU the CPU has to tell the GPU what to do next about 3 billion times. If there were a 1 microsecond latency on average, that would add 3000 seconds to the crunch time. Average latencies of 40 nanoseconds would still amount to 2 minutes added to the crunch time. One other detail would require some cooperation from the BOINC developers. The Scheduler won't believe any host has more than 8 CUDA GPUs, quoting from the sched_send.cpp source code: const int MAX_CUDA_DEVS = 8; Joe |
HAL9000 Send message Joined: 11 Sep 99 Posts: 6534 Credit: 196,805,888 RAC: 57 |
Ah, No point to use more then 4 cards then :/ I wonder if this is an issue they will revisit with the new boards with 6 PCIe x16 slots or when they start cramming more GPUs on the cards. SETI@home classic workunits: 93,865 CPU time: 863,447 hours Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[ |
-= Vyper =- Send message Joined: 5 Sep 99 Posts: 1652 Credit: 1,065,191,981 RAC: 2,537 |
Ah, No point to use more then 4 cards then :/ I wonder if this is an issue they will revisit with the new boards with 6 PCIe x16 slots or when they start cramming more GPUs on the cards. There is no physical room for more than perhaps 6 one slot gpu's so the total number of cuda boards would be less than eight anyhow. //Vyper _________________________________________________________________________ Addicted to SETI crunching! Founder of GPU Users Group |
Richard Haselgrove Send message Joined: 4 Jul 99 Posts: 14654 Credit: 200,643,578 RAC: 874 |
There is no physical room for more than perhaps 6 one slot gpu's so the total number of cuda boards would be less than eight anyhow. But the question was about a 20 slot expansion backplane. |
-= Vyper =- Send message Joined: 5 Sep 99 Posts: 1652 Credit: 1,065,191,981 RAC: 2,537 |
But the question was about a 20 slot expansion backplane. Hm, i thought he had answered that question himself in my mind, refering to that it's no use and started discussing about the 6 slot PCI-E boards which you can't fit 6 dualies on. If my assumptions were wrong about the question then i'm sorry, my bad. Kind regards Vyper _________________________________________________________________________ Addicted to SETI crunching! Founder of GPU Users Group |
ML1 Send message Joined: 25 Nov 01 Posts: 20397 Credit: 7,508,002 RAC: 20 |
But the question was about a 20 slot expansion backplane. Interesting idea, but have you seen the price of that thing?! Cheaper the buy multiple motherboards and CPUs! (Unless you really are going to populate all 20 slots!!!) Happy crunchin', Martin See new freedom: Mageia Linux Take a look for yourself: Linux Format The Future is what We all make IT (GPLv3) |
Sutaru Tsureku Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
17 x GTX295..! [http://www.hardware-infos.com/news.php?news=2865]-[german] Google translation: 23-times Geforce GTX 295 for mankind On Youtube is these days a video has been uploaded, which is the simultaneous operation of a total of 17 Geforce GTX 295 graphics cards, and 34 GT200 chips, each with 240 shader units 1D shows. Initially, the author of this video the commissioning of 23 Geforce GTX 295-designed graphics cards, but failed on the power dissipation. The campaign runs under the motto "A GPU Folding Farm" to the fight against Huntington's disease, an incurable disease, sometimes in the human nervous system, the autosomal dominant inherited. Already a Geforce GTX 295 offers a theoretical computing power of 1788 to Gigaflops. As a result, the rack installed, 17 Geforce GTX 295-Gigaflops 30,396 cards available. Or in other words, just over 30 teraflops. As the author announces, he has two of the six remaining 295-Geforce GTX graphics cards in the private PC in SLI mode (Quad-SLI) were used. At the end of the video will also show that 14 Geforce GTX 295 graphics cards from EVGA and 9 were made by MSI. A Geforce GTX 260 and GeForce 9800 GT Round personal lineup from Nvidia. Atlas Folder - 23 nVidia GTX295 GPU Folding Farm [http://www.youtube.com/watch?v=KjOW5iW7dJQ] |
Sutaru Tsureku Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
|
Sutaru Tsureku Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
|
Sutaru Tsureku Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
|
HAL9000 Send message Joined: 11 Sep 99 Posts: 6534 Credit: 196,805,888 RAC: 57 |
But the question was about a 20 slot expansion backplane. I was thinking of an Asus P6T6 WS Revolution MB with 6 BFG NVIDIA GeForce GTX 295 H2OC cards. As they only require 1 slot width. So a "standard" motherboard could have 12 cuda tasks running in theory if it were not otherwise limited and you were willing to spend $8000 on the beast of a machine. lol Newegg has some nice photos of the card. SETI@home classic workunits: 93,865 CPU time: 863,447 hours Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[ |
-= Vyper =- Send message Joined: 5 Sep 99 Posts: 1652 Credit: 1,065,191,981 RAC: 2,537 |
I was thinking of an Asus P6T6 WS Revolution MB with 6 BFG NVIDIA GeForce GTX 295 H2OC cards. As they only require 1 slot width. So a "standard" motherboard could have 12 cuda tasks running in theory if it were not otherwise limited and you were willing to spend $8000 on the beast of a machine. lol Newegg has some nice photos of the card. Ah i thought of that one too but it's a dual slotter as bfgs own homepage quotes: "One vacant add-in card slot below the PCI Express® x16 slot. This graphics card physically occupies two slots" From http://www.bfgtech.com/bfgegtx2951792h2ocwbe.aspx Otherwise it could've been plausible until a company actually could create a true single slotter of a GTX295.. But i don't think it's far fetched that we'll see a performance single slotter soon because nVidia is in the ramps for lower nm on their parts. Kind regards Vyper _________________________________________________________________________ Addicted to SETI crunching! Founder of GPU Users Group |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
But the question was about a 20 slot expansion backplane. The board in question has a bunch of PCIe slots, and a processor-board slot at the end. The processor board has the chipset, etc. -- just no slots. These go in a case designed for the board, with room for 20 cards. So, my only real question is: is it 20 counting the processor card, or 20 plus the processor card. ... and yes, Martin, they're incredibly expensive because we're all out buying motherboards and not investing in these gawdawful expensive things. These types of boards used to come in "split" 10/10 versions, and even split 5/5/5/5, so you could put four complete systems in one 4u case. |
HAL9000 Send message Joined: 11 Sep 99 Posts: 6534 Credit: 196,805,888 RAC: 57 |
But the question was about a 20 slot expansion backplane. I have only seen SBC that use "2 slots" leaving you with at most 18 free slots. The 20 slot boards also are the whole width of a 19" chassis so the PSU's either get mounted in front or under the board. Making it taller and heavier :/ I haven't found anyone that makes a 3 or 4 SBC backplane that would be ideal for making CUDA crunchers. The best I have come across is a backplane with 6 segments. Each with 1 PCIe x16 connector, and 3 PCIe x8 connectors. So you could have 6 cuda machines in 1 box. There might be a 14-slot split backplane out there with enough slots on it for 2 quad video card machines, but I haven't found it yet. SETI@home classic workunits: 93,865 CPU time: 863,447 hours Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[ |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
But the question was about a 20 slot expansion backplane. I haven't looked. They're really expensive. |
ML1 Send message Joined: 25 Nov 01 Posts: 20397 Credit: 7,508,002 RAC: 20 |
The board in question has a bunch of PCIe slots, and a processor-board slot at the end. The processor board has the chipset, etc. -- just no slots. Anyone see any prices anywhere to price up a 4 cpu card behemoth to see how it compares against a PC motherboard solution? Happy crunchin', Martin See new freedom: Mageia Linux Take a look for yourself: Linux Format The Future is what We all make IT (GPLv3) |
john deneer Send message Joined: 16 Nov 06 Posts: 331 Credit: 20,996,606 RAC: 0 |
The board in question has a bunch of PCIe slots, and a processor-board slot at the end. The processor board has the chipset, etc. -- just no slots. Hi Martin, You mean something like this? I have no idea about the price, you have to fill in a form to ask for a quote. There is probably a reason for that, not scaring potential customers off and all that .... They say it is 'at a very affordable price', though :-) Regards, John. |
zoom3+1=4 Send message Joined: 30 Nov 03 Posts: 65793 Credit: 55,293,173 RAC: 49 |
The board in question has a bunch of PCIe slots, and a processor-board slot at the end. The processor board has the chipset, etc. -- just no slots. Two slots and of course being there in that type case It's just one usable slot, As a 295 or newer would cover both, I'd rather go for an Asrock X58 Deluxe which as of Bios 1.2(It's at Bios revision 2.0 right now) supports four GTX295(Their site says GTX296, The support website is in Taiwan, So that's close enough) cards and I saw that Fred W mentioned Boinc as not supporting more than 8 gpus per install(4 cards) and good luck getting the Devs to change that, He said He tried already. The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's |
Fred W Send message Joined: 13 Jun 99 Posts: 2524 Credit: 11,954,210 RAC: 0 |
...and I saw that Fred W mentioned Boinc as not supporting more than 8 gpus per install(4 cards) and good luck getting the Devs to change that, He said He tried already. Not guilty, M'Lud. I saw that post too but it wasn't mine. I have (well, don't have ATM as it's on RMA with XFX) only one GTX295. F. |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.