How many gpus can you run on an AMD AM4 socket motherboard? (Ryzen 7 1900, 2700 etc)

Message boards : Number crunching : How many gpus can you run on an AMD AM4 socket motherboard? (Ryzen 7 1900, 2700 etc)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1997339 - Posted: 8 Jun 2019, 2:46:37 UTC - in response to Message 1997317.  

The TDP for the 12core is the same as the 8 core 2700X. The rumored TDP of the 16 core is 125W or 135W.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1997339 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997387 - Posted: 8 Jun 2019, 11:29:58 UTC - in response to Message 1997339.  

The TDP for the 12core is the same as the 8 core 2700X. The rumored TDP of the 16 core is 125W or 135W.


Which would leave it out of safe reach of my TB350-BTC. Oh well.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997387 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997873 - Posted: 12 Jun 2019, 0:43:43 UTC

Yesterday I finished setting up a Asrock B450 Pro4 motherboard.
It has 6 pcie slots. It has been flashed to the very latest bios so in theory it could run the Ryzen 9 cpus.

That version of the Bios does not have a "standard" toggle to enable "Above 4G" decoding to allow for a higher number of pcie devices.
It also will boot and crunch on all 6 gpu slots.
The only reason it is not doing that now is my office ran out of power "headroom" and 6 gpus started blowing the breaker.

The cpu is an Ryzen 2600 (6c/12t) and under "auto" it is crunching along at around 3.6Ghz.

So once I get my power to the office upgraded. And once I have the money for an Ryzen 9 3950x and once they start shipping it. I will have to decide if I want to try it out, probably on the Asrock MB.

My Biostar TB350-BTC appears to be a 1st generation AM4 motherboard so it doesn't support any of the improvements of the Zen+ cpus even though I am running a Ryzen 7 2700 on it.
The Asrock B450 Pro4 motherboard does seem to be a Zen+ MB but apparently because of the Bios flash update, all the extra toggles that I was expecting are not on there? And I haven't gotten my external bios flasher to work so I can't back flash and check.

In recap, it now looks like we have at least two AM4 motherboards below the X470/X570 models that will run at least 6 gpus.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997873 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997976 - Posted: 13 Jun 2019, 1:11:38 UTC - in response to Message 1997873.  
Last modified: 13 Jun 2019, 1:11:58 UTC

Yesterday I finished setting up a Asrock B450 Pro4 motherboard.
It has 6 pcie slots. It has been flashed to the very latest bios so in theory it could run the Ryzen 9 cpus.
==Edit===
In recap, it now looks like we have at least two AM4 motherboards below the X470/X570 models that will run at least 6 gpus.

Tom


To test if the Asrock would boot/run more than 6 gpus I borrowed "several" gpus from my Biostar MB.

After a fair amount of tinkering I believe it is possible that the Asrock MB could run 7 gpus. However I didn't have time for any kind of extended run to see if it crashed pretty soon or not.
I am pretty sure it will not run 8 or 9 gpus.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997976 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1999165 - Posted: 22 Jun 2019, 13:59:18 UTC

Under the "I shoulda known" sub-thread...

I had managed to get my Biostar tb350-btc/Ryzen 7 2700 upto 3.9GHz under a pair of DDR4-3000 ram I had swapped in "temporarily" because I wanted to try the DDR4-3200 out on my "new" 2600.

I was not happy with the cpu processing with some of our latest tasks. Average processing had ballooned to over an hour. It looked like 3.9GHz was actually processing cpu tasks slower than 3.7GHz.

So I said, lets put some "3200" memory back in there. It "oughta" speed it up. Right?

All the settings in the bios (cpu voltage etc) crashed and burned causing the bios to do a re-set to default.

As of a little while ago I am back up to 3.7GHz with a much lower cpu voltage offset.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1999165 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1999889 - Posted: 27 Jun 2019, 5:21:51 UTC - in response to Message 1999165.  

[quote]Under the "I shoulda known" sub-thread...
[quote]

Apparently exchanging two gtx 1060 3G's for gtx 1070's can screw it up too. Back at 100% defaults except for XMP#1 on ram, 4G decode and Mining mode in "above.... something". Not 6 gpu mode.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1999889 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1999892 - Posted: 27 Jun 2019, 6:05:41 UTC - in response to Message 1999889.  

Must be the extra RAM on each card compared to the 3GB cards. You need more VGA memory workspace to map the card resources in the BIOS. The "Above 4G decoding" I guess is the solution.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1999892 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1999908 - Posted: 27 Jun 2019, 12:30:46 UTC - in response to Message 1999892.  

Must be the extra RAM on each card compared to the 3GB cards. You need more VGA memory workspace to map the card resources in the BIOS. The "Above 4G decoding" I guess is the solution.


It was starting up ok, but then was quitting/app crashing later. The "Above 4G" was engaged. It looks like it is still running as of the moment in "almost" all default. Will start turning up the cpu multiplier today.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1999908 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2007485 - Posted: 15 Aug 2019, 13:19:52 UTC

It turns out there is a difference in the # of gpu's you can run on a Biostar TB350-BTC.
With a 2700 cpu you can run 9 by using the "Over VGA?" in the mining toggle in the bios.
With a 2600 cpu you can only run 7. The "Over VGA?" toggle won't work (it boots back to the bios).

My current guess for running a Biostar TB350-BTC is run a Amd Ryzen 2700/2700x whatever you have. Disable the CPD and run "everything" else on auto except your ram which you can run using the XMP profile.

This should result in a pretty cheap, stable Seti cruncher with upto 9 gpus.

I have had significant trouble trying to overclock the cpu. But running on auto, the gpus still crunch as fast as they do.

I am NOT confident you can run an Amd Ryzen 9 3900x or 3950x on this MB even though the MB does have a Ryzen 3000 bios upgrade available (and that upgrade will run Ryzen 2600/2700 cpus.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2007485 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2007487 - Posted: 15 Aug 2019, 13:22:35 UTC

After significant testing on an ASUS Crosshair 7 Hero MB (using a 2700 cpu) I can say, so far, I can only get 6 gpus to boot. It dies in the POST when you go for 7.

That said, it has a lot of VRM resources and I expect to get high, stable cpu OC out of it (waiting on a new cpu cooler).

Tom
A proud member of the OFA (Old Farts Association).
ID: 2007487 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2013333 - Posted: 25 Sep 2019, 23:37:10 UTC

Latest report on an Amd 2700 spinning along at 4Ghz while driving 6 gpus. Its on a ROG Crosshair 7 Hero that I have to thank Keith for convincing me to try out. The cpu is being cooled by one rather large Noctua air-cooler and one rather small Noctua fan blowing air up through the cpu socket.
The LLC is set to 3.

tom@EJS-GIFT:~$ sensors
asuswmisensors-isa-0000
Adapter: ISA adapter
CPU Core Voltage:         +1.26 V  
CPU SOC Voltage:          +1.04 V  
DRAM Voltage:             +1.40 V  
VDDP Voltage:             +0.74 V  
1.8V PLL Voltage:         +1.96 V  
+12V Voltage:            +11.83 V  
+5V Voltage:              +4.99 V  
3VSB Voltage:             +3.36 V  
VBAT Voltage:             +3.23 V  
AVCC3 Voltage:            +3.38 V  
SB 1.05V Voltage:         +1.07 V  
CPU Core Voltage:         +1.27 V  
CPU SOC Voltage:          +1.04 V  
DRAM Voltage:             +1.41 V  
CPU Fan:                 1205 RPM
Chassis Fan 1:           4560 RPM
Chassis Fan 2:              0 RPM
Chassis Fan 3:              0 RPM
HAMP Fan:                   0 RPM
Water Pump:                 0 RPM
CPU OPT:                    0 RPM
Water Flow:                 0 RPM
AIO Pump:                1431 RPM
CPU Temperature:          +66.0°C  
CPU Socket Temperature:   +44.0°C  
Motherboard Temperature:  +30.0°C  
Chipset Temperature:      +46.0°C  
Tsensor 1 Temperature:   +216.0°C  
CPU VRM Temperature:      +49.0°C  
Water In:                +216.0°C  
Water Out:               +216.0°C  
CPU VRM Output Current:  +81.00 A  

k10temp-pci-00c3
Adapter: PCI adapter
temp1:        +66.8°C  (high = +70.0°C)

asus-isa-0000
Adapter: ISA adapter
cpu_fan:        0 RPM

tom@EJS-GIFT:~$ 


Tom
A proud member of the OFA (Old Farts Association).
ID: 2013333 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2013340 - Posted: 26 Sep 2019, 1:07:16 UTC

Your welcome :-} The C7H is a very solid board. Good temps under load there too.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2013340 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2027540 - Posted: 13 Jan 2020, 0:50:26 UTC

Thank you Mr. Moderator.

I have asked to restart this thread because except for some unstable results with a Biostar B..... I mostly haven't been able to get past a 6 gpu limit on AM4 socketed motherboards running 2700/2700x/3900x/3950x.

I have found that the CH7 that Keith recommended seems to be ultra-stable but I have not been able to get past 6 gpus. And I don't think it's bios includes an "Above 4G" setting that will allow you to sometimes increase your total available gpu's.

Has anyone got a fresh lead on getting more than 6 gpu's to run reliably on an AM4 (AMD) Motherboard?

Tom
A proud member of the OFA (Old Farts Association).
ID: 2027540 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2027579 - Posted: 13 Jan 2020, 17:20:42 UTC

And I don't think it's bios includes an "Above 4G" setting that will allow you to sometimes increase your total available gpu's.

It does show up in the BIOS settings when you print/save them out to a USB stick in the BIOS on other ASUS boards. I found a printout from a board that had the setting. I don't see it in my 2801 BIOS printout though. You might have to use one of the modified BIOS to see it.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2027579 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2027603 - Posted: 14 Jan 2020, 0:15:45 UTC

I just finished testing an Asus Prime X470-Pro motherboard.

It has 6 PCIe slots and will run 6 video cards.

It has 2 M.2 type slots. When I installed an adaptor to allow me to try to run another gpu the MB suddenly only had 4 working GPUs with 7 plugged in.

I tried a 1 to 4 expander in one of the long slots after removing the M.2 adaptor. No joy there.

So this MB using an Amd 2700 with a bios version: 5204

I will retest it with the Ryzen 3000 bios upgrade because this MB will become home to an AMD 3900x in the near future.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2027603 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2027604 - Posted: 14 Jan 2020, 0:18:30 UTC - in response to Message 2027579.  

And I don't think it's bios includes an "Above 4G" setting that will allow you to sometimes increase your total available gpu's.

It does show up in the BIOS settings when you print/save them out to a USB stick in the BIOS on other ASUS boards. I found a printout from a board that had the setting. I don't see it in my 2801 BIOS printout though. You might have to use one of the modified BIOS to see it.


If it "prints out" does that mean you can "find" it and enable it or does just means you can see it on the printout?
Could you expand on "modified Bios" please? I am assuming it is not something that ASUS makes available.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2027604 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2027608 - Posted: 14 Jan 2020, 1:25:13 UTC - in response to Message 2027604.  

If it "prints out" does that mean you can "find" it and enable it or does just means you can see it on the printout?
Could you expand on "modified Bios" please? I am assuming it is not something that ASUS makes available.

It means it is in the BIOS. Depends on the motherboard and on the BIOS. Whether the setting is exposed in the BIOS interface is another question. A lot of settings are in the BIOS but are not visible in the interface. If you have a F9 "find" feature, sometimes you can find it that way. But that does not necessarily mean that changing the found "feature" actually implements the change. Sometimes it does and sometimes it does not. AMD is constantly adding and removing features in every BIOS. HPET is in and out over and over again for example. Lots of other examples like fan interfaces and such.

A modified BIOS is just that, someone ( a BIOS modder) has taken the stock OEM BIOS and either added back missing features or exposed features in the BIOS that are not visible in the BIOS interface. You need specific tools to modify the BIOS and some knowledge. Much easier with the pre-Ryzen 3000 BIOS's since they only had one BIOS comprising 16GB of code. The Ryzen 3000 BIOS' have 32GB of code and comprise a Ryzen 2000 BIOS in addition to a Ryzen 3000 BIOS in the same code. Some elements between the two BIOS images are shared as in the AGESA code.

That is why it is sometime better to stick with a Ryzen 2000 BIOS for Ryzen 2000 parts and not upgrade to the dual BIOS' that can handle both Ryzen 2000 and Ryzen 3000 parts. Lots of reports that performance degrades on the Ryzen 2000 cpus when run with a dual BIOS.

If you want to learn how to modify the BIOS, then go to the OCN and read through the Ryzen BIOS modder thread or the Ryzen Memory threads.
https://www.overclock.net/forum/11-amd-motherboards/1640394-ryzen-bios-mods-how-update-bios-correctly.html
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2027608 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2027609 - Posted: 14 Jan 2020, 1:44:07 UTC

If you search the OCN forums, you will get the most hits on X99 mobos. But I even see hits on B450 mobos by various vendors.

In case you didn't know "above 4G decoding" was mainly put in for TITAN or Tesla or Quadro gpus with 16GB or 24GB of video RAM. You can't get the boards to be recognized without above 4G decoding enabled as the mapped RAM space intrudes into the normal x86 mapped I/O memory space.
https://www.msi.com/faq/motherboard-2726
https://superuser.com/questions/1239231/what-is-above-4g-decoding
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2027609 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2027629 - Posted: 14 Jan 2020, 4:03:42 UTC

Tom, are the extenders that you're using PLX chip equipped or not?

If not then you may need to invest in 1 that is to get over the limitations that you're experiencing. ;-)

Cheers.
ID: 2027629 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2028228 - Posted: 17 Jan 2020, 23:57:28 UTC - in response to Message 2027629.  

Tom, are the extenders that you're using PLX chip equipped or not?

If not then you may need to invest in 1 that is to get over the limitations that you're experiencing. ;-)

Cheers.


I need to find a listing for a PLX chip on an extender.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2028228 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

Message boards : Number crunching : How many gpus can you run on an AMD AM4 socket motherboard? (Ryzen 7 1900, 2700 etc)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.