Ah! So I am already using it!

Sweet!

Whats this "Petri's software"??

Petri created the source code for CUDA9x and Tbar has been compiling it, packaging it and making it available as well as supporting it.
And doing debug work on it.

Tom

---

"I owe", "I owe", "Its off to work I go" (from a bumper sticker on a smallish Mercedes Benz)
(on the back of a Semi Tractor) "If you can read this bumper sticker, I've LOST MY TRAILER!"

Thanks Tom!

You and TBar are a real source of help.

The #1 guy on the planet W3Perl, I asked him how he does it, over 100 PC's...
He mentioned to be sure to use Petri's software with the latest nvidia driver (410.77)

Then he shot me the link to the Crunchers Anonymous forum where I see a lot of TBar's contributions.

Whats this "Petri's software"??

I tried adding an AMD card for #9 and it boots but I dont know about mixing drivers, flavors of cards yet...

Anyone??

I will try 396.54 again later.

How does one call Nvidia tech support?

Based on the reviews for that MB, mixing Nvidia and AMD drivers should not be an issue.

It is possible to not use the Nvidia install of drivers and use the "software updater" in Linux. If you use the "PPA" addon so you get the beta test stuff you can use it to install both the 396 type driver and lately it has the 410 driver. I am using the 396.

Adding this PPA to your system

You can update your system with unsupported packages from this untrusted PPA by adding ppa:graphics-drivers/ppa to your system's Software Sources. (Read about installing)

sudo add-apt-repository ppa:graphics-drivers/ppa
sudo apt-get update
        

From https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa

Then you use the preferences -> "add drivers" to get to the listings for changing/installing the gpu drivers.

But based on Tbars discussion I would not care to mix the two.

I don't know about calling Nvidia tech support. Sorry.

Tom

---

"I owe", "I owe", "Its off to work I go" (from a bumper sticker on a smallish Mercedes Benz)
(on the back of a Semi Tractor) "If you can read this bumper sticker, I've LOST MY TRAILER!"

Wow.
I guess I was hoping for too much from these power supplies.
That big P/S was so noisy with those two high speed fans I tried to run the rig without it.

I was having an Apollo 13 MAIN BUS B UNDERVOLT situation! ;-)

The big supply doesn't even get warm without those fans running so I took the case off the beast and am blowing enough air on it with my main system cooling box fan to keep it happy to the touch.

More than one GPU was going into cardiac arrest without the AMPS from the BAPS. (Big A** Power Supply)

Live and learn....

Well...
Thats weird.
I guess I am still learning how to use all the data available to me about my system as reported by Seti.
I got 8 cards working on the "stock" Nvidia driver using TBars new version of the app.
Looked good when I went to bed.
Woke up with it doing something very odd I had not seen before.
If I read the results data right, GPU #8?? was having a seizure of some kind?
I replaced it with a different card this morning.

I tried a lot of things last night to see about more than eight GPU's with this driver.
A guy i work with said the black screen might be a driver limitation OR a bad GPU.
Maybe #8 was my red herring?
Was it in #3's spot before I reconfigured? Humm...
I tried adding an AMD card for #9 and it boots but I dont know about mixing drivers, flavors of cards yet...

Anyone??

I will try 396.54 again later.

How does one call Nvidia tech support?

Odd how the error goes on about the problem but the units seem to be crunching...

You should be able to tell the misbehaving GPU by looking at the Values in NVIDIA Settings. The one not working correctly should have some values listed as Unknown, whereas the working GPUs will have the values listed correctly. NVIDIA Settings has the PCIe slot listed, so, identifying the card shouldn't be difficult.

Never thought of that.

Have you try to connect your monitor to each GPU to see the Desktop ?

---

Odd how the error goes on about the problem but the units seem to be crunching...

So maybe I do have a way.
One of the cards are cold. The rest are red hot.
Maybe...

Interesting about #3.
No way to tell which card is #3 in this system ya know?

Yep. For sure did that just as you instructed.
No idea whats happened.
Interesting how the driver I'm using now has this card limitation.
Huh.
One day when I have more time I will try it again.
Lots of steps.
Too bad there cant be a script of some kind developed to install it.
So many steps. To ensure no mistakes... I'm just sayin...

I'm sitting here looking at un-used GPU's and several systems running windows.
DUH. I can fit two each in these other systems except the SYSTEM32. That mobo doesnt like the driver either...

Thanks man.

Looking at your Error List it would Appear Device 3 is has either dropped offline or suffered some Fault. Usually a reboot will fix it.

In cudaAcc_initializeDevice(): Boinc passed DevPref 3
setiathome_CUDA: CUDA Device 3 specified, checking...

If a reboot doesn't fix it, swap the card for a different one and see if the card works in a different machine.

The only difference is you are Now running the Repository driver verses the one from nVidia. As I said, they are different.
The driver usually controls how many GPUs it will drive. I'm running 11 with the nVidia driver.
I don't know why you are having trouble with installing the Driver from nVidia, it works for most people.
The major point is to make sure you have removed ALL of the Repository driver, that means first running,
sudo apt-get remove --purge nvidia*
Then after that run,
sudo apt-get autoremove
If you don't run autoremove, parts of the Repository driver will not be removed and will cause problems with the driver from nVidia.

Now Set says I'm running eight...
Delays delays delays...

TBAR,

I even tried an AMD GPU and that didnt change the behavior...

Heres another odd thing. Now that I have eight GPU's plugged in and running, the stats for that PC in Seti only show 7.

What the heck?

I have 0 through 7 GPU's running units.

Aint that still eight these days?

TBAR! Help me man!

I got my 16GB of new RAM but the OS still wont boot with more than eight cards installed!
I texted you the screen goes black except for this line at the top...
/dev/sda2: clean, 262462/3571712 files, 1897677/142725512 blocks

I thought it was frozen but its not!
It just isn't booting to the desktop! The cursor blinks and the PC is running.
I can get to the console by CTRL ALT F1 and log in but I dont know what I'm doing in there or what to do to try and help.
I can force a reboot but thats all I know how to do.

If I turn the PC off and remove the 9th GPU and turn it on, when the system boots, it shows a box about "This system has encountered and error" or something like that.

Any idea at all how to get the OS to boot with more than 8 GPU's plugged in and or why it might not be booting?
It used to...
Now it dont...

Fudge.

Dave

System froze up. Down to 7 GPU's...

Not sure if this is useful to your efforts but I just caught one work unit stalled over 10 min at almost 80% complete...
I ordered another set of 16GB of RAM, quality name brand RAM this time. Cant wait for it to get here on the chance thats the problem.