Setting up Linux to crunch CUDA90 and above for Windows users

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 113 · 114 · 115 · 116 · 117 · 118 · 119 . . . 162 · Next

AuthorMessage
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2001639 - Posted: 8 Jul 2019, 15:00:44 UTC - in response to Message 2001634.  

ID: 2001639 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2001641 - Posted: 8 Jul 2019, 15:02:03 UTC - in response to Message 2001634.  

I would say there is an improvement in the 0.98 code compared to 0.97. I proved that to myself when I benched the betas for Petri before wide release. But Ian states that his beta of the 0.98b1 CUDA10 with driver version 410 beats out the 0.98b1 CUDA101 version with drivers 418. He kept his beta release and is running that to great effect. I was not a tester of that version so never got a chance to benchmark it.


. . Would you say that improvement (0.98b over 0.97) is enough to bother updating? I am running 0.97 on both the rig with 970s and the rig with the 1050ti (which sadly is using the repository version of BOINC) so after reading things like the comment that the 101 version is only useful on Turing cards I am not confident it would make any significant difference on my rigs.

Stephen

? ?


it's absolutely worth updating. just because there is still a CUDA 9.0 version of the app, doesn't mean it's the same app. v0.98 is quite a bit faster than v0.97.

if you have a Turing card, then the CUDA 10+ apps are very slightly faster than 9.0. but v0.98 is faster than 0.97 all else being equal.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2001641 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2001643 - Posted: 8 Jul 2019, 15:27:28 UTC - in response to Message 2001641.  

I would say there is an improvement in the 0.98 code compared to 0.97. I proved that to myself when I benched the betas for Petri before wide release. But Ian states that his beta of the 0.98b1 CUDA10 with driver version 410 beats out the 0.98b1 CUDA101 version with drivers 418. He kept his beta release and is running that to great effect. I was not a tester of that version so never got a chance to benchmark it.


. . Would you say that improvement (0.98b over 0.97) is enough to bother updating? I am running 0.97 on both the rig with 970s and the rig with the 1050ti (which sadly is using the repository version of BOINC) so after reading things like the comment that the 101 version is only useful on Turing cards I am not confident it would make any significant difference on my rigs.

Stephen

? ?


it's absolutely worth updating. just because there is still a CUDA 9.0 version of the app, doesn't mean it's the same app. v0.98 is quite a bit faster than v0.97.

if you have a Turing card, then the CUDA 10+ apps are very slightly faster than 9.0. but v0.98 is faster than 0.97 all else being equal.


So for a Linux Tbar system that is running strickly gtx type nvidia video cards then going back to the 98? version included in the setup 10 and downgrading to one step below the 4.18 video driver is a good idea? Or did I miss something?
A proud member of the OFA (Old Farts Association).
ID: 2001643 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2001652 - Posted: 8 Jul 2019, 15:57:11 UTC - in response to Message 2001643.  

I'm not sure I understand what you're asking.

V0.98b1 CUDA 9.0 is faster than V0.97 CUDA 9.0
V0.98b1 CUDA 10.0 is faster than V0.97 CUDA 10.0
CUDA 10 (or 10.1) vs CUDA 9 is probably negligible, only showing a slight advantage to the Turing cards
the v0.98 app is anywhere from 10-30% faster on average than v0.97 in my tests (varied by WU and type)


I found the best performance with the CUDA 10 app over the 10.1 app, but the difference has little or nothing to do with the app itself. The difference is due to the drivers needed.

I found upwards of 5% reduction in processing speed when using drivers 415+. Nvidia did "something" that caused this slowdown. since the CUDA 10.1 app requires 418+ drivers to be used, you get hit with this slowdown from the DRIVERS, not the app. So since all of my cards now are early versions of Turing that can use the 410 drivers, my personal preferred setup is the CUDA 10 app with 410 drivers. If you have any of the later Turing cards (RTX 2060, GTX 16-series, RTX Super series) you will be required to use the later drivers for compatibility anyway.

the v0.98 app is anywhere from 10-30% faster on average than v0.97 in my tests (varied by WU and type)

if you have a GTX 10-series card, I would probably use the v0.98b1 CUDA 9.0 app with drivers 410 or lower.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2001652 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2001661 - Posted: 8 Jul 2019, 16:49:14 UTC - in response to Message 2001652.  

I'm not sure I understand what you're asking.


You nailed the answer though. Thank you.
I will see if I can migrate back down to 4.15

Tom
A proud member of the OFA (Old Farts Association).
ID: 2001661 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2001670 - Posted: 8 Jul 2019, 17:44:35 UTC - in response to Message 2001661.  

no, you need 410 or lower. 415 and later is when i noticed the slowdown. also make sure you're pairing that with the CUDA 90 app, as the CUDA 10.1 app wont run on any driver less than 418.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2001670 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2001671 - Posted: 8 Jul 2019, 17:46:35 UTC - in response to Message 2001670.  

no, you need 410 or lower. 415 and later is when i noticed the slowdown. also make sure you're pairing that with the CUDA 90 app, as the CUDA 10.1 app wont run on any driver less than 418.


Thank you for the correction.

As far as I can tell, the CUDA10 archive has a "cuda9" in it that will run 4.10?

Tom
A proud member of the OFA (Old Farts Association).
ID: 2001671 · Report as offensive     Reply Quote
Loren Datlof

Send message
Joined: 24 Jan 14
Posts: 73
Credit: 19,652,385
RAC: 0
United States
Message 2001672 - Posted: 8 Jul 2019, 17:51:11 UTC

Well I finally upgraded the drivers and now I am crunching, for better or worse, with CUDA101 on all my hosts that have the capability to do so.
ID: 2001672 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2001673 - Posted: 8 Jul 2019, 17:52:37 UTC - in response to Message 2001671.  
Last modified: 8 Jul 2019, 17:53:44 UTC

i don't know what you mean by "CUDA10 archive"

but the app you want to use with the 410 (or lower) drivers will be the CUDA90 app. This is CUDA 9.0 enabled. not CUDA 10. I have a beta version that is CUDA 10 (not 10.1) enabled.

the apps available to you in the latest standard All-In-One package are the CUDA 9.0 and CUDA 10.1 app. choose the 9.0 one. You wont see any benefit using a CUDA 10+ app on your GTX 10-series cards.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2001673 · Report as offensive     Reply Quote
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 2001676 - Posted: 8 Jul 2019, 18:46:21 UTC

So any idea how much of a gain there is going from cuda10.1 to cuda9 on a 10x0 only system?
ID: 2001676 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2001677 - Posted: 8 Jul 2019, 18:52:40 UTC - in response to Message 2001676.  

probably none by just changing the app alone.

but you could get some extra speed by changing the app AND the drivers down to 410 or lower (and then using the 9.0 app, since the 10.1 app wont work with the older drivers). the speed boost will come from the drivers, not the app.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2001677 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2001678 - Posted: 8 Jul 2019, 18:56:05 UTC - in response to Message 2001673.  

i don't know what you mean by "CUDA10 archive"

but the app you want to use with the 410 (or lower) drivers will be the CUDA90 app. This is CUDA 9.0 enabled. not CUDA 10. I have a beta version that is CUDA 10 (not 10.1) enabled.

the apps available to you in the latest standard All-In-One package are the CUDA 9.0 and CUDA 10.1 app. choose the 9.0 one. You wont see any benefit using a CUDA 10+ app on your GTX 10-series cards.


I downloaded a new copy. And it appears I was running an unknown previous version of the 10.1 archive.
It was throwing computation errors.

Installed the "new" archive over the top of the "old" stuff. Put in the "-nobs" in the app_info.xml file.

Running it now with NNT while I confirm it has stopped throwing "computation errors".

Tom
A proud member of the OFA (Old Farts Association).
ID: 2001678 · Report as offensive     Reply Quote
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 2001689 - Posted: 8 Jul 2019, 19:56:10 UTC
Last modified: 8 Jul 2019, 20:01:19 UTC

My new host wont see the GPU in ubuntu. What am I did wrong?

quotro P2000

event says app version refers to missing nvidia gpu
ID: 2001689 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2001690 - Posted: 8 Jul 2019, 20:00:05 UTC - in response to Message 2001689.  
Last modified: 8 Jul 2019, 20:02:12 UTC

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2001690 · Report as offensive     Reply Quote
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 2001691 - Posted: 8 Jul 2019, 20:04:20 UTC - in response to Message 2001690.  

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.


Drivers are UP, sorry its a P2000 not K2000.
ID: 2001691 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2001694 - Posted: 8 Jul 2019, 20:17:09 UTC - in response to Message 2001691.  
Last modified: 8 Jul 2019, 20:19:09 UTC

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.


Drivers are UP, sorry its a P2000 not K2000.

OK, sorry about the confusion. Able to use the special app. What does any of the programs I mentioned show for drivers? Which Nvidia version did you install?

Have you rebooted the system yet after installing the Nvidia drivers?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2001694 · Report as offensive     Reply Quote
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 2001695 - Posted: 8 Jul 2019, 20:19:27 UTC - in response to Message 2001694.  
Last modified: 8 Jul 2019, 20:27:57 UTC

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.


Drivers are UP, sorry its a P2000 not K2000.

OK, sorry about the confusion. Able to use the special app. What does any of the programs I mentioned show for drivers? Which Nvidia version did you install?

nvidia X server is also showing the gpu as P2000.
Have you rebooted the system yet after installing the Nvidia drivers?


precision@precision-Precision-3630-Tower:~$ lspci -vnn | grep -i VGA -A 12
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2000] [10de:1c30] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Dell GP106GL [Quadro P2000] [1028:11b3]
Flags: bus master, fast devsel, latency 0, IRQ 141
Memory at a3000000 (32-bit, non-prefetchable) [size=16M]
Memory at 90000000 (64-bit, prefetchable) [size=256M]
Memory at a0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000 [size=128]
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: <access denied>
Kernel driver in use: nouveau
Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia

01:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)

Driver 418.

Seems GPU was picked up, after bios update

NVIDIA Quadro P2000 (4095MB) driver: 418.56 OpenCL: 1.2
ID: 2001695 · Report as offensive     Reply Quote
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 2001698 - Posted: 8 Jul 2019, 20:28:29 UTC - in response to Message 2001677.  

probably none by just changing the app alone.

but you could get some extra speed by changing the app AND the drivers down to 410 or lower (and then using the 9.0 app, since the 10.1 app wont work with the older drivers). the speed boost will come from the drivers, not the app.

Yes of course with changing drivers. I'm asking because if the gain is very small I'm not going to change anything.
ID: 2001698 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2001699 - Posted: 8 Jul 2019, 20:29:18 UTC - in response to Message 2001695.  

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.


Drivers are UP, sorry its a P2000 not K2000.

OK, sorry about the confusion. Able to use the special app. What does any of the programs I mentioned show for drivers? Which Nvidia version did you install?

Have you rebooted the system yet after installing the Nvidia drivers?


precision@precision-Precision-3630-Tower:~$ lspci -vnn | grep -i VGA -A 12
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2000] [10de:1c30] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Dell GP106GL [Quadro P2000] [1028:11b3]
Flags: bus master, fast devsel, latency 0, IRQ 141
Memory at a3000000 (32-bit, non-prefetchable) [size=16M]
Memory at 90000000 (64-bit, prefetchable) [size=256M]
Memory at a0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000 [size=128]
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: <access denied>
Kernel driver in use: nouveau
Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia

01:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)

Driver 418.

Look at what I highlighted RED

You have not rebooted the system since installing the 418 drivers. You have to reboot the system to use or change over to any different driver since the drivers are incorporated into a new kernel that is built when you change drivers.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2001699 · Report as offensive     Reply Quote
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 2001701 - Posted: 8 Jul 2019, 20:31:36 UTC - in response to Message 2001699.  

My new host wont see the GPU in ubuntu. What am I did wrong?

Did you install the Nvidia drivers? If you did. . . . what does nvidia-smi show? What does Nvidia X Server Settings show? Have you installed clinfo to allow easy checking of installed CUDA and OpenCL drivers?
The Quadro K2000 is not able to use the special app since the card only has CC = 3.0. You will have to use the stock SoG application which requires OpenCL.


Drivers are UP, sorry its a P2000 not K2000.

OK, sorry about the confusion. Able to use the special app. What does any of the programs I mentioned show for drivers? Which Nvidia version did you install?

Have you rebooted the system yet after installing the Nvidia drivers?


precision@precision-Precision-3630-Tower:~$ lspci -vnn | grep -i VGA -A 12
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2000] [10de:1c30] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Dell GP106GL [Quadro P2000] [1028:11b3]
Flags: bus master, fast devsel, latency 0, IRQ 141
Memory at a3000000 (32-bit, non-prefetchable) [size=16M]
Memory at 90000000 (64-bit, prefetchable) [size=256M]
Memory at a0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000 [size=128]
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: <access denied>
Kernel driver in use: nouveau
Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia

01:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)

Driver 418.

Look at what I highlighted RED

You have not rebooted the system since installing the 418 drivers. You have to reboot the system to use or change over to any different driver since the drivers are incorporated into a new kernel that is built when you change drivers.


Lesson learned, thank you
ID: 2001701 · Report as offensive     Reply Quote
Previous · 1 . . . 113 · 114 · 115 · 116 · 117 · 118 · 119 . . . 162 · Next

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.