Setting up Linux to crunch CUDA90 and above for Windows users

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 98 · 99 · 100 · 101 · 102 · 103 · 104 . . . 162 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1994308 - Posted: 19 May 2019, 7:38:21 UTC - in response to Message 1994306.  

Decided to take the plunge and moved 2 boxes to Linux.

Should give the output a good lift.
Grant
Darwin NT
ID: 1994308 · Report as offensive     Reply Quote
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1994313 - Posted: 19 May 2019, 9:49:36 UTC - in response to Message 1994308.  

Decided to take the plunge and moved 2 boxes to Linux.

Should give the output a good lift.


Possibly. I have removed a gpu from syphilis (now down to 2 gpus from 3). Smallpox (2 gpus) hasn't been running for a few months so output has been zero on that front. I do take your point though, it will be interesting to see where they land. Syphilis was averaging around 42k prior to the GTX 780 TI coming out so will be interesting to see if the throughput keeps things constant or not.
ID: 1994313 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1994332 - Posted: 19 May 2019, 15:33:32 UTC - in response to Message 1994306.  

Decided to take the plunge and moved 2 boxes to Linux.


. . They should achieve 6 digit RACs.

Stephen

:)
ID: 1994332 · Report as offensive     Reply Quote
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1994415 - Posted: 20 May 2019, 5:21:49 UTC - in response to Message 1994332.  

Decided to take the plunge and moved 2 boxes to Linux.


. . They should achieve 6 digit RACs.

Stephen

:)


How's the Ryzen project going?
ID: 1994415 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1994424 - Posted: 20 May 2019, 9:33:40 UTC - in response to Message 1994415.  

How's the Ryzen project going?


. . It's still running Windows and SoG. I have tried a few times to get Linux up and running SETI but while I can get it going, after a short while it loses the eternet port and goes permanently offline. But when I boot back into Windows the port is just fine again. There is something funny about the Linux drivers and this Ryzen mobo. So far it is above my pay grade.

Stephen

<shrug>
ID: 1994424 · Report as offensive     Reply Quote
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1994453 - Posted: 20 May 2019, 14:28:27 UTC - in response to Message 1994424.  

I have only had that type of a problem on 1 computer - happens that is a 1700x/Gigabit board.

In my case it is when a PCI extender is flaky and drops offline. That takes down the Ethernet, be it wirer or wireless adaptor.

All I can say is leave NVidia-smi open to see if they go down together.
ID: 1994453 · Report as offensive     Reply Quote
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1994485 - Posted: 20 May 2019, 20:23:19 UTC

Some weeks ago there was talk about a new version (99b1?) of the special app been tested by petri, as I recall it sounded as it was close to be ready for release. Any news about that?
ID: 1994485 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1994486 - Posted: 20 May 2019, 20:57:15 UTC - in response to Message 1994485.  

Still in development I guess. Haven't heard a peep of any progress report.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1994486 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1994493 - Posted: 20 May 2019, 22:36:55 UTC - in response to Message 1994453.  

I have only had that type of a problem on 1 computer - happens that is a 1700x/Gigabit board.

In my case it is when a PCI extender is flaky and drops offline. That takes down the Ethernet, be it wirer or wireless adaptor.

All I can say is leave NVidia-smi open to see if they go down together.


. . No extenders in this rig, it is running just the two 1060s. A shame because it should be my best producer.

Stephen

:(
ID: 1994493 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1994497 - Posted: 20 May 2019, 23:06:02 UTC - in response to Message 1994424.  

How's the Ryzen project going?


. . It's still running Windows and SoG. I have tried a few times to get Linux up and running SETI but while I can get it going, after a short while it loses the eternet port and goes permanently offline. But when I boot back into Windows the port is just fine again. There is something funny about the Linux drivers and this Ryzen mobo. So far it is above my pay grade.

Stephen

<shrug>

What Ryzen motherboard is it? Have you updated the Linux firmware so that it has the latest motherboard drivers?
Do you have a lot of SATA and M.2 drives installed? The Ryzen cpu and PCH chipset can only support certain configurations with certain devices. The host runs out of PCIe resources.

I just found this really neat image of the new X570 motherboard PCI layout with how it handles resources. This demonstrates why for example you can't plug a gpu into the X4 slot and also install a M.2 drive that is served out of the PCH. One or the other, but never both can be installed.

Notice how the Wi-Fi and Ethernet port are served out of the PCH. If you have a gpu installed into the X4 slot you have to configure the BIOS to separate the PCI resources coming out of the PCH.
For example this is part of my BIOS configuration.

M.2_2 PCIe Bandwidth Configuration
[Auto] Auto-detects the M.2_2 slot. If an M.2 device is detected,
PCIEX16_1 and PCIEX8_2 will run at x8/x4 mode, respectively.
[Disabled(X8 mode)] Disable M.2_2 for PCIEX16_1 and PCIEX8_2 running on high
performance. (x16 or x8/x8)
[Disabled(X4/X4 mode)] Disable M.2_2 with PCIEX8_2 running on x4/x4 for PCIE Raid
card.
PCIEX16/X8_1 Mode
This item allows you to set the link speed for PCIEX16/X8_1 slot.
Configuration options: [Auto] [GEN 1] [GEN 2] [GEN 3]
PCIEX8/X4_2 Mode
This item allows you to set the link speed for PCIEX8/X4_2 slot.
Configuration options: [Auto] [GEN 1] [GEN 2] [GEN 3]
PCIEX4_3 Mode
This item allows you to set the link speed for PCIEX4_3 slot.
Configuration options: [Auto] [GEN 1] [GEN 2]
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1994497 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1995015 - Posted: 24 May 2019, 14:58:33 UTC - in response to Message 1994497.  
Last modified: 24 May 2019, 15:00:30 UTC


. . It's still running Windows and SoG. I have tried a few times to get Linux up and running SETI but while I can get it going, after a short while it loses the eternet port and goes permanently offline. But when I boot back into Windows the port is just fine again. There is something funny about the Linux drivers and this Ryzen mobo. So far it is above my pay grade.
Stephen
<shrug>

What Ryzen motherboard is it? Have you updated the Linux firmware so that it has the latest motherboard drivers?
Do you have a lot of SATA and M.2 drives installed? The Ryzen cpu and PCH chipset can only support certain configurations with certain devices. The host runs out of PCIe resources.


. . OK, this is the hardware list...

ASUS PRIME X370-Pro mobo
2 x Corsair Vengeance DDR4 2666MHz 8GB ram
EVGA SuperNova G2 750W Gold PSU
Samsung 850 EVO 250GB SSD on 0-0-0 (Windows drive)
Sandisk 120GB SSD on 1-0-0 (Linux drive)
Sandisk Ultra 16GB USB 3.0 flashdrive on Port 4 Hub 1(SETI data drive for Windows)
Seagate 1TB ST1000 HDD on 4-0-0
CD Drive ASUS DRW 24D5MT on 5-0-0
GTX1060-6GB on PCIe x 16 slot 1
GTX1060-6GB on PCIe x 16 slot 3 (which runs in x4 mode)

. . I believe that should be conflict free for on board mobo resources.

Stephen

? ?
ID: 1995015 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995016 - Posted: 24 May 2019, 15:16:23 UTC - in response to Message 1995015.  
Last modified: 24 May 2019, 15:34:15 UTC

That is a lot of storage drives attached to your computer. They all need resources. I would refer you to section 1-6 in your manual for the IRQ interrupt table which shows which slots, devices and controllers share IRQ resources of which one of them is the LAN chip served out of the PCH chip.

I never had more than 3 storage devices connected and have never lost the LAN port except for the motherboard I killed when I scraped a SMD device off the backside of the board near the cpu socket. That was self-inflicted.

[Edit]Not sure about your designations on your drives. Maybe port#'s? The 4 and 5 ports are served out of the Asmedia controller and there is a disclaimer in the manual not to use those ports if you intend to use a graphics card in one of the PCIe slots are the speeds will get pulled down to X4 or something.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995016 · Report as offensive     Reply Quote
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1995065 - Posted: 24 May 2019, 21:33:25 UTC - in response to Message 1995016.  

Might sound like a silly question, but is there a thread around where you can see/post comments on the, I think it is, x41p_V0.98 optimised app with Linux?
ID: 1995065 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995069 - Posted: 24 May 2019, 21:47:19 UTC - in response to Message 1995065.  

I would say either this thread or the High Performance Linux clients at SETI
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995069 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995081 - Posted: 24 May 2019, 22:59:24 UTC

Missed this news yesterday. It looks like the .ISO image for Ubuntu 19.10 is going to come with the proprietary Nvidia 390 and 418 drivers in it. So you will be able to install them after the initial default Nouveau driver installation without having any network connection.
https://www.phoronix.com/scan.php?page=news_item&px=Ubuntu-19.10-NVIDIA-On-ISO
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995081 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1995095 - Posted: 25 May 2019, 0:15:47 UTC - in response to Message 1995081.  

Missed this news yesterday. It looks like the .ISO image for Ubuntu 19.10 is going to come with the proprietary Nvidia 390 and 418 drivers in it. So you will be able to install them after the initial default Nouveau driver installation without having any network connection.
https://www.phoronix.com/scan.php?page=news_item&px=Ubuntu-19.10-NVIDIA-On-ISO


. . That's a good move ...

Stephen

:)
ID: 1995095 · Report as offensive     Reply Quote
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1995262 - Posted: 25 May 2019, 21:56:49 UTC - in response to Message 1995069.  

I would say either this thread or the High Performance Linux clients at SETI


thank you
ID: 1995262 · Report as offensive     Reply Quote
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34748
Credit: 261,360,520
RAC: 489
Australia
Message 1995317 - Posted: 26 May 2019, 5:56:35 UTC

My hat's off to Petri for the Cuda code and to TBar for the packaging the deal and supplying a fixed version of BOINC (now if that stupid Notices tab could be moved all the way to the far right....), but if Seti's project url was also included in the readme that would just make it just so much easier for us dummies to just copy'n'paste). :-)

As to an update on what's going on with my rejuvenated 2500K w/ dual GTX 1060's rig, here's a run down so far over the last 20hrs.

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).

I didn't really pick a good time to do the change over for with all the noise bombs about, but those good blc25's that took around 11mins 30secs to do under the Windows SoG app went down to around 3mins 11secs and the blc26's that take 9mins under Windows are being done in around 2mins 30secs.

The 1060's in the 2500K performance under Windows were achieving an APR of 264.99 GFLOPS and now with the special sauce under Linux that has now gone up to a whopping APR of 1,118.20 GFLOPS (and still rising).

My total RAC stayed flat for yesterday, even with my 3750K rig's RAC still dropping and the 2500K rig being offline for around 10hrs (for cleaning, parts additions and replacements), just 1 real drawback I found out to having well hidden cables and wires was tracing them all back out again, but today it's already heading ballistic. :-O

Cheers.
ID: 1995317 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1995334 - Posted: 26 May 2019, 13:38:15 UTC - in response to Message 1995317.  


My total RAC stayed flat for yesterday, even with my 3750K rig's RAC still dropping and the 2500K rig being offline for around 10hrs (for cleaning, parts additions and replacements), just 1 real drawback I found out to having well hidden cables and wires was tracing them all back out again, but today it's already heading ballistic. :-O

Cheers.


+1
A proud member of the OFA (Old Farts Association).
ID: 1995334 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1995335 - Posted: 26 May 2019, 13:42:30 UTC - in response to Message 1995317.  


As to an update on what's going on with my rejuvenated 2500K w/ dual GTX 1060's rig, here's a run down so far over the last 20hrs.


Are you running with the "-nobs" in the commandline for the app_info.xml?
If you decide you want to wring the very last production out, that will. Needs a core per gpu.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1995335 · Report as offensive     Reply Quote
Previous · 1 . . . 98 · 99 · 100 · 101 · 102 · 103 · 104 . . . 162 · Next

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.