Setting up Linux to crunch CUDA90 and above for Windows users

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 99 · 100 · 101 · 102 · 103 · 104 · 105 . . . 162 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995370 - Posted: 26 May 2019, 18:58:18 UTC - in response to Message 1995317.  

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).

You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995370 · Report as offensive     Reply Quote
Loren Datlof

Send message
Joined: 24 Jan 14
Posts: 73
Credit: 19,652,385
RAC: 0
United States
Message 1995371 - Posted: 26 May 2019, 19:26:56 UTC - in response to Message 1995370.  

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).

You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.


So does the above mean that SSE41 processes WUs faster than than AVX?
ID: 1995371 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1995372 - Posted: 26 May 2019, 19:33:50 UTC - in response to Message 1995371.  

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).

You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.


So does the above mean that SSE41 processes WUs faster than than AVX?


It did in my limited testing.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1995372 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995380 - Posted: 26 May 2019, 20:06:33 UTC - in response to Message 1995371.  

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).

You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.


So does the above mean that SSE41 processes WUs faster than than AVX?

It depends on the processor. Could be faster or basically the same as Wiggo describes. Could also be dependent on the cpu task type. The way to disprove or prove is to run a mix of varying cpu task types through the benchmark tools and see which app is faster on the general mix.

In my previous testing, I always found the SSE41 app faster than the AVX or AVX2 app by 1-5% on average. Juan found the AVX app faster than the SSE41 app on his host in his benchmark testing. Don't know why we have different results.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995380 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995383 - Posted: 26 May 2019, 20:17:48 UTC - in response to Message 1995370.  

You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.

The reason for this on X99 motherboards like my own or similar is that in the BIOS there is a setting that automatically applies a negative offset to the core clock ratio when detecting a AVX instruction.

AVX Instruction Core Ratio Negative Offset [Auto]
This item allows you to get the ratio at which AVX applications run by subtracting the value
from your core ratio.
Configuration options: [Auto] [1] - [31]

So for example if the core clock ratio is default 32X for example, which would run the cpu at 3.2Ghz, the cpu reduces the core clock ratio to 25X automatically on Auto when an AVX instruction runs.
So your cpu would actually only be running at 2.5Ghz when running an AVX application.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995383 · Report as offensive     Reply Quote
Loren Datlof

Send message
Joined: 24 Jan 14
Posts: 73
Credit: 19,652,385
RAC: 0
United States
Message 1995386 - Posted: 26 May 2019, 20:36:25 UTC - in response to Message 1995380.  
Last modified: 26 May 2019, 20:56:47 UTC

...The way to disprove or prove is to run a mix of varying cpu task types through the benchmark tools and see which app is faster on the general mix.
I found the benchmark tools at lunatics. Is there a tutorial on how to use them somewhere? I am not sure which one to use. I will run the tests on a linux machine. Also do I have to stop crunching in order to run the benchmark tools? I could probably run them in a VM.
ID: 1995386 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1995389 - Posted: 26 May 2019, 21:08:14 UTC - in response to Message 1995386.  
Last modified: 26 May 2019, 21:09:19 UTC

...The way to disprove or prove is to run a mix of varying cpu task types through the benchmark tools and see which app is faster on the general mix.
I found the benchmark tools at lunatics. Is there a tutorial on how to use them somewhere? I am not sure which one to use. I will run the tests on a linux machine. Also do I have to stop crunching in order to run the benchmark tools? I could probably run them in a VM.

The Lunatics benchmark tools are rather old, but still functional. I think that RueiKe's benchmark tool is the current best and can handle all possible AMD and Nvidia gpus and any X86_64 cpu. It does both Multiband and Astropulse applications. I think it very simple to use since all you have to do is edit the bench.cfg file for whatever application you want to run by commenting out the applications in the list leaving only the one you want to run. You can add in the special app application by just copying and pasting the application names into the list. Already comes with a slew of test WU's with their reference results already calculated by the project stock cpu app for verification. You can find the latest release here:

https://github.com/Ricks-Lab/benchMT/tree/v1.6.0

With Rick's tool you don't have to stop crunching and it will stop the client for you automatically and start it back up once the benchmark is done.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1995389 · Report as offensive     Reply Quote
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34748
Credit: 261,360,520
RAC: 489
Australia
Message 1995390 - Posted: 26 May 2019, 21:35:32 UTC

The CPU app is about on par with the Lunatics AVX app, but I'm now doing 3 tasks in the same time as running 2 under Windows (so there's a 50% plus to start with).
You are ahead of the game with the SSE41 app versus the AVX app on power usage. On Intel chips, there is penalty for running AVX processes because the cpu reduces the clocks because of the higher power usage for crunching AVX instructions when it detects an AVX instruction. The SSE41 app doesn't get penalized.
Yes there would be some power saving and less heat there, but both my i5 rigs are also locked at 3.4GHz and under Windows running under full CPU load the 2500K's CM V8 cooler was keeping a lid on temps even with a seized fan (it now has a brand new fan in it and the current CPU loading is running at 80-90%).

That being said the heat now coming out of that rig from the 1060's is certainly keeping my toes warm on this frosty morning (they've been getting cold of late here). :-)

Are you running with the "-nobs" in the commandline for the app_info.xml?
1 thing at a time Grasshopper. ;-)

I'll let this run at the "out of the box" settings until its RAC levels out first before I do any tinkering (though I did change the checkpoints to 6mins). ;-)

Cheers.
ID: 1995390 · Report as offensive     Reply Quote
Miklos M.

Send message
Joined: 5 May 99
Posts: 955
Credit: 136,115,648
RAC: 73
Hungary
Message 1997014 - Posted: 6 Jun 2019, 11:32:12 UTC

Excuse me for asking, butis this all I have to do get linux on my Intel computers with 2 gpu each? One runs 1080ti's
the other 780ti's.
I am a beginner with computers. A step by easy step would help.

Thank you

nick
ID: 1997014 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997018 - Posted: 6 Jun 2019, 12:10:19 UTC - in response to Message 1997014.  

Excuse me for asking, butis this all I have to do get linux on my Intel computers with 2 gpu each? One runs 1080ti's
the other 780ti's.
I am a beginner with computers. A step by easy step would help.

Thank you

nick

Convert one system at a time. I know a gtx 1080Ti will do this. I am uncertain about your 2nd system.

1) You need to set the computer you want to convert to "No New Tasks" under the BOINC Manager.
Run out of everything you are processing. Might do the conversion while Seti is down on Tuesday(s).
2) Back up any non-BOINC data you want to keep.
3) Download a copy of Ubuntu 18.x
4) Download a copy of Rufus
5) Using at least an 8 GB Flash drive, install Ubuntu using the Rufus program.
This can be done on any Windows box (probably) certainly any Win10 box.
6) Boot from the flash drive. Install Ubuntu by re-formating your HD etc.
3b) Download a copy of Tbar's All-in-One. (Hey folks, what is the latest URL?)
7) Install 7pzip using
sudo apt-get install p7zip
from a terminal session in Ubuntu.
8) Install
 libwebkitgtk-1.0-0 
libcurl3

using the same syntax.
9)
sudo apt-get install ocl-icd-libopencl1

10) Add this to your system so you will be able to easily install the Video drivers:
[code}
https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa

Adding this PPA to your system

You can update your system with unsupported packages from this untrusted PPA by adding ppa:graphics-drivers/ppa to your system's Software Sources. (Read about installing)

sudo add-apt-repository ppa:graphics-drivers/ppa
sudo apt-get update[/code]
11) Use the file manager to unpack Tbar's "All in One" in the directory (Home) or desktop where you want to install it.
12) Use the "software updater" to install "additional drivers" and upgrade Linux/Ubuntu to the latest driver (probably).
13) Cross fingers and skip it could be bad luck.
14) Locate the "boincmgr" file in the BOINC folder/sub-directory
Left double click it.
15)A Linux version of the Boinc Manager will display.
16) Add the seti@home project.
17) Happy Crunching!
18) After you get everything else working you can try the "-nobs" on the "commandline" in the "app_info.xml" file.

Someone please review this and help me fix anything I screwed up.
Thank you.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997018 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1997021 - Posted: 6 Jun 2019, 12:25:51 UTC - in response to Message 1997014.  
Last modified: 6 Jun 2019, 12:45:25 UTC

Excuse me for asking, butis this all I have to do get linux on my Intel computers with 2 gpu each? One runs 1080ti's
the other 780ti's.
I am a beginner with computers. A step by easy step would help.
Thank you
nick

. . Check that the 780ti cards support Cuda8 or Cuda9, because that is required to run any of the 'special sauce' varieties. Ironically I know that the 750 and 750ti both do and they are Maxwell cards, but I am not sure about the 780/ti as the 760's do not have the right version of Cuda and both the 760 and 780 cards are Kepler not Maxwell. The 1080ti is a goer though and will produce great results.

. . An updated version of the step by step is probably due. The last update was Tom's some time ago though that would probably get you through. He has just posted another version of it too.

Stephen

. .
ID: 1997021 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1997024 - Posted: 6 Jun 2019, 12:43:07 UTC - in response to Message 1997018.  
Last modified: 6 Jun 2019, 12:44:29 UTC

Excuse me for asking, butis this all I have to do get linux on my Intel computers with 2 gpu each? One runs 1080ti's
the other 780ti's.
I am a beginner with computers. A step by easy step would help.

Thank you

nick

Convert one system at a time. I know a gtx 1080Ti will do this. I am uncertain about your 2nd system.


7) Install 7pzip using
sudo apt-get install p7zip
from a terminal session in Ubuntu.
8) Install
 sudo apt-get install libwebkitgtk-1.0-0 
sudo apt-get install libcurl3

using the same syntax.
9)
sudo apt-get install ocl-icd-libopencl1



Someone please review this and help me fix anything I screwed up.
Thank you.

Tom


. . Probably less confusing to newbies to add the full synatx in the given info rather than just say "use the same". Also I would leave a blank line between each step for ease of reading.

Stephen
ID: 1997024 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1997051 - Posted: 6 Jun 2019, 16:02:11 UTC

The 780 Ti's are a no-go because they are only C.C. 3.5 capable and the special app needs C.C. of at least 5.0.

The AIO is where it's always been.

http://www.arkayn.us/lunatics/BOINC.7z
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1997051 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1997068 - Posted: 6 Jun 2019, 18:28:18 UTC

Actually, the current version of the BOINC client in the All-In-One package doesn't Need any dependencies and works with Ubuntu 15.04 to 18.10.... None, no libcurl3, no libwebkitgtk-1.0-0
Also, the Cuda 6.0 Special App works with the CC=3.5 GPUs that have at least 2 GB of vRam, http://www.arkayn.us/lunatics/CUDA60_zi3v-Special.7z
ID: 1997068 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1997070 - Posted: 6 Jun 2019, 18:40:43 UTC - in response to Message 1997068.  

Thanks for the link to the older zi3v app TBar. I thought it had disappeared. Good to know there is a solution for the CC3.5 cards.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1997070 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997094 - Posted: 6 Jun 2019, 21:49:14 UTC - in response to Message 1997068.  

Actually, the current version of the BOINC client in the All-In-One package doesn't Need any dependencies and works with Ubuntu 15.04 to 18.10.... None, no libcurl3, no libwebkitgtk-1.0-0
Also, the Cuda 6.0 Special App works with the CC=3.5 GPUs that have at least 2 GB of vRam, http://www.arkayn.us/lunatics/CUDA60_zi3v-Special.7z


Thank you. It has been so long since I installed from scratch I had forgotten you got rid of those.
Thank you, Tbar!

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997094 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1997100 - Posted: 6 Jun 2019, 22:15:02 UTC - in response to Message 1997068.  

Actually, the current version of the BOINC client in the All-In-One package doesn't Need any dependencies and works with Ubuntu 15.04 to 18.10.... None, no libcurl3, no libwebkitgtk-1.0-0
Also, the Cuda 6.0 Special App works with the CC=3.5 GPUs that have at least 2 GB of vRam, http://www.arkayn.us/lunatics/CUDA60_zi3v-Special.7z


. . It even worked with my old GT 730 ...

Stephen

:)
ID: 1997100 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1997114 - Posted: 7 Jun 2019, 1:25:30 UTC - in response to Message 1997100.  

Actually, the current version of the BOINC client in the All-In-One package doesn't Need any dependencies and works with Ubuntu 15.04 to 18.10.... None, no libcurl3, no libwebkitgtk-1.0-0
Also, the Cuda 6.0 Special App works with the CC=3.5 GPUs that have at least 2 GB of vRam, http://www.arkayn.us/lunatics/CUDA60_zi3v-Special.7z


. . It even worked with my old GT 730 ...

Stephen

:)


WOW! (No I am not talking about that event based in Germany :)

Tom
A proud member of the OFA (Old Farts Association).
ID: 1997114 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1997132 - Posted: 7 Jun 2019, 4:36:33 UTC - in response to Message 1997114.  

Also, the Cuda 6.0 Special App works with the CC=3.5 GPUs that have at least 2 GB of vRam, http://www.arkayn.us/lunatics/CUDA60_zi3v-Special.7z

. . It even worked with my old GT 730 ...
Stephen

WOW! (No I am not talking about that event based in Germany :)
Tom


. . Yep, it was doing Arecibo tasks in about 21 mins and GBT tasks in about 27 to 32 mins. So if you have an old GT730 lying about the place and a rig to put it in then go Linux and Cuda6.0, it will give you a nice productivity.

Stephen

:)
ID: 1997132 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1997226 - Posted: 7 Jun 2019, 19:47:27 UTC

Well, wish me luck. Decided to take one of my summer-off-line boxes and make the switch.
Not auspicious so far; took over 4 hours to get Ubuntu 18.04.2 to load. The installer kept crashing.
Now to try for the rest of the install.
As I'm using an ISO burned to DVD for the Ubuntu install, would anyone be interested if I posted a modified copy of the procedure reflecting that?
ID: 1997226 · Report as offensive     Reply Quote
Previous · 1 . . . 99 · 100 · 101 · 102 · 103 · 104 · 105 . . . 162 · Next

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.