Setting up Linux to crunch CUDA90 and above for Windows users

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 31 · 32 · 33 · 34 · 35 · 36 · 37 . . . 162 · Next

AuthorMessage
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1882070 - Posted: 4 Aug 2017, 15:46:02 UTC - in response to Message 1882067.  

I can only think of using the Package Manager to get rid of outdated and obsolete packages. The other thing I can think of is that logs must be growing somewhere significantly. Why don't you use the Package Manager and search on utilities similar to Windows Directory Status. I'm sure there must have been something like that developed for Linux.


Or maybe "Disk Cleanup"?

I doubt that Piriform has a CCLeaner for Linux but if they do, it would probably take care of the problem too.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1882070 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1882072 - Posted: 4 Aug 2017, 15:46:44 UTC

If you open up the Dash and type in Disk Usage Analyzer that will give you a built-in app that graphically shows the disk usage by directory. It used to be called Baobab. That should show you the directories that are using the most disk space.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1882072 · Report as offensive     Reply Quote
Juha
Volunteer tester

Send message
Joined: 7 Mar 04
Posts: 388
Credit: 1,857,738
RAC: 0
Finland
Message 1882100 - Posted: 4 Aug 2017, 17:56:32 UTC - in response to Message 1882050.  

I originally had about 4-5GB free but now I am down to just 2 GB so I need to find out what is eating up the space so I can clean it up


If you have been installing updates you may have multiple kernel versions installed and those take a lot disk space. "sudo apt-get autoclean" and "sudo apt-get autoremove" may help. Synaptic may have those in some menu.
ID: 1882100 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882158 - Posted: 4 Aug 2017, 23:29:55 UTC - in response to Message 1882100.  

I originally had about 4-5GB free but now I am down to just 2 GB so I need to find out what is eating up the space so I can clean it up


If you have been installing updates you may have multiple kernel versions installed and those take a lot disk space. "sudo apt-get autoclean" and "sudo apt-get autoremove" may help. Synaptic may have those in some menu.


. . Thanks for the suggetions guys. I will look into them :)

. . And I have been installing updates as they become available, so it sounds like we might have a winner there.

Stephen

..
ID: 1882158 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1882163 - Posted: 5 Aug 2017, 0:00:10 UTC - in response to Message 1881215.  

Oh before I forget again. I promised a report on the USB 3.0 right-angle adapter I ordered. Came from Hong Kong so it took a while. It still doesn't allow fitting of a full length gpu because it hits the fan shroud because it is still too tall. Oh well, try again. I'll order the other version of the adapter with the short flying leads. I hope it will allow the wires to be squished flat out at 90° from the top of the connector and allow a gpu to fit.

And once more for a follow-up with my 'USB 3.0 motherboard connector in the poor location' journey. Got the other version of the USB 3.0 adapter today and installed it. Yay! Allows fitting of my case USB 3.0 molded cable again. I have my front USB ports back in operation. In case anyone else is in need of this solution, the adapter is REALLY low profile, Only 7mm tall and is basically the connector that fits down into the motherboard connector shroud and just has flying leads coming out of it. No problem with clearance now. The leads are 12 cm long leading to the female connector that is nicely heat shrinked. You just plug your case USB 3.0 cable into the extended adapter and you're in like Flint. This is the adapter.

USB-3.0-20 20 Pin-Internal-Header-Ribbon-Cable-Low-Profile-Connector
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1882163 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882172 - Posted: 5 Aug 2017, 0:26:13 UTC - in response to Message 1882163.  


And once more for a follow-up with my 'USB 3.0 motherboard connector in the poor location' journey. Got the other version of the USB 3.0 adapter today and installed it. Yay! Allows fitting of my case USB 3.0 molded cable again. I have my front USB ports back in operation. In case anyone else is in need of this solution, the adapter is REALLY low profile, Only 7mm tall and is basically the connector that fits down into the motherboard connector shroud and just has flying leads coming out of it. No problem with clearance now. The leads are 12 cm long leading to the female connector that is nicely heat shrinked. You just plug your case USB 3.0 cable into the extended adapter and you're in like Flint. This is the adapter.

USB-3.0-20 20 Pin-Internal-Header-Ribbon-Cable-Low-Profile-Connector


. . Thanks Keith, handy to know.

Stephen

:)
ID: 1882172 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882178 - Posted: 5 Aug 2017, 1:07:11 UTC - in response to Message 1882072.  

If you open up the Dash and type in Disk Usage Analyzer that will give you a built-in app that graphically shows the disk usage by directory. It used to be called Baobab. That should show you the directories that are using the most disk space.


. . Thanks, but sadly I have no idea what is necessary and what is dross. /root/user takes up heaps and the Mozilla caches (if they are as shown there are 4 of them taking up over 1.2 GB). But I have no idea how to clean them up. I ran sudo apt-get for autoclean and autoremove and it did it's thing but they do not show up as apps in the dash. How do I get them to actually work??

Stephen

??
ID: 1882178 · Report as offensive     Reply Quote
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1882186 - Posted: 5 Aug 2017, 1:40:55 UTC - in response to Message 1882178.  

/root/user is your home directory. If BOINC is installed there. it will be big.

autoclean/autoremove just cleanup unneaded packages that have been updated, or no longer needed. It should have told you how much space it cleared. There is no app to appear later.

Mozilla is Thunderbird and Firefox. If you don't use them (as it is a cruncher) you can remove them.
ID: 1882186 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882188 - Posted: 5 Aug 2017, 2:11:20 UTC - in response to Message 1882186.  

/root/user is your home directory. If BOINC is installed there. it will be big.

autoclean/autoremove just cleanup unneaded packages that have been updated, or no longer needed. It should have told you how much space it cleared. There is no app to appear later.

Mozilla is Thunderbird and Firefox. If you don't use them (as it is a cruncher) you can remove them.


. . Hi Brent

. . Even though it is a cruncher I still use Firefox to access these forums so I do need it, but I don't see why it would need 1.2GB of cached material. And I would rather use Firefox than IE or Chrome.

. . OK so the apt-get autoclean should have done the trick by itself? Well it would seem that it didn't help ... :(

Stephen

:(
ID: 1882188 · Report as offensive     Reply Quote
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22233
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1882209 - Posted: 5 Aug 2017, 6:26:09 UTC

Apt-get only retrieves and installs an application. Depending how the application was written it may, or may not, appear in the list of installed apps (a bit like windows). So, open a command window and type in the application name (again, just like windows), or if you want to make sure it will run type "sudo appname", you will have to enter your password, and then, again depending on how the app was written the app will run, either in the command window or one of its own.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1882209 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882241 - Posted: 5 Aug 2017, 14:48:49 UTC - in response to Message 1882209.  

Apt-get only retrieves and installs an application. Depending how the application was written it may, or may not, appear in the list of installed apps (a bit like windows). So, open a command window and type in the application name (again, just like windows), or if you want to make sure it will run type "sudo appname", you will have to enter your password, and then, again depending on how the app was written the app will run, either in the command window or one of its own.


. . Hi Rob,

. . I tried the sudo apt-get on this machine (i5 with 970s) and it performed as advertised reclaiming over 600MB of space. But not on the C2D, there it just says 0 to install, 0 to remove, 0 to update. But it does seem to have recovered a little space (maybe) or I didn't pay quite enough attention to the exact space left prior to running it.

. . However, when I subsequently try to run it again with sudo autoclean or sudo autoremove it replies with command not found.

Stephen

:(
ID: 1882241 · Report as offensive     Reply Quote
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22233
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1882243 - Posted: 5 Aug 2017, 14:59:40 UTC
Last modified: 5 Aug 2017, 15:00:44 UTC

apt-get is the command to get an application from a repository so I suspect it did a bit of a purge on junk hanging around in one or other of the various caches.
I'm nowhere near any of my Linux computers just now, so can't get at my notes pinned to the wall - yes real paper & pen notes! Try doing a "man" inquiry on the two commands, there are probably a few switches that can trigger more information and a more in depth purge of junk.
Don't forget that by default Linux file names are case sensitive....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1882243 · Report as offensive     Reply Quote
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22233
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1882244 - Posted: 5 Aug 2017, 15:08:14 UTC

Just a thought - turn off the Firefox's caching - this can get REALLY big in no time at all particularly if you visit sites with lost of embedded graphics and videos (adverts are among the worst "normal" things that flood the cache with junk, and often you don't know they dumped the junk....)
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1882244 · Report as offensive     Reply Quote
dallasdawg

Send message
Joined: 19 Aug 99
Posts: 49
Credit: 142,692,438
RAC: 2
United States
Message 1882246 - Posted: 5 Aug 2017, 15:16:14 UTC - in response to Message 1882050.  
Last modified: 5 Aug 2017, 15:30:08 UTC

. . @ all

. . Does anyone know a decent "disk clean" utility for Linux to remove detritus from the storage drive. I originally had about 4-5GB free but now I am down to just 2 GB so I need to find out what is eating up the space so I can clean it up, before BOINC/SETI runs into a brick wall. I noticed the problem (for the second time) when BOINC would not download new work saying I was out of disk space. The first time I changed the allocations to give it another 1 GB, and this time (maybe 6 weeks later or less) I have had to increase it by another 1 GB. If this keeps up the system will choke up in a month or 2.

Stephen.

?


BleachBit is a popular app.

Also, verify your syslog and kern.log files have not gotten huge. They are supposed to self-truncate, but I had a situation where I did something and the system started throwing constant errors in both. By the time I realized what was going on, both files were a couple gig each. The files were growing faster than the system could archive. If you see this, do not delete the file that is huge. Use the following command: sudo cat /dev/null/ > /path/to/file.log Both syslog and kern.log are in /var/log/ This will move the contents of the file to dev/null/ which basically deletes all the stuff in the file without deleting the file. BOINC also has a two log files /var/log as well that may be large.

Another thing to run is: sudo apt-get autoremove to remove unused packages and older kernels that you are no longer using.

Outside of that one situation with the log files and running apt-get autoremove, I have never really had to run a system cleaner. The typical linux filesystem (ext4) is different than ntfs. The journaling of linux does a better job of file management. It generally handles temporary files, fragmented files, broken links better than ntfs. However, it does sometimes burp (like my log file issue).
ID: 1882246 · Report as offensive     Reply Quote
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22233
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1882250 - Posted: 5 Aug 2017, 15:40:58 UTC

BleachBit can be very aggressive in its action, so be careful if you decide to use it.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1882250 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1882321 - Posted: 6 Aug 2017, 0:15:25 UTC - in response to Message 1882188.  
Last modified: 6 Aug 2017, 0:20:07 UTC

/root/user is your home directory. If BOINC is installed there. it will be big.
autoclean/autoremove just cleanup unneaded packages that have been updated, or no longer needed. It should have told you how much space it cleared. There is no app to appear later.
Mozilla is Thunderbird and Firefox. If you don't use them (as it is a cruncher) you can remove them.
. . Hi Brent

. . Even though it is a cruncher I still use Firefox to access these forums so I do need it, but I don't see why it would need 1.2GB of cached material. And I would rather use Firefox than IE or Chrome.
. . OK so the apt-get autoclean should have done the trick by itself? Well it would seem that it didn't help ... :(
Did you at least clear the FireFox cache? Go to Edit/Preferences/Advanced/Network/Cached Web Content/Clear Now
You can also set the limit of how much is cached, Override automatic cache management...
Try that, if you haven't already.
ID: 1882321 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882423 - Posted: 6 Aug 2017, 15:05:49 UTC - in response to Message 1882321.  

Did you at least clear the FireFox cache? Go to Edit/Preferences/Advanced/Network/Cached Web Content/Clear Now
You can also set the limit of how much is cached, Override automatic cache management...
Try that, if you haven't already.


. . I have done so now, thanks for that guidance. I had to select "open Menu" three times before I saw the options you mentioned, the first two times it was just things like cut, copy and paste and printer etc.

. . I have now set the cache limit to 120MB so hopefully it will not hog so much space. The total storage space used is now under 10GB so I should be OK for a while into the future.

Stephen


:)
ID: 1882423 · Report as offensive     Reply Quote
Bruce
Volunteer tester

Send message
Joined: 15 Mar 02
Posts: 123
Credit: 124,955,234
RAC: 11
United States
Message 1882978 - Posted: 10 Aug 2017, 13:52:51 UTC

Hi Guys,

I could use some help/advice.

I have been off-line for two or three months now playing with different distros of Linux.

I have decided to install Linux Mint 18.2 Cinnamon. I chose this because it felt more comfortable to me. This is my first time with Linux, so I'am a complete rookie here.

I installed Mint and did the update and upgrade. It now has Kernel 4.10.0.27. Everything seemed to be OK.

I then installed nVidia 384 driver from the repository. When it went in, it did not ask me about nvidia.xconfig like I was expecting it to. After some reading I learned that some of the video processes were moved to the kernel. This might be why it did not ask.

So far so good.

The trouble that I am having is with Cool-bits. With Mint 18.2 nvidia.xconfig seems to have moved from etc/x11 to usr/share/x11. Not much of a problem once you find it. I was reading about someone else who was having problems and he fixed it but adding a 20-nvidia.conf file to the usr/share/x11/xorg.conf.d path. This is what I did also.

20-nvidia.conf:
-----------------------------------------------------------------
##Cool-bits Device Section Start

Section "Device"
Identifier "Device0"
Driver "nvidia"
VendorName "NVIDIA Corporation"
BoardName "GeForce GTX TITAN Z"
BusID "PCI:3:0:0"
Option "Cool-bits" "4"
EndSection

Section "Device"
Identifier "Device1"
Driver "nvidia"
VendorName "NVIDIA Corporation"
BoardName "GeForce GTX TITAN Z"
BusID "PCI:4:0:0"
Option "Cool-bits" "4"
EndSection

Section "Device"
Identifier "Device2"
Driver "nvidia"
VendorName "NVIDIA Corporation"
BoardName "GeForce GTX TITAN Z"
BusID "PCI:9:0:0"
Option "Cool-bits" "4"
EndSection

Section "Device"
Identifier "Device3"
Driver "nvidia"
VendorName "NVIDIA Corporation"
BoardName "GeForce GTX TITAN Z"
BusID "PCI:10:0:0"
Option "Cool-bits" "4"
EndSection

##Cool-bits Device Section End
---------------------------------------------------------------

This file will run the same in either etc/x11/xorg.conf.d or usr/share/x11/xorg.conf.d paths.

As you can see, the file sets Cool-bits at 4 for fan control. It works - sort of.
This file sets Cool-bits to 4, but when you check it with the nVidia settings program GPU0 has the fan control, I can enable it and set to 100% then apply. It works, but GPU1,2,3 do not show the fan control at all.

I have noticed two things, #1: with the conf file as it is, it controls the fan of GPU0 and GPU1. I trid editing the conf file by deleting Device1 and Device3 sections, the fan control still showed up in GPU0 but not in GPU1,2,3, but GPU0 now controled it self and GPU2. #2: If the Cinnamon Desktop crashes you enter a safe mode, if you then open nVidia settings then all four GPU's have the fan control listed but unavailable.

The 20-nvidia.conf file seems right to me, but as a rookie I might be making some simple mistake. I am leaning towards it being a conflict somewhere, but again as a rookie I don't have any idea of where to look and how to fix it.

Does anyone running Linux Mint 18.1 or 18.2 and have Cool-bits working on multiple gpu's properly, if so how did you do it?

Any of you Linux Gurus have any ideas or suggestions which might allow me to fix this and get it running right? I would appreciate any and all help!

Sorry for the long post but RAC is almost gone and I might not be able to post much longer. Hope that I can start crunching again soon.

Thanks to all.
Bruce
ID: 1882978 · Report as offensive     Reply Quote
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1882979 - Posted: 10 Aug 2017, 14:02:07 UTC - in response to Message 1882978.  

I just run:
sudo nvidia-xconfig --thermal-configuration-check --cool-bits=28 --enable-all-gpus
That would be 4 for you if you just want fan control.

It puts the appropriate sections in the xconfig file, and you done, no need for extra config files.
ID: 1882979 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1882981 - Posted: 10 Aug 2017, 14:50:55 UTC - in response to Message 1882979.  

I just run:
sudo nvidia-xconfig --thermal-configuration-check --cool-bits=28 --enable-all-gpus
That would be 4 for you if you just want fan control.

It puts the appropriate sections in the xconfig file, and you done, no need for extra config files.


. . I think that is the crucial part for his problem ...

Stephen

:)
ID: 1882981 · Report as offensive     Reply Quote
Previous · 1 . . . 31 · 32 · 33 · 34 · 35 · 36 · 37 . . . 162 · Next

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.