Setting up Linux to crunch CUDA90 and above for Windows users

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 135 · 136 · 137 · 138 · 139 · 140 · 141 . . . 162 · Next

AuthorMessage
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2021784 - Posted: 5 Dec 2019, 4:06:08 UTC - in response to Message 2021759.  

resulting in many "finish file present too long" and 'exceeded time limit" errors.

Finish file errors can be resolved by moving to the 7.16.3 client. Exceeded time limit errors are likely caused by trying to support one too many cards on the bus.
You can find the latest Linux client at the BOINC ppa.
https://launchpad.net/~costamagnagianfranco/+archive/ubuntu/boinc

Thanks for the heads-up. I had heard that 7.16.3 fixed the issue, but didn't know where to get it.
Unfortunately, I guess I'm still missing something, as after adding the PPA and issuing the update
sudo add-apt-repository ppa:costamagnagianfranco/boinc
sudo apt-get update
I'm still on 7.14.2 after a reboot.
Are there more steps required, considering I'm on the AIO so the installation is in /user/home/BOINC?
Thanks ...
ID: 2021784 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2021790 - Posted: 5 Dec 2019, 6:09:33 UTC

No the installation from the ppa would be the standard repository location in /usr/bin/boinc-client. Just unpack the archive without running the installer and grab the BOINC client and manager files, boinc and boincmgr and drop them into your normal AIO /home BOINC directory.
Or to the immediate point just download the client and manager.
https://launchpad.net/~costamagnagianfranco/+archive/ubuntu/boinc/+build/17833498/+files/boinc-client_7.16.3+dfsg+201910010804~ubuntu18.04.1_amd64.deb
https://launchpad.net/~costamagnagianfranco/+archive/ubuntu/boinc/+build/17833498/+files/boinc-manager_7.16.3+dfsg+201910010804~ubuntu18.04.1_amd64.deb
Then just unpack them and not run the deb installer. The binaries are in the data package.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2021790 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2021791 - Posted: 5 Dec 2019, 6:20:02 UTC - in response to Message 2021790.  

No the installation from the ppa would be the standard repository location in /usr/bin/boinc-client. Just unpack the archive without running the installer and grab the BOINC client and manager files, boinc and boincmgr and drop them into your normal AIO /home BOINC directory.
Or to the immediate point just download the client and manager.
https://launchpad.net/~costamagnagianfranco/+archive/ubuntu/boinc/+build/17833498/+files/boinc-client_7.16.3+dfsg+201910010804~ubuntu18.04.1_amd64.deb
https://launchpad.net/~costamagnagianfranco/+archive/ubuntu/boinc/+build/17833498/+files/boinc-manager_7.16.3+dfsg+201910010804~ubuntu18.04.1_amd64.deb
Then just unpack them and not run the deb installer. The binaries are in the data package.

The downside to not using the package installer, I guess. Figured it was something like that. Again, thanks ...
ID: 2021791 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2021798 - Posted: 5 Dec 2019, 8:08:44 UTC - in response to Message 2021790.  
Last modified: 5 Dec 2019, 8:09:33 UTC

Then just unpack them and not run the deb installer. The binaries are in the data package.
Guess I'll look at it later. Right now, it's making no sense, in that the extracted file sizes are vastly different.
Thanks, Bernie, for moving this thread! Much appreciated.
ID: 2021798 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2021799 - Posted: 5 Dec 2019, 8:21:54 UTC

I checked the files. They report correctly. But the smaller sizes are likely because they weren't compiled with a debug library. Our AIO binaries were compiled with the debug symbols and are very large. If you strip out the debug symbols, the client binary is only about 1200KB instead of 20.1MB

Run
strip --strip-debug boinc
on your AIO binary and you can reduce the size also.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2021799 · Report as offensive     Reply Quote
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2021800 - Posted: 5 Dec 2019, 8:38:51 UTC - in response to Message 2021799.  

I had the same observation about file sizes when I first started experimenting with the AIO and the spoofed client.

I think it would be better to disable or strip the debug symbols at the compilation stage, before distribution. That would save on download bandwidth, both for the downloader and the hosting site.
ID: 2021800 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2021821 - Posted: 5 Dec 2019, 16:09:50 UTC - in response to Message 2021800.  

I had the same observation about file sizes when I first started experimenting with the AIO and the spoofed client.

I think it would be better to disable or strip the debug symbols at the compilation stage, before distribution. That would save on download bandwidth, both for the downloader and the hosting site.

True, that is if you don't need to debug established code. But since we are playing with the spoofed client, better to leave in for debugging purposes. Guess the code is settled now and we could make use of the --strip-all or -Wl parameter in the makefile and make a much smaller binary for reduced download bandwidth. Or for use on small SBC computers with limited RAM.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2021821 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2021891 - Posted: 6 Dec 2019, 1:47:26 UTC

Guess I can't get there from here ...
ID: 2021891 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2022130 - Posted: 7 Dec 2019, 16:15:23 UTC - in response to Message 2022125.  
Last modified: 7 Dec 2019, 17:01:33 UTC


Can the AR be determined somehow from the file name like the ones below?
16jl09ab.22871.9065.7.34.215_1
blc61_2bit_guppi_58642_05986_HIP54072_0023.6488.0.21.44.69.vlar_0


kind of, but not precisely. (using the file name only, but can be determined by the WU header, see Richard's post below)

WUs without the "vlar" label will have AR values >(0.05-0.12)0.01 or so (I dont know the exact limit, but it's quite small), I've seen this go all the way up to like 180, but that's pretty rare.

WUs with the "vlar" label will then have AR values <(0.05-0.12)0.01

We refer to WUs that have AR >1 as "VHAR", but the project does not explicitly label them as such
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2022130 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2022138 - Posted: 7 Dec 2019, 16:40:24 UTC - in response to Message 2022125.  
Last modified: 7 Dec 2019, 16:42:33 UTC

.....Also want to get the _autosetup and configure to work. It is a real PITA to edit the Makefile. In addition want to look at a Windows version. I retired when my company switched platforms from Windows to Linux & CORBA. Linux was OK with me but I had exactly ZERO interest in CORBA.
Good luck with that. Petri and myself couldn't get it to work using _autosetup and configure.
The only way to see the Angle Range of the task is to either run the task, or open the task with a text editor and look at the <true_angle_range></true_angle_range> value.
The only correct way to test the different Apps is to run them in the Benchmark App using the same task for each App. Try running the CUDA 10.1 & 10.2 Apps in the Benchmark App using these WUs, http://www.arkayn.us/lunatics/Test_WUs.7z When I run that test I get different results, and the 10.2 results are better.
ID: 2022138 · Report as offensive     Reply Quote
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2022139 - Posted: 7 Dec 2019, 16:45:58 UTC - in response to Message 2022125.  

Can the AR be determined somehow from the file name like the ones below?
Apart from the crude vlar flag, NO.

But it can be determined from the plain-text XML header in the workunit data file:

<workunit_header>
  <name>blc14_2bit_guppi_58691_66098_HIP38931_0045.12140.818.21.44.27.vlar</name>
    <data_desc>
      <start_ra>7.9659866666667</start_ra>
      <start_dec>0.8143</start_dec>
      <end_ra>7.966</end_ra>
      <end_dec>0.8142</end_dec>
      <true_angle_range>0.014330391459691</true_angle_range>
- so a wider range than Ian&Steve said. I think the technical definition was "up to 0.05", but the practical line was drawn higher - at around 0.12
ID: 2022139 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2022141 - Posted: 7 Dec 2019, 16:55:58 UTC - in response to Message 2022139.  

so a wider range than Ian&Steve said. I think the technical definition was "up to 0.05", but the practical line was drawn higher - at around 0.12


thanks for the clarification.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2022141 · Report as offensive     Reply Quote
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9960
Credit: 103,452,613
RAC: 328
United Kingdom
Message 2022345 - Posted: 8 Dec 2019, 10:46:08 UTC

I have moved all the "off topic posts" to a new thread, if I missed any just red-x it and I will move it.

I also hid the discussion of how to get the job done as it had now been done and the posts were redundant ;-)
ID: 2022345 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022353 - Posted: 8 Dec 2019, 13:14:48 UTC - in response to Message 2022345.  

I have moved all the "off topic posts" to a new thread, if I missed any just red-x it and I will move it.

I also hid the discussion of how to get the job done as it had now been done and the posts were redundant ;-)


. . Thanks Bernie.

Stephen
ID: 2022353 · Report as offensive     Reply Quote
Darrell Wilcox Project Donor
Volunteer tester

Send message
Joined: 11 Nov 99
Posts: 303
Credit: 180,954,940
RAC: 118
Vietnam
Message 2022472 - Posted: 9 Dec 2019, 13:27:16 UTC

I am a long-time Windows user. This thread is for someone who ALREADY knows some Linux, not a Linux noob.

I have several computers, and some are being considered for running Ubuntu and SETI. I have installed (that is, I followed the instructions)
Ubuntu 18.04.3 LTS on a thumb drive, then on an SSD, in a VM and also 19.10 in a VM. Trying to follow this topic here, about the 4th post
said to install something, and I am lost. I tried reading "The Complete Linux Manual Vol30 2019" on how to install other software, without
success. None of the instructions seem to work, so I need something quite a bit more elementary.

I tried to install BOINC using the instructions from the BOINC website but they didn't work. My installation didn't even recognize the command "APTITUDE".

Can someone point me to a very beginning level magazine or book, or set of instructions, on how to install software in Ubuntu? Baby step level.

I am not a fan boy for Windows, but I must give them credit for making life easy to load software.
ID: 2022472 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2022474 - Posted: 9 Dec 2019, 13:46:50 UTC - in response to Message 2022472.  

what are you trying to install specifically?

for things that are in the standard repositories you would install with:
sudo apt install <package-name>


if it's not in the repos, you may have to add the repository that it's in.

sometimes if it's not available in any repo, you woul have to download a .deb file, or similar, and install it manually.

it really depends on what you are trying to do.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2022474 · Report as offensive     Reply Quote
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2022476 - Posted: 9 Dec 2019, 13:57:55 UTC - in response to Message 2022472.  

Like you, I set up a Linux box from scratch about 6 months ago. It's a steep learning curve, but my saviour was a Windows box alongside me as I worked, with Google* permanently open.

* other search engines are available.
ID: 2022476 · Report as offensive     Reply Quote
Profile tullio
Volunteer tester

Send message
Joined: 9 Apr 04
Posts: 8797
Credit: 2,930,782
RAC: 1
Italy
Message 2022481 - Posted: 9 Dec 2019, 14:49:32 UTC
Last modified: 9 Dec 2019, 14:51:15 UTC

I am running a SuSE Linux Virtual Machine on this Windows 8.1 PC with its 5.3.12 kernel. After starting it I download BOINC from SuSE and start it. The VM Linux PC is enlisted in Science United and gets tasks from it, mostly SETi. Milkyway and Asteroids. It cannot see the GTX 1050 Ti on the host PC and runs only CPU tasks on its A10-6700 CPU.
Tullio
ID: 2022481 · Report as offensive     Reply Quote
Profile Joseph Stateson Project Donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 309
Credit: 70,759,933
RAC: 3
United States
Message 2022482 - Posted: 9 Dec 2019, 15:02:00 UTC - in response to Message 2022481.  

I am running a SuSE Linux Virtual Machine on this Windows 8.1 PC with its 5.3.12 kernel. After starting it I download BOINC from SuSE and start it. The VM Linux PC is enlisted in Science United and gets tasks from it, mostly SETi. Milkyway and Asteroids. It cannot see the GTX 1050 Ti on the host PC and runs only CPU tasks on its A10-6700 CPU.
Tullio


I had the same problem with the "Windows Subsystem for Linux". It does not support OpenCL or CUDA.
ID: 2022482 · Report as offensive     Reply Quote
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3870
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2022483 - Posted: 9 Dec 2019, 15:15:51 UTC - in response to Message 2022482.  

I had the same problem with the "Windows Subsystem for Linux". It does not support OpenCL or CUDA.


It does actually now have the capability as WSL2 which was released this year uses a real virtualized kernel with device driver support rather than just translating all kernel system calls, but CUDA/OpenCL have yet to be implemented. Microsoft has indicated it's in development though I wouldn't expect it until perhaps mid-2020.
ID: 2022483 · Report as offensive     Reply Quote
Previous · 1 . . . 135 · 136 · 137 · 138 · 139 · 140 · 141 . . . 162 · Next

Message boards : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2026 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.