Setting up Linux to crunch CUDA90 and above for Windows users

留言板 : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users
留言板合理

To post messages, you must log in.

前 · 1 . . . 101 · 102 · 103 · 104 · 105 · 106 · 107 . . . 161 · 后

作者消息
Profile petri33
志愿者测试人员

发送消息
已加入:6 Jun 02
贴子:1668
积分:623,086,772
近期平均积分:156
Finland
消息 1950847 - 发表于:20 Aug 2018, 3:23:03 UTC

I must have updated my gnu compiler at some time.
Would it be of any help if i built the app with -static-libstdc++ ?
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1950847 · 举报违规帖子     回复 引用
TBar
志愿者测试人员

发送消息
已加入:22 May 99
贴子:5204
积分:840,779,836
近期平均积分:2,768
United States
消息 1950842 - 发表于:20 Aug 2018, 2:57:27 UTC - 回复消息 1950834.  

Well, 18.04 is only 6 months old, and I usually wait until Systems are 1 year old before moving to them. I haven't heard of any nasty problems with 18.04, so, it might be OK. I'm going to wait a little longer though. I really don't understand why the Apps aren't working with the Kernel 4.4 systems, the way it usually works is you need equal to or higher than the system that compiled the App. The only thing that looks a little strange is Petri's GCC version seems a little high. From trying to compile Apps in the AKv8 folder we found that GCC 4.9 in Ubuntu 15.04 worked, but GCC 5.2 in 15.10 had problems. So, it would appear GCC 5.21 is a little higher than you would expect for Petri's Ubuntu 14.04.4. Or, maybe they just updated it since the last time I looked. The version of GCC in Ubuntu 14.04.1 that I used says 4.8.4. Anyway, the App I compiled is working in 14.04.1 with Kernel 3.13.
ID: 1950842 · 举报违规帖子     回复 引用
Profile Keith Myers Special Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:29 Apr 01
贴子:11776
积分:1,160,866,277
近期平均积分:1,873
United States
消息 1950836 - 发表于:20 Aug 2018, 2:04:48 UTC - 回复消息 1950834.  

Either 16.04 or 18.04. 18.04 has a future till 2024. There are a lot of nice new features in 18.04. I've been happy with it. Always a bit jarring to pull up a chair to one of my first systems with 16.04 still on it. I've become much more comfortable and used to 18.04 by now. In fact, my first Linux system just popped up a upgrade notice saying click here for the latest and greatest 18.04. I put it off till the end of the contest.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1950836 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950834 - 发表于:20 Aug 2018, 1:40:23 UTC - 回复消息 1950819.  

This system is running release 131 which is pretty much up to date. This system is the one on which I foolishly installed the repository version of BOINC.

Yes, both those systems are showing Kernel 4.4. They Should work. There might be something else going on there. Did you try the Other App? The one that is listed in the app_info that Keith and myself used? You should give it a try.

I've told you before, it should be simple to change the Repository BOINC over to Berkeley BOINC. The boinc-client folder is basically the Berkeley BOINC without the BOINC Apps installed. The biggest problem is you need to use a clean install of Ubuntu so you don't have any configuration files from the Repository BOINC in your system. All you really need to save your HOST ID is the client_state.xml file, the rest of the folder is gravy. You just need to ZIP the boinc-client folder and save it for the New System before you install the New System.


. . It all seems to come down to the c++ library libstdc++6. That library is installed on this host but those two extensions are missing which 0.97 needs, GLIBCXX_3.4.20 and 21. I did a re-install of the library with Synaptic but those later extensions are still MIA.

. . I have some errands and then I'll get lunch and come back for another try. Which version of Ubuntu OS should I go for ... 18.04?

Stephen

?
ID: 1950834 · 举报违规帖子     回复 引用
Profile Tom M
志愿者测试人员

发送消息
已加入:28 Nov 02
贴子:4973
积分:276,046,078
近期平均积分:462
消息 1950833 - 发表于:20 Aug 2018, 1:32:19 UTC

I am pleased to announce that my I7-3770 machine (#ID: 8564832 is the Linux version) has successfully undergone dual boot upgrade and is happily munching along at the moment. I will have to boot back into Windows to get the rest of its tasks processed out.

The "au" tasks make it harder to see that the Gtx 750Ti is running a bunch faster but it is clear that the cpu is running its tasks faster than another box I have which doesn't have the AVX instruction set.

I am very pleased, even if I am running a version that is 2-3 releases behind. :)

Tom
A proud member of the OFA (Old Farts Association).
A candidate for membership in the WWA (Walking Wounded Association).
ID: 1950833 · 举报违规帖子     回复 引用
Profile Keith Myers Special Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:29 Apr 01
贴子:11776
积分:1,160,866,277
近期平均积分:1,873
United States
消息 1950831 - 发表于:20 Aug 2018, 1:14:54 UTC - 回复消息 1950827.  

I don't know if kernel 4.4.5 was in your original distribution upgrade path or not. You could always try at least.
sudo apt-get dist-upgrade

first and see if that snags the next kernel in your distribution path. Or if necessary do the release upgrade.
sudo do-release-upgrade

Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1950831 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950827 - 发表于:20 Aug 2018, 0:47:49 UTC - 回复消息 1950818.  

What was the output of the ldd Terminal run?

uname -r

prints out the kernel revision number.


. . Yes there are the two missing dependencies covered in the messages from TBar, Petri and our Canadian friend :) But it seems it all comes back to the libstdc++.so.6 so I will try that in Synaptic.

. . But the result of that uname -r is ... 4.4.0-131-generic

. . TBar is right that I should update to 4.4.5 but I don't know how. I accept all the usual system updates.

. . It's a good thing I'm bald or I would tear out my hair ...

Stephen

:(
ID: 1950827 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950823 - 发表于:20 Aug 2018, 0:31:50 UTC - 回复消息 1950765.  

And I'm guessing (finding) that `GLIBCXX_3.4.21' can't/won't work with Ubuntu 14 ??

I'm sure it can be found or compiled. I must have it from somewhere.

This might be of help https://askubuntu.com/questions/575505/glibcxx-3-4-20-not-found-how-to-fix-this-error
It is not 3.4.2.1 but doing similar google searches might help.

I compile my programs with
gcc --version
gcc (Ubuntu 5.2.1-22ubuntu2) 5.2.1 20151010
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.


. . It seems I need to update the stdlibc++6 but when I try is says locked.

I have stopped fully Boinc with the service stop command but it still says locked.

Stephen

:(
ID: 1950823 · 举报违规帖子     回复 引用
TBar
志愿者测试人员

发送消息
已加入:22 May 99
贴子:5204
积分:840,779,836
近期平均积分:2,768
United States
消息 1950819 - 发表于:20 Aug 2018, 0:18:46 UTC - 回复消息 1950809.  

This system is running release 131 which is pretty much up to date. This system is the one on which I foolishly installed the repository version of BOINC.

Yes, both those systems are showing Kernel 4.4. They Should work. There might be something else going on there. Did you try the Other App? The one that is listed in the app_info that Keith and myself used? You should give it a try.

I've told you before, it should be simple to change the Repository BOINC over to Berkeley BOINC. The boinc-client folder is basically the Berkeley BOINC without the BOINC Apps installed. The biggest problem is you need to use a clean install of Ubuntu so you don't have any configuration files from the Repository BOINC in your system. All you really need to save your HOST ID is the client_state.xml file, the rest of the folder is gravy. You just need to ZIP the boinc-client folder and save it for the New System before you install the New System.
ID: 1950819 · 举报违规帖子     回复 引用
Profile Keith Myers Special Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:29 Apr 01
贴子:11776
积分:1,160,866,277
近期平均积分:1,873
United States
消息 1950818 - 发表于:20 Aug 2018, 0:17:27 UTC - 回复消息 1950813.  

What was the output of the ldd Terminal run?

uname -r

prints out the kernel revision number.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1950818 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950815 - 发表于:20 Aug 2018, 0:09:40 UTC - 回复消息 1950762.  

All you have to do is Update it to 14.04.5 and it will work.
The 14.04 system that isn't working hasn't been updated in some time.
Petri is running 4.2.0-42, you need at least that.


. . This is not the machine that you think it is. This one gets updated regularly and works AOK (which is strange because it is quite an old C2D while the machine with the updated kernel issues is an i5-6600, the second newest machine I have, only 12 months old).

. . How do I tell exactly what version/revision of the kernel is running? In 'about Ubuntu' it only says 14.04 LTS?

Stephen

?
ID: 1950815 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950813 - 发表于:20 Aug 2018, 0:04:00 UTC - 回复消息 1950761.  

And I'm guessing (finding) that `GLIBCXX_3.4.21' can't/won't work with Ubuntu 14 ??


. . Give the man the cigar ... All searches in Synaptic find nothing ...

Stephen

:(
ID: 1950813 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950812 - 发表于:19 Aug 2018, 23:51:06 UTC - 回复消息 1950744.  

Well first requirement is a Nvidia driver with CUDA9.2 capability. So 396.45 or 396.51 is mandatory. The tasks you linked show a missing dependency on your system. Since I believe you are either running off a USB stick or minimal installation, you must not have the normal packages installed. You should open a Terminal. Type ldd and a space. With File Manager opened on the directory you have the 0.97 special app unpacked in, I assume either the /Downloads or /setiathome.berkeley.edu directory, click on the special app with the mouse and drag and drop it into the Terminal window. Click on the Terminal window again to make it have focus and hit Enter. The ldd command will print out all the dependencies that are needed by the 0.97 special app. The printed output at the top will show which packages are missing followed by all the packages dependencies that are satisfied. You need to install the packages that are missing. By the looks of your errored tasks, I would say you are missing the gcc6+ package libraries or gnu related.


. . Yep you're right there are 2 missing libraries. I will hit that with Synaptic and see how that goes.

Stephen

<my bad>
ID: 1950812 · 举报违规帖子     回复 引用
Profile Keith Myers Special Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:29 Apr 01
贴子:11776
积分:1,160,866,277
近期平均积分:1,873
United States
消息 1950810 - 发表于:19 Aug 2018, 23:37:58 UTC

Yes, that Minimal install sure is bass-ackwards. Install everything first . . . Then delete most of what you installed. Huh!? Canonical must have stock in storage companies to help exercise hard drives. I was disappointed in the Remmina data usage too. There are alternatives though.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1950810 · 举报违规帖子     回复 引用
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:20 Sep 12
贴子:5398
积分:192,787,363
近期平均积分:628
Australia
消息 1950809 - 发表于:19 Aug 2018, 23:34:44 UTC - 回复消息 1950739.  

What you failed to notice is that Keith and myself used PETRIS OTHER APP, the one for MAXWELLs.
You chose to use the OTHER PETRI APP, and didn't bother to look at the name difference.
IF, you would have had BOTH of Petri's Apps in the Folder, it wouldn't have GHOSTED the tasks. BOINC MUST FIND THE NAMED FILE.
If you have a named file in you app_info, it had Better be in the folder.

. . True but I had already said I knew the mistake I made there, I corrected that and I can recover the ghosts later.

Your other problem Appears to be you didn't Enable Networking in Recovery Mode as per instructions.
If you don't Enable Networking, Nothing will be written to the disk.

. . OK, that is something to note for the future. Never having used 'recovery mode' before I went back over the messages to get the details but I did not find the message with that detail in it. If I had the time and the patience I would go back over this thread and try to get all the important info like that together in a short series of messages. But like the saying says, we learn more from mistakes than from getting it right.

Is this the same system of yours that's been borked for some time? Something about you can't update the Kernel?
I remember some problems you were having.

. . Nope, that is the system with the 970's. I can update the kernel but any kernel later than release 96 and it won't boot from the flashdrive any more. So it stays at release 96.

Petri's App must have at least the same Kernel that was used to Compile the App.
Your Kernel may be too old, hence the Compute Errors. His Apps will Not work in Ubuntu 14.04.1, the one I use to compile with kernel 3.13. I had to change systems to use his App.
This Means your System is too Old, /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.20' not found
Looks as though it's time you finally fixed that system.

. . I actually asked Petri about kernel compatibility and he assured me he had compiled on a system running 14.04 so it should have worked. I guess there was more detail I should have know about but sadly I am no Linux guru. This system is running release 131 which is pretty much up to date. This system is the one on which I foolishly installed the repository version of BOINC. So upgrading to a later version of Ubuntu is a problem, I don't want to trash the host ID and create a new one. Catch 22's all over the place. If I choose the option in the update process to step up to a later Linux kernel, say 18.04 will it do a 'friendly' update without trashing everything/anything?

Stephen

<shrug>
ID: 1950809 · 举报违规帖子     回复 引用
Profile Raistmer
志愿者开发人员
志愿者测试人员
Avatar

发送消息
已加入:16 Jun 01
贴子:6259
积分:106,370,077
近期平均积分:121
Russia
消息 1950801 - 发表于:19 Aug 2018, 22:28:48 UTC
最近的修改日期:19 Aug 2018, 23:21:12 UTC

Live booted Ubuntu doesn't have MidnightCommander. What happened with the world %)
EDIT: I observe very strange installation procedure.
Minimal install was chosen. So it installed... seems ALL. And now it REMOVES stuff. For example, it removed GNOME docs and now preparing to remove Majong game. Is it not common logic to NOT install everything on MINIMAL install? Even Windows at least pretends not to install smth that didn't selected for install...
EDIT2: Remmina (RDP client) asks to send usage statistics.. Is it really *nix OS or M$ won everywhere ???
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1950801 · 举报违规帖子     回复 引用
TBar
志愿者测试人员

发送消息
已加入:22 May 99
贴子:5204
积分:840,779,836
近期平均积分:2,768
United States
消息 1950781 - 发表于:19 Aug 2018, 19:50:48 UTC

....or, you could just wait around a few days until I've tested the version of V0.97, that I compiled in Ubuntu 14.04.1, long enough to feel safe about posting it.
It was compiled in an old enough version of 14.04 that it will work on almost ALL versions of 14.04, sorta like All the past versions I've posted.
It will probably even work on Stephen's system.
But, I just started testing it Yesterday...a few hours after receiving the source code.
It's the one running here, https://setiathome.berkeley.edu/results.php?hostid=6813106&offset=340
I'd like to see a few more days of testing.
It will also contain an actual app_info.xml...
ID: 1950781 · 举报违规帖子     回复 引用
Profile Keith Myers Special Project $250 donor
志愿者测试人员
Avatar

发送消息
已加入:29 Apr 01
贴子:11776
积分:1,160,866,277
近期平均积分:1,873
United States
消息 1950780 - 发表于:19 Aug 2018, 19:44:34 UTC

So who is going to volunteer to develop a snap version of the 0.97 application installation and make a easy one click installation? That is what Richard keeps hinting at.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1950780 · 举报违规帖子     回复 引用
Profile petri33
志愿者测试人员

发送消息
已加入:6 Jun 02
贴子:1668
积分:623,086,772
近期平均积分:156
Finland
消息 1950778 - 发表于:19 Aug 2018, 19:34:02 UTC
最近的修改日期:19 Aug 2018, 19:34:53 UTC

Here is what I have...
root@Linux1:~/sah_v7_opt/Xbranch/client# ldd setiathome_x41zc_x86_64-pc-linux-gnu_cuda92     (<-- that is my latest executable, I have not updated the Makefile in a long time for the name)
	linux-vdso.so.1 =>  (0x00007ffc539e5000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8aee5fd000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8aee3f9000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f8aee1f0000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f8aede6e000)    <<<-------------- here is my libstdc++
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f8aedb66000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f8aed94e000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8aed584000)
	/lib64/ld-linux-x86-64.so.2 (0x000055b0abbfd000)

root@Linux1:~/sah_v7_opt/Xbranch/client# gcc --version
gcc (Ubuntu 5.2.1-22ubuntu2) 5.2.1 20151010
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

root@Linux1:~/sah_v7_opt/Xbranch/client#  strings /usr/lib/x86_64-linux-gnu/libstdc++.so.6 | grep GLIBCXX    <<------ and here is what is in it regarding GLIBCXX
GLIBCXX_3.4
GLIBCXX_3.4.1
GLIBCXX_3.4.2
GLIBCXX_3.4.3
GLIBCXX_3.4.4
GLIBCXX_3.4.5
GLIBCXX_3.4.6
GLIBCXX_3.4.7
GLIBCXX_3.4.8
GLIBCXX_3.4.9
GLIBCXX_3.4.10
GLIBCXX_3.4.11
GLIBCXX_3.4.12
GLIBCXX_3.4.13
GLIBCXX_3.4.14
GLIBCXX_3.4.15
GLIBCXX_3.4.16
GLIBCXX_3.4.17
GLIBCXX_3.4.18
GLIBCXX_3.4.19
GLIBCXX_3.4.20
GLIBCXX_3.4.21                                            <<<-------------- 3.4.21 is the last one I have
GLIBCXX_DEBUG_MESSAGE_LENGTH

To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1950778 · 举报违规帖子     回复 引用
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
志愿者测试人员

发送消息
已加入:1 Dec 99
贴子:2786
积分:685,657,289
近期平均积分:835
Canada
消息 1950773 - 发表于:19 Aug 2018, 19:24:09 UTC - 回复消息 1950765.  

I have been Asking.Ubuntu a lot here, LOL
Been through a bunch of those toolchain installs.

Description: Ubuntu 14.04.5 LTS
Release: 14.04

mine for ... strings /usr/lib/x86_64-linux-gnu/libstdc++.so.6 | grep GLIBCXX
<snip> ....
GLIBCXX_3.4.18
GLIBCXX_3.4.19
GLIBCXX_3.4.20
GLIBCXX_3.4.21
GLIBCXX_3.4.22
GLIBCXX_3.4.23
GLIBCXX_3.4.24
GLIBCXX_3.4.25
GLIBCXX_DEBUG_MESSAGE_LENGTH

stderr ...
../../projects/setiathome.berkeley.edu/setiV0.97.linux_x64_10x0: relocation error: ../../projects/setiathome.berkeley.edu/setiV0.97.linux_x64_10x0: symbol _ZTVNSt7__cxx1119basic_istringstreamIcSt11char_traitsIcESaIcEEE, version GLIBCXX_3.4.21 not defined in file libstdc++.so.6 with link time reference

I'm going to look through that symbolic link again ...
ID: 1950773 · 举报违规帖子     回复 引用
前 · 1 . . . 101 · 102 · 103 · 104 · 105 · 106 · 107 . . . 161 · 后

留言板 : Number crunching : Setting up Linux to crunch CUDA90 and above for Windows users


 
©2020 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.