Linux CUDA 'Special' App finally available, featuring Low CPU use

Message boards : Number crunching : Linux CUDA 'Special' App finally available, featuring Low CPU use
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 52 · 53 · 54 · 55 · 56 · 57 · 58 . . . 83 · Next

AuthorMessage
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1888856 - Posted: 9 Sep 2017, 18:11:00 UTC - in response to Message 1888155.  

In script ... /usr/bin/perl^M ... not found or something
try typing
whereis perl <enter>
on a terminal window.

I guess it finds it ok. Then edit the ^M (Ctrl+M) away from the script file. It is a DOS remnant.

Typing whereis perl finds Perl OK

perl: /usr/bin/perl5.22-x86_64-linux-gnu /usr/bin/perl /etc/perl /usr/share/perl /usr/share/man/man1/perl.1.gz

But I can't find ^M (Ctrl+M) anywhere in the script.

On linux, Perl is already installed (type 'whereis perl' to know where the perl binary is located).
so change the first line "#!/usr/bin/perl" to your perl path "#!/<mypath>/perl" where mypath is your
perl path.
or you can run the script using :
'perl cpu2gpu.pl -i'

http://www.w3perl.com/seti/

"#!/usr/bin/perl" in the script seem to be OK, typing perl cpu2gpu.pl -i works:

#CPU,GPU,AP wu
95,195,0

Tried a simulation run: perl cpu2gpu.pl -r -u

GPU version found : 801 - (class : cuda80)
CPU version found : 800
AP version found : 704
Completed wu : blc05_2bit_guppi_57903_46950_HIP9480_0002.10206.409.24.47.45.vlar_1 (800)
Completed wu : blc05_2bit_guppi_57903_46950_HIP9480_0002.7287.818.24.47.37.vlar_0 (801)
Completed wu : blc05_2bit_guppi_57903_47289_HIP8825_0003.7853.818.24.47.81.vlar_1 (801)
Completed wu : blc05_2bit_guppi_57903_47289_HIP8825_0003.7853.818.24.47.72.vlar_1 (801)
Active wu : 01mr08ac.6628.24208.12.39.19_1 (800)
Active wu : 21oc08ac.15280.21745.4.31.139.vlar_2 (800)
Active wu : 21oc08ac.24024.1704.9.36.38_1 (800)
Active wu : 21oc08ac.10891.5385.7.34.153.vlar_1 (800)
Active wu : blc05_2bit_guppi_57903_47289_HIP8825_0003.7853.818.24.47.53.vlar_0 (801)
Active wu : blc05_2bit_guppi_57903_47289_HIP8825_0003.7853.818.24.47.56.vlar_0 (801)
Found GPU version used : 801 in /var/lib/boinc-client/client_state.xml (cuda80 / x86_64-pc-linux-gnu)
Found CPU Version used : 800 in /var/lib/boinc-client/client_state.xml
300 wu found
----- MODE SIMULATION
cannot write /var/lib/boinc-client/client_state_new.xml at cpu2gpu.pl line 441.

So I'm still stuck :(
ID: 1888856 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1888858 - Posted: 9 Sep 2017, 18:13:54 UTC - in response to Message 1888856.  
Last modified: 9 Sep 2017, 18:14:42 UTC

cannot write /var/lib/boinc-client/client_state_new.xml at cpu2gpu.pl line 441.
Try running as SuperUser 'sudo'
ID: 1888858 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1888860 - Posted: 9 Sep 2017, 18:45:40 UTC - in response to Message 1888858.  

cannot write /var/lib/boinc-client/client_state_new.xml at cpu2gpu.pl line 441.
Try running as SuperUser 'sudo'

That worked, thanks.

Sudo this sudo that...
ID: 1888860 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1888861 - Posted: 9 Sep 2017, 18:59:47 UTC - in response to Message 1888860.  

I just leave a SuperUser window (did I say Window? LOL) open so that everything you do is a sudo
sudo bash - makes you SuperUser.
ID: 1888861 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1889078 - Posted: 10 Sep 2017, 16:34:28 UTC

I've searched the thread and didn't come up with an answer to a question I have about what does "Sigma" represent in the stderr.txt output. It varies quite a bit over large values. Is a Sigma value of 3 good? Or is a Sigma value of 400 good?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1889078 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1668
Credit: 623,086,772
RAC: 156
Finland
Message 1889099 - Posted: 10 Sep 2017, 18:01:38 UTC - in response to Message 1889078.  
Last modified: 10 Sep 2017, 18:02:04 UTC

I've searched the thread and didn't come up with an answer to a question I have about what does "Sigma" represent in the stderr.txt output. It varies quite a bit over large values. Is a Sigma value of 3 good? Or is a Sigma value of 400 good?


Sigma refers to the width of a Gaussian search. The bigger the value the wider the search under the Gaussian curve (more work). No bad or good meanings.

Petri
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1889099 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1889103 - Posted: 10 Sep 2017, 18:12:44 UTC - in response to Message 1889099.  

Thanks Petri. Just wondered what it represented and if it had anything to do with a low value in my case, being represented a lot more in my Inconclusives list. I figured it probably didn't since my increase in the past week was of my own doing. But was curious anyhow.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1889103 · Report as offensive
W3Perl Project Donor
Volunteer tester

Send message
Joined: 29 Apr 99
Posts: 251
Credit: 3,696,783,867
RAC: 12,606
France
Message 1889114 - Posted: 10 Sep 2017, 19:30:53 UTC - in response to Message 1889099.  



Sigma refers to the width of a Gaussian search. The bigger the value the wider the search under the Gaussian curve (more work). No bad or good meanings.

Petri


With one sigma, you get 68% of the signal, two sigma 95%, 3 sigma 99.7% and 5 sigma 99.999%
In science, most people require a 3 sigma signal to be relevant. In particle physics, they need 5 sigma to make an announcement.
ID: 1889114 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1668
Credit: 623,086,772
RAC: 156
Finland
Message 1889116 - Posted: 10 Sep 2017, 19:42:15 UTC - in response to Message 1889103.  

Thanks Petri. Just wondered what it represented and if it had anything to do with a low value in my case, being represented a lot more in my Inconclusives list. I figured it probably didn't since my increase in the past week was of my own doing. But was curious anyhow.


The value being output is an old debug print out. I was figuring out what the software does with different ar and WU type. Some WU's do not do any Gaussian searches, some do not do any pulse finds with small FFT lengths. Vlars/Guppi do a lot of pulse find work with FFT len 8, 16, 32,..., 1024 and that is SLOW even with the special app.

Some workloads spread nicely over all of the GPU compute units, some do not. There is a lot of places for optimisations still to do. That keeps me in this hobby. I would not do this for money.
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1889116 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1889164 - Posted: 11 Sep 2017, 3:30:45 UTC - in response to Message 1889116.  
Last modified: 11 Sep 2017, 3:32:14 UTC

There is a lot of places for optimisations still to do. That keeps me in this hobby. I would not do this for money.

:-)
Reminds me of when I used to repair VCRs, cameras and the like for a living. When my VCR broke down, I didn't repair it for about 3 months, and only then because my brother kept hassling me about it.
When you have to do something, it tends to take a lot of the enjoyment out of it.
Grant
Darwin NT
ID: 1889164 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1889172 - Posted: 11 Sep 2017, 4:24:01 UTC

Anybody know if the Special App was tested against the 4-bit WUs in Beta? The reason I ask is that I've had some odd Invalids on two different machines over the last couple days. They're -9 overflows where the Pulse and Triplet counts differ significantly from the wingmen who successfully validated.

I'm pretty sure there's also been an increase in my Inconclusives, with a sampling of those looking like these:

Workunit 2669316379 (01mr08ac.6680.72.14.41.0)
Task 6005913251 (S=0, A=0, P=29, T=1, G=0, BG=0) v8.22 (opencl_nvidia_SoG) windows_intelx86
Task 6005913252 (S=0, A=0, P=0, T=30, G=0, BG=0) x41p_zi3v, Cuda 8.00 special

Workunit 2670652172 (10oc08af.29544.82164.10.37.255)
Task 6008700184 (S=0, A=0, P=29, T=1, G=0, BG=0) v8.20 (opencl_ati5_SoG_mac) x86_64-apple-darwin
Task 6008700185 (S=0, A=0, P=10, T=20, G=0, BG=0) x41p_zi3t2b, Cuda 8.00 special

Workunit 2671281097 (14dc08ab.28268.66735.15.42.1)
Task 6010004517 (S=0, A=0, P=14, T=16, G=0, BG=0) v8.22 (opencl_nvidia_SoG) windows_intelx86
Task 6010004518 (S=0, A=0, P=0, T=30, G=0, BG=0) x41p_zi3t2b, Cuda 8.00 special

Workunit 2671421404 (14dc08ab.30525.69598.16.43.0)
Task 6010297125 (S=0, A=0, P=30, T=0, G=0, BG=0) v8.22 (opencl_nvidia_SoG) windows_intelx86
Task 6010297126 (S=0, A=0, P=0, T=30, G=0, BG=0) x41p_zi3t2b, Cuda 8.00 special

This may not be limited to Cuda80, though, as I also got an Invalid for a similar Pulse/Triplet mismatch on my daily driver running Cuda50. Only my 4th Invalid on that machine in over 4 years of crunching.
ID: 1889172 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22204
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1889173 - Posted: 11 Sep 2017, 5:02:41 UTC

Hmmm - I'm seeing a number of invalids across my Linux boxes, all of which are running the special app. Some are guppies, but one set are ex-Arecibo, not sue if they were 2 or 4 bit deliveries....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1889173 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22204
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1889178 - Posted: 11 Sep 2017, 5:19:17 UTC

I've just watched a pile of downloads - it would appear that most, if not all, tasks (including ex-Arecibo) we are getting now are 4-bit, despite many being labeled 2-bit
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1889178 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1889181 - Posted: 11 Sep 2017, 5:31:16 UTC

I've been seeing a lot of inconclusives too. Additional new ones beyond the ones I admit were caused by me. I am seeing a single count difference either in Triplets or Pulses against my wingmen. They seem to be associated mostly with the new larger tasks.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1889181 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1889182 - Posted: 11 Sep 2017, 5:41:48 UTC - in response to Message 1889178.  

I've just watched a pile of downloads - it would appear that most, if not all, tasks (including ex-Arecibo) we are getting now are 4-bit, despite many being labeled 2-bit


From Eric in Beta when they were first released for testing-
There won't be any easy way to tell what you've got apart from the file size. 2-bit WUs are about 360K. 4-bit WUs are about 620K. The "2bit" or "8bit" designation in the file name is about the input data that the splitter operated upon. (And it's wrong anyway. The 2bit input data is actually 4 bits per complex sample.)

In the workunit file itself, there's a relatively new entry called wu_bits_per_sample which should be 2 past data, and in the new data should say 4.

Grant
Darwin NT
ID: 1889182 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22204
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1889185 - Posted: 11 Sep 2017, 6:56:36 UTC

The batch I watched were coming in at ~700k rather than the ~360k of late
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1889185 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1889191 - Posted: 11 Sep 2017, 7:39:35 UTC - in response to Message 1889185.  

From Eric:
Double size is the new standard for both Arecibo and GBT (and eventually Parkes). Unless UC complains about the extra traffic. I don't think they'll even notice it.
ID: 1889191 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1889192 - Posted: 11 Sep 2017, 7:42:22 UTC - in response to Message 1889185.  

Yes, same here. Based on the FIFO ordering of tasks, I still am processing that big slug of 700K sized tasks. The recent ones today seem to be the older 357K size.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1889192 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1889195 - Posted: 11 Sep 2017, 8:09:46 UTC - in response to Message 1889192.  

Strange, my 3x1080 rig does not have one 350k file on it.
ID: 1889195 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1889197 - Posted: 11 Sep 2017, 8:17:24 UTC - in response to Message 1889195.  
Last modified: 11 Sep 2017, 9:07:30 UTC

Strange, my 3x1080 rig does not have one 350k file on it.

Likewise, all 705kB files here as well.

EDIT- just picked up a 360kB file; resend of a resend.
Grant
Darwin NT
ID: 1889197 · Report as offensive
Previous · 1 . . . 52 · 53 · 54 · 55 · 56 · 57 · 58 . . . 83 · Next

Message boards : Number crunching : Linux CUDA 'Special' App finally available, featuring Low CPU use


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.