Optimised application installation thread 2.

Message boards : Number crunching : Optimised application installation thread 2.
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1872851 - Posted: 14 Jun 2017, 7:22:39 UTC

Hi all...I didn't want to hijack Suzuki's thread with my own inquiries.... Any how, I had installed the beta6 Lunatics App on my HP the other day.
The first thing I noticed was that my task load was greatly shortened.....And yesterday when I returned home from work...I was very surprised to see that my computer only had the GPU WU loaded and were near completion. I hadn't enough WUs to process during the down time at Berkely...
It appears my CPUs had no work. I have uninstalled the Beta6 app for the moment. But my daily task rates are still only 5...one for each processor and the GPU???
Should I just wait for the system to get going again or can I even reinstall BONIC without losing information?
Clearly It was me that did something wrong with the Beta6 installation....perhaps something I didn't tick in a box!!
ID: 1872851 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1872859 - Posted: 14 Jun 2017, 7:59:26 UTC

By all rights your i3 rig would be the only rig you have to really benefit by using Lunatics at this time by using the AVX based CPU app.

You also have to remember that if you have a large cache and install Lunatics your estimated run times for a while will be increased decreasing your cache's usual capacity until those run times stabilise again and that looks to be what happened to you (best to do the change to Lunatics after an outage instead of before). ;-)

Cheers.
ID: 1872859 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1872868 - Posted: 14 Jun 2017, 10:30:38 UTC - in response to Message 1872859.  

Thanks Wiggo.....
So should I re install the Lunatics app @ Beta6?
And if so what boxes should I tick? Really sorry about the dummy questions........My task list is still only showing 5 tasks...the ones that are currently running?
Can I reinstall BONIC...or would that make things worse for me?
Thanks for your help sir!
ID: 1872868 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1872882 - Posted: 14 Jun 2017, 11:20:25 UTC
Last modified: 14 Jun 2017, 11:20:44 UTC

On your i3 the installer will pick the best CPU MB app itself (the AVX app in its case), just make sure that you tick AP processing as well, and if you're going to use the Intel iGPU tick both MB and AP processing there (the AMD/ATi & Nvidia screens should be left alone).

I'd just let the Dell run stock as it should wind up getting the v8.05 windows_x86_64 app in the end, just like your i3 and Turion are now doing, and that should be the best app for it.

Cheers.
ID: 1872882 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1872915 - Posted: 14 Jun 2017, 14:32:07 UTC - in response to Message 1872882.  

Thanks Wiggie for your help....
ID: 1872915 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1872925 - Posted: 14 Jun 2017, 15:24:02 UTC - in response to Message 1872915.  

Well I did al of the above but only got one task going. Does the app condense all the tasks into just one?
So I have uninstalled again.....and now I am getting " No work to process"
I think I have upset someone...:-)
ID: 1872925 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1872937 - Posted: 14 Jun 2017, 16:17:46 UTC - in response to Message 1872925.  
Last modified: 14 Jun 2017, 16:18:00 UTC

OK. So I am currently processing 4 X WUs and I X Graphics...a total of 5 WU been processed. Each WU is around 3 hours long.
While I had the Lunatic installed I had one almost 12 hour WU been processed. Is this in fact what the Optimized app does....?
ID: 1872937 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1872978 - Posted: 14 Jun 2017, 22:22:50 UTC

On your i3 you need to reserve a core of 2 if you're going to use the iGPU otherwise you'll just suffer cache thrashing which will slow down all core processing, but as I said, it's pointless to run Lunatics on that Dell as it is. ;-)

Cheers.
ID: 1872978 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1872987 - Posted: 14 Jun 2017, 22:58:53 UTC - in response to Message 1872937.  

OK. So I am currently processing 4 X WUs and I X Graphics...a total of 5 WU been processed. Each WU is around 3 hours long.
While I had the Lunatic installed I had one almost 12 hour WU been processed. Is this in fact what the Optimized app does....?

I believe Wiggo mentioned this previously previously. The estimated completion times in BOINC when you change apps will be inaccurate until the server gets an accurate estimate.

This requires 11 good tasks to be completed. You can check the status of this from the Application details on your host.
So far your i3 has 3 results that count toward this. See Number of tasks completed.
SETI@home v8 (anonymous platform, CPU)
Number of tasks completed	3
Max tasks per day		36
Number of tasks today		0
Consecutive valid tasks		3
Average processing rate		17.65 GFLOPS
Average turnaround time		0.37 days

Sometimes you may see the value for Consecutive valid tasks higher than Number of tasks completed. because your returned a good result, but it was perhaps a VLAR or VHAR which falls outside the bounds to be included in Number of tasks completed

The Optimized apps work just like the other apps, but have code optimizations which can allow them to complete the same work faster.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1872987 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1873002 - Posted: 15 Jun 2017, 0:21:35 UTC
Last modified: 15 Jun 2017, 0:21:49 UTC

On your i3 it is doing,

v8 8.00 windows_intelx86  Average processing rate 	12.81 GFLOPS
v8 8.05 windows_x86_64  Average processing rate 	13.53 GFLOPS
v8 (anonymous platform, CPU) Average processing rate 	17.65 GFLOPS

so as you can see you were doing a lot better with the Lunatics app and I still think you'd be better off not using the iGPU and just running all 4 cores instead (as many here have found out through testing).

Cheers.
ID: 1873002 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1873008 - Posted: 15 Jun 2017, 1:00:39 UTC - in response to Message 1873002.  

i GPUs are evil IMO.
ID: 1873008 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873062 - Posted: 15 Jun 2017, 6:37:08 UTC - in response to Message 1873002.  

On your i3 it is doing,

v8 8.00 windows_intelx86  Average processing rate 	12.81 GFLOPS
v8 8.05 windows_x86_64  Average processing rate 	13.53 GFLOPS
v8 (anonymous platform, CPU) Average processing rate 	17.65 GFLOPS

so as you can see you were doing a lot better with the Lunatics app and I still think you'd be better off not using the iGPU and just running all 4 cores instead (as many here have found out through testing).

Cheers.

Again....many thanks...I shall install again and use only 4 CRU...
Thank you...:-)
ID: 1873062 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873063 - Posted: 15 Jun 2017, 6:38:29 UTC - in response to Message 1872987.  

OK. So I am currently processing 4 X WUs and I X Graphics...a total of 5 WU been processed. Each WU is around 3 hours long.
While I had the Lunatic installed I had one almost 12 hour WU been processed. Is this in fact what the Optimized app does....?

I believe Wiggo mentioned this previously previously. The estimated completion times in BOINC when you change apps will be inaccurate until the server gets an accurate estimate.

This requires 11 good tasks to be completed. You can check the status of this from the Application details on your host.
So far your i3 has 3 results that count toward this. See Number of tasks completed.
SETI@home v8 (anonymous platform, CPU)
Number of tasks completed	3
Max tasks per day		36
Number of tasks today		0
Consecutive valid tasks		3
Average processing rate		17.65 GFLOPS
Average turnaround time		0.37 days

Sometimes you may see the value for Consecutive valid tasks higher than Number of tasks completed. because your returned a good result, but it was perhaps a VLAR or VHAR which falls outside the bounds to be included in Number of tasks completed

The Optimized apps work just like the other apps, but have code optimizations which can allow them to complete the same work faster.


Thank you very much for the support on this matter....am clearly new but hopefully learning...:-)
ID: 1873063 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1873064 - Posted: 15 Jun 2017, 6:46:26 UTC

Here you must follow the old saying, "Patience Grasshopper".

Major changes can take up to 4-6 weeks to show their true potential, so just remember the old adage, "Rome wasn't built in a day" (a week or 2 maybe, a month possibly,....). ;-)

Cheers.
ID: 1873064 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873066 - Posted: 15 Jun 2017, 6:56:31 UTC - in response to Message 1873064.  

Here you must follow the old saying, "Patience Grasshopper".

Major changes can take up to 4-6 weeks to show their true potential, so just remember the old adage, "Rome wasn't built in a day" (a week or 2 maybe, a month possibly,....). ;-)

Cheers.

Quite true......
Have re installed and with no IGPU....and will leave it alone now. Thank you again for your information patience...:-)
ID: 1873066 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873433 - Posted: 16 Jun 2017, 21:40:24 UTC - in response to Message 1873066.  

Well....things seem to be settling down now...I think my numbers are improving with the Lunatics app.....but cant find the place to check...any how....will continue to leave well enough alone....
Although I have installed Ubuntu and may indeed use it as my new OS on the Dell desk top in a virtual box as it comes mainly in 64 bit...while my Dell is 32 bit...but this might just be as an experiment only trial...:-)
ID: 1873433 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1873438 - Posted: 16 Jun 2017, 22:08:16 UTC - in response to Message 1873433.  

I think my numbers are improving with the Lunatics app.....but cant find the place to check

The quickest method is to look at the run times in the BOINC Manager.

The other method is to look at the computer on your Account, click on the Tasks link, and then look at the Validated (or Pending) results & see how long they are running for.
One thing I find odd with your i3 numbers is that your Run times are almost 45 min longer than the CPU time- this generally indicates something else is running that is taking time away from crunching the WUs. If you are no longer using the iGPU, once all the existing iGPU WUs have been processed, CPU & Run times should become the same (give or take a few minutes). If they don't, i'd suggest running Process Explorer to see just what is interfering with your processing.
Your Core 2 Duo times are almost double, so something is going on there as well, impacting on your crunching.
Grant
Darwin NT
ID: 1873438 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873531 - Posted: 17 Jun 2017, 6:29:13 UTC - in response to Message 1873438.  

I think my numbers are improving with the Lunatics app.....but cant find the place to check

The quickest method is to look at the run times in the BOINC Manager.

The other method is to look at the computer on your Account, click on the Tasks link, and then look at the Validated (or Pending) results & see how long they are running for.
One thing I find odd with your i3 numbers is that your Run times are almost 45 min longer than the CPU time- this generally indicates something else is running that is taking time away from crunching the WUs. If you are no longer using the iGPU, once all the existing iGPU WUs have been processed, CPU & Run times should become the same (give or take a few minutes). If they don't, i'd suggest running Process Explorer to see just what is interfering with your processing.
Your Core 2 Duo times are almost double, so something is going on there as well, impacting on your crunching.

Thanks for that...I had put that down to the fact that I have recently installed the Lunatics app....and that it takes soem time for it to settle dow. For example the estimated run time have already dropped significantly to date...
But again I shall consider to monitor...
I appreciate your help....thanks....
ID: 1873531 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1873533 - Posted: 17 Jun 2017, 6:35:34 UTC - in response to Message 1873531.  

Yeah!!
Just checked now and the computers with Lunatics running are throwing up the anomalies between run time..and processing times...
I shall let it settle for a while....
ID: 1873533 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1873535 - Posted: 17 Jun 2017, 6:50:15 UTC

Nice thing about doing it in cc_config is that it can be done on the fly, with changes being immediate and not requiring a shutdown/restart, unlike app_config changes.

For app_config, all you need to do is Options, read config files.

Your run times are still longer than i would have expected- from memory my C2D with the GTX 750Tis was doing WUs in around17min with SoG.
Are you crunching any CPU WUs at the moment?
What is the CPU utilisation in Task Manager?
The way I read that ncpus setting is that it allows you to increase the number of WUs that can run on a single CPU core, not for reserving cores for other uses.

Yeah, I'm taking a little different approach to sneaking up on this, as I did before when doing Beta.
I started out Cuda50 running 3 tasks/GPU, as I have forever. Then ran 3/gpu Sog for a bit (hence the long run times). Now down to 2 tasks/gpu and have 1 AP running on the CPU I'm trying to get pushed through. The 2 GPU tasks running in parallel, 1 is with default tuning, the second is with your suggested tuning. Watching to see how that performs, then see how the box does with 2/ tuned, watch for restarts, and will later back that down to 1/ for comparison.
When I did this last fall, I think I actually came out a bit ahead at 2/. The other thing I do is watch CPU and GPU core and memory controller usage, power and temps. SoG CPU% are in the low 90s (untuned job) and high 90s (tuned job). somewhat more mouse/kb lag than I'll want to tolerate.


With low power GPUs, the only advantage of running 2 at a time is that the 15-20sec startup time where the GPU isn't crunching yet is offset by the other WU that is being processed. Overall, the GPU output is about the same as 1 at a time, except you loose the output from that second CPU core that's required. So the end result is (slightly) less WUs per hour. The big advantage of 1 at t time is that you never get a mix of WUs on the 1 GPU- ie 1 GBT and 1 Arecibo. When that happens, the Arecibo crunching time can be as much as triple it's usual run time.

Interesting question will be what it looks like with a mix of GPUs, as most of my boxes run 1-980 and 2-750tis, due to power/heat issues. Not aware of a way to tune each GPU individually ...


Grant, thinking this might be a better place for our discussion instead of the Win 10 thread :)
ID: 1873535 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : Optimised application installation thread 2.


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.