Stock AP 7.06 released for testing, please do test.

Message boards : AstroPulse : Stock AP 7.06 released for testing, please do test.
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53219 - Posted: 10 Dec 2014, 22:16:27 UTC

It includes last changes from Lunatics pack like better system memory handling on overlow task and additional tuning options.
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53219 · Report as offensive
HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Dec 09
Posts: 74
Credit: 1,248,766
RAC: 0
United States
Message 53220 - Posted: 11 Dec 2014, 1:58:55 UTC

I have put my troublemaker 6370m on it.
ID: 53220 · Report as offensive
Profile Jeff Buck
Volunteer tester

Send message
Joined: 11 Dec 14
Posts: 96
Credit: 1,240,941
RAC: 0
United States
Message 53224 - Posted: 11 Dec 2014, 6:09:43 UTC

Okay, guess it's time for me to try this Beta thing. I've signed up my T7400 to run APs on its 3 GPUs (GTX 660, GTX 670, GTX 780). I'll let them run pretty much plain vanilla overnight and see what I can tweak tomorrow. Anything specific I should be trying?
ID: 53224 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53225 - Posted: 11 Dec 2014, 9:39:16 UTC - in response to Message 53224.  

Cause it's test for stock app (stock mode) it's important to see how app work w/o any additional tweaking - that's "stock mode" about.
"stock mode" doesn't necessary mean best performance, additional tweaking can improve performance, but in "stock mode" app should:
1) work
2) interfere with user as low as possible (to encourage users to leave app running while they active instead of disabling GPU usage in such cases).
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53225 · Report as offensive
Profile Jeff Buck
Volunteer tester

Send message
Joined: 11 Dec 14
Posts: 96
Credit: 1,240,941
RAC: 0
United States
Message 53226 - Posted: 11 Dec 2014, 16:43:36 UTC
Last modified: 11 Dec 2014, 16:46:42 UTC

Okay, I'll resist the urge to tweak. ;^) Looks like its out of work this morning, anyway, so it doesn't matter.

It ran 284 APs overnight, but as far as I can tell, all of them were either 30/30 overflows or 100% blanked (too much RFI), which doesn't seem very helpful.

Task 18093993 got a computation error, "finish file present too long". However, it doesn't look like a BOINC crash issue, just some odd delay right at the end of the run. The Stderr for the task shows:

05:03:27 (3960): called boinc_finish(0)

but the event log doesn't show "Computation finished" for another 13 seconds. Here's the log entries from around that time:

12/11/2014 5:03:24 AM | SETI@home Beta Test | Finished upload of ap_23no14ab_B3_P0_00375_20141211_02931.wu_1_0
12/11/2014 5:03:30 AM | SETI@home Beta Test | Finished download of ap_23no14ab_B3_P1_00207_20141211_25534.wu
12/11/2014 5:03:30 AM | SETI@home Beta Test | Started download of ap_23no14ab_B3_P1_00210_20141211_25534.wu
12/11/2014 5:03:30 AM | SETI@home Beta Test | Starting task ap_23no14ab_B3_P1_00207_20141211_25534.wu_1
12/11/2014 5:03:30 AM | SETI@home Beta Test | [cpu_sched] Starting task ap_23no14ab_B3_P1_00207_20141211_25534.wu_1 using astropulse_v7 version 706 (opencl_nvidia_100) in slot 3
12/11/2014 5:03:40 AM | SETI@home Beta Test | Computation for task ap_23no14ab_B3_P1_00202_20141211_25534.wu_1 finished
12/11/2014 5:03:52 AM | SETI@home Beta Test | Started upload of ap_23no14ab_B3_P1_00202_20141211_25534.wu_1_0
12/11/2014 5:03:58 AM | SETI@home Beta Test | Finished upload of ap_23no14ab_B3_P1_00202_20141211_25534.wu_1_0


This was also a 100% blanked task.
ID: 53226 · Report as offensive
Zalster
Volunteer tester

Send message
Joined: 30 Dec 13
Posts: 258
Credit: 12,340,341
RAC: 59
United States
Message 53227 - Posted: 11 Dec 2014, 17:10:02 UTC - in response to Message 53226.  
Last modified: 11 Dec 2014, 17:10:38 UTC

Windows 7, GTX 780s

AstroPulse v7 7.06 windows_intelx86 (opencl_nvidia_100)
Number of tasks completed 0
Max tasks per day 384
Number of tasks today 170
Consecutive valid tasks 351
Average turnaround time 0.00 days


What I'm seeing is >95% CPU utilization and approximately 54-57% Kernal usage with each AP. Memory is ok 141 MB. Mixed bag of slightly blanked, shorties and some 30/30 but most seem to follow the above CPU usage.

Waiting for my other machine to start crunching so by tomorrow I should know more

Zalster
ID: 53227 · Report as offensive
Werinbert
Volunteer tester

Send message
Joined: 11 May 13
Posts: 36
Credit: 1,001,497
RAC: 0
United States
Message 53231 - Posted: 12 Dec 2014, 8:38:20 UTC

running on an old dell laptop...
i5-2410M, GT 540M (driver 337.88), OpenCL: 1.1

I am getting problems in that it keeps erroring out the video driver, causing it to stall (waiting for video reset). Occasionally crashing the computer entirely. Just looked up my task list and it is the same task disrupting my computer over and over....aborting.
ID: 53231 · Report as offensive
Werinbert
Volunteer tester

Send message
Joined: 11 May 13
Posts: 36
Credit: 1,001,497
RAC: 0
United States
Message 53232 - Posted: 12 Dec 2014, 11:03:04 UTC

Regarding my previous post. My task was an OpenCL task rather than a cuda task. I recall reading someplace that the SETI beta WUs require ocl 1.2. I am not sure if this is still true or not. If it is true then I should be sent only cuda tasks as Nividia drivers support only ocl 1.1.
ID: 53232 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53233 - Posted: 12 Dec 2014, 15:29:46 UTC - in response to Message 53232.  
Last modified: 12 Dec 2014, 15:30:25 UTC

Regarding my previous post. My task was an OpenCL task rather than a cuda task. I recall reading someplace that the SETI beta WUs require ocl 1.2. I am not sure if this is still true or not. If it is true then I should be sent only cuda tasks as Nividia drivers support only ocl 1.1.


Try to add
-unroll 2 -ffa_block 256 -ffa_block_fetch 256
command line params.

Will it crash too? Seems you have some low-end NV GPU that can't handle default data chunks before Windows resets driver for too long wait for response.

P.S. There is no such thing as OpenCL 1.2 support from nVidia... Sad but true ;)
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53233 · Report as offensive
HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Dec 09
Posts: 74
Credit: 1,248,766
RAC: 0
United States
Message 53235 - Posted: 12 Dec 2014, 19:42:34 UTC - in response to Message 53232.  

Regarding my previous post. My task was an OpenCL task rather than a cuda task. I recall reading someplace that the SETI beta WUs require ocl 1.2. I am not sure if this is still true or not. If it is true then I should be sent only cuda tasks as Nividia drivers support only ocl 1.1.

I think the only mention of OpenCL requirement is that Intel driver must be updated if they report OpenCL 1.1. I'm not sure if that was an OpenCL requirement or if it was just easier to list OpenCL version to make sure the driver was new enough.
I think I saw mention that some NV 9800's with OCL 1.0 were able to run the AP app OK before, but I might be dreaming that.
ID: 53235 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53236 - Posted: 12 Dec 2014, 22:27:34 UTC - in response to Message 53235.  

Both OpenCL SETI apps are OpenCL 1.0 specification ones.
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53236 · Report as offensive
Werinbert
Volunteer tester

Send message
Joined: 11 May 13
Posts: 36
Credit: 1,001,497
RAC: 0
United States
Message 53239 - Posted: 13 Dec 2014, 11:55:26 UTC

Added -unroll 2 -ffa_block 256 -ffa_block_fetch 256 to the ap_cmdline_7.06_windows_intelx86__opencl_nvidia_100.txt file. As luck would have it I got two cuda files instead of ocl. None the less, these two files also crapped out the video driver while processing. (I saw no cmdline equivalent file to change for cuda.) So it is not a ocl/cuda issue.

In the mean time, I am turning off the nvidia WUs in the preferences for now.
ID: 53239 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53242 - Posted: 13 Dec 2014, 13:46:24 UTC - in response to Message 53239.  

As being beta tester one could try to narrow down issue, if have time for that.
One of paths to try is to reinstall current driver, revert to older driver.
Run some stress tests on GPU itself.
Last time I had really ugly issue with NV GPU was the time power cord burned and GPU did not recive external power via additional port. It looked like OS/app/software instability... until I looked on card's physical state per se.
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53242 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53258 - Posted: 15 Dec 2014, 23:06:48 UTC
Last modified: 15 Dec 2014, 23:07:14 UTC

Got quite many CPU tasks but no GPU ones...
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53258 · Report as offensive
Winterknight
Volunteer tester

Send message
Joined: 15 Jun 05
Posts: 707
Credit: 5,565,069
RAC: 1,760
United Kingdom
Message 53261 - Posted: 16 Dec 2014, 3:38:40 UTC
Last modified: 16 Dec 2014, 3:45:57 UTC

Is there any way we can get some AP tasks that are not heavily blanked.
Since Raistmer's request for testers of V7.06, I have done >60, witrh tasks 57 validated, but no tasks have reached the "Number of tasks completed" listing. Therefore the completion time is still about 40 * reality.

AstroPulse v7 7.06 windows_intelx86 (opencl_nvidia_100)
Number of tasks completed 0
Max tasks per day 90
Number of tasks today 8
Consecutive valid tasks 57
Average turnaround time 0.00 days
ID: 53261 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53265 - Posted: 16 Dec 2014, 11:39:02 UTC - in response to Message 53261.  

Yes, the same here.
Eric is informed about issue. Don't know if it's possible to solve it (how strong data for main and beta are connected).
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53265 · Report as offensive
Zalster
Volunteer tester

Send message
Joined: 30 Dec 13
Posts: 258
Credit: 12,340,341
RAC: 59
United States
Message 53272 - Posted: 17 Dec 2014, 0:32:15 UTC - in response to Message 53265.  

I think they fixed it after the last maintenance update. Before the weekly maintenance I didn't have any. Now I'm starting to see some in the completed tasks. Raistmer, how many (number done) do you want done before we can try to modify the command code and setting to see if we can run more than 1 at time on the GPUs?


AstroPulse v7 7.06 windows_intelx86 (opencl_nvidia_100)
Number of tasks completed 12
Max tasks per day 610
Number of tasks today 83
Consecutive valid tasks 577
Average processing rate 1,644.07 GFLOPS
Average turnaround time 0.05 days

AstroPulse v7 7.06 windows_intelx86 (opencl_nvidia_100)
Number of tasks completed 16
Max tasks per day 167
Number of tasks today 77
Consecutive valid tasks 134
Average processing rate 1,601.05 GFLOPS
Average turnaround time 0.05 days


Zalster
ID: 53272 · Report as offensive
HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Dec 09
Posts: 74
Credit: 1,248,766
RAC: 0
United States
Message 53275 - Posted: 17 Dec 2014, 14:27:32 UTC
Last modified: 17 Dec 2014, 14:28:23 UTC

It looks like I might be seeing ~30-50% longer CPU time on tasks with similar high blanking vs older version. Where task Run Time is similar.
Task 18121170: AP ATi v7.06, Blanked 77.33%, Run Time: 21234 CPU Time: 2037
Task 18121171: AP ATi v7.06, Blanked 79.83%, Run Time: 19575 CPU Time: 1711
Task 17691353: AP ATi v7.04, Blanked 79.34%, Run Time: 19477 CPU Time: 1298
Task 17687932: AP ATi v7.04, Blanked 72.67%, Run Time: 19448 CPU Time: 1248
It certainly could be due to different data, but wanted to see if anyone else was seeing something similar.
ID: 53275 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53280 - Posted: 17 Dec 2014, 21:01:21 UTC - in response to Message 53275.  
Last modified: 17 Dec 2014, 21:05:22 UTC

It looks like I might be seeing ~30-50% longer CPU time on tasks with similar high blanking vs older version. Where task Run Time is similar.
Task 18121170: AP ATi v7.06, Blanked 77.33%, Run Time: 21234 CPU Time: 2037
Task 18121171: AP ATi v7.06, Blanked 79.83%, Run Time: 19575 CPU Time: 1711
Task 17691353: AP ATi v7.04, Blanked 79.34%, Run Time: 19477 CPU Time: 1298
Task 17687932: AP ATi v7.04, Blanked 72.67%, Run Time: 19448 CPU Time: 1248
It certainly could be due to different data, but wanted to see if anyone else was seeing something similar.


I'm not so certain it's about data:

Driver version: 1573.4 (VM)
Version: OpenCL 1.2 AMD-APP (1573.4)

and

Driver version: 1445.5 (VM)
Version: OpenCL 1.2 AMD-APP (1445.5)

So would check driver's performance first.
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53280 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 53281 - Posted: 17 Dec 2014, 21:04:11 UTC - in response to Message 53272.  

Raistmer, how many (number done) do you want done before we can try to modify the command code and setting to see if we can run more than 1 at time on the GPUs?

Zalster


My feeing that to have ~100 completed and validated per device that include overflows, zero-blanked, high blanked is enough for this testing.

Mostly one need to demonstrate that app works right and w/o too big annoyance to PC owner for this test. Then free to check any additional optimizations you like but please state in reports what was changed from defaults if any issue arise.
News about SETI opt app releases: https://twitter.com/Raistmer
ID: 53281 · Report as offensive
1 · 2 · 3 · 4 · Next

Message boards : AstroPulse : Stock AP 7.06 released for testing, please do test.


 
©2019 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.