Inconclusive Work Units Running AP Ver 6

Message boards : Number crunching : Inconclusive Work Units Running AP Ver 6
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 10 · Next

AuthorMessage
LadyL
Volunteer tester
Avatar

Send message
Joined: 14 Sep 11
Posts: 1679
Credit: 5,230,097
RAC: 0
Message 1220365 - Posted: 19 Apr 2012, 17:31:12 UTC - in response to Message 1220358.  

Keep in mind most of 560ti are factory overclocked.
Remember my thread at lunatics about this behaviour.

Of the seven hosts I'm tracking so far for inconclusives, only one is running a 560Ti

I've just downloaded 49 inconclusive datafiles from X-Files' GTX 580 with unroll=8 - what do you suggest is wrong with that one?


the inconclusives I checked are all 30 rep pulses.
looks like with unroll 8 on that card it sometimes works and sometimes doesn't.

@ X-Files try and decrease unroll


12 out of my last 20 APs i crunched with GPU had 30 rep pulses.
All validated in first attempt.


yes but those are inconclusive.
I'm not the Pope. I don't speak Ex Cathedra!
ID: 1220365 · Report as offensive
Profile cliff
Avatar

Send message
Joined: 16 Dec 07
Posts: 625
Credit: 3,590,440
RAC: 0
United Kingdom
Message 1220368 - Posted: 19 Apr 2012, 17:37:40 UTC - in response to Message 1220362.  
Last modified: 19 Apr 2012, 18:29:32 UTC

Add to that how many are crunching more than 1 WU at a time..

I can only crunch 1 per GPU, my psu is'nt up to handling both GPU's if I try to run more than 1 per..

This could be either hardware or software related or even a bit of both, given that nvidia drivers have had a tendancy to push such app's onto the CPU as well as the GPU.

I watched some AP6 tasks running with a graph depicting GPU usage.. under 285.62 nv drivers the percentage continually varied between 6% and 43% with some peaks of 66% and very occaisionally 81%.. The lower the percentage overall it 'seemed' related to the degree of blanking reported.
Unfortunately NV 301.24 stopped my monitoring software working, so I can no longer watch usage as before.. But then I no longer have any AP6 WU's to process, none are available..

[edit]

seems I was wrong about AP6 I do indeed have 1 such task waiting in the queue.

Regards,
Cliff,
Been there, Done that, Still no damm T shirt!
ID: 1220368 · Report as offensive
musicplayer

Send message
Joined: 17 May 10
Posts: 2430
Credit: 926,046
RAC: 0
Message 1220384 - Posted: 19 Apr 2012, 18:51:30 UTC

Oh, better trust the results and the numbers being returned more than the user(s) behind.
ID: 1220384 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1220393 - Posted: 19 Apr 2012, 20:09:17 UTC

Okay, I guess I'd better give my information. My little GTS450 is running a little overclocked at 885/1804 and is between 62 and 63*C. I'm also running 51/49 and my command line looks like this...
<cmdline>-instances_per_device 1 -unroll 10 -ffa_block 8192 -ffa_block_fetch 4096</cmdline>. Anything else you need to know?


PROUD MEMBER OF Team Starfire World BOINC
ID: 1220393 · Report as offensive
Profile X-Files 27
Avatar

Send message
Joined: 17 May 99
Posts: 104
Credit: 111,191,433
RAC: 0
Canada
Message 1220395 - Posted: 19 Apr 2012, 20:22:51 UTC - in response to Message 1220352.  

Keep in mind most of 560ti are factory overclocked.
Remember my thread at lunatics about this behaviour.

Of the seven hosts I'm tracking so far for inconclusives, only one is running a 560Ti

I've just downloaded 49 inconclusive datafiles from X-Files' GTX 580 with unroll=8 - what do you suggest is wrong with that one?


the inconclusives I checked are all 30 rep pulses.
looks like with unroll 8 on that card it sometimes works and sometimes doesn't.

@ X-Files try and decrease unroll

I will adjust the params once I get home. unroll will be 6.

Other notes:
0.51 for AP and 0.49 for MB
GPUs are OC'ed thru the bios
XFX PRO1250W Black Edition = kill-a-watt says 932W usage
ID: 1220395 · Report as offensive
Profile Jim_S
Avatar

Send message
Joined: 23 Feb 00
Posts: 4705
Credit: 64,560,357
RAC: 31
United States
Message 1220432 - Posted: 19 Apr 2012, 23:29:43 UTC

Where do I find stderr_txt?

I Desire Peace and Justice, Jim Scott (Mod-Ret.)
ID: 1220432 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1220436 - Posted: 19 Apr 2012, 23:36:31 UTC - in response to Message 1220432.  

Your accounts page /tasks/ task. Take one of the tasks you have completed and open the section marked task,click for details, on the left hand side.


PROUD MEMBER OF Team Starfire World BOINC
ID: 1220436 · Report as offensive
Profile Jim_S
Avatar

Send message
Joined: 23 Feb 00
Posts: 4705
Credit: 64,560,357
RAC: 31
United States
Message 1220456 - Posted: 20 Apr 2012, 1:29:34 UTC - in response to Message 1220436.  

Your accounts page /tasks/ task. Take one of the tasks you have completed and open the section marked task,click for details, on the left hand side.

Thanks much My Friend.

I Desire Peace and Justice, Jim Scott (Mod-Ret.)
ID: 1220456 · Report as offensive
Profile cliff
Avatar

Send message
Joined: 16 Dec 07
Posts: 625
Credit: 3,590,440
RAC: 0
United Kingdom
Message 1220589 - Posted: 20 Apr 2012, 11:54:32 UTC
Last modified: 20 Apr 2012, 12:12:56 UTC

I've just noticed something slightly strange.
I'm monitoring both my GPU's with msi afterburner and an AP6 GPU task has just been loaded and is running.

Immediatley it loaded, both my GPU's started to display the same behaviour, ie graphs of usage started to oscillate wildly.

This was not seen on the other GPU prior to the AP6 task being loaded.

That graph was a near perfect line with only the occaisional dip at odd intervals.

That GPU is running an e@h gpu task.

So it seems that simply loading and running an AP6 GPU task affects both GPU's even if they are not running the same type of task.

I hadnt noticed this before because I'd been running the same type of task on both GPU's ie AP6 ones.

Anyone have any ideas whay this is happening?
[edit]
It seems that both GPU's are in some way synchronised, as the graphs rise and lower together, differing only in amplitude.Could this be a driver related process?


Regards,
Cliff,
Been there, Done that, Still no damm T shirt!
ID: 1220589 · Report as offensive
Horacio

Send message
Joined: 14 Jan 00
Posts: 536
Credit: 75,967,266
RAC: 0
Argentina
Message 1220599 - Posted: 20 Apr 2012, 12:47:58 UTC

Extra info that may be worth about my inconclusive GPU WUs (560TIs):

These 3 WUs were crunched on the suspected failling GPU:
ap_08jn11aa_B5_P1_00343_20120412_19722.wu (30 pulses w/o repetitives) Still Inconclusive
ap_25ja12ad_B3_P1_00044_20120411_05125.wu (30 pulses w/o repetitives) Invalid (against 2 stock V6 6.01)
ap_26no11ae_B2_P0_00210_20120315_31464.wu (30 pulses w/o repetitives) Invalid (against 2 stock V6 6.01)

This WU was crunched on the good GPU (only 1 invalid over 2K WUs crunched):
ap_11my11ab_B2_P0_00278_20120409_08996.wu (30 pulses with 30 repetitives) Still Inconclusive

The command line parameters used was for sure:
-instances_per_device 2 -unroll 8 -ffa_block 8192 -ffa_block_fetch 4096
(Ive recently added also -no_cpu_lock and -hp, but Im not sure if these settings were applied to those WUs.)

Right now, the host with the 560Tis is not crunching SETI anymore (as there is no BOINC version doing the schedulling/workfecth in the way I want, Ive assigned only one project per host, which seems it is helping a lot to increase the SETI RAC)
ID: 1220599 · Report as offensive
LadyL
Volunteer tester
Avatar

Send message
Joined: 14 Sep 11
Posts: 1679
Credit: 5,230,097
RAC: 0
Message 1220618 - Posted: 20 Apr 2012, 14:15:51 UTC
Last modified: 20 Apr 2012, 14:20:37 UTC

I've got something that probably explains why some cards cope with high unroll and some don't, but I can't type it up easy right now.

For the time being, if you see invalids from units with 30 (rep) pulses it's most likely GPU memory corruption due to too high unroll. Dropping unroll all the way to 2 should cure it, or you can try if intermediate values work.

Cards that will probably not take high unroll are GTX 470, 480, 570 and 580.
Cards that should work with high unroll are GTX 460, 560, 560 Ti and 680.
I'm not the Pope. I don't speak Ex Cathedra!
ID: 1220618 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1220646 - Posted: 20 Apr 2012, 15:33:29 UTC
Last modified: 20 Apr 2012, 16:12:05 UTC

I'm posting this one http://setiathome.berkeley.edu/workunit.php?wuid=969007370 not because it's an Inconclusive but because of the high numbers 14/30 counts. When I was running Raistmers app for 5.05s a count like that would almost assuredly error out. This one and another like it earlier have validated.



Okay Lady L. now you're confusing me. I'm getting some with high rep. counts but they are validating. Should I cut back on my unroll or not? So far, none of mine have errored out.


PROUD MEMBER OF Team Starfire World BOINC
ID: 1220646 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1220649 - Posted: 20 Apr 2012, 15:39:24 UTC - in response to Message 1220646.  

I'm posting this one http://setiathome.berkeley.edu/workunit.php?wuid=969007370 not because it's an Inconclusive but because of the high numbers 14/30 counts. When I was running Raistmers app for 5.05s a count like that would almost assuredly error out. This one and another like it earlier have validated.

At least that one validated against the stock app, so we can be reasonably sure that the high counts are genuine - although the lack of signal reporting in the stock app's stderr_txt always leaves a nagging doubt in one's mind.

The real dangers start when an app with a tendency to false detections becomes widespread enough to start validating against itself, as we saw during the V12/Fermi saga.
ID: 1220649 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34258
Credit: 79,922,639
RAC: 80
Germany
Message 1220650 - Posted: 20 Apr 2012, 15:39:44 UTC - in response to Message 1220646.  

I'm posting this one http://setiathome.berkeley.edu/workunit.php?wuid=969007370 not because it's an Inconclusive but because of the high numbers 14/30 counts. When I was running Raistmers app for 5.05s a count like that would almost assuredly error out. This one and another like it earlier have validated.


Number of signal alone tells nothing at all.
I had dozens which validate in first attempt.

Its only a indiction if the wingmen gets different amount of signals.



With each crime and every kindness we birth our future.
ID: 1220650 · Report as offensive
LadyL
Volunteer tester
Avatar

Send message
Joined: 14 Sep 11
Posts: 1679
Credit: 5,230,097
RAC: 0
Message 1220660 - Posted: 20 Apr 2012, 16:21:03 UTC - in response to Message 1220646.  

Okay Lady L. now you're confusing me. I'm getting some with high rep. counts but they are validating. Should I cut back on my unroll or not? So far, none of mine have errored out.


if they are validating it's ok. if you get early exits (30/30) and they _don't_ validate, then something is off.
same story as with excessive -9 on MB, really.

Unless you're getting high numbers of inconclusives/invalids with those 30 signals, you're in the clear.
I'm not the Pope. I don't speak Ex Cathedra!
ID: 1220660 · Report as offensive
Profile X-Files 27
Avatar

Send message
Joined: 17 May 99
Posts: 104
Credit: 111,191,433
RAC: 0
Canada
Message 1220686 - Posted: 20 Apr 2012, 17:25:06 UTC

So far so good after lowering it down to 6 from 8. 4 valids and 0 inconclusive so far.

ID: 1220686 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1220826 - Posted: 20 Apr 2012, 23:45:34 UTC - in response to Message 1220686.  

I've just got my second but this time on my 2500K, http://setiathome.berkeley.edu/workunit.php?wuid=972977092.

Cheers.
ID: 1220826 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34258
Credit: 79,922,639
RAC: 80
Germany
Message 1220832 - Posted: 20 Apr 2012, 23:56:56 UTC - in response to Message 1220826.  

I've just got my second but this time on my 2500K, http://setiathome.berkeley.edu/workunit.php?wuid=972977092.

Cheers.


Both you and your wingman found 30/30 pulses so it will probably get validated.



With each crime and every kindness we birth our future.
ID: 1220832 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1221260 - Posted: 21 Apr 2012, 16:16:25 UTC - in response to Message 1220216.  

Richard Haselgrove wrote:
tbret wrote:
I didn't like that list over there. Here it is where it ought to be, I guess:

One inconclusive:

2387615947 - 966484070 - 5829212

Yes, better here - though we're really trying to concentrate on the (few) inconclusives, which otherwise get rather lost in the greater number of valid results.

Anyway, ap_02ja12aa_B5_P1_00071_20120406_22092.wu has been added to the menagerie - that's r555 on your CPU, there. Thanks.

That one should give credit when another result is received. The AP Validator has a critical level for single pulses, it only checks those with peak power at least 1% above threshold. In that WU there's a single pulse which the optimized app calculates as being 0.996% above threshold, but stock gets 1.002% above threshold. The 0.006% difference is a lot tighter than the 0.1% allowed tolerance, but the Validator ignores the one from optimized. Those cases are fairly rare, and would require revising the Validator code to eliminate.
                                                                  Joe
ID: 1221260 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1221366 - Posted: 21 Apr 2012, 20:37:21 UTC - in response to Message 1221260.  

ID: 1221366 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 10 · Next

Message boards : Number crunching : Inconclusive Work Units Running AP Ver 6


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.