Perhaps some tweaks needed to newly installed GTX650ti cards...


log in

Advanced search

Message boards : Number crunching : Perhaps some tweaks needed to newly installed GTX650ti cards...

1 · 2 · 3 · 4 . . . 5 · Next
Author Message
mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465492 - Posted: 17 Jan 2014, 18:49:12 UTC
Last modified: 17 Jan 2014, 18:49:52 UTC

Hello Everyone,

Firstly I want to thank everyone in my previous thread regarding graphics cards to purchase. Everyone was extremely helpful, as the forums always are, and if it wasn't for everyone helping out this project would not be as successful as it is today.

I have recently installed two GTX650ti cards, and they have been running for about 20-36 hours or so, off and on. In that amount of time, I have gotten 25+ inconclusive results, which seems quite high, and 5 invalid work units. Granted my new cards are doing MORE work than my old cards, but with that said, my old cards did not produce this many inconclusives/invalid results.

What I have done so far:
1) Upgraded to BOINC version 7.2.33
2) Upgraded my NVIDIA drivers to 332.21
3) Ran the lunatics installer, selecting cuda50.
4) Edited the app_info.xml to allow each GTX650ti card to run two work units at the same time.
5) Manually set the GPU fan speed to be 50%, instead of the 25% or so that was being done automatically. (likely inconsequential)

Can anyone suggest what might be going wrong with my cards' settings? Is there anything wrong? Any discussion is much appreciated!

juan BFBProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5486
Credit: 316,024,243
RAC: 147,146
Brazil
Message 1465495 - Posted: 17 Jan 2014, 18:53:23 UTC - in response to Message 1465492.
Last modified: 17 Jan 2014, 18:57:05 UTC

First Clue. What are the temps? 50% for the fans could not be enought when crunching.

Could be other cause but high temps is one of the most common cause of problems.
____________

rob smithProject donor
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8806
Credit: 62,797,729
RAC: 73,025
United Kingdom
Message 1465497 - Posted: 17 Jan 2014, 18:58:04 UTC

Check the temps
Set the fans to 100%
Check the temps

Inconclusives are not a problem unless they end up as invalids, so keep an eye on the invalid count (which at 5 is a bit high given the time you've been running with two '650s
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465502 - Posted: 17 Jan 2014, 19:04:13 UTC

I am at work right now, so I am not sure.

However, after running the cards overnight I woke up to them being at about 50C.

I'll check to see if that is still the case when I get home.

Thanks for the replies!

Profile Jeff BuckProject donor
Volunteer tester
Send message
Joined: 11 Feb 00
Posts: 397
Credit: 39,085,580
RAC: 27,107
United States
Message 1465505 - Posted: 17 Jan 2014, 19:08:29 UTC - in response to Message 1465502.

Looks like all of your Invalids so far are coming from Device 2, so it may be just one card that's having a problem. All of them were either overflows or have Spike counts that are wildly out of line with your wingmen.

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465513 - Posted: 17 Jan 2014, 19:31:23 UTC - in response to Message 1465505.

Looks like all of your Invalids so far are coming from Device 2, so it may be just one card that's having a problem. All of them were either overflows or have Spike counts that are wildly out of line with your wingmen.


Hm. That is interesting. It has of course also provided valid results as well, so I am doubtful that it is defective...but that is a great observation Jeff. I didn't realize they were from the same card.

When you guys tweak your GPU fan %, what do you put it to? Does it really just depend on what maintains a good temperature? Does everyone normally just put it to 100% and forget about it?

juan BFBProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5486
Credit: 316,024,243
RAC: 147,146
Brazil
Message 1465526 - Posted: 17 Jan 2014, 20:21:07 UTC - in response to Message 1465513.
Last modified: 17 Jan 2014, 20:23:12 UTC

When you guys tweak your GPU fan %, what do you put it to? Does it really just depend on what maintains a good temperature? Does everyone normally just put it to 100% and forget about it?

Use the fan at 100% all the time is not good for the fan life, the best thing to do is adjust the fan curve to match the target temp.

In my case for example (others sure use diferent settings) i use 70C as the max temp on the GPU, so i set the fan to run at 85% if the temp < 70C, an 100% above that. 50% at 50C, etc.
____________

Profile petri33Project donor
Volunteer tester
Send message
Joined: 6 Jun 02
Posts: 409
Credit: 73,872,955
RAC: 76,069
Finland
Message 1465528 - Posted: 17 Jan 2014, 20:25:25 UTC - in response to Message 1465513.

I keep my GPUs just under 70C (158F).




-- cut -- forget -- off topic -- for those who are just bored --

Since my computer room is in the basement half underground i do not have to do any seasonal adjustments, 90% is sufficient for both AP and MB.

The two GTX-780's that are now crunching 2x(4AP i.e 0.25 or 3MB i.e. 0.33) (( ASUS Direct Cu II) have a fixed 90% fan speed. Crunching 24/7/356,25.

After drying the laundry the warm air flows upstairs helping keep the house warm 8 months out of 12. The remaining four - I'll just have to manage with the heat.

-- bla bla ends -- this space is intentionally left blank --
____________

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465554 - Posted: 17 Jan 2014, 22:40:16 UTC

Thanks everyone for the comments.

I just got home and checked both cards. They have been running all day, and have not gone above 60C. The fan speed switched back to automatic for whatever reason, and seems to be hovering around 30%.

With this information, it doesn't sound heat related.

No more invalids have occured since I began this thread, however a few more inconclusives did.

bill
Send message
Joined: 16 Jun 99
Posts: 861
Credit: 24,274,175
RAC: 6,763
United States
Message 1465557 - Posted: 17 Jan 2014, 22:49:19 UTC - in response to Message 1465492.
Last modified: 17 Jan 2014, 22:53:11 UTC

First I'd set the gpu's to run one work unit at a time until
you figure out the problem.

Second run a program that allows you to run a graph of the heat
like GPUZ or TTHROTTLE and get an idea os what's happening over time.

Third set your fans back to automatic to see what they are doing in regards to heat. GPUZ will let you watch how the fans spin up as the heat increases.

Post what happens.

edit: You posted before I hit send. Still, leave the fans on automatic and
watch to see if you get any spikes in heat over an hour or two.

Profile Jeff BuckProject donor
Volunteer tester
Send message
Joined: 11 Feb 00
Posts: 397
Credit: 39,085,580
RAC: 27,107
United States
Message 1465560 - Posted: 17 Jan 2014, 22:59:12 UTC - in response to Message 1465554.

Thanks everyone for the comments.

I just got home and checked both cards. They have been running all day, and have not gone above 60C. The fan speed switched back to automatic for whatever reason, and seems to be hovering around 30%.

With this information, it doesn't sound heat related.

No more invalids have occured since I began this thread, however a few more inconclusives did.

It seems odd, but the handful of your inconclusives that I looked all seem to have Spike counts that are just a tad higher than your wingman's. I wonder if there's some instability in your voltage. Perhaps your old PSU is having trouble keeping up with your new GPUs. (I don't claim to be an expert in this area, but it's just a thought.)

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465564 - Posted: 17 Jan 2014, 23:13:06 UTC - in response to Message 1465560.
Last modified: 17 Jan 2014, 23:16:57 UTC



edit: You posted before I hit send. Still, leave the fans on automatic and
watch to see if you get any spikes in heat over an hour or two.


Thanks bill. I'll keep an eye on it, however it does seem quite stable over the last 24 hours or so.



It seems odd, but the handful of your inconclusives that I looked all seem to have Spike counts that are just a tad higher than your wingman's. I wonder if there's some instability in your voltage. Perhaps your old PSU is having trouble keeping up with your new GPUs. (I don't claim to be an expert in this area, but it's just a thought.)


Hm, that is an interesting thought. My power supply is 750W, and I was under the impression that this was sufficient for two of these cards. Granted, it is an old power supply.

I don't know much about voltage, but the program I run to monitor heat also has a min/max statistic about voltage.

One card has had a max of 1100, and a min of 1087. A difference of only 13. However, the second card has had a maximum of 1100, and a minimum of 1050. A difference of 50. Not sure if this matters, but it did catch my eye.

Edit: I'll clarify a bit. The voltages aren't jumping around, and are currently stable and constant. This is a min/max over the past 10 hours.

jravin
Send message
Joined: 25 Mar 02
Posts: 991
Credit: 106,121,034
RAC: 82,353
United States
Message 1465566 - Posted: 17 Jan 2014, 23:19:59 UTC

750 watts should be OK, if the PSU is not so old that it has lost some of its power (a known symptom of PSU aging).

I have two machines running 2 GTX 6xx cards each (all more powerful than yours), and they draw about 500 watts each. (Roughly speaking, 150 for each GPU, 100 for the CPU and about 100 for the MB, HD and fans).
____________

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465567 - Posted: 17 Jan 2014, 23:29:38 UTC - in response to Message 1465566.

750 watts should be OK, if the PSU is not so old that it has lost some of its power (a known symptom of PSU aging).

I have two machines running 2 GTX 6xx cards each (all more powerful than yours), and they draw about 500 watts each. (Roughly speaking, 150 for each GPU, 100 for the CPU and about 100 for the MB, HD and fans).


I made a point to unplug all of the unnecessary things inside the case that aren't needed such as additional HD's and the CDROM. I hope that that means I am running a bit under the 750W max.

Before I installed these 650ti's, I had these installed:
NVIDIA GeForce 8800 GTS 512 (512MB)
AMD Radeon HD 7700 series (Cape Verde) (1024MB).

I'm not sure of the wattage on those cards, but they both ran issue free for about 6 months until I took them out this week.

juan BFBProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5486
Credit: 316,024,243
RAC: 147,146
Brazil
Message 1465568 - Posted: 17 Jan 2014, 23:36:24 UTC

The 750W good PSU is far enought to drive 2x650TI, i use one to drive 2x670 with no problem for years.

A long shoot is to split the PSU conectors on the 2 GPU´s, if the problem changes that indicates the PSU not have a single rail 12V, some old PSU don´t use single 12V rail, if that your case, it could cause the problem you notice and that point to change the PSU. But be aware it´s a very very long shoot most of the newer PSU´s uses a single 12V rail.
____________

Profile Jeff BuckProject donor
Volunteer tester
Send message
Joined: 11 Feb 00
Posts: 397
Credit: 39,085,580
RAC: 27,107
United States
Message 1465569 - Posted: 17 Jan 2014, 23:38:44 UTC - in response to Message 1465567.

750 watts should be OK, if the PSU is not so old that it has lost some of its power (a known symptom of PSU aging).

I have two machines running 2 GTX 6xx cards each (all more powerful than yours), and they draw about 500 watts each. (Roughly speaking, 150 for each GPU, 100 for the CPU and about 100 for the MB, HD and fans).


I made a point to unplug all of the unnecessary things inside the case that aren't needed such as additional HD's and the CDROM. I hope that that means I am running a bit under the 750W max.

Before I installed these 650ti's, I had these installed:
NVIDIA GeForce 8800 GTS 512 (512MB)
AMD Radeon HD 7700 series (Cape Verde) (1024MB).

I'm not sure of the wattage on those cards, but they both ran issue free for about 6 months until I took them out this week.

Yeah, I would think 750w would be plenty. My most power-hungry machine, with a GTX670 and 2 GTX660s doesn't draw more than 590w on a 1000w PSU. Anyway, as I said, I'm not an expert but thought those odd and only occasional extra counts (as opposed to runaway overflows) seemed like there might be some kind of slight instability somewhere.

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465579 - Posted: 18 Jan 2014, 0:11:22 UTC - in response to Message 1465568.

The 750W good PSU is far enought to drive 2x650TI, i use one to drive 2x670 with no problem for years.

A long shoot is to split the PSU conectors on the 2 GPU´s, if the problem changes that indicates the PSU not have a single rail 12V, some old PSU don´t use single 12V rail, if that your case, it could cause the problem you notice and that point to change the PSU. But be aware it´s a very very long shoot most of the newer PSU´s uses a single 12V rail.


I believe that I have a separate rail going into each GPU. Are you suggesting that separate rails could be the issue?



Yeah, I would think 750w would be plenty. My most power-hungry machine, with a GTX670 and 2 GTX660s doesn't draw more than 590w on a 1000w PSU. Anyway, as I said, I'm not an expert but thought those odd and only occasional extra counts (as opposed to runaway overflows) seemed like there might be some kind of slight instability somewhere.


I appreciate the input nonetheless.

juan BFBProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5486
Credit: 316,024,243
RAC: 147,146
Brazil
Message 1465583 - Posted: 18 Jan 2014, 0:22:18 UTC - in response to Message 1465579.
Last modified: 18 Jan 2014, 0:37:55 UTC

As i said, this is a very very long shoot. Why this could happening? If you have separe rails (not usual), while one rail feed only one GPU, the other rail could feed the GPU + the entire MB and probabily the HDD, etc. So it could reach it maximum due de power spikes needed by the GPU to work in some random moments. Then the GPU feeded by this rail could start to produce some random wierd results like the ones you are talking. Switch the cables will easely check the theory if the problem disapears or changes from one GPU to the other. Remember at this time we are trying to catch some "ghosts on the machine"

<edit> I just remember something, did your GPU has a separate power conector? (i don´t remember if the 650Ti has or not) if no and it uses the power direct from the PCI-e slot forget my ideia. If that is your case, switch the GPU´s itself, that could show you if you could have some trouble with the PCI-e Slot itself (another long shoot)
____________

mherr170
Avatar
Send message
Joined: 15 Nov 12
Posts: 282
Credit: 7,052,074
RAC: 7,153
United States
Message 1465588 - Posted: 18 Jan 2014, 0:42:26 UTC - in response to Message 1465583.

As i said, this is a very very long shoot. Why this could happening? If you have separe rails (not usual), while one rail feed only one GPU, the other rail could feed the GPU + the entire MB and probabily the HDD, etc. So it could reach it maximum due de power spikes needed by the GPU to work in some random moments. Then the GPU feeded by this rail could start to produce some random wierd results like the ones you are talking. Switch the cables will easely check the theory if the problem disapears or changes from one GPU to the other. Remember at this time we are trying to catch some "ghosts on the machine"

<edit> I just remember something, did your GPU has a separate power conector? (i don´t remember if the 650Ti has or not) if no and it uses the power direct from the PCI-e slot forget my ideia. If that is your case, switch the GPU´s itself, that could show you if you could have some trouble with the PCI-e Slot itself (another long shoot)


The 650ti does indeed have a separate power connector, so I believe I will try your idea of switching the power rails momentarily!

juan BFBProject donor
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5486
Credit: 316,024,243
RAC: 147,146
Brazil
Message 1465590 - Posted: 18 Jan 2014, 1:02:18 UTC - in response to Message 1465588.

Switch and leave running for some time and see if something changes.
____________

1 · 2 · 3 · 4 . . . 5 · Next

Message boards : Number crunching : Perhaps some tweaks needed to newly installed GTX650ti cards...

Copyright © 2014 University of California