Help with Dual GTX 460s with SLI turned on

Message boards : Number crunching : Help with Dual GTX 460s with SLI turned on
Message board moderation

To post messages, you must log in.

AuthorMessage
Pete Church
Volunteer tester
Avatar

Send message
Joined: 1 Sep 08
Posts: 7
Credit: 6,827,500
RAC: 0
United States
Message 1067292 - Posted: 16 Jan 2011, 10:53:16 UTC
Last modified: 16 Jan 2011, 11:02:46 UTC

My rig (Nyx) is very stable as long as I don't turn on SLI. Once I turn on SLI, all hell seems to break loose.

Now, technically, I'm willing to run without SLI mode turned on, as I don't really need it, but it doesn't make sense that it should destabilize my system this much. So worse comes to worse, I'll just leave it off... but if you more experienced folks can help out, then all that much better.

Both CPU and GPUs are OC'd (GPUs at 840/1680/1900) but has exhibited same behavior at factory clock settings. It is water-cooled so running relatively cool at between 38-44 Celcius depending on ambient temps. So I don't believe its a heat issue either. I'm running 2 tasks/card, normally putting GPU usage at 88-90%. GPU memory usage is around 560mb.

I've dedicated 2 cpus (1 full core) to GPU tasks, so i'm only crunching CPU tasks on 10 cpus. Oh, and I'm running Lunatic's optimized apps for CPU and GPU.


Some of the symptoms I've seen once I turn SLI mode on:
- after a while of crunching, GPU usage drops down to 30% instead (EVGA precision doesn't show clock speeds changing when this happens).
- normally I can crunch GPU/CPU full steam and still use computer for email, surfing, video watching etc. But in SLI mode i have to shut down GPU crunching as the system becomes significantly more unusable with SETI on.
- just recently it started spewing errors immediately upon WU start, and once that started, it didnt stop. I had to quickly shut down SETI and disable SLI.

Example errors:
1780568665
1780554454

Some are OOM errors, others something else. Tried to catch it as fast as i could to shut it down. Disabled SLI, and was back to normal again.

Any suggestions/help would be appreciated!
ID: 1067292 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34905
Credit: 261,360,520
RAC: 489
Australia
Message 1067302 - Posted: 16 Jan 2011, 13:00:12 UTC - in response to Message 1067292.  

Try turning off Hyperthreading.

Cheers.
ID: 1067302 · Report as offensive
hbomber
Volunteer tester

Send message
Joined: 2 May 01
Posts: 437
Credit: 50,852,854
RAC: 0
Bulgaria
Message 1067310 - Posted: 16 Jan 2011, 15:00:48 UTC
Last modified: 16 Jan 2011, 15:02:25 UTC

What changes, when using SLI, is that u get work data of all running units copied in each cards memory. If u run 4 tasks(2 per cards), 330 MB each, u are out of memory(4x330). I'm not sure, but if it gets memory shortage, perhaps it starts to use system memory and thats why u get these slow downs.
There is no win-win solution. Either don't run SLI mode or just run one WU per cards(technically u can run one WU on one card and two on another, bcs of, I guess, each card has 1 GB).

I guess SLI runs fine with games etc. and problem is related only to SETI, right?
ID: 1067310 · Report as offensive
baron_iv
Volunteer tester
Avatar

Send message
Joined: 4 Nov 02
Posts: 109
Credit: 104,905,241
RAC: 0
United States
Message 1067340 - Posted: 16 Jan 2011, 16:43:59 UTC

Yes, seti has always had a bit of a problem with SLI. I have dual MSI GTX 460 HAWX in NON-SLI and I run 4 units at the same time (2 per card). Yes, I lose out on 3D performance, but if I want to play a game on that computer, all I have to do is restart in SLI mode and I'm good to go. So, for seti, run non-sli, it'll make your life a whooooole lot easier (and faster). :)

Happy Crunching!
-baron_iv
Proud member of:
GPU Users Group
ID: 1067340 · Report as offensive
Pete Church
Volunteer tester
Avatar

Send message
Joined: 1 Sep 08
Posts: 7
Credit: 6,827,500
RAC: 0
United States
Message 1067361 - Posted: 16 Jan 2011, 17:32:10 UTC

I may try dropping to 1 task/card just to confirm, but it may be that yeah, i just have to keep switching SLI on/off. Will probably just keep it off, since the GTX640 seems to handle any game quite well. without help.

Thanks for the input, will let you know if there are further developments!
ID: 1067361 · Report as offensive
-BeNt-
Avatar

Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1067448 - Posted: 16 Jan 2011, 22:09:34 UTC

From my understanding when you run SLi only one card will crunch. So when you have it setup for 4 WU's all four are being transferred to one card. And like hbomber said (4x330) is more memory then one of your cards have available. So simply go into your control panel and disable SLi when crunching and when you want to play a game enable it. Another thing to look at is HT has been known to cause issues on various machine. I know Steve was having some issue with it on, not sure if what was affecting his machine is the will affect yours as he runs a wildly different setup but it's worth checking into as well.
Traveling through space at ~67,000mph!
ID: 1067448 · Report as offensive
hbomber
Volunteer tester

Send message
Joined: 2 May 01
Posts: 437
Credit: 50,852,854
RAC: 0
Bulgaria
Message 1067451 - Posted: 16 Jan 2011, 22:39:52 UTC
Last modified: 16 Jan 2011, 22:43:42 UTC

Both cards crunch is SLI mode. They just mirror memory contents.
Other noticeable thing which happens, it is they get their order swapped as CUDA devices. At least I observed last thing with some drivers before. But it can be checked easily.
ID: 1067451 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1067456 - Posted: 16 Jan 2011, 22:51:37 UTC - in response to Message 1067448.  

From my understanding when you run SLi only one card will crunch.

I believe this was a problem earlier, but has been overcome with current drivers.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1067456 · Report as offensive
-BeNt-
Avatar

Send message
Joined: 17 Oct 99
Posts: 1234
Credit: 10,116,112
RAC: 0
United States
Message 1067466 - Posted: 16 Jan 2011, 23:12:13 UTC - in response to Message 1067456.  

From my understanding when you run SLi only one card will crunch.

I believe this was a problem earlier, but has been overcome with current drivers.


Ah gotcha, so it's merely a matter of memory now then? So can you crunch 4 WUs in SLi if you have 1.5-2GB cards?
Traveling through space at ~67,000mph!
ID: 1067466 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1067479 - Posted: 16 Jan 2011, 23:40:40 UTC - in response to Message 1067466.  

From my understanding when you run SLi only one card will crunch.

I believe this was a problem earlier, but has been overcome with current drivers.


Ah gotcha, so it's merely a matter of memory now then? So can you crunch 4 WUs in SLi if you have 1.5-2GB cards?

I believe that is true. I have left SLI turned off on my dual card rigs anyway, as I don't do any gaming.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1067479 · Report as offensive
Pete Church
Volunteer tester
Avatar

Send message
Joined: 1 Sep 08
Posts: 7
Credit: 6,827,500
RAC: 0
United States
Message 1067530 - Posted: 17 Jan 2011, 2:47:00 UTC - in response to Message 1067479.  

Well I'll just leave SLI off. I was only trying to get it fixed because I thought there might be something wrong with the setup and I was concerned.

I do game a bit, but SLI isn't really needed. As someone mentioned out there, SLI is more for bragging rights anyway! It's happily crunching 2/card with SLI off, i'm ok with that.

I will go follow up on the discussions regarding hyperthreading. I'm not having problems that I know of, but worth checking out to see if its really helping or not.
ID: 1067530 · Report as offensive

Message boards : Number crunching : Help with Dual GTX 460s with SLI turned on


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.