I was having a problem w/gpu downclocks while doing S@H wu's[solved]

Message boards : Number crunching : I was having a problem w/gpu downclocks while doing S@H wu's[solved]
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6651
Credit: 121,090,076
RAC: 0
United States
Message 1361779 - Posted: 27 Apr 2013, 10:48:51 UTC

Have you tried increasing the voltage? I have the voltage on my cards maxed out at 1.138 VDC. Some cards may need more voltage to just do stock speeds, at the intensity we drive them. I believe the 590's are intentionally undervolted, because the 580's didn't like higher voltage, but I could be wrong about that. I haven't checked for quite a while.

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1361779 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1361789 - Posted: 27 Apr 2013, 11:35:57 UTC - in response to Message 1361779.  

Have you tried increasing the voltage? I have the voltage on my cards maxed out at 1.138 VDC. Some cards may need more voltage to just do stock speeds, at the intensity we drive them. I believe the 590's are intentionally undervolted, because the 580's didn't like higher voltage, but I could be wrong about that. I haven't checked for quite a while.

Steve

Since this is a 580 here, yeah I've tried up to 1.075v, currently the card is at 1.025v, right now I'm back to the Zotac 772MHz 580 bios, permanently as I went to bed earlier and at nearly midnight the gpu stopped doing work, then I looked in boinc tasks 1.46 and the gpu suddenly started working back at 772MHz, weird, but not a downclock at least. I'm also back to the 310.70 drivers, this time the international version, just to be complete. I just raised the voltage back to 1.05v and the gpu temp is 65-68C so far, after that the card seems to have settled on 66C for the moment.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1361789 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1361805 - Posted: 27 Apr 2013, 13:04:03 UTC - in response to Message 1361789.  

Have you tried increasing the voltage? I have the voltage on my cards maxed out at 1.138 VDC. Some cards may need more voltage to just do stock speeds, at the intensity we drive them. I believe the 590's are intentionally undervolted, because the 580's didn't like higher voltage, but I could be wrong about that. I haven't checked for quite a while.

Steve

Since this is a 580 here, yeah I've tried up to 1.075v, currently the card is at 1.025v, right now I'm back to the Zotac 772MHz 580 bios, permanently as I went to bed earlier and at nearly midnight the gpu stopped doing work, then I looked in boinc tasks 1.46 and the gpu suddenly started working back at 772MHz, weird, but not a downclock at least. I'm also back to the 310.70 drivers, this time the international version, just to be complete. I just raised the voltage back to 1.05v and the gpu temp is 65-68C so far, after that the card seems to have settled on 66C for the moment.

I found why the gpu stopped doing work, the hdd was turned off after 20 mins by a windows 7 power setting, fixed that and examined all the rest for any others, none were out of place, so the Asus 580 Matrix bios was not at fault so I reflashed it, since it seems a bit more stable, so far.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1361805 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1361864 - Posted: 27 Apr 2013, 17:00:01 UTC - in response to Message 1361805.  


I found why the gpu stopped doing work, the hdd was turned off after 20 mins by a windows 7 power setting, fixed that and examined all the rest for any others, none were out of place, so the Asus 580 Matrix bios was not at fault so I reflashed it, since it seems a bit more stable, so far.

Hope that's your answer...a sleepy hard drive could really muck things up, for sure. However, you said it did run for 12 hours at one point, so I don't know why the HD would have been put to sleep, unless Boinc might not have required HD access for over the 20 minute timeout. I would think checkpointing would require access more often than that.
But, good luck with it nonetheless.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1361864 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1361872 - Posted: 27 Apr 2013, 17:11:40 UTC - in response to Message 1361864.  


I found why the gpu stopped doing work, the hdd was turned off after 20 mins by a windows 7 power setting, fixed that and examined all the rest for any others, none were out of place, so the Asus 580 Matrix bios was not at fault so I reflashed it, since it seems a bit more stable, so far.

Hope that's your answer...a sleepy hard drive could really muck things up, for sure. However, you said it did run for 12 hours at one point, so I don't know why the HD would have been put to sleep, unless Boinc might not have required HD access for over the 20 minute timeout. I would think checkpointing would require access more often than that.
But, good luck with it nonetheless.

The 12 hours was when I was awake, so I was as usual at the PC.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1361872 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362265 - Posted: 28 Apr 2013, 19:10:29 UTC
Last modified: 28 Apr 2013, 19:17:57 UTC

Ok I'm back to using the Zotac 580 vanilla bios on this card, permanently this time, as the asus and evga 580 bioses have been deleted, this morning I noticed pink and green stripes on My screen, even when rebooting, also as of 6:55am(13:55 here) I've been crunching with an Nvidia driver of 306.02 x64(a beta driver) and the zotac 580 vanilla bios on the card and for just over 2 hours I left the pc alone as if I'd went to bed, everything kept on crunching, of course the monitor was on so that I could see what BoincTasks 1.46 was up to without using the mouse of keyboard even once, without missing a beat, I think I found a combo that works, I'll know more tomorrow on the two, bios and driver that is, so far, so good.

The gpu temp @ 772MHz is 63-64C and yes I have the swamp cooler with the hard water circulating, it's 73F(25C) in here and the humidity is about 73% and it's 90F(32C) and 15% Humidity outside, I live in a desert where the predicted high temp is 97F(36C)... I love summer, it keeps My OA at bay. :)
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362265 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362569 - Posted: 29 Apr 2013, 16:27:07 UTC

I did discover one potential cure for the downclocks, Nibitor, basically rewriting some of the readable info in the bios, which I did successfully and suitably altered, this is just clock speeds and some info that identifies the rom file, of course I had to use an EVGA bios instead of a Zotac, since 6.06 will load the zotac bios and say unknown and if saved give off an i/o error when one tries to flash the file, I saw no i/o error with the modified evga bios which now thinks it's a zotac bios, so 405 should be history now, but this is only a prototype, unless this evga 580 bios works as well as the vanilla zotac 580 bios, as I think I still need to alter a zotac 580 bios to be perfect and yes I emailed the author of Nibitor about that, I'll find out if He writes back.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362569 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362652 - Posted: 29 Apr 2013, 19:08:16 UTC

The testing phase is now over, passed with flying colors, there were no downclocks or gpu going to sleep, just like it had at night. Oh and I didn't alter what I didn't know about, those values I left alone, others that aren't displayed I can't touch and don't seem to matter. I just need to reset the PC to see how the boot will go. Oh and if a downclock from 815MHz happened, it would be to 772MHz, which is acceptable and is a lot better than 405MHz...
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362652 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362709 - Posted: 29 Apr 2013, 21:36:59 UTC - in response to Message 1362652.  

The testing phase is now over, passed with flying colors, there were no downclocks or gpu going to sleep, just like it had at night. Oh and I didn't alter what I didn't know about, those values I left alone, others that aren't displayed I can't touch and don't seem to matter. I just need to reset the PC to see how the boot will go. Oh and if a downclock from 815MHz happened, it would be to 772MHz, which is acceptable and is a lot better than 405MHz...

Well this idea was not going to work, I rebooted and the firmware would get up to the Windows 7 screen and then go into power saving mode, so I had to move card down to the next pcie slot and temporarily install an Nvidia 7900 GTX card in the main slot, since I found out that firmware can't be flashed in safe mode, and after flashing the card and installing the 306.02 drivers(before installing 306.02, the 7900 had 306.97 and the 580 had 311.06, weird, but understandable as the 7900 is now a legacy card as the last driver for it was/is in the 307.xx range, but 307.xx in this case will not work with the 580), so now the 580 is fixed and I even had the time to install 3 fans and remove 2 others, plus install a SuperG pci wireless card, the gpu now has a 120x38mm 130cfm fan on the 580 radiator and flanking that fan are two 120x25mm 113cfm fans. Oh well I tried...
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362709 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362715 - Posted: 29 Apr 2013, 22:37:35 UTC

Almost had a problem, seems the Delta 120x38mm 130cfm fan wasn't getting any power and the temp while doing Seti shot up to 85C, I promptly shut down Seti and opened the case and rerouted the fan to a psu connection, but before I could do anything, I had to take a break elsewhere in the house. Now at idle I see 30C, at load so far It's 64-70C on the water temp. I'm hoping I don't have to open it up again as it's 98F outside. I might have to go back to a 113cfm fan, as the driver just went to 405MHz.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362715 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362716 - Posted: 29 Apr 2013, 22:52:47 UTC
Last modified: 29 Apr 2013, 23:06:49 UTC

So far the fan is holding at 70-71C while crunching, I'm a bit nervous and tired too. I may have buy 3 Delta 120x38mm 150cfm fans, ugh, 4000rpm... I sure won't put the 252cfm fan on there, it's much louder, but wow, does that 120x38mm fan ever flow air...

Update: The new Delta 120x38mm 130cfm fan is cooling the water to 68-69C and holding, still 150cfm is an option that I hope don't need to go to, I may try and do a push pull on an Omni upgrade kit, cause the pump can be unscrewed from the radiator, problem is does the tubing have enough slack to allow a 25mm thick fan? I don't know, I'll have to see, but not today, I'm beat.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362716 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362746 - Posted: 30 Apr 2013, 3:24:16 UTC

Well on Tuesday I get to swap the 130cfm fan(3200rpm) out for the faster 113cfm fan(3400rpm), as this fan is just not up to the job. I'm getting 74C, sure I can get 69C when the swamp cooler is on, but My OA in My shoulders doesn't like 70F temps, so I'm draining my cache to get rid of the gpu wu's. If I only had the air cooled fan section for a reference model GTX 580 card... One from a PNY, Gigabyte, MSI N580GTX TWIN FROZR II/OC or a EVGA GeForce GTX 580 DoubleShot Superclocked cards top...

Getting any water blocks will be a few months off of course and yes I know which type/brand to get and where they are, but until I get all of them I'm keeping quiet on that. Then I still need a Phobya 360x360 radiator, a Phobya radiator stand, 9 100cfm+ 120mm fans, some koolance quick disconnects, black tubing, at least I have a pump and reservoir...

Cause with the way the 580 is setup I can't crunch for long.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362746 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1362751 - Posted: 30 Apr 2013, 4:15:49 UTC - in response to Message 1362746.  

Vic, I think that you might want to change the radiator for a 240mm unit for you to get those temps down to a level where you are not constantly watching them and it should be quieter into the bargain. ;-)

Cheers.
ID: 1362751 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362757 - Posted: 30 Apr 2013, 4:33:35 UTC - in response to Message 1362751.  

Vic, I think that you might want to change the radiator for a 240mm unit for you to get those temps down to a level where you are not constantly watching them and it should be quieter into the bargain. ;-)

Cheers.

Wiggo, the current radiator has no way of being made to do that, it's a closed loop water cooler, one that could have been double thick and allowed for push/pull fan operation, but it doesn't. I do have a Coolgate 360 dual pass Radiator and except for the other parts that I have would be a problem, plus I've never built a custom water cooled system before, oh I know about what to do, I just lack all the extra parts required, like a gtx580 gpu block, black tubing, clamps, etc.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362757 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1362766 - Posted: 30 Apr 2013, 5:27:10 UTC - in response to Message 1362757.  

Vic, I think that you might want to change the radiator for a 240mm unit for you to get those temps down to a level where you are not constantly watching them and it should be quieter into the bargain. ;-)

Cheers.

Wiggo, the current radiator has no way of being made to do that, it's a closed loop water cooler, one that could have been double thick and allowed for push/pull fan operation, but it doesn't. I do have a Coolgate 360 dual pass Radiator and except for the other parts that I have would be a problem, plus I've never built a custom water cooled system before, oh I know about what to do, I just lack all the extra parts required, like a gtx580 gpu block, black tubing, clamps, etc.

Nothing is completely that closed when 1 has a goal. ;-)

From the pic's you've posted it looks that the piping can be de-barbed off the card itself or any place else from there to the radiator and you'll be surprised what you can find at a plumbing supply or aquarium store.

But I shouldn't think that it require that much effort or cost (other than the larger radiator.

I keep thinking about doing a whole extra heavy duty heat exchanger system here but then I reckon that if I can't get away with just air the cost isn't worth it. I may change my mind on this but ATM it just isn't cost effective here for me.

Cheers.
ID: 1362766 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362787 - Posted: 30 Apr 2013, 6:14:42 UTC - in response to Message 1362766.  

Vic, I think that you might want to change the radiator for a 240mm unit for you to get those temps down to a level where you are not constantly watching them and it should be quieter into the bargain. ;-)

Cheers.

Wiggo, the current radiator has no way of being made to do that, it's a closed loop water cooler, one that could have been double thick and allowed for push/pull fan operation, but it doesn't. I do have a Coolgate 360 dual pass Radiator and except for the other parts that I have would be a problem, plus I've never built a custom water cooled system before, oh I know about what to do, I just lack all the extra parts required, like a gtx580 gpu block, black tubing, clamps, etc.

Nothing is completely that closed when 1 has a goal. ;-)

From the pic's you've posted it looks that the piping can be de-barbed off the card itself or any place else from there to the radiator and you'll be surprised what you can find at a plumbing supply or aquarium store.

But I shouldn't think that it require that much effort or cost (other than the larger radiator.

I keep thinking about doing a whole extra heavy duty heat exchanger system here but then I reckon that if I can't get away with just air the cost isn't worth it. I may change my mind on this but ATM it just isn't cost effective here for me.

Cheers.

A goal is one thing, but only if one has the skills and I do not, I'd just be banging against it since I have no idea how to mod the thing, I can build a replacement cooling system using standard parts, but it'll take time of which I have plenty.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362787 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1362793 - Posted: 30 Apr 2013, 6:23:58 UTC - in response to Message 1362787.  

Just don't forget the earplugs.

Cheers.
ID: 1362793 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362810 - Posted: 30 Apr 2013, 6:56:57 UTC - in response to Message 1362793.  

Just don't forget the earplugs.

Cheers.

If I used faster fans, yeah I'd need them, 3400 rpm is about as much as I can tolerate, 4000+ forget about it, I have a 252cfm 120mm*38mm fan, puts out lots of air, but it's way too noisy, I'll never use that fan, bought it to see how noisy it was, 113cfm is fast enough. In any case I'm going to bed as I'm very tired.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362810 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362911 - Posted: 30 Apr 2013, 18:45:41 UTC

Ok I'm back online, now that I have 3 Delta 120x25mm 113cfm fans in the top of the case with 1 attached to the Zotac IE GTX580 radiator, at idle the temp is 28C without the dust filter and 29C with the filter in place, of course since I have no Seti@Home wu's yet for the gpu since S@H is down for the usual maintenance(I'll fix that soon), I'll will have to wait for the load temps and this is with the swamp cooler on too. Oh and I found out that push/pull will not work, not unless someone has a 2-4mm thick high speed 120mm fan(I've heard of 120x120x12mm fans, but that's it), as I pried the pump away from the radiator to clean some dust out and the hoses don't have hardly any slack there. Before closing up the case the PC had a little accident, it fell off the small wood tray table, nothing was broken or out of place of course. And holy cow! No wonder I needed the swamp cooler on, the temp outside is already 85F at 11:34am...

The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362911 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1362918 - Posted: 30 Apr 2013, 19:12:15 UTC

On closer inspection I found a problem with the case after it had experienced a fall, but it's only at the top on one side, the plastic top was tight to the metal case before, now the plastic top is out of place, well the case was going to get replaced with an NZXT Phantom 630 anyway, so this just adds a bit to the fire as it were. Of course with no wu's the 580 gpu is idling at 29C, not like it would crunch at that temp, but when I get some I'll see what the load is like then.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1362918 · Report as offensive
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : I was having a problem w/gpu downclocks while doing S@H wu's[solved]


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.