Come on admit it, you have an E5-2670 crunching on Boinc and/or Seti@Home. How is it doing?

Message boards : Number crunching : Come on admit it, you have an E5-2670 crunching on Boinc and/or Seti@Home. How is it doing?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926028 - Posted: 23 Mar 2018, 17:37:11 UTC

Well I am still trying to search for a solution for the extra EATX12V_1 cable needed. My plan to use the PCIe-Molex adapters on the Peripheral ports almost fried the motherboard. I think thank goodness that the power supply crowbarred itself when I turned it on with the cable plugged into the motherboard. The motherboard was totally dead. No lights, no fans. Nothing. No response to power or reset. Thought I had killed it.

Finally pulled the plug from the motherboard and pulled the plug on the power supply and then held in the power button for 30 seconds. Think that removed the internal crowbar set in the power supply and the system powered up again. Don't think there was any permanent damage.

Totally conflicting information on how to provide power to the EATX12V_1, 6-pin port on the motherboard. It has reverse polarity compared to the other EATX12V ports and cables. Some information that a PCIe cable will work, some others say not. Moot point as I don't have any more PCIe ports or cables available on the power supply.

That is what I configured with the PCIe-Molex adapters and it powered up the 1060 OK. There is a missing 12V connection pin in those adapters that is needed for the motherboard connector but I guess is not necessary for a gpu.

Anyone have any idea of how to provide the extra power necessary for four gpus on my motherboard?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926028 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1926035 - Posted: 23 Mar 2018, 18:47:14 UTC - in response to Message 1926028.  

how big is your PSU?
ID: 1926035 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926036 - Posted: 23 Mar 2018, 18:57:47 UTC - in response to Message 1926035.  

It is the EVGA SuperNOVA 1000 G2, 80+ GOLD 1000W power supply.

The system is only drawing 600W from the wall from the Backups 1500G UPS front panel meter.

I may have damaged things after all. Just trashed my whole cache. I had every gpu task aborted from time exceeded errors. Just deleted the hidden .NV Compute Cache and all the slots. Reset the project.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926036 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1926038 - Posted: 23 Mar 2018, 19:08:58 UTC - in response to Message 1926036.  

Lowest PSU I run is 1200, most are 1600W. You using a Killawatt monitor? I would think they would be drawing 1100 at least.
ID: 1926038 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926041 - Posted: 23 Mar 2018, 19:14:57 UTC

Still erroring out on "finish file present too long" errors. I don't see how since I deleted entirely every slot before I restarted BOINC.

System just crashed again. I fear I have damaged it with whatever happened with the extra PCIe slot power cable plugged in. Will rip the system apart since it is unusable for BOINC at this time.

I still don't know why the peripheral cable converted to the needed EATX12V_1 cable didn't work and it WAS the correct polarity after all. The same polarity as a PCIe 6 pin cable. The only issue is that the 6pin cable adapters I have pulled from every gpu box and manufacturer only has two of the three 12V pins connected. The motherboard connector is supposed to have all three 12V pins provided power.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926041 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926043 - Posted: 23 Mar 2018, 19:17:24 UTC - in response to Message 1926038.  

Lowest PSU I run is 1200, most are 1600W. You using a Killawatt monitor? I would think they would be drawing 1100 at least.

No I am using the power monitor in the UPS. I am using only three 1080 right now. Nvidia-smi only shows each card drawing 215W when crunching.

None of my systems have ever drawn more than 700W at any time.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926043 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1926051 - Posted: 23 Mar 2018, 19:49:37 UTC - in response to Message 1926043.  

EATX power cables and PCI cables have opposite polarity. And have different coding (squares, and D's)

I ran into a similar issue when swapping out a MasterCooler 750W with a 1200W. The power supply end was the same for the EATX (great I thought, don't have to rearrange the neat cabling) but the polarity was opposite - wouldn't power up, dead. But got lucky the swapping the cable out worked with no damage. SILLY BUGGERS TO DO THAT!!!
ID: 1926051 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1926053 - Posted: 23 Mar 2018, 19:53:47 UTC

Anyone want to take bets on whether or not Keith replaces the Intel with a TheardRipper within a month? :D
ID: 1926053 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1926055 - Posted: 23 Mar 2018, 20:00:40 UTC

I'm not sure but i believe the connector in the MB is a PCE-e type, but to be sure look the MB manual they shows what is the right one to use.

Or as ASUS tech support.

Anyone want to take bets on whether or not Keith replaces the Intel with a TheardRipper within a month? :D


A month? More like a week no? LOL
ID: 1926055 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926104 - Posted: 23 Mar 2018, 22:03:28 UTC - in response to Message 1926051.  

EATX power cables and PCI cables have opposite polarity. And have different coding (squares, and D's)

I ran into a similar issue when swapping out a MasterCooler 750W with a 1200W. The power supply end was the same for the EATX (great I thought, don't have to rearrange the neat cabling) but the polarity was opposite - wouldn't power up, dead. But got lucky the swapping the cable out worked with no damage. SILLY BUGGERS TO DO THAT!!!

No, that is not the case with the ASUS EATX12V_1 connector on the motherboard. It is keyed opposite the EATX12V and EATX12V1 connectors.


Look at this photo from the manual.
X99-E-10G WS EATX power connector pinout

Notice the orientation of the latch side and where the 12V and ground reference pins are on the EATX12V_1 connector compared to the two EATX cpu 8-pin connectors. They are opposite. The square pin references are the opposite diagonal too. You can't use the cpu EATX power cables provided with the EVGA power supply to provide the extra 12V for the PCIe slots next to slot 1.

But that pinout orientation is the same as the standard PCIe 6-pin power connector.

PCIe 6-pin connector pinout

But I haven't figured out a way to make another 6-pin PCIe power cable available from the power supply yet when all the provided PCIe cables and ports are already in use.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926104 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926107 - Posted: 23 Mar 2018, 22:13:37 UTC

If this X99 board is unusable for crunching, then the experiment has been a waste of time and money and only provided a learning experience.

I read the ASUS ROG Zenith Extreme X399 thread every day and the product development is about where the X370 boards were at a similar time frame. The X399 products have been out for less than 6 months so far. That motherboard has its own share of foibles and eccentricities and I haven't felt the urge yet to pull the trigger on a X399 build. That time may come shortly if the X99 experiment ends up a bust.

Getting ready to tear down the system and do the surgery on the X99 board. Will give it a real good look over and see if there any traces burnt or overheated. I haven't started yet cause I need the kitchen table for Pipsqueek rebuild with the 1070Ti that UPS just dropped off. That should go quickly and then I will start removing everything out of the Core X9 chassis so I can remove the motherboard tray and the motherboard.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926107 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1926116 - Posted: 23 Mar 2018, 22:48:52 UTC - in response to Message 1926107.  
Last modified: 23 Mar 2018, 22:52:09 UTC

Keith I used 2 Molex connectors to connect to a single 6 pin connector for the motherboard . I don't have a pic here that I can show you with.

Z

edit..

Found one

ID: 1926116 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926145 - Posted: 24 Mar 2018, 0:31:03 UTC

That's exactly what I used for both conversions of the peripheral cables into PCIe 6 pin connectors. The two adapters were in each of my EVGA GTX 970 boxes. The 970 uses dual 6 pin connectors.

The cable did not work and prevented the machine from powering up when plugged into the auxiliary PCIe slot power connector on the motherboard . The cable does power up the 1060 fine though. The adapters that EVGA provides have only two of the three 12V pins in the 6 pin connector. The middle pin is missing.

I have located similar parts on Amazon that from the images, might have all three yellow 12V wires connected. None of the images show the cable connections into the 6 pin connector clearly. I have one in my wish list but I won't buy it until I know that it will work. Plus it is too low a cost for free shipping and has to be an add-on item for another order of $25 or more. That really isn't a hindrance, I'll pay for expedited shipping if it will work.

I didn't get around to calling ASUS or EVGA today because I was busy putting out other fires. I need to talk to EVGA and ask them what I am supposed to do for providing the EATX12V_1 power cable. I wonder whether the peripheral ports can provide the power or not. Maybe the SATA ports? It shouldn't matter because the power supply uses a single 12V rail that should provide 12V to ALL ports where needed.

I found one forum thread post that said the SATA spec provides 4.5A of 12V power. I can't find any data on what the EVGA peripheral port provides. The Molex LP-4 connector is good for 6A on the 12V lines if built with standard 18ga. wire. That is 72W on just a single 12V yellow wire. The single molex pin can carry 9A. Using the adapter in your image should provide 154W with two 12V wires into the 6 pin connector. With three 12V wires into the 6 pin connector and what is expected on the motherboard side connector should provide 225W of additional 12V power to the PCIe slots.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926145 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1926163 - Posted: 24 Mar 2018, 1:19:18 UTC

You are in the right path, just need to find a compatible cable. Maybe because that is why X99 MB like mine uses a common old molex conectors for the extra power. It could handle a little power only but is easy to find and all PSW has one to spare. Hope you find a compatible one, sure ASUS has them on stock since they use in a lot of MB models.
ID: 1926163 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1926193 - Posted: 24 Mar 2018, 4:54:36 UTC - in response to Message 1926145.  

If you want to get creative - remove the pins out of both the plugs and make your own :)
Then you will have a single ended PCIe power cable which will be much neater in the end.
ID: 1926193 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926224 - Posted: 24 Mar 2018, 8:19:46 UTC - in response to Message 1926193.  

I am certainly capable of making my own cables. Just have to order the pins and connectors from Mouser or Digi-key. But the main issue is where to get the 12V from the power supply in the first place.

The only free ports on the power supply are the two peripheral ports and 5 empty SATA ports. By comparing cables and pinouts from both the peripheral and SATA cables, only one pin in each of the peripheral or SATA power supply ports has 12V on it. The rest are either +3.3V, +5v or common.

I would have thought that with two peripheral cables I should have been able to source 150W to the EATX12V_1 connector and that should have been plenty of extra wattage for the 4th card and not let the 12V PCIe bus droop too low and cause the card dropouts and compute errors I was getting.

Unless the power supply objected on the amp draw on each single 12V peripheral pin and crowbarred the supply to prevent damage. That would mean there is a current protection circuit in the power supply. That does not sound out of the realm of possibility if the supply is well designed. I would design a supply that way myself.

The other possibility is that the motherboard has a sensing circuit and shuts itself down if it does not see 12V on each of the three 12V pins in the EATX12V_1 socket.

The only way to answer these questions would have been a conversation with both EVGA and ASUS and I missed the opportunity today.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926224 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1926227 - Posted: 24 Mar 2018, 8:34:33 UTC - in response to Message 1926224.  

My bad, I was thinking that with one CPU you would have an extra EATX power cable with the 1000W PSU, but I see now that you have 2x8pin and a 6pin connectors on that board, so no extra EATX cable. I picked up a bunch of connectors a couple of months ago to clean up some cabling.
ID: 1926227 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926238 - Posted: 24 Mar 2018, 9:37:50 UTC

Yes, all the EATX cables from the power supply got used. The motherboard has two 8-pin EATX connectors to feed the VRM's. No extra 6 pin connector unless you count the 6+2 PCIe connectors of which six are provided and all six get used for the three 1080's and none left over. Kind of makes it hard to power up the extra EATX12V_1 PCIe slot connector which is necessary for feeding 4 cards.

I pulled all the power cables from the motherboard and used the test connector to start the power supply up and plugged in my two peripheral cables turned into a 6-pin EATX12V_1 cable and measured the 12V on it. Everything looked good. No ripple and the same 12V reading I was getting for the 12V on the cpu and PCIe ports. So the same 12V rail as the power supply was advertised with. Unloaded of course so no way to measure what happens to the voltage under load.

So I got brave and plugged in all the power cables for the motherboard and the EATX12V_1 cable. The motherboard had normal lights, so I gave the power button a try and the system booted and came up. This didn't happen the first time I plugged in the cable. So something different this time. Still have to figure out a way to power up the 1060 card in the 4th slot from the SATA ports. I think I saw a adapter cable for that configuration earlier when I was searching for the EATX12V_1 solution.

So, at that point I decided to rip everything out as planned to remove the motherboard from the chassis so I could do the PCH surgery on it and upgrade the cpu from the Xeon to the 6850K.

Nine screws later the PCH heat sink and the two heat pipe radiators came off the board to expose the PCH chip and the two PLX chips. Lo and behold, guess what I found? There was no thermal pad on the bottom PLX chip and it was not contacting the heat pipe at all. I wonder which part of the motherboard that PLX chip services? Could it be the PCIe slots 5 and 7 which are where the 3rd and 4th double wide gpus get plugged into? And coincidentally my previously stable system with just two gpus in slots 1 and 3 are serviced by the top PLX chip which had thermal material. And the system became unstable as soon as I plugged in the 3rd and 4th gpus.

X99-E-10G WS Block diagram

So I removed the old pad material on the PCH chip and the top PLX chip and put on the FujiPoly thermal pad material I had purchased for this operation on both PLX chips and the PCH chip. Then reassembled the PCH heat sink. I looked at the VRM heat sinks and decided not to remove them because I didn't have enough FujiPoly material left over to replace its thermal material. Need a bigger piece that is much longer than the 50mm square material I got. So changed out the cpu and then mounted the motherboard back onto the motherboard tray and put it back into the case.

And that is where I stopped tonight to type this up. Time for bed and some fresh eyes and caffeine later in the morning to start reassembling the computer.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926238 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1926460 - Posted: 25 Mar 2018, 1:00:05 UTC

Progress report. The Xeon is now replaced by a 6850K @ 4Ghz and memory running at XMP spec of 3000Mhz. System is up and running again with 3 gpus and simply waiting for power adapters to put the 4th card in on Monday.

So the computer surgery was successful.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1926460 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1926467 - Posted: 25 Mar 2018, 1:13:34 UTC - in response to Message 1926460.  

Progress report. The Xeon is now replaced by a 6850K @ 4Ghz and memory running at XMP spec of 3000Mhz. System is up and running again with 3 gpus and simply waiting for power adapters to put the 4th card in on Monday.

So the computer surgery was successful.

Nice. Will drink to that!

Can't wait what your new baby could do.
ID: 1926467 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

Message boards : Number crunching : Come on admit it, you have an E5-2670 crunching on Boinc and/or Seti@Home. How is it doing?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.