New SETI Rig

Message boards : Number crunching : New SETI Rig
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
I3APR

Send message
Joined: 23 Apr 16
Posts: 99
Credit: 70,717,488
RAC: 0
Italy
Message 1805015 - Posted: 26 Jul 2016, 21:23:33 UTC - in response to Message 1805004.  

Are your chipset drivers already installed yet ?

Intel C612 chipset drivers....

https://downloadcenter.intel.com/product/81756/Intel-C612-Chipset


Thank you Matrix, yes I also updated the chipset drivers, with newer one.
BTW, my Chipset is C610/X99, and the most recent I was able to find was ver. 10.1.2.10.

A.
ID: 1805015 · Report as offensive
J. Mileski
Volunteer tester
Avatar

Send message
Joined: 9 Jun 02
Posts: 632
Credit: 172,116,532
RAC: 572
United States
Message 1805018 - Posted: 26 Jul 2016, 21:47:42 UTC - in response to Message 1805013.  

First the PCIe slots are numbered from bottom to top with the white ones from CPU 2 and the blue ones from CPU 1, to me that suggests two separate PCIe channels. I'm guessing that the 2 different generations of cards are not working together on this motherboard. From your description you ended up with one card on the white slot and one on the blue. So I believe if you want to add another card in the future, if it is another 780ti, place it in the same color slot as your first card.


Hi J, tnx for the hint, and thanx for taking the time to read the manual of a MoBo you don't own, I really appreciate that !!
Well, I've been fighting all evening with this Mobo and his 7-read-7 PCI slots...
The connection schema of the PCI Slot to CPU are part of the equation, but what you can't see on the manual, is that on the Bios, you can also set the Link speed and the Width, so the variables became a lot !!
So after a couple of hours of "try-and-error" approach, rather frustrating I had to say, I read the manual again and decide to act as if I had to install an homogeneous 4 way SLI, but instead I wanted to install 1x780ti and 3x660ti, NOT in SLI.
I followed the instruction, putting the link width at 16x for slots 1,3,5,7, set generation to Gen2 for stability, connected an extra power link from PSU to the Mobo, for voltage/current stability and rebooted :



Surprise ! All four GPUs... ;-)

Started Boinc, and this is the first part of the log :

7/26/2016 9:42:32 PM | | Starting BOINC client version 7.6.22 for windows_x86_64
7/26/2016 9:42:32 PM | | log flags: file_xfer, sched_ops, task
7/26/2016 9:42:32 PM | | Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
7/26/2016 9:42:32 PM | | Data directory: C:\ProgramData\BOINC
7/26/2016 9:42:32 PM | | Running under account Andrea
7/26/2016 9:42:37 PM | | CUDA: NVIDIA GPU 0: GeForce GTX 780 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.5, 3072MB, 2879MB available, 6022 GFLOPS peak)
7/26/2016 9:42:37 PM | | CUDA: NVIDIA GPU 1: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | | CUDA: NVIDIA GPU 2: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | | CUDA: NVIDIA GPU 3: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | | OpenCL: NVIDIA GPU 0: GeForce GTX 780 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 3072MB, 2879MB available, 6022 GFLOPS peak)
7/26/2016 9:42:37 PM | | OpenCL: NVIDIA GPU 1: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | | OpenCL: NVIDIA GPU 2: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | | OpenCL: NVIDIA GPU 3: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/26/2016 9:42:37 PM | SETI@home | Found app_info.xml; using anonymous platform
7/26/2016 9:42:37 PM | | Host name: Win2012ST
7/26/2016 9:42:37 PM | | Processor: 48 GenuineIntel Genuine Intel(R) CPU @ 2.20GHz [Family 6 Model 63 Stepping 1]
7/26/2016 9:42:37 PM | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 fma cx16 sse4_1 sse4_2 movebe popcnt aes f16c rdrandsyscall nx lm avx avx2 vmx smx tm2 dca pbe fsgsbase bmi1 hle smep bmi2
7/26/2016 9:42:37 PM | | OS: Microsoft Windows Server 2012 R2: Standard x64 Edition, (06.03.9600.00)
7/26/2016 9:42:37 PM | | Memory: 31.88 GB physical, 63.88 GB virtual
7/26/2016 9:42:37 PM | | Disk: 232.54 GB total, 176.93 GB free
7/26/2016 9:42:37 PM | | Local time is UTC +2 hours
7/26/2016 9:42:37 PM | SETI@home | Found app_config.xml
7/26/2016 9:42:37 PM | | Config: use all coprocessors


And this is the power consumption ( @220V) read on Corsair Link sofware connected via USB to the PSU :



I tell ya, not bad for a dual Xeon V3 with 48 cores@100% and 4 Gpus...

Now, the next step would be to try to fill the remaining 3 PCI slots, but...unfortunately I almost run out of connection on the mighty Corsair AX1500i PSU...: only two PCI-E power connections left, so I'll have to wait until the GTX 1070 will arrive to test it "full spread".

I'm not really familiar now with the setting in app_config.xml for a 48 core ( 24 physical ) system with four nvidia GPUs, but I'm opening a new thread for this.
Thank you, however...

A.


I love reading manuals for boards I don't own. When I'm shopping for parts, that is how I determine what is right for me. I'm building my own dual xeon system and I'm hoping to have it running for the WOW event. I'm not sure I have enough income to achieve that goal, but it's going to be close.

http://setiathome.berkeley.edu/forum_thread.php?id=79841
ID: 1805018 · Report as offensive
The_Matrix
Volunteer tester

Send message
Joined: 17 Nov 03
Posts: 414
Credit: 5,827,850
RAC: 0
Germany
Message 1805093 - Posted: 27 Jul 2016, 11:37:15 UTC - in response to Message 1805015.  
Last modified: 27 Jul 2016, 12:02:47 UTC

my Chipset is C610/X99,



http://www.asrockrack.com/general/productdetail.asp?Model=EP2C612%20WS#Specifications

That´s WRONG. hehe watch this side theres is truly a C612 Chipset...

that must be the fault...

If it the installer installs your set of drivers , there must be something wrong, and u have to install the right drivers manualy over the device manager.

To get those drivers -> u must set a junction on the desktop to the setup.exe file, rightclick properties and insert following:

C:\SetupChipset.exe -extract c:\Intel

Now all drivers are in the "Intel" folder , u need the folder "haswelle".
ID: 1805093 · Report as offensive
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 1805106 - Posted: 27 Jul 2016, 13:29:40 UTC

Your system is a master! I wish I had something like this for seti. No GPUs?
ID: 1805106 · Report as offensive
I3APR

Send message
Joined: 23 Apr 16
Posts: 99
Credit: 70,717,488
RAC: 0
Italy
Message 1805108 - Posted: 27 Jul 2016, 13:34:53 UTC - in response to Message 1805093.  

Hello Matrix, thank you for the info.
Hmm..I don't really know how I could get them wrong but I effectively did...
I got the drivers for 610 from here : http://www.guru3d.com/files-get/intel-chipset-software-installation-10-1-2-10-whql-download,1.html ...but I was lucky, because I have just compared them with the one from the link you gave to me, and the binary comparison of the two executable says that the file is exactely the same, bit by bit.
So apparently, 610 chipset and 612 share the same inf files...

Thank you tho !!!

A.
ID: 1805108 · Report as offensive
The_Matrix
Volunteer tester

Send message
Joined: 17 Nov 03
Posts: 414
Credit: 5,827,850
RAC: 0
Germany
Message 1805109 - Posted: 27 Jul 2016, 13:35:30 UTC
Last modified: 27 Jul 2016, 13:48:04 UTC

See the last post, 3x 660Ti + 780Ti. On the i7 a 1080 :DDDDDDDDDD and of course the tiny Intel "gpu"....
ID: 1805109 · Report as offensive
I3APR

Send message
Joined: 23 Apr 16
Posts: 99
Credit: 70,717,488
RAC: 0
Italy
Message 1805142 - Posted: 27 Jul 2016, 17:22:03 UTC - in response to Message 1805109.  

See the last post, 3x 660Ti + 780Ti. On the i7 a 1080 :DDDDDDDDDD and of course the tiny Intel "gpu"....

Oh well..of course we always try to improve... ;-) ...so today I added the 5th GPU...a humble GTX 660 ( not ti ).

7/27/2016 6:51:59 PM | | Starting BOINC client version 7.6.22 for windows_x86_64
7/27/2016 6:51:59 PM | | log flags: file_xfer, sched_ops, task
7/27/2016 6:51:59 PM | | Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
7/27/2016 6:51:59 PM | | Data directory: C:\ProgramData\BOINC
7/27/2016 6:51:59 PM | | Running under account Andrea
7/27/2016 6:52:03 PM | | CUDA: NVIDIA GPU 0: GeForce GTX 780 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.5, 3072MB, 2879MB available, 6022 GFLOPS peak)
7/27/2016 6:52:03 PM | | CUDA: NVIDIA GPU 1: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | CUDA: NVIDIA GPU 2: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | CUDA: NVIDIA GPU 3: GeForce GTX 660 Ti (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | CUDA: NVIDIA GPU 4: GeForce GTX 660 (driver version 368.81, CUDA version 8.0, compute capability 3.0, 2048MB, 1961MB available, 1982 GFLOPS peak)
7/27/2016 6:52:03 PM | | OpenCL: NVIDIA GPU 0: GeForce GTX 780 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 3072MB, 2879MB available, 6022 GFLOPS peak)
7/27/2016 6:52:03 PM | | OpenCL: NVIDIA GPU 1: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | OpenCL: NVIDIA GPU 2: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | OpenCL: NVIDIA GPU 3: GeForce GTX 660 Ti (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1953MB available, 2810 GFLOPS peak)
7/27/2016 6:52:03 PM | | OpenCL: NVIDIA GPU 4: GeForce GTX 660 (driver version 368.81, device version OpenCL 1.2 CUDA, 2048MB, 1961MB available, 1982 GFLOPS peak)
7/27/2016 6:52:03 PM | SETI@home | Found app_info.xml; using anonymous platform
7/27/2016 6:52:03 PM | | Host name: Win2012ST


So here' some picture of the actual rig :





The power consuption, did raise at 700/800 W tho.... :-(



Anyway still waiting for the two GTX 1070 which should arrive any moment...my "dream" would be to accomodate them on the two PCI slot left... :-D

Ciao
A.
ID: 1805142 · Report as offensive
The_Matrix
Volunteer tester

Send message
Joined: 17 Nov 03
Posts: 414
Credit: 5,827,850
RAC: 0
Germany
Message 1805146 - Posted: 27 Jul 2016, 17:35:25 UTC
Last modified: 27 Jul 2016, 17:51:19 UTC

What an overhaul, hope there isn´t a intenion to mine ?

Who´s paying the electricity bill ? Not me for sure. *duckandrun* *fromtheflyingshoe*

https://www.alternate.de/Corsair/AX1500i-PC-Netzteil/html/product/1120621

Energy effiency at 94% , that could be paid...
ID: 1805146 · Report as offensive
elec999 Project Donor

Send message
Joined: 24 Nov 02
Posts: 375
Credit: 416,969,548
RAC: 141
Canada
Message 1805150 - Posted: 27 Jul 2016, 17:53:44 UTC

Where did you get those adapters to connect the cards?
ID: 1805150 · Report as offensive
The_Matrix
Volunteer tester

Send message
Joined: 17 Nov 03
Posts: 414
Credit: 5,827,850
RAC: 0
Germany
Message 1805151 - Posted: 27 Jul 2016, 17:54:42 UTC
Last modified: 27 Jul 2016, 17:57:53 UTC

They can be buyed at amazon, u know...the come from ...u know where...

https://www.amazon.com/Fixable-Adapter-Flexible-Extension-Connector/dp/B00IMYODGS

don´t know if it´s the best price
ID: 1805151 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1805221 - Posted: 27 Jul 2016, 23:02:16 UTC - in response to Message 1805151.  

LMAO

9.99 .com
53.10 .ca
ID: 1805221 · Report as offensive
I3APR

Send message
Joined: 23 Apr 16
Posts: 99
Credit: 70,717,488
RAC: 0
Italy
Message 1805297 - Posted: 28 Jul 2016, 9:08:25 UTC

@Brent

9.99 .com
53.10 .ca
15.00 .it

...but I saw this on amazon.ca :

https://www.amazon.ca/SODIAL-Express-Extender-Adapter-Litecoin/dp/B00OPO4K8K/ref=sr_1_1?ie=UTF8&qid=1469696658&sr=8-1&keywords=usb+riser

Which looks exactly the same to mine..

@Matrix
A thought crossed my mind about about mining, butfor now I'm really happy to stay with the aliens searchers.. ;-)


Well, I had a phone call : the two GTX 1070 arrived today, so this evening I'll try to add them to the PC.

A
ID: 1805297 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1805318 - Posted: 28 Jul 2016, 11:47:51 UTC - in response to Message 1805297.  

Sounds exciting, I hope your install with the 1070s goes smoothly. The issue I ran into when adding my 980Ti SC to the 48 core rig with the 1080 FTW is that the new EVGA Precision software version that works with the 10x0 series cards, that controls the overclocking and such, doesn't play at all with the previous generation cards. It shows them fine, but when you try to click on the 980 for example, it pops up saying sorry, only works with 1070 and 1080 cards. I ended up using the old version to control them both, but it was less than optimal, it doesn't work with the new cards nearly as well as the version that is designed for it, but whattya gonna do, it's either that, or not control the 9xx and older cards at all. EVGA doesn't have a solution, and doesn't know if/when they will, which I found amazing. Let me know how you end up controlling yours, and how it works for you. I am interested to see how well those 1070's work on the USB extenders, as this weekend I will most likely be following in your footsteps with a build that is similar, and if you run into any gotchas, it'd be good to hear about them. Great work on this, and glad it seems to be working ok so far for you!

ID: 1805318 · Report as offensive
Previous · 1 · 2

Message boards : Number crunching : New SETI Rig


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.