Building a 32 thread xeon system doesn't need to cost a lot

Message boards : Number crunching : Building a 32 thread xeon system doesn't need to cost a lot
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 12 · Next

AuthorMessage
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1778443 - Posted: 12 Apr 2016, 20:05:29 UTC - in response to Message 1777323.  
Last modified: 12 Apr 2016, 20:21:19 UTC

Yes but it's 100 WUs for all cores, not 100 WUs per core.
I get exactly 300 WUs for 2 GPUs and 4 cores, that's 100 per GPU and only 100 for my quad core...

I still don't see the issue.
If you had a second CPU, you would get another 100WU.
Once you finish a WU, you can then download another. The 100WU limit per device is not a per day limit.


EDIT-
So it seems useless to have more than 100 cores, because they will stop processing at the slightest server hiccup.


If it were 100 cores on a single CPU, yes. But as it's on multiple CPUs then it's not an issue (if my understanding of the limits is correct).



Anyone with a multi-CPU system able to advise whether the CPU limit is 100WUs per system, or per CPU?

My experience is per machine, not per CPU, at least on my HP Z600, which has 2x Xeon E5620's. I get 100 ea. for two GPUs, and 100 for both CPUs. Unfortunate.

FWIW, HP Z600s have been going pretty cheap on eBay lately. Mine was ~$285 with the above CPUs, 12 gb ram, a 128gb SSD, a 1tb HDD and Win7x64 pro installed and licensed. Room for 2x x16 dual slot GPUs. Pretty good way to get into the multi-CPU game with a turn-key solution.
ID: 1778443 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1778795 - Posted: 13 Apr 2016, 19:52:59 UTC - in response to Message 1778443.  

Jim, do you know if these systems would run v2 procs?

ID: 1778795 · Report as offensive
Gamboleer

Send message
Joined: 3 Jun 06
Posts: 29
Credit: 12,391,598
RAC: 0
United States
Message 1778830 - Posted: 13 Apr 2016, 22:19:06 UTC - in response to Message 1778795.  

Jim, do you know if these systems would run v2 procs?


Every V1 board I looked at also ran V2; it was one of the reasons for using the 2660/2670 CPUs, as there should be a cheap upgrade path to V2 in a couple years. V1 is limited to 1600 DDR3. V2 allows 1866. V1/V2 cannot use V3 CPUs.

These are my boards; they definitely run V2:

ASUS Z9PA-D8 (ATX)
ASROCK EP2C602-4L/D16 (SSI-EEB)
ID: 1778830 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1778850 - Posted: 14 Apr 2016, 0:10:17 UTC - in response to Message 1778795.  
Last modified: 14 Apr 2016, 0:26:24 UTC

Jim, do you know if these systems would run v2 procs?

If by V2 you mean 1333, I believe so. I base this off the HP spec sheet. Bunch of different sheets around on this box. One for sure suggests it will support the 3.2ghz hex core Xeon just fine. Still a bit pricey for those on eBay these days... But poke around a bit more at the HP site above and you should be able to get for sure data. Always good also to check for the latest BIOS on those.
Here's one I was watching on eBay. Not suggesting it necessarily, but just a flavor as to what's out there.
Later, Jim ...
ID: 1778850 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1778861 - Posted: 14 Apr 2016, 0:51:56 UTC - in response to Message 1778850.  

Thanks for the link, I meant Xeon v.2 CPU's. As was mentioned above, sadly the v.1-2 boards won't do v.3, and not sure if v.3 boards support v.4 or not, but we're a ways away from the day that _those_ processors will be "affordable"...

ID: 1778861 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1778873 - Posted: 14 Apr 2016, 1:25:31 UTC - in response to Message 1778861.  

Thanks for the link, I meant Xeon v.2 CPU's. As was mentioned above, sadly the v.1-2 boards won't do v.3, and not sure if v.3 boards support v.4 or not, but we're a ways away from the day that _those_ processors will be "affordable"...

Yeah, I haven't researched the Xeons deeply enough to know which CPU is whuch version. Guess I should look into that, eh?
ID: 1778873 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1778881 - Posted: 14 Apr 2016, 2:03:48 UTC - in response to Message 1778795.  
Last modified: 14 Apr 2016, 2:08:42 UTC

Jim, do you know if these systems would run v2 procs?

Near as I can tell, any LGA 1366 Xeon should be usable, as that's what the Z400/Z600 are equipped with. Looks to me like V1 (Nehalem) are the only Xeons to use LGA 1366.

If I've researched this right:

V2 is Sandy Bridge/Ivy Bridge, neither of which are offered in LGA 1366.
Sandy Bridge supported include LGA 1155, LGA 2011, Socket G2, BGA-1023, BGA-1224, BGA-1284
Ivy Bridge supported include LGA 1155, LGA 2011, LGA 2011-1, LGA 1356, Socket G2, BGA-1023, BGA-1224, BGA-1284
V3 is Haswell, again no LGA 1366. LGA1150, BGA1364, LGA2011-3 offered
V4 is Broadwell, again no LGA 1366. LGA1150 only
V5 is Skylake, again no LGA 1366. LGA1151 only

Al, does this sound about right?
ID: 1778881 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1778894 - Posted: 14 Apr 2016, 3:17:52 UTC - in response to Message 1778881.  
Last modified: 14 Apr 2016, 3:53:32 UTC

Looks like you've nailed it down pretty well. One thing I find interesting, they haven't released the Skylake 2011 (R1) (if that is what it will be, they seem to change sockets like I change underwear) versions, and not sure if they will skip v4 of these chips and go straight to v5?

So all in all, you've summarized it quite well. Excellent work!

*edit* Oh, and best as I can tell from that chart, the best processors for the board in that computer would be the W3690 or the X5690, they both run at 3.46 Ghz and support 1333 memory, and have a TDP of 130w, so very good cooling is a must, these guys are heaters. I believe the main difference is the X series is overclockable. And, just checked on Fleabay, the avg price for the W3690 is $150-175, and the X5690 is averaging around $275-300.

*edit edit* Scratch half of that, the W36xx series is only a single proessor chip, won't work in dual CPU systems, so by default, that makes the X5690 the winner tonite!

ID: 1778894 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1778896 - Posted: 14 Apr 2016, 3:28:28 UTC - in response to Message 1778894.  

they haven't released the Skylake 2011 (R1) (if that is what it will be,


computex taiwan is May 30
ID: 1778896 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1778903 - Posted: 14 Apr 2016, 3:42:13 UTC - in response to Message 1778896.  

they haven't released the Skylake 2011 (R1) (if that is what it will be,


computex taiwan is May 30

That's projected to be when the big announcement will be for these? And, I can only imagine the price..

ID: 1778903 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1778906 - Posted: 14 Apr 2016, 3:46:24 UTC - in response to Message 1778903.  

Don't know if those specifically but the Broadwells will be and you could guess they might also have others they talk about as well.

Guess we have to wait and see..
ID: 1778906 · Report as offensive
Gamboleer

Send message
Joined: 3 Jun 06
Posts: 29
Credit: 12,391,598
RAC: 0
United States
Message 1778908 - Posted: 14 Apr 2016, 4:10:00 UTC

V3 (LGA2011-3) boards will support V4/Broadwell Xeon 2600 series CPUs with a BIOS update. Example:

http://b2b.gigabyte.com/products/product-page.aspx?pid=5146#ov
ID: 1778908 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1778912 - Posted: 14 Apr 2016, 4:17:38 UTC - in response to Message 1778881.  
Last modified: 14 Apr 2016, 4:29:20 UTC

Near as I can tell, any LGA 1366 Xeon should be usable, as that's what the Z400/Z600 are equipped with. Looks to me like V1 (Nehalem) are the only Xeons to use LGA 1366.

Actually, within the Nehalem family, it's Bloomfield, Gainestown, Jasper Forest, Westmere and Gulftown that support LGA 1366.
So the hottest of the bunch would be the W3690 (~$175 used) or X5690 (~$300 used), which are 3.46ghz, 12mb L3 cache, 6.4 GT/s QPI, 1333 DDR3, 130 watts, 6 cores, 12 threads, with turbo boost.
Used prices stay high on these as they're in demand for Mac Pro upgrades.
But what does seem to be a bargain right now is the X5670 Six Cores 2.93 GHz/12M/6.40GT 95 watt LGA1366, which can be had for under $100 used. A pair of these could make the Z600 a pretty heavy hitter ... I suppose one of these days I'll get a couple and give it a shot...
To pull it back to the forum thread title, the above would be a 24 thread system, probably for under $500 all told.
ID: 1778912 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1783977 - Posted: 1 May 2016, 16:35:27 UTC - in response to Message 1778443.  
Last modified: 1 May 2016, 16:41:56 UTC


My experience is per machine, not per CPU, at least on my HP Z600, which has 2x Xeon E5620's. I get 100 ea. for two GPUs, and 100 for both CPUs. Unfortunate.

FWIW, HP Z600s have been going pretty cheap on eBay lately. Mine was ~$285 with the above CPUs, 12 gb ram, a 128gb SSD, a 1tb HDD and Win7x64 pro installed and licensed. Room for 2x x16 dual slot GPUs. Pretty good way to get into the multi-CPU game with a turn-key solution.

Well Jim, your experience with the Z600 piqued my interest, so I happened across one on fleabay a week or so ago for what seemed like a very reasonable price. It came with a single Intel Xeon E5649 2.53GHz SLBZ8 12MB 5.86 GT/s LGA1366 6-Core Processor, so I went out and found a 2nd one for about $50 and the standard, not high performance version of the HP OEM cooler for another 60 or so. I installed it the other day, and was looking at the wiring inside there, in terms of video card capabilities, and noticed that it only had a single 6 pin power connector for the video off of the PSU, though there is a 2nd power cord for SATA or IDE HD's that could be used with an adapter to I believe make a 2nd 6 pin, but not sure if it's configured correctly, as those usually use 2 different cables from the PSU, and this one would be using 2 connectors on one cable, since that's all there is in there.

I was a little suprised, as I'd have thought that being a workstation, it would be setup for installing a couple high horsepower GPU's into it. This one came with an Nvidia Quadro FX1800 in it, which has no power connectors, so would I be correct in presuming that it is a very low end card?

Other than putting in whatever the fastest GPU that has a single 6 pin connector along with a 2nd card that doesn't require any external power, what is a person to do for Moar Power? lol Or, is it just "it is what it is"? Thanks, this should be interesting.

*edit* Do Quadro's even work with BOINC & SETI? I see there is an PNY Nvidia Quadro FX 5800 video card out of a HP workstation that has a single 6 pin connector, starting bid of $149, who knows the final price, but I am not up to speed on those style of cards, so prices and capabilities elude me.

ID: 1783977 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1783981 - Posted: 1 May 2016, 16:42:16 UTC - in response to Message 1783977.  


My experience is per machine, not per CPU, at least on my HP Z600, which has 2x Xeon E5620's. I get 100 ea. for two GPUs, and 100 for both CPUs. Unfortunate.

FWIW, HP Z600s have been going pretty cheap on eBay lately. Mine was ~$285 with the above CPUs, 12 gb ram, a 128gb SSD, a 1tb HDD and Win7x64 pro installed and licensed. Room for 2x x16 dual slot GPUs. Pretty good way to get into the multi-CPU game with a turn-key solution.

Well Jim, your experience with the Z600 piqued my interest, so I happened across one on fleabay a week or so ago for what seemed like a very reasonable price. It came with a single Intel Xeon E5649 2.53GHz SLBZ8 12MB 5.86 GT/s LGA1366 6-Core Processor, so I went out and found a 2nd one for about $50 and the standard, not high performance version of the HP OEM cooler for another 60 or so. I installed it the other day, and was looking at the wiring inside there, in terms of video card capabilities, and noticed that it only had a single 6 pin power connector for the video off of the PSU, though there is a 2nd power cord for SATA or IDE HD's that could be used with an adapter to I believe make a 2nd 6 pin, but not sure if it's configured correctly, as those usually use 2 different cables from the PSU, and this one would be using 2 connectors on one cable, since that's all there is in there.

I was a little suprised, as I'd have thought that being a workstation, it would be setup for installing a couple high horsepower GPU's into it. This one came with an Nvidia Quadro FX1800 in it, which has no power connectors, so would I be correct in presuming that it is a very low end card?

Other than putting in whatever the fastest GPU that has a single 6 pin connector along with a 2nd card that doesn't require any external power, what is a person to do for Moar Power? lol Or, is it just "it is what it is"? Thanks, this should be interesting.

*edit* Do Quadro's even work with BOINC & SETI?

List of Nvidia graphics processing units
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1783981 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 1783985 - Posted: 1 May 2016, 16:48:57 UTC - in response to Message 1783977.  
Last modified: 1 May 2016, 16:53:38 UTC

The Quadro's work, though that model won't be breaking any records, with only 64 Cuda cores and compute capability 1.1 (pre-Fermi). Most likely either Cuda 2.3 or 3.2 will be the best choice for Cuda MB application, and you'd need to be careful with drivers since Pre-Fermi was moved to an end-of-life branch, and might need to try a few to see which will support OpenCL on this device.

(If looking to change, a 750ti would cream that GPU for less noise and power)
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 1783985 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1784014 - Posted: 1 May 2016, 17:27:41 UTC

Checked out that list, wow, that one's going to be going bye-bye. So, next question, off the top of your heads, do you have an opinion of what the fastest 6 pin GPU would be? It can be a 600 or 700 series, as well as the 900, though I believe the connector on my GTX950 dual fan model is a single 8 pin, so that would take an adapter I mentioned earlier. I'd like to turn this one up a notch from the standard builds I have been doing with the 750/950s that I have, but I know that the single 6 pin is going to be my limitation. Thanks for your thoughts/opinions.

ID: 1784014 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1784017 - Posted: 1 May 2016, 17:33:49 UTC

Oh, and a little OT, but Jason, could you head over to this thread and check out my post here and comment there on your thoughts of what might be going on? It seems a little weird, with such a large difference in systems that they would be so close in RAC. Thanks!

ID: 1784017 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1784026 - Posted: 1 May 2016, 17:56:49 UTC - in response to Message 1784014.  
Last modified: 1 May 2016, 17:59:21 UTC

Checked out that list, wow, that one's going to be going bye-bye. So, next question, off the top of your heads, do you have an opinion of what the fastest 6 pin GPU would be? It can be a 600 or 700 series, as well as the 900, though I believe the connector on my GTX950 dual fan model is a single 8 pin, so that would take an adapter I mentioned earlier. I'd like to turn this one up a notch from the standard builds I have been doing with the 750/950s that I have, but I know that the single 6 pin is going to be my limitation. Thanks for your thoughts/opinions.

You may be limited by the PSU in that system. However doing a quick check looks like those workstations came with a 650w 80Plus Bronze PSU. So you might just be OK.
A PCIe x16 slot, by spec, should provide 75w. Note: Sometimes motherboards are not designed to actually accommodate this to save money.
A 6-pin PCIe connector is rated for 75w & an 8-pin PCIe connector is rated for 150w.

So with a single 6-pin connector that would limit you to a GPU under 150w. On paper a GTX 970 is 145w, but all of the 970's I've come across have either an 8-pin or 8-pin + 6-pin connector. Some GTX 960's do have a single 6-pin connector. So that kind of limits your options in the 900 series without using any adapters.

If you wanted to go with adapters a GTX 980, 165w, with 2 6-pin connectors might be a good option. Like the 04G-P4-2981-KR or 04G-P4-2983-KR.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1784026 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1784036 - Posted: 1 May 2016, 18:12:02 UTC - in response to Message 1784026.  

Hal, thanks for the advice, I will look into both the adapters I'd need to pull this off, and those cards you linked to. So this pretty much limits me to a single powered GPU, plus another like the bottom end 950 or 750.

Maybe it's because it is is the Z600, which is the little brother to the Z800, and has available a 1100w PSU. I have never seen the inside of that one, but I'm pretty sure that they have more GPU power options available, otherwise, why bother, eh? ;-)

ID: 1784036 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 12 · Next

Message boards : Number crunching : Building a 32 thread xeon system doesn't need to cost a lot


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.