Heavy Metal! - high cpu count

Message boards : Number crunching : Heavy Metal! - high cpu count
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1960507 - Posted: 16 Oct 2018, 6:01:00 UTC
Last modified: 16 Oct 2018, 6:01:21 UTC

This system is on the 2nd page of the LeaderBoard and moving up. It has "only" 80 'cpus' and [4] NVIDIA Quadro P4000 (4095MB) driver: 382.59 OpenCL: 1.2's

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8431394

Tom
A proud member of the OFA (Old Farts Association).
ID: 1960507 · Report as offensive
Phil Burden

Send message
Joined: 26 Oct 00
Posts: 264
Credit: 22,303,899
RAC: 0
United Kingdom
Message 1960508 - Posted: 16 Oct 2018, 6:06:38 UTC - in response to Message 1960507.  

This system is on the 2nd page of the LeaderBoard and moving up. It has "only" 80 'cpus' and [4] NVIDIA Quadro P4000 (4095MB) driver: 382.59 OpenCL: 1.2's

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8431394

Tom


Doesn't appear to be doing much at present, it has zero tasks in progress, maybe it's resting ;-)

P.
ID: 1960508 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1960592 - Posted: 17 Oct 2018, 2:19:03 UTC - in response to Message 1960508.  

This system is on the 2nd page of the LeaderBoard and moving up. It has "only" 80 'cpus' and [4] NVIDIA Quadro P4000 (4095MB) driver: 382.59 OpenCL: 1.2's

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8431394

Tom


Doesn't appear to be doing much at present, it has zero tasks in progress, maybe it's resting ;-)

P.


If it rests too long it is going to fall right off the page.

I have two theories.
1) They are running it in a household and blew the heck out of the breaker box.
2) Someone just came back to work and noticed someone was "borrowing" the server :)

Tom
A proud member of the OFA (Old Farts Association).
ID: 1960592 · Report as offensive
Profile Bill Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 30 Nov 05
Posts: 282
Credit: 6,916,194
RAC: 60
United States
Message 1961125 - Posted: 20 Oct 2018, 12:59:51 UTC - in response to Message 1960592.  

I have two theories.
1) They are running it in a household and blew the heck out of the breaker box.
2) Someone just came back to work and noticed someone was "borrowing" the server :)


It looks like that person keeping an eye on the server just went back on break...
Seti@home classic: 1,456 results, 1.613 years CPU time
ID: 1961125 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1962433 - Posted: 29 Oct 2018, 16:06:18 UTC - in response to Message 1961125.  

I am not sure but I think he has "just" switched over to the Lunatics Distro. The reason I am saying "just" is because the Gflops on his gpu is very low compared to the Gflops on the SOG task.

But he has processed a lot of gpu tasks. I wonder which app he is actually using? Is it not the fastest Nvidia based gpu task?

Tom
A proud member of the OFA (Old Farts Association).
ID: 1962433 · Report as offensive
Keldon Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 28 Nov 17
Posts: 8
Credit: 124,341,599
RAC: 214
Channel Islands
Message 1962552 - Posted: 30 Oct 2018, 10:44:19 UTC

I have been using my machine for various tasks, testing different settings and it gets switched off when I am away hence the figures are a bit messed up.

Most interesting is that the cpus on their own outperform the gpus on a chip by chip basis. When I did the last test I was able to process tasks at around 1.5 minutes on average as each chip was processing 40 tasks at a time and taking about an hour for each. And that's on a Windows machine so I assume a Linux machine would be even better.

I have not seen much discussion on whether the increasing number of multi core cpus will offer an alternative to gpus.
ID: 1962552 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1962565 - Posted: 30 Oct 2018, 12:36:39 UTC - in response to Message 1962552.  

I would expect you would double the performance of the GPUs under Linux, with the CPU performance unchanged much since I believe it's the same code base for the apps. You may want to try out the SSE4.2 and 4.1 apps. Some people see better performance depending on the system. I don't think AVX512 exists around these parts.

RAM speed and fine tuning would be a must, and it looks like those chips would prefer 6 channels.
ID: 1962565 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1962682 - Posted: 31 Oct 2018, 15:56:47 UTC - in response to Message 1962552.  
Last modified: 31 Oct 2018, 15:57:45 UTC

I have been using my machine for various tasks, testing different settings and it gets switched off when I am away hence the figures are a bit messed up.

Most interesting is that the cpus on their own outperform the gpus on a chip by chip basis. When I did the last test I was able to process tasks at around 1.5 minutes on average as each chip was processing 40 tasks at a time and taking about an hour for each. And that's on a Windows machine so I assume a Linux machine would be even better.

I have not seen much discussion on whether the increasing number of multi core cpus will offer an alternative to gpus.


unfortunately, regardless of how many cores you have, or even physical CPUs, the server will only send you 100 CPU jobs at a time. unlike the 100 per GPU you can get with GPU work. this wont matter very much until you hit the Tuesday maintenance days, then you will run out of work fairly quickly. you can reschedule jobs to the GPU to stack them up, but since you'll have 80 "in projess" jobs at a time that you wont be able to reschedule, that means you can only reschedule 20 jobs per 5 minutes over too the GPUs. it will be painful doing that enough times to get a good number stacked up to hold you over for an outage.

I would swap it over to Linux. you can likely run the P4000s on the special app since they are pascal based and look similar to a GTX 1070 in specs. you can also run the AVX2 app which might boost performance of the CPUs.

No AVX512 for SETI that i'm aware of.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1962682 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1962695 - Posted: 31 Oct 2018, 17:34:33 UTC

If I am understanding it correctly, he would have to find a professional equivalent of the Film Editing app in Linux or else go with a dual booting solution to be able to switch it over to Linux to take advantage of the CUDA91 solution.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1962695 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1964118 - Posted: 9 Nov 2018, 11:31:43 UTC

I have got to wonder though, what command line is he using on his gpu's? They really should be running at under 7 minutes per task unless he is running 2 tasks / gpu.

I used to get about 7 minutes/task under Windows with the standard Seti SOG task and a gtx 1060 3GB and if I am reading his gpu task(s) right he has more muscle than that on each card.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1964118 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1964823 - Posted: 12 Nov 2018, 16:08:24 UTC - in response to Message 1964118.  

I have got to wonder though, what command line is he using on his gpu's? They really should be running at under 7 minutes per task unless he is running 2 tasks / gpu.

I used to get about 7 minutes/task under Windows with the standard Seti SOG task and a gtx 1060 3GB and if I am reading his gpu task(s) right he has more muscle than that on each card.

Tom


Here is an example of the gpu task https://setiathome.berkeley.edu/result.php?resultid=7136665038 It's running twice as slow as a gtx 1060 3GB running stock SOG type of gpu task.

Any ideas?

Tom
A proud member of the OFA (Old Farts Association).
ID: 1964823 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1964924 - Posted: 13 Nov 2018, 4:15:05 UTC
Last modified: 13 Nov 2018, 4:16:03 UTC

Another "heavy metal" system has joined the parade.

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8593761

It says 112 cores.... running two RX Vega gpus under Windows 10. :)

And stock Seti apps.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1964924 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1966694 - Posted: 23 Nov 2018, 1:34:47 UTC

Found another one :)

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8608043
A proud member of the OFA (Old Farts Association).
ID: 1966694 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1968683 - Posted: 4 Dec 2018, 21:03:56 UTC
Last modified: 4 Dec 2018, 21:04:40 UTC

Just bumped into this one that was next to one of mine. 96 processors.

4 gpus that I am not sure he is using much at all. Looks like he is using the stock Linux apps.

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8620252
A proud member of the OFA (Old Farts Association).
ID: 1968683 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1970879 - Posted: 18 Dec 2018, 5:51:12 UTC - in response to Message 1964924.  

Another "heavy metal" system has joined the parade.

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8593761

It says 112 cores.... running two RX Vega gpus under Windows 10. :)

And stock Seti apps.

Tom


Apparently the cpu chips are 28c/56t which means this is a 2 cpu system. I see a refurbished cpu for just under $10,000

Tom
A proud member of the OFA (Old Farts Association).
ID: 1970879 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1970880 - Posted: 18 Dec 2018, 5:58:06 UTC - in response to Message 1968683.  

Just bumped into this one that was next to one of mine. 96 processors.

4 gpus that I am not sure he is using much at all. Looks like he is using the stock Linux apps.

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8620252


New list price on New Egg is $5,888 something. 24c/48t. So this is another 2 cpu rig.
A proud member of the OFA (Old Farts Association).
ID: 1970880 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1977627 - Posted: 29 Jan 2019, 6:51:04 UTC
Last modified: 29 Jan 2019, 6:54:54 UTC

How about 64 cores for $225?

https://www.ebay.com/itm/New-INTEL-Xeon-Phi-7210-CPU-1-30GHz-64-core-32MB-16GB-MCDRAM-LGA3647-Socket/202519851383?hash=item2f271fb177:g:P3kAAOSwSe5cAEpQ:rk:3:pf:0

There are a couple of catches:
1) Low speed (1.3GHz)
2) No hyper threading
3) The motherboard(s) appear to be north of $500+

But outside of those issues, it looks like a lovely cpu chip. I even found a 68 core version on eBay.
--------------edit-------------
I actually found a 128 core on ebay https://www.ebay.com/sch/i.html?_from=R40&_trksid=p2334524.m570.l1313.TR1.TRC0.A0.H1.X128-core.TRS0&_nkw=128-core&_sacat=0&LH_TitleDesc=0&_sop=12&_odkw=128+core
It is only $17,750 or "best offer" :)

Tom
A proud member of the OFA (Old Farts Association).
ID: 1977627 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22188
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1977633 - Posted: 29 Jan 2019, 7:40:23 UTC

But outside of those issues, it looks like a lovely cpu chip. I even found a 68 core version on eBay.
--------------edit-------------
I actually found a 128 core on ebay https://www.ebay.com/sch/i.html?_from=R40&_trksid=p2334524.m570.l1313.TR1.TRC0.A0.H1.X128-core.TRS0&_nkw=128-core&_sacat=0&LH_TitleDesc=0&_sop=12&_odkw=128+core
It is only $17,750 or "best offer" :)


No, you found a one or two core chip with a 128k L2 cache - you should start to read the specs before jumping to conclusions that fleebat adverts are as clear as they should be.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1977633 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1977701 - Posted: 29 Jan 2019, 16:07:53 UTC - in response to Message 1977633.  


No, you found a one or two core chip with a 128k L2 cache - you should start to read the specs before jumping to conclusions that fleebat adverts are as clear as they should be.


Darn. Thank you for clearing that up before I started trying to raise the money ;)

Tom
A proud member of the OFA (Old Farts Association).
ID: 1977701 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1984591 - Posted: 11 Mar 2019, 18:23:07 UTC

More "Heavy Metal" :)

https://setiathome.berkeley.edu/show_host_detail.php?hostid=8431394

About 80 cores worth!

Tom
A proud member of the OFA (Old Farts Association).
ID: 1984591 · Report as offensive
1 · 2 · 3 · Next

Message boards : Number crunching : Heavy Metal! - high cpu count


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.