Panic Mode On (83) Server Problems?


log in

Advanced search

Message boards : Number crunching : Panic Mode On (83) Server Problems?

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 22 · Next
Author Message
Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5831
Credit: 59,448,548
RAC: 47,826
Australia
Message 1359100 - Posted: 20 Apr 2013, 22:44:56 UTC - in response to Message 1358966.

According to the new Haveland graphs, 'Results received in last hour' (the blue line on that page) hasn't dipped below 110K for 30 hours solid - in fact, it's averaged more than that for the whole of the last week. That's nearly 22 million results in the 8 days covered by the weekly graph.

And whatever gets returned, has to have been sent out first. That's one hell of a hammering the servers are getting - kudos to all involved.

And add to that the numbner of AP WUs in progress & the number returned per hour are approaching as high as they have ever been before as well.
That's a lot of work for the servers to handle.
____________
Grant
Darwin NT.

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5831
Credit: 59,448,548
RAC: 47,826
Australia
Message 1359165 - Posted: 21 Apr 2013, 4:07:15 UTC - in response to Message 1359100.


Results returned in the last hour has fallen to 100,000 (still 30,000 more than usual), and the Ready-to-send buffer has actually started to recover.
Just had a look in my work queue & there are a few GPU units that will take more than 3min to crunch. Not many, but some.

So the shorty storm continues, but at least it's abated a bit.
____________
Grant
Darwin NT.

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359346 - Posted: 21 Apr 2013, 12:49:13 UTC

I just had a look in my hosts and the GPU's have a boatload of shorties. Have a lot of Ap's though. I like AP's especialy in the 550TI can run one in 4 hours.
____________

Old James

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5831
Credit: 59,448,548
RAC: 47,826
Australia
Message 1359448 - Posted: 21 Apr 2013, 17:44:44 UTC - in response to Message 1359346.


Splitters still struggling.
____________
Grant
Darwin NT.

Filipe
Send message
Joined: 12 Aug 00
Posts: 111
Credit: 4,106,573
RAC: 434
Portugal
Message 1359520 - Posted: 21 Apr 2013, 21:15:56 UTC

I just had a look in my hosts and the GPU's have a boatload of shorties. Have a lot of Ap's though. I like AP's especialy in the 550TI can run one in 4 hours.


4 hours?!? My 550Ti does the AP's on +/- 1 hour. Check my results.
____________

Tom*
Send message
Joined: 12 Aug 11
Posts: 114
Credit: 4,812,750
RAC: 1,055
United States
Message 1359534 - Posted: 21 Apr 2013, 21:56:01 UTC
Last modified: 21 Apr 2013, 22:52:24 UTC

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359779 - Posted: 22 Apr 2013, 11:48:00 UTC - in response to Message 1359534.

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.


No im not, But I have debated if I want to free one core up. But if an AP can be done in an hour That kind of clinches the debate. I didnt realize that it made that much of a differemce.
____________

Old James

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359780 - Posted: 22 Apr 2013, 11:48:30 UTC - in response to Message 1359534.

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.


Now I need to find that post on how to do it.
____________

Old James

Profile WilliamProject donor
Volunteer tester
Avatar
Send message
Joined: 14 Feb 13
Posts: 1602
Credit: 9,469,122
RAC: 258
Message 1359785 - Posted: 22 Apr 2013, 12:03:31 UTC - in response to Message 1359780.

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.


Now I need to find that post on how to do it.

How to do what - free up a core? Go to settings and change 'on multiprocessors use at most x% of processors' to a suitable value (e.g. 80/90 for 6/7 out of 8 cores respectively) If you have local preferences, change the value there.
____________
A person who won't read has no advantage over one who can't read. (Mark Twain)

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359792 - Posted: 22 Apr 2013, 12:22:36 UTC - in response to Message 1359785.

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.


Now I need to find that post on how to do it.

How to do what - free up a core? Go to settings and change 'on multiprocessors use at most x% of processors' to a suitable value (e.g. 80/90 for 6/7 out of 8 cores respectively) If you have local preferences, change the value there.


Thanks William. I changed the local pref to 80 and have 6 cores running now. I take it I can scale that up to get 7 running by going to 85% ?
____________

Old James

Richard HaselgroveProject donor
Volunteer tester
Send message
Joined: 4 Jul 99
Posts: 8550
Credit: 50,410,015
RAC: 51,007
United Kingdom
Message 1359795 - Posted: 22 Apr 2013, 12:29:39 UTC - in response to Message 1359792.

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.

Now I need to find that post on how to do it.

How to do what - free up a core? Go to settings and change 'on multiprocessors use at most x% of processors' to a suitable value (e.g. 80/90 for 6/7 out of 8 cores respectively) If you have local preferences, change the value there.

Thanks William. I changed the local pref to 80 and have 6 cores running now. I take it I can scale that up to get 7 running by going to 85% ?

Not quite - 7/8ths of the available cores is 87.5%, so you need that figure or higher. That's why William suggested 90, as an easy figure - or you could use 88, then your fingers don't have to move so far.

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359798 - Posted: 22 Apr 2013, 12:37:42 UTC - in response to Message 1359795.
Last modified: 22 Apr 2013, 12:38:36 UTC

He likely isn't allocating a cpu core out of his 8 HT on his i7 to the

AP OpenCL 6.04's .

It makes a huge difference for NVIDIA OpenCL tasks.

I am just starting to test a HD7950 for SETI and only stock tasks I get are
AP's no MB's the AP Opencl ATI tasks using 12.4 OpenCL with 13.2 beta 7 Catalyst/Control
take 32 minutes and do not use a full core CPU time is roughly 1/3 the total time. I have been reading here about newer Lunatics AP's and MB's needing a full core for ATI but I will experiment with a stock AP and anonymous MB's
for the HD7950 as I did for the GTX660 I have been running for several months now.

Now I need to find that post on how to do it.

How to do what - free up a core? Go to settings and change 'on multiprocessors use at most x% of processors' to a suitable value (e.g. 80/90 for 6/7 out of 8 cores respectively) If you have local preferences, change the value there.

Thanks William. I changed the local pref to 80 and have 6 cores running now. I take it I can scale that up to get 7 running by going to 85% ?

Not quite - 7/8ths of the available cores is 87.5%, so you need that figure or higher. That's why William suggested 90, as an easy figure - or you could use 88, then your fingers don't have to move so far.

Thanks Richard, I will try 88% and see what happens.
Will freeing up a core help my GTS 250 any? Im running lunatics on that machine.
And while Im asking dumb questions, My I7 3770 with the 550TI does not have lunatics installed. When the day comes and they get the go ahead If I install them will I loose crunching AP on a GPU?
____________

Old James

Profile WilliamProject donor
Volunteer tester
Avatar
Send message
Joined: 14 Feb 13
Posts: 1602
Credit: 9,469,122
RAC: 258
Message 1359805 - Posted: 22 Apr 2013, 12:59:19 UTC - in response to Message 1359798.

Thanks Richard, I will try 88% and see what happens.
Will freeing up a core help my GTS 250 any? Im running lunatics on that machine.
And while Im asking dumb questions, My I7 3770 with the 550TI does not have lunatics installed. When the day comes and they get the go ahead If I install them will I loose crunching AP on a GPU?

Depends on the day ;)

Out of the box, the v0.40 installer doesn't include the OpenCL AP for NV app.
It would need to be (semi-)manually added.

If you wait for the next installer (after V7 release), that one is planned to contain all latest releases, including OpenCL AP for NV.
____________
A person who won't read has no advantage over one who can't read. (Mark Twain)

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1359813 - Posted: 22 Apr 2013, 13:05:44 UTC - in response to Message 1359805.

Thanks Richard, I will try 88% and see what happens.
Will freeing up a core help my GTS 250 any? Im running lunatics on that machine.
And while Im asking dumb questions, My I7 3770 with the 550TI does not have lunatics installed. When the day comes and they get the go ahead If I install them will I loose crunching AP on a GPU?

Depends on the day ;)

Out of the box, the v0.40 installer doesn't include the OpenCL AP for NV app.
It would need to be (semi-)manually added.

If you wait for the next installer (after V7 release), that one is planned to contain all latest releases, including OpenCL AP for NV.

Thanks William, I can wait for the one with all the bells and whistles.
____________

Old James

Filipe
Send message
Joined: 12 Aug 00
Posts: 111
Credit: 4,106,573
RAC: 434
Portugal
Message 1359925 - Posted: 22 Apr 2013, 17:31:56 UTC
Last modified: 22 Apr 2013, 17:36:08 UTC

James, how much faster are running the Ap's now with one free core?

William. How many time for the V7 release? +/- Weeks?
____________

Profile WilliamProject donor
Volunteer tester
Avatar
Send message
Joined: 14 Feb 13
Posts: 1602
Credit: 9,469,122
RAC: 258
Message 1360279 - Posted: 23 Apr 2013, 10:39:44 UTC - in response to Message 1359925.

William. How many time for the V7 release? +/- Weeks?

No idea. That is entirely up to Eric - when he believes that the applications have been tested enough and the whole system is sound.
Also provided no further problems with apps are spotted that would lead to a fresh round of testing.
Currently a major problem is to get the scheduler to deliver the best CUDA app to the host. So 'not ready yet'
Anyway anybody running stock will just start processing the new tasks.
____________
A person who won't read has no advantage over one who can't read. (Mark Twain)

Profile James Sotherden
Avatar
Send message
Joined: 16 May 99
Posts: 8835
Credit: 34,936,179
RAC: 58,458
United States
Message 1360299 - Posted: 23 Apr 2013, 12:14:26 UTC - in response to Message 1359925.

James, how much faster are running the Ap's now with one free core?

William. How many time for the V7 release? +/- Weeks?



Total time to run is about 2 hours and 55 minutes. So I saved an hour by going to 7 cores.
I dont overclock or run more than one WU on the GPU. Yet anyway. I will ask how to do that when I feel more at ease with tweaking settings. I really need to read my ASUS motherboard manual.

One thing that is strange since running Ap's on the gpu is the temps. Im reading 55 C. doing an Ap and 63 C. when I run a regular work unit.
____________

Old James

Profile SliverProject donor
Avatar
Send message
Joined: 18 May 11
Posts: 281
Credit: 7,189,948
RAC: 4,372
United States
Message 1360444 - Posted: 24 Apr 2013, 1:55:39 UTC

And the shorty storm continues.
____________

zoom314Project donor
Avatar
Send message
Joined: 30 Nov 03
Posts: 46393
Credit: 36,742,344
RAC: 4,899
United States
Message 1360445 - Posted: 24 Apr 2013, 1:56:54 UTC - in response to Message 1360444.

Anti shorty guns powered down, shields are holding...
____________
My Facebook, War Commander, 2015

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5831
Credit: 59,448,548
RAC: 47,826
Australia
Message 1360534 - Posted: 24 Apr 2013, 7:08:03 UTC - in response to Message 1360445.


And the splitters are still unable to keep up their production. Rgeardless of the number of shorties, they have been able to sustain 50/s+ in the past even when there were shorties going through the system.
For some reason though they haven't been up to the job for over a week.


And i noticed yet another download record on the Cricket Graphs- 662Mb/s after the outage.
____________
Grant
Darwin NT.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 22 · Next

Message boards : Number crunching : Panic Mode On (83) Server Problems?

Copyright © 2014 University of California