Panic Mode On (105) Server Problems?

Message boards : Number crunching : Panic Mode On (105) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 34 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13733
Credit: 208,696,464
RAC: 304
Australia
Message 1857709 - Posted: 26 Mar 2017, 18:21:17 UTC - in response to Message 1857643.  
Last modified: 26 Mar 2017, 18:21:35 UTC

I see the web site is back, as well as the server status data; the graphs are updating again.
Grant
Darwin NT
ID: 1857709 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1857712 - Posted: 26 Mar 2017, 18:36:58 UTC - in response to Message 1857643.  

You missed all of the fights and (intoxicated) slurs over on the BOINC forums. Well, or not, of course. :)

At least he didn't go into a total meltdown.
ID: 1857712 · Report as offensive
Mark Stevenson Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 8 Sep 11
Posts: 1736
Credit: 174,899,165
RAC: 91
United Kingdom
Message 1857718 - Posted: 26 Mar 2017, 19:15:38 UTC - in response to Message 1857715.  
Last modified: 26 Mar 2017, 19:17:12 UTC

This site will crash again pretty soon.
No doubt about that.
More tea thank you...burp...


That's a givin ain't it nothing's 100% reliable , seti website will " Go down " again and work will either keep flowing like this time or stop , or maybe even be intermittant , one thing i do know is the " real " world will continue and events happen that are far more important than a website / project :-)

So shal it be :-)

( ohh poo that's blasphomy what i just posted bug#er ;-) )
Life is what you make of it :-)

When i'm good i'm very good , but when i'm bad i'm shi#eloads better ;-) In't I " buttercups " p.m.s.l at authoritie !!;-)
ID: 1857718 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1857719 - Posted: 26 Mar 2017, 19:15:49 UTC

Wasn't expecting it to be back any time today tbh, so the person/s that did it early on a Sunday morning should be thanked :-)
ID: 1857719 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1857735 - Posted: 26 Mar 2017, 21:29:35 UTC

Just for grins, based on the stated times for running 100 WUs on GPUs up thread, I have decided to try an experiment on my test cruncher Sabertooth to see if in fact I get about the same RAC using 1 WU/GPU instead of the current 3/GPU (It's running 1 GTX 980 and 1 GTX 1080). I should be able to get a real sense of this in about 24 hours. I made the change a few minutes ago.

At present, the only thing I can see in in SIV, which showed the GPUs as running around a steady 95% GPU utilization with 3 WUs, and is now showing them at ~60-80% and highly variable . Don't know what that really implies going forward, but lets find out what happens to the RAC.
ID: 1857735 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1668
Credit: 623,086,772
RAC: 156
Finland
Message 1857737 - Posted: 26 Mar 2017, 21:36:32 UTC - in response to Message 1857479.  

How many hours does it take for a GTX 1080 to go trough the 100WU limit?


My GTX1080 does guppi vlar in 150 seconds and a shortie in 46 seconds so a 100 of them would take 4600 - 15000 seconds (1hr 17 min - 4hr 10min).
My GTX1080Ti does guppi vlar in 110 seconds and a shortie in 37 seconds so a 100 of them would take 3700 - 11000 seconds (1hr 2 min - 3hr 4min).

Petri
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1857737 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1857745 - Posted: 26 Mar 2017, 22:03:53 UTC

I found several hundreds of teams and user profiles with spam in them, varying from pornography through illegal download torrents to (online) casinos. Having that in the database couldn't have made it easier to load either, especially not if these were linked to and read by thousands from outside. There is a script running in the background now ridding the database of all that crud, which is causing some slowdowns here as it's quite resource intensive.
ID: 1857745 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1857747 - Posted: 26 Mar 2017, 22:14:14 UTC - in response to Message 1857745.  

There is a script running in the background now ridding the database of all that crud, which is causing some slowdowns here as it's quite resource intensive.

Excellent.
ID: 1857747 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1857759 - Posted: 26 Mar 2017, 22:47:06 UTC

+1
ID: 1857759 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857768 - Posted: 26 Mar 2017, 23:34:59 UTC - in response to Message 1857735.  

Just for grins, based on the stated times for running 100 WUs on GPUs up thread, I have decided to try an experiment on my test cruncher Sabertooth to see if in fact I get about the same RAC using 1 WU/GPU instead of the current 3/GPU (It's running 1 GTX 980 and 1 GTX 1080). I should be able to get a real sense of this in about 24 hours. I made the change a few minutes ago.

At present, the only thing I can see in in SIV, which showed the GPUs as running around a steady 95% GPU utilization with 3 WUs, and is now showing them at ~60-80% and highly variable . Don't know what that really implies going forward, but lets find out what happens to the RAC.


. . I would expect the RAC to decrease from the usage figures you have said. What crunching app are you running ??

. . I find that with SoG r3557 I am getting near 99 percent usage running doubles (on a GTX950 in an i5 rig with sleep ON). As the SoG apps have been developed they have become more and more efficient requiring less concurrent tasks to achieve near full GPU utilisation. Most guys achieving high utilisation running singles also run with sleep OFF and have a CPU core dedicated to each task. I don't know if that can help you at all, but I thought I would raise the point :)

Stephen

.
ID: 1857768 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1857775 - Posted: 27 Mar 2017, 0:00:25 UTC - in response to Message 1857768.  
Last modified: 27 Mar 2017, 0:01:09 UTC

Am running Beta 6 SoG.

I have run with sleep off for quite a while now, as I found that the CPU usage accompanying GPU WUs was basically bogus before making the change. That is, with sleep off my CPU usage/WU is <20% for Arecibo, and ~30% for GBT, as opposed to ~100% without it, and that completion times are about the same - BUT I can run a couple of more CPU threads now because of the more available CPU time.
ID: 1857775 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1857787 - Posted: 27 Mar 2017, 0:43:38 UTC
Last modified: 27 Mar 2017, 0:44:42 UTC

Use_sleep with a 1080?? I would drop that and use -hp instead. You have to remember that a 5% increase in GPU times will be more than your entire CPU can do for RAC.

EDIT: And I would update to r3584 as well.
ID: 1857787 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1857789 - Posted: 27 Mar 2017, 0:57:27 UTC - in response to Message 1857787.  

Use_sleep with a 1080?? I would drop that and use -hp instead. You have to remember that a 5% increase in GPU times will be more than your entire CPU can do for RAC.

EDIT: And I would update to r3584 as well.


1) I am running dual 8 core E5-2670s, so 32 threads. Considering the GPU threads, actually running 24 or 25 CPU threads on my 2 main crunchers, and they come close to ~1 GPU. Or at least not completely left in the dust like a desktop CPU would be.

2) As far as R3584 goes, I am loathe to do anything not in stock or Lunatics, since it is so easy to screw up the app_info.

3) use_sleep seems to work fine for me, as I mentioned above.
ID: 1857789 · Report as offensive
EdwardPF
Volunteer tester

Send message
Joined: 26 Jul 99
Posts: 389
Credit: 236,772,605
RAC: 374
United States
Message 1857791 - Posted: 27 Mar 2017, 1:09:43 UTC - in response to Message 1857789.  

2) As far as R3584 goes, I am loathe to do anything not in stock or Lunatics, since it is so easy to screw up the app_info.


Tisk ... me too ... I still have "ghosts" out there from the (next to) last time I tried. The last time I got no ghosts ...'cause there were no WU's in (anybodies) queue ...

EdF
ID: 1857791 · Report as offensive
Profile Chris904395093209d Project Donor
Volunteer tester

Send message
Joined: 1 Jan 01
Posts: 112
Credit: 29,923,129
RAC: 6
United States
Message 1857797 - Posted: 27 Mar 2017, 2:10:04 UTC - in response to Message 1857745.  

There is a script running in the background now ridding the database of all that crud, which is causing some slowdowns here as it's quite resource intensive.


Glad to hear the script is running to get rid of the crud. Sounds like some house cleaning will do a lot of good.
~Chris

ID: 1857797 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857799 - Posted: 27 Mar 2017, 2:39:05 UTC - in response to Message 1857775.  

Am running Beta 6 SoG.

I have run with sleep off for quite a while now, as I found that the CPU usage accompanying GPU WUs was basically bogus before making the change. That is, with sleep off my CPU usage/WU is <20% for Arecibo, and ~30% for GBT, as opposed to ~100% without it, and that completion times are about the same - BUT I can run a couple of more CPU threads now because of the more available CPU time.


. . How strange, that is the complete opposite of my experience. With sleep ON under SoG r3554 on the i5 with GTX950, and previously on the Core2 Duo with the GYX1050ti, I was/am able to run multiple WUs per GPU and only need to allocate a single CPU core. ON my rig with the 1060s I was running SoG with sleep OFF and I could only run singles as each GPU WU was taking a whole CPU core. Now I am running Linux and CUDA80 on the latter 2 machines and that is singles only regardless. And I wouldn't have it any other way :)

. . But I agree that the completion times do not vary much between the two options.

Stephen

.
ID: 1857799 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1857800 - Posted: 27 Mar 2017, 2:42:22 UTC - in response to Message 1857787.  

Use_sleep with a 1080?? I would drop that and use -hp instead. You have to remember that a 5% increase in GPU times will be more than your entire CPU can do for RAC.

EDIT: And I would update to r3584 as well.


. . I would use r3584 too if there was a Lunatics release with it included. I am loathe to attempt editing app_info.xml manually, I have heard too many scary stories.

. . Stephen

.
ID: 1857800 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1857801 - Posted: 27 Mar 2017, 2:48:10 UTC - in response to Message 1857789.  

Use_sleep with a 1080?? I would drop that and use -hp instead. You have to remember that a 5% increase in GPU times will be more than your entire CPU can do for RAC.

EDIT: And I would update to r3584 as well.


1) I am running dual 8 core E5-2670s, so 32 threads. Considering the GPU threads, actually running 24 or 25 CPU threads on my 2 main crunchers, and they come close to ~1 GPU. Or at least not completely left in the dust like a desktop CPU would be.

2) As far as R3584 goes, I am loathe to do anything not in stock or Lunatics, since it is so easy to screw up the app_info.

3) use_sleep seems to work fine for me, as I mentioned above.

The current stock NV & ATI apps are r3584.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1857801 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1857821 - Posted: 27 Mar 2017, 4:12:34 UTC



The current stock NV & ATI apps are r3584.

But with crappy CPU apps which offset the r3584 gains.

OTOH Lunatics Beta 6 installer uses the slightly older GPU r3557 app which is kilometres better than any of the older SoG apps (which were quite frankly crappy and invalid prone) and only a millimetre short of the current r3584 app (without invalids), but with kilometres better CPU apps, and most of us would rather wait for the next Lunatics Installer to correct that instead of trying to jump through hoops and trashing work trying to alter our app_info.xml to suit the r3584 app.

Suitable horses for suitable courses and K.I.S.S. comes into play here as well HAL. ;-)

Cheers.
ID: 1857821 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13733
Credit: 208,696,464
RAC: 304
Australia
Message 1857850 - Posted: 27 Mar 2017, 7:05:03 UTC - in response to Message 1857735.  
Last modified: 27 Mar 2017, 7:06:10 UTC

At present, the only thing I can see in in SIV, which showed the GPUs as running around a steady 95% GPU utilization with 3 WUs, and is now showing them at ~60-80% and highly variable .

Using GPUz my GTX 1070s show 90-95% GPU load with 70-90% Memory Controller load (some drops down to 20% depending on where it is in the WU) and Bus Interface load generally around 18% and Power Consumption around 62% running just 1WU at a time.
Running SoG with aggressive settings and 1 CPU core reserved per WU.
Grant
Darwin NT
ID: 1857850 · Report as offensive
Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 34 · Next

Message boards : Number crunching : Panic Mode On (105) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.