The Server Issues / Outages Thread - Panic Mode On! (117)

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 34 · 35 · 36 · 37 · 38 · 39 · 40 . . . 52 · Next

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2022540 - Posted: 9 Dec 2019, 22:38:11 UTC - in response to Message 2022529.  

People react to what they see, not what they're told, I believe.
I think that's right. People have lost a lot of their curiosity: "How does this thing work?"

If there's a button, they'll push it. If there's a knob, they'll twist it. But comprehension? nah.

Just watch the kids in any 'interactive' museum.
ID: 2022540 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24912
Credit: 3,081,182
RAC: 7
Ireland
Message 2022541 - Posted: 9 Dec 2019, 22:44:57 UTC - in response to Message 2022540.  

Just watch the kids in any 'interactive' museum.
LOL. Just watched 7 of them live on the BBC.
ID: 2022541 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022543 - Posted: 9 Dec 2019, 23:06:59 UTC - in response to Message 2022524.  

Current result creation rate **	0/sec	0/sec	0/sec	5m


Panic mode ON?

<edit> Never mind, it's back now.


. . The adrenaline rush of fear and panic has passed??

Stephen

:)
ID: 2022543 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1856
Credit: 268,616,081
RAC: 1,349
United States
Message 2022564 - Posted: 10 Dec 2019, 0:30:37 UTC - in response to Message 2022540.  

People react to what they see, not what they're told, I believe.
I think that's right. People have lost a lot of their curiosity: "How does this thing work?"

Can't remember the exact Heinlein quote, but it goes something along the lines that at some point, to the vast unwashed masses, technology is little different than magic.
One of the great successes is that technology has become in general so easy, and bullet-proof, that little understanding is required. Also a great failure.
ID: 2022564 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3806
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2022565 - Posted: 10 Dec 2019, 0:31:59 UTC - in response to Message 2022564.  

"Any sufficiently advanced technology is indistinguishable from magic" perhaps?
ID: 2022565 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1856
Credit: 268,616,081
RAC: 1,349
United States
Message 2022568 - Posted: 10 Dec 2019, 0:35:14 UTC - in response to Message 2022565.  

"Any sufficiently advanced technology is indistinguishable from magic" perhaps?

that
ID: 2022568 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022571 - Posted: 10 Dec 2019, 0:47:18 UTC - in response to Message 2022565.  

"Any sufficiently advanced technology is indistinguishable from magic" perhaps?


. . that sounds familiar :)

Stephen
ID: 2022571 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022573 - Posted: 10 Dec 2019, 0:49:57 UTC

. . It seems the boffins have decided that 400/GPU was too high and they seem to have rolled it back, to perhaps 300 I am guessing, as my work requests for GPU tasks are all being met with 'you have reached the limit'. My CPUs are still getting 200 WUs.

Stephen

? ?
ID: 2022573 · Report as offensive
Kiska
Volunteer tester

Send message
Joined: 31 Mar 12
Posts: 302
Credit: 3,067,762
RAC: 0
Australia
Message 2022600 - Posted: 10 Dec 2019, 6:38:42 UTC - in response to Message 2022486.  

Looking at Kiska's RTS graph, it's very striking how quickly RTS dropped on Friday night. That says a lot of hosts were set to cache more than they were allowed, and might have been hammering on the server doors all this time.

That might, paradoxically, make the server load lighter in the future, once we've filled everyone up.


Zoomed in :D
ID: 2022600 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2022607 - Posted: 10 Dec 2019, 8:37:43 UTC - in response to Message 2022565.  

"Any sufficiently advanced technology is indistinguishable from magic" perhaps?
That was Arthur C. Clarke - also known as 'Clarke's Third Law'.
ID: 2022607 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 2022609 - Posted: 10 Dec 2019, 8:54:50 UTC - in response to Message 2022573.  

. . It seems the boffins have decided that 400/GPU was too high and they seem to have rolled it back, to perhaps 300 I am guessing, as my work requests for GPU tasks are all being met with 'you have reached the limit'. My CPUs are still getting 200 WUs.
That would explain the drop in Results-in-out-in-the-field. It had hit 7.22 Million, and was still climbing when it then started to fall. Seems to have levelled off at around 7 million for now.
Grant
Darwin NT
ID: 2022609 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 2022612 - Posted: 10 Dec 2019, 9:56:53 UTC
Last modified: 10 Dec 2019, 10:20:59 UTC

Not a good sign before the weekly outage- Last couple of Scheduler requests have resulted in "Project has no tasks available" messages.


Edit-
2nd last request took 20 seconds to get a response from the Scheduler. Usually it's around 3 secs.
Last request took around 5 sec & picked up 5 WUs, so about 35 short of present limits...

In the same period, the Windows host has only had one "Project has no tasks available" response.

Edit- it's looking like the request that resulted in work was just a glitch.
And the Windows system is now getting more frequent "Project has no tasks available messages", but is still mostly getting work (for now).
Grant
Darwin NT
ID: 2022612 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2022613 - Posted: 10 Dec 2019, 9:58:34 UTC - in response to Message 2022612.  

Same here. Curious, when RTS is high, splitting is fast, and host is nowhere near any conceivable limit.
ID: 2022613 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13854
Credit: 208,696,464
RAC: 304
Australia
Message 2022615 - Posted: 10 Dec 2019, 10:15:35 UTC
Last modified: 10 Dec 2019, 10:28:32 UTC

Results-received-in-last-hour was over 160k for a while there, and is still over 157k. Maybe that's causing things to choke up?
At least the lack of work going out is helping the Ready-to-send buffer to refill….


Edit-
Scheduler is now giving out work again.
Panic over (till the next one).
Grant
Darwin NT
ID: 2022615 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022622 - Posted: 10 Dec 2019, 12:47:26 UTC - in response to Message 2022609.  

. . It seems the boffins have decided that 400/GPU was too high and they seem to have rolled it back, to perhaps 300 I am guessing, as my work requests for GPU tasks are all being met with 'you have reached the limit'. My CPUs are still getting 200 WUs.
That would explain the drop in Results-in-out-in-the-field. It had hit 7.22 Million, and was still climbing when it then started to fall. Seems to have levelled off at around 7 million for now.


. . It's good to see them react promptly with a compromise to preserve the stabilty of the system.

Stephen

:)
ID: 2022622 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 31009
Credit: 53,134,872
RAC: 32
United States
Message 2022644 - Posted: 10 Dec 2019, 16:02:06 UTC

Late start
ID: 2022644 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 2022655 - Posted: 10 Dec 2019, 22:13:50 UTC

and we are back...
ID: 2022655 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2022671 - Posted: 10 Dec 2019, 23:27:29 UTC

Gonna be a challenge getting through I think. HTTP internal server errors as all the semi-empty hosts hammer the servers trying to report work.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2022671 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5126
Credit: 276,046,078
RAC: 462
Message 2022675 - Posted: 11 Dec 2019, 0:11:44 UTC - in response to Message 2022565.  

"Any sufficiently advanced technology is indistinguishable from magic" perhaps?


I thought that was an Clarke "rule".... though it is perfectly reasonable that Heinlein or Asimov could have spoke it too.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2022675 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2022676 - Posted: 11 Dec 2019, 0:12:13 UTC - in response to Message 2022671.  

Gonna be a challenge getting through I think. HTTP internal server errors as all the semi-empty hosts hammer the servers trying to report work.


. . Even with max reported tasks set to 64 I was getting http: internal errors and 'unable to connect to server' errors ...

. . But the last machine seems to be reporting OK now ...

Stephen

:(
ID: 2022676 · Report as offensive
Previous · 1 . . . 34 · 35 · 36 · 37 · 38 · 39 · 40 . . . 52 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.