Panic Mode On (113) Server Problems?

Message boards : Number crunching : Panic Mode On (113) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 37 · Next

AuthorMessage
Profile B. Ahmet KIRAN

Send message
Joined: 19 Oct 14
Posts: 77
Credit: 36,140,903
RAC: 140
Turkey
Message 1959448 - Posted: 10 Oct 2018, 4:01:13 UTC
Last modified: 10 Oct 2018, 4:03:44 UTC

Even posting messages seems to have problems
ID: 1959448 · Report as offensive
Profile B. Ahmet KIRAN

Send message
Joined: 19 Oct 14
Posts: 77
Credit: 36,140,903
RAC: 140
Turkey
Message 1959449 - Posted: 10 Oct 2018, 4:02:08 UTC

I expect a new Maintenance shutdown very soon... None of the major functions are working (except message boards maybe) and system has been turned on for what purposes it is not clear... Completed tasks has reached over 1000 now which was normally around 2~3~4 hundred at the max... No new tasks, and the credit function(s) has frozen....
ID: 1959449 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1959450 - Posted: 10 Oct 2018, 4:09:03 UTC - in response to Message 1959441.  
Last modified: 10 Oct 2018, 4:28:41 UTC

Reporting doesn't work ATM, my guess the servers are getting hammered.


. . Still not working for me, I keep getting message that the servers are down :(

Stephen

:(

. . this is on top of I had to shut the whole shebang down for 3 hours because a massive electrical storm came over ... :(

. . Damn, it's looking like I may not have shut down early enough. I cannot boot the new system into Windows, I seem to have lost the SSD drive :(



.
ID: 1959450 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959451 - Posted: 10 Oct 2018, 4:15:14 UTC
Last modified: 10 Oct 2018, 4:16:40 UTC

Server Status page slows mostly green, but still unable to contact the Scheduler.

Edit- and the forums are very, very, very, very slow.
Grant
Darwin NT
ID: 1959451 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1959452 - Posted: 10 Oct 2018, 4:31:46 UTC - in response to Message 1959451.  

The only thing working is the website and that very slowly. Absolutely no luck in contacting the servers.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1959452 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959454 - Posted: 10 Oct 2018, 4:47:26 UTC

Scheduler requests have gone from "Couldn't connect to server" to "HTTP internal server error" through to "HTTP service unavailable" then back to "HTTP internal server error."
Grant
Darwin NT
ID: 1959454 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1959455 - Posted: 10 Oct 2018, 4:50:48 UTC - in response to Message 1959452.  

The only thing working is the website and that very slowly. Absolutely no luck in contacting the servers.

Yep
ID: 1959455 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1959458 - Posted: 10 Oct 2018, 5:00:35 UTC

I'm finally able to contact the Server, but, all I'm getting is 'No tasks available' Most of the stats on the SSP are still 12 hours old and nothing is able to touch the RTS.
ID: 1959458 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1959459 - Posted: 10 Oct 2018, 5:05:14 UTC

With a bit of prodding, I can upload and report work, and perform a scheduler request for new work.
However, no work is reported back as available, and SSP status remains 12 hrs behind.
Looks like it did not come up cleanly after the outage.
ID: 1959459 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959461 - Posted: 10 Oct 2018, 5:13:04 UTC - in response to Message 1959458.  
Last modified: 10 Oct 2018, 5:14:03 UTC

I'm finally able to contact the Server

You're doing better than I am then.
It seems to have settled on "HTTP internal server error" for any requests I make.

Hang on, I just got a "Couldn't connect to server" for something different.
Usually a Scheduler request takes 3 seconds, these are taking 1-2 minutes to get those non-responses.
Things are very, very broken.
Grant
Darwin NT
ID: 1959461 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65745
Credit: 55,293,173
RAC: 49
United States
Message 1959465 - Posted: 10 Oct 2018, 5:20:50 UTC - in response to Message 1959452.  

The only thing working is the website and that very slowly. Absolutely no luck in contacting the servers.

I think molasses going uphill in a hail storm on February 30th would be quicker.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1959465 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1959473 - Posted: 10 Oct 2018, 7:50:15 UTC

SSP's still hosed, but I'm starting to get work again.
Looks like just a long recovery that it may be able to work through ...
ID: 1959473 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1959474 - Posted: 10 Oct 2018, 7:53:47 UTC

Reports of completed tasks seem to be being accepted and processed at normal speed now - worth reporting any surplus (in smaller batches) with 'No New Tasks' set to clear things out without stressing the server more than necessary. I doubt there's any new work available anyway, with the SSP in the state it's in.
ID: 1959474 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959475 - Posted: 10 Oct 2018, 7:55:37 UTC - in response to Message 1959473.  
Last modified: 10 Oct 2018, 8:00:35 UTC

SSP's still hosed, but I'm starting to get work again.

Not here, but now Scheduler requests are at least going through and getting a valid response (30sec to 1min- a bit longer than the usual 3 seconds, but at least something's going through now).
And that response- "Project has no tasks available."

At least there are some signs of life.


Edit- as the results are being returned, the time it takes the Scheduler to respond is improving on each subsequent request.
And the forums are responding in a timely manner now as well.
Grant
Darwin NT
ID: 1959475 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1959477 - Posted: 10 Oct 2018, 8:23:35 UTC

As I type there is almost 1.3 million ready to be sent. I cannot recall ever seeing the RTS been this high
ID: 1959477 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65745
Credit: 55,293,173
RAC: 49
United States
Message 1959478 - Posted: 10 Oct 2018, 8:40:53 UTC

I'm down to 4wu's, of those, 2 will be uploading in about 5mins, the other 2 in about 22 mins.

I did a test with 3wu's at a time here, 5 completed in about 29-30mins each, My earlier recollection of 1wu at a time was off by about a min, instead of 11 it's more like 12:38 but was only on 2wu's right before I switched to 2wu. Not the most powerful card I admit, but it's ok.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1959478 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959480 - Posted: 10 Oct 2018, 8:50:55 UTC
Last modified: 10 Oct 2018, 9:05:27 UTC

Ok, Server Status page is updating again (all bar a couple of values), and Scheduler requests are still completing successfully.

Now if only I could get some of that work instead of "Project has no tasks available" messages...


And it appears the Assimilator backlog not only hasn't been cleared, but continues to grow as work is returned & validated. At what point will it run out of disk space & everything grind to another halt?
Grant
Darwin NT
ID: 1959480 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1959484 - Posted: 10 Oct 2018, 9:07:20 UTC

Splitters are throttled back, and my caches are full-up.
Not sure I'm really believing what I saw when the SSP said the splitters were doing 371/sec, but a million plus RTS is impressive if true.
ID: 1959484 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1959487 - Posted: 10 Oct 2018, 9:29:30 UTC - in response to Message 1959484.  

my caches are full-up.

I wish.
I've picked up some work, and naturally the faster system got the least.
But the usual response is "Project has no tasks available." Over & over & over again.

I don't know why the outage was so long, nor the recovery so long, but things are still very much borked.
Grant
Darwin NT
ID: 1959487 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1959488 - Posted: 10 Oct 2018, 9:54:17 UTC - in response to Message 1959487.  

I don't know why the outage was so long, nor the recovery so long, but things are still very much borked.

Luck of the draw, I'm guessing, as the SSP says more than 200k units were sent out in the last 40 minutes or so.
ID: 1959488 · Report as offensive
Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 37 · Next

Message boards : Number crunching : Panic Mode On (113) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.