Panic Mode On (114) Server Problems?

Message boards : Number crunching : Panic Mode On (114) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 16 · 17 · 18 · 19 · 20 · 21 · 22 . . . 45 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1972525 - Posted: 29 Dec 2018, 18:58:54 UTC - in response to Message 1972519.  

Wonder if the stumbling servers will pick themselves off the floor on their own again. Seems that whenever some script runs in the background to clean up the backlogs, the scheduler goes missing.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1972525 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1972540 - Posted: 29 Dec 2018, 20:27:30 UTC
Last modified: 29 Dec 2018, 21:25:12 UTC

Splitters may be running, but their output is less than the demand.
Ready-to-send buffer continues to empty, just not as quickly as it was.

Edit- looks like the splitters have finally fully recovered. Ready-to-send buffer is re-filling again.
Grant
Darwin NT
ID: 1972540 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1972714 - Posted: 31 Dec 2018, 0:53:02 UTC

Here we go again.
Forums barely functional, Scheduler not responding.
31/12/2018 10:11:55 | SETI@home | Project has no tasks available
31/12/2018 10:17:44 | SETI@home | Scheduler request failed: Failure when receiving data from the peer
31/12/2018 10:21:25 | SETI@home | Scheduler request failed: HTTP service unavailable
Grant
Darwin NT
ID: 1972714 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1972723 - Posted: 31 Dec 2018, 1:40:09 UTC

Been an hour since status update. Time to panic (small p panic as it has only been an hour). It is 5:40pm on Sunday in California.
ID: 1972723 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1972724 - Posted: 31 Dec 2018, 1:50:34 UTC - in response to Message 1972714.  

Here we go again.
Forums barely functional, Scheduler not responding.
31/12/2018 10:11:55 | SETI@home | Project has no tasks available
31/12/2018 10:17:44 | SETI@home | Scheduler request failed: Failure when receiving data from the peer
31/12/2018 10:21:25 | SETI@home | Scheduler request failed: HTTP service unavailable

Yep
ID: 1972724 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1972726 - Posted: 31 Dec 2018, 1:59:36 UTC - in response to Message 1972724.  

Here we go again.
Forums barely functional, Scheduler not responding.
31/12/2018 10:11:55 | SETI@home | Project has no tasks available
31/12/2018 10:17:44 | SETI@home | Scheduler request failed: Failure when receiving data from the peer
31/12/2018 10:21:25 | SETI@home | Scheduler request failed: HTTP service unavailable

Yep
+1
ID: 1972726 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1972730 - Posted: 31 Dec 2018, 2:35:42 UTC - in response to Message 1972728.  

I believe these big lags started when they brought the replica database back online.
Since then it seems the main database has troubles under high loads when whatever script runs.
My thought anyways ...
ID: 1972730 · Report as offensive
Profile Chris904395093209d Project Donor
Volunteer tester

Send message
Joined: 1 Jan 01
Posts: 112
Credit: 29,923,129
RAC: 6
United States
Message 1972736 - Posted: 31 Dec 2018, 2:54:54 UTC

Don't see this everyday:

Results ready to send 860,844
Current result creation rate 377.8151/sec
~Chris

ID: 1972736 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1972751 - Posted: 31 Dec 2018, 3:46:29 UTC

Yes I too believe the lags started with the replica being brought back. I wondered if the reason it went missing in the first place was because they felt the I/O to the replica was slowing down the main database insertions. Possibly that was the reason the replica was turned off.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1972751 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1972834 - Posted: 31 Dec 2018, 18:07:28 UTC

I'm really not sure if I should report these hiccups as a panic issue. I don't know if they resolve themselves or need human intervention. I can wait patiently if this is the new normal, but I just don't know if it is.
ID: 1972834 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11361
Credit: 29,581,041
RAC: 66
United States
Message 1972835 - Posted: 31 Dec 2018, 18:11:10 UTC

The boards are getting laggy
ID: 1972835 · Report as offensive
Profile Freewill Project Donor
Avatar

Send message
Joined: 19 May 99
Posts: 766
Credit: 354,398,348
RAC: 11,693
United States
Message 1972836 - Posted: 31 Dec 2018, 18:32:19 UTC

Cannot get any jobs now for several tries...time to panic.
ID: 1972836 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1972839 - Posted: 31 Dec 2018, 18:46:14 UTC

It's starting to clear up, just got a good handful of new tasks.
Might take a while to catch up again.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1972839 · Report as offensive
Profile Freewill Project Donor
Avatar

Send message
Joined: 19 May 99
Posts: 766
Credit: 354,398,348
RAC: 11,693
United States
Message 1972841 - Posted: 31 Dec 2018, 18:49:20 UTC - in response to Message 1972839.  

Yes, I finally did, as well. Still seems shaky going into a holiday and this special sauce linux app chews through jobs like a buzz saw. :)
ID: 1972841 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1972844 - Posted: 31 Dec 2018, 19:32:32 UTC - in response to Message 1972841.  

Yes, I finally did, as well. Still seems shaky going into a holiday and this special sauce linux app chews through jobs like a buzz saw. :)


. . Yes. It does!

Stephen

:)
ID: 1972844 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1972849 - Posted: 31 Dec 2018, 21:18:56 UTC - in response to Message 1972844.  
Last modified: 31 Dec 2018, 21:42:41 UTC

Yes, I finally did, as well. Still seems shaky going into a holiday and this special sauce linux app chews through jobs like a buzz saw. :)


. . Yes. It does!

Stephen

:)

What great news in the eyes of science. I think there is an experimental application for windows. I haven't heard when it will be in production I wish there was such a application to run on Windows. I am aware that you can do it virtually on Linux but it's not the same in my opinion
ID: 1972849 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1972925 - Posted: 1 Jan 2019, 5:26:26 UTC

Happy New Year.

ID: 1972925 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1972936 - Posted: 1 Jan 2019, 9:22:00 UTC - in response to Message 1972925.  

Happy New Year.


+1
A proud member of the OFA (Old Farts Association).
ID: 1972936 · Report as offensive
puh32

Send message
Joined: 8 Oct 99
Posts: 30
Credit: 4,746,631
RAC: 9
Sweden
Message 1973004 - Posted: 1 Jan 2019, 20:28:23 UTC

Out of curiosity regarding workunit 3224345143 (https://setiathome.berkeley.edu/workunit.php?wuid=3224345143)

minimum quorum 2
initial replication 2
19 Nov 2018, 14:50:31 UTC 21 Nov 2018, 3:50:28 UTC Completed, waiting for validation
19 Nov 2018, 14:50:42 UTC 19 Nov 2018, 14:53:13 UTC Abandoned
19 Nov 2018, 19:20:11 UTC 19 Nov 2018, 20:27:25 UTC Completed, waiting for validation

What is it waiting for since 19 Nov? I suppose this means the workunit is broken one way or the other?
ID: 1973004 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1973005 - Posted: 1 Jan 2019, 20:34:08 UTC - in response to Message 1973004.  

Out of curiosity regarding workunit 3224345143 (https://setiathome.berkeley.edu/workunit.php?wuid=3224345143)

minimum quorum 2
initial replication 2
19 Nov 2018, 14:50:31 UTC 21 Nov 2018, 3:50:28 UTC Completed, waiting for validation
19 Nov 2018, 14:50:42 UTC 19 Nov 2018, 14:53:13 UTC Abandoned
19 Nov 2018, 19:20:11 UTC 19 Nov 2018, 20:27:25 UTC Completed, waiting for validation

What is it waiting for since 19 Nov? I suppose this means the workunit is broken one way or the other?
This happens regularly and should correct itself when the original report deadline of 11 Jan 2019, 19:50:13 UTC is reached.

Cheers.
ID: 1973005 · Report as offensive
Previous · 1 . . . 16 · 17 · 18 · 19 · 20 · 21 · 22 . . . 45 · Next

Message boards : Number crunching : Panic Mode On (114) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.