The Server Issues / Outages Thread - Panic Mode On! (117)


Advanced search

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · 31 · 32 . . . 52 · Next

AuthorMessage
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2018043 - Posted: 7 Nov 2019, 3:59:19 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0

Still nothing at Beta....
ID: 2018043 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2018047 - Posted: 7 Nov 2019, 5:46:47 UTC

And there's still a general post outage malaise with the Seti servers.
Grant
Darwin NT
ID: 2018047 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 2018055 - Posted: 7 Nov 2019, 11:47:38 UTC - in response to Message 2018043.  

There is now. :-)
ID: 2018055 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2018067 - Posted: 7 Nov 2019, 15:22:56 UTC - in response to Message 2017975.  

Still No Work at Beta. Tasks ready to send = 0


I finally got my latish model Android phone setup to crunch for Beta so someone hopefully could get us some updated tasks that would run on late model Androids.
Its been "waiting for work, nothing to do" for "several" days now.

Tom


Ah, now I see said the blind man. My late model Android phone blew through 99 beta site errors so the scheduler won't send me any more for a while. Maybe it will give the Android Dev something to change.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2018067 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2018085 - Posted: 7 Nov 2019, 19:28:03 UTC

The server status page is showing many processes disabled. Not sure what is going on.
ID: 2018085 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 2018086 - Posted: 7 Nov 2019, 19:28:22 UTC

Houston, we've had a problem ...
ID: 2018086 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 2018089 - Posted: 7 Nov 2019, 20:02:00 UTC

And we're back
ID: 2018089 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2018091 - Posted: 7 Nov 2019, 20:32:13 UTC - in response to Message 2018085.  
Last modified: 7 Nov 2019, 20:33:35 UTC

The server status page is showing many processes disabled. Not sure what is going on.


"'This must be Thursday,' said Arthur to himself, sinking low over his beer. 'I never could get the hang of Thursdays.'"
--- Douglas Adams, The The Hitchhiker's Guide to the Galaxy

(Or was it Thorsday?)
ID: 2018091 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2018096 - Posted: 7 Nov 2019, 21:49:16 UTC

The unplanned outage did not help the situation. The splitters are slow and the RTS is down to 68k. Hopefully everyone has full caches at the moment, and we will only get a depletion of our own caches and not a run dry situation. Since the system is working (though not optimally) I don't think there is much to do but muddle through and hope things get better.

I still think some longer lasting WUs would help.
ID: 2018096 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2018145 - Posted: 8 Nov 2019, 6:43:18 UTC

Looks like the file deleters have given up, and due to that backlog the splitters are struggling even more than they were just after the weekly outage.

Maybe time to see if the new upload server (and the other processes it runs) would help things out here on Main?
Grant
Darwin NT
ID: 2018145 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2018158 - Posted: 8 Nov 2019, 10:23:15 UTC
Last modified: 8 Nov 2019, 10:24:59 UTC

WU delete backlog continues to grown, and the splitter output has just taken a dive, but recovered back to it's better than zero output a few minutes later.
The noise bombs mixed in with the shorties certainly aren't helping things.
Grant
Darwin NT
ID: 2018158 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2018207 - Posted: 8 Nov 2019, 22:05:51 UTC

WU awaiting deletion continues to climb, but with the Return rate lower than it's been the splitters have been able to pump out a bit more work than they have been.
Grant
Darwin NT
ID: 2018207 · Report as offensive
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 715
Credit: 8,032,827
RAC: 62
France
Message 2018254 - Posted: 9 Nov 2019, 9:28:45 UTC
Last modified: 9 Nov 2019, 9:29:53 UTC

3649588606

8042499883	7019416	12 Sep 2019, 14:46:25 UTC	14 Sep 2019, 1:50:18 UTC Terminé et validé	2,208.81	322.94	66.57	SETI@home v8
Plateforme anonyme (GPU ATI)
8042499884	8813875	12 Sep 2019, 14:46:34 UTC	5 Nov 2019, 6:37:30 UTC	Terminé et validé	1,285.38	123.20	66.57	SETI@home v8 v8.00 (cuda42)
windows_intelx86
8201281661	8555278	5 Nov 2019, 0:11:05 UTC	      28 Dec 2019, 5:10:47 UTC	     En cours	   ---	---	---	SETI@home v8 v8.22 (opencl_ati5_SoG_cat132)
windows_intelx86



Wu validated but sent to third wingmen
ID: 2018254 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2018256 - Posted: 9 Nov 2019, 9:48:27 UTC - in response to Message 2018254.  

3649588606

8042499883	7019416	12 Sep 2019, 14:46:25 UTC	14 Sep 2019, 1:50:18 UTC Terminé et validé	2,208.81	322.94	66.57	SETI@home v8
Plateforme anonyme (GPU ATI)
8042499884	8813875	12 Sep 2019, 14:46:34 UTC	5 Nov 2019, 6:37:30 UTC	Terminé et validé	1,285.38	123.20	66.57	SETI@home v8 v8.00 (cuda42)
windows_intelx86
8201281661	8555278	5 Nov 2019, 0:11:05 UTC	      28 Dec 2019, 5:10:47 UTC	     En cours	   ---	---	---	SETI@home v8 v8.22 (opencl_ati5_SoG_cat132)
windows_intelx86



Wu validated but sent to third wingmen
Now this was your fault by returning that work unit late, Report deadline 4 Nov 2019, 19:46:16 UTC - Received 5 Nov 2019, 6:37:30 UTC, so by missing the deadline you triggered a resend. It's just a shame that that resend will gain no credit for that person.

Cheers.
ID: 2018256 · Report as offensive
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 715
Credit: 8,032,827
RAC: 62
France
Message 2018284 - Posted: 9 Nov 2019, 15:54:55 UTC

7019416 is my host ^^ received the 9-12 sent the 9-14 ;)
ID: 2018284 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2018295 - Posted: 9 Nov 2019, 18:38:35 UTC

I'm sorry, it was your wingman's fault, but you should understand now about what happens when someone returns after a deadline has passed.

Cheers.
ID: 2018295 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2018318 - Posted: 9 Nov 2019, 21:02:32 UTC

But no harm done. All received the same credit. Just a waste of processing time.

Task
click for details	Computer	Sent	Time reported
or deadline
explain	Status	Run time
(sec)	CPU time
(sec)	Credit	Application
8042499883	7019416	12 Sep 2019, 14:46:25 UTC	14 Sep 2019, 1:50:18 UTC	Completed and validated	2,208.81	322.94	66.57	SETI@home v8
Anonymous platform (ATI GPU)
8042499884	8813875	12 Sep 2019, 14:46:34 UTC	5 Nov 2019, 6:37:30 UTC	Completed and validated	1,285.38	123.20	66.57	SETI@home v8 v8.00 (cuda42)
windows_intelx86
8201281661	8555278	5 Nov 2019, 0:11:05 UTC	9 Nov 2019, 14:02:29 UTC	Completed and validated	1,976.42	397.70	66.57	SETI@home v8 v8.22 (opencl_ati5_SoG_cat132)
windows_intelx86
ID: 2018318 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 2018453 - Posted: 11 Nov 2019, 0:25:14 UTC - in response to Message 2018207.  

WU awaiting deletion continues to climb

It could just be me but it seems the new average is between 5.4 and 5.6 million work units waiting deletion. From where I sit the server seems to be handling this quite well or am I missing something?I am gathering it is sitting a little higher than normal because of the fast return rate in saying this though I have seen very few noise bombs a.k.a. -9 overflow
ID: 2018453 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2018479 - Posted: 11 Nov 2019, 6:05:10 UTC

The db purging can get large and not have issues until approaching 10 million or so.

The WU lines in the status should be small though, like they are right now. The WU files waiting for deletion has been over 1 million recently, and that is out of the ordinary and something to keep an eye on.

Workunits waiting for validation 0 1 523 9m
Workunits waiting for assimilation 0 0 68,929 9m
Workunit files waiting for deletion 0 0 1,728 9m
Result files waiting for deletion 0 0 664 9m

Luckily it looks like the system has recovered and is doing much better at the moment.
ID: 2018479 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2018490 - Posted: 11 Nov 2019, 8:35:18 UTC - in response to Message 2018453.  
Last modified: 11 Nov 2019, 8:35:43 UTC

WU awaiting deletion continues to climb
It could just be me but it seems the new average is between 5.4 and 5.6 million work units waiting deletion. From where I sit the server seems to be handling this quite well or am I missing something?I am gathering it is sitting a little higher than normal because of the fast return rate in saying this though I have seen very few noise bombs a.k.a. -9 overflow
WUs Awaiting deletion normal level, regardless of return rate, should be 0 (or very close to it). The highest it has ever got is 4.06million, although this time it hit the number 2 position with 1.47 million.
In progress tends to vary from 4.6 to 5 million.
Results awaiting purge varies between 2 to 6 million, depending on what issues the servers are having at the time.
Grant
Darwin NT
ID: 2018490 · Report as offensive
Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · 31 · 32 . . . 52 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.