Panic Mode On (114) Server Problems?

Message boards : Number crunching : Panic Mode On (114) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 45 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969186 - Posted: 7 Dec 2018, 23:24:35 UTC - in response to Message 1969185.  

07/12/2018 23:05:39 | SETI@home | Scheduler request completed: got 0 new tasks
07/12/2018 23:15:06 | SETI@home | Scheduler request completed: got 24 new tasks

Don't pay too much attention to transient, ephemeral, artefacts. Give the servers a second chance.

8/12/2018 07:20:45 | SETI@home | Project has no tasks available
8/12/2018 07:25:53 | SETI@home | Project has no tasks available
8/12/2018 07:31:02 | SETI@home | Project has no tasks available
8/12/2018 07:36:11 | SETI@home | Project has no tasks available
8/12/2018 07:41:20 | SETI@home | Project has no tasks available
8/12/2018 07:46:35 | SETI@home | Project has no tasks available
8/12/2018 07:51:45 | SETI@home | Project has no tasks available
8/12/2018 07:56:54 | SETI@home | Project has no tasks available
8/12/2018 08:02:04 | SETI@home | Project has no tasks available
8/12/2018 08:07:14 | SETI@home | Project has no tasks available
8/12/2018 08:12:23 | SETI@home | Project has no tasks available
8/12/2018 08:17:32 | SETI@home | Project has no tasks available
8/12/2018 08:22:42 | SETI@home | Project has no tasks available
8/12/2018 08:27:52 | SETI@home | Project has no tasks available
8/12/2018 08:33:02 | SETI@home | Project has no tasks available
8/12/2018 08:38:12 | SETI@home | Scheduler request completed: got 1 new tasks
8/12/2018 08:43:21 | SETI@home | Project has no tasks available
8/12/2018 08:48:31 | SETI@home | Project has no tasks available

In progress has dropped by around 250k over the last couple of hours.
Not what I would consider to be transient, ephemeral or an artefact. I'd say there is an issue when it comes to allocating work.
Grant
Darwin NT
ID: 1969186 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1969188 - Posted: 7 Dec 2018, 23:43:43 UTC

Check how many tasks the top machines have, https://setiathome.berkeley.edu/top_hosts.php

One of mine has around 400 out of 1100.
Another has 60 out of 500 and will be out in about 10 to 15 minutes.
ID: 1969188 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1969191 - Posted: 7 Dec 2018, 23:52:00 UTC - in response to Message 1969173.  

That is not surprising at all. With the replica database being brought back online, it is trying to catch up and creating a lot of extra load.


. .Less than 12 hours behind now ...

Stephen

. .
ID: 1969191 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969205 - Posted: 8 Dec 2018, 0:52:39 UTC

8/12/2018 08:53:39 | SETI@home | Project has no tasks available
8/12/2018 08:58:49 | SETI@home | Project has no tasks available
8/12/2018 09:03:59 | SETI@home | Project has no tasks available
8/12/2018 09:09:08 | SETI@home | Project has no tasks available
8/12/2018 09:14:18 | SETI@home | Project has no tasks available
8/12/2018 09:19:28 | SETI@home | Project has no tasks available
8/12/2018 09:24:38 | SETI@home | Project has no tasks available
8/12/2018 09:29:48 | SETI@home | Project has no tasks available
8/12/2018 09:34:58 | SETI@home | Project has no tasks available
8/12/2018 09:40:09 | SETI@home | Project has no tasks available
8/12/2018 09:45:24 | SETI@home | Project has no tasks available
8/12/2018 09:50:33 | SETI@home | Project has no tasks available
8/12/2018 09:55:42 | SETI@home | Project has no tasks available
8/12/2018 10:00:51 | SETI@home | Project has no tasks available
8/12/2018 10:06:01 | SETI@home | Project has no tasks available
8/12/2018 10:11:11 | SETI@home | Project has no tasks available
8/12/2018 10:16:21 | SETI@home | Project has no tasks available
8/12/2018 10:21:30 | SETI@home | Project has no tasks available
Grant
Darwin NT
ID: 1969205 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1969210 - Posted: 8 Dec 2018, 1:27:41 UTC

On the upside, the splitters are have no problem with keeping the server cache full.
ID: 1969210 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969223 - Posted: 8 Dec 2018, 2:21:14 UTC

Starting to pick up some work on every 3rd to 8th request.
Grant
Darwin NT
ID: 1969223 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1969233 - Posted: 8 Dec 2018, 3:03:20 UTC

You're having better luck than I am. Guess with your comment there is hope.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1969233 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1969245 - Posted: 8 Dec 2018, 3:47:58 UTC - in response to Message 1969233.  
Last modified: 8 Dec 2018, 3:49:27 UTC

Double post
ID: 1969245 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1969246 - Posted: 8 Dec 2018, 3:49:09 UTC - in response to Message 1969245.  
Last modified: 8 Dec 2018, 3:51:24 UTC

You're having better luck than I am. Guess with your comment there is hope.

+1

My only hope is i have and entire 3k buffer filled so it must last for the entire night.

All request for new WU ends on:

Fri 07 Dec 2018 10:49:59 PM EST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Fri 07 Dec 2018 10:50:01 PM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 07 Dec 2018 10:50:01 PM EST | SETI@home | Project has no tasks available

ID: 1969246 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1969253 - Posted: 8 Dec 2018, 4:14:36 UTC

If my observations are correct, the server only seems to be handing out handfuls of tasks when the splitters are not running.
When the splitters kick in, and server load increases - nothing.
ID: 1969253 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1969267 - Posted: 8 Dec 2018, 5:17:37 UTC
Last modified: 8 Dec 2018, 5:31:19 UTC

Results out in the field is down to 4,576,035 it is usually over 5 million.

edit: why does the "baby" always get sick on Friday night??
ID: 1969267 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969270 - Posted: 8 Dec 2018, 6:40:20 UTC - in response to Message 1969233.  

You're having better luck than I am. Guess with your comment there is hope.

I think it was just toying with me for a while there.
After that it dried up again for a while, now it's giving out (some) work every 10-15 requests.
Grant
Darwin NT
ID: 1969270 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1969288 - Posted: 8 Dec 2018, 8:56:28 UTC
Last modified: 8 Dec 2018, 8:56:39 UTC

I think someone may have just drove a tank through the flood gates :D
ID: 1969288 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1969289 - Posted: 8 Dec 2018, 9:05:27 UTC

Hallelujah . . . . you are correct. Getting back to full caches.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1969289 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969290 - Posted: 8 Dec 2018, 9:14:35 UTC - in response to Message 1969288.  
Last modified: 8 Dec 2018, 9:15:10 UTC

I think someone may have just drove a tank through the flood gates :D

It would appear so- In Progress is shooting back up to where it usually is. But Ready to send is still falling- the Splitters appear to be reluctant to pick up the pace again. Hopefully it won't take them too long to get going at high speed again.

The Validators are still struggling, so the Assimilators are still behind.
Grant
Darwin NT
ID: 1969290 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1969293 - Posted: 8 Dec 2018, 9:44:04 UTC

Lots of BLC13 "noisebombs" too.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1969293 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13789
Credit: 208,696,464
RAC: 304
Australia
Message 1969298 - Posted: 8 Dec 2018, 10:31:43 UTC
Last modified: 8 Dec 2018, 10:32:05 UTC

And now the Splitters have called it quits. Ready-to-send buffer should be out of work in an hour or so.
Grant
Darwin NT
ID: 1969298 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51470
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1969319 - Posted: 8 Dec 2018, 14:33:57 UTC

The kitties sent the word out.
Hopefully Eric or Jeff can do something by remote.

Meow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1969319 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1969324 - Posted: 8 Dec 2018, 14:40:34 UTC
Last modified: 8 Dec 2018, 14:42:37 UTC

Thank you Kittyman for sending the signal !!!

Out in the field is down to 4,455,127, and falling.

Unixchick
who has 4 kitties of her own who are all very talkative.

edit: looks like resends are going through quickly, even if nothing new is being split.
ID: 1969324 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51470
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1969325 - Posted: 8 Dec 2018, 14:45:07 UTC - in response to Message 1969324.  

Thank you Kittyman for sending the signal !!!

Out in the field is down to 4,455,127, and falling.

Unixchick
who has 4 kitties of her own who are all very talkative.

edit: looks like resends are going through quickly, even if nothing new is being split.

4 kitties! That's nice to hear.
Have them send their kitty juju to the servers.
Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1969325 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 45 · Next

Message boards : Number crunching : Panic Mode On (114) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.