The Server Issues / Outages Thread - Panic Mode On! (117)

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 25 · 26 · 27 · 28 · 29 · 30 · 31 . . . 52 · Next

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2017205 - Posted: 30 Oct 2019, 11:40:13 UTC - in response to Message 2017204.  

It was probably SETI's maintenance outage (during which, you can't report tasks), coupled with BOINC's automatic extending backoffs.

You can't set a 5-minute repeat update: the server tells you to delay that long, as a minimum. You did the right thing, with your single mouse click.
ID: 2017205 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2017208 - Posted: 30 Oct 2019, 12:20:24 UTC - in response to Message 2017205.  

It was probably SETI's maintenance outage (during which, you can't report tasks), coupled with BOINC's automatic extending backoffs.

You can't set a 5-minute repeat update: the server tells you to delay that long, as a minimum. You did the right thing, with your single mouse click.


Sorry I misspoke. I have the "store up additional work" preference set to 0.1 which usually results in a 5 minute update cycle.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2017208 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 2017321 - Posted: 31 Oct 2019, 5:43:59 UTC

Looks like the splitters have finally recovered form the weekly outage.
Grant
Darwin NT
ID: 2017321 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 2017590 - Posted: 2 Nov 2019, 21:08:53 UTC

Ever since the last weekly outage there have been issues with Splitter output, and both AP & MB Results awaiting purge & WU awaiting purge, Results awaiting validation & WU awaiting deletion & WU awaiting assimilation.
Nothing that's had any impact on users, but just a general malaise where the servers just aren't able to keep up with everything at the same time. It clears one backlog, only for another to form elsewhere.
Grant
Darwin NT
ID: 2017590 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2017663 - Posted: 3 Nov 2019, 4:40:58 UTC

Seems Beta has run outta work, Tasks ready to send 0
Can someone please load some more work at Beta?
ID: 2017663 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2017698 - Posted: 3 Nov 2019, 13:33:55 UTC

Beta is Still out of work.....
ID: 2017698 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 2017768 - Posted: 4 Nov 2019, 8:04:49 UTC

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
Grant
Darwin NT
ID: 2017768 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2017771 - Posted: 4 Nov 2019, 8:18:32 UTC - in response to Message 2017768.  

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
AP work that was sent out on the 9th Oct timed out this morning and I got 1 of those resends, it was validated 4hrs later.

Cheers.
ID: 2017771 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 2017774 - Posted: 4 Nov 2019, 8:25:53 UTC - in response to Message 2017771.  

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
AP work that was sent out on the 9th Oct timed out this morning and I got 1 of those resends, it was validated 4hrs later.
Yeah, but id expect resends to occur daily (at least over the period AP was being sent out for. There have just been the odd blips, here & there.
The numbers and their timing just appear odd to me.
*shrug*
Grant
Darwin NT
ID: 2017774 · Report as offensive
Profile Siran d'Vel'nahr
Volunteer tester
Avatar

Send message
Joined: 23 May 99
Posts: 7379
Credit: 44,181,323
RAC: 238
United States
Message 2017912 - Posted: 5 Nov 2019, 20:52:32 UTC
Last modified: 5 Nov 2019, 20:55:25 UTC

Greetings,

[edit]Ok, they're starting to trickle in now, a few at a time here and there. [/edit]

The server status says there are over 600K WUs ready to send and I'm getting this:
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | [sched_op] CPU work request: 1194028.31 seconds; 0.00 devices
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | [sched_op] NVIDIA GPU work request: 216000.00 seconds; 2.00 devices
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Scheduler request completed: got 0 new tasks
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | [sched_op] Server version 709
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Project has no tasks available   <<<<<<<<<<<<
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Project requested delay of 303 seconds

What gives?

Have a great day! :)

Siran
CAPT Siran d'Vel'nahr - L L & P _\\//
Winders 11 OS? "What a piece of junk!" - L. Skywalker
"Logic is the cement of our civilization with which we ascend from chaos using reason as our guide." - T'Plana-hath
ID: 2017912 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24875
Credit: 3,081,182
RAC: 7
Ireland
Message 2017915 - Posted: 5 Nov 2019, 21:00:43 UTC - in response to Message 2017912.  

05/11/2019 20:59:02 | SETI@home | Scheduler request completed: got 0 new tasks
05/11/2019 20:59:02 | SETI@home | Project has no tasks available
:-(
ID: 2017915 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2017918 - Posted: 5 Nov 2019, 21:23:00 UTC

Well what a morning to have a longish outage and a frosty cold snap at the same time, I woke up cold. :-(

Cheers.
ID: 2017918 · Report as offensive
Holdolin

Send message
Joined: 10 Apr 19
Posts: 68
Credit: 88,777,750
RAC: 30
United States
Message 2017921 - Posted: 5 Nov 2019, 21:40:23 UTC

Bummer, made use of the downtime to re-arrange my systems in a better fashion and start bringing them up to find no work is avail. Here's to hoping it gets fixed soon.
ID: 2017921 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2017924 - Posted: 5 Nov 2019, 22:06:04 UTC

Well the caches on both my rigs are again full and things are starting to warm up. :-)

Cheers.
ID: 2017924 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 2017929 - Posted: 5 Nov 2019, 22:31:17 UTC

Still No Work at Beta. Tasks ready to send = 0
ID: 2017929 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30608
Credit: 53,134,872
RAC: 32
United States
Message 2017932 - Posted: 5 Nov 2019, 22:47:00 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0

Waiting on a power supply for one of my iMac's, so no real tragedy.
ID: 2017932 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 2017946 - Posted: 6 Nov 2019, 1:35:12 UTC

The Beast had a hiccup. after the outage, I was unable to VNC into it. but I could see its IP still active in my router. so I ssh'd into it, but it just hung when trying to run nvidia-smi. it would run htop though, which showed the system pretty much idle doing nothing.

i guess a driver crash? when i was able to get back to the system and hard reboot it, BOINC showed a couple computation error task, followed by a long string of "Exceeded time limit" tasks. (NOT the ongoing Windows/nvidia driver/SoG issue with Arecibo VHARs, this is a Linux box on Special App, and it was working on BLC13s at the time) So i lost a couple hours of crunching.

I guess I can't complain, it had been running untouched for nearly 2 months (59 days).
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2017946 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 2017948 - Posted: 6 Nov 2019, 2:46:43 UTC - in response to Message 2017946.  

The Beast had a hiccup. after the outage, I was unable to VNC into it. but I could see its IP still active in my router. so I ssh'd into it, but it just hung when trying to run nvidia-smi. it would run htop though, which showed the system pretty much idle doing nothing.

i guess a driver crash? when i was able to get back to the system and hard reboot it, BOINC showed a couple computation error task, followed by a long string of "Exceeded time limit" tasks. (NOT the ongoing Windows/nvidia driver/SoG issue with Arecibo VHARs, this is a Linux box on Special App, and it was working on BLC13s at the time) So i lost a couple hours of crunching.

I guess I can't complain, it had been running untouched for nearly 2 months (59 days).

I see that precise sequence once a week or so on one or the other of the Linux boxes here.
ID: 2017948 · Report as offensive
Profile bloodrain
Volunteer tester
Avatar

Send message
Joined: 8 Dec 08
Posts: 231
Credit: 28,112,547
RAC: 1
Antarctica
Message 2017967 - Posted: 6 Nov 2019, 8:12:04 UTC - in response to Message 2003161.  

today alone i gobble up 2.3k worth of units.
i am running dry.
ID: 2017967 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 2017975 - Posted: 6 Nov 2019, 13:17:31 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0


I finally got my latish model Android phone setup to crunch for Beta so someone hopefully could get us some updated tasks that would run on late model Androids.
Its been "waiting for work, nothing to do" for "several" days now.

Tom
A proud member of the OFA (Old Farts Association).
ID: 2017975 · Report as offensive
Previous · 1 . . . 25 · 26 · 27 · 28 · 29 · 30 · 31 . . . 52 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.