Panic Mode On (117) Server Problems?

Message boards : Number crunching : Panic Mode On (117) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · 31 · 32 . . . 33 · Next

AuthorMessage
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3869
Credit: 229,532,768
RAC: 355,308
United States
Message 2017208 - Posted: 30 Oct 2019, 12:20:24 UTC - in response to Message 2017205.  

It was probably SETI's maintenance outage (during which, you can't report tasks), coupled with BOINC's automatic extending backoffs.

You can't set a 5-minute repeat update: the server tells you to delay that long, as a minimum. You did the right thing, with your single mouse click.


Sorry I misspoke. I have the "store up additional work" preference set to 0.1 which usually results in a 5 minute update cycle.

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
ID: 2017208 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11820
Credit: 183,132,504
RAC: 228,057
Australia
Message 2017321 - Posted: 31 Oct 2019, 5:43:59 UTC

Looks like the splitters have finally recovered form the weekly outage.
Grant
Darwin NT
ID: 2017321 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11820
Credit: 183,132,504
RAC: 228,057
Australia
Message 2017590 - Posted: 2 Nov 2019, 21:08:53 UTC

Ever since the last weekly outage there have been issues with Splitter output, and both AP & MB Results awaiting purge & WU awaiting purge, Results awaiting validation & WU awaiting deletion & WU awaiting assimilation.
Nothing that's had any impact on users, but just a general malaise where the servers just aren't able to keep up with everything at the same time. It clears one backlog, only for another to form elsewhere.
Grant
Darwin NT
ID: 2017590 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 4913
Credit: 659,413,778
RAC: 1,431,224
United States
Message 2017663 - Posted: 3 Nov 2019, 4:40:58 UTC

Seems Beta has run outta work, Tasks ready to send 0
Can someone please load some more work at Beta?
ID: 2017663 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 4913
Credit: 659,413,778
RAC: 1,431,224
United States
Message 2017698 - Posted: 3 Nov 2019, 13:33:55 UTC

Beta is Still out of work.....
ID: 2017698 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11820
Credit: 183,132,504
RAC: 228,057
Australia
Message 2017768 - Posted: 4 Nov 2019, 8:04:49 UTC

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
Grant
Darwin NT
ID: 2017768 · Report as offensive     Reply Quote
Profile Wiggo "Democratic Socialist"
Avatar

Send message
Joined: 24 Jan 00
Posts: 17167
Credit: 239,308,500
RAC: 175,264
Australia
Message 2017771 - Posted: 4 Nov 2019, 8:18:32 UTC - in response to Message 2017768.  

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
AP work that was sent out on the 9th Oct timed out this morning and I got 1 of those resends, it was validated 4hrs later.

Cheers.
ID: 2017771 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11820
Credit: 183,132,504
RAC: 228,057
Australia
Message 2017774 - Posted: 4 Nov 2019, 8:25:53 UTC - in response to Message 2017771.  

Not a panic, but a just some wondering- What on earth is going on with the AP Results Awaiting validation? Every so often there are small surges in the AP Results Awaiting validation numbers. No change in the In progress numbers, but there are surges in Received last hour, and drops in Average turnaround time. It's as though a large batch of resends have just been returned (150-200) all in one hit.
AP work that was sent out on the 9th Oct timed out this morning and I got 1 of those resends, it was validated 4hrs later.
Yeah, but id expect resends to occur daily (at least over the period AP was being sent out for. There have just been the odd blips, here & there.
The numbers and their timing just appear odd to me.
*shrug*
Grant
Darwin NT
ID: 2017774 · Report as offensive     Reply Quote
Profile Siran d'Vel'nahr
Volunteer tester
Avatar

Send message
Joined: 23 May 99
Posts: 7131
Credit: 30,499,053
RAC: 113,298
United States
Message 2017912 - Posted: 5 Nov 2019, 20:52:32 UTC
Last modified: 5 Nov 2019, 20:55:25 UTC

Greetings,

[edit]Ok, they're starting to trickle in now, a few at a time here and there. [/edit]

The server status says there are over 600K WUs ready to send and I'm getting this:
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | [sched_op] CPU work request: 1194028.31 seconds; 0.00 devices
Tue 05 Nov 2019 02:45:21 PM CST | SETI@home | [sched_op] NVIDIA GPU work request: 216000.00 seconds; 2.00 devices
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Scheduler request completed: got 0 new tasks
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | [sched_op] Server version 709
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Project has no tasks available   <<<<<<<<<<<<
Tue 05 Nov 2019 02:45:22 PM CST | SETI@home | Project requested delay of 303 seconds

What gives?

Have a great day! :)

Siran
CAPT Siran d'Vel'nahr XO - L L & P _\\//
USS Vre'kasht NCC-33187
Winders 10 OS? "What a piece of junk!" - L. Skywalker
"Logic is the cement of our civilization with which we ascend from chaos using reason as our guide." - T'Plana-hath
ID: 2017912 · Report as offensive     Reply Quote
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 21176
Credit: 2,958,827
RAC: 815
Ireland
Message 2017915 - Posted: 5 Nov 2019, 21:00:43 UTC - in response to Message 2017912.  

05/11/2019 20:59:02 | SETI@home | Scheduler request completed: got 0 new tasks
05/11/2019 20:59:02 | SETI@home | Project has no tasks available
:-(
ID: 2017915 · Report as offensive     Reply Quote
Profile Wiggo "Democratic Socialist"
Avatar

Send message
Joined: 24 Jan 00
Posts: 17167
Credit: 239,308,500
RAC: 175,264
Australia
Message 2017918 - Posted: 5 Nov 2019, 21:23:00 UTC

Well what a morning to have a longish outage and a frosty cold snap at the same time, I woke up cold. :-(

Cheers.
ID: 2017918 · Report as offensive     Reply Quote
Holdolin

Send message
Joined: 10 Apr 19
Posts: 68
Credit: 87,433,762
RAC: 708,916
United States
Message 2017921 - Posted: 5 Nov 2019, 21:40:23 UTC

Bummer, made use of the downtime to re-arrange my systems in a better fashion and start bringing them up to find no work is avail. Here's to hoping it gets fixed soon.
ID: 2017921 · Report as offensive     Reply Quote
Profile Wiggo "Democratic Socialist"
Avatar

Send message
Joined: 24 Jan 00
Posts: 17167
Credit: 239,308,500
RAC: 175,264
Australia
Message 2017924 - Posted: 5 Nov 2019, 22:06:04 UTC

Well the caches on both my rigs are again full and things are starting to warm up. :-)

Cheers.
ID: 2017924 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 4913
Credit: 659,413,778
RAC: 1,431,224
United States
Message 2017929 - Posted: 5 Nov 2019, 22:31:17 UTC

Still No Work at Beta. Tasks ready to send = 0
ID: 2017929 · Report as offensive     Reply Quote
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 25984
Credit: 50,921,131
RAC: 21,847
United States
Message 2017932 - Posted: 5 Nov 2019, 22:47:00 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0

Waiting on a power supply for one of my iMac's, so no real tragedy.
ID: 2017932 · Report as offensive     Reply Quote
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 1982
Credit: 901,591,036
RAC: 2,742,138
United States
Message 2017946 - Posted: 6 Nov 2019, 1:35:12 UTC

The Beast had a hiccup. after the outage, I was unable to VNC into it. but I could see its IP still active in my router. so I ssh'd into it, but it just hung when trying to run nvidia-smi. it would run htop though, which showed the system pretty much idle doing nothing.

i guess a driver crash? when i was able to get back to the system and hard reboot it, BOINC showed a couple computation error task, followed by a long string of "Exceeded time limit" tasks. (NOT the ongoing Windows/nvidia driver/SoG issue with Arecibo VHARs, this is a Linux box on Special App, and it was working on BLC13s at the time) So i lost a couple hours of crunching.

I guess I can't complain, it had been running untouched for nearly 2 months (59 days).
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 2017946 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1513
Credit: 191,777,310
RAC: 461,173
United States
Message 2017948 - Posted: 6 Nov 2019, 2:46:43 UTC - in response to Message 2017946.  

The Beast had a hiccup. after the outage, I was unable to VNC into it. but I could see its IP still active in my router. so I ssh'd into it, but it just hung when trying to run nvidia-smi. it would run htop though, which showed the system pretty much idle doing nothing.

i guess a driver crash? when i was able to get back to the system and hard reboot it, BOINC showed a couple computation error task, followed by a long string of "Exceeded time limit" tasks. (NOT the ongoing Windows/nvidia driver/SoG issue with Arecibo VHARs, this is a Linux box on Special App, and it was working on BLC13s at the time) So i lost a couple hours of crunching.

I guess I can't complain, it had been running untouched for nearly 2 months (59 days).

I see that precise sequence once a week or so on one or the other of the Linux boxes here.
ID: 2017948 · Report as offensive     Reply Quote
Profile bloodrain
Volunteer tester
Avatar

Send message
Joined: 8 Dec 08
Posts: 200
Credit: 24,623,769
RAC: 73,995
Antarctica
Message 2017967 - Posted: 6 Nov 2019, 8:12:04 UTC - in response to Message 2003161.  

today alone i gobble up 2.3k worth of units.
i am running dry.
ID: 2017967 · Report as offensive     Reply Quote
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 3869
Credit: 229,532,768
RAC: 355,308
United States
Message 2017975 - Posted: 6 Nov 2019, 13:17:31 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0


I finally got my latish model Android phone setup to crunch for Beta so someone hopefully could get us some updated tasks that would run on late model Androids.
Its been "waiting for work, nothing to do" for "several" days now.

Tom
A proud member of the OFA (Old Farts Association)
"Over the hill? WHAT Hill? I don't REMEMBER any hill...." (from a bumper sticker I bought at a truck stop).
ID: 2017975 · Report as offensive     Reply Quote
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 4913
Credit: 659,413,778
RAC: 1,431,224
United States
Message 2018043 - Posted: 7 Nov 2019, 3:59:19 UTC - in response to Message 2017929.  

Still No Work at Beta. Tasks ready to send = 0

Still nothing at Beta....
ID: 2018043 · Report as offensive     Reply Quote
Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · 31 · 32 . . . 33 · Next

Message boards : Number crunching : Panic Mode On (117) Server Problems?


 
©2019 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.