Anyone else getting this?

Tue 03 Dec 2019 05:30:39 PM CST | SETI@home | Scheduler request failed: HTTP internal server error

Not all here.

Cheers.

The Haveland graphs site has been down for almost 24hrs.

Oh, and the Ready-to-send buffer is approaching empty.
124k left, 144k being returned per hour.

---

Grant
Darwin NT

Ready-to-send now down to 89k, 154k being returned per hour. Splitter output has fallen from 44/s down to 26/s.
Prepare for lots of "Project has no tasks available" Scheduler responses.

---

Grant
Darwin NT

The RTS remains to be alarmingly low.

---

The RTS remains to be alarmingly low.

It is currently 144,188 I would call that low it is lower than normal granted but there is enough work for about an hour with no output at the current return rate

---

It is currently 144,188

Now 477k, so it is recovering, albeit slowly.

---

Grant
Darwin NT

Still no graphs.

---

Grant
Darwin NT

Have we just crashed?
Just had a bunch of stalled downloads on one system (cleared after 3-4min), and now both systems are getting "Project has no tasks available" Scheduler responses, and not a WU in sight.


Edit- eventually got some work, on both systems. And neither can download it; one system's been going for 4min & counting with not a bit transferred (and it's just gone in to timeout). The other keeps timing out on the retries.

---

Grant
Darwin NT

Definitely strangeness going on. What I've never seen before is that on my Win box the stalled downloads are in excess to my full cache. e.g. with 2 GPUs I'm limited to 200 GPU tasks, I have 200 tasks in process and it's stalled downloading another 51.

Yeah, that happened on my Windows system that started off with the stalled downloads.
In progress is 346 (but there's only 1 CPU & 2*GPUs).

Everything is now in extended backoff mode, and the website & forums have shifted in to super go slow mode as well.

---

Grant
Darwin NT

Have we just crashed?
Just had a bunch of stalled downloads on one system (cleared after 3-4min), and now both systems are getting "Project has no tasks available" Scheduler responses, and not a WU in sight.


Edit- eventually got some work, on both systems. And neither can download it; one system's been going for 4min & counting with not a bit transferred (and it's just gone in to timeout). The other keeps timing out on the retries.

. . I have masses of WUs trying to download but it has gone into 'project backoff'.

[edit]
. . I seem to have poked the bear and I am now getting some, very slow, action on the downloads ...

Stephen

:(

Just cleared, whatever it was ... (somewhat)

---

. . I have masses of WUs trying to upload but it has gone into 'projec t backoff'.

Only been getting the odd one or 2 uploads that take a second attempt to go through, been that way for over a month.


My Windows system has managed to get all the downloads to clear (after a lot of retries)- it's set to use George M.
The Linux system is free to choose it's download server, and I've only been able to get a few of it's downloads to clear, till now. The last of the them finally went through.


Scheduler requests either result in "Project has no tasks available" or "Scheduler request failed: Couldn't connect to server" messages. It was "no tasks..." but now it's all "request failed.." responses now.

---

Grant
Darwin NT

Just cleared, whatever it was ... (somewhat)

What about Scheduler requests?

---

Grant
Darwin NT

Just cleared, whatever it was ... (somewhat)

. . Not quite. The servers are clearly distressed, the downloads finally cleared but I have about 50 WUs waiting to report on just one machine but when I eventually get a response it is 'internal HTTP error'.

. . Not looking pretty ...

Stephen

Just cleared, whatever it was ... (somewhat)

What about Scheduler requests?

I just started up my Weekend Warrior machine and it just came back with something like "scheduler request failed, server(s) down"?

Oh, well....
-edit---
Now its reporting no tasks available
--edit--

Tom

---

A proud member of the OFA (Old Farts Association).

… and now we're back to "Project has no tasks available" Scheduler responses. At least the Scheduler is back.

---

Grant
Darwin NT

. . I am now working on another machine, no CPU crunching, 1 x GPU and running an old stock client but it has 153 WUs cached. Like Jimbocus I am being allocated more WUs than I should be ..............

Stephen

? ?

What a mess. Everything was fine this morning.
The results out in the field 5,362,638 is high usually we run under 5 million.
I too have been allocated more than my limit.
At least we have WUs to crunch but wow... Tuesdays maintenance is going to have to do extra clean up for this.

At least we have WUs to crunch

Actually, we don't.
My Linux system is out of GPU work, Windows system not too far behind.

Not only is the Scheduler not sending out any work (scratch that- the odd WU here & there on every 4-12 requests), but the Splitters aren't even splitting any new work. Ready-to-send is less than 65k- correction 18.5k. Splitter output, zero.
It's borked.

---

Grant
Darwin NT

Yeah, things are rather confused right now.

Looks like the splitters have started producing some work, now hopefully the Scheduler will start allocating them.

---

Grant
Darwin NT