Scheduler request errors are now occuring within a couple of seconds.
If that doesn't happen then a timeout is more likely than a response. Add to that the shorties & the continuing upload issues.


EDIT- and these shorties are *really* short.
Running 3 at a time on my GTX 560Ti they're being done in just over 4 minutes.

---

Grant
Darwin NT

Scheduler request errors are now occuring within a couple of seconds.
If that doesn't happen then a timeout is more likely than a response. Add to that the shorties & the continuing upload issues.

I have been seeing my caches, such as were stingily allowed recently, diminish greatly.
As is the temperature in the crunching den of the kitties.

When I walked in after work this afternoon and saw the room temperature, I knew something was wrong/. It had already gone to crap hours before, while I was at work.
Multi thousand watts of Seti crunching power not being dissipated by hard working GPUs into the cold winter air.

Meowsigh.

---

"Time is simply the mechanism that keeps everything from happening all at once."

Just ran out of work on one GPU.
Even if i can upload the results, i get nothing but Scheduler errors or timeouts. By then, i can't get new work because of all the uploads that have backed up again. When i finally get them all uploaded, i get a Scheduler error or timeout again.
Etc, etc, etc,

---

Grant
Darwin NT

Just ran out of work on one GPU.
Even if i can upload the results, i get nothing but Scheduler errors or timeouts. By then, i can't get new work because of all the uploads that have backed up again.

I am ditching soon for the night.......
Hope the kitties and myself don't freeze overnight due to the LACK OF FREAKING CRUNCHING>>>>>>>>>ARRGGGGGGHHHHHHHHHHHHHHHHHHHHHHHHHH.

---

"Time is simply the mechanism that keeps everything from happening all at once."

Just ran out of work on one GPU.
Even if i can upload the results, i get nothing but Scheduler errors or timeouts. By then, i can't get new work because of all the uploads that have backed up again. When i finally get them all uploaded, i get a Scheduler error or timeout again.
Etc, etc, etc,

Having 2 or 3 good backup projects at times like these helps (I must see about getting 2 of them added to our Team's participating projects list). ;)

Cheers.

---

Seems as if something has received a fix as my uploads are suddenly start to clear. :)

Cheers.

---

It may be about over. My Uploads aren't hanging anymore, most of the 4 minute MB Shorties have been replaced by newly downloaded 20 min Longies, and the Update is working more than not. Maybe...

Uploads are still working but it takes a while and can be very temperamental. However I can't get a scheduler to not timeout and without that I can't see if downloads are equally temperamental.

Something is stopping up the pipes. Cricket now shows a nasty spike of incoming packets with a similar spike on the outgoing packets. Incoming packets now around 1/3 higher than is was yesterday and outgoing packets at nearly 10 kpkt/s.

Looks as if the chart started to go off "normal" about 24 hours ago. I imagine we are seeing some kind of cascading failure condition, clogging the pipes with retries that then trigger more hosts to fail connecting which then triggers more retires that clogs the pipes even more, etc.

This is what I'm seeing in my log

12/29/2012 1:09:16 AM | SETI@home | Reporting 6 completed tasks, requesting new tasks for CPU and ATI
12/29/2012 1:09:18 AM |  | Project communication failed: attempting access to reference site
12/29/2012 1:09:18 AM | SETI@home | Scheduler request failed: Server returned nothing (no headers, no data)
12/29/2012 1:09:20 AM |  | Internet access OK - project servers may be temporarily down.

---

"Life is just nature's way of keeping meat fresh." - The Doctor

Question is, can anybody report?

Very, very, very occasionally.
Very.


And that's with No New Tasks Set.
Even less often when trying for more work.

---

Grant
Darwin NT

Honestly it's becoming SOP that when I complain it starts working. Well sort of.

12/29/2012 1:23:30 AM | SETI@home | Reporting 7 completed tasks, requesting new tasks for CPU and ATI
12/29/2012 1:24:54 AM | SETI@home | Scheduler request completed: got 7 new tasks
12/29/2012 1:24:56 AM | SETI@home | Started download of 22dc09ac.3555.167212.140733193388041.10.92
12/29/2012 1:24:56 AM | SETI@home | Started download of 08oc12aa.26644.119686.4.10.1.vlar
12/29/2012 1:25:05 AM | SETI@home | Computation for task 26no12ad.24534.17654.140733193388043.10.56_1 finished
12/29/2012 1:25:05 AM | SETI@home | Starting task 22no12ad.3861.7429.140733193388038.10.76.vlar_1 using setiathome_enhanced version 603 in slot 0
12/29/2012 1:25:07 AM | SETI@home | Started upload of 26no12ad.24534.17654.140733193388043.10.56_1_0
12/29/2012 1:25:29 AM |  | Project communication failed: attempting access to reference site
12/29/2012 1:25:29 AM | SETI@home | Temporarily failed upload of 26no12ad.24534.17654.140733193388043.10.56_1_0: connect() failed
12/29/2012 1:25:29 AM | SETI@home | Backing off 2 min 13 sec on upload of 26no12ad.24534.17654.140733193388043.10.56_1_0
12/29/2012 1:25:31 AM |  | Internet access OK - project servers may be temporarily down.
12/29/2012 1:27:43 AM | SETI@home | Started upload of 26no12ad.24534.17654.140733193388043.10.56_1_0
12/29/2012 1:28:58 AM |  | Project communication failed: attempting access to reference site
12/29/2012 1:28:58 AM | SETI@home | Temporarily failed upload of 26no12ad.24534.17654.140733193388043.10.56_1_0: connect() failed
12/29/2012 1:28:58 AM | SETI@home | Backing off 4 min 50 sec on upload of 26no12ad.24534.17654.140733193388043.10.56_1_0
12/29/2012 1:28:59 AM |  | Internet access OK - project servers may be temporarily down.
12/29/2012 1:29:59 AM |  | Project communication failed: attempting access to reference site
12/29/2012 1:29:59 AM | SETI@home | Temporarily failed download of 08oc12aa.26644.119686.4.10.1.vlar: transient HTTP error
12/29/2012 1:29:59 AM | SETI@home | Backing off 3 min 5 sec on download of 08oc12aa.26644.119686.4.10.1.vlar
12/29/2012 1:29:59 AM | SETI@home | Started download of 22dc09ac.3555.167212.140733193388041.10.98
12/29/2012 1:30:00 AM |  | Internet access OK - project servers may be temporarily down.

And the answer to my previous post is yes, downloads are equally cranky.

---

"Life is just nature's way of keeping meat fresh." - The Doctor

Seems as if something has received a fix as my uploads are suddenly start to clear. :)

Still takes multiple clicks of the Retry button for me.

---

Grant
Darwin NT

Seems as if something has received a fix as my uploads are suddenly start to clear. :)

Cheers.

Well that only lasted long enough to clear 2 rigs. :(

Cheers.

---

Seems as if something has received a fix as my uploads are suddenly start to clear. :)

Still takes multiple clicks of the Retry button for me.

Although it's not taking as many clicks as it was.
However this upload improvement (minor as it is) appears to have come at the expense of Scheduler contact. As difficult as it has been, it's even more borked than it was before.

---

Grant
Darwin NT

Not getting many Scheduler timeouts now.
Now they just fail.

I can upload, but not contact the Schedluer- or it times out. Or i can upload, but the Scheduler just fails.
Either way, getting work just isn't possible.

---

Grant
Darwin NT

It's just the alien's way of trying to know that not too m;any of us shall find them too soon.

---

"Time is simply the mechanism that keeps everything from happening all at once."

And now uploads have gone from bad to worse, but Scheduler contacts haven't improved at all.
It'll probably all come crashing down before morning.

---

Grant
Darwin NT

:-(

Secondary projects in my BOINC are 'happy' about ..

I guess (worry) S@h is down, until after the first power outage ..

After a fresh start .. - at Jan/7, 8 should run 'everything' again well.


* Best regards! :-) * Sutaru Tsureku, team seti.international founder. * Optimize your PC for higher RAC. * SETI@home needs your help. *

---

It's not completely dead. I got 3 or 4 uploads through and got one scheduler contact to report some completions in the last half hour. Can't get other uploads through or get new work, so gpu is crunching Einstein on 0 resource share to keep the house warm.

It looks like a long weekend + holiday. Wish they'd loosen the limits if they are even needed - I'm not convinced of that.

---

Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.

And now uploads have gone from bad to worse, but Scheduler contacts haven't improved at all.
It'll probably all come crashing down before morning.

Every once in a while, the kitty claws get through to the servers letting them know they still want work......
It's still all basically fukayed.
Mostly by the server problems.
But also by the underpinnings of Boinc's 'don't bother the servers' attitude.
Server contacts borked, don't try any more.
Too many uploads pending, don't ask for work.
Even ONE download backed off, don't ask for work.
Things not running smoothly, don't even ask.
A fart in the carload...back off.

Any excuse to back off.
And, if things work, stop at 100 tasks for your GPUs.
Even if they can return 100 tasks in a few hours or less.

This is rather maddening when one has 9 rigs online begging to do as much work possible for this project as they can. THIS project, not Einstein or some other backup. THIS project. The one I care about.

---

"Time is simply the mechanism that keeps everything from happening all at once."

Whatever has stuffed things up, it's an odd one. There have been a couple of spikes in inbound traffic, but uploads & Scheduler requests have still been stuffed even during those periods. There's been the odd very slight dip in outbound traffic, yet most Scheduler requests result in an error, those that aren't an error timeout- It'd would be 5% or less of the requests that actually get a result.
Still the network traffic (inbound & outbound) is right up there.

---

Grant
Darwin NT