Panic Mode On (56) Server problems?

Author	Message
Terror Australis Volunteer tester Send message Joined: 14 Feb 04 Posts: 1417 Credit: 181,859,521 RAC: 159,375	Message 1157948 - Posted: 1 Oct 2011, 17:02:25 UTC - in response to Message 1157937.
TA, we can always blame Misfit. Actually, I kinda miss him. Wonder how he's doing? Same here, I still occasionally go look at his profile when I want a grin.
ID: 1157948 ·

Richard Haselgrove Volunteer tester Send message Joined: 4 Jul 99 Posts: 7459 Credit: 39,690,810 RAC: 34,091	Message 1157953 - Posted: 1 Oct 2011, 17:11:20 UTC Last modified: 1 Oct 2011, 17:18:11 UTC
More worryingly, I just got 01/10/2011 18:03:21 \| SETI@home \| Sending scheduler request: Requested by user. 01/10/2011 18:03:21 \| SETI@home \| Reporting 14 completed tasks, requesting new tasks for CPU and NVIDIA GPU 01/10/2011 18:03:21 \| SETI@home \| [sched_op] CPU work request: 673473.12 seconds; 0.00 CPUs 01/10/2011 18:03:21 \| SETI@home \| [sched_op] NVIDIA GPU work request: 154670.17 seconds; 0.00 GPUs 01/10/2011 18:04:22 \| SETI@home \| Scheduler request failed: HTTP internal server error 01/10/2011 18:04:22 \| SETI@home \| [sched_op] Deferring communication for 1 min 30 sec The 14 tasks got reported OK, because the 'in progress' count for that host on the website is now 14 fewer than the number of tasks BoincView is counting - I never got the 'ack' for successful reporting of those tasks, so BOINC locally still thinks they're 'ready to report'. Edit - whatever it was, was only temporary. The tasks reported properly and were acknowledged a couple of attempts later, and I got some new work.
ID: 1157953 ·

Sten-Arne Volunteer tester Send message Joined: 1 Nov 08 Posts: 2688 Credit: 7,672,829 RAC: 23,098	Message 1157964 - Posted: 1 Oct 2011, 18:17:50 UTC
Looking at the cricket graph for the last 4 days, one would be excused if one confused it with a vital signs monitor connected to a patient with only a few days left to live.... ____________ /The grumpy old Swede. "I'm so old, that 98% of all trees in the forest, are younger than I am"
ID: 1157964 ·

James Sotherden Volunteer moderator Send message Joined: 16 May 99 Posts: 6051 Credit: 14,697,958 RAC: 21,368	Message 1157965 - Posted: 1 Oct 2011, 18:25:55 UTC
Just tried to to report work from the old P4 and its a no go. Says servers may be down. the Mac has two work units that I got sometime today. This I7 still has 4 Einstiens I want to finish befor I request new work. Think I will get some? And downloads from Einstien havent been very fast the past few days either. Ive had one trying since this morning. Ill join Chris at the pub. ____________
ID: 1157965 ·

Sten-Arne Volunteer tester Send message Joined: 1 Nov 08 Posts: 2688 Credit: 7,672,829 RAC: 23,098	Message 1157967 - Posted: 1 Oct 2011, 18:32:20 UTC - in response to Message 1157965.
Just tried to to report work from the old P4 and its a no go. Says servers may be down. the Mac has two work units that I got sometime today. This I7 still has 4 Einstiens I want to finish befor I request new work. Think I will get some? And downloads from Einstien havent been very fast the past few days either. Ive had one trying since this morning. Ill join Chris at the pub. I can't go to the pub, I just feel too low to get near any place where alcohol can be found. I may drink too much and fall into a manhole, on my way home. I think I'll just stay at home, crying my eyes out, and posting the occasional whining post. LOL ____________ /The grumpy old Swede. "I'm so old, that 98% of all trees in the forest, are younger than I am"
ID: 1157967 ·

MikeN Send message Joined: 24 Jan 11 Posts: 221 Credit: 16,016,975 RAC: 24,669	Message 1157976 - Posted: 1 Oct 2011, 19:04:07 UTC Last modified: 1 Oct 2011, 19:06:00 UTC
Daren't go to pub. The only way i can get uploads and reports through is to sit here constantly hitting the retry button. Just to add insult to injury, I jave got a whole load of 12s megashorties that take 12s to abort and then 12 minutes to upload and another 12 minutes to report. Have to go now still got WU to report again and again and again.... EDIT guess what while I was typing this the report went through. Now I have 14 minutes free till the next shortie finishes. How many pints can I drink in 14 minutes?
ID: 1157976 ·

WinterKnight Volunteer tester Send message Joined: 18 May 99 Posts: 6809 Credit: 17,121,554 RAC: 26,923	Message 1157978 - Posted: 1 Oct 2011, 19:07:31 UTC - in response to Message 1157976.
Daren't go to pub. The only way i can get uploads and reports through is to sit here constantly hitting the retry button. Just to add insult to injury, I jave got a whole load of 12s megashorties that take 12s to abort and then 12 minutes to upload and another 12 minutes to report. Have to go now still got WU to report again and again and again.... Well the cricket graph has almost hit rock bottom, so the sensible decision is go down the pub and check when we get back.
ID: 1157978 ·

rob smith Volunteer moderator Send message Joined: 7 Mar 03 Posts: 5452 Credit: 20,773,240 RAC: 128,638	Message 1157981 - Posted: 1 Oct 2011, 19:14:23 UTC - in response to Message 1157976.
EDIT guess what while I was typing this the report went through. Now I have 14 minutes free till the next shortie finishes. How many pints can I drink in 14 minutes? Well it was fun while it lasted. Pints in 14 minutes? That depends how many you get lined up first, some pubs I know you'd be lucky to get one in never mind drunk, others you could line a dozen or more up and still have time to order another dozen. Don't bother punishing the re-try button, just retire to the pub, someone has flattened the crickets :-( ____________ Bob Smith Member of Seti PIPPS (Pluto is a Planet Protest Society) Somewhere in the (un)known Universe?
ID: 1157981 ·

clive G1FYE Volunteer moderator Send message Joined: 4 Nov 04 Posts: 1284 Credit: 14,943,811 RAC: 2,626	Message 1157991 - Posted: 1 Oct 2011, 19:37:28 UTC
Jeff Cobb has posted an update for our woes in the HE thread http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929
ID: 1157991 ·

Kinguni Volunteer tester Send message Joined: 15 Feb 00 Posts: 239 Credit: 9,041,929 RAC: 94	Message 1157994 - Posted: 1 Oct 2011, 19:47:30 UTC
Got results gone past expiry now. I'd just like to be able to upload and report them. I have plenty of work on other projects. ____________ Join Team Starfire BOINC Chat
ID: 1157994 ·

__W__ Send message Joined: 28 Mar 09 Posts: 91 Credit: 2,104,389 RAC: 1,990	Message 1158007 - Posted: 1 Oct 2011, 20:49:50 UTC - in response to Message 1157834.
Someone must have kicked the routers at HE very hard - yiiihhha Just got 40 WUs and downloaded them in under 2 minutes, in spite of cricket nearly maxed out - and pinging the servers is as fast as never before (from my point of the world) :-) . Only short time of happiness, ping on .13 and .16 lost in timeouts :-( - .18 and 20 are as fast as before :-) - __W__ ____________ _______________________________________________________________________________
ID: 1158007 ·

Fred J. Verster Volunteer tester Send message Joined: 21 Apr 04 Posts: 3232 Credit: 31,585,541 RAC: 1	Message 1158009 - Posted: 1 Oct 2011, 21:01:27 UTC - in response to Message 1158007.
One rig reported on 1 Oct 2011 \| 20:55:08 UTC, but only UPLoad, no work. Also no more work from SETI Bêta, see an enormous spike at Milkyway. ____________ Knight Who Says Ni N!, OUT numbered.................
ID: 1158009 ·

Ichobod Send message Joined: 20 Apr 08 Posts: 6 Credit: 2,948,560 RAC: 0	Message 1158012 - Posted: 1 Oct 2011, 21:09:38 UTC
I've been getting a good amount of cpu but I don't think either of my computers have received any gpu since the last outtage. Is there not enough CUDA to go around or something else is wrong ?
ID: 1158012 ·

Claggy Volunteer tester Send message Joined: 5 Jul 99 Posts: 3363 Credit: 25,950,143 RAC: 1,098	Message 1158013 - Posted: 1 Oct 2011, 21:18:03 UTC - in response to Message 1158012. Last modified: 1 Oct 2011, 21:19:56 UTC
I've been getting a good amount of cpu but I don't think either of my computers have received any gpu since the last outtage. Is there not enough CUDA to go around or something else is wrong ? Boinc will fill it's fastest device first, be it CPU or GPU, then once that cache is full it will fill the other, (it seems to be operating the other way round at the moment through) You can try reducing your Cache setting until Boinc no longer asks for CPU work, once the HE link behaves itself you should get some GPU work, Claggy
ID: 1158013 ·

MikeN Send message Joined: 24 Jan 11 Posts: 221 Credit: 16,016,975 RAC: 24,669	Message 1158018 - Posted: 1 Oct 2011, 21:39:41 UTC - in response to Message 1157978.
Jeff Cobb has posted an update for our woes in the HE thread http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929 cricket graph seems to be coming back to life. Whoever Jeff kicked, bribed or sweet talked to sort out the connection issues seems to have done the trick
ID: 1158018 ·

soft^spirit Send message Joined: 18 May 99 Posts: 6231 Credit: 27,516,315 RAC: 9,214	Message 1158026 - Posted: 1 Oct 2011, 22:11:13 UTC - in response to Message 1158018.
Jeff Cobb has posted an update for our woes in the HE thread http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929 cricket graph seems to be coming back to life. Whoever Jeff kicked, bribed or sweet talked to sort out the connection issues seems to have done the trick If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew. ____________ Janice
ID: 1158026 ·

Blurf Volunteer tester Send message Joined: 2 Sep 06 Posts: 6346 Credit: 5,677,455 RAC: 5,979	Message 1158030 - Posted: 1 Oct 2011, 22:18:27 UTC - in response to Message 1158026.
If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew. and dessert is a heaping mound of Mento's :) ____________
ID: 1158030 ·

Donald L. Johnson Send message Joined: 5 Aug 02 Posts: 3901 Credit: 359,641 RAC: 823	Message 1158034 - Posted: 1 Oct 2011, 22:28:13 UTC - in response to Message 1158030.
If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew. and dessert is a heaping mound of Mento's :) Mountain Dew Code Red or Voltage (Blue), microwave pizza snacks, and Hershey's miniatures (Ghirardeli when I can get them) or Reece's pieces. (8{) ____________ Donald Infernal Optimist / Submariner, retired
ID: 1158034 ·

Wembley Volunteer tester Send message Joined: 16 Sep 09 Posts: 415 Credit: 879,818 RAC: 0	Message 1158047 - Posted: 1 Oct 2011, 23:03:32 UTC - in response to Message 1158034.
If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew. and dessert is a heaping mound of Mento's :) Mountain Dew Code Red or Voltage (Blue), microwave pizza snacks, and Hershey's miniatures (Ghirardeli when I can get them) or Reece's pieces. (8{) Jumbo bag of Skittles. Pretty much pure sugar with some flavoring. ____________ Donate with your searches and online buys: http://www.goodsearch.com/toolbar/university-of-california-setihome
ID: 1158047 ·

Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 5059 Credit: 40,885,898 RAC: 52,911	Message 1158052 - Posted: 1 Oct 2011, 23:33:08 UTC Last modified: 1 Oct 2011, 23:34:29 UTC
Something(s) definately stuffed. Outbound network traffic is barely peaking at 60Mb/s, for a while there it wasn't even peaking at 30Mb/s. This is with both of my machines not having reached the present limits. One of them actually ran out of work because the upload server was down at one stage, and the backoffs from that resulted in it backing off for over 4 hours. At the moment it's backed off for over 6 hours due to the problem with the Scheduler. Most requests to the Scheduler result in "project has no tasks available", which is odd considering the very low level of network traffic. When it does connect, it gets 2-3 tasks (DCF of 1.2). However at the present moment all attempts to contect the Scheduler result in failure. 2/10/2011 8:57:30 SETI@home Sending scheduler request: To fetch work. 2/10/2011 8:57:30 SETI@home Reporting 6 completed tasks, requesting new tasks for CPU and GPU 2/10/2011 8:57:52 Project communication failed: attempting access to reference site 2/10/2011 8:57:52 SETI@home Scheduler request failed: Couldn't connect to server 2/10/2011 8:57:54 Internet access OK - project servers may be temporarily down. and repeat time & time again. ____________ Grant Darwin NT.
ID: 1158052 ·

Author

Message

Terror Australis
Volunteer tester
Send message
Joined: 14 Feb 04
Posts: 1417
Credit: 181,859,521
RAC: 159,375

TA, we can always blame Misfit. Actually, I kinda miss him. Wonder how he's doing?

Same here, I still occasionally go look at his profile when I want a grin.

ID: 1157948 ·

Richard Haselgrove

Volunteer tester
Send message
Joined: 4 Jul 99
Posts: 7459
Credit: 39,690,810
RAC: 34,091

More worryingly, I just got

The 14 tasks got reported OK, because the 'in progress' count for that host on the website is now 14 fewer than the number of tasks BoincView is counting - I never got the 'ack' for successful reporting of those tasks, so BOINC locally still thinks they're 'ready to report'.

Edit - whatever it was, was only temporary. The tasks reported properly and were acknowledged a couple of attempts later, and I got some new work.

ID: 1157953 ·

Sten-Arne
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 2688
Credit: 7,672,829
RAC: 23,098

Looking at the cricket graph for the last 4 days, one would be excused if one confused it with a vital signs monitor connected to a patient with only a few days left to live....

____________
/The grumpy old Swede.

"I'm so old, that 98% of all trees in the forest, are younger than I am"

ID: 1157964 ·

James Sotherden

Volunteer moderator
Avatar

Send message
Joined: 16 May 99
Posts: 6051
Credit: 14,697,958
RAC: 21,368

Just tried to to report work from the old P4 and its a no go. Says servers may be down. the Mac has two work units that I got sometime today. This I7 still has 4 Einstiens I want to finish befor I request new work. Think I will get some?

And downloads from Einstien havent been very fast the past few days either. Ive had one trying since this morning.

Ill join Chris at the pub.
____________

ID: 1157965 ·

Sten-Arne
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 2688
Credit: 7,672,829
RAC: 23,098

Just tried to to report work from the old P4 and its a no go. Says servers may be down. the Mac has two work units that I got sometime today. This I7 still has 4 Einstiens I want to finish befor I request new work. Think I will get some?

And downloads from Einstien havent been very fast the past few days either. Ive had one trying since this morning.

Ill join Chris at the pub.

I can't go to the pub, I just feel too low to get near any place where alcohol can be found. I may drink too much and fall into a manhole, on my way home.

I think I'll just stay at home, crying my eyes out, and posting the occasional whining post.

LOL
____________
/The grumpy old Swede.

"I'm so old, that 98% of all trees in the forest, are younger than I am"

ID: 1157967 ·

MikeN

Send message
Joined: 24 Jan 11
Posts: 221
Credit: 16,016,975
RAC: 24,669

Daren't go to pub. The only way i can get uploads and reports through is to sit here constantly hitting the retry button. Just to add insult to injury, I jave got a whole load of 12s megashorties that take 12s to abort and then 12 minutes to upload and another 12 minutes to report. Have to go now still got WU to report again and again and again....

EDIT guess what while I was typing this the report went through. Now I have 14 minutes free till the next shortie finishes. How many pints can I drink in 14 minutes?

ID: 1157976 ·

WinterKnight
Volunteer tester
Send message
Joined: 18 May 99
Posts: 6809
Credit: 17,121,554
RAC: 26,923

Daren't go to pub. The only way i can get uploads and reports through is to sit here constantly hitting the retry button. Just to add insult to injury, I jave got a whole load of 12s megashorties that take 12s to abort and then 12 minutes to upload and another 12 minutes to report. Have to go now still got WU to report again and again and again....

Well the cricket graph has almost hit rock bottom, so the sensible decision is go down the pub and check when we get back.

ID: 1157978 ·

rob smith

Volunteer moderator
Send message
Joined: 7 Mar 03
Posts: 5452
Credit: 20,773,240
RAC: 128,638

EDIT guess what while I was typing this the report went through. Now I have 14 minutes free till the next shortie finishes. How many pints can I drink in 14 minutes?

Well it was fun while it lasted.

Pints in 14 minutes? That depends how many you get lined up first, some pubs I know you'd be lucky to get one in never mind drunk, others you could line a dozen or more up and still have time to order another dozen.
Don't bother punishing the re-try button, just retire to the pub, someone has flattened the crickets :-(
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

ID: 1157981 ·

clive G1FYE

Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1284
Credit: 14,943,811
RAC: 2,626

Jeff Cobb has posted an update for our woes in the HE thread
http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929

ID: 1157991 ·

Kinguni
Volunteer tester
Avatar

Send message
Joined: 15 Feb 00
Posts: 239
Credit: 9,041,929
RAC: 94

Got results gone past expiry now. I'd just like to be able to upload and report them. I have plenty of work on other projects.
____________
Join Team Starfire
BOINC Chat

ID: 1157994 ·

__W__

Send message
Joined: 28 Mar 09
Posts: 91
Credit: 2,104,389
RAC: 1,990

Someone must have kicked the routers at HE very hard - yiiihhha
Just got 40 WUs and downloaded them in under 2 minutes, in spite of cricket nearly maxed out - and pinging the servers is as fast as never before (from my point of the world) :-) .

Only short time of happiness, ping on .13 and .16 lost in timeouts :-( - .18 and 20 are as fast as before :-) -

__W__

____________
_______________________________________________________________________________

ID: 1158007 ·

Fred J. Verster
Volunteer tester
Avatar

Send message
Joined: 21 Apr 04
Posts: 3232
Credit: 31,585,541
RAC: 1

One rig reported on 1 Oct 2011 | 20:55:08 UTC, but only UPLoad, no work.
Also no more work from SETI Bêta, see an enormous spike at Milkyway.

____________

Knight Who Says Ni N!, OUT numbered.................

ID: 1158009 ·

Ichobod
Send message
Joined: 20 Apr 08
Posts: 6
Credit: 2,948,560
RAC: 0

I've been getting a good amount of cpu but I don't think either of my computers have received any gpu since the last outtage. Is there not enough CUDA to go around or something else is wrong ?

ID: 1158012 ·

Claggy

Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 3363
Credit: 25,950,143
RAC: 1,098

I've been getting a good amount of cpu but I don't think either of my computers have received any gpu since the last outtage. Is there not enough CUDA to go around or something else is wrong ?

Boinc will fill it's fastest device first, be it CPU or GPU, then once that cache is full it will fill the other, (it seems to be operating the other way round at the moment through)
You can try reducing your Cache setting until Boinc no longer asks for CPU work, once the HE link behaves itself you should get some GPU work,

Claggy

ID: 1158013 ·

MikeN

Send message
Joined: 24 Jan 11
Posts: 221
Credit: 16,016,975
RAC: 24,669

Jeff Cobb has posted an update for our woes in the HE thread
http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929

cricket graph seems to be coming back to life. Whoever Jeff kicked, bribed or sweet talked to sort out the connection issues seems to have done the trick

ID: 1158018 ·

soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6231
Credit: 27,516,315
RAC: 9,214

Jeff Cobb has posted an update for our woes in the HE thread
http://setiathome.berkeley.edu/forum_thread.php?id=64652&nowrap=true#1157929

cricket graph seems to be coming back to life. Whoever Jeff kicked, bribed or sweet talked to sort out the connection issues seems to have done the trick

If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew.
____________

Janice

ID: 1158026 ·

Blurf
Volunteer tester
Avatar

Send message
Joined: 2 Sep 06
Posts: 6346
Credit: 5,677,455
RAC: 5,979

If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew.

and dessert is a heaping mound of Mento's :)
____________

ID: 1158030 ·

Donald L. Johnson

Send message
Joined: 5 Aug 02
Posts: 3901
Credit: 359,641
RAC: 823

If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew.

and dessert is a heaping mound of Mento's :)

Mountain Dew Code Red or Voltage (Blue), microwave pizza snacks, and Hershey's miniatures (Ghirardeli when I can get them) or Reece's pieces. (8{)
____________
Donald
Infernal Optimist / Submariner, retired

ID: 1158034 ·

Wembley
Volunteer tester

Send message
Joined: 16 Sep 09
Posts: 415
Credit: 879,818
RAC: 0

If I was Admin in this situation, I would be completely incoherent. These are times that Sadms live on Cheeto's and Mountain Dew.

and dessert is a heaping mound of Mento's :)

Mountain Dew Code Red or Voltage (Blue), microwave pizza snacks, and Hershey's miniatures (Ghirardeli when I can get them) or Reece's pieces. (8{)

Jumbo bag of Skittles. Pretty much pure sugar with some flavoring.
____________

Donate with your searches and online buys:
http://www.goodsearch.com/toolbar/university-of-california-setihome

ID: 1158047 ·

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5059
Credit: 40,885,898
RAC: 52,911

Something(s) definately stuffed.
Outbound network traffic is barely peaking at 60Mb/s, for a while there it wasn't even peaking at 30Mb/s. This is with both of my machines not having reached the present limits. One of them actually ran out of work because the upload server was down at one stage, and the backoffs from that resulted in it backing off for over 4 hours. At the moment it's backed off for over 6 hours due to the problem with the Scheduler.
Most requests to the Scheduler result in "project has no tasks available", which is odd considering the very low level of network traffic. When it does connect, it gets 2-3 tasks (DCF of 1.2).
However at the present moment all attempts to contect the Scheduler result in failure.

2/10/2011 8:57:30 SETI@home Sending scheduler request: To fetch work.
2/10/2011 8:57:30 SETI@home Reporting 6 completed tasks, requesting new tasks for CPU and GPU
2/10/2011 8:57:52 Project communication failed: attempting access to reference site
2/10/2011 8:57:52 SETI@home Scheduler request failed: Couldn't connect to server
2/10/2011 8:57:54 Internet access OK - project servers may be temporarily down.

and repeat time & time again.
____________
Grant
Darwin NT.

ID: 1158052 ·