Panic Mode On (76) Server Problems?


log in

Advanced search

Message boards : Number crunching : Panic Mode On (76) Server Problems?

Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 21 · Next
Author Message
Profile Gatekeeper
Avatar
Send message
Joined: 14 Jul 04
Posts: 887
Credit: 176,479,616
RAC: 0
United States
Message 1276775 - Posted: 28 Aug 2012, 21:05:56 UTC
Last modified: 28 Aug 2012, 21:06:29 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.
____________

Profile Fred E.
Volunteer tester
Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 2
United States
Message 1276810 - Posted: 28 Aug 2012, 22:34:54 UTC
Last modified: 28 Aug 2012, 22:38:35 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.


Similar problems, although a couple got through on NNT. Task page is very sluggish, sometimes times out. Still running without replica.

Edit: and they are splitting astropulse. Want to reach out and grab!
____________
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.

Profile Bernie VineProject donor
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 26 May 99
Posts: 7650
Credit: 33,381,859
RAC: 22,533
United Kingdom
Message 1276818 - Posted: 28 Aug 2012, 23:17:05 UTC

Just getting "project has no tasks available" here.
____________


Sometimes it is the people no one imagines anything of who do the things that no one can imagine.

Profile Wiggo
Avatar
Send message
Joined: 24 Jan 00
Posts: 9164
Credit: 109,245,667
RAC: 69,929
Australia
Message 1276820 - Posted: 28 Aug 2012, 23:23:56 UTC - in response to Message 1276818.

Just getting "project has no tasks available" here.

You're lucky just connecting with the servers but the cricket graph is dropping out as we speak.

Cheers.
____________

.clair.
Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 29,693,696
RAC: 11,594
United Kingdom
Message 1276829 - Posted: 29 Aug 2012, 0:27:54 UTC
Last modified: 29 Aug 2012, 0:29:33 UTC

Cricket taking a dive
No jobs avail
Timeout
internal server error
Yup geting the `sumat`s broke` feeling.
Just about the time when the crew go home.

Is it me or is the forum gettingg ss ll ooo wwwe

Profile Gatekeeper
Avatar
Send message
Joined: 14 Jul 04
Posts: 887
Credit: 176,479,616
RAC: 0
United States
Message 1276832 - Posted: 29 Aug 2012, 0:41:19 UTC - in response to Message 1276775.
Last modified: 29 Aug 2012, 0:42:04 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.


Update: 4 hours later and no change. Cricket's dropping as mentioned. And there doesn't appear to have been a stats dump today.
____________

Profile ivan
Volunteer tester
Avatar
Send message
Joined: 5 Mar 01
Posts: 694
Credit: 167,312,409
RAC: 136,283
United Kingdom
Message 1276835 - Posted: 29 Aug 2012, 0:53:15 UTC - in response to Message 1276832.

I don't seem to have had any new tasks since before the outage. Bit hard to be totally sure because the task pages are so slow to load. Notice "replica behind master" says offline, despite the green in the left-hand column...

____________

Cosmic_Ocean
Avatar
Send message
Joined: 23 Dec 00
Posts: 2461
Credit: 9,389,463
RAC: 2,764
United States
Message 1276837 - Posted: 29 Aug 2012, 1:14:02 UTC

Contacting the scheduler seems to be hit or miss for me. It timed out one time, then was fine the next, then 5 minutes after that, timed out three times in a row, then connected.

No new work since coming back for me, either.
____________

Linux laptop uptime: 1484d 22h 42m
Ended due to UPS failure, found 14 hours after the fact

Profile betregerProject donor
Avatar
Send message
Joined: 29 Jun 99
Posts: 3012
Credit: 6,717,934
RAC: 7,537
United States
Message 1276855 - Posted: 29 Aug 2012, 2:54:04 UTC

Is thinman dying?
____________

Profile arkaynProject donor
Volunteer tester
Avatar
Send message
Joined: 14 May 99
Posts: 3809
Credit: 48,779,443
RAC: 2
United States
Message 1276865 - Posted: 29 Aug 2012, 3:29:04 UTC - in response to Message 1276855.

Is thinman dying?


Thinman is the web server, Synergy is the scheduling server and should be able to handle the load just fine.

synergy: Intel Server (2 x hexa-core 2.53GHz Xeon, 96 GB RAM)
thinman: Sun V40z (4 x 2.2GHz Opteron, 28 GB RAM)

http://setiathome.berkeley.edu/sah_status.html
____________

Profile Slavac
Volunteer tester
Avatar
Send message
Joined: 27 Apr 11
Posts: 1932
Credit: 17,952,639
RAC: 0
United States
Message 1276881 - Posted: 29 Aug 2012, 4:36:13 UTC - in response to Message 1276855.

Is thinman dying?


Thinman should be fine but may be supplemented with another server down the road. We've cleared out 4 servers I think to date with more scheduled which frees up a few machines to do simple tasks like web servers.

Here's all I'm seeing recently:

8/28/2012 10:15:22 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:15:44 PM Project communication failed: attempting access to reference site
8/28/2012 10:15:44 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:15:45 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:16:49 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:16:49 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:18:28 PM SETI@home Scheduler request failed: HTTP internal server error
8/28/2012 10:19:28 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:19:28 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:21:45 PM SETI@home Scheduler request failed: HTTP internal server error
8/28/2012 10:22:45 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:22:45 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:25:46 PM Project communication failed: attempting access to reference site
8/28/2012 10:25:46 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:25:48 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:26:56 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:26:56 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:27:39 PM Project communication failed: attempting access to reference site
8/28/2012 10:27:39 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:27:40 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:28:59 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:28:59 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:30:18 PM Project communication failed: attempting access to reference site
8/28/2012 10:30:18 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:30:19 PM Internet access OK - project servers may be temporarily down.

____________


Executive Director GPU Users Group Inc. -
brad@gpuug.org

Profile Dirk SadowskiProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 6800
Credit: 62,287,584
RAC: 5,840
Germany
Message 1276882 - Posted: 29 Aug 2012, 4:36:41 UTC
Last modified: 29 Aug 2012, 5:04:25 UTC

My BOINC get:
Scheduler request failed: Couldn't connect to server
.. and ..
Scheduler request failed: HTTP internal server error
[EDIT#2: .. and ..
Scheduler request failed: Server returned nothing (no headers, no data)]

.. messages.

Scheduler server URL x.20 is not reachable well.


[EDIT#1: Last contact of my BOINC to scheduler server: Aug/29 2012, 0:18:16 UTC (from the online overview).]


* Best regards! :-) * Sutaru Tsureku, team seti.international founder. * Optimize your PC for higher RAC. * SETI@home needs your help. *
____________

Keith White
Avatar
Send message
Joined: 29 May 99
Posts: 373
Credit: 3,407,235
RAC: 2,655
United States
Message 1276888 - Posted: 29 Aug 2012, 5:04:26 UTC

Even getting a list of currently assigned tasks is taking a very long time before a response. Feels like a problem with the database drive array being cranky.
____________
"Life is just nature's way of keeping meat fresh." - The Doctor

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 6228
Credit: 69,431,935
RAC: 48,645
Australia
Message 1276890 - Posted: 29 Aug 2012, 5:10:48 UTC - in response to Message 1276888.


No luck contacting the Scheduler here, and looking at the network traffic graphs it's only at 10Mb/s where it should be around 17-19Mb/s.
Server status shows green, but the Scheduler isn't responding.
____________
Grant
Darwin NT.

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 40860
Credit: 665,993,638
RAC: 362,415
United States
Message 1276915 - Posted: 29 Aug 2012, 6:43:24 UTC
Last modified: 29 Aug 2012, 6:44:24 UTC

Much trouble connecting to the servers to report here too.
Forums somewhat dodgy.
Either another DOS or bot attack, or something's not happy in serverland.
____________
*********************************************
Behold the power of kitty!!

I have met a few friends in my life.
Most were cats.

AndrewM
Volunteer tester
Send message
Joined: 5 Jan 08
Posts: 369
Credit: 34,275,196
RAC: 98
Australia
Message 1276929 - Posted: 29 Aug 2012, 8:09:43 UTC

I've had 2 sucessful sheduler contacts reporting tasks today, but they're piling up in the validate queue.
Just so you all know reorting is only the first hurdle. Good luck

.clair.
Volunteer moderator
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 29,693,696
RAC: 11,594
United Kingdom
Message 1276957 - Posted: 29 Aug 2012, 10:39:33 UTC

Cricket is as un green as an outage day
Uploads are ok
Downloads ? what do they taste like ?
Time to go down to the switch room
I think we have another moth in a relay

Profile KWSN Ekky Ekky Ekky
Avatar
Send message
Joined: 25 May 99
Posts: 932
Credit: 14,404,363
RAC: 12,074
United Kingdom
Message 1276960 - Posted: 29 Aug 2012, 10:46:13 UTC

Alas poor Bruno.
I knew him Horatio.
____________

juan BFP
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5567
Credit: 324,093,327
RAC: 13,956
Panama
Message 1276966 - Posted: 29 Aug 2012, 10:50:42 UTC - in response to Message 1276915.
Last modified: 29 Aug 2012, 10:59:56 UTC

Much trouble connecting to the servers to report here too.
Forums somewhat dodgy.
Either another DOS or bot attack, or something's not happy in serverland.


Must be the hurracaine arrival at serverland...
Who says there are no hurracaines in CA?
____________

Profile Swordfish
Avatar
Send message
Joined: 5 Aug 06
Posts: 72
Credit: 3,012,670
RAC: 0
United Kingdom
Message 1276968 - Posted: 29 Aug 2012, 10:52:42 UTC

ATI tasks are running out on my network and no new work(CPU or GPU) is being sent out due to problems with the server.
The cricket graph shows a huge tail off since midnight (cricket graph time).

Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 21 · Next

Message boards : Number crunching : Panic Mode On (76) Server Problems?

Copyright © 2015 University of California