Panic Mode On (76) Server Problems?


log in

Advanced search

Message boards : Number crunching : Panic Mode On (76) Server Problems?

Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 21 · Next
Author Message
Profile Gatekeeper
Avatar
Send message
Joined: 14 Jul 04
Posts: 887
Credit: 176,479,616
RAC: 0
United States
Message 1276775 - Posted: 28 Aug 2012, 21:05:56 UTC
Last modified: 28 Aug 2012, 21:06:29 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.
____________

Profile Fred E.
Volunteer tester
Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 0
United States
Message 1276810 - Posted: 28 Aug 2012, 22:34:54 UTC
Last modified: 28 Aug 2012, 22:38:35 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.


Similar problems, although a couple got through on NNT. Task page is very sluggish, sometimes times out. Still running without replica.

Edit: and they are splitting astropulse. Want to reach out and grab!
____________
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.

Profile Bernie VineProject donor
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 26 May 99
Posts: 7925
Credit: 35,586,431
RAC: 33,403
United Kingdom
Message 1276818 - Posted: 28 Aug 2012, 23:17:05 UTC

Just getting "project has no tasks available" here.
____________

Profile Wiggo
Avatar
Send message
Joined: 24 Jan 00
Posts: 9452
Credit: 116,321,550
RAC: 73,480
Australia
Message 1276820 - Posted: 28 Aug 2012, 23:23:56 UTC - in response to Message 1276818.

Just getting "project has no tasks available" here.

You're lucky just connecting with the servers but the cricket graph is dropping out as we speak.

Cheers.
____________

.clair.
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 29,816,496
RAC: 1,011
United Kingdom
Message 1276829 - Posted: 29 Aug 2012, 0:27:54 UTC
Last modified: 29 Aug 2012, 0:29:33 UTC

Cricket taking a dive
No jobs avail
Timeout
internal server error
Yup geting the `sumat`s broke` feeling.
Just about the time when the crew go home.

Is it me or is the forum gettingg ss ll ooo wwwe

Profile Gatekeeper
Avatar
Send message
Joined: 14 Jul 04
Posts: 887
Credit: 176,479,616
RAC: 0
United States
Message 1276832 - Posted: 29 Aug 2012, 0:41:19 UTC - in response to Message 1276775.
Last modified: 29 Aug 2012, 0:42:04 UTC

All my scheduler requests since the project came back up are ending with HTTP Internal server errors. I'm at 6.12.34 with the max tasks option in cc_config. Looks like there's something amiss server-side.


Update: 4 hours later and no change. Cricket's dropping as mentioned. And there doesn't appear to have been a stats dump today.
____________

Profile ivan
Volunteer tester
Avatar
Send message
Joined: 5 Mar 01
Posts: 757
Credit: 181,033,556
RAC: 148,785
United Kingdom
Message 1276835 - Posted: 29 Aug 2012, 0:53:15 UTC - in response to Message 1276832.

I don't seem to have had any new tasks since before the outage. Bit hard to be totally sure because the task pages are so slow to load. Notice "replica behind master" says offline, despite the green in the left-hand column...

____________

Cosmic_Ocean
Avatar
Send message
Joined: 23 Dec 00
Posts: 2575
Credit: 9,705,256
RAC: 3,843
United States
Message 1276837 - Posted: 29 Aug 2012, 1:14:02 UTC

Contacting the scheduler seems to be hit or miss for me. It timed out one time, then was fine the next, then 5 minutes after that, timed out three times in a row, then connected.

No new work since coming back for me, either.
____________
Linux laptop:
Record uptime: 1484d 22h 42m
Ended due to UPS failure, as discovered 14 hours later

Current run: 1172d 22h 10m (as of 20150829_1906 UTC)

Profile betregerProject donor
Avatar
Send message
Joined: 29 Jun 99
Posts: 3267
Credit: 7,446,751
RAC: 8,300
United States
Message 1276855 - Posted: 29 Aug 2012, 2:54:04 UTC

Is thinman dying?
____________

Profile arkaynProject donor
Volunteer tester
Avatar
Send message
Joined: 14 May 99
Posts: 3881
Credit: 50,641,515
RAC: 21,653
United States
Message 1276865 - Posted: 29 Aug 2012, 3:29:04 UTC - in response to Message 1276855.

Is thinman dying?


Thinman is the web server, Synergy is the scheduling server and should be able to handle the load just fine.

synergy: Intel Server (2 x hexa-core 2.53GHz Xeon, 96 GB RAM)
thinman: Sun V40z (4 x 2.2GHz Opteron, 28 GB RAM)

http://setiathome.berkeley.edu/sah_status.html
____________

Profile Slavac
Volunteer tester
Avatar
Send message
Joined: 27 Apr 11
Posts: 1932
Credit: 17,952,639
RAC: 0
United States
Message 1276881 - Posted: 29 Aug 2012, 4:36:13 UTC - in response to Message 1276855.

Is thinman dying?


Thinman should be fine but may be supplemented with another server down the road. We've cleared out 4 servers I think to date with more scheduled which frees up a few machines to do simple tasks like web servers.

Here's all I'm seeing recently:

8/28/2012 10:15:22 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:15:44 PM Project communication failed: attempting access to reference site
8/28/2012 10:15:44 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:15:45 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:16:49 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:16:49 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:18:28 PM SETI@home Scheduler request failed: HTTP internal server error
8/28/2012 10:19:28 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:19:28 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:21:45 PM SETI@home Scheduler request failed: HTTP internal server error
8/28/2012 10:22:45 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:22:45 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:25:46 PM Project communication failed: attempting access to reference site
8/28/2012 10:25:46 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:25:48 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:26:56 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:26:56 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:27:39 PM Project communication failed: attempting access to reference site
8/28/2012 10:27:39 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:27:40 PM Internet access OK - project servers may be temporarily down.
8/28/2012 10:28:59 PM SETI@home Sending scheduler request: To fetch work.
8/28/2012 10:28:59 PM SETI@home Requesting new tasks for GPU
8/28/2012 10:30:18 PM Project communication failed: attempting access to reference site
8/28/2012 10:30:18 PM SETI@home Scheduler request failed: Failure when receiving data from the peer
8/28/2012 10:30:19 PM Internet access OK - project servers may be temporarily down.

____________


Executive Director GPU Users Group Inc. -
brad@gpuug.org

Profile [#1@SETI] Dirk SadowskiProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 6896
Credit: 62,961,388
RAC: 7,631
Germany
Message 1276882 - Posted: 29 Aug 2012, 4:36:41 UTC
Last modified: 29 Aug 2012, 5:04:25 UTC

My BOINC get:
Scheduler request failed: Couldn't connect to server
.. and ..
Scheduler request failed: HTTP internal server error
[EDIT#2: .. and ..
Scheduler request failed: Server returned nothing (no headers, no data)]

.. messages.

Scheduler server URL x.20 is not reachable well.


[EDIT#1: Last contact of my BOINC to scheduler server: Aug/29 2012, 0:18:16 UTC (from the online overview).]


* Best regards! :-) * Sutaru Tsureku, team seti.international founder. * Optimize your PC for higher RAC. * SETI@home needs your help. *
____________

Keith White
Avatar
Send message
Joined: 29 May 99
Posts: 383
Credit: 3,661,719
RAC: 2,282
United States
Message 1276888 - Posted: 29 Aug 2012, 5:04:26 UTC

Even getting a list of currently assigned tasks is taking a very long time before a response. Feels like a problem with the database drive array being cranky.
____________
"Life is just nature's way of keeping meat fresh." - The Doctor

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 6396
Credit: 74,234,914
RAC: 47,343
Australia
Message 1276890 - Posted: 29 Aug 2012, 5:10:48 UTC - in response to Message 1276888.


No luck contacting the Scheduler here, and looking at the network traffic graphs it's only at 10Mb/s where it should be around 17-19Mb/s.
Server status shows green, but the Scheduler isn't responding.
____________
Grant
Darwin NT.

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 42221
Credit: 703,917,895
RAC: 404,719
United States
Message 1276915 - Posted: 29 Aug 2012, 6:43:24 UTC
Last modified: 29 Aug 2012, 6:44:24 UTC

Much trouble connecting to the servers to report here too.
Forums somewhat dodgy.
Either another DOS or bot attack, or something's not happy in serverland.
____________
**************************
PCs, kitties, and kibblestones.
That would be me.


I have met a few friends in my life.
Most were cats.

AndrewM
Volunteer tester
Send message
Joined: 5 Jan 08
Posts: 369
Credit: 34,275,196
RAC: 0
Australia
Message 1276929 - Posted: 29 Aug 2012, 8:09:43 UTC

I've had 2 sucessful sheduler contacts reporting tasks today, but they're piling up in the validate queue.
Just so you all know reorting is only the first hurdle. Good luck

.clair.
Send message
Joined: 4 Nov 04
Posts: 1300
Credit: 29,816,496
RAC: 1,011
United Kingdom
Message 1276957 - Posted: 29 Aug 2012, 10:39:33 UTC

Cricket is as un green as an outage day
Uploads are ok
Downloads ? what do they taste like ?
Time to go down to the switch room
I think we have another moth in a relay

Profile KWSN Ekky Ekky Ekky
Avatar
Send message
Joined: 25 May 99
Posts: 932
Credit: 15,704,688
RAC: 12,355
United Kingdom
Message 1276960 - Posted: 29 Aug 2012, 10:46:13 UTC

Alas poor Bruno.
I knew him Horatio.
____________

juan BFP
Volunteer tester
Avatar
Send message
Joined: 16 Mar 07
Posts: 5636
Credit: 326,094,544
RAC: 34,015
Panama
Message 1276966 - Posted: 29 Aug 2012, 10:50:42 UTC - in response to Message 1276915.
Last modified: 29 Aug 2012, 10:59:56 UTC

Much trouble connecting to the servers to report here too.
Forums somewhat dodgy.
Either another DOS or bot attack, or something's not happy in serverland.


Must be the hurracaine arrival at serverland...
Who says there are no hurracaines in CA?
____________

Profile Swordfish
Avatar
Send message
Joined: 5 Aug 06
Posts: 72
Credit: 3,012,670
RAC: 0
United Kingdom
Message 1276968 - Posted: 29 Aug 2012, 10:52:42 UTC

ATI tasks are running out on my network and no new work(CPU or GPU) is being sent out due to problems with the server.
The cricket graph shows a huge tail off since midnight (cricket graph time).

Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 21 · Next

Message boards : Number crunching : Panic Mode On (76) Server Problems?

Copyright © 2015 University of California