Panic Mode On (115) Server Problems?

Message boards : Number crunching : Panic Mode On (115) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · Next

AuthorMessage
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1858
Credit: 268,616,081
RAC: 1,349
United States
Message 1987310 - Posted: 26 Mar 2019, 21:47:14 UTC
Last modified: 26 Mar 2019, 22:34:29 UTC

{}
ID: 1987310 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1646
Credit: 12,921,799
RAC: 89
New Zealand
Message 1987312 - Posted: 26 Mar 2019, 21:58:58 UTC - in response to Message 1987310.  

SSPs stalled.

Looks good at 21: 50: 06
ID: 1987312 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3835
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 1987337 - Posted: 27 Mar 2019, 0:03:11 UTC - in response to Message 1987303.  

all my stuck downloads cleared. things seem smooth, for now.


Dr. K. indicated that there was actually an issue with the campus networking... he's done a workaround so it seems to have resolved it. Whew. :^)
ID: 1987337 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1987357 - Posted: 27 Mar 2019, 0:52:30 UTC - in response to Message 1987337.  

Interesting. When the issue first popped up I did a look at the campus network status page and didn't see anything related to our part of it. Just some Wi-Fi network issues and time card reporting issues.

http://systemstatus.berkeley.edu/
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1987357 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 1987383 - Posted: 27 Mar 2019, 4:36:24 UTC

8 hours since the outage, and the splitters are still struggling.
Glad that the uploads have been sorted out.
Grant
Darwin NT
ID: 1987383 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1987388 - Posted: 27 Mar 2019, 6:02:39 UTC

I see the download backoff problem has arisen again ...
ID: 1987388 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 1987391 - Posted: 27 Mar 2019, 6:21:41 UTC - in response to Message 1987388.  

I see the download backoff problem has arisen again ...

Just checked my log, and there were certainly download issues for a while there.
Grant
Darwin NT
ID: 1987391 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1987393 - Posted: 27 Mar 2019, 7:03:50 UTC - in response to Message 1987391.  

I have around 50 tasks in download backoff currently among my hosts.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1987393 · Report as offensive
Cherokee150

Send message
Joined: 11 Nov 99
Posts: 192
Credit: 58,513,758
RAC: 74
United States
Message 1987394 - Posted: 27 Mar 2019, 7:34:50 UTC - in response to Message 1987206.  

Thank you, Mr. Kevvy! I didn't know you could set a project resource to zero. That would certainly make it easier when SETI is short on new units. I'll give it a try.
ID: 1987394 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 37598
Credit: 261,360,520
RAC: 489
Australia
Message 1987395 - Posted: 27 Mar 2019, 8:01:47 UTC - in response to Message 1987394.  

Thank you, Mr. Kevvy! I didn't know you could set a project resource to zero. That would certainly make it easier when SETI is short on new units. I'll give it a try.
Some projects won't allow a 0% resource setting, but will allow a 1%, 0.1% or 0.01% setting which is almost as good as 0%. ;-)

Cheers.
ID: 1987395 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5126
Credit: 276,046,078
RAC: 462
Message 1987417 - Posted: 27 Mar 2019, 12:23:30 UTC - in response to Message 1987289.  

Yep downloads are stalled.
just as I posted things got unstuck, whining often works, that is one of the basic laws of physics.


Biophysics?
A proud member of the OFA (Old Farts Association).
ID: 1987417 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1987446 - Posted: 27 Mar 2019, 16:16:40 UTC

looking at the low Results out in the Field number and the growing RTS number I'm guessing we are still having a communications problem. It was stated earlier that this is a Berkley network issue, so I guess we need to wait this out. Is there anything on our end we can do? DNS entries?
ID: 1987446 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1987457 - Posted: 27 Mar 2019, 16:35:20 UTC - in response to Message 1987446.  

looking at the low Results out in the Field number and the growing RTS number I'm guessing we are still having a communications problem. It was stated earlier that this is a Berkley network issue, so I guess we need to wait this out. Is there anything on our end we can do? DNS entries?
People would have to examine their own Event Logs and make an informed choice based on what they see there.

DNS entries are only an informed choice if the Event Log contains entries like "Couldn't resolve host name".
ID: 1987457 · Report as offensive
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1382
Credit: 54,506,847
RAC: 60
United States
Message 1987462 - Posted: 27 Mar 2019, 17:33:48 UTC - in response to Message 1987457.  
Last modified: 27 Mar 2019, 17:36:21 UTC

We slowly climbing out of the ditch, but we still don't have a cause. It started suddenly at 7am Monday, so we're guessing that there was a change in hardware/software/DNS or routing at that point. We've got a trouble ticket in with campus networking and they are looking into it.

(My workaround was just to not let connection attempts sit in the local queues for long periods of time. Quick drops are often much better than those that hang around and prevent other connections.
That seems to have fixed the log jam, but there may still be people who can't connect.)
@SETIEric@qoto.org (Mastodon)

ID: 1987462 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1987464 - Posted: 27 Mar 2019, 18:04:09 UTC - in response to Message 1987462.  

Hello Eric, It's good to see you in here :)
I was looking a little bit ago, and the computer I seem to be having the most problem with doesn't have static DNS entries.
The other only drop a few connections, but eventually they go through on their own.
Hopefully they can sort it out.
ID: 1987464 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1987469 - Posted: 27 Mar 2019, 19:06:00 UTC - in response to Message 1987464.  
Last modified: 27 Mar 2019, 19:09:57 UTC

Thanks for the update Eric. That seems to be the case with my hosts. If the download request doesn't go through immediately, it drops out to a backoff.

[Edit] After looking at http_debug, I'm not sure if there is any DNS issue.

Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Connected to boinc2.ssl.berkeley.edu (208.68.240.127) port 80 (#51041)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: GET /sah/download_fanout/bc/26mr19ac.2101.22971.6.33.215 HTTP/1.1
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Host: boinc2.ssl.berkeley.edu
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: User-Agent: BOINC client (x86_64-pc-linux-gnu 7.15.0)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept: */*
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept-Encoding: deflate, gzip
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept-Language: en_US
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server:
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42639] Info: Empty reply from server
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42639] Info: Connection #51040 to host boinc2.ssl.berkeley.edu left intact
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] HTTP error: Server returned nothing (no headers, no data)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Empty reply from server
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Connection #51041 to host boinc2.ssl.berkeley.edu left intact
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] HTTP error: Server returned nothing (no headers, no data)
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Temporarily failed download of 26mr19ac.12199.21335.15.42.201: transient HTTP error
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Backing off 00:02:48 on download of 26mr19ac.12199.21335.15.42.201
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Temporarily failed download of 26mr19ac.2101.22971.6.33.215: transient HTTP error
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Backing off 00:02:00 on download of 26mr19ac.2101.22971.6.33.215
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1987469 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1987479 - Posted: 27 Mar 2019, 20:22:15 UTC

Seems to come and go. Stuck downloads for a while on all hosts that eventually clear. Then a period of no download issues. Then back to stalled downloads and backoffs.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1987479 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1987498 - Posted: 27 Mar 2019, 21:45:57 UTC - in response to Message 1987464.  

Hello Eric, It's good to see you in here :)
I was looking a little bit ago, and the computer I seem to be having the most problem with doesn't have static DNS entries.
The other only drop a few connections, but eventually they go through on their own.
Hopefully they can sort it out.


Eric does know to look for the most recent Panic Mode thread, he is just a very infrequent poster.

ID: 1987498 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1987499 - Posted: 27 Mar 2019, 22:36:39 UTC - in response to Message 1987498.  

Eric does know to look for the most recent Panic Mode thread, he is just a very infrequent poster.
The Panic Mode threads started in a light-hearted way, and it's good to keep them that way. But they do serve a valuable purpose, which is one reason why I try to pounce on demonstrably false 'information' posted in them.
ID: 1987499 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1987512 - Posted: 27 Mar 2019, 23:45:24 UTC - in response to Message 1987469.  

Thanks for the update Eric. That seems to be the case with my hosts. If the download request doesn't go through immediately, it drops out to a backoff.

[Edit] After looking at http_debug, I'm not sure if there is any DNS issue.

Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Connected to boinc2.ssl.berkeley.edu (208.68.240.127) port 80 (#51041)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: GET /sah/download_fanout/bc/26mr19ac.2101.22971.6.33.215 HTTP/1.1
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Host: boinc2.ssl.berkeley.edu
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: User-Agent: BOINC client (x86_64-pc-linux-gnu 7.15.0)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept: */*
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept-Encoding: deflate, gzip
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server: Accept-Language: en_US
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Sent header to server:
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42639] Info: Empty reply from server
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42639] Info: Connection #51040 to host boinc2.ssl.berkeley.edu left intact
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] HTTP error: Server returned nothing (no headers, no data)
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Empty reply from server
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] [ID#42640] Info: Connection #51041 to host boinc2.ssl.berkeley.edu left intact
Wed 27 Mar 2019 12:07:00 PM PDT | SETI@home | [http] HTTP error: Server returned nothing (no headers, no data)
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Temporarily failed download of 26mr19ac.12199.21335.15.42.201: transient HTTP error
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Backing off 00:02:48 on download of 26mr19ac.12199.21335.15.42.201
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Temporarily failed download of 26mr19ac.2101.22971.6.33.215: transient HTTP error
Wed 27 Mar 2019 12:07:01 PM PDT | SETI@home | Backing off 00:02:00 on download of 26mr19ac.2101.22971.6.33.215



I knew it...It was you Keith!!! bahahahaha....
ID: 1987512 · Report as offensive
Previous · 1 . . . 26 · 27 · 28 · 29 · 30 · Next

Message boards : Number crunching : Panic Mode On (115) Server Problems?


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.