The Server Issues / Outages Thread - Panic Mode On! (117)

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 52 · Next

AuthorMessage
Profile B. Ahmet KIRAN

Send message
Joined: 19 Oct 14
Posts: 77
Credit: 36,140,903
RAC: 140
Turkey
Message 2011259 - Posted: 8 Sep 2019, 16:27:09 UTC

Project servers may be temporarily down

Anyone having same problem as below? I've been receiving this message on 4 computers since the last 40~50 minutes, any yet I find no one reporting it? Is it for me only?

08-Sep-19 19:20:18 | SETI@home | Reporting 65 completed tasks
08-Sep-19 19:20:18 | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
08-Sep-19 19:21:32 | SETI@home | Scheduler request failed: Failure when receiving data from the peer
08-Sep-19 19:21:33 | | Project communication failed: attempting access to reference site
08-Sep-19 19:21:36 | | Internet access OK - project servers may be temporarily down.
ID: 2011259 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 2011260 - Posted: 8 Sep 2019, 16:30:55 UTC

Anyone having same problem as below? I've been receiving this message on 4 computers since the last 40~50 minutes, any yet I find no one reporting it? Is it for me only?


Actually that is what the last few post are actually discussing,

Might need to skip down (or up depending on your settings) to read from the start.
ID: 2011260 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2011266 - Posted: 8 Sep 2019, 17:06:15 UTC - in response to Message 2011224.  

It isn't accepting or sending WUs which I thought those functions belonged to different machines.
georgem, vader, and bruno.
Misunderstanding. The upload server (Bruno) is accepting data: the download servers (georgem and vader) are sending data.

The server which has failed is Synergy (the scheduling server) which tells you which data to download, and accepts your report that you've successfully uploaded the completed data.
ID: 2011266 · Report as offensive
wandrr

Send message
Joined: 24 Dec 00
Posts: 19
Credit: 40,182,080
RAC: 48
Canada
Message 2011273 - Posted: 8 Sep 2019, 19:18:14 UTC

Looks like we are back - just got a bunch of tasks.
Arnie
Alberta, Canada
ID: 2011273 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 2011274 - Posted: 8 Sep 2019, 19:20:11 UTC

Eric just replied.
He said Apache was stuck on synergy.
Should be back up now.
Might take quite a bit to settle back down after the outage.
Thank you, Eric!

Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 2011274 · Report as offensive
Profile Freewill Project Donor
Avatar

Send message
Joined: 19 May 99
Posts: 766
Credit: 354,398,348
RAC: 11,693
United States
Message 2011277 - Posted: 8 Sep 2019, 19:39:55 UTC - in response to Message 2011274.  

Eric just replied.
He said Apache was stuck on synergy.
Should be back up now.
Might take quite a bit to settle back down after the outage.
Thank you, Eric!

Meow!


Thank you! At least Eric didn't have to dial in on #caturday
ID: 2011277 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2011281 - Posted: 8 Sep 2019, 19:57:21 UTC
Last modified: 8 Sep 2019, 19:59:44 UTC

I tried my usual solution: I went out the the pub (and had a very nice Sunday roast, thank you for asking). When I got back, Synergy accepted all my completed work, and rewarded all my emptiest machines with new work. It always works...

Edit - georgem and vader are feeling a bit shell-shocked just at the moment - they must have been enjoying a nice Sunday lie-in.
ID: 2011281 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2011282 - Posted: 8 Sep 2019, 20:00:27 UTC - in response to Message 2011281.  

I tried my usual solution: I went out the the pub (and had a very nice Sunday roast, thank you for asking). When I got back, Synergy accepted all my completed work, and rewarded all my emptiest machines with new work. It always works...

My spoofed cache holds for a lot more time, but i will follow your suggestion and go to the bar.
ID: 2011282 · Report as offensive
Bart

Send message
Joined: 23 Apr 03
Posts: 17
Credit: 3,080,489
RAC: 27
United States
Message 2011283 - Posted: 8 Sep 2019, 20:45:44 UTC
Last modified: 8 Sep 2019, 20:46:15 UTC

No new tasks for me yet... Uploaded finished work though...

9/8/2019 3:34:22 PM | SETI@home | Sending scheduler request: Requested by user.
9/8/2019 3:34:22 PM | SETI@home | Reporting 17 completed tasks
9/8/2019 3:34:22 PM | SETI@home | Not requesting tasks: "no new tasks" requested via Manager
9/8/2019 3:34:24 PM | SETI@home | Scheduler request completed
9/8/2019 3:36:03 PM | SETI@home | update requested by user
9/8/2019 3:36:04 PM | SETI@home | Sending scheduler request: Requested by user.
9/8/2019 3:36:04 PM | SETI@home | Not requesting tasks: "no new tasks" requested via Manager
9/8/2019 3:36:07 PM | SETI@home | Scheduler request completed
9/8/2019 3:42:36 PM | SETI@home | work fetch resumed by user
9/8/2019 3:42:40 PM | SETI@home | Sending scheduler request: To fetch work.
9/8/2019 3:42:40 PM | SETI@home | Requesting new tasks for CPU
9/8/2019 3:42:42 PM | SETI@home | Scheduler request completed: got 0 new tasks
9/8/2019 3:42:42 PM | SETI@home | Project has no tasks available
ID: 2011283 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2011286 - Posted: 8 Sep 2019, 21:02:49 UTC - in response to Message 2011283.  
Last modified: 8 Sep 2019, 21:04:04 UTC

The clue is in the log.

9/8/2019 3:36:04 PM | SETI@home | Not requesting tasks: "no new tasks" requested via Manager
But yes, reading as far as "work fetch resumed by user" does help ;-)
ID: 2011286 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2011302 - Posted: 8 Sep 2019, 23:09:30 UTC - in response to Message 2011282.  

I tried my usual solution: I went out the the pub (and had a very nice Sunday roast, thank you for asking). When I got back, Synergy accepted all my completed work, and rewarded all my emptiest machines with new work. It always works...

My spoofed cache holds for a lot more time, but i will follow your suggestion and go to the bar.

. . Days like this make me wish I was able, or brave enough to try, to set up the spoofed cache on these machines :(

Stephen

:(
ID: 2011302 · Report as offensive
Profile Mike-fr

Send message
Joined: 13 Jan 01
Posts: 5
Credit: 2,422,149
RAC: 1
France
Message 2011736 - Posted: 12 Sep 2019, 15:11:44 UTC

Hello

same issue since Sep 8 and not resolved for me.

12-Sep-2019 16:59:51 [SETI@home] Fetching scheduler list
12-Sep-2019 16:59:53 [---] Project communication failed: attempting access to reference site
12-Sep-2019 16:59:54 [---] Internet access OK - project servers may be temporarily down.

i have restarted my boinc manager without success.

regards.
Michel.
ID: 2011736 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2011739 - Posted: 12 Sep 2019, 15:32:38 UTC - in response to Message 2011736.  

Hello
same issue since Sep 8 and not resolved for me.
12-Sep-2019 16:59:51 [SETI@home] Fetching scheduler list
12-Sep-2019 16:59:53 [---] Project communication failed: attempting access to reference site
12-Sep-2019 16:59:54 [---] Internet access OK - project servers may be temporarily down.
i have restarted my boinc manager without success.
regards.
Michel.

. . The project had server issues on the 8th but they have been fixed, I cannot explain why you are still having troubles. It is very late at night here and I am not thinking that clearly. You can access the forums OK it seems so I have no explanation at the moment :(

Stephen

. .
ID: 2011739 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2011740 - Posted: 12 Sep 2019, 15:38:40 UTC - in response to Message 2011739.  
Last modified: 12 Sep 2019, 15:41:19 UTC

Hello
same issue since Sep 8 and not resolved for me.
12-Sep-2019 16:59:51 [SETI@home] Fetching scheduler list
12-Sep-2019 16:59:53 [---] Project communication failed: attempting access to reference site
12-Sep-2019 16:59:54 [---] Internet access OK - project servers may be temporarily down.
i have restarted my boinc manager without success.
regards.
Michel.

. . The project had server issues on the 8th but they have been fixed, I cannot explain why you are still having troubles. It is very late at night here and I am not thinking that clearly. You can access the forums OK it seems so I have no explanation at the moment :(

Stephen

. .

It's working fine here. DL & UL ok.

Until someone give you a better answer, i suggest to check your route to the lab or the DNS and see if there are some broken link.
ID: 2011740 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2011817 - Posted: 13 Sep 2019, 6:59:58 UTC - in response to Message 2011736.  

Hello

same issue since Sep 8 and not resolved for me.

12-Sep-2019 16:59:51 [SETI@home] Fetching scheduler list
12-Sep-2019 16:59:53 [---] Project communication failed: attempting access to reference site
12-Sep-2019 16:59:54 [---] Internet access OK - project servers may be temporarily down.

i have restarted my boinc manager without success.
Any recent software updates, such as your AntiVirus programme on or around that date? Configuration changes to AV/firewall software?
Grant
Darwin NT
ID: 2011817 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 2011819 - Posted: 13 Sep 2019, 7:11:40 UTC

As Juan alluded to, first thing I'd try is to Start>Run> CMD, then do an ipconfig /flushdns, if in fact this is still happening.
ID: 2011819 · Report as offensive
Profile Mike-fr

Send message
Joined: 13 Jan 01
Posts: 5
Credit: 2,422,149
RAC: 1
France
Message 2011835 - Posted: 13 Sep 2019, 13:30:50 UTC - in response to Message 2011819.  

hello

i use boinc_7.2.42_i686-pc-linux-gnu.sh
on Centos 5.11

i tried iptables -F
i set another dns
no antivirus on this linux and no change since Sept 08

13-Sep-2019 15:19:12 [---] Starting BOINC client version 6.2.15 for i686-pc-linux-gnu
13-Sep-2019 15:19:12 [---] log flags: task, file_xfer, sched_ops
13-Sep-2019 15:19:12 [---] Libraries: libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3 c-ares/1.5.1
13-Sep-2019 15:19:12 [---] Data directory: /usr/local/BOINC
13-Sep-2019 15:19:12 [---] Processor: 8 AuthenticAMD AMD FX-8320E Eight-Core Processor [Family 21 Model 2 Stepping 0]
13-Sep-2019 15:19:12 [---] Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc nonstop_tsc cpb pni ssse3 cx16 sse4_1 sse4_2 popcnt lahf_lm cmp_legacy svm extapic cr8l
13-Sep-2019 15:19:12 [---] OS: Linux: 2.6.18-308.el5PAE
13-Sep-2019 15:19:12 [---] Memory: 15.83 GB physical, 4.91 GB virtual
13-Sep-2019 15:19:12 [---] Disk: 446.32 GB total, 353.07 GB free
13-Sep-2019 15:19:12 [---] Local time is UTC +2 hours
13-Sep-2019 15:19:12 [---] No coprocessors
13-Sep-2019 15:19:12 [SETI@home] URL: http://setiathome.berkeley.edu/; Computer ID: 8237426; location: home; project prefs: default
13-Sep-2019 15:19:12 [---] No general preferences found - using BOINC defaults
13-Sep-2019 15:19:12 [---] Reading preferences override file
13-Sep-2019 15:19:12 [---] Preferences limit memory usage when active to 8104.71MB
13-Sep-2019 15:19:12 [---] Preferences limit memory usage when idle to 11346.59MB
13-Sep-2019 15:19:12 [---] Preferences limit disk usage to 13.97GB
13-Sep-2019 15:22:38 [SETI@home] Fetching scheduler list
13-Sep-2019 15:22:39 [---] Project communication failed: attempting access to reference site
13-Sep-2019 15:22:40 [---] Internet access OK - project servers may be temporarily down.

regards.
Michel
ID: 2011835 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2011841 - Posted: 13 Sep 2019, 13:46:06 UTC - in response to Message 2011835.  

With a client as old as that, you may be using an outdated security certificate in ca-bundle.crt

Enable <http_debug> event logging to see the server responses in detail, and if they reveal an https handshaking failure, replace the security bundle from another machine or a more modern download.
ID: 2011841 · Report as offensive
Profile Mike-fr

Send message
Joined: 13 Jan 01
Posts: 5
Credit: 2,422,149
RAC: 1
France
Message 2011844 - Posted: 13 Sep 2019, 14:09:37 UTC - in response to Message 2011841.  

i set http_debug.
it is a SSL3 certificate error:

13-Sep-2019 16:04:10 [---] [http_debug] HTTP_OP::init_get(): http://boinc.berkeley.edu/project_list.php
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: About to connect() to boinc.berkeley.edu port 80 (#0)
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Trying 208.68.240.115...
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Connected to boinc.berkeley.edu (208.68.240.115) port 80 (#0)
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Sent header to server: GET /project_list.php HTTP/1.1
User-Agent: BOINC client (i686-pc-linux-gnu 6.2.15)
Host: boinc.berkeley.edu
Accept: */*
Accept-Encoding: deflate, gzip
Content-Type: application/x-www-form-urlencoded

13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: HTTP/1.1 301 Moved Permanently
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Date: Fri, 13 Sep 2019 14:04:10 GMT
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Server: Apache/2.2.15 (Scientific Linux)
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Location: https://boinc.berkeley.edu/project_list.php
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Content-Length: 345
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Connection: close
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server: Content-Type: text/html; charset=iso-8859-1
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] Received header from server:
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Closing connection #0
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Issue another request to this URL: 'https://boinc.berkeley.edu/project_list.php'
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: About to connect() to boinc.berkeley.edu port 443 (#0)
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Trying 208.68.240.115...
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Connected to boinc.berkeley.edu (208.68.240.115) port 443 (#0)
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: successfully set certificate verify locations:
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: CAfile: ca-bundle.crt
CApath: none
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: SSLv2, Client hello (1):
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: SSLv3, TLS handshake, Server hello (2):
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: SSLv3, TLS handshake, CERT (11):
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: SSLv3, TLS alert, Server hello (2):
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: SSL certificate problem, verify that the CA cert is OK. Details:
error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Expire cleared
13-Sep-2019 16:04:10 [---] [http_debug] [ID#0] info: Connection #0 to host boinc.berkeley.edu left intact
13-Sep-2019 16:04:10 [---] [http_debug] HTTP error: Peer certificate cannot be authenticated with known CA certificates
ID: 2011844 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2011845 - Posted: 13 Sep 2019, 14:25:14 UTC - in response to Message 2011844.  
Last modified: 13 Sep 2019, 14:34:28 UTC

For Windows, BOINC supplies its own copy of the security certificates in the program directory.

Looking at my Linux Mint system, every reference to ca-bundle.crt on the machine (including the one in the boinc-client folder) links back to a central copy located at

/etc/ssl/certs/ca-certificates.crt
I don't know how that translates to Centos 5.11, but I hope that gives you some clues as to where you need to start looking.

Edit: try https://raymii.org/s/snippets/CentOS_5_CA_Certificate_Bundle_Update.html
ID: 2011845 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 52 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.