Can't report completed tasks due to "Scheduler request failed: HTTP internal server error"

Questions and Answers : Unix/Linux : Can't report completed tasks due to "Scheduler request failed: HTTP internal server error"
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2001406 - Posted: 6 Jul 2019, 22:31:05 UTC
Last modified: 10 Jul 2019, 11:20:21 UTC

This computer hasn't reported tasks in days. When started BOINC tries to report and a few minutes later gives "Scheduler request failed: HTTP internal server error". Using TBar's latest AIO; Mint 19.1 is a derivative of Ubuntu 18.4.
Note: I accidentally created a duplicate of this hostname in my Computers while troubleshooting but it has a different ID so it won't interfere with this one.

I already:
    * Verified internet connection is fine for everything else
  • Verified firewall is off (which is Mint's default)
  • Rebooted
  • Checked the hosts file for bad entries and removed everything unnecessary
  • Enabled/disabled network and NNT (I did get the master file download message as well)
  • Flushed the DNS cache with "sudo systemd-resolve --flush-caches" and "systemctl restart systemd-resolved.service"
  • Set max_tasks_reported in cc_config.xml to 100
  • Added "208.68.240.126 setiboinc.ssl.berkeley.edu" to hosts
  • Found that netstat -tupn shows boincmgr connected to localhost 127.0.0.1 rather than an external SETI@Home IP address
  • Found that BOINC > Projects shows "Scheduler request pending, Requested by user, Scheduler request in progress" even when BOINC is quit completely and restarted and there is no "user request"
    * Moved the entire BOINC folder to another known-working BOINC computer changing its hostname to match and the same thing happened, showing that it's a BOINC issue, not the computer or OS



I enabled everything in the Event Log and here's the start until it repeats awaiting the timeout. Sorry it's so long...

Sat 06 Jul 2019 07:33:08 AM EDT |  | 0 persistent file xfers
Sat 06 Jul 2019 07:33:08 AM EDT |  | 0 active tasks
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | URL http://setiathome.berkeley.edu/; Computer ID 8705341; resource share 100
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | General prefs: from SETI@home (last modified 03-Mar-2016 06:55:05)
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | Computer location: home
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | General prefs: no separate prefs for home; using your defaults
Sat 06 Jul 2019 07:33:08 AM EDT |  | Reading preferences override file
Sat 06 Jul 2019 07:33:08 AM EDT |  | Preferences:
Sat 06 Jul 2019 07:33:08 AM EDT |  | max memory usage when active: 3548.36 MB
Sat 06 Jul 2019 07:33:08 AM EDT |  | max memory usage when idle: 3548.36 MB
Sat 06 Jul 2019 07:33:08 AM EDT |  | max disk usage: 22.10 GB
Sat 06 Jul 2019 07:33:08 AM EDT |  | (to change preferences, visit a project web site or select Preferences in the Manager)
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] Request CPU reschedule: Prefs update
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] Request work fetch: Prefs update
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] Request CPU reschedule: Startup
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] Request work fetch: Startup
Sat 06 Jul 2019 07:33:08 AM EDT |  | Setting up project and slot directories
Sat 06 Jul 2019 07:33:08 AM EDT |  | Checking active tasks
Sat 06 Jul 2019 07:33:08 AM EDT |  | [statefile] set dirty: init
Sat 06 Jul 2019 07:33:08 AM EDT |  | Setting up GUI RPC socket
Sat 06 Jul 2019 07:33:08 AM EDT |  | [gui_rpc] Local control only allowed
Sat 06 Jul 2019 07:33:08 AM EDT |  | [gui_rpc] Listening on port 31416
Sat 06 Jul 2019 07:33:08 AM EDT |  | Checking presence of 6474 project files
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] adding feed: http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d, 86400 sec
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] feed: http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d, 86400 sec
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] processing notice: New SETI Perspectives:  "Seeing the Unseeable: The Black Hole Image"
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] adding notice 1
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] processing notice: Private message
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] scanning old notice 1: New SETI Perspectives:  "Seeing the Unseeable: The Black Hole Image"
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] adding notice 2
Sat 06 Jul 2019 07:33:08 AM EDT |  | read 2 total notices
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] Request CPU reschedule: Not idle
Sat 06 Jul 2019 07:33:08 AM EDT |  | [mem_usage] All others: WS 1494.86MB, swap 55473.18MB, user 42.900s, kernel 31.410s
Sat 06 Jul 2019 07:33:08 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:08 AM EDT |  | [notice] start fetch from http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:08 AM EDT |  | [http] HTTP_OP::init_get(): http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:08 AM EDT |  | [proxy] HTTP_OP::no_proxy_for_url(): http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:08 AM EDT |  | [proxy] returning false
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] Request CPU reschedule: periodic CPU scheduling
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [prio] recent est credit: 0.00G in 5.73 sec, 12797165.958044 + -146.317937 ->12797019.640107
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] schedule_cpus(): start
Sat 06 Jul 2019 07:33:08 AM EDT |  | [rr_sim] start: work_buf min 172800 additional 0 total 172800 on_frac 0.930 active_frac 1.000
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] enforce_run_list(): start
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] preliminary job list:
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] final job list:
Sat 06 Jul 2019 07:33:08 AM EDT |  | [mem_usage] enforce: available RAM 3548.36MB swap 1325.14MB
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] using 0.00 out of 4 CPUs
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] Request work fetch: CPUs idle
Sat 06 Jul 2019 07:33:08 AM EDT |  | [cpu_sched_debug] enforce_run_list: end
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | sched RPC pending: Requested by user
Sat 06 Jul 2019 07:33:08 AM EDT |  | [rr_sim] start: work_buf min 172800 additional 0 total 172800 on_frac 0.930 active_frac 1.000
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [prio] -1.000000 rsf 1.000000 rt 12797019.640107 rs 12797019.640107
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] ------- start work fetch state -------
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] target work buffer: 172800.00 + 0.00 sec
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] --- project states ---
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] REC 12797019.640 prio -1.000 can request work
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] --- state for CPU ---
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] shortfall 691200.00 nidle 4.00 saturated 0.00 busy 0.00
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] share 1.000
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] --- state for NVIDIA GPU ---
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] shortfall 518400.00 nidle 3.00 saturated 0.00 busy 0.00
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] share 1.000
Sat 06 Jul 2019 07:33:08 AM EDT |  | [work_fetch] ------- end work fetch state -------
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] set_request() for CPU: ninst 4 nused_total 0.00 nidle_now 4.00 fetch share 1.00 req_inst 4.00 req_secs 691200.00
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 0.00 nidle_now 3.00 fetch share 1.00 req_inst 3.00 req_secs 518400.00
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [sched_op] Starting scheduler request
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [work_fetch] request: CPU (691200.00 sec, 4.00 inst) NVIDIA GPU (518400.00 sec, 3.00 inst)
Sat 06 Jul 2019 07:33:08 AM EDT |  | [disk_usage] allowed 22624.11MB used 2962.34MB
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [disk_usage] usage 2620.38MB share 24886.52MB
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | Sending scheduler request: Requested by user.
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | Reporting 512 completed tasks
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [sched_op] CPU work request: 691200.00 seconds; 4.00 devices
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [sched_op] NVIDIA GPU work request: 518400.00 seconds; 3.00 devices
Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | [http] HTTP_OP::init_post(): http://setiboinc.ssl.berkeley.edu/sah_cgi/cgi
Sat 06 Jul 2019 07:33:08 AM EDT |  | [proxy] HTTP_OP::no_proxy_for_url(): http://setiboinc.ssl.berkeley.edu/sah_cgi/cgi
Sat 06 Jul 2019 07:33:08 AM EDT |  | [proxy] returning false
Sat 06 Jul 2019 07:33:08 AM EDT |  | [poll] CLIENT_STATE::poll_slow_events(): scheduler_rpc
Sat 06 Jul 2019 07:33:08 AM EDT |  | [statefile] Writing state file
Sat 06 Jul 2019 07:33:11 AM EDT |  | [statefile] Done writing state file
Sat 06 Jul 2019 07:33:11 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 1 tasks active
Sat 06 Jul 2019 07:33:11 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:11 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 0 tasks active
Sat 06 Jul 2019 07:33:11 AM EDT |  | [time] dt 26.238149 susp_reason 0 gpu_susp_reason 0
Sat 06 Jul 2019 07:33:11 AM EDT |  | [time] w2 0.999970 on 0.929523; active 0.999959; gpu_active 0.999959; conn -1.000000, cpu_and_net_avail 0.251361
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] got new GUI RPC connection
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><auth1/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><nonce>1562412791.200918</nonce></boinc_gui_rpc_reply>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><auth2><nonce_hash>34c5b3f8054966534f833d67676b8a9a</nonce_hash></auth2></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><authorized/></boinc_gui_rpc_reply>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><exchange_versions>   <major>7</major>   <minor>14</minor>   <release>2</release></exchange_versions></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><server_version>   <major>7</major>   <minor>14</minor>   <release>2</release></server_version></boin'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_cc_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [network_status] status: online
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><cc_status>   <network_status>0</network_status>   <ams_password_error>0</ams_password_error>   <task_s'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_state/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><client_state><host_info>    <timezone>-14400</timezone>    <domain_name>BeaterCruncher3</domain_name>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:    Trying 208.68.240.110...
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  TCP_NODELAY set
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Info:    Trying 208.68.240.126...
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Info:  TCP_NODELAY set
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_project_init_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><get_project_init_status>    <url></url>    <name></name>    <team_name></team_name>    <setup_cookie>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><acct_mgr_info/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><acct_mgr_info>   <acct_mgr_url></acct_mgr_url>   <acct_mgr_name></acct_mgr_name></acct_mgr_info></boi'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_project_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><projects><project>    <master_url>http://setiathome.berkeley.edu/</master_url>    <project_name>SETI@h'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><acct_mgr_info/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><acct_mgr_info>   <acct_mgr_url></acct_mgr_url>   <acct_mgr_name></acct_mgr_name></acct_mgr_info></boi'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  Connected to setiathome.berkeley.edu (208.68.240.110) port 80 (#0)
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: GET /notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d HTTP/1.1
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: Host: setiathome.berkeley.edu
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: User-Agent: BOINC client (x86_64-pc-linux-gnu 7.14.2)
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: Accept: */*
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: Content-Type: application/x-www-form-urlencoded
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: Accept-Language: en_CA
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server:
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Sent header to server: te:5
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Info:  Connected to setiboinc.ssl.berkeley.edu (208.68.240.126) port 80 (#1)
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: POST /sah_cgi/cgi HTTP/1.1
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Host: setiboinc.ssl.berkeley.edu
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: User-Agent: BOINC client (x86_64-pc-linux-gnu 7.14.2)
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Accept: */*
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Accept-Language: en_CA
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Content-Length: 29583615
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server: Expect: 100-continue
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Sent header to server:
Sat 06 Jul 2019 07:33:11 AM EDT | SETI@home | [http] [ID#1] Received header from server: HTTP/1.1 100 Continue
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: HTTP/1.1 302 Found
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Date: Sat, 06 Jul 2019 11:33:11 GMT
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Server: Apache/2.2.15 (Scientific Linux)
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: X-Powered-By: PHP/5.3.3
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Location: https://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Content-Length: 0
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Connection: close
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server: Content-Type: text/html; charset=UTF-8
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Received header from server:
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  Closing connection 0
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  Issue another request to this URL: 'https://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d'
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:    Trying 208.68.240.110...
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  TCP_NODELAY set
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  Connected to setiathome.berkeley.edu (208.68.240.110) port 443 (#2)
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  found 133 certificates in /etc/ssl/certs/ca-certificates.crt
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  found 402 certificates in /etc/ssl/certs
Sat 06 Jul 2019 07:33:11 AM EDT |  | [http] [ID#0] Info:  ALPN, offering http/1.1
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  SSL connection using TLS1.2 / ECDHE_RSA_AES_256_GCM_SHA384
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 server certificate verification OK
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 server certificate status verification SKIPPED
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 common name: setiathome.berkeley.edu (matched)
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 server certificate expiration date OK
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 server certificate activation date OK
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 certificate public key: RSA
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 certificate version: #3
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 subject: CN=setiathome.berkeley.edu
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 start date: Thu, 09 May 2019 20:25:04 GMT
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 expire date: Wed, 07 Aug 2019 20:25:04 GMT
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 issuer: C=US,O=Let's Encrypt,CN=Let's Encrypt Authority X3
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  	 compression: NULL
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  ALPN, server did not agree to a protocol
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: GET /notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d HTTP/1.1
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Host: setiathome.berkeley.edu
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: User-Agent: BOINC client (x86_64-pc-linux-gnu 7.14.2)
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Accept: */*
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Referer: http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Content-Type: application/x-www-form-urlencoded
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server: Accept-Language: en_CA
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Sent header to server:
Sat 06 Jul 2019 07:33:12 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:12 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 0 tasks active
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: HTTP/1.1 200 OK
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Date: Sat, 06 Jul 2019 11:33:12 GMT
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Server: Apache/2.2.15 (Scientific Linux)
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: X-Powered-By: PHP/5.3.3
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Expires: Sat, 06 Jul 2019 11:33:12 GMT
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Last-Modified: Sat, 06 Jul 2019 11:33:12 GMT
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Content-Length: 1455
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Connection: close
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server: Content-Type: application/xml
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Received header from server:
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http_xfer] [ID#0] HTTP: wrote 1455 bytes
Sat 06 Jul 2019 07:33:12 AM EDT |  | [http] [ID#0] Info:  Closing connection 2
Sat 06 Jul 2019 07:33:13 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] handling reply from http://setiathome.berkeley.edu/notices.php?userid=9652&auth=9652_4de752a06d640b1fed5702c24144bb6d
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] parsed RSS feed: total 2 error 0 added 0
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] processing notice: Private message
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] scanning old notice 2: New SETI Perspectives:  "Seeing the Unseeable: The Black Hole Image"
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] scanning old notice 1: Private message
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] keeping identical older notice 1
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] processing notice: New SETI Perspectives:  "Seeing the Unseeable: The Black Hole Image"
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] scanning old notice 2: New SETI Perspectives:  "Seeing the Unseeable: The Black Hole Image"
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] keeping identical older notice 2
Sat 06 Jul 2019 07:33:13 AM EDT |  | [notice] scanning old notice 1: Private message
Sat 06 Jul 2019 07:33:13 AM EDT |  | [poll] CLIENT_STATE::poll_slow_events(): gui_http
Sat 06 Jul 2019 07:33:13 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 1 tasks active
Sat 06 Jul 2019 07:33:13 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:13 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 0 tasks active
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><set_language>    <language>en_CA</language></set_language></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:13 AM EDT |  | [statefile] set dirty: set_language
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><success/></boinc_gui_rpc_reply>'
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_cc_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:13 AM EDT |  | [network_status] status: online
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><cc_status>   <network_status>0</network_status>   <ams_password_error>0</ams_password_error>   <task_s'
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_messages>  <seqno>0</seqno>  <translatable/></get_messages></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:13 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><msgs><msg> <project></project> <pri>1</pri> <seqno>11192</seqno> <body><![CDATA[    blc64_2bit_gupp'
Sat 06 Jul 2019 07:33:14 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_notices>   <seqno>0</seqno></get_notices></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:14 AM EDT |  | NOTICES::write: seqno 0, refresh false, 2 notices
Sat 06 Jul 2019 07:33:14 AM EDT |  | NOTICES::write: sending notice 1
Sat 06 Jul 2019 07:33:14 AM EDT |  | NOTICES::write: sending notice 2
Sat 06 Jul 2019 07:33:14 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><notices><notice>   <title>Private message</title>   <description><![CDATA[You have received a <a href'
Sat 06 Jul 2019 07:33:14 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_project_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:14 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><projects><project>    <master_url>http://setiathome.berkeley.edu/</master_url>    <project_name>SETI@h'
Sat 06 Jul 2019 07:33:14 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason
Sat 06 Jul 2019 07:33:14 AM EDT |  | [statefile] Writing state file
Sat 06 Jul 2019 07:33:16 AM EDT |  | [statefile] Done writing state file

[------This block then just repeats every second------]

Sat 06 Jul 2019 07:33:16 AM EDT |  | [poll] CLIENT_STATE::do_something(): End poll: 0 tasks active
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_cc_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [network_status] status: online
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><cc_status>   <network_status>0</network_status>   <ams_password_error>0</ams_password_error>   <task_s'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_messages>  <seqno>13192</seqno>  <translatable/></get_messages></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><msgs><msg> <project></project> <pri>1</pri> <seqno>13193</seqno> <body><![CDATA[[gui_rpc] GUI RPC r'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_project_status/></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><projects><project>    <master_url>http://setiathome.berkeley.edu/</master_url>    <project_name>SETI@h'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC Command = '<boinc_gui_rpc_request><get_messages>  <seqno>13208</seqno>  <translatable/></get_messages></boinc_gui_rpc_request>'
Sat 06 Jul 2019 07:33:16 AM EDT |  | [gui_rpc] GUI RPC reply: '<boinc_gui_rpc_reply><msgs><msg> <project></project> <pri>1</pri> <seqno>13209</seqno> <body><![CDATA[[gui_rpc] GUI RPC r'
Sat 06 Jul 2019 07:33:17 AM EDT |  | [suspend] net_susp: no; file_xfer_susp: no; reason: unknown reason

[------End repeat block------]


Thanks for any assistance!
ID: 2001406 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 2001418 - Posted: 6 Jul 2019, 23:28:18 UTC

No Programme permissions relating to network connections? Firewall permissions?
Grant
Darwin NT
ID: 2001418 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2001458 - Posted: 7 Jul 2019, 2:55:02 UTC - in response to Message 2001418.  

Not that I know of... firewall is off (by default in Mint as well) and also on the other computer where this BOINC does the same, but its own connects properly.
ID: 2001458 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2001914 - Posted: 10 Jul 2019, 11:16:18 UTC
Last modified: 10 Jul 2019, 11:35:16 UTC

Well I am at a loss... the very same thing has happened again. I reinstalled the AIO on that machine wiping out all traces of the old one (backed it up to a flash drive) and it worked since the time of my last update, and now the same thing has happened again and it is refusing to contact the scheduler.

I'm adding more data into the first post as I find it so that it's all one place.

Edit: I may have found the issue in client_state.xml. If one of the video cards has issues and won't initialize, repeating error blocks are accumulating in the stderr of the work units, which are then too large to be reported so the scheduler throws an error, which in any other circumstance would mean it was down or having issues. I'm going to remove those blocks and retry. I will post the details and I'm archiving client_state.xml as this may need to go to the developers...
ID: 2001914 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2001920 - Posted: 10 Jul 2019, 12:20:34 UTC - in response to Message 2001406.  

I see

Sat 06 Jul 2019 07:33:08 AM EDT | SETI@home | Reporting 512 completed tasks
Please (for debugging purposes) look for the file 'sched_request_setiathome.berkeley.edu.xml' in your BOINC data directory and record the file size in KB or - more likely - MB. I have a suspicion that the internal server errors are more likely when the size of this file grows when multiple task reports are combined.

Then, find and edit your 'cc_config.xml' file. Look for the line

<max_tasks_reported>0</max_tasks_reported>
and set an actual number - I usually suggest 64. Save the file, select 'Read config files' in BOINC Manager (options menu), and try a manual update again.
ID: 2001920 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2001922 - Posted: 10 Jul 2019, 12:35:09 UTC - in response to Message 2001920.  
Last modified: 10 Jul 2019, 12:55:16 UTC

Firstly, thank you for replying!

sched_request_setiathome.berkeley.edu is 6.9MB and yup, it's full of those same repeating bad init blocks.... I'll send you a .7z of it.

cc_config.xml already has

<max_tasks_reported>100</max_tasks_reported>


It was 512 earlier. However: I had not placed it at first so if it's still showing zero, this appears to be further evidence as well as the "user initiated" scheduler request on startup that BOINC is futilely trying to complete old sched. requests rather than starting a new ones with the changed parameters.

Edit: Success! I reduced <max_tasks_reported> to 10 and it went through! Seems to also be working, albeit slowly, with 64 (nice call) so I will leave it on that permanently.
ID: 2001922 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2001928 - Posted: 10 Jul 2019, 13:20:08 UTC - in response to Message 2001922.  

That does seem to say that 'size matters'. Whether it's because the server runs out of memory, or because it runs out of time, I'll leave it to Eric to diagnose from the server logs.

The zero setting was a quick illustrative paste from my travelling laptop - it can't be seen remotely. I think in this case, zero means unrestricted.

To save time, remember that you can make updates as often as you like - you don't need to respect the 3:03 time out. But you DO need to respect the timeout when the backlog has cleared and you're ready to request new tasks.

BTW, I find it's also quicker to clear this sort of problem if you set 'No New Tasks' while you're clearing the backlog - turn it back on only when things are under control.
ID: 2001928 · Report as offensive

Questions and Answers : Unix/Linux : Can't report completed tasks due to "Scheduler request failed: HTTP internal server error"


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.