Panic Mode On (109) Server Problems?

Message boards : Number crunching : Panic Mode On (109) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 36 · Next

AuthorMessage
Profile Chris904395093209d Project Donor
Volunteer tester

Send message
Joined: 1 Jan 01
Posts: 112
Credit: 29,923,129
RAC: 6
United States
Message 1907095 - Posted: 14 Dec 2017, 23:21:54 UTC

I too am not getting any new work. Scratch that, I just got 15 tasks on my main Windows 10 machine.
~Chris

ID: 1907095 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1907111 - Posted: 15 Dec 2017, 0:29:07 UTC - in response to Message 1907090.  

. . Well after the unscheduled 3 hour outage a few hours ago I am now getting mostly "no tasks available". Won't be long until I am out of work again. :(

. . Maybe I should give the guys a rest anyway with the heat we've been having lately. A/C isn't coping and with the wick turned way up it it still 30 C in here :(

. . Oh well ... I'll give it another hour ...


[edit] . . OK, it is eerie but just co-incidence, after posting that I received two full downloads of over 100 tasks each (before I would only get one or two if any). So I am guessing the issue has again been sorted (had band-aid applied). I am back in business.

Stephen

:)
ID: 1907111 · Report as offensive
Profile bcavnaugh
Avatar

Send message
Joined: 26 Jun 14
Posts: 15
Credit: 9,836,694
RAC: 0
United States
Message 1907121 - Posted: 15 Dec 2017, 1:18:35 UTC
Last modified: 15 Dec 2017, 1:19:01 UTC

I guess that is why I am not able to get any Tasks for the day or two.

Crunching@EVGA The Number One Team in the BOINC Community. Folding@EVGA The Number One Team in the Folding@Home Community.
ID: 1907121 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1907127 - Posted: 15 Dec 2017, 1:27:14 UTC
Last modified: 15 Dec 2017, 1:38:12 UTC

Any of the BOINC experts care to chime in on my question in my previous post? What causes backoffs?
[Edit] Let me amend the question with some facts. I did a search on "backoffs" and hit posts back to 2011.

My Event Log shows no problems with contacting the servers. I don't have any uploads or downloads stalled.

So are the backoffs simply because I keep getting the "no tasks are available" message from the scheduler?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1907127 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11408
Credit: 29,581,041
RAC: 66
United States
Message 1907139 - Posted: 15 Dec 2017, 1:52:52 UTC - in response to Message 1907127.  

So are the backoffs simply because I keep getting the "no tasks are available" message from the scheduler?

Yep
ID: 1907139 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1907151 - Posted: 15 Dec 2017, 2:17:57 UTC - in response to Message 1907139.  

So are the backoffs simply because I keep getting the "no tasks are available" message from the scheduler?

Yep

Arrgh! So I need to just keep hammering on the scheduler to try to get work and once I do, the backoffs are ended until the next round of backoffs caused by no work.

Not a very well designed "set and forget" system is it?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1907151 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1907161 - Posted: 15 Dec 2017, 2:56:06 UTC

That's the approach I posted earlier that I think the project should take. Just take the project down and fix the servers properly and take as long as needed. I can't handle the constant band-aid up and down lately.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1907161 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13835
Credit: 208,696,464
RAC: 304
Australia
Message 1907172 - Posted: 15 Dec 2017, 3:55:20 UTC - in response to Message 1907092.  

So a question for the group. What criteria does the scheduler use to put a host into backoff. For both cpu and gpu conditions?

It's not the Scheduler, it's the Manager that implements the backoffs.
Grant
Darwin NT
ID: 1907172 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13835
Credit: 208,696,464
RAC: 304
Australia
Message 1907173 - Posted: 15 Dec 2017, 3:58:34 UTC

Well, the Server status page is back, and it still doesn't look good.
Still having Assimilation/deletion issues. The splitters after doing so well appear to be falling over again for lengthy periods, and the Replica just gets further and further behind.
Grant
Darwin NT
ID: 1907173 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 36363
Credit: 261,360,520
RAC: 489
Australia
Message 1907178 - Posted: 15 Dec 2017, 4:25:13 UTC - in response to Message 1907172.  

So a question for the group. What criteria does the scheduler use to put a host into backoff. For both cpu and gpu conditions?

It's not the Scheduler, it's the Manager that implements the backoffs.

That's why I run a very old version off BOINC to avoid those severe backoffs, but I must do more tinkering in the background for it all to work to begin with. ;-)

Cheers.
ID: 1907178 · Report as offensive
Profile David@home
Volunteer tester
Avatar

Send message
Joined: 16 Jan 03
Posts: 755
Credit: 5,040,916
RAC: 28
United Kingdom
Message 1907194 - Posted: 15 Dec 2017, 7:30:26 UTC - in response to Message 1907161.  

That's the approach I posted earlier that I think the project should take. Just take the project down and fix the servers properly and take as long as needed. I can't handle the constant band-aid up and down lately.


+1, I think the SETI team should do that and get ready for Parkes by taking things offline and doing whatever is needed to get the Database sorted.

Looks like my PC survived the night and managed to keep enough work in the cache. When I went to bed the cache was very low and I was half expecting my backup project to kick in, but in the end it didn't.
ID: 1907194 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22447
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1907195 - Posted: 15 Dec 2017, 7:52:32 UTC - in response to Message 1907172.  

The back-offs are administered by your machine.
You enter a back-off state when the communication during a file transfer takes too long. The first few are quite short, but progressively increase to several hours (as you have no doubt observed). The theory behind this is that the by having a back-off the communications link has a chance to recover, and by having a long back-off that chance is increased and the number of "client retry" messages is reduced. However there is a downside in that the large number of long back-offs results in the servers having a lot of "sending" tasks hanging around, which increases the load on the storage system, and the chances of some of the tasks becoming "ghosts". A balancing act that I think has swung too far in the direction of long delays.

There is another type of back-off, which is when the server sends out a message to say "I'm down for maintenance" as the trigger, the starting delay is larger, but the final maximum is about the same.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1907195 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1907200 - Posted: 15 Dec 2017, 8:38:24 UTC

The types of "Backoffs" are Project Backoff and Resource Backoff. You can see the difference in the Work Fetch log.
The most common Project Backoff is the project set 5 minutes between work requests. On semi-fast multi-GPU machines it's difficult to invoke a Resource Backoff as it is reset every time a task is uploaded. You have to not receive a download and not upload a task within 5 minutes. I was able to get one machine to go into resource backoff by having a full cache and starting two BLC4s at the same time. The machine briefly went into resource backoff for the time it took to upload the first completed task and then the backoff disappeared. If you are reporting tasks every 5 minutes you should never see the machine go into resource backoff.

Fri 15 Dec 2017 03:18:38 AM EST | SETI@home | Sending scheduler request: To fetch work.
Fri 15 Dec 2017 03:18:38 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 03:18:38 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 03:18:38 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 119319.31 seconds; 0.00 devices
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | No tasks sent
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | No tasks are available for AstroPulse v7
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | No tasks are available for SETI@home v8
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | This computer has reached a limit on tasks in progress
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | [work_fetch] backing off NVIDIA GPU 394 sec
Fri 15 Dec 2017 03:18:40 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 03:18:40 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 03:18:45 AM EST | SETI@home | [work_fetch] REC 296414.499 prio -0.013 can't request work: scheduler RPC backoff (297.93 sec)
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 141999.36 busy 0.00
Fri 15 Dec 2017 03:18:45 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] shortfall 119334.77 nidle 0.00 saturated 35215.72 busy 0.00
Fri 15 Dec 2017 03:18:45 AM EST | SETI@home | [work_fetch] share 0.000 project is backed off (resource backoff: 388.67, inc 600.00)
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 03:18:45 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 03:19:17 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 03:19:17 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_50280_HIP9598_0012.22152.818.24.47.236.vlar_2 finished
Fri 15 Dec 2017 03:19:17 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_50615_HIP9446_0013.9161.0.23.46.225.vlar_0
Fri 15 Dec 2017 03:19:19 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_50280_HIP9598_0012.22152.818.24.47.236.vlar_2_r1965364715_0
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 03:19:20 AM EST | SETI@home | [work_fetch] REC 296419.695 prio -0.013 can't request work: scheduler RPC backoff (262.85 sec)
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 141978.74 busy 0.00
Fri 15 Dec 2017 03:19:20 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] shortfall 119421.86 nidle 0.00 saturated 35171.88 busy 0.00
Fri 15 Dec 2017 03:19:20 AM EST | SETI@home | [work_fetch] share 0.000 project is backed off (resource backoff: 353.59, inc 600.00)
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 03:19:20 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 03:19:23 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_50280_HIP9598_0012.22152.818.24.47.236.vlar_2_r1965364715_0
Fri 15 Dec 2017 03:19:23 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 03:19:25 AM EST | SETI@home | [work_fetch] REC 296419.695 prio -0.013 can't request work: scheduler RPC backoff (257.79 sec)
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 141974.81 busy 0.00
Fri 15 Dec 2017 03:19:25 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] shortfall 119425.98 nidle 0.00 saturated 35168.66 busy 0.00
Fri 15 Dec 2017 03:19:25 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 03:19:25 AM EST | | [work_fetch] ------- end work fetch state -------


No resource Backoff after the upload.
ID: 1907200 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1907213 - Posted: 15 Dec 2017, 10:10:59 UTC - in response to Message 1907200.  

I noticed the Server has decided to starve one of my other machines, something that has become quite common over the past YEAR. Would the Work Fetch Log Help? I sorta doubt it since nothing has helped over the past Year. I'll post it anyway. The machine has Three nVidia GPUs and the current longest MB BLC4s are taking just over 8 minutes, the cache is set for 1 day and should be around 320~ tasks, it is currently running around 160 or so.. As you can see, the machine is Not going into Resource Backoff, Why is the Server refusing to send the tasks the client is requesting?

Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | [work_fetch] request: CPU (0.00 sec, 0.00 inst) NVIDIA GPU (230334.72 sec, 0.00 inst)
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | Reporting 2 completed tasks
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 04:41:47 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 230334.72 seconds; 0.00 devices
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | Scheduler request completed: got 4 new tasks
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] estimated total CPU task duration: 0 seconds
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] estimated total NVIDIA GPU task duration: 1339 seconds
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_50615_HIP9446_0013.17168.409.23.46.209.vlar_0
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51500_HIP12932_0015.17618.0.23.46.100.vlar_0
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 04:41:53 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 04:41:53 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 04:41:55 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Started download of 17mr07ab.4289.72.12.39.120
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Started download of 17mr07ab.4289.72.12.39.123
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Started download of 17mr07ab.4289.72.12.39.68
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Started download of 17mr07ab.4289.72.12.39.111
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Computation for task 08mr07ag.1050.22976.3.30.149_0 finished
Fri 15 Dec 2017 04:41:55 AM EST | SETI@home | Starting task 10fe07ag.20799.11934.3.30.225_2
Fri 15 Dec 2017 04:41:57 AM EST | SETI@home | Started upload of 08mr07ag.1050.22976.3.30.149_0_r1935988811_0
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | Finished download of 17mr07ab.4289.72.12.39.120
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | Finished download of 17mr07ab.4289.72.12.39.68
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | Finished download of 17mr07ab.4289.72.12.39.111
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | [work_fetch] REC 435387.762 prio -0.005 can't request work: scheduler RPC backoff (297.87 sec)
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96294.50 busy 0.00
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] shortfall 229021.17 nidle 0.00 saturated 18558.06 busy 0.00
Fri 15 Dec 2017 04:41:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:41:58 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:41:59 AM EST | SETI@home | Finished download of 17mr07ab.4289.72.12.39.123
Fri 15 Dec 2017 04:41:59 AM EST | SETI@home | Finished upload of 08mr07ag.1050.22976.3.30.149_0_r1935988811_0
Fri 15 Dec 2017 04:41:59 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:42:03 AM EST | SETI@home | [work_fetch] REC 435388.012 prio -0.005 can't request work: scheduler RPC backoff (292.75 sec)
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96289.08 busy 0.00
Fri 15 Dec 2017 04:42:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] shortfall 229032.45 nidle 0.00 saturated 18551.07 busy 0.00
Fri 15 Dec 2017 04:42:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:42:03 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:42:56 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:42:56 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_52171_HIP13021_0017.22450.409.23.46.14.vlar_1 finished
Fri 15 Dec 2017 04:42:56 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51500_HIP12932_0015.24781.409.23.46.236.vlar_0
Fri 15 Dec 2017 04:42:58 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_52171_HIP13021_0017.22450.409.23.46.14.vlar_1_r1178569859_0
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:42:58 AM EST | SETI@home | [work_fetch] REC 435411.243 prio -0.005 can't request work: scheduler RPC backoff (237.55 sec)
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96208.61 busy 0.00
Fri 15 Dec 2017 04:42:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] shortfall 229246.63 nidle 0.00 saturated 18476.60 busy 0.00
Fri 15 Dec 2017 04:42:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:42:58 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:43:01 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_52171_HIP13021_0017.22450.409.23.46.14.vlar_1_r1178569859_0
Fri 15 Dec 2017 04:43:01 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:43:03 AM EST | SETI@home | [work_fetch] REC 435411.243 prio -0.005 can't request work: scheduler RPC backoff (232.46 sec)
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96205.26 busy 0.00
Fri 15 Dec 2017 04:43:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] shortfall 229261.45 nidle 0.00 saturated 18473.86 busy 0.00
Fri 15 Dec 2017 04:43:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:43:03 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:43:55 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:43:55 AM EST | SETI@home | Computation for task 10fe07ag.20799.11934.3.30.225_2 finished
Fri 15 Dec 2017 04:43:55 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.86.vlar_0
Fri 15 Dec 2017 04:43:57 AM EST | SETI@home | Started upload of 10fe07ag.20799.11934.3.30.225_2_r947362081_0
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:43:58 AM EST | SETI@home | [work_fetch] REC 435436.762 prio -0.005 can't request work: scheduler RPC backoff (177.25 sec)
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96127.77 busy 0.00
Fri 15 Dec 2017 04:43:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] shortfall 229415.50 nidle 0.00 saturated 18423.40 busy 0.00
Fri 15 Dec 2017 04:43:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:43:58 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:44:00 AM EST | SETI@home | Finished upload of 10fe07ag.20799.11934.3.30.225_2_r947362081_0
Fri 15 Dec 2017 04:44:00 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:44:03 AM EST | SETI@home | [work_fetch] REC 435438.440 prio -0.005 can't request work: scheduler RPC backoff (172.17 sec)
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96120.69 busy 0.00
Fri 15 Dec 2017 04:44:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] shortfall 229426.41 nidle 0.00 saturated 18420.67 busy 0.00
Fri 15 Dec 2017 04:44:03 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:44:03 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:45:04 AM EST | SETI@home | [work_fetch] REC 435452.615 prio -0.005 can't request work: scheduler RPC backoff (111.99 sec)
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 96018.05 busy 0.00
Fri 15 Dec 2017 04:45:04 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] shortfall 229535.85 nidle 0.00 saturated 18382.06 busy 0.00
Fri 15 Dec 2017 04:45:04 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:45:04 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:46:04 AM EST | SETI@home | [work_fetch] REC 435466.780 prio -0.005 can't request work: scheduler RPC backoff (51.83 sec)
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95906.47 busy 0.00
Fri 15 Dec 2017 04:46:04 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] shortfall 229700.57 nidle 0.00 saturated 18322.27 busy 0.00
Fri 15 Dec 2017 04:46:04 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:46:04 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:46:39 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_51166_SO0253_0014.24829.0.24.47.92.vlar_1 finished
Fri 15 Dec 2017 04:46:39 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.74.vlar_1
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:46:39 AM EST | SETI@home | [work_fetch] REC 435482.303 prio -0.005 can't request work: scheduler RPC backoff (16.75 sec)
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95844.59 busy 0.00
Fri 15 Dec 2017 04:46:39 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] shortfall 229791.97 nidle 0.00 saturated 18290.95 busy 0.00
Fri 15 Dec 2017 04:46:39 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:46:39 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:46:41 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24829.0.24.47.92.vlar_1_r226374669_0
Fri 15 Dec 2017 04:46:45 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24829.0.24.47.92.vlar_1_r226374669_0
Fri 15 Dec 2017 04:46:45 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:46:49 AM EST | SETI@home | [work_fetch] REC 435482.303 prio -0.005 can't request work: scheduler RPC backoff (6.63 sec)
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95828.96 busy 0.00
Fri 15 Dec 2017 04:46:49 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] shortfall 229817.57 nidle 0.00 saturated 18285.51 busy 0.00
Fri 15 Dec 2017 04:46:49 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:46:49 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:46:56 AM EST | | [work_fetch] Request work fetch: Backoff ended for SETI@home
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [work_fetch] REC 435482.303 prio -1.005 can request work
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95811.04 busy 0.00
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] shortfall 229835.43 nidle 0.00 saturated 18280.67 busy 0.00
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:46:59 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 137.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 229835.43
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [work_fetch] request: CPU (0.00 sec, 0.00 inst) NVIDIA GPU (229835.43 sec, 0.00 inst)
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | Reporting 4 completed tasks
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 04:46:59 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 229835.43 seconds; 0.00 devices
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | Scheduler request completed: got 2 new tasks
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] estimated total CPU task duration: 0 seconds
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] estimated total NVIDIA GPU task duration: 325 seconds
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_52171_HIP13021_0017.22450.409.23.46.14.vlar_1
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 08mr07ag.1050.22976.3.30.149_0
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51166_SO0253_0014.24829.0.24.47.92.vlar_1
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 10fe07ag.20799.11934.3.30.225_2
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 04:47:06 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 04:47:06 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 04:47:08 AM EST | SETI@home | Started download of 09mr07af.5164.19704.16.43.3
Fri 15 Dec 2017 04:47:08 AM EST | SETI@home | Started download of 17mr07ab.4289.481.12.39.200
Fri 15 Dec 2017 04:47:11 AM EST | SETI@home | Finished download of 09mr07af.5164.19704.16.43.3
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:47:11 AM EST | SETI@home | [work_fetch] REC 435489.911 prio -0.005 can't request work: scheduler RPC backoff (297.87 sec)
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95790.40 busy 0.00
Fri 15 Dec 2017 04:47:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] shortfall 229540.24 nidle 0.00 saturated 18482.30 busy 0.00
Fri 15 Dec 2017 04:47:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:47:11 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:47:12 AM EST | SETI@home | Finished download of 17mr07ab.4289.481.12.39.200
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:48:11 AM EST | SETI@home | [work_fetch] REC 435490.158 prio -0.005 can't request work: scheduler RPC backoff (237.60 sec)
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95679.00 busy 0.00
Fri 15 Dec 2017 04:48:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] shortfall 229701.77 nidle 0.00 saturated 18429.81 busy 0.00
Fri 15 Dec 2017 04:48:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:48:11 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:49:12 AM EST | SETI@home | [work_fetch] REC 435504.338 prio -0.005 can't request work: scheduler RPC backoff (177.43 sec)
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95575.47 busy 0.00
Fri 15 Dec 2017 04:49:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] shortfall 229862.75 nidle 0.00 saturated 18367.80 busy 0.00
Fri 15 Dec 2017 04:49:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:49:12 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:50:12 AM EST | SETI@home | [work_fetch] REC 435518.507 prio -0.005 can't request work: scheduler RPC backoff (117.24 sec)
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95465.22 busy 0.00
Fri 15 Dec 2017 04:50:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] shortfall 230017.79 nidle 0.00 saturated 18314.94 busy 0.00
Fri 15 Dec 2017 04:50:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:50:12 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:51:12 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_51500_HIP12932_0015.24781.409.23.46.236.vlar_0 finished
Fri 15 Dec 2017 04:51:12 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_52508_SO0253_0018.29047.0.23.46.158.vlar_0
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:51:12 AM EST | SETI@home | [work_fetch] REC 435558.125 prio -0.005 can't request work: scheduler RPC backoff (57.08 sec)
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95358.72 busy 0.00
Fri 15 Dec 2017 04:51:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] shortfall 230199.82 nidle 0.00 saturated 18250.20 busy 0.00
Fri 15 Dec 2017 04:51:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:51:12 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:51:14 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_51500_HIP12932_0015.24781.409.23.46.236.vlar_0_r770906967_0
Fri 15 Dec 2017 04:51:18 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_51500_HIP12932_0015.24781.409.23.46.236.vlar_0_r770906967_0
Fri 15 Dec 2017 04:51:18 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:51:22 AM EST | SETI@home | [work_fetch] REC 435558.125 prio -0.005 can't request work: scheduler RPC backoff (46.96 sec)
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95342.71 busy 0.00
Fri 15 Dec 2017 04:51:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] shortfall 230223.23 nidle 0.00 saturated 18243.86 busy 0.00
Fri 15 Dec 2017 04:51:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:51:22 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:52:09 AM EST | | [work_fetch] Request work fetch: Backoff ended for SETI@home
Fri 15 Dec 2017 04:52:11 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:52:11 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.86.vlar_0 finished
Fri 15 Dec 2017 04:52:11 AM EST | SETI@home | Starting task 14fe07ad.28757.13569.15.42.157_0
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [work_fetch] REC 435583.606 prio -1.005 can request work
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95248.95 busy 0.00
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] shortfall 230367.08 nidle 0.00 saturated 18197.71 busy 0.00
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:52:12 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 137.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 230367.08
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [work_fetch] request: CPU (0.00 sec, 0.00 inst) NVIDIA GPU (230367.08 sec, 0.00 inst)
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | Reporting 1 completed tasks
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 04:52:12 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 230367.08 seconds; 0.00 devices
Fri 15 Dec 2017 04:52:13 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.86.vlar_0_r59251866_0
Fri 15 Dec 2017 04:52:15 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.86.vlar_0_r59251866_0
Fri 15 Dec 2017 04:52:15 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | Project has no tasks available
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51500_HIP12932_0015.24781.409.23.46.236.vlar_0
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 04:52:20 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 04:52:20 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:52:26 AM EST | SETI@home | [work_fetch] REC 435583.606 prio -0.005 can't request work: scheduler RPC backoff (297.85 sec)
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95224.43 busy 0.00
Fri 15 Dec 2017 04:52:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] shortfall 230397.12 nidle 0.00 saturated 18190.79 busy 0.00
Fri 15 Dec 2017 04:52:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:52:26 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:53:26 AM EST | SETI@home | [work_fetch] REC 435597.829 prio -0.004 can't request work: scheduler RPC backoff (237.67 sec)
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 95122.89 busy 0.00
Fri 15 Dec 2017 04:53:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] shortfall 230540.93 nidle 0.00 saturated 18133.77 busy 0.00
Fri 15 Dec 2017 04:53:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:53:26 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:54:26 AM EST | SETI@home | [work_fetch] REC 435611.995 prio -0.004 can't request work: scheduler RPC backoff (177.48 sec)
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] shortfall 23.11 nidle 0.00 saturated 95016.89 busy 0.00
Fri 15 Dec 2017 04:54:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] shortfall 230734.68 nidle 0.00 saturated 18079.26 busy 0.00
Fri 15 Dec 2017 04:54:26 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:54:26 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:55:00 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:55:00 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.74.vlar_1 finished
Fri 15 Dec 2017 04:55:00 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51166_SO0253_0014.29585.409.24.47.185.vlar_0
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:55:01 AM EST | SETI@home | [work_fetch] REC 435632.705 prio -0.004 can't request work: scheduler RPC backoff (142.32 sec)
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] shortfall 80.15 nidle 0.00 saturated 94959.85 busy 0.00
Fri 15 Dec 2017 04:55:01 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] shortfall 230850.82 nidle 0.00 saturated 18041.76 busy 0.00
Fri 15 Dec 2017 04:55:01 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:55:01 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:55:02 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.74.vlar_1_r469245715_0
Fri 15 Dec 2017 04:55:07 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.74.vlar_1_r469245715_0
Fri 15 Dec 2017 04:55:07 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:55:11 AM EST | SETI@home | [work_fetch] REC 435632.705 prio -0.004 can't request work: scheduler RPC backoff (132.25 sec)
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] shortfall 98.84 nidle 0.00 saturated 94941.16 busy 0.00
Fri 15 Dec 2017 04:55:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] shortfall 230873.42 nidle 0.00 saturated 18029.54 busy 0.00
Fri 15 Dec 2017 04:55:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:55:11 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:56:11 AM EST | SETI@home | [work_fetch] REC 435647.120 prio -0.004 can't request work: scheduler RPC backoff (72.10 sec)
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] shortfall 201.14 nidle 0.00 saturated 94838.86 busy 0.00
Fri 15 Dec 2017 04:56:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] shortfall 231085.91 nidle 0.00 saturated 17943.92 busy 0.00
Fri 15 Dec 2017 04:56:11 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:56:11 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:57:12 AM EST | SETI@home | [work_fetch] REC 435661.379 prio -0.004 can't request work: scheduler RPC backoff (11.44 sec)
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] shortfall 300.42 nidle 0.00 saturated 94739.58 busy 0.00
Fri 15 Dec 2017 04:57:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] shortfall 231291.40 nidle 0.00 saturated 17880.48 busy 0.00
Fri 15 Dec 2017 04:57:12 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:57:12 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:57:24 AM EST | | [work_fetch] Request work fetch: Backoff ended for SETI@home
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] REC 435661.379 prio -1.004 can request work
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] shortfall 325.03 nidle 0.00 saturated 94714.97 busy 0.00
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] shortfall 231347.10 nidle 0.00 saturated 17864.66 busy 0.00
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 04:57:27 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] set_request() for CPU: ninst 2 nused_total 38.60 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 325.03
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 136.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 231347.10
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [work_fetch] request: CPU (325.03 sec, 0.00 inst) NVIDIA GPU (231347.10 sec, 0.00 inst)
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | Reporting 2 completed tasks
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [sched_op] CPU work request: 325.03 seconds; 0.00 devices
Fri 15 Dec 2017 04:57:27 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 231347.10 seconds; 0.00 devices
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | Project has no tasks available
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.86.vlar_0
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51166_SO0253_0014.24868.409.23.46.74.vlar_1
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 04:57:34 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 04:57:34 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:57:39 AM EST | SETI@home | [work_fetch] REC 435661.379 prio -0.004 can't request work: scheduler RPC backoff (297.90 sec)
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] shortfall 345.34 nidle 0.00 saturated 94694.66 busy 0.00
Fri 15 Dec 2017 04:57:39 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] shortfall 231385.48 nidle 0.00 saturated 17856.41 busy 0.00
Fri 15 Dec 2017 04:57:39 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:57:39 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:58:07 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:58:07 AM EST | SETI@home | Computation for task 14fe07ad.28757.13569.15.42.157_0 finished
Fri 15 Dec 2017 04:58:07 AM EST | SETI@home | Starting task 08mr07ag.10803.4571.4.31.236_0
Fri 15 Dec 2017 04:58:09 AM EST | SETI@home | Started upload of 14fe07ad.28757.13569.15.42.157_0_r1230941329_0
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:58:10 AM EST | SETI@home | [work_fetch] REC 435677.399 prio -0.004 can't request work: scheduler RPC backoff (267.34 sec)
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] shortfall 392.89 nidle 0.00 saturated 94647.11 busy 0.00
Fri 15 Dec 2017 04:58:10 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] shortfall 231417.93 nidle 0.00 saturated 17839.45 busy 0.00
Fri 15 Dec 2017 04:58:10 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:58:10 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:58:11 AM EST | SETI@home | Finished upload of 14fe07ad.28757.13569.15.42.157_0_r1230941329_0
Fri 15 Dec 2017 04:58:11 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:58:15 AM EST | SETI@home | [work_fetch] REC 435677.399 prio -0.004 can't request work: scheduler RPC backoff (262.19 sec)
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] shortfall 401.68 nidle 0.00 saturated 94638.32 busy 0.00
Fri 15 Dec 2017 04:58:15 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] shortfall 231427.17 nidle 0.00 saturated 17835.98 busy 0.00
Fri 15 Dec 2017 04:58:15 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:58:15 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:58:50 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 04:58:50 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_52508_SO0253_0018.29047.0.23.46.158.vlar_0 finished
Fri 15 Dec 2017 04:58:50 AM EST | SETI@home | Starting task 14fe07ad.30095.10297.14.41.243_0
Fri 15 Dec 2017 04:58:52 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_52508_SO0253_0018.29047.0.23.46.158.vlar_0_r843084162_0
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:58:52 AM EST | SETI@home | [work_fetch] REC 435695.977 prio -0.004 can't request work: scheduler RPC backoff (225.34 sec)
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] shortfall 462.80 nidle 0.00 saturated 94577.20 busy 0.00
Fri 15 Dec 2017 04:58:52 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] shortfall 231594.84 nidle 0.00 saturated 17777.02 busy 0.00
Fri 15 Dec 2017 04:58:52 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:58:52 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:58:54 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_52508_SO0253_0018.29047.0.23.46.158.vlar_0_r843084162_0
Fri 15 Dec 2017 04:58:54 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:58:57 AM EST | SETI@home | [work_fetch] REC 435695.977 prio -0.004 can't request work: scheduler RPC backoff (220.27 sec)
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] shortfall 469.36 nidle 0.00 saturated 94570.64 busy 0.00
Fri 15 Dec 2017 04:58:57 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] shortfall 231608.97 nidle 0.00 saturated 17772.60 busy 0.00
Fri 15 Dec 2017 04:58:57 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:58:57 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 04:59:57 AM EST | SETI@home | [work_fetch] REC 435710.236 prio -0.004 can't request work: scheduler RPC backoff (159.78 sec)
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] shortfall 565.06 nidle 0.00 saturated 94474.94 busy 0.00
Fri 15 Dec 2017 04:59:57 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] shortfall 231820.13 nidle 0.00 saturated 17705.88 busy 0.00
Fri 15 Dec 2017 04:59:57 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 04:59:57 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:00:58 AM EST | SETI@home | [work_fetch] REC 435724.393 prio -0.004 can't request work: scheduler RPC backoff (99.60 sec)
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] shortfall 662.03 nidle 0.00 saturated 94377.97 busy 0.00
Fri 15 Dec 2017 05:00:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] shortfall 232058.85 nidle 0.00 saturated 17630.45 busy 0.00
Fri 15 Dec 2017 05:00:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:00:58 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:01:58 AM EST | SETI@home | [work_fetch] REC 435738.571 prio -0.004 can't request work: scheduler RPC backoff (39.35 sec)
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] shortfall 764.00 nidle 0.00 saturated 94276.00 busy 0.00
Fri 15 Dec 2017 05:01:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] shortfall 232358.63 nidle 0.00 saturated 17526.67 busy 0.00
Fri 15 Dec 2017 05:01:58 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:01:58 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] Request work fetch: Backoff ended for SETI@home
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] REC 435738.571 prio -1.004 can request work
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] shortfall 830.45 nidle 0.00 saturated 94209.55 busy 0.00
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] shortfall 232570.89 nidle 0.00 saturated 17467.38 busy 0.00
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:02:38 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] set_request() for CPU: ninst 2 nused_total 38.40 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 830.45
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 134.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 232570.89
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [work_fetch] request: CPU (830.45 sec, 0.00 inst) NVIDIA GPU (232570.89 sec, 0.00 inst)
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | Reporting 2 completed tasks
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [sched_op] CPU work request: 830.45 seconds; 0.00 devices
Fri 15 Dec 2017 05:02:38 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 232570.89 seconds; 0.00 devices
Fri 15 Dec 2017 05:02:42 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:02:42 AM EST | SETI@home | Computation for task 08mr07ag.10803.4571.4.31.236_0 finished
Fri 15 Dec 2017 05:02:42 AM EST | SETI@home | Starting task 15fe07ac.22337.13569.3.30.240_0
Fri 15 Dec 2017 05:02:44 AM EST | SETI@home | Started upload of 08mr07ag.10803.4571.4.31.236_0_r1313071724_0
Fri 15 Dec 2017 05:02:46 AM EST | SETI@home | Finished upload of 08mr07ag.10803.4571.4.31.236_0_r1313071724_0
Fri 15 Dec 2017 05:02:46 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | Scheduler request completed: got 5 new tasks
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] estimated total CPU task duration: 7804 seconds
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] estimated total NVIDIA GPU task duration: 1520 seconds
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_52508_SO0253_0018.29047.0.23.46.158.vlar_0
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 14fe07ad.28757.13569.15.42.157_0
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 05:02:47 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 05:02:47 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 05:02:49 AM EST | SETI@home | Started download of 17mr07ab.27245.2935.5.32.226
Fri 15 Dec 2017 05:02:49 AM EST | SETI@home | Started download of 17mr07ab.8361.72.14.41.42
Fri 15 Dec 2017 05:02:49 AM EST | SETI@home | Started download of 17mr07ab.8361.72.14.41.25
Fri 15 Dec 2017 05:02:49 AM EST | SETI@home | Started download of blc04_2bit_guppi_57903_52508_SO0253_0018.20538.818.23.46.11.vlar
Fri 15 Dec 2017 05:02:49 AM EST | SETI@home | Started download of blc04_2bit_guppi_57903_52843_HIP13027_0019.19940.409.24.47.224.vlar
Fri 15 Dec 2017 05:02:51 AM EST | SETI@home | Finished download of 17mr07ab.8361.72.14.41.25
Fri 15 Dec 2017 05:02:51 AM EST | SETI@home | Finished download of blc04_2bit_guppi_57903_52843_HIP13027_0019.19940.409.24.47.224.vlar
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | Finished download of 17mr07ab.27245.2935.5.32.226
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | Finished download of 17mr07ab.8361.72.14.41.42
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | Finished download of blc04_2bit_guppi_57903_52508_SO0253_0018.20538.818.23.46.11.vlar
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | [work_fetch] REC 435762.999 prio -0.005 can't request work: scheduler RPC backoff (297.86 sec)
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100591.46 busy 0.00
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] shortfall 231075.45 nidle 0.00 saturated 17885.45 busy 0.00
Fri 15 Dec 2017 05:02:52 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:02:52 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:03:00 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:03:00 AM EST | SETI@home | Computation for task 14fe07ad.30095.10297.14.41.243_0 finished
Fri 15 Dec 2017 05:03:00 AM EST | SETI@home | Starting task 08mr07ag.10803.4571.4.31.230_0
Fri 15 Dec 2017 05:03:02 AM EST | SETI@home | Started upload of 14fe07ad.30095.10297.14.41.243_0_r1600047609_0
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:03:02 AM EST | SETI@home | [work_fetch] REC 435766.479 prio -0.005 can't request work: scheduler RPC backoff (287.68 sec)
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100585.50 busy 0.00
Fri 15 Dec 2017 05:03:02 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] shortfall 231102.84 nidle 0.00 saturated 17871.16 busy 0.00
Fri 15 Dec 2017 05:03:02 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:03:02 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:03:04 AM EST | SETI@home | Finished upload of 14fe07ad.30095.10297.14.41.243_0_r1600047609_0
Fri 15 Dec 2017 05:03:04 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:03:07 AM EST | SETI@home | [work_fetch] REC 435766.479 prio -0.005 can't request work: scheduler RPC backoff (282.61 sec)
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100583.36 busy 0.00
Fri 15 Dec 2017 05:03:07 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] shortfall 231118.33 nidle 0.00 saturated 17863.83 busy 0.00
Fri 15 Dec 2017 05:03:07 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:03:07 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:03:25 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:03:25 AM EST | SETI@home | Computation for task blc04_2bit_guppi_57903_51166_SO0253_0014.29585.409.24.47.185.vlar_0 finished
Fri 15 Dec 2017 05:03:25 AM EST | SETI@home | Starting task 14fe07ad.28757.13569.15.42.153_0
Fri 15 Dec 2017 05:03:27 AM EST | SETI@home | Started upload of blc04_2bit_guppi_57903_51166_SO0253_0014.29585.409.24.47.185.vlar_0_r1593352069_0
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:03:28 AM EST | SETI@home | [work_fetch] REC 435776.893 prio -0.004 can't request work: scheduler RPC backoff (262.45 sec)
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100564.39 busy 0.00
Fri 15 Dec 2017 05:03:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] shortfall 231196.07 nidle 0.00 saturated 17838.27 busy 0.00
Fri 15 Dec 2017 05:03:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:03:28 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:03:31 AM EST | SETI@home | Finished upload of blc04_2bit_guppi_57903_51166_SO0253_0014.29585.409.24.47.185.vlar_0_r1593352069_0
Fri 15 Dec 2017 05:03:31 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:03:33 AM EST | SETI@home | [work_fetch] REC 435776.893 prio -0.004 can't request work: scheduler RPC backoff (257.36 sec)
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100562.10 busy 0.00
Fri 15 Dec 2017 05:03:33 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:03:33 AM EST | | [work_fetch] shortfall 231212.80 nidle 0.00 saturated 17833.16 busy 0.00
Fri 15 Dec 2017 05:03:33 AM EST | SETI@home | [work_fetch] s
ID: 1907213 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13835
Credit: 208,696,464
RAC: 304
Australia
Message 1907215 - Posted: 15 Dec 2017, 10:19:06 UTC - in response to Message 1907213.  

As you can see, the machine is Not going into Resource Backoff, Why is the Server refusing to send the tasks the client is requesting?

And why does your triple update usually get the work flowing again?
Or mucking around with Application preferences?
Grant
Darwin NT
ID: 1907215 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1907216 - Posted: 15 Dec 2017, 10:20:14 UTC - in response to Message 1907213.  

Continued...
Now it's down to 153 tasks, it will eventually run out if left to the Server which for some reason Refuses to send it the tasks it is requesting.

Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [work_fetch] REC 435838.054 prio -1.004 can request work
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100391.50 busy 0.00
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] shortfall 232520.57 nidle 0.00 saturated 17408.83 busy 0.00
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:07:54 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 133.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 232520.57
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [work_fetch] request: CPU (0.00 sec, 0.00 inst) NVIDIA GPU (232520.57 sec, 0.00 inst)
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | Reporting 5 completed tasks
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 05:07:54 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 232520.57 seconds; 0.00 devices
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | Project has no tasks available
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task blc04_2bit_guppi_57903_51166_SO0253_0014.29585.409.24.47.185.vlar_0
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 08mr07ag.10803.4571.4.31.236_0
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 14fe07ad.30095.10297.14.41.243_0
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 15fe07ac.22337.13569.3.30.240_0
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 08mr07ag.10803.4571.4.31.230_0
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 05:08:01 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 05:08:01 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:08:06 AM EST | SETI@home | [work_fetch] REC 435838.054 prio -0.004 can't request work: scheduler RPC backoff (297.92 sec)
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100378.54 busy 0.00
Fri 15 Dec 2017 05:08:06 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] shortfall 232586.09 nidle 0.00 saturated 17392.11 busy 0.00
Fri 15 Dec 2017 05:08:06 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:08:06 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:09:06 AM EST | SETI@home | [work_fetch] REC 435852.225 prio -0.004 can't request work: scheduler RPC backoff (237.73 sec)
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100309.70 busy 0.00
Fri 15 Dec 2017 05:09:06 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] shortfall 232874.21 nidle 0.00 saturated 17296.12 busy 0.00
Fri 15 Dec 2017 05:09:06 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:09:06 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:09:13 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:09:13 AM EST | SETI@home | Computation for task 14fe07ad.28757.13569.15.42.153_0 finished
Fri 15 Dec 2017 05:09:13 AM EST | SETI@home | Starting task 08mr07ag.10803.4571.4.31.219_0
Fri 15 Dec 2017 05:09:15 AM EST | SETI@home | Started upload of 14fe07ad.28757.13569.15.42.153_0_r86932060_0
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:09:16 AM EST | SETI@home | [work_fetch] REC 435868.129 prio -0.004 can't request work: scheduler RPC backoff (227.50 sec)
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100300.80 busy 0.00
Fri 15 Dec 2017 05:09:16 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] shortfall 232891.16 nidle 0.00 saturated 17281.65 busy 0.00
Fri 15 Dec 2017 05:09:16 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:09:16 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:09:17 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:09:17 AM EST | SETI@home | Finished upload of 14fe07ad.28757.13569.15.42.153_0_r86932060_0
Fri 15 Dec 2017 05:09:17 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:09:17 AM EST | SETI@home | Computation for task 08mr07ag.10803.4571.4.31.229_0 finished
Fri 15 Dec 2017 05:09:17 AM EST | SETI@home | Starting task 14fe07ad.30095.10297.14.41.242_1
Fri 15 Dec 2017 05:09:19 AM EST | SETI@home | Started upload of 08mr07ag.10803.4571.4.31.229_0_r1131630668_0
Fri 15 Dec 2017 05:09:22 AM EST | SETI@home | Finished upload of 08mr07ag.10803.4571.4.31.229_0_r1131630668_0
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:09:22 AM EST | SETI@home | [work_fetch] REC 435869.902 prio -0.004 can't request work: scheduler RPC backoff (222.42 sec)
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100298.70 busy 0.00
Fri 15 Dec 2017 05:09:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] shortfall 232905.32 nidle 0.00 saturated 17277.64 busy 0.00
Fri 15 Dec 2017 05:09:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:09:22 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:10:22 AM EST | SETI@home | [work_fetch] REC 435884.222 prio -0.004 can't request work: scheduler RPC backoff (161.59 sec)
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100261.09 busy 0.00
Fri 15 Dec 2017 05:10:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] shortfall 233145.71 nidle 0.00 saturated 17192.70 busy 0.00
Fri 15 Dec 2017 05:10:22 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:10:22 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:11:23 AM EST | SETI@home | [work_fetch] REC 435898.434 prio -0.004 can't request work: scheduler RPC backoff (101.15 sec)
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100222.82 busy 0.00
Fri 15 Dec 2017 05:11:23 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] shortfall 233375.40 nidle 0.00 saturated 17120.84 busy 0.00
Fri 15 Dec 2017 05:11:23 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:11:23 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:11:26 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:11:26 AM EST | SETI@home | Computation for task 14fe07ad.28757.13569.15.42.145_0 finished
Fri 15 Dec 2017 05:11:26 AM EST | SETI@home | Starting task 08mr07ag.10803.4571.4.31.225_0
Fri 15 Dec 2017 05:11:28 AM EST | SETI@home | Started upload of 14fe07ad.28757.13569.15.42.145_0_r851274790_0
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:11:28 AM EST | SETI@home | [work_fetch] REC 435901.454 prio -0.004 can't request work: scheduler RPC backoff (96.08 sec)
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100219.90 busy 0.00
Fri 15 Dec 2017 05:11:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] shortfall 233390.43 nidle 0.00 saturated 17117.81 busy 0.00
Fri 15 Dec 2017 05:11:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:11:28 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:11:32 AM EST | SETI@home | Finished upload of 14fe07ad.28757.13569.15.42.145_0_r851274790_0
Fri 15 Dec 2017 05:11:32 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:11:33 AM EST | SETI@home | [work_fetch] REC 435901.454 prio -0.004 can't request work: scheduler RPC backoff (91.02 sec)
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100216.95 busy 0.00
Fri 15 Dec 2017 05:11:33 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] shortfall 233407.37 nidle 0.00 saturated 17115.08 busy 0.00
Fri 15 Dec 2017 05:11:33 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:11:33 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:12:33 AM EST | SETI@home | [work_fetch] REC 435915.636 prio -0.004 can't request work: scheduler RPC backoff (30.78 sec)
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100162.17 busy 0.00
Fri 15 Dec 2017 05:12:33 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] shortfall 233748.15 nidle 0.00 saturated 16986.19 busy 0.00
Fri 15 Dec 2017 05:12:33 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:12:33 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:13:04 AM EST | | [work_fetch] Request work fetch: Backoff ended for SETI@home
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [work_fetch] REC 435915.636 prio -1.004 can request work
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100135.83 busy 0.00
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] shortfall 233956.14 nidle 0.00 saturated 16932.55 busy 0.00
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [work_fetch] share 1.000
Fri 15 Dec 2017 05:13:08 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [work_fetch] set_request() for NVIDIA GPU: ninst 3 nused_total 130.00 nidle_now 0.00 fetch share 1.00 req_inst 0.00 req_secs 233956.14
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [sched_op] Starting scheduler request
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [work_fetch] request: CPU (0.00 sec, 0.00 inst) NVIDIA GPU (233956.14 sec, 0.00 inst)
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | Sending scheduler request: To report completed tasks.
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | Reporting 3 completed tasks
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | Requesting new tasks for NVIDIA GPU
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
Fri 15 Dec 2017 05:13:08 AM EST | SETI@home | [sched_op] NVIDIA GPU work request: 233956.14 seconds; 0.00 devices
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] Server version 707
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | Project has no tasks available
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | Project requested delay of 303 seconds
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 14fe07ad.28757.13569.15.42.153_0
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 08mr07ag.10803.4571.4.31.229_0
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task 14fe07ad.28757.13569.15.42.145_0
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] Deferring communication for 00:05:03
Fri 15 Dec 2017 05:13:17 AM EST | SETI@home | [sched_op] Reason: requested by project
Fri 15 Dec 2017 05:13:17 AM EST | | [work_fetch] Request work fetch: RPC complete
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:13:23 AM EST | SETI@home | Computation for task 14fe07ad.30095.10297.14.41.242_1 finished
Fri 15 Dec 2017 05:13:23 AM EST | SETI@home | Starting task 14fe07ad.28757.13569.15.42.137_0
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:13:23 AM EST | SETI@home | [work_fetch] REC 435939.893 prio -0.004 can't request work: scheduler RPC backoff (297.91 sec)
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100120.19 busy 0.00
Fri 15 Dec 2017 05:13:23 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] shortfall 234006.20 nidle 0.00 saturated 16914.91 busy 0.00
Fri 15 Dec 2017 05:13:23 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:13:23 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:13:25 AM EST | SETI@home | Started upload of 14fe07ad.30095.10297.14.41.242_1_r1766161452_0
Fri 15 Dec 2017 05:13:28 AM EST | SETI@home | Finished upload of 14fe07ad.30095.10297.14.41.242_1_r1766161452_0
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:13:28 AM EST | SETI@home | [work_fetch] REC 435939.893 prio -0.004 can't request work: scheduler RPC backoff (292.84 sec)
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100115.53 busy 0.00
Fri 15 Dec 2017 05:13:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] shortfall 234015.87 nidle 0.00 saturated 16908.00 busy 0.00
Fri 15 Dec 2017 05:13:28 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:13:28 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:13:43 AM EST | SETI@home | Computation for task 08mr07ag.10803.4571.4.31.219_0 finished
Fri 15 Dec 2017 05:13:43 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51166_SO0253_0014.31661.0.24.47.27.vlar_1
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:13:43 AM EST | SETI@home | [work_fetch] REC 435948.590 prio -0.004 can't request work: scheduler RPC backoff (277.68 sec)
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100106.51 busy 0.00
Fri 15 Dec 2017 05:13:43 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] shortfall 234044.50 nidle 0.00 saturated 16888.25 busy 0.00
Fri 15 Dec 2017 05:13:43 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:13:43 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:13:45 AM EST | SETI@home | Started upload of 08mr07ag.10803.4571.4.31.219_0_r729195601_0
Fri 15 Dec 2017 05:13:49 AM EST | SETI@home | Finished upload of 08mr07ag.10803.4571.4.31.219_0_r729195601_0
Fri 15 Dec 2017 05:13:49 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:13:53 AM EST | SETI@home | [work_fetch] REC 435948.590 prio -0.004 can't request work: scheduler RPC backoff (267.41 sec)
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100099.27 busy 0.00
Fri 15 Dec 2017 05:13:53 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] shortfall 234075.43 nidle 0.00 saturated 16874.38 busy 0.00
Fri 15 Dec 2017 05:13:53 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:13:53 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:14:53 AM EST | SETI@home | [work_fetch] REC 435962.838 prio -0.004 can't request work: scheduler RPC backoff (207.05 sec)
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 100055.47 busy 0.00
Fri 15 Dec 2017 05:14:53 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] shortfall 234299.32 nidle 0.00 saturated 16817.89 busy 0.00
Fri 15 Dec 2017 05:14:53 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:14:53 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:15:54 AM EST | SETI@home | [work_fetch] REC 435977.035 prio -0.004 can't request work: scheduler RPC backoff (146.66 sec)
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 99972.61 busy 0.00
Fri 15 Dec 2017 05:15:54 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] shortfall 234534.46 nidle 0.00 saturated 16722.38 busy 0.00
Fri 15 Dec 2017 05:15:54 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:15:54 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:16:10 AM EST | | [work_fetch] Request work fetch: application exited
Fri 15 Dec 2017 05:16:10 AM EST | SETI@home | Computation for task 08mr07ag.10803.4571.4.31.225_0 finished
Fri 15 Dec 2017 05:16:10 AM EST | SETI@home | Starting task blc04_2bit_guppi_57903_51500_HIP12932_0015.29562.409.23.46.184.vlar_1
Fri 15 Dec 2017 05:16:12 AM EST | SETI@home | Started upload of 08mr07ag.10803.4571.4.31.225_0_r476133809_0
Fri 15 Dec 2017 05:16:14 AM EST | SETI@home | Finished upload of 08mr07ag.10803.4571.4.31.225_0_r476133809_0
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] Request work fetch: project finished uploading
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:16:14 AM EST | SETI@home | [work_fetch] REC 435988.248 prio -0.004 can't request work: scheduler RPC backoff (126.53 sec)
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 99954.41 busy 0.00
Fri 15 Dec 2017 05:16:14 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] shortfall 234572.32 nidle 0.00 saturated 16713.43 busy 0.00
Fri 15 Dec 2017 05:16:14 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] ------- end work fetch state -------
Fri 15 Dec 2017 05:16:14 AM EST | | [work_fetch] No project chosen for work fetch
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] ------- start work fetch state -------
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] target work buffer: 86400.00 + 8640.00 sec
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] --- project states ---
Fri 15 Dec 2017 05:17:14 AM EST | SETI@home | [work_fetch] REC 436002.415 prio -0.004 can't request work: scheduler RPC backoff (66.32 sec)
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] --- state for CPU ---
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] shortfall 0.00 nidle 0.00 saturated 99898.24 busy 0.00
Fri 15 Dec 2017 05:17:14 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] --- state for NVIDIA GPU ---
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] shortfall 234744.40 nidle 0.00 saturated 16664.10 busy 0.00
Fri 15 Dec 2017 05:17:14 AM EST | SETI@home | [work_fetch] share 0.000
Fri 15 Dec 2017 05:17:14 AM EST | | [work_fetch] ------- end work fetch state -------
ID: 1907216 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1907218 - Posted: 15 Dec 2017, 10:29:19 UTC - in response to Message 1907215.  

As you can see, the machine is Not going into Resource Backoff, Why is the Server refusing to send the tasks the client is requesting?

And why does your triple update usually get the work flowing again?
Or mucking around with Application preferences?

My WAG is that by forcing the Server to actually LOOK at what the Client is requesting results in the Server actually sending the tasks the Client has been requesting. Otherwise, it appears the Server is simply Ignoring the Client requests and simply sending a bone ever so often.
That's certainly the way it appears.
ID: 1907218 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14674
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1907221 - Posted: 15 Dec 2017, 10:40:58 UTC - in response to Message 1907218.  

My WAG is that by forcing the Server to actually LOOK at what the Client is requesting results in the Server actually sending the tasks the Client has been requesting. Otherwise, it appears the Server is simply Ignoring the Client requests and simply sending a bone ever so often.
That's certainly the way it appears.
Before starting conspiracy theories, have you read the code which drives the server-side scheduler? Computers operate the way they are programmed. It's easy to code bugs, but very hard to program random malicious intent in open-source software used at every BOINC project across the globe.
ID: 1907221 · Report as offensive
Al Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 3 Apr 99
Posts: 1682
Credit: 477,343,364
RAC: 482
United States
Message 1907239 - Posted: 15 Dec 2017, 14:42:46 UTC - in response to Message 1907234.  

These massive long posts are out of order.

WAG's are wives and girl friends i.e. women. Nuff said?

Umm, then what would a SWAG be? ;-)

ID: 1907239 · Report as offensive
Iona
Avatar

Send message
Joined: 12 Jul 07
Posts: 790
Credit: 22,438,118
RAC: 0
United Kingdom
Message 1907243 - Posted: 15 Dec 2017, 15:11:31 UTC - in response to Message 1907194.  

That's the approach I posted earlier that I think the project should take. Just take the project down and fix the servers properly and take as long as needed. I can't handle the constant band-aid up and down lately.


+1, I think the SETI team should do that and get ready for Parkes by taking things offline and doing whatever is needed to get the Database sorted.

Looks like my PC survived the night and managed to keep enough work in the cache. When I went to bed the cache was very low and I was half expecting my backup project to kick in, but in the end it didn't.


I couldn't agree more. To be honest, I'm of the opinion that they'd do better to sort things out properly and do the preparatory work for the new additions, than to keep using 'Band-Aids'. Carrying on like this, is just a waste of everyone's time, especially, theirs. Sooner or later, that preparatory work has to be done and with things the way they are, it may as well be now.
Don't take life too seriously, as you'll never come out of it alive!
ID: 1907243 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 36 · Next

Message boards : Number crunching : Panic Mode On (109) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.