Panic Mode On (111) Server Problems?

Message boards : Number crunching : Panic Mode On (111) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 31 · Next

AuthorMessage
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1929577 - Posted: 12 Apr 2018, 14:06:12 UTC - in response to Message 1929558.  

I think I found a corrupted task file ... blc11_2bit_guppi_58137_42360_HIP64241_0045.2736.818.22.45.145.vlar_6
It seems to be running download errors now.
I'm #7 on the list.
http://setiathome.berkeley.edu/workunit.php?wuid=2865073343

blc11 ??


. . We have had Blc0n, Blc1n and Blc2n where n is from 0 to7, though I have not seen every combination I am sure they are about and I suspect we may yet see up to Blc7n

Stephen

?
ID: 1929577 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1929586 - Posted: 12 Apr 2018, 15:49:10 UTC
Last modified: 12 Apr 2018, 15:51:20 UTC

Having issues getting work on one Linux machine right now. Down about 100 tasks. Are we getting into a Arecibo VLAR storm right now?
ASUS-Linux

26876 SETI@home 4/12/2018 08:32:14 [sched_op] Starting scheduler request
26877 SETI@home 4/12/2018 08:32:14 Sending scheduler request: To fetch work.
26878 SETI@home 4/12/2018 08:32:14 Reporting 16 completed tasks
26879 SETI@home 4/12/2018 08:32:14 Requesting new tasks for CPU and NVIDIA GPU
26880 SETI@home 4/12/2018 08:32:14 [sched_op] CPU work request: 760550.29 seconds; 0.00 devices
26881 SETI@home 4/12/2018 08:32:14 [sched_op] NVIDIA GPU work request: 310531.33 seconds; 0.00 devices
26882 SETI@home 4/12/2018 08:32:17 Scheduler request completed: got 7 new tasks
26883 SETI@home 4/12/2018 08:32:17 [sched_op] Server version 709
26884 SETI@home 4/12/2018 08:32:17 Project requested delay of 303 seconds

ASUS-Linux

27009 SETI@home 4/12/2018 08:37:23 [sched_op] Starting scheduler request
27010 SETI@home 4/12/2018 08:37:23 Sending scheduler request: To fetch work.
27011 SETI@home 4/12/2018 08:37:23 Reporting 18 completed tasks
27012 SETI@home 4/12/2018 08:37:23 Requesting new tasks for CPU and NVIDIA GPU
27013 SETI@home 4/12/2018 08:37:23 [sched_op] CPU work request: 761694.53 seconds; 0.00 devices
27014 SETI@home 4/12/2018 08:37:23 [sched_op] NVIDIA GPU work request: 310003.26 seconds; 0.00 devices
27015 SETI@home 4/12/2018 08:37:26 Scheduler request completed: got 2 new tasks
27016 SETI@home 4/12/2018 08:37:26 [sched_op] Server version 709
27017 SETI@home 4/12/2018 08:37:26 Project requested delay of 303 seconds
27018 SETI@home 4/12/2018 08:37:26 [sched_op] estimated total CPU task duration: 6292 seconds
27019 SETI@home 4/12/2018 08:37:26 [sched_op] estimated total NVIDIA GPU task duration: 0 seconds

ASUS-Linux

27119 SETI@home 4/12/2018 08:42:32 [sched_op] Starting scheduler request
27120 SETI@home 4/12/2018 08:42:32 Sending scheduler request: To fetch work.
27121 SETI@home 4/12/2018 08:42:32 Reporting 15 completed tasks
27122 SETI@home 4/12/2018 08:42:32 Requesting new tasks for CPU and NVIDIA GPU
27123 SETI@home 4/12/2018 08:42:32 [sched_op] CPU work request: 756477.72 seconds; 0.00 devices
27124 SETI@home 4/12/2018 08:42:32 [sched_op] NVIDIA GPU work request: 311672.56 seconds; 0.00 devices
27125 SETI@home 4/12/2018 08:42:34 Scheduler request completed: got 0 new tasks
27126 SETI@home 4/12/2018 08:42:34 [sched_op] Server version 709
27127 SETI@home 4/12/2018 08:42:34 No tasks sent
27128 SETI@home 4/12/2018 08:42:34 This computer has reached a limit on tasks in progress
27129 SETI@home 4/12/2018 08:42:34 Project requested delay of 303 seconds
ASUS-Linux

27217 SETI@home 4/12/2018 08:47:40 [sched_op] Starting scheduler request
27218 SETI@home 4/12/2018 08:47:40 Sending scheduler request: To fetch work.
27219 SETI@home 4/12/2018 08:47:40 Reporting 14 completed tasks
27220 SETI@home 4/12/2018 08:47:40 Requesting new tasks for CPU and NVIDIA GPU
27221 SETI@home 4/12/2018 08:47:40 [sched_op] CPU work request: 757635.36 seconds; 0.00 devices
27222 SETI@home 4/12/2018 08:47:40 [sched_op] NVIDIA GPU work request: 313295.83 seconds; 0.00 devices
27223 SETI@home 4/12/2018 08:47:41 Message from task: 0
27224 SETI@home 4/12/2018 08:47:41 Computation for task 18dc17aa.12466.24210.10.37.87_0 finished
27225 SETI@home 4/12/2018 08:47:41 Starting task 19dc17ab.13693.22562.5.32.215_1
27226 SETI@home 4/12/2018 08:47:43 Started upload of 18dc17aa.12466.24210.10.37.87_0_r16378418_0
27227 SETI@home 4/12/2018 08:47:43 Scheduler request completed: got 3 new tasks
27228 SETI@home 4/12/2018 08:47:43 [sched_op] Server version 709
27229 SETI@home 4/12/2018 08:47:43 Project requested delay of 303 seconds
27230 SETI@home 4/12/2018 08:47:43 [sched_op] estimated total CPU task duration: 0 seconds

[Edit] Now every machine is coming up short and not getting replacement work.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1929586 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1929592 - Posted: 12 Apr 2018, 16:08:50 UTC

Also down on WUs, over 100 to full cache on main PC.
ID: 1929592 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1929593 - Posted: 12 Apr 2018, 16:11:31 UTC

Getting a lot of work requests with no new work sent.
And we are not the only ones. Results in the field stat has been dropping as well.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1929593 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1929595 - Posted: 12 Apr 2018, 16:15:54 UTC - in response to Message 1929593.  
Last modified: 12 Apr 2018, 16:31:50 UTC

Haven't we seen this before when the results to be purged starts growing larger than normal and the RTS buffer heads north of 600K720K?
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1929595 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1929596 - Posted: 12 Apr 2018, 16:17:28 UTC
Last modified: 12 Apr 2018, 16:22:30 UTC

Nothing here too. But i receive the $#%$%#%!!! msg:

Thu 12 Apr 2018 11:05:16 AM EST | SETI@home | This computer has reached a limit on tasks in progress


Less than 200 GPU WU in the cache far from my 400 WU limit (4 GPUs)

<edit> Made a test:
- Reschedule all the CPU WU to GPU
- Update
- New CPU data arrived. All Arecibo VLARS!!!
ID: 1929596 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1929597 - Posted: 12 Apr 2018, 16:20:38 UTC - in response to Message 1929586.  

Are we getting into a Arecibo VLAR storm right now?
Yes. On a machine with 40 cached, 36 are VLAR, only four guppies.
ID: 1929597 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1929598 - Posted: 12 Apr 2018, 16:21:08 UTC

Just sent word to Eric and Jeff. Hopefully one of them can look into the entanglement.
Meowsigh.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1929598 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1929601 - Posted: 12 Apr 2018, 16:34:31 UTC

Sigh... REALLY wish we could get a setting to accept Arecibo VLAR work for Anonymous Hosts running Nvidia.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1929601 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1929602 - Posted: 12 Apr 2018, 16:44:36 UTC

Looks like all the splitters have shut down.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1929602 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1929603 - Posted: 12 Apr 2018, 16:51:30 UTC
Last modified: 12 Apr 2018, 16:51:44 UTC

Think the splitter process stop point is at 743K for the RTS buffer. Until the CPU and ATI Hosts can take some of the Arecibo VLARs out of the buffer to drop below the cutoff point, the splitters won't start back up.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1929603 · Report as offensive
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1929604 - Posted: 12 Apr 2018, 16:53:55 UTC - in response to Message 1929602.  

I find myself reading through this thread often as it gets posted on quite a bit...But I must admit to never fully it at all....understanding any of the posts.
I know it must be important to some people...just not sure if it should be important to me as well...LOL....

I usually just check that my machines are still working and that yet another update from windows hasn't shut me down without me knowing!!
ID: 1929604 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1929605 - Posted: 12 Apr 2018, 16:58:41 UTC

Well, I just now finally got a burst of 64 new WUs on this rig.
Meow!!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1929605 · Report as offensive
Profile Cactus Bob
Avatar

Send message
Joined: 19 May 99
Posts: 209
Credit: 10,924,287
RAC: 29
Canada
Message 1929606 - Posted: 12 Apr 2018, 17:18:38 UTC

If the splitters stop for @home do the stop for AP also

Data Distribution State ............................Astropulse #......SETI@home v8 # As of*

Current result creation rate **..................0.0667/sec ............1.5214/sec 5m

There are 7 AP channels available to be split.

Bob
Sometimes I wonder, what happened to all the people I gave directions to?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
SETI@home classic workunits 4,321
SETI@home classic CPU time 22,169 hours
ID: 1929606 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1929608 - Posted: 12 Apr 2018, 17:27:45 UTC - in response to Message 1929605.  

Well, I just now finally got a burst of 64 new WUs on this rig.
Meow!!

And the VLAR storm has ended. Pretty short in reality. I was down 300 tasks on the fastest machine for a while. Made it back up quickly with 110 , 75, 48, and multiple 25's pulls.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1929608 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1929617 - Posted: 12 Apr 2018, 18:24:14 UTC - in response to Message 1929601.  

Sigh... REALLY wish we could get a setting to accept Arecibo VLAR work for Anonymous Hosts running Nvidia.

Just had a look at my system before heading off to work, and it appears i'm now getting Arecibo VLARs on my NVidia GPUs. Will be a few hours yet till they get processed.
Grant
Darwin NT
ID: 1929617 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1929620 - Posted: 12 Apr 2018, 18:40:19 UTC - in response to Message 1929619.  
Last modified: 12 Apr 2018, 18:41:11 UTC

Sigh... REALLY wish we could get a setting to accept Arecibo VLAR work for Anonymous Hosts running Nvidia.

Just had a look at my system before heading off to work, and it appears i'm now getting Arecibo VLARs on my NVidia GPUs. Will be a few hours yet till they get processed.

Yes, same here. For the first time on Main.
Arecibo VLAR's has been sent to Nvidia GPU's on Beta for a long time though. No problems whatsoever on my 980, although
the crunching times will increase considerably, compared to non VLARs.

Same here, just receive >190 Arebibo Vlars to be crunched on the GPU .
I could live with that, but what i not like is why change the roule of the game without warning the players.
Another big dive in our daily production on sight.
ID: 1929620 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1929623 - Posted: 12 Apr 2018, 18:53:03 UTC

There will be blood....

Hey, it wasn't me. I just suggested having them on Anonymous platform.
Oh well. It did fix the GPU WU shortage though.
Perhaps CreditFew will do it's job and award twice as much credit for a task taking twice as long. It probably won't though.
ID: 1929623 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1929626 - Posted: 12 Apr 2018, 19:04:44 UTC

On the other hand, they fix the problem with the outages, 100 Arecibo Vlars WU last for about 400 min (>6 hrs).
With the new 5 hrs outage, they will keep the GPU busy all the time.
ID: 1929626 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24876
Credit: 3,081,182
RAC: 7
Ireland
Message 1929631 - Posted: 12 Apr 2018, 19:52:36 UTC

That was a fast outage :-)
ID: 1929631 · Report as offensive
Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 31 · Next

Message boards : Number crunching : Panic Mode On (111) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.