Panic Mode On (116) Server Problems?

Message boards : Number crunching : Panic Mode On (116) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · 11 · 12 . . . 47 · Next

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14653
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1989128 - Posted: 7 Apr 2019, 13:47:23 UTC

I think it's like Arkwright's Store - everything's in stock, but the service leaves something to be desired.
ID: 1989128 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989131 - Posted: 7 Apr 2019, 14:02:19 UTC - in response to Message 1989127.  

Hi , just wanted to post that i dont get any downloads for SOG and while typing i recieved a few SOG files for my vidcard.
Yesterday all files where done and waiting to be uploaded for a very long time,
after a retry all of em got send and i recieved a few CPU tasks.
Can someone pat the server gently and see if it has to burp ?

Happy Weekend


B U R P!
A proud member of the OFA (Old Farts Association).
ID: 1989131 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989132 - Posted: 7 Apr 2019, 14:03:25 UTC - in response to Message 1989124.  
Last modified: 7 Apr 2019, 14:06:31 UTC

The machine I had that was completely dry now has 18 gpu tasks "in progress" :) Not going to last very long though.

Tom


It is finding a few more tasks everytime it updates. Now if it would download enough tasks to keep mine busy.... :)
-edit-
OMG, I am up to 82 tasks in progress.... :) (on the machine that was dry).

Tom
A proud member of the OFA (Old Farts Association).
ID: 1989132 · Report as offensive
Boiler Paul

Send message
Joined: 4 May 00
Posts: 232
Credit: 4,965,771
RAC: 64
United States
Message 1989133 - Posted: 7 Apr 2019, 14:04:08 UTC

I finally received a few tasks....woot
ID: 1989133 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1989136 - Posted: 7 Apr 2019, 14:14:53 UTC - in response to Message 1989135.  

Chris, you demonstrate a degree of lack of understanding of the project situation and its finances in your last post, coupled with a high degree of negativity.

I will not bandy words with you on line, I will reply through separate channels where it will have more effect.
The truth has a habit of stinging. :-)
ID: 1989136 · Report as offensive
Profile Siran d'Vel'nahr
Volunteer tester
Avatar

Send message
Joined: 23 May 99
Posts: 7379
Credit: 44,181,323
RAC: 238
United States
Message 1989138 - Posted: 7 Apr 2019, 14:17:58 UTC - in response to Message 1989136.  

Chris, you demonstrate a degree of lack of understanding of the project situation and its finances in your last post, coupled with a high degree of negativity.

I will not bandy words with you on line, I will reply through separate channels where it will have more effect.
The truth has a habit of stinging. :-)

Hi Serius,

Watch out! He'll try to convince you of something that is totally not true and without facts to back it up. ;)

Have a great day! :)

Siran
CAPT Siran d'Vel'nahr - L L & P _\\//
Winders 11 OS? "What a piece of junk!" - L. Skywalker
"Logic is the cement of our civilization with which we ascend from chaos using reason as our guide." - T'Plana-hath
ID: 1989138 · Report as offensive
Profile entigy
Volunteer tester

Send message
Joined: 5 Aug 99
Posts: 10
Credit: 2,446,624
RAC: 2
United Kingdom
Message 1989153 - Posted: 7 Apr 2019, 15:45:49 UTC

1.2 million tasks ready to send, but "No tasks available".
They can't all be for CPU or Linux can they......??
ID: 1989153 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19072
Credit: 40,757,560
RAC: 67
United Kingdom
Message 1989154 - Posted: 7 Apr 2019, 15:55:07 UTC - in response to Message 1989079.  

3. Why is it necessary to keep 20 year old data current when nothing is done with it

Because if something interesting is found, then the scientists will need to go back and look at all the observations from that part of the sky. It is also possible that some parts haven't been looked at all that often
And 20 years in this business is not a long period of time.
ID: 1989154 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1989155 - Posted: 7 Apr 2019, 15:56:38 UTC - in response to Message 1989153.  
Last modified: 7 Apr 2019, 16:01:32 UTC

1.2 million tasks ready to send, but "No tasks available".
They can't all be for CPU or Linux can they......??

Unlikely
The problem is how the distribution of the new work works.
With a lot of hungry hosts asking for work at the same time the servers could only feed some at a time, then the others receive the No Task Available msg.
That is normal when recovering from a big out(r)age. Expect to be fixed during the next hours.
ID: 1989155 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14653
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1989162 - Posted: 7 Apr 2019, 16:34:03 UTC - in response to Message 1989153.  

They can't all be for CPU or Linux can they......??
Tasks are just tasks - the same for everyone and everything.

They only become CPU or GPU, Windows, Mac or Linux tasks when they become your tasks, and are marked for whatever you've got to run them.
ID: 1989162 · Report as offensive
EdwardPF
Volunteer tester

Send message
Joined: 26 Jul 99
Posts: 389
Credit: 236,772,605
RAC: 374
United States
Message 1989166 - Posted: 7 Apr 2019, 17:22:31 UTC
Last modified: 7 Apr 2019, 17:23:01 UTC

17:20UT my tank is full!! 100 CPU 200 GPU WU's!!!

Ed F
ID: 1989166 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1989168 - Posted: 7 Apr 2019, 17:39:10 UTC

I think I'm seeing a pattern. As the system comes back up after an outage,
first if it is a db crash then we get some warnings and the status has weird numbers and empty slots as it works on rebuilding (I'm guessing).
Then the system starts accepting our completed WUs and starts processing these and doing db purges as necessary. Resends go to the RTS.
While the system is accepting WUs, it is also splitting files like crazy causing the RTS number to zoom up until we all go crazy wishing it would just give us some of the sweet sweet new WUs. I think it is now part of "normal" procedure for it to do this and not hand out WUs for a while. No need to panic.
Then the floodgates open a little and first the slow machines get some WUs and then finally when all is good the faster machines start to get some WUs and seti life starts to get back to normal.

We can all dream about a seti with more money and thus more people and better machines, but this is today's reality, that we have. Maybe there should be a separate thread about how if money wasn't a problem and I was in charge, how I would design seti. It is good to dream, and toss ideas around.

I don't think ANY of us expect the seti team to work on things during holidays and weekends. They do because they want to or feel they have to, but I don't think that it has anything to do with us users. I'm betting they are grateful when the automatic notifications fail, but they get notice from those few people who have access to the bat signal. I don't think they would have handed the contact info to those that have it unless they wanted to be notified.

Thanks again to seti people who gave up weekend time to fix this mess.
ID: 1989168 · Report as offensive
EdwardPF
Volunteer tester

Send message
Joined: 26 Jul 99
Posts: 389
Credit: 236,772,605
RAC: 374
United States
Message 1989175 - Posted: 7 Apr 2019, 18:35:43 UTC - in response to Message 1989168.  

+1

Ed F
ID: 1989175 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989197 - Posted: 7 Apr 2019, 20:46:02 UTC - in response to Message 1989153.  
Last modified: 7 Apr 2019, 20:53:41 UTC

1.2 million tasks ready to send, but "No tasks available".
They can't all be for CPU or Linux can they......??


. . Actually the OS has nothing to do with it, and the device rather little as well, that is not set until the host asks for work for a particular device. It is the type of job mainly such as Astropulse etc. Like when Arecibo VLAR tasks were flooding the RTS and were not being sent (at that time) to GPUs, causing a logjam because there were not enough CPU hosts/capacity to take them fast enough. Now we get those tasks on GPUs as well and that problem cleared.

Stephen

:)
ID: 1989197 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989339 - Posted: 9 Apr 2019, 0:42:42 UTC

. . Well the Blc22 tapes are nearly finished but there are 9 older tapes still stuck in the splitters that finished splitting days ago, and the same story with the Blc36 tapes, only a couple left to finish but there are 6 early ones from weeks ago still stuck there. Hopefully that will get sorted with the imminent maintenance outage. Then down to just the Blc34 tapes.

Stephen
ID: 1989339 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1989340 - Posted: 9 Apr 2019, 0:48:53 UTC

I'm guessing we will get new files tomorrow after the outage. The question is... will it still be the same day ??
ID: 1989340 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989347 - Posted: 9 Apr 2019, 3:26:27 UTC - in response to Message 1989340.  
Last modified: 9 Apr 2019, 3:31:11 UTC

I'm guessing we will get new files tomorrow after the outage. The question is... will it still be the same day ??


. . That has been the pattern in recent times but I am wondering if the hanging tapes stuck in the splitters might affect the process ...

. . I wish now that I had been keeping track of which tapes series for this date that we have completed to know if there are many more outstanding. I know we have done Blc22, Blc25, Blc31, Blc34, Blc36 and some in the Blc1x series before that. But I don't think we have seen Blc32, Blc33 or Blc35 yet ...

Stephen

? ?
ID: 1989347 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989361 - Posted: 9 Apr 2019, 6:41:10 UTC - in response to Message 1989339.  

. . Well the Blc22 tapes are nearly finished but there are 9 older tapes still stuck in the splitters that finished splitting days ago, and the same story with the Blc36 tapes, only a couple left to finish but there are 6 early ones from weeks ago still stuck there. Hopefully that will get sorted with the imminent maintenance outage. Then down to just the Blc34 tapes.

Stephen


[edit]
. . Well someone has cleared the 6 stuck Blc36 tapes, many thanks. The 9 Blc22 tapes are still stuck. But the splitter load is starting to look a little lean.

Stephen

. .
ID: 1989361 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1989364 - Posted: 9 Apr 2019, 7:08:53 UTC - in response to Message 1989361.  

. . Well the Blc22 tapes are nearly finished but there are 9 older tapes still stuck in the splitters that finished splitting days ago, and the same story with the Blc36 tapes, only a couple left to finish but there are 6 early ones from weeks ago still stuck there. Hopefully that will get sorted with the imminent maintenance outage. Then down to just the Blc34 tapes.

Stephen


[edit]
. . Well someone has cleared the 6 stuck Blc36 tapes, many thanks. The 9 Blc22 tapes are still stuck. But the splitter load is starting to look a little lean.

Stephen

. .

Hopefully with a arm small queue it will allow the short data sets to be processed, that have been around for over a month it would be nice to see them be processed
ID: 1989364 · Report as offensive
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 716
Credit: 8,032,827
RAC: 62
France
Message 1989370 - Posted: 9 Apr 2019, 9:36:38 UTC

Hi, is there a new downloads behavior setting in server side ? only downloading WU twenty by twenty ^^ may have a better experience downloading WU after the tuesday outage ? hope so ...




09-Apr-2019 10:38:23 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 10:38:23 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 10:38:26 [SETI@home] Scheduler request completed: got 20 new tasks
09-Apr-2019 10:38:28 [SETI@home] Downloading 20 tasks ...
09-Apr-2019 10:43:33 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 10:43:33 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 10:43:36 [SETI@home] Scheduler request completed: got 20 new tasks
09-Apr-2019 10:43:38 [SETI@home] Downloading 20 tasks ...
09-Apr-2019 10:48:40 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 10:48:40 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 10:48:42 [SETI@home] Scheduler request completed: got 20 new tasks
09-Apr-2019 10:48:44 [SETI@home] Downloading 20 tasks ...
09-Apr-2019 10:53:47 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 10:53:47 [SETI@home] Reporting 1 completed tasks
09-Apr-2019 10:53:47 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 10:53:50 [SETI@home] Scheduler request completed: got 19 new tasks
09-Apr-2019 10:53:52 [SETI@home] Downloading 19 tasks ...
09-Apr-2019 10:58:54 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 10:58:54 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 10:58:56 [SETI@home] Scheduler request completed: got 9 new tasks
09-Apr-2019 10:58:58 [SETI@home] Downloading 9 tasks ...
09-Apr-2019 11:04:00 [SETI@home] Sending scheduler request: To fetch work.
09-Apr-2019 11:04:00 [SETI@home] Requesting new tasks for AMD/ATI GPU
09-Apr-2019 11:04:02 [SETI@home] Scheduler request completed: got 0 new tasks
09-Apr-2019 11:04:02 [SETI@home] No tasks sent
09-Apr-2019 11:04:02 [SETI@home] No tasks are available for AstroPulse v7
09-Apr-2019 11:04:02 [SETI@home] No tasks are available for SETI@home v8
09-Apr-2019 11:04:02 [SETI@home] Tasks for CPU are available, but your preferences are set to not accept them
09-Apr-2019 11:04:02 [SETI@home] Tasks for NVIDIA GPU are available, but your preferences are set to not accept them
09-Apr-2019 11:04:02 [SETI@home] Tasks for Intel GPU are available, but your preferences are set to not accept them
09-Apr-2019 11:04:02 [SETI@home] This computer has reached a limit on tasks in progress

ID: 1989370 · Report as offensive
Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · 11 · 12 . . . 47 · Next

Message boards : Number crunching : Panic Mode On (116) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.