Panic Mode On (116) Server Problems?

Message boards : Number crunching : Panic Mode On (116) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 47 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1989427 - Posted: 10 Apr 2019, 5:02:15 UTC - in response to Message 1989426.  

I've had a rash of partially downloaded tasks on all my hosts this week prior to the outage. Some were showing 13 hours elapsed time in downloads at some partial percentage of completion from 30 - 80%. The hosts would be downloading normally all other tasks but with one or two in download limbo until I stopped and restarted BOINC. The Event Log would then show the successful download of the in limbo task at startup. It's as if it never got an ack for the finish of its download.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1989427 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1989429 - Posted: 10 Apr 2019, 5:30:50 UTC - in response to Message 1989427.  

What I've been seeing the most of, is the Server sending tasks and then expiring them a couple of minutes later, https://setiathome.berkeley.edu/results.php?hostid=6813106&state=6
I just deleted a 'few' hundred tasks from that machine, and then did a Project Reset, let's see if they show up as new errors.
ID: 1989429 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1989430 - Posted: 10 Apr 2019, 5:36:02 UTC

Starting to clean up nicely at this point. Getting close to full caches and downloads seem peppy.
Good job, whomever!
ID: 1989430 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14653
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1989438 - Posted: 10 Apr 2019, 7:38:38 UTC

When I've had download problems in the past (going back years), I've sometimes gone to 'Suspend Network activity' for a few seconds to pause 'active' downloads making no progress, then turned Network activity on again to give them another chance. That helped back then: I don't know whether it would work now, because I don't what exact problems you guys are seeing.

But it's a lot quicker, simpler, and less wasteful than some of the sledgehammers you guys are using.
ID: 1989438 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1989448 - Posted: 10 Apr 2019, 10:08:26 UTC

Nice thing about being in the UK.

SETI still down, went to bed. This morning quick check before my walk, all machines either up to max or in the process of downloading.

Zero frustration ;-)
ID: 1989448 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1989480 - Posted: 10 Apr 2019, 14:24:03 UTC

They gotta be kidding, right?



1 hr 45 min 44 sec remaining...

...108 days?
ID: 1989480 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989484 - Posted: 10 Apr 2019, 14:30:19 UTC - in response to Message 1989480.  

They gotta be kidding, right?



1 hr 45 min 44 sec remaining...

...108 days?


I have had such tasks pop up. Usually they take less than 8 hours sometimes they take an hour or two. One took forty minutes. Give it a half hour of crunching and look at the time estimate again. It might be significantly lower.

A couple of times I have had tasks hang at an apparent 100% but keep burning cpu time. If I suspend and restart the cpu task, they abruptly finish....

Tom
A proud member of the OFA (Old Farts Association).
ID: 1989484 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1989485 - Posted: 10 Apr 2019, 14:30:50 UTC - in response to Message 1989480.  

They gotta be kidding, right?



1 hr 45 min 44 sec remaining...

...108 days?


New machine?? New setup?? I'm guessing it doesn't have info on how long that file should take to process because it hasn't done enough of them on the current setup. The wildass guess sure is scary though :-)
ID: 1989485 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1989486 - Posted: 10 Apr 2019, 14:41:14 UTC - in response to Message 1989485.  

No, all other tasks showing normal run times between 4hr 33min & 4 hr 53 min. Just thought taking a screen shot for prosperity. :-)
ID: 1989486 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989488 - Posted: 10 Apr 2019, 14:48:47 UTC - in response to Message 1989486.  

No, all other tasks showing normal run times between 4hr 33min & 4 hr 53 min. Just thought taking a screen shot for prosperity. :-)


After all, who said doing seti was "normal"?


ROFL.....
A proud member of the OFA (Old Farts Association).
ID: 1989488 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1989508 - Posted: 10 Apr 2019, 15:48:11 UTC - in response to Message 1989347.  

I'm guessing we will get new files tomorrow after the outage. The question is... will it still be the same day ??


. . That has been the pattern in recent times but I am wondering if the hanging tapes stuck in the splitters might affect the process ...

. . I wish now that I had been keeping track of which tapes series for this date that we have completed to know if there are many more outstanding. I know we have done Blc22, Blc25, Blc31, Blc34, Blc36 and some in the Blc1x series before that. But I don't think we have seen Blc32, Blc33 or Blc35 yet ...

Stephen

? ?


Stephen guessed correctly... it is groundhog day, and we have blc32.

I'm glad they let some of the older files finish before loading the new batch in.
ID: 1989508 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989513 - Posted: 10 Apr 2019, 15:56:59 UTC - in response to Message 1989402.  




I am sorry, I need a more mature wolf to howl with.....
A proud member of the OFA (Old Farts Association).
ID: 1989513 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1989539 - Posted: 10 Apr 2019, 20:54:30 UTC

Down for maintenance again.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1989539 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1989541 - Posted: 10 Apr 2019, 21:11:27 UTC - in response to Message 1989539.  

Down for maintenance again.

Another party?
ID: 1989541 · Report as offensive
Profile mr.mac52
Avatar

Send message
Joined: 18 Mar 03
Posts: 67
Credit: 245,882,461
RAC: 0
United States
Message 1989542 - Posted: 10 Apr 2019, 21:12:01 UTC

Lots of disabled hosts just now and not downloading anything in Colorado.
ID: 1989542 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1989547 - Posted: 10 Apr 2019, 21:28:14 UTC - in response to Message 1989539.  
Last modified: 10 Apr 2019, 21:49:53 UTC

Down for maintenance again.


And we are back. A nice shorty outage.

[Edit] And as soon as I posted, my post broke the schedulers again.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1989547 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1989548 - Posted: 10 Apr 2019, 21:50:30 UTC

I blame that 108 day wu which finally completed & reported in. :-)
ID: 1989548 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1989549 - Posted: 10 Apr 2019, 21:56:24 UTC - in response to Message 1989548.  

I blame that 108 day wu which finally completed & reported in. :-)


in one of the other BOINC projects, maybe climate prediction, the CPU apps usually ran a week or so.....

Tom
A proud member of the OFA (Old Farts Association).
ID: 1989549 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989551 - Posted: 10 Apr 2019, 22:00:21 UTC - in response to Message 1989513.  




I am sorry, I need a more mature wolf to howl with.....


. . So you'd leave that helpless little pup to howl alone .... ? Hard dude, so hard ....

Stephen

:)
ID: 1989551 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1989552 - Posted: 10 Apr 2019, 22:01:46 UTC - in response to Message 1989539.  

Down for maintenance again.


. . Just a mini outage, only one hour ...

Stephen

<shrug>
ID: 1989552 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 47 · Next

Message boards : Number crunching : Panic Mode On (116) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.