Panic Mode On (114) Server Problems?

Message boards : Number crunching : Panic Mode On (114) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · 22 · 23 . . . 45 · Next

AuthorMessage
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1973097 - Posted: 2 Jan 2019, 23:09:41 UTC

and we are back...
ID: 1973097 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1973098 - Posted: 2 Jan 2019, 23:27:38 UTC - in response to Message 1973097.  

and we are back...


. . Yes! Yes we are!

Stephen

:)
ID: 1973098 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1973106 - Posted: 3 Jan 2019, 0:14:00 UTC

forums are back, but no communication between hosts and servers yet.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1973106 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1973110 - Posted: 3 Jan 2019, 0:45:24 UTC - in response to Message 1973106.  
Last modified: 3 Jan 2019, 0:54:49 UTC

. . [edit]
. . Forums are slow and I cannot report anything from the 2 Windows boxes. The 2 Linux boxes are were a bit hit and miss but generally working. Now everything is incommunicado.

Stephen

:(
ID: 1973110 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1973111 - Posted: 3 Jan 2019, 0:48:35 UTC

my finished WUs have been uploaded, but not validated, at this point. I've stopped asking for WUs until I see some signs in the status that WUs are actually being handed out.
ID: 1973111 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1973112 - Posted: 3 Jan 2019, 0:57:06 UTC - in response to Message 1973111.  

my finished WUs have been uploaded, but not validated, at this point. I've stopped asking for WUs until I see some signs in the status that WUs are actually being handed out.


. . I have set my work requests to 0.05 and 0. If work starts flowing it should keep the rigs working but place very small demand on the schedulers/download servers.

Stephen

<shrug>
ID: 1973112 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1973113 - Posted: 3 Jan 2019, 0:58:56 UTC

looks like splitting is happening. There is an Aricebo file, and I can see progress on the blc files as well, so when the floodgates open there will be more than the usual (600K) files to hand out.
ID: 1973113 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1973116 - Posted: 3 Jan 2019, 1:20:26 UTC
Last modified: 3 Jan 2019, 1:55:31 UTC

The boards seem to have a better response time right now, but I am concerned that I usually don't see anything in this status field, but now it looks like there is at least a 2 hour backlog.

Transitioner backlog (hours) 2

edit : status updates are back

Results ready to send 0 2,957 1,038,656 WOW!!!
ID: 1973116 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1973128 - Posted: 3 Jan 2019, 3:55:55 UTC

The stats seem to be mostly current but still having a hard time getting any work, just drips and drabs. I still need to report all my work on my daily driver once I clear out the tasks from the development host I have been working on today. Probably won't revisit in a while and didn't want to leave tasks to time out and be polite about it.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1973128 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1973130 - Posted: 3 Jan 2019, 4:24:36 UTC

status hasn't updated for about 30 minutes, so this is a rough recovery.
ID: 1973130 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13744
Credit: 208,696,464
RAC: 304
Australia
Message 1973133 - Posted: 3 Jan 2019, 5:20:28 UTC - in response to Message 1973130.  

status hasn't updated for about 30 minutes, so this is a rough recovery.

A recovery implies things are improving, getting better.
There was a brief period where that might have been the case, but now it's just fallen over & doesn't appear to be getting up any time soon.
At least the Scheduler errors have stopped, now we just need to be able to get work again when we can contact the Scheduler.
Grant
Darwin NT
ID: 1973133 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13744
Credit: 208,696,464
RAC: 304
Australia
Message 1973150 - Posted: 3 Jan 2019, 7:01:01 UTC

Out of CPU work again.
On the odd occasion I could get some work, it was mostly for the GPUs. The GPUs were returning work so fast that on the rare occasion work did come through it was just to replace what had been processed. The odd WU that did make it through for the CPU wasn't enough to keep it going due to the periods between work being available being so long. Even after extended outages it's not this difficult to get work- be it the Scheduler or the Feeder or some other process, something is seriously screwed up.


Normally after an outage, the Work-in-progress takes a dive as all the work already returned is reported. Then it gradually climbs back up to it's usual level. This time it fell, sort of recovered a bit, then just continued to fall further.
At best, things have stopped getting worse, but they certainly aren't improving.
Grant
Darwin NT
ID: 1973150 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1973152 - Posted: 3 Jan 2019, 7:17:28 UTC

Just got 30 WUs for my GPU only cruncher
ID: 1973152 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13744
Credit: 208,696,464
RAC: 304
Australia
Message 1973160 - Posted: 3 Jan 2019, 8:11:04 UTC - in response to Message 1973152.  
Last modified: 3 Jan 2019, 8:13:06 UTC

Just got 30 WUs for my GPU only cruncher

Just managed to pick up some work, an hour and a half after the last successful attempt. So, still out of CPU work.

Still no signs of recovery from the project (work-in-progress is still way, way down), at least it hasn't got any worse.
Grant
Darwin NT
ID: 1973160 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1973162 - Posted: 3 Jan 2019, 8:20:35 UTC

I still have one host that has never received a single task since the project came back.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1973162 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13744
Credit: 208,696,464
RAC: 304
Australia
Message 1973163 - Posted: 3 Jan 2019, 8:24:48 UTC - in response to Message 1973162.  

I still have one host that has never received a single task since the project came back.

Yeah, more than ever- timing is everything.
Grant
Darwin NT
ID: 1973163 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13744
Credit: 208,696,464
RAC: 304
Australia
Message 1973171 - Posted: 3 Jan 2019, 9:55:05 UTC

Managed to finally get some more CPU. Whether it will be enough to last till the next WU lottery payout though is anybody's guess.
Grant
Darwin NT
ID: 1973171 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1973177 - Posted: 3 Jan 2019, 10:39:52 UTC

Still struggling to get work here, almost 12 hrs after the outage.
ID: 1973177 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1973185 - Posted: 3 Jan 2019, 11:46:00 UTC
Last modified: 3 Jan 2019, 11:46:24 UTC

Now that the festivities are over, don your headphones, pop over to youtube & listen to I'm Alive - Celine Dion.

Best time to listen is between 16:00 UTC Tues & 16:00 UTC Weds.

Certain to cure any WU blues. :-)
ID: 1973185 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1973190 - Posted: 3 Jan 2019, 12:56:04 UTC - in response to Message 1973177.  
Last modified: 3 Jan 2019, 12:58:10 UTC

Still struggling to get work here, almost 12 hrs after the outage.

Still NADA here too...

Running out of GPU WU. Rescheduled the last CPU WU to GPU now.

Thu 03 Jan 2019 07:50:54 AM EST | SETI@home | Requesting new tasks for CPU and NVIDIA GPU
Thu 03 Jan 2019 07:50:55 AM EST | SETI@home | Scheduler request completed: got 0 new tasks
Thu 03 Jan 2019 07:50:55 AM EST | SETI@home | Project has no tasks available

The RTS is at 633,712 and the Current result creation rate 55.9085/sec.
This output must be going somewhere, any clue or idea how to fix?
ID: 1973190 · Report as offensive
Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · 22 · 23 . . . 45 · Next

Message boards : Number crunching : Panic Mode On (114) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.