The Server Issues / Outages Thread - Panic Mode On! (117)


Advanced search

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 52 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008373 - Posted: 19 Aug 2019, 19:59:25 UTC

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008373 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 2008374 - Posted: 19 Aug 2019, 20:07:14 UTC - in response to Message 2008373.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.

ID: 2008374 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2008394 - Posted: 19 Aug 2019, 22:34:53 UTC - in response to Message 2008374.  
Last modified: 19 Aug 2019, 22:35:08 UTC

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host
ID: 2008394 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008396 - Posted: 19 Aug 2019, 22:47:15 UTC - in response to Message 2008394.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008396 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2008401 - Posted: 19 Aug 2019, 23:19:40 UTC - in response to Message 2008396.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.


. . Now I want to say greedy but I am not sure I can duck fast enough ... :)

Stephen

:)
ID: 2008401 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008404 - Posted: 19 Aug 2019, 23:38:01 UTC - in response to Message 2008401.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.


. . Now I want to say greedy but I am not sure I can duck fast enough ... :)

Stephen

:)

If I could get paired with faster wingmen, I wouldn't have such a big footprint. Only 28K tasks in progress for all hosts.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008404 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2008409 - Posted: 20 Aug 2019, 0:02:27 UTC - in response to Message 2008404.  
Last modified: 20 Aug 2019, 0:04:03 UTC


Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.

. . Now I want to say greedy but I am not sure I can duck fast enough ... :)
Stephen
:)

If I could get paired with faster wingmen, I wouldn't have such a big footprint. Only 28K tasks in progress for all hosts.


. . That is the curse of the faster(est) crunchers, large pending queues. And the other side, large valid lists :)

Stephen

:)
ID: 2008409 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008413 - Posted: 20 Aug 2019, 0:10:52 UTC - in response to Message 2008409.  

WU deletions have finally bottomed out. The tasks are finally appearing after a much shorter while.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008413 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2008452 - Posted: 20 Aug 2019, 6:10:40 UTC

mild panic - not sure why the RTS queue is at 360K.
ID: 2008452 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008459 - Posted: 20 Aug 2019, 7:40:22 UTC - in response to Message 2008452.  

WU deletions are back on the rise, so splitting reduces because of the I/O overhead.

Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008459 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 2008460 - Posted: 20 Aug 2019, 8:14:16 UTC - in response to Message 2008459.  
Last modified: 20 Aug 2019, 8:17:26 UTC

WU deletions are back on the rise, so splitting reduces because of the I/O overhead.

Not sure just what is going on there, as the backlog had been much higher for much longer & the splitters were able to keep pumping out work; but they have certainly ground to a near halt now.
Looking at going in to the weekly outage with no work in the Ready-to-send buffer & crunchers caches already running down as well.

Edit- looking at the amount of work In progress, it was probably that level going over 6 million again that tipped the Deleters & Splitters over the edge (although once again, they were able to put out work previously with In progress levels up that high).
Grant
Darwin NT
ID: 2008460 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 2008506 - Posted: 20 Aug 2019, 19:54:34 UTC

Now for the fun part, getting more work after the outage.

ID: 2008506 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2008507 - Posted: 20 Aug 2019, 20:01:15 UTC - in response to Message 2008506.  

Now for the fun part, getting more work after the outage.

. . Hi Arkayn
. . At least it was only 4 hours, only ran out a little over an hour ago.

Stephen

<shrug>
ID: 2008507 · Report as offensive
Spartana

Send message
Joined: 24 Apr 16
Posts: 99
Credit: 41,712,387
RAC: 25
United States
Message 2008512 - Posted: 20 Aug 2019, 20:24:49 UTC

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.
ID: 2008512 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 2008513 - Posted: 20 Aug 2019, 20:29:34 UTC - in response to Message 2008507.  

Now for the fun part, getting more work after the outage.

. . Hi Arkayn
. . At least it was only 4 hours, only ran out a little over an hour ago.

Stephen

<shrug>


I still had half my cache left.

ID: 2008513 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 2008520 - Posted: 20 Aug 2019, 21:46:30 UTC - in response to Message 2008512.  

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.

Fixing this problem is simple. Run another project so they don't idol
ID: 2008520 · Report as offensive
Spartana

Send message
Joined: 24 Apr 16
Posts: 99
Credit: 41,712,387
RAC: 25
United States
Message 2008522 - Posted: 20 Aug 2019, 21:55:54 UTC - in response to Message 2008520.  

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.

Fixing this problem is simple. Run another project so they don't idol


Only if it'll find aliens.

Wedgies and purple nerples are the only things those math and biology nerds will get from me. ;-)
ID: 2008522 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 2008523 - Posted: 20 Aug 2019, 21:55:55 UTC
Last modified: 20 Aug 2019, 21:57:48 UTC

Finally things are warming back up here this morning now that my 2 rigs have their caches filled again.

Another few more degrees in here and then I can turn the heater off (it gets cold here in winter in the highlands down under and I feel it when all 4 GPU's go cold).

Cheers.
ID: 2008523 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 2008573 - Posted: 21 Aug 2019, 2:58:08 UTC

The replica database is not making any progress. Been stuck lagging 5K seconds for hours now.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 2008573 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2008576 - Posted: 21 Aug 2019, 3:08:25 UTC - in response to Message 2008573.  

The replica database is not making any progress. Been stuck lagging 5K seconds for hours now.

. . I wonder how far away Muarae2 is? Not long I hope ...

Stephen

? ?
ID: 2008576 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 52 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (117)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.