Panic Mode On (117) Server Problems?

Message boards : Number crunching : Panic Mode On (117) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 27 · Next

AuthorMessage
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4693
Credit: 150,351,153
RAC: 236,436
Australia
Message 2008265 - Posted: 19 Aug 2019, 9:06:53 UTC - in response to Message 2008244.  

Uploads are getting sticky again along with the general slowness of the website. Taking a long time to pull up tasks too.


. . The database master is getting 3891 hits per second ... that could do it ...

Stephen

? ?
ID: 2008265 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008373 - Posted: 19 Aug 2019, 19:59:25 UTC

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008373 · Report as offensive     Reply Quote
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4390
Credit: 54,990,803
RAC: 724
United States
Message 2008374 - Posted: 19 Aug 2019, 20:07:14 UTC - in response to Message 2008373.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.

ID: 2008374 · Report as offensive     Reply Quote
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 8127
Credit: 495,807,711
RAC: 384,197
Panama
Message 2008394 - Posted: 19 Aug 2019, 22:34:53 UTC - in response to Message 2008374.  
Last modified: 19 Aug 2019, 22:35:08 UTC

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host
ID: 2008394 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008396 - Posted: 19 Aug 2019, 22:47:15 UTC - in response to Message 2008394.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008396 · Report as offensive     Reply Quote
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4693
Credit: 150,351,153
RAC: 236,436
Australia
Message 2008401 - Posted: 19 Aug 2019, 23:19:40 UTC - in response to Message 2008396.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.


. . Now I want to say greedy but I am not sure I can duck fast enough ... :)

Stephen

:)
ID: 2008401 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008404 - Posted: 19 Aug 2019, 23:38:01 UTC - in response to Message 2008401.  

Impossible to view the tasks of any of my hosts due the database sluggishess. Pages time out when tried.


Pages are loading instantly for me.


Works fine here too, even on a 6500 cache host

Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.


. . Now I want to say greedy but I am not sure I can duck fast enough ... :)

Stephen

:)

If I could get paired with faster wingmen, I wouldn't have such a big footprint. Only 28K tasks in progress for all hosts.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008404 · Report as offensive     Reply Quote
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4693
Credit: 150,351,153
RAC: 236,436
Australia
Message 2008409 - Posted: 20 Aug 2019, 0:02:27 UTC - in response to Message 2008404.  
Last modified: 20 Aug 2019, 0:04:03 UTC


Yes, but you only have 1/10 of the number of tasks in the database that I do. I have 110K.

. . Now I want to say greedy but I am not sure I can duck fast enough ... :)
Stephen
:)

If I could get paired with faster wingmen, I wouldn't have such a big footprint. Only 28K tasks in progress for all hosts.


. . That is the curse of the faster(est) crunchers, large pending queues. And the other side, large valid lists :)

Stephen

:)
ID: 2008409 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008413 - Posted: 20 Aug 2019, 0:10:52 UTC - in response to Message 2008409.  

WU deletions have finally bottomed out. The tasks are finally appearing after a much shorter while.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008413 · Report as offensive     Reply Quote
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 566
Credit: 1,947,888
RAC: 844
United States
Message 2008452 - Posted: 20 Aug 2019, 6:10:40 UTC

mild panic - not sure why the RTS queue is at 360K.
ID: 2008452 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008459 - Posted: 20 Aug 2019, 7:40:22 UTC - in response to Message 2008452.  

WU deletions are back on the rise, so splitting reduces because of the I/O overhead.


Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008459 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 11650
Credit: 173,656,361
RAC: 115,903
Australia
Message 2008460 - Posted: 20 Aug 2019, 8:14:16 UTC - in response to Message 2008459.  
Last modified: 20 Aug 2019, 8:17:26 UTC

WU deletions are back on the rise, so splitting reduces because of the I/O overhead.

Not sure just what is going on there, as the backlog had been much higher for much longer & the splitters were able to keep pumping out work; but they have certainly ground to a near halt now.
Looking at going in to the weekly outage with no work in the Ready-to-send buffer & crunchers caches already running down as well.

Edit- looking at the amount of work In progress, it was probably that level going over 6 million again that tipped the Deleters & Splitters over the edge (although once again, they were able to put out work previously with In progress levels up that high).
Grant
Darwin NT
ID: 2008460 · Report as offensive     Reply Quote
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4390
Credit: 54,990,803
RAC: 724
United States
Message 2008506 - Posted: 20 Aug 2019, 19:54:34 UTC

Now for the fun part, getting more work after the outage.

ID: 2008506 · Report as offensive     Reply Quote
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 4693
Credit: 150,351,153
RAC: 236,436
Australia
Message 2008507 - Posted: 20 Aug 2019, 20:01:15 UTC - in response to Message 2008506.  

Now for the fun part, getting more work after the outage.

. . Hi Arkayn
. . At least it was only 4 hours, only ran out a little over an hour ago.

Stephen

<shrug>
ID: 2008507 · Report as offensive     Reply Quote
Spartana

Send message
Joined: 24 Apr 16
Posts: 94
Credit: 12,807,884
RAC: 217,366
United States
Message 2008512 - Posted: 20 Aug 2019, 20:24:49 UTC

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.
ID: 2008512 · Report as offensive     Reply Quote
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4390
Credit: 54,990,803
RAC: 724
United States
Message 2008513 - Posted: 20 Aug 2019, 20:29:34 UTC - in response to Message 2008507.  

Now for the fun part, getting more work after the outage.

. . Hi Arkayn
. . At least it was only 4 hours, only ran out a little over an hour ago.

Stephen

<shrug>


I still had half my cache left.

ID: 2008513 · Report as offensive     Reply Quote
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1346
Credit: 10,593,357
RAC: 4,716
New Zealand
Message 2008520 - Posted: 20 Aug 2019, 21:46:30 UTC - in response to Message 2008512.  

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.

Fixing this problem is simple. Run another project so they don't idol
ID: 2008520 · Report as offensive     Reply Quote
Spartana

Send message
Joined: 24 Apr 16
Posts: 94
Credit: 12,807,884
RAC: 217,366
United States
Message 2008522 - Posted: 20 Aug 2019, 21:55:54 UTC - in response to Message 2008520.  

It really is a bit sad to see my GPUs just sitting there doing nothing. Cold, flaccid, some of them don't even have the motivation to spin their little fans anymore.

My orphaned GPUs.

Fixing this problem is simple. Run another project so they don't idol


Only if it'll find aliens.

Wedgies and purple nerples are the only things those math and biology nerds will get from me. ;-)
ID: 2008522 · Report as offensive     Reply Quote
Profile Wiggo "Democratic Socialist"
Avatar

Send message
Joined: 24 Jan 00
Posts: 16786
Credit: 230,321,118
RAC: 164,740
Australia
Message 2008523 - Posted: 20 Aug 2019, 21:55:55 UTC
Last modified: 20 Aug 2019, 21:57:48 UTC

Finally things are warming back up here this morning now that my 2 rigs have their caches filled again.

Another few more degrees in here and then I can turn the heater off (it gets cold here in winter in the highlands down under and I feel it when all 4 GPU's go cold).

Cheers.
ID: 2008523 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 9850
Credit: 925,933,727
RAC: 1,504,588
United States
Message 2008573 - Posted: 21 Aug 2019, 2:58:08 UTC

The replica database is not making any progress. Been stuck lagging 5K seconds for hours now.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 2008573 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 27 · Next

Message boards : Number crunching : Panic Mode On (117) Server Problems?


 
©2019 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.