Unexplained database slowness

Message boards : News : Unexplained database slowness
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 9592
Credit: 123,383,855
RAC: 75,412
Australia
Message 1930457 - Posted: 17 Apr 2018, 6:36:01 UTC - in response to Message 1930419.  

The experimental reorg that we did two weeks ago appears to have worked. Our speed is better, and our outage last week was down to about 3.5 hours.

Fingers crossed that things keep working out.

Prior to the Arecibo VLARs going out to NVidia GPUs, the deleters & purgers were falling behind again.
Will be interesting to see if they do any better then next time the Received-last-hour hits 130k-145k sustained, they were struggling with it just under 120k.
Grant
Darwin NT
ID: 1930457 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 4169
Credit: 240,838,203
RAC: 583,504
United States
Message 1930560 - Posted: 17 Apr 2018, 15:51:38 UTC - in response to Message 1930457.  

I wonder if we will ever hit the 145K/hour return rate again as long as there are Arecibo tasks going out. Also, have you noticed the coincidence in the Haveland graphs where the splitter output has a negative spike to zero at the same time the purgers/deleters have a positive spike? I wonder is this is part of the database reorg reconfiguration. Looks like a script is running.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1930560 · Report as offensive     Reply Quote
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1019
Credit: 142,063,066
RAC: 154,614
Denmark
Message 1930568 - Posted: 17 Apr 2018, 21:06:09 UTC - in response to Message 1930427.  

Thanks for the progress report Eric. Fingers crossed. Everything seems to hitting on all cylinders since the reorg. Good Job!

+1
ID: 1930568 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 4169
Credit: 240,838,203
RAC: 583,504
United States
Message 1930570 - Posted: 17 Apr 2018, 21:10:04 UTC

Isn't this a new process we haven't seen before on the servers?

splitter_throttle_sah bruno
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1930570 · Report as offensive     Reply Quote
Kissagogo27 Special Project $75 donor

Send message
Joined: 6 Nov 99
Posts: 171
Credit: 4,661,676
RAC: 6,662
France
Message 1930579 - Posted: 17 Apr 2018, 22:18:54 UTC

i've just seen it , splitters speed limit ?
ID: 1930579 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 4169
Credit: 240,838,203
RAC: 583,504
United States
Message 1930580 - Posted: 17 Apr 2018, 22:33:14 UTC - in response to Message 1930579.  

i've just seen it , splitters speed limit ?

No, I think it is the process that knocks the splitters offline when the RTS buffer hits its max limit trip-point of around 620-640K. I've caught the splitters offline several times when the RTS buffer gets full. When the splitters go offline, it frees up resources for the file deleters and purgers to get caught up. You can see the behavior in the Haveland graphs.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1930580 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1082
Credit: 103,540,318
RAC: 84,661
United States
Message 1930599 - Posted: 18 Apr 2018, 1:13:02 UTC - in response to Message 1930560.  

I wonder if we will ever hit the 145K/hour return rate again as long as there are Arecibo tasks going out. . .

I imagine we will, once the glut of APs goes away.
I think that's the more relevant factor here, rather than Aricebo VLARs.
ID: 1930599 · Report as offensive     Reply Quote
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 49655
Credit: 903,849,598
RAC: 189,990
United States
Message 1930715 - Posted: 18 Apr 2018, 17:18:57 UTC

Great news on the DB reorg, Eric!
And the shortened outages are a refreshing change as well!
I hope things stay flowing if the result return rate goes back up at some point.
But in any case, very nice to see the servers working efficiently.
My body may be here, but my mind is in a galaxy far, far away.

Have made friends here.
Most were cats.
ID: 1930715 · Report as offensive     Reply Quote
juan BFP Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 6820
Credit: 375,305,564
RAC: 179,880
Panama
Message 1930729 - Posted: 18 Apr 2018, 19:33:10 UTC - in response to Message 1930715.  

Great news on the DB reorg, Eric!
And the shortened outages are a refreshing change as well!
I hope things stay flowing if the result return rate goes back up at some point.
But in any case, very nice to see the servers working efficiently.

+ 1
ID: 1930729 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1082
Credit: 103,540,318
RAC: 84,661
United States
Message 1930788 - Posted: 19 Apr 2018, 2:43:38 UTC - in response to Message 1930729.  

Great news on the DB reorg, Eric!
And the shortened outages are a refreshing change as well!
I hope things stay flowing if the result return rate goes back up at some point.
But in any case, very nice to see the servers working efficiently.

+ 1

+1
ID: 1930788 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5

Message boards : News : Unexplained database slowness


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.