Unexplained database slowness

Message boards : News : Unexplained database slowness
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 5 · Next

AuthorMessage
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1305
Credit: 27,346,393
RAC: 47,914
United States
Message 1927456 - Posted: 31 Mar 2018, 6:11:02 UTC

The database has gotten hung up a couple of times with slow queries. I've restarted it once and that seems to have helped. It'll take several hours to be sure.

If that didn't solve the problem, it probably means the index the server uses to choose workunits to send has gotten corrupted. If I need to rebuild it, we'll probably be down most of tomorrow while I do so.
@SETIEric

ID: 1927456 · Report as offensive
Profile Stargate (S.A.) Project Donor
Volunteer tester
Avatar

Send message
Joined: 4 Mar 10
Posts: 1641
Credit: 558,352
RAC: 1,271
Australia
Message 1927457 - Posted: 31 Mar 2018, 6:19:43 UTC

No worries Eric thanks for the update..
ID: 1927457 · Report as offensive
Un4given

Send message
Joined: 1 May 04
Posts: 18
Credit: 6,180,142
RAC: 1,593
United States
Message 1927458 - Posted: 31 Mar 2018, 7:28:32 UTC

As an IT guy myself, I feel your pain. Unfortunately, I think the worst case scenario is playing out. I've been days without being able to get work units, up to, and including, just before writing this message.
ID: 1927458 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1108
Credit: 112,624,245
RAC: 73,824
United States
Message 1927463 - Posted: 31 Mar 2018, 7:57:52 UTC

Appreciate the update. Good luck.
ID: 1927463 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 10316
Credit: 138,545,741
RAC: 82,650
Australia
Message 1927467 - Posted: 31 Mar 2018, 8:36:00 UTC
Last modified: 31 Mar 2018, 8:58:48 UTC

Thanks for the update.
Presently Server Status is green, but many values not updated for 2 hours & still unable to get work- "Project has no tasks available"

Edit- Server Status numbers now updated.
Still no joy getting work, and it's not just me; Server Status In-progress numbers continuing to fall.
Grant
Darwin NT
ID: 1927467 · Report as offensive
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 50085
Credit: 937,625,612
RAC: 244,438
United States
Message 1927479 - Posted: 31 Mar 2018, 10:13:32 UTC

Thank you for the update, Eric.
Looks like things still need 'adjustment'.
Appreciate your efforts last night to try to fix it.
Hope the rebuild goes well, as it appears that it may be necessary.
Happy is the person who shares their life with a cat. (Or two or three or........) =^.^=

Have made friends here.
Most were cats.
ID: 1927479 · Report as offensive
Profile Dimly Lit Lightbulb 😀
Volunteer tester
Avatar

Send message
Joined: 30 Aug 08
Posts: 15264
Credit: 6,889,186
RAC: 1,309
United Kingdom
Message 1927502 - Posted: 31 Mar 2018, 13:35:51 UTC

Thanks for the update, have a good weekend.

Member of the People Encouraging Niceness In Society club.
ID: 1927502 · Report as offensive
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 3694
Credit: 84,205,644
RAC: 134,375
Australia
Message 1927510 - Posted: 31 Mar 2018, 14:44:27 UTC - in response to Message 1927456.  

. . Hi Eric,

. . It looks like the worst case scenario indeed. None of my rigs are getting any work and they are now competely out so beddy byes for me and for them :(

Stephen

:(
ID: 1927510 · Report as offensive
Grumpy Old Man
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 7269
Credit: 45,281,379
RAC: 1,955
Sweden
Message 1927511 - Posted: 31 Mar 2018, 14:56:31 UTC

I got 34 tasks all of a sudden, and then a little bit later a few more.
ID: 1927511 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1620
Credit: 17,384,087
RAC: 12,774
United States
Message 1927514 - Posted: 31 Mar 2018, 15:31:04 UTC

Thanks for the heads up. As I can burn through 200 work units in a single day, I have activated my backup project so if I run out of work, I will still have something to crunch.
ID: 1927514 · Report as offensive
Profile Christian Diekmann

Send message
Joined: 30 Mar 00
Posts: 10
Credit: 34,097,806
RAC: 37,697
Germany
Message 1927518 - Posted: 31 Mar 2018, 16:47:06 UTC

My first letter here after 18 years

Sorry, I know you sure work a lot there at SETI. I have been working for over 18 years.
But please: How do you want to recognize and interpret an extraterrestrial signal, if you do not even have the earthly technology under control?

Here is another important request: In BOINC you can secure yourself for SETI under the calculations 10 plus 10 working days, so that in case of a system failure everyone has enough work units. Unfortunately that has never worked! If there is a failure, I can work with my computers just 8 hours, then the work units are used up.
If there is a secret attitude with which one can bypass the Stone Age bunkering of work units, then I ask for tips.

For all users, this is a huge loss of work for SETI. And then the failures that have been going on for years from Tuesday to Wednesday due to maintenance work. If there were at least work units for those two days (real 48 hours), the project would have taken a big step forward and we'd all come closer to ET.

Sorry, but I'm really upset about the many failures for years.
ID: 1927518 · Report as offensive
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 35,782
RAC: 24
United States
Message 1927549 - Posted: 31 Mar 2018, 19:11:59 UTC

any news on the database repair? Hope to get this laptop back to work soon.
hope everybody has a peaceful Easter holiday with family and freinds.
ID: 1927549 · Report as offensive
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 35,782
RAC: 24
United States
Message 1927552 - Posted: 31 Mar 2018, 19:15:20 UTC - in response to Message 1927518.  
Last modified: 31 Mar 2018, 19:18:07 UTC

perhaps we need to donate funds to build a server that can handle the work load. consider donating parts . I have a 650 watt power supply collecting dust. I'm willing to donate to this cause.

I'm willing as I'm sure others are to help in any means possible. I understand not everybody has liquid funds to donate. lets get this project going friends.. do what you can......
ID: 1927552 · Report as offensive
Triwush

Send message
Joined: 31 Aug 99
Posts: 2
Credit: 81,076,662
RAC: 28,168
United States
Message 1927554 - Posted: 31 Mar 2018, 19:18:24 UTC

18+ years of Seti enjoyment. Thanks for the updates and good work, Eric and Team.
ID: 1927554 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 10316
Credit: 138,545,741
RAC: 82,650
Australia
Message 1927577 - Posted: 31 Mar 2018, 21:20:39 UTC - in response to Message 1927552.  

perhaps we need to donate funds to build a server that can handle the work load. consider donating parts . I have a 650 watt power supply collecting dust. I'm willing to donate to this cause.

$250,000 would go a long way to getting an All Flash Array and 100GB Ethernet backbone & switches.
Grant
Darwin NT
ID: 1927577 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 5521
Credit: 381,575,576
RAC: 1,016,043
United States
Message 1927578 - Posted: 31 Mar 2018, 21:24:12 UTC - in response to Message 1927577.  

There hasn't been any posts about what they spent the donations on from the last fundraiser back in December. Are the funds just sitting idle? I would like to them to use some of that in rebuilding the servers to handle the increased work output from all the crunchers.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1927578 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 10316
Credit: 138,545,741
RAC: 82,650
Australia
Message 1927580 - Posted: 31 Mar 2018, 21:30:55 UTC - in response to Message 1927578.  

There hasn't been any posts about what they spent the donations on from the last fundraiser back in December. Are the funds just sitting idle? I would like to them to use some of that in rebuilding the servers to handle the increased work output from all the crunchers.

That money was for the Parkes data store & development
Reallocating money that was given for a particular purpose to a different one has killed many a project over the years. Using surplus funds, not so much of a problem. But re-allocating the bulk of funds raised for one purpose to another purpose is a great way of ensuring you never get donations again.

Better to state what the problem is, what is required to sort it out, and have another specific fund raiser.
Grant
Darwin NT
ID: 1927580 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 12189
Credit: 124,879,260
RAC: 40,671
United Kingdom
Message 1927589 - Posted: 31 Mar 2018, 22:02:47 UTC

I still think it's important to think about raising money for new/extra staff, to spread the load and deal with all those niggling and long-standing glitches. Don't put all your faith in hardware alone.
ID: 1927589 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 10316
Credit: 138,545,741
RAC: 82,650
Australia
Message 1927595 - Posted: 31 Mar 2018, 22:24:11 UTC - in response to Message 1927589.  
Last modified: 31 Mar 2018, 22:27:52 UTC

I still think it's important to think about raising money for new/extra staff, to spread the load and deal with all those niggling and long-standing glitches. Don't put all your faith in hardware alone.

True.
It used to be 1 splitter for each file, and splitter output was very good with only a few splitters. It's been a while since that was the case. The more splitters you have on a single file, she slower the splitting rate tends to be. So it would be nic if that issue was sorted out.
You have to have the staff to support the hardware.

But it doesn't matter how many staff you have, if the hardware isn't up to the job.

Hence a post telling us exactly what the problem is (or most likely problems. The issue (from the outside looking in) is most likely I/O contention within the file servers- even a rack of enterprise HDDs can't match the random or sequential performance of a few high end consumer SSDs, so an AFA would sort that out. Of course to take full advantage of that storage would require new servers with plenty of Cores & plenty of RAM. And of course improved network bandwidth between the systems so the internal network itself doesn't become the bottleneck), what's required to fix it, and keep it fixed for a reasonable period of time.
And it's no good getting something that's affordable, if it's not noting to meet future demands- you just have to raise more money from scratch at that time. Better to save up the money till you can afford what's required to meet current & future needs, or do the upgrades in stages. Replace the current bottleneck, with equipment that will meet our likely needs 10 years from now. When funds are next available, replace the next bottleneck, and so on.
Grant
Darwin NT
ID: 1927595 · Report as offensive
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 35,782
RAC: 24
United States
Message 1927597 - Posted: 31 Mar 2018, 22:26:57 UTC - in response to Message 1927589.  
Last modified: 31 Mar 2018, 22:27:21 UTC

I agree with the right marketing raising those kinds of funds shouldn't be an issue considering anybody can participate in the project and see their own dollars in effect,.
ID: 1927597 · Report as offensive
1 · 2 · 3 · 4 . . . 5 · Next

Message boards : News : Unexplained database slowness


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.