Unexplained database slowness

Message boards : News : Unexplained database slowness
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 5 · Next

AuthorMessage
Eric Korpela Project Donor
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 3 Apr 99
Posts: 1299
Credit: 23,121,620
RAC: 14,714
United States
Message 1927456 - Posted: 31 Mar 2018, 6:11:02 UTC

The database has gotten hung up a couple of times with slow queries. I've restarted it once and that seems to have helped. It'll take several hours to be sure.

If that didn't solve the problem, it probably means the index the server uses to choose workunits to send has gotten corrupted. If I need to rebuild it, we'll probably be down most of tomorrow while I do so.
@SETIEric

ID: 1927456 · Report as offensive     Reply Quote
Profile Stephen Newton Project Donor
Volunteer tester
Avatar

Send message
Joined: 4 Mar 10
Posts: 1263
Credit: 382,907
RAC: 1,962
Australia
Message 1927457 - Posted: 31 Mar 2018, 6:19:43 UTC

No worries Eric thanks for the update..
ID: 1927457 · Report as offensive     Reply Quote
Un4given Project Donor

Send message
Joined: 1 May 04
Posts: 18
Credit: 5,982,019
RAC: 4,990
United States
Message 1927458 - Posted: 31 Mar 2018, 7:28:32 UTC

As an IT guy myself, I feel your pain. Unfortunately, I think the worst case scenario is playing out. I've been days without being able to get work units, up to, and including, just before writing this message.
ID: 1927458 · Report as offensive     Reply Quote
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1090
Credit: 107,431,529
RAC: 30,667
United States
Message 1927463 - Posted: 31 Mar 2018, 7:57:52 UTC

Appreciate the update. Good luck.
ID: 1927463 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 9899
Credit: 128,414,196
RAC: 80,797
Australia
Message 1927467 - Posted: 31 Mar 2018, 8:36:00 UTC
Last modified: 31 Mar 2018, 8:58:48 UTC

Thanks for the update.
Presently Server Status is green, but many values not updated for 2 hours & still unable to get work- "Project has no tasks available"

Edit- Server Status numbers now updated.
Still no joy getting work, and it's not just me; Server Status In-progress numbers continuing to fall.
Grant
Darwin NT
ID: 1927467 · Report as offensive     Reply Quote
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 49845
Credit: 914,529,168
RAC: 161,114
United States
Message 1927479 - Posted: 31 Mar 2018, 10:13:32 UTC

Thank you for the update, Eric.
Looks like things still need 'adjustment'.
Appreciate your efforts last night to try to fix it.
Hope the rebuild goes well, as it appears that it may be necessary.
What meowing lurks in the hearts of man? The kittyman knows....MEOWhahahahahahha!

Have made friends here.
Most were cats.
ID: 1927479 · Report as offensive     Reply Quote
Profile Dimly Lit Lightbulb 😀
Volunteer tester
Avatar

Send message
Joined: 30 Aug 08
Posts: 15163
Credit: 6,699,039
RAC: 1,550
United Kingdom
Message 1927502 - Posted: 31 Mar 2018, 13:35:51 UTC

Thanks for the update, have a good weekend.

Member of the People Encouraging Niceness In Society club.
ID: 1927502 · Report as offensive     Reply Quote
Stephen "Heretic" Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 3352
Credit: 69,662,288
RAC: 91,204
Australia
Message 1927510 - Posted: 31 Mar 2018, 14:44:27 UTC - in response to Message 1927456.  

. . Hi Eric,

. . It looks like the worst case scenario indeed. None of my rigs are getting any work and they are now competely out so beddy byes for me and for them :(

Stephen

:(
ID: 1927510 · Report as offensive     Reply Quote
Tutankhamon
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 7112
Credit: 44,223,852
RAC: 4,186
Sweden
Message 1927511 - Posted: 31 Mar 2018, 14:56:31 UTC

I got 34 tasks all of a sudden, and then a little bit later a few more.
ID: 1927511 · Report as offensive     Reply Quote
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1620
Credit: 15,843,415
RAC: 13,970
United States
Message 1927514 - Posted: 31 Mar 2018, 15:31:04 UTC

Thanks for the heads up. As I can burn through 200 work units in a single day, I have activated my backup project so if I run out of work, I will still have something to crunch.
ID: 1927514 · Report as offensive     Reply Quote
Profile Christian Diekmann

Send message
Joined: 30 Mar 00
Posts: 10
Credit: 29,307,135
RAC: 14,963
Germany
Message 1927518 - Posted: 31 Mar 2018, 16:47:06 UTC

My first letter here after 18 years

Sorry, I know you sure work a lot there at SETI. I have been working for over 18 years.
But please: How do you want to recognize and interpret an extraterrestrial signal, if you do not even have the earthly technology under control?

Here is another important request: In BOINC you can secure yourself for SETI under the calculations 10 plus 10 working days, so that in case of a system failure everyone has enough work units. Unfortunately that has never worked! If there is a failure, I can work with my computers just 8 hours, then the work units are used up.
If there is a secret attitude with which one can bypass the Stone Age bunkering of work units, then I ask for tips.

For all users, this is a huge loss of work for SETI. And then the failures that have been going on for years from Tuesday to Wednesday due to maintenance work. If there were at least work units for those two days (real 48 hours), the project would have taken a big step forward and we'd all come closer to ET.

Sorry, but I'm really upset about the many failures for years.
ID: 1927518 · Report as offensive     Reply Quote
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 33,812
RAC: 103
United States
Message 1927549 - Posted: 31 Mar 2018, 19:11:59 UTC

any news on the database repair? Hope to get this laptop back to work soon.
hope everybody has a peaceful Easter holiday with family and freinds.
ID: 1927549 · Report as offensive     Reply Quote
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 33,812
RAC: 103
United States
Message 1927552 - Posted: 31 Mar 2018, 19:15:20 UTC - in response to Message 1927518.  
Last modified: 31 Mar 2018, 19:18:07 UTC

perhaps we need to donate funds to build a server that can handle the work load. consider donating parts . I have a 650 watt power supply collecting dust. I'm willing to donate to this cause.

I'm willing as I'm sure others are to help in any means possible. I understand not everybody has liquid funds to donate. lets get this project going friends.. do what you can......
ID: 1927552 · Report as offensive     Reply Quote
Triwush

Send message
Joined: 31 Aug 99
Posts: 2
Credit: 77,568,456
RAC: 54,747
United States
Message 1927554 - Posted: 31 Mar 2018, 19:18:24 UTC

18+ years of Seti enjoyment. Thanks for the updates and good work, Eric and Team.
ID: 1927554 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 9899
Credit: 128,414,196
RAC: 80,797
Australia
Message 1927577 - Posted: 31 Mar 2018, 21:20:39 UTC - in response to Message 1927552.  

perhaps we need to donate funds to build a server that can handle the work load. consider donating parts . I have a 650 watt power supply collecting dust. I'm willing to donate to this cause.

$250,000 would go a long way to getting an All Flash Array and 100GB Ethernet backbone & switches.
Grant
Darwin NT
ID: 1927577 · Report as offensive     Reply Quote
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 4476
Credit: 278,695,010
RAC: 631,647
United States
Message 1927578 - Posted: 31 Mar 2018, 21:24:12 UTC - in response to Message 1927577.  

There hasn't been any posts about what they spent the donations on from the last fundraiser back in December. Are the funds just sitting idle? I would like to them to use some of that in rebuilding the servers to handle the increased work output from all the crunchers.
Seti@Home classic workunits:20,676 CPU time:74,226 hours
ID: 1927578 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 9899
Credit: 128,414,196
RAC: 80,797
Australia
Message 1927580 - Posted: 31 Mar 2018, 21:30:55 UTC - in response to Message 1927578.  

There hasn't been any posts about what they spent the donations on from the last fundraiser back in December. Are the funds just sitting idle? I would like to them to use some of that in rebuilding the servers to handle the increased work output from all the crunchers.

That money was for the Parkes data store & development
Reallocating money that was given for a particular purpose to a different one has killed many a project over the years. Using surplus funds, not so much of a problem. But re-allocating the bulk of funds raised for one purpose to another purpose is a great way of ensuring you never get donations again.

Better to state what the problem is, what is required to sort it out, and have another specific fund raiser.
Grant
Darwin NT
ID: 1927580 · Report as offensive     Reply Quote
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11991
Credit: 118,641,544
RAC: 40,571
United Kingdom
Message 1927589 - Posted: 31 Mar 2018, 22:02:47 UTC

I still think it's important to think about raising money for new/extra staff, to spread the load and deal with all those niggling and long-standing glitches. Don't put all your faith in hardware alone.
ID: 1927589 · Report as offensive     Reply Quote
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 9899
Credit: 128,414,196
RAC: 80,797
Australia
Message 1927595 - Posted: 31 Mar 2018, 22:24:11 UTC - in response to Message 1927589.  
Last modified: 31 Mar 2018, 22:27:52 UTC

I still think it's important to think about raising money for new/extra staff, to spread the load and deal with all those niggling and long-standing glitches. Don't put all your faith in hardware alone.

True.
It used to be 1 splitter for each file, and splitter output was very good with only a few splitters. It's been a while since that was the case. The more splitters you have on a single file, she slower the splitting rate tends to be. So it would be nic if that issue was sorted out.
You have to have the staff to support the hardware.

But it doesn't matter how many staff you have, if the hardware isn't up to the job.

Hence a post telling us exactly what the problem is (or most likely problems. The issue (from the outside looking in) is most likely I/O contention within the file servers- even a rack of enterprise HDDs can't match the random or sequential performance of a few high end consumer SSDs, so an AFA would sort that out. Of course to take full advantage of that storage would require new servers with plenty of Cores & plenty of RAM. And of course improved network bandwidth between the systems so the internal network itself doesn't become the bottleneck), what's required to fix it, and keep it fixed for a reasonable period of time.
And it's no good getting something that's affordable, if it's not noting to meet future demands- you just have to raise more money from scratch at that time. Better to save up the money till you can afford what's required to meet current & future needs, or do the upgrades in stages. Replace the current bottleneck, with equipment that will meet our likely needs 10 years from now. When funds are next available, replace the next bottleneck, and so on.
Grant
Darwin NT
ID: 1927595 · Report as offensive     Reply Quote
Christian Lynch

Send message
Joined: 16 Nov 17
Posts: 4
Credit: 33,812
RAC: 103
United States
Message 1927597 - Posted: 31 Mar 2018, 22:26:57 UTC - in response to Message 1927589.  
Last modified: 31 Mar 2018, 22:27:21 UTC

I agree with the right marketing raising those kinds of funds shouldn't be an issue considering anybody can participate in the project and see their own dollars in effect,.
ID: 1927597 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 5 · Next

Message boards : News : Unexplained database slowness


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.