MySQL Weirdness (Jul 29 2009)


log in

Advanced search

Message boards : Technical News : MySQL Weirdness (Jul 29 2009)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 922244 - Posted: 29 Jul 2009, 22:32:28 UTC

So.. getting mork on line as a test replica server still continues to be one headache after another. We finally got the hardware working, finally got the drive configuration set up, finally got the OS installed, finally got MySQL fired up, and we were populating the databases using Tuesday's dump files.

Then we hit a completely mysterious error and consistently at the same point in the dump file. Long story short, I spent pretty much all day today trying to find the cause of this error. At this point we're about 90% convinced it's an actual bug in the MySQL version that comes standard with Fedora Core 11 (version 5.1.35) where it fails reading mysqldumps containing large text fields. This seems like a major problem, no? Anyway, the same mysqldump worked on a test 5.0.x database engine. So I'm looking to upgrade this version beyond what's in the current Fedora repositories. What a pain!!!

I just turned on the "show results" flag, even though our current replica is still far behind reality.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 922265 - Posted: 29 Jul 2009, 23:12:11 UTC - in response to Message 922244.

Replying to myself... it seems like a mysql upgrade isn't actually possible yet (we're already very close to what's publically available). However, I think I just scripted up a workaround that so far is working and reading the mysql dump file into mork. Gotta love perl.

- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Terror Australis
Volunteer tester
Send message
Joined: 14 Feb 04
Posts: 1715
Credit: 205,773,319
RAC: 27,608
Australia
Message 922305 - Posted: 30 Jul 2009, 0:51:26 UTC

Have you thought about trying a different Linux distro ? Throughout your posts in the Tech News forum there is a list of problems you've had with installation, bugs etc. over the past few years. I've experimented with many different Linux distro's over the years and even at the desktop level I've found Fedora less "user friendly" and quirkier than others.

Profile Edywison
Avatar
Send message
Joined: 31 May 09
Posts: 13
Credit: 20,563
RAC: 0
Indonesia
Message 922375 - Posted: 30 Jul 2009, 8:49:10 UTC - in response to Message 922244.

That's why I have decided to leave computer related field, I HAVE ENOUGH.
No more errors, no more bugs.
They drive me crazy.
They give me headache.

NO MORE PROGRAMMING, NO MORE DATABASE IN MY LIFE.
I QUITTTTTTTTTTTT

Speedy
Volunteer tester
Avatar
Send message
Joined: 26 Jun 04
Posts: 678
Credit: 5,922,634
RAC: 3,922
New Zealand
Message 922377 - Posted: 30 Jul 2009, 9:12:54 UTC

Thanks for news updates Matt I love reading them. How's the data bank holding up? Out of complete curiosity do any of the team crunch data for the main project while they are doing their work on a daily basis?

____________

Live in NZ y not join Smile City?

Profile S@NL - Eesger - www.knoop.nl
Avatar
Send message
Joined: 7 Oct 01
Posts: 384
Credit: 37,171,080
RAC: 14,069
Netherlands
Message 922378 - Posted: 30 Jul 2009, 9:19:50 UTC - in response to Message 922265.
Last modified: 30 Jul 2009, 9:20:42 UTC

Perl :D (I am a "small" Perl fan myself ;)

I (and our team) have trouble with large SQL tables also, our (project)server uses MySql version 4.1.22 (community-nt).. we are planing to switch to Linux (and a newer MySql version)..
Which version would you recommend? (5.0.x?)
____________
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS

Morpheus57
Volunteer tester
Avatar
Send message
Joined: 14 Mar 03
Posts: 6
Credit: 11,088,695
RAC: 5,134
Puerto Rico
Message 922457 - Posted: 30 Jul 2009, 16:06:22 UTC

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.
____________

Profile chrisp jr
Send message
Joined: 29 Dec 02
Posts: 2
Credit: 1,189,815
RAC: 0
United Kingdom
Message 922485 - Posted: 30 Jul 2009, 18:50:21 UTC - in response to Message 922457.

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.


I was going to suggest the same, we run 2 CentOS 5 boxes at work for email virus and spam-filtering which process between 6000-7000 items an hour. They are rock solid in my opinion.

1mp0£173
Volunteer tester
Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 922494 - Posted: 30 Jul 2009, 19:25:16 UTC - in response to Message 922485.

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.


I was going to suggest the same, we run 2 CentOS 5 boxes at work for email virus and spam-filtering which process between 6000-7000 items an hour. They are rock solid in my opinion.

Things to remember:

  • SETI@Home is trying to run just one distribution, so switching to CENTOS or Red Hat or Ubuntu means eventually switching every server to a new distribution.

  • Changing distributions means learning the quirks of a new distribution (Fedora may or may not be the greatest, but they've got experience with Fedora)

  • For every distribution there are champions here to promote it. Doesn't mean they're wrong, it just means that there is an almost infinite variety of advice out there.


____________

DrFoo
Send message
Joined: 17 Jul 99
Posts: 26
Credit: 25,437,947
RAC: 27,539
United States
Message 923094 - Posted: 2 Aug 2009, 2:50:32 UTC

Yes, CentOS is rock solid. But that's partly because it's intentionally slow to upgrade. That makes it somewhat inappropriate here. As Matt pointed out in this very thread they like to live close the edge of what's available (at least with MySQL). This has actually been one of few issues I've had with CentOS/RHEL. PHP and MySQL are always so out of date. Of course there are ways around that when needed, but then you risk giving up the stability anyway.

And just for the record, CentOS and Fedora actually are RedHat for all intents and purposes. Fedora is the flavor on the bleeding edge, though, so it seems a very reasonable choice to me.
____________

Profile Andy Lee Robinson
Avatar
Send message
Joined: 8 Dec 05
Posts: 615
Credit: 42,642,670
RAC: 26,360
Hungary
Message 924353 - Posted: 7 Aug 2009, 16:03:56 UTC - in response to Message 922244.

Matt, I had some issues with migrating from 5.0.77 to the 5.1 with fc11 with a 4Gb database.
My solution was to export just the 'mysql' db separately,
import into 5.1
run mysql_upgrade -p
and then import another dump without mysql.

This is because of new fields in the grant tables, and we made heavy use of stored procedures, views and triggers.

Message boards : Technical News : MySQL Weirdness (Jul 29 2009)

Copyright © 2014 University of California