MySQL Weirdness (Jul 29 2009)

Message boards : Technical News : MySQL Weirdness (Jul 29 2009)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 922244 - Posted: 29 Jul 2009, 22:32:28 UTC

So.. getting mork on line as a test replica server still continues to be one headache after another. We finally got the hardware working, finally got the drive configuration set up, finally got the OS installed, finally got MySQL fired up, and we were populating the databases using Tuesday's dump files.

Then we hit a completely mysterious error and consistently at the same point in the dump file. Long story short, I spent pretty much all day today trying to find the cause of this error. At this point we're about 90% convinced it's an actual bug in the MySQL version that comes standard with Fedora Core 11 (version 5.1.35) where it fails reading mysqldumps containing large text fields. This seems like a major problem, no? Anyway, the same mysqldump worked on a test 5.0.x database engine. So I'm looking to upgrade this version beyond what's in the current Fedora repositories. What a pain!!!

I just turned on the "show results" flag, even though our current replica is still far behind reality.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 922244 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 922265 - Posted: 29 Jul 2009, 23:12:11 UTC - in response to Message 922244.  

Replying to myself... it seems like a mysql upgrade isn't actually possible yet (we're already very close to what's publically available). However, I think I just scripted up a workaround that so far is working and reading the mysql dump file into mork. Gotta love perl.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 922265 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 922305 - Posted: 30 Jul 2009, 0:51:26 UTC

Have you thought about trying a different Linux distro ? Throughout your posts in the Tech News forum there is a list of problems you've had with installation, bugs etc. over the past few years. I've experimented with many different Linux distro's over the years and even at the desktop level I've found Fedora less "user friendly" and quirkier than others.
ID: 922305 · Report as offensive
Profile Edywison
Avatar

Send message
Joined: 31 May 09
Posts: 13
Credit: 20,563
RAC: 0
Indonesia
Message 922375 - Posted: 30 Jul 2009, 8:49:10 UTC - in response to Message 922244.  

That's why I have decided to leave computer related field, I HAVE ENOUGH.
No more errors, no more bugs.
They drive me crazy.
They give me headache.

NO MORE PROGRAMMING, NO MORE DATABASE IN MY LIFE.
I QUITTTTTTTTTTTT
ID: 922375 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1639
Credit: 12,921,799
RAC: 89
New Zealand
Message 922377 - Posted: 30 Jul 2009, 9:12:54 UTC

Thanks for news updates Matt I love reading them. How's the data bank holding up? Out of complete curiosity do any of the team crunch data for the main project while they are doing their work on a daily basis?

ID: 922377 · Report as offensive
Profile S@NL - Eesger - www.knoop.nl
Avatar

Send message
Joined: 7 Oct 01
Posts: 385
Credit: 50,200,038
RAC: 0
Netherlands
Message 922378 - Posted: 30 Jul 2009, 9:19:50 UTC - in response to Message 922265.  
Last modified: 30 Jul 2009, 9:20:42 UTC

Perl :D (I am a "small" Perl fan myself ;)

I (and our team) have trouble with large SQL tables also, our (project)server uses MySql version 4.1.22 (community-nt).. we are planing to switch to Linux (and a newer MySql version)..
Which version would you recommend? (5.0.x?)
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS
ID: 922378 · Report as offensive
Bad Spartan
Volunteer tester
Avatar

Send message
Joined: 14 Mar 03
Posts: 6
Credit: 47,663,261
RAC: 117
Puerto Rico
Message 922457 - Posted: 30 Jul 2009, 16:06:22 UTC

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.
ID: 922457 · Report as offensive
Profile chrisp jr

Send message
Joined: 29 Dec 02
Posts: 2
Credit: 1,508,702
RAC: 0
United Kingdom
Message 922485 - Posted: 30 Jul 2009, 18:50:21 UTC - in response to Message 922457.  

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.


I was going to suggest the same, we run 2 CentOS 5 boxes at work for email virus and spam-filtering which process between 6000-7000 items an hour. They are rock solid in my opinion.
ID: 922485 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 922494 - Posted: 30 Jul 2009, 19:25:16 UTC - in response to Message 922485.  

Hi Matt,

Have you ever considered using other flavor of Linux OS? I have been using CENTOS for a while an have proven quite stable in different roles even as a LAMP server. It's based on Redhat Enterprise code. Good luck.


I was going to suggest the same, we run 2 CentOS 5 boxes at work for email virus and spam-filtering which process between 6000-7000 items an hour. They are rock solid in my opinion.

Things to remember:

  • SETI@Home is trying to run just one distribution, so switching to CENTOS or Red Hat or Ubuntu means eventually switching every server to a new distribution.

  • Changing distributions means learning the quirks of a new distribution (Fedora may or may not be the greatest, but they've got experience with Fedora)

  • For every distribution there are champions here to promote it. Doesn't mean they're wrong, it just means that there is an almost infinite variety of advice out there.


ID: 922494 · Report as offensive
DrFoo

Send message
Joined: 17 Jul 99
Posts: 26
Credit: 28,975,189
RAC: 0
United States
Message 923094 - Posted: 2 Aug 2009, 2:50:32 UTC

Yes, CentOS is rock solid. But that's partly because it's intentionally slow to upgrade. That makes it somewhat inappropriate here. As Matt pointed out in this very thread they like to live close the edge of what's available (at least with MySQL). This has actually been one of few issues I've had with CentOS/RHEL. PHP and MySQL are always so out of date. Of course there are ways around that when needed, but then you risk giving up the stability anyway.

And just for the record, CentOS and Fedora actually are RedHat for all intents and purposes. Fedora is the flavor on the bleeding edge, though, so it seems a very reasonable choice to me.
ID: 923094 · Report as offensive
Profile Andy Lee Robinson
Avatar

Send message
Joined: 8 Dec 05
Posts: 630
Credit: 59,973,836
RAC: 0
Hungary
Message 924353 - Posted: 7 Aug 2009, 16:03:56 UTC - in response to Message 922244.  

Matt, I had some issues with migrating from 5.0.77 to the 5.1 with fc11 with a 4Gb database.
My solution was to export just the 'mysql' db separately,
import into 5.1
run mysql_upgrade -p
and then import another dump without mysql.

This is because of new fields in the grant tables, and we made heavy use of stored procedures, views and triggers.
ID: 924353 · Report as offensive

Message boards : Technical News : MySQL Weirdness (Jul 29 2009)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.