List:Replication« Previous MessageNext Message »
From:Jamen McGranahan Date:July 14 2013 9:54pm
Subject:RE: 2 slaves - one Master; continues to fail
View as plain text  
Suresh,

Thank you for your quick response.


1)      This is happening on multiple tables - only one at a time, though. I get one fixed
(or at least I try) and then another table errors out. And it seems to be the same tables
in both slaves.

2)      I thought the "read-only" might have been the issue because I was able to get one
slave to run for about 30 minutes before erroring out.

Something else I have tried - I am using separate accounts for both slaves. Initially both
were using the same slave account, but I was afraid this was part of the problem so
created a separate account for the second slave. What else can I try (or what can I
provide to help troubleshoot this)?

Jamen McGranahan
Systems Services Librarian
Vanderbilt University Library

From: Suresh Kuna [mailto:sureshkumarilu@stripped]
Sent: Sunday, July 14, 2013 2:18 PM
To: McGranahan, Jamen
Cc: replication@stripped
Subject: Re: 2 slaves - one Master; continues to fail

Hi Jemen,
It could happen for several reasons, try to narrow down the number of problems occurring
here.
1) Is it only one table in duplicate keys question ? ( could be a replication problem,
starting from correcting position from master will eliminate it )
2) Does the slave's getting direct hits from application ? ( check grants and make slave's
read only )
Let me know if this helps, if not we will dig further.


On Sun, Jul 14, 2013 at 2:25 PM, McGranahan, Jamen
<jamen.mcgranahan@stripped<mailto:jamen.mcgranahan@stripped>>
wrote:
Master MySQL = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64) using  EditLine
wrapper
Slave #1 = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64) using  EditLine
wrapper
Slave #2 = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64) using  EditLine
wrapper

For days now, I have been trying to resolve why my slaves keep failing. I have tried any
number of suggestions found via Google, including doing a full dump & reload into my
slave. However, both slaves keep coming up with some kind of duplication error. What I
have been doing to try to "fix" this is to remove that record in the slave; restart the
slave; and then within a few minutes, I get another duplication error - and it's been 3-4
databases causing this issue (all seem to be log or cache tables). I'm truly at a loss and
am quite frustrated. Here's my my.cnf on my SLAVES (Slave #1 has a server-id: 2; Slave #2
= 3) - the reason why I am including it here below is because I believe it is something
with this that is causing it, but I don't know what and I'm really tired of shooting in
the dark - so figure someone on here might be able to point out the problem:

[client]
port            = 3306
socket          = /tmp/mysql.sock

[mysqld]
port            = 3306
socket          = /tmp/mysql.sock
skip-external-locking
key_buffer_size = 256M
max_allowed_packet = 64M
table_open_cache = 256
sort_buffer_size = 1M
net_buffer_length = 8K
read_buffer_size = 1M
read_rnd_buffer_size = 4M
myisam_sort_buffer_size = 64M
lower_case_table_names=1
thread_cache_size = 8
query_cache_size = 16M

max_connections = 225
thread_concurrency = 8

delay_key_write=ALL
bulk_insert_buffer_size=256M

log-bin=mysql-bin

binlog_format=mixed

server-id       = 3

[mysqldump]
quick
max_allowed_packet = 16M

[mysql]
no-auto-rehash

[myisamchk]
key_buffer_size = 128M
sort_buffer_size = 128M
read_buffer = 2M
write_buffer = 2M

[mysqlhotcopy]
interactive-timeout

The errors I'm getting are this:
Last_SQL_Error: Error 'Duplicate entry '1:c61e404586ba64fb97286ffe7f98c7b4' for key
'PRIMARY'' on query. Default database: 'tennshare'. Query: 'INSERT INTO cache_filter
(cid, data, created, expire, headers, serialized) VALUES
('1:c61e404586ba64fb97286ffe7f98c7b4', '<p>Hi, my name is Joan Lange and I am the
librarian at Pope John Paul II High School in Hendersonville, TN.</p>\n<p>How
do I access the In the Cloud presentation? It looks interesting.</p>\n', 1373824783,
1373911183, '', 0)';

Another error in the server.err file:
130714 12:20:58 [Warning] Slave: Duplicate entry
'http://staffweb.library.vanderbilt.edu/recipes' for key 'PRIMARY' Error_code: 1062
130714 12:20:58 [ERROR] Error running query, slave SQL thread aborted. Fix the problem,
and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.000468'
position 314378650

Jamen McGranahan
Systems Services Librarian
Vanderbilt University LIbrary
Central Library
Room 811
419 21st Avenue South
Nashville, TN 37214



--
Thanks
Suresh Kuna
MySQL & MongoDB DBA

Thread
2 slaves - one Master; continues to failJamen McGranahan14 Jul
  • Re: 2 slaves - one Master; continues to failSuresh Kuna14 Jul
    • RE: 2 slaves - one Master; continues to failJamen McGranahan14 Jul
      • Re: 2 slaves - one Master; continues to failSuresh Kuna14 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
    • RE: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
    • Re: 2 slaves - one Master; continues to failTruls Bergskaug15 Jul
  • Re: 2 slaves - one Master; continues to failJesper Wisborg Krogh15 Jul
    • Re: 2 slaves - one Master; continues to failDivesh Kamra16 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
    • Re: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
      • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
        • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
          • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
            • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
              • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman17 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman18 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
    • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
      • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
        • Re: 2 slaves - one Master; continues to failSuresh Kuna18 Jul
          • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
        • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
          • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
            • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
              • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
              • RE: 2 slaves - one Master; continues to failJamen McGranahan22 Jul
                • Re: 2 slaves - one Master; continues to failSuresh Kuna22 Jul