List:Replication« Previous MessageNext Message »
From:Suresh Kuna Date:July 14 2013 10:09pm
Subject:Re: 2 slaves - one Master; continues to fail
View as plain text  
Hi Jamen,

If you can confirm that you have started with right positions from master
backup and no writes to slave's then if we still get error's then check the
records insertion timestamp if those tables have timestamp field on update.


On Sun, Jul 14, 2013 at 5:54 PM, McGranahan, Jamen <
jamen.mcgranahan@stripped> wrote:

>  Suresh,****
>
> ** **
>
> Thank you for your quick response.****
>
> ** **
>
> **1)      **This is happening on multiple tables – only one at a time,
> though. I get one fixed (or at least I try) and then another table errors
> out. And it seems to be the same tables in both slaves.****
>
> **2)      **I thought the “read-only” might have been the issue because
> I
> was able to get one slave to run for about 30 minutes before erroring out.
> ****
>
> ** **
>
> Something else I have tried – I am using separate accounts for both
> slaves. Initially both were using the same slave account, but I was afraid
> this was part of the problem so created a separate account for the second
> slave. What else can I try (or what can I provide to help troubleshoot
> this)?****
>
> ** **
>
> *Jamen McGranahan*
>
> *Systems Services Librarian*
>
> *Vanderbilt University Library*
>
> ** **
>
> *From:* Suresh Kuna [mailto:sureshkumarilu@stripped]
> *Sent:* Sunday, July 14, 2013 2:18 PM
> *To:* McGranahan, Jamen
> *Cc:* replication@stripped
> *Subject:* Re: 2 slaves - one Master; continues to fail****
>
> ** **
>
> Hi Jemen,****
>
> It could happen for several reasons, try to narrow down the number of
> problems occurring here. ****
>
> 1) Is it only one table in duplicate keys question ? ( could be a
> replication problem, starting from correcting position from master will
> eliminate it )****
>
> 2) Does the slave's getting direct hits from application ? ( check grants
> and make slave's read only )****
>
> Let me know if this helps, if not we will dig further.****
>
> ** **
>
> ** **
>
> On Sun, Jul 14, 2013 at 2:25 PM, McGranahan, Jamen <
> jamen.mcgranahan@stripped> wrote:****
>
> Master MySQL = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64)
> using  EditLine wrapper
> Slave #1 = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64)
> using  EditLine wrapper
> Slave #2 = running mysql  Ver 14.14 Distrib 5.5.17, for Linux (x86_64)
> using  EditLine wrapper
>
> For days now, I have been trying to resolve why my slaves keep failing. I
> have tried any number of suggestions found via Google, including doing a
> full dump & reload into my slave. However, both slaves keep coming up with
> some kind of duplication error. What I have been doing to try to "fix" this
> is to remove that record in the slave; restart the slave; and then within a
> few minutes, I get another duplication error - and it's been 3-4 databases
> causing this issue (all seem to be log or cache tables). I'm truly at a
> loss and am quite frustrated. Here's my my.cnf on my SLAVES (Slave #1 has a
> server-id: 2; Slave #2 = 3) - the reason why I am including it here below
> is because I believe it is something with this that is causing it, but I
> don't know what and I'm really tired of shooting in the dark - so figure
> someone on here might be able to point out the problem:
>
> [client]
> port            = 3306
> socket          = /tmp/mysql.sock
>
> [mysqld]
> port            = 3306
> socket          = /tmp/mysql.sock
> skip-external-locking
> key_buffer_size = 256M
> max_allowed_packet = 64M
> table_open_cache = 256
> sort_buffer_size = 1M
> net_buffer_length = 8K
> read_buffer_size = 1M
> read_rnd_buffer_size = 4M
> myisam_sort_buffer_size = 64M
> lower_case_table_names=1
> thread_cache_size = 8
> query_cache_size = 16M
>
> max_connections = 225
> thread_concurrency = 8
>
> delay_key_write=ALL
> bulk_insert_buffer_size=256M
>
> log-bin=mysql-bin
>
> binlog_format=mixed
>
> server-id       = 3
>
> [mysqldump]
> quick
> max_allowed_packet = 16M
>
> [mysql]
> no-auto-rehash
>
> [myisamchk]
> key_buffer_size = 128M
> sort_buffer_size = 128M
> read_buffer = 2M
> write_buffer = 2M
>
> [mysqlhotcopy]
> interactive-timeout
>
> The errors I'm getting are this:
> Last_SQL_Error: Error 'Duplicate entry
> '1:c61e404586ba64fb97286ffe7f98c7b4' for key 'PRIMARY'' on query. Default
> database: 'tennshare'. Query: 'INSERT INTO cache_filter (cid, data,
> created, expire, headers, serialized) VALUES
> ('1:c61e404586ba64fb97286ffe7f98c7b4', '<p>Hi, my name is Joan Lange and I
> am the librarian at Pope John Paul II High School in Hendersonville,
> TN.</p>\n<p>How do I access the In the Cloud presentation? It looks
> interesting.</p>\n', 1373824783, 1373911183, '', 0)';
>
> Another error in the server.err file:
> 130714 12:20:58 [Warning] Slave: Duplicate entry '
> http://staffweb.library.vanderbilt.edu/recipes' for key 'PRIMARY'
> Error_code: 1062
> 130714 12:20:58 [ERROR] Error running query, slave SQL thread aborted. Fix
> the problem, and restart the slave SQL thread with "SLAVE START". We
> stopped at log 'mysql-bin.000468' position 314378650
>
> Jamen McGranahan
> Systems Services Librarian
> Vanderbilt University LIbrary
> Central Library
> Room 811
> 419 21st Avenue South
> Nashville, TN 37214****
>
>
>
>
> -- ****
>
> Thanks
> Suresh Kuna
> MySQL & MongoDB DBA****
>



-- 
Thanks
Suresh Kuna
MySQL & MongoDB DBA

Thread
2 slaves - one Master; continues to failJamen McGranahan14 Jul
  • Re: 2 slaves - one Master; continues to failSuresh Kuna14 Jul
    • RE: 2 slaves - one Master; continues to failJamen McGranahan14 Jul
      • Re: 2 slaves - one Master; continues to failSuresh Kuna14 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
    • RE: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
    • Re: 2 slaves - one Master; continues to failTruls Bergskaug15 Jul
  • Re: 2 slaves - one Master; continues to failJesper Wisborg Krogh15 Jul
    • Re: 2 slaves - one Master; continues to failDivesh Kamra16 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
    • Re: 2 slaves - one Master; continues to failJohan De Meersman15 Jul
      • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
        • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
          • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
            • RE: 2 slaves - one Master; continues to failJamen McGranahan15 Jul
              • Re: 2 slaves - one Master; continues to failSuresh Kuna15 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman17 Jul
Re: 2 slaves - one Master; continues to failJohan De Meersman18 Jul
  • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
    • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
      • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
        • Re: 2 slaves - one Master; continues to failSuresh Kuna18 Jul
          • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
        • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
          • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
            • Re: 2 slaves - one Master; continues to failMarcus Bointon18 Jul
              • RE: 2 slaves - one Master; continues to failJamen McGranahan18 Jul
              • RE: 2 slaves - one Master; continues to failJamen McGranahan22 Jul
                • Re: 2 slaves - one Master; continues to failSuresh Kuna22 Jul