List:General Discussion« Previous MessageNext Message »
From:Jeff Smelser Date:October 2 2012 10:07pm
Subject:BINLOG data
View as plain text  
I am having an issue with mysql 5.1.52 and using mysqlbinlog. Essentially I
am running the command piped into mysql and all is working well until I am
getting to a huge BINLOG command and I get:

121002 16:09:03 [ERROR] /usr/libexec/mysqld: Out of memory (Needed
3759556332 bytes)

Small versions process just fine.

BINLOG '
BqtgUBNBBgAAYgAAANeP7QAAAEMsAAAAAAEABHRlbXAAD3l0X3N5bnRocHViX2F1ZwARAw8PDw8P
D/YDAwP29vb2Dw8algAeAB4AlgCWAB4AAwMcCBwIHAgcCP0C/QIAAAA=
BqtgUBdBBgAACAQAAN+T7QAAAEMsAAAAAAAAEf///wAA/gEAAAAACDIwMTIwODAxAAAAAIPnDAMA
AMIBAADcRgAAgAAAAAAAAAAABcOpiIAAAAAAAAAAAAAAAACAAAAAAAAAAAIDw9JIgAAAAAAAAAAA
AuVLGAAAAAAAAP4CAAAAAAgyMDEyMDgwMgAAAACD5yFJAACKBwAA0TQBAIAAAAAAAAAABgR7rXiA
AAAAAAAAAAAAAAAAgAAAAAAAAAAsBIW7sIAAAAAAAAAABgWvc7QAAAAAAAD+AwAAAAAIMjAxMjA4
MDMAAAAAg+dZWgAAKwgAALh5AQCAAAAAAAAAABYE6fowgAAAAAAAAAAAACYloIAAAAAAAAAAUQE8
NyyAAAAAAAAAAA4ASHFQAAAAAAAA/gQAAAAACDIwMTIwODA0AAAAAIPnBVwAANoHAAA2cQEAgAAA
AAAAAAAWBBGi/IAAAAAAAAAAAABhqACAAAAAAAAAAD0CKo5ogAAAAAAAAAALAh073AAAAAAAAP4F
AAAAAAgyMDEyMDgwNQAAAACD5zNoAADTCAAAz3cBAIAAAAAAAAAAGgGO8niAAAAAAAAAAAAAUmXA
gAAAAAAAAABCAIfs4IAAAAAAAAAADALT31QAAAAAAAD+BgAAAAAIMjAxMjA4MDYAAAAAg+csfgAA
7AsAAPuNAQCAAAAAAAAAAD0DFom8gAAAAAAAAAAABRKF4IAAAAAAAAAAWwKqkRyAAAAAAAAAABQE
j0JcAAAAAAAA/gcAAAAACDIwMTIwODA3AAAAAIPnLYAAAOkJAADpfgEAgAAAAAAAAABIAWA/yIAA
AAAAAAAAAgHCImCAAAAAAAAAAFgAOBgogAAAAAAAAAAVBaL2DAAAAAAAAP4IAAAAAAgyMDEyMDgw
OAAAAACD50R+AACGCQAA3HwBAIAAAAAAAAAATwNswyyAAAAAAAAAAAEBuPqggAAAAAAAAACBAAcP
0IAAAAAAAAAAHAHZhkQAAAAAAAD+CQAAAAAIMjAxMjA4MDkAAAAAg+ebiQAAYAkAAJODAQCAAAAA
AAAAADEDNHtcgAAAAAAAAAABBBOzgIAAAAAAAAAAfQQHr7iAAAAAAAAAABcFQDbAAAAAAAAA/goA
AAAACDIwMTIwODEwAAAAAIPnWJcAAMAJAABNmgEAgAAAAAAAAABGA/Z9xIAAAAAAAAAAAQThseCA
AAAAAAAAAJQBPIEAgAAAAAAAAAAdBEfO9AAAAAAAAP4LAAAAAAgyMDEyMDgxMQAAAACD5wyRAAAI


And the above goes on for pages and pages..  I dont have some memory high
enough, just trying to sort out which one.

[mysqld]
innodb_file_per_table
datadir=/data/mysql/databases
socket=/var/lib/mysql/mysql.sock
user=mysql
port = 3306
tmpdir                          = /data/mysql/temp
# skip-external-locking           = 1
# skip-name-resolve
open-files-limit                = 20000
socket = /var/lib/mysql/mysql.sock
collation_server=utf8_general_ci
character_set_server=utf8
event-scheduler = OFF
expire_logs_days = 7
#max_binlog_size = 500M
back_log = 500
max_connections = 100
max_connect_errors = 10000
table_open_cache = 2048
table-definition-cache = 1024
max_allowed_packet = 16M
binlog_cache_size = 10M
max_heap_table_size = 2G
sort_buffer_size = 256M
join_buffer_size = 256M
thread_cache_size = 16
thread_concurrency = 8
query_cache_size = 128M
query_cache_limit = 8M
ft_min_word_len = 4
default-storage-engine = InnoDB
thread_stack = 768K
transaction_isolation = REPEATABLE-READ
tmp_table_size = 2G
log-bin=mysql-bin
binlog_format=mixed
slow_query_log
long_query_time = 2
interactive-timeout = 2400
wait-timeout = 2400
ssl-ca          = /var/lib/mysql/certs/ca-cert.pem
ssl-cert        = /var/lib/mysql/certs/server-cert.pem
ssl-key         = /var/lib/mysql/certs/server-key.pem

# ***  Replication related settings
server-id = 3
skip-slave-start
## read-only

#*** MyISAM Specific options
key_buffer_size = 1024M
read_buffer_size = 8M
read_rnd_buffer_size = 16M
bulk_insert_buffer_size = 64M
myisam_sort_buffer_size = 1024M
myisam_max_sort_file_size = 20G
myisam_repair_threads = 1
myisam_recover

# *** INNODB Specific options ***
default-storage-engine  = InnoDB
innodb = FORCE
ignore-builtin-innodb
plugin-load=ha_innodb_plugin.so
innodb_additional_mem_pool_size = 16M
innodb_buffer_pool_size = 130G
innodb_data_file_path = ibdata1:10M:autoextend
innodb_file_io_threads = 4
innodb_thread_concurrency = 16
innodb_flush_log_at_trx_commit = 1
innodb_log_buffer_size = 8M
innodb_log_file_size = 256M
innodb_log_files_in_group = 3
innodb_max_dirty_pages_pct = 90
innodb_lock_wait_timeout = 120
innodb-open-files = 300

[mysqldump]
quick

max_allowed_packet = 16M

[mysql]
no-auto-rehash

[myisamchk]
key_buffer_size = 512M
sort_buffer_size = 512M
read_buffer = 8M
write_buffer = 8M

[mysqlhotcopy]
interactive-timeout

[mysqld_safe]

Thanks,
Jeff

Thread
BINLOG dataJeff Smelser2 Oct