List:General Discussion« Previous MessageNext Message »
From:Geoffrey Date:February 7 2004 8:11pm
Subject:Re: Memory Leak using InnoDB ?
View as plain text  
Dan, Heikki,

----- Original Message ----- 
From: "Heikki Tuuri" <Heikki.Tuuri@stripped>
To: <mysql@stripped>
Sent: Saturday, February 07, 2004 11:39 AM
Subject: Re: Memory Leak using InnoDB ?


> Geoffrey, Dan,
>
> ----- Original Message ----- 
> From: "Dan Nelson" <dnelson@stripped>
> Newsgroups: mailing.database.myodbc
> Sent: Saturday, February 07, 2004 5:27 AM
> Subject: Re: Memory Leak using InnoDB ?
>
>
> > In the last episode (Feb 07), Geoffrey said:
> > > I'm running MySQL 4.0.17 with RH Linux 8 on Xeon 3.0/1GB RAM.
> > >
> > > One application has to access the database (1 connection to the DB is
> > > open on startup and left open). However this application performs a
> > > lot of queries on the DB.
> > >
> > > Thanks to  "top", I can see that the "used memory" is constantly
> > > increasing and never freed (up to 1 GB) when performing a lot of
> > > queries. In fact, I can see the total memory usage increasing but the
> > > mysqld process memory usage remains the same.
> > >
> > > When the DB is not accessed, the memory usage is stable. Stopping
MySQL
> > > server doesn't free the abnormaly allocated memory.
> >
> > Ideally, you should have very little "free" memory according to top
> > (most systems will see under 20MB free).  Free memory is wasted memory.
> > Unix uses memory not allocated to processes for a disk cache.  To
> > determine whether you are truly low on memory, run iostat and watch the
> > swap columns.  Constant swap activity means you're low on memory.
>
> Dan is right. A memory leak in the mysqld process should show up in the
> 'top' line for that process.
>
> By the way, monitoring if InnoDB has memory leaks is very easy. Just look
> with SHOW INNODB STATUS at the 'total allocated memory'. If that keeps
> climbing without bounds, that is an indication of a memory leak.
>

Thanks for your help.

For testing, I tried the following my.cnf :

server-id=1
socket=/tmp/mysql.sock
innodb_data_file_path = ibdata1:750M:autoextend
set-variable = innodb_buffer_pool_size=50M
set-variable = innodb_additional_mem_pool_size=10M
set-variable = innodb_log_file_size=300M
set-variable = innodb_log_buffer_size=2M
innodb_flush_log_at_trx_commit=0
skip-locking
set-variable = max_connections=5
set-variable = read_buffer_size=1M
set-variable = sort_buffer=1M
set-variable = key_buffer=10M

Here is the result of "top" after 20 hours :

 8:26pm  up 18:35,  1 user,  load average: 0.42, 0.26, 0.20
46 processes: 44 sleeping, 2 running, 0 zombie, 0 stopped
CPU states:  3.7% user,  0.5% system,  0.0% nice, 95.6% idle
Mem:  1031048K av, 1021460K used,    9588K free,       0K shrd,   55288K
buff
Swap: 2044072K av,       0K used, 2044072K free                  845544K
cached
PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME COMMAND
960 mysql     15   0 67872  66M  2656 S     0.1  6.5   6:29 mysqld

Here is the result of "top" after a reboot :

 8:54pm  up 9 min,  1 user,  load average: 0.16, 0.17, 0.10
46 processes: 44 sleeping, 2 running, 0 zombie, 0 stopped
CPU states:  4.5% user,  0.3% system,  0.0% nice, 95.0% idle
Mem:  1031048K av,  136512K used,  894536K free,       0K shrd,   13276K
buff
Swap: 2044072K av,       0K used, 2044072K free                   61620K
cached
PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME COMMAND
774 mysql     15   0 36276  35M  2496 S     0.7  3.5   0:03 mysqld

Here is the SHOW INNODB STATUS after 20 hours :

----------------------
BUFFER POOL AND MEMORY
----------------------
Total memory allocated 75115912; in additional pool allocated 1611008
Buffer pool size   3200
Free buffers       1
Database pages     3091
Modified db pages  160
Pending reads 0
Pending writes: LRU 0, flush list 0, single page 0
Pages read 7212, created 2274, written 801221
0.00 reads/s, 0.02 creates/s, 12.45 writes/s
Buffer pool hit rate 1000 / 1000

As far as I understand, the "Total Mem" increasing constantly when MySQL is
heavily accessed is not really memory allocated by MySQL but allocated by
Linux to take advantage of the unused memory ?

So I should not pay attention to it (as long as used swap is 0).

Correct ?

Regards.

Thread
Memory Leak using InnoDB ?Geoffrey7 Feb
  • Re: Memory Leak using InnoDB ?Dan Nelson7 Feb
  • Re: Memory Leak using InnoDB ?Greg Day7 Feb
Re: Memory Leak using InnoDB ?Heikki Tuuri7 Feb
Re: Memory Leak using InnoDB ?Geoffrey7 Feb
Re: Memory Leak using InnoDB ?Heikki Tuuri7 Feb