List:General Discussion« Previous MessageNext Message »
From:Jason Linden Date:September 18 2003 6:19pm
Subject:RE: MySQL/Cron problem
View as plain text  
The same thing happens whether or not I use the PHP script or a standard
SQL script as described in my original post, so I don't think it is a
PHP problem.  Below is two snapshots, one @ 2:06 and the second @ 2:11,
if this is hard to read due to formatting let me know and I can send it
to you as an attachment.

Thanks!

[root@idsconsole root]# clock
Thu 18 Sep 2003 02:06:27 PM EDT  -0.247002 seconds
[root@idsconsole root]# ps -eo pid,ppid,rss,vsize,pcpu,pmem,cmd -ww
--sort=pid
  PID  PPID  RSS   VSZ %CPU %MEM CMD
    1     0  476  1376  0.1  0.1 init
    2     1    0     0  0.0  0.0 [keventd]
    3     1    0     0  0.0  0.0 [kapmd]
    4     1    0     0  0.0  0.0 [ksoftirqd_CPU0]
    5     1    0     0  0.0  0.0 [kswapd]
    6     1    0     0  0.0  0.0 [kscand/DMA]
    7     1    0     0  0.0  0.0 [kscand/Normal]
    8     1    0     0  0.0  0.0 [kscand/HighMem]
    9     1    0     0  0.0  0.0 [bdflush]
   10     1    0     0  0.0  0.0 [kupdated]
   11     1    0     0  0.0  0.0 [mdrecoveryd]
   15     1    0     0  0.0  0.0 [kjournald]
   73     1    0     0  0.0  0.0 [khubd]
 1036     1    0     0  0.0  0.0 [kjournald]
 1073     1    0     0  0.0  0.0 [kjournald]
 1542     1  956  1964  0.0  0.2 /sbin/dhclient -1 -q -lf
/var/lib/dhcp/dhclient-eth1.leases -pf /var/run/dhclient-eth1.pid -cf
/etc/dhclient-eth1.conf eth1
 1597     1  428  1368  0.0  0.1 klogd -x
 1667     1  488  1360  0.0  0.1 /usr/sbin/apmd -p 10 -w 5 -W -P
/etc/sysconfig/apm-scripts/apmscript
 1704     1 1496  3504  0.0  0.3 /usr/sbin/sshd
 1718     1  868  2024  0.0  0.2 xinetd -stayalive -reuse -pidfile
/var/run/xinetd.pid
 1732     1 2392  2396  0.0  0.6 [ntpd]
 1741     1  444  1412  0.0  0.1 gpm -t ps/2 -m /dev/mouse
 1753     1 5792 14316  0.0  1.5 /usr/sbin/httpd
 1762     1  572  1428  0.0  0.1 crond
 1770  1753 6356 14520  0.0  1.6 [httpd]
 1774     1 1928  7508  0.0  0.5 cupsd
 1809     1 1164  4184  0.0  0.3 /bin/sh /usr/bin/mysqld_safe
--datadir=/var/lib/mysql
--pid-file=/var/lib/mysql/idsconsole.abc.com.pid
 1835  1809 19840 31216  0.0  5.1 [mysqld]
 1855  1835 19840 31216  0.0  5.1 [mysqld]
 1856  1855 19840 31216  0.0  5.1 [mysqld]
 1857  1855 19840 31216  0.0  5.1 [mysqld]
 1858  1855 19840 31216  0.0  5.1 [mysqld]
 1859  1855 19840 31216  0.0  5.1 [mysqld]
 1861     1 3080  4524  0.0  0.8 [xfs]
 1879     1  528  1408  0.0  0.1 [atd]
 1889     1  524  3396  0.0  0.1 rhnsd --interval 240
 1896     1  588  3956  0.0  0.1 pure-ftpd (SERVER)
 1903  1855 19840 31216  0.0  5.1 [mysqld]
 1904  1855 19840 31216  0.0  5.1 [mysqld]
 1905  1855 19840 31216  0.0  5.1 [mysqld]
 1906  1855 19840 31216  0.0  5.1 [mysqld]
 1917     1  888  2208  0.0  0.2 syslogd -r -f /etc/syslog.conf
 1918  1855 19840 31216  0.0  5.1 [mysqld]
 1920     1  400  1352  0.0  0.1 /sbin/mingetty tty1
 1921     1  400  1352  0.0  0.1 /sbin/mingetty tty2
 1922     1  400  1352  0.0  0.1 /sbin/mingetty tty3
 1923     1  400  1352  0.0  0.1 /sbin/mingetty tty4
 1924     1  400  1352  0.0  0.1 /sbin/mingetty tty5
 1925     1  400  1352  0.0  0.1 /sbin/mingetty tty6
 1973  1753 6416 14548  0.0  1.6 [httpd]
 1976  1704 2392  6776  0.0  0.6 /usr/sbin/sshd
 1978  1976 1440  4364  0.0  0.3 -bash
 2065  1855 19840 31216  0.0  5.1 [mysqld]
 2066  1855 19840 31216  0.0  5.1 [mysqld]
 2067  1855 19840 31216  0.0  5.1 [mysqld]
 2166  1855 19840 31216  0.0  5.1 [mysqld]
 2330  1978  692  2636  0.0  0.1 ps -eo pid,ppid,rss,vsize,pcpu,pmem,cmd
-ww --sort=pid
[root@idsconsole root]# free
             total       used       free     shared    buffers
cached
Mem:        383268     134548     248720          0      28800
67556
-/+ buffers/cache:      38192     345076
Swap:       522104          0     522104


[root@idsconsole root]# clock
Thu 18 Sep 2003 02:11:43 PM EDT  -0.810180 seconds
[root@idsconsole root]# ps -eo pid,ppid,rss,vsize,pcpu,pmem,cmd -ww
--sort=pid
  PID  PPID  RSS   VSZ %CPU %MEM CMD
    1     0  476  1376  0.1  0.1 init
    2     1    0     0  0.0  0.0 [keventd]
    3     1    0     0  0.0  0.0 [kapmd]
    4     1    0     0  0.0  0.0 [ksoftirqd_CPU0]
    5     1    0     0  0.0  0.0 [kswapd]
    6     1    0     0  0.0  0.0 [kscand/DMA]
    7     1    0     0  0.0  0.0 [kscand/Normal]
    8     1    0     0  0.0  0.0 [kscand/HighMem]
    9     1    0     0  0.0  0.0 [bdflush]
   10     1    0     0  0.0  0.0 [kupdated]
   11     1    0     0  0.0  0.0 [mdrecoveryd]
   15     1    0     0  0.0  0.0 [kjournald]
   73     1    0     0  0.0  0.0 [khubd]
 1036     1    0     0  0.0  0.0 [kjournald]
 1073     1    0     0  0.0  0.0 [kjournald]
 1542     1  956  1964  0.0  0.2 /sbin/dhclient -1 -q -lf
/var/lib/dhcp/dhclient-eth1.leases -pf /var/run/dhclient-eth1.pid -cf
/etc/dhclient-eth1.conf eth1
 1597     1  428  1368  0.0  0.1 klogd -x
 1667     1  488  1360  0.0  0.1 /usr/sbin/apmd -p 10 -w 5 -W -P
/etc/sysconfig/apm-scripts/apmscript
 1704     1 1496  3504  0.0  0.3 /usr/sbin/sshd
 1718     1  868  2024  0.0  0.2 xinetd -stayalive -reuse -pidfile
/var/run/xinetd.pid
 1732     1 2392  2396  0.0  0.6 [ntpd]
 1741     1  444  1412  0.0  0.1 gpm -t ps/2 -m /dev/mouse
 1753     1 5792 14316  0.0  1.5 /usr/sbin/httpd
 1762     1  572  1428  0.0  0.1 crond
 1770  1753 6356 14520  0.0  1.6 [httpd]
 1774     1 1928  7508  0.0  0.5 cupsd
 1809     1 1164  4184  0.0  0.3 /bin/sh /usr/bin/mysqld_safe
--datadir=/var/lib/mysql
--pid-file=/var/lib/mysql/idsconsole.abc.com.pid
 1835  1809 19844 31216  0.0  5.1 [mysqld]
 1855  1835 19844 31216  0.0  5.1 [mysqld]
 1856  1855 19844 31216  0.0  5.1 [mysqld]
 1857  1855 19844 31216  0.0  5.1 [mysqld]
 1858  1855 19844 31216  0.0  5.1 [mysqld]
 1859  1855 19844 31216  0.0  5.1 [mysqld]
 1861     1 3080  4524  0.0  0.8 [xfs]
 1879     1  528  1408  0.0  0.1 [atd]
 1889     1  524  3396  0.0  0.1 rhnsd --interval 240
 1896     1  588  3956  0.0  0.1 pure-ftpd (SERVER)
 1903  1855 19844 31216  0.0  5.1 [mysqld]
 1904  1855 19844 31216  0.0  5.1 [mysqld]
 1905  1855 19844 31216  0.0  5.1 [mysqld]
 1906  1855 19844 31216  0.0  5.1 [mysqld]
 1917     1  888  2208  0.0  0.2 syslogd -r -f /etc/syslog.conf
 1918  1855 19844 31216  0.0  5.1 [mysqld]
 1920     1  400  1352  0.0  0.1 /sbin/mingetty tty1
 1921     1  400  1352  0.0  0.1 /sbin/mingetty tty2
 1922     1  400  1352  0.0  0.1 /sbin/mingetty tty3
 1923     1  400  1352  0.0  0.1 /sbin/mingetty tty4
 1924     1  400  1352  0.0  0.1 /sbin/mingetty tty5
 1925     1  400  1352  0.0  0.1 /sbin/mingetty tty6
 1973  1753 6416 14548  0.0  1.6 [httpd]
 1976  1704 2392  6776  0.0  0.6 /usr/sbin/sshd
 1978  1976 1440  4364  0.0  0.3 -bash
 2065  1855 19844 31216  0.0  5.1 [mysqld]
 2066  1855 19844 31216  0.0  5.1 [mysqld]
 2067  1855 19844 31216  0.0  5.1 [mysqld]
 2166  1855 19844 31216  0.0  5.1 [mysqld]
 2358  1978  692  2636  0.0  0.1 ps -eo pid,ppid,rss,vsize,pcpu,pmem,cmd
-ww --sort=pid
[root@idsconsole root]# free
             total       used       free     shared    buffers
cached
Mem:        383268     135904     247364          0      29888
67708
-/+ buffers/cache:      38308     344960
Swap:       522104          0     522104


-----Original Message-----
From: Dathan Vance Pattishall [mailto:dathan@stripped] 
Sent: Thursday, September 18, 2003 1:42 PM
To: 'Jason Linden'; mysql@stripped
Subject: RE: MySQL/Cron problem

What do you mean it doesn't release itself? Can you provide some free
examples of before and after then 5 min after that?

The indication from the content of the below message is that the PHP
version in use has a memory leak. 1st you need to make sure that the
memory is not being put into a cache pool.



- Dathan Vance Pattishall
  - Sr. Programmer and mySQL DBA for FriendFinder Inc.
  - http://friendfinder.com/go/p40688


-->-----Original Message-----
-->From: Jason Linden [mailto:jlinden@stripped]
-->Sent: Thursday, September 18, 2003 10:24 AM
-->To: mysql@stripped
-->Subject: RE: MySQL/Cron problem
-->
-->Somebody suggested that I create the cron job as a php scripts, so I
-->did:
-->
-->include("dbinfo.inc.php");
-->
-->$connect = MYSQL_CONNECT($hostname, $username, $password) OR
DIE("Unable
-->to connect to the database");
-->@mysql_select_db( "$dbName") or die( "Unable to select database");
-->$insert = "INSERT INTO sysklog2
-->(machine,facility,priority,logdate,logtime,message) SELECT machine,
-->facility, priority, cast(left(date1,8) as date) as logdate,
-->cast(right(date1,6) as time) as logtime, message FROM sysklog;";
-->$query = mysql_query($insert);
-->$delete = "DELETE from sysklog;";
-->$query = mysql_query($delete);
-->mysql_close($connect);
-->
-->I am still having the same issue, when the above script runs every
-->minute memory usage increases by 200-500k and doesn't release itself.
-->
-->Any ideas/suggestions?
-->
-->Thanks!
-->
-->-----Original Message-----
-->From: Jason Linden [mailto:jlinden@stripped]
-->Sent: Wednesday, September 17, 2003 2:32 PM
-->To: Tbird67ForSale@stripped; mysql@stripped
-->Subject: RE: MySQL/Cron problem
-->
-->Tried it... didn't do anything.  Also, there are 11 different
instances
-->of mysql running.  Any ideas why?  Or is that just how it works?
-->
-->-----Original Message-----
-->From: Tbird67ForSale@stripped [mailto:Tbird67ForSale@stripped]
-->Sent: Wednesday, September 17, 2003 9:37 AM
-->To: jlinden@stripped; mysql@stripped
-->Subject: Re: MySQL/Cron problem
-->
-->Hmmm, have you tried putting is a folling mysqladmin flush-threads
-->command?
-->
-->-----Original Message-----
-->From: Jason Linden [mailto:jlinden@stripped]
-->Sent: Wednesday, September 17, 2003 8:57 AM
-->To: mysql@stripped
-->Subject: MySQL/Cron problem
-->
-->I am fairly new to both linux and mysql. I have a cron job that runs
-->every minute to move data from one mysql table to another (both
tables
-->are in the same database), see below:
-->
-->Cron job is:
-->
-->mysql -u *** --password=*** syslog < /var/scripts/updsysklog2
-->
-->Script is:
-->
-->INSERT INTO sysklog2
(machine,facility,priority,logdate,logtime,message)
-->SELECT machine, facility, priority, cast(left(date1,8) as date) as
-->logdate, cast(right(date1,6) as time) as logtime, message FROM
sysklog;
-->DELETE FROM sysklog;
-->
-->The problem I am having is every time this runs it adds ~250k to
memory
-->and doesn't release it then server locks up every 5 or 6 days.
-->
-->Any ideas on how to fix this?
-->
-->Thanks!
-->
-->
-->--
-->MySQL General Mailing List
-->For list archives: http://lists.mysql.com/mysql
-->To unsubscribe:
http://lists.mysql.com/mysql?unsub=1
-->
-->
-->--
-->MySQL General Mailing List
-->For list archives: http://lists.mysql.com/mysql
-->To unsubscribe:
-->http://lists.mysql.com/mysql?unsub=1



Thread
MySQL/Cron problemJason Linden17 Sep
Re: MySQL/Cron problemTbird67ForSale17 Sep
  • RE: MySQL/Cron problemJason Linden17 Sep
    • RE: MySQL/Cron problemDathan Vance Pattishall17 Sep
    • RE: MySQL/Cron problemJason Linden18 Sep
      • RE: MySQL/Cron problemDathan Vance Pattishall18 Sep
        • RE: MySQL/Cron problemJason Linden18 Sep