I just tried to migrate a database with a few hundred thousand records
across 50 tables. And I'm having similar problems. My server is
running FreeBSD 5.3-STABLE with the FreeBSD port install of MySQL
4.1.7
While filling the tables with, the mysqldump output of a lot of INSERT
statements, the mysql client would regularly claim to loose its
connection to the server. However, oddly, LOAD DATA INFILE worked.
Then trying to use it in production for about 30 minutes, where the
current MySQL server is handling ~200 requests/sec at the moment, ndbd
nodes would regularly crash (but interestingly, the two nodes would
tend to crash at different times) - within 5-10 minutes of starting
up. And frequently they would crash during startup as well.
Interestingly, this only seems to occur due to a rapid stream of
queries. When just testing the DB after loading the data, it works ok.
Based on martin's post, I'm guessing it must be related to how insert
type requests are handled. Maybe somethings aren't being cleaned up
fast enough?
NODE "20" (1 of 2 ndbd nodes) error log
Date/Time: Tuesday 23 November 2004 - 14:48:59
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtcMain.cpp
Object of reference: DBTC (Line: 8542) 0x00000002
ProgramName: NDB Kernel
ProcessID: 9277
TraceFile: /var/db/mysql-cluster//ndb_20_trace.log.1
***EOM***
Date/Time: Wednesday 24 November 2004 - 16:58:30
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 13352
TraceFile: /var/db/mysql-cluster//ndb_20_trace.log.2
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:01:23
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 76829
TraceFile: /var/db/mysql-cluster//ndb_20_trace.log.3
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:11:04
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 77210
TraceFile: /var/db/mysql-cluster//ndb_20_trace.log.4
***EOM***
--------------------------------------------------------------------------------------------------------
NODE "21" (2 of 2) error log:
Date/Time: Wednesday 24 November 2004 - 16:58:25
Type of error: error
Message: Node failed during system restart
Fault ID: 2308
Problem data: Unhandled node failure during restart
Object of reference: NDBCNTR (Line: 1389) 0x00000002
ProgramName: NDB Kernel
ProcessID: 1144
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.1
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:00:43
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 7029
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.2
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:01:18
Type of error: error
Message: Node failed during system restart
Fault ID: 2308
Problem data: Unhandled node failure during restart
Object of reference: NDBCNTR (Line: 1389) 0x00000002
ProgramName: NDB Kernel
ProcessID: 7643
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.3
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:06:09
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 7688
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.4
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:07:09
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 8138
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.5
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:10:59
Type of error: error
Message: Node failed during system restart
Fault ID: 2308
Problem data: Unhandled node failure during restart
Object of reference: NDBCNTR (Line: 1389) 0x00000002
ProgramName: NDB Kernel
ProcessID: 8199
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.6
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:13:16
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 8456
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.7
***EOM***
Date/Time: Wednesday 24 November 2004 - 17:18:53
Type of error: error
Message: Pointer too large
Fault ID: 2306
Problem data: DbtupIndex.cpp
Object of reference: DBTUP (Line: 136) 0x00000002
ProgramName: NDB Kernel
ProcessID: 8780
TraceFile: /var/db/mysql-cluster//ndb_21_trace.log.8
***EOM***
Would the trace logs help?
