From: Johan Andersson Date: August 23 2012 3:27pm Subject: Re: [Fwd: DIP NDB CLUSTER ISSUES] List-Archive: http://lists.mysql.com/cluster/8387 Message-Id: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=e89a8f22beb9447ad604c7f07ff8 --e89a8f22beb9447ad604c7f07ff8 Content-Type: text/plain; charset=ISO-8859-1 Hi Umapathi, could you also send a sample data set on this query and we can see what i find. You can email it directly to me. That would be great. Best regards, Johan Severalnines AB On Thu, Aug 23, 2012 at 3:10 PM, umapathi b wrote: > Hi All, > > When I ran the query ( in the attached file ) , the cluster is completely > shutting down. > It won't take any time in non-ndb ( innodb,myisam ) instead. > I am also getting the same error in 7.2.7 . > Here is the error log .. > > 2012-08-23 05:21:57 [ndbd] INFO -- Message to big in sendSignal > 2012-08-23 05:21:57 [ndbd] INFO -- > 2012-08-23 05:21:57 [ndbd] INFO -- Error handler shutting down system > 2012-08-23 05:21:57 [ndbd] INFO -- Error handler shutdown completed - > exiting > 2012-08-23 05:22:05 [ndbd] ALERT -- Node 3: Forced node shutdown > completed. Caused by error 2341: 'Internal program error (failed > ndbrequire)(Internal error, programming error or missing error message, > please report a bug). Temporary error, restart node'. > > Help in this regard is highly appreciated. > > Thanks, > Umapathi. > > > > ---------- Forwarded message ---------- > From: > Date: Thu, Aug 23, 2012 at 6:34 PM > Subject: [Fwd: DIP NDB CLUSTER ISSUES] > To: umapathi.b@stripped > > > ---------------------------- Original Message ---------------------------- > Subject: DIP NDB CLUSTER ISSUES > From: umapathi@stripped > Date: Thu, June 21, 2012 7:44 pm > To: venu@stripped > Cc: dev@stripped > qa@stripped > dba@stripped > support-it@stripped > -------------------------------------------------------------------------- > > Sir, > > Today after smoothly running for some time the DIP cluster database > suddenly went down due to the following query . At that time there was no > cpu load or memory issues on the servers. > > It is basically a memory issue and it is reported as a bug in the manuals. > > > mgmd ( Management Node ) > --------------------------- > > 2012-06-21 03:08:16 [MgmtSrvr] ALERT -- Node 1: Node 2 Disconnected > 2012-06-21 03:08:16 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected > 2012-06-21 03:08:20 [MgmtSrvr] ALERT -- Node 2: Forced node shutdown > completed. Caused by error 2341: 'Internal program error (failed > ndbrequire)(Internal error, programming error or missing error message, > please report a bug). Temporary error, restart node'. > 2012-06-21 03:08:20 [MgmtSrvr] INFO -- Mgmt server state: nodeid 2 > freed, m_reserved_nodes 1, 3, 5 and 6. > 2012-06-21 03:08:21 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown > completed. Caused by error 2341: 'Internal program error (failed > ndbrequire)(Internal error, programming error or missing error message, > please report a bug). Temporary error, restart node'. > 2012-06-21 03:08:21 [MgmtSrvr] INFO -- Mgmt server state: nodeid 3 > freed, m_reserved_nodes 1, 5 and 6. > > > ndbd ( node 1) > --------------- > > 2012-06-21 03:08:10 [ndbd] INFO -- > > /pb2/build/sb_0-5227860-1331723713.63/mysql-cluster-gpl-7.2.5/storage/ndb/src/kernel/blocks/dbspj/DbspjMain.cpp > 2012-06-21 03:08:10 [ndbd] INFO -- DBSPJ (Line: 888) 0x00000006 > 2012-06-21 03:08:10 [ndbd] INFO -- Error handler shutting down system > 2012-06-21 03:08:10 [ndbd] INFO -- Error handler shutdown completed - > exiting > 2012-06-21 03:08:20 [ndbd] ALERT -- Node 2: Forced node shutdown > completed. Caused by error 2341: 'Internal program error (failed > ndbrequire)(Internal error, programming error or missing e > rror message, please report a bug). Temporary error, restart node'. > > > > node2 > ------- > > H'00015abd H'00f00500 scanIndex_abort state: 3 > 2012-06-21 03:08:10 [ndbd] INFO -- > > /pb2/build/sb_0-5227860-1331723713.63/mysql-cluster-gpl-7.2.5/storage/ndb/src/kernel/blocks/dbspj/DbspjMain.cpp > 2012-06-21 03:08:10 [ndbd] INFO -- DBSPJ (Line: 888) 0x00000006 > 2012-06-21 03:08:10 [ndbd] INFO -- Error handler shutting down system > 2012-06-21 03:08:10 [ndbd] INFO -- Error handler shutdown completed - > exiting > 2012-06-21 03:08:21 [ndbd] ALERT -- Node 3: Forced node shutdown > completed. Caused by error 2341: 'Internal program error (failed > ndbrequire)(Internal error, programming error or missing error message, > please report a bug). Temporary error, restart node'. > > > > > find the attached file ..in which the query caused the issue . > > Thanks, > Umapathi. > > > > > > --e89a8f22beb9447ad604c7f07ff8--