Re: [Fwd: DIP NDB CLUSTER ISSUES]

[Johan Andersson]

Hi Umapathi,

could you also send a sample data set on this query and we can see what i
find.
You can email it directly to me. That would be great.


Best regards,
Johan
Severalnines AB

On Thu, Aug 23, 2012 at 3:10 PM, umapathi b <umapathi.b@stripped> wrote:

> Hi All,
>
> When I ran the query ( in the attached file ) , the cluster is completely
> shutting down.
> It won't take any time in non-ndb ( innodb,myisam ) instead.
> I am also getting the same error in 7.2.7 .
> Here is the error log ..
>
> 2012-08-23 05:21:57 [ndbd] INFO     -- Message to big in sendSignal
> 2012-08-23 05:21:57 [ndbd] INFO     --
> 2012-08-23 05:21:57 [ndbd] INFO     -- Error handler shutting down system
> 2012-08-23 05:21:57 [ndbd] INFO     -- Error handler shutdown completed -
> exiting
> 2012-08-23 05:22:05 [ndbd] ALERT    -- Node 3: Forced node shutdown
> completed. Caused by error 2341: 'Internal program error (failed
> ndbrequire)(Internal error, programming error or missing error message,
> please report a bug). Temporary error, restart node'.
>
> Help in this regard is highly appreciated.
>
> Thanks,
> Umapathi.
>
>
>
> ---------- Forwarded message ----------
> From: <umapathi@stripped>
> Date: Thu, Aug 23, 2012 at 6:34 PM
> Subject: [Fwd: DIP NDB CLUSTER ISSUES]
> To: umapathi.b@stripped
>
>
> ---------------------------- Original Message ----------------------------
> Subject: DIP NDB CLUSTER ISSUES
> From:    umapathi@stripped
> Date:    Thu, June 21, 2012 7:44 pm
> To:      venu@stripped
> Cc:      dev@stripped
>          qa@stripped
>          dba@stripped
>          support-it@stripped
> --------------------------------------------------------------------------
>
> Sir,
>
> Today after smoothly running for some time the DIP cluster database
> suddenly went down due to the following query . At that time there was no
> cpu load or memory issues on the servers.
>
> It is basically a memory issue and it is reported as a bug in the manuals.
>
>
> mgmd ( Management Node )
> ---------------------------
>
> 2012-06-21 03:08:16 [MgmtSrvr] ALERT    -- Node 1: Node 2 Disconnected
> 2012-06-21 03:08:16 [MgmtSrvr] ALERT    -- Node 1: Node 3 Disconnected
> 2012-06-21 03:08:20 [MgmtSrvr] ALERT    -- Node 2: Forced node shutdown
> completed. Caused by error 2341: 'Internal program error (failed
> ndbrequire)(Internal error, programming error or missing error message,
> please report a bug). Temporary error, restart node'.
> 2012-06-21 03:08:20 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 2
> freed, m_reserved_nodes 1, 3, 5 and 6.
> 2012-06-21 03:08:21 [MgmtSrvr] ALERT    -- Node 3: Forced node shutdown
> completed. Caused by error 2341: 'Internal program error (failed
> ndbrequire)(Internal error, programming error or missing error message,
> please report a bug). Temporary error, restart node'.
> 2012-06-21 03:08:21 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3
> freed, m_reserved_nodes 1, 5 and 6.
>
>
> ndbd ( node 1)
> ---------------
>
> 2012-06-21 03:08:10 [ndbd] INFO     --
>
>
> /pb2/build/sb_0-5227860-1331723713.63/mysql-cluster-gpl-7.2.5/storage/ndb/src/kernel/blocks/dbspj/DbspjMain.cpp
> 2012-06-21 03:08:10 [ndbd] INFO     -- DBSPJ (Line: 888) 0x00000006
> 2012-06-21 03:08:10 [ndbd] INFO     -- Error handler shutting down system
> 2012-06-21 03:08:10 [ndbd] INFO     -- Error handler shutdown completed -
> exiting
> 2012-06-21 03:08:20 [ndbd] ALERT    -- Node 2: Forced node shutdown
> completed. Caused by error 2341: 'Internal program error (failed
> ndbrequire)(Internal error, programming error or missing e
> rror message, please report a bug). Temporary error, restart node'.
>
>
>
> node2
> -------
>
> H'00015abd H'00f00500 scanIndex_abort state: 3
> 2012-06-21 03:08:10 [ndbd] INFO     --
>
>
> /pb2/build/sb_0-5227860-1331723713.63/mysql-cluster-gpl-7.2.5/storage/ndb/src/kernel/blocks/dbspj/DbspjMain.cpp
> 2012-06-21 03:08:10 [ndbd] INFO     -- DBSPJ (Line: 888) 0x00000006
> 2012-06-21 03:08:10 [ndbd] INFO     -- Error handler shutting down system
> 2012-06-21 03:08:10 [ndbd] INFO     -- Error handler shutdown completed -
> exiting
> 2012-06-21 03:08:21 [ndbd] ALERT    -- Node 3: Forced node shutdown
> completed. Caused by error 2341: 'Internal program error (failed
> ndbrequire)(Internal error, programming error or missing error message,
> please report a bug). Temporary error, restart node'.
>
>
>
>
> find the attached file ..in which the query caused the issue .
>
> Thanks,
> Umapathi.
>
>
>
>
>
>