From: Johan Andersson Date: September 5 2012 11:07am Subject: Re: problem with mysql cluster data node.Occured during startphase 4. Caused by error 2355 List-Archive: http://lists.mysql.com/cluster/8393 Message-Id: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=bcaec54ee4981bda3004c8f26260 --bcaec54ee4981bda3004c8f26260 Content-Type: text/plain; charset=ISO-8859-1 Hi, What happens if you start the other Data node (nodeid 4 and only that one). Thanks, Johan Severalnines AB On Wed, Sep 5, 2012 at 9:40 AM, xgss2000 wrote: > dear all: > > My Cluster data node can't startup. It will be terminated after about 1 > min. > > I don't know what happened and what i can do. > > pls help me and give me some suggestion. > > thanks very much. > > the version is below: > > ndb_mgm> show > Cluster Configuration > --------------------- > [ndbd(NDB)] 2 node(s) > id=3 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7, starting, Nodegroup: 0) > id=4 (not connected, accepting connect from localhost) > > [ndb_mgmd(MGM)] 1 node(s) > id=1 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7) > > [mysqld(API)] 1 node(s) > id=50 (not connected, accepting connect from any host) > > > here is the log: > > 2012-09-05 15:13:34 [MgmtSrvr] INFO -- Nodeid 3 allocated for NDB at > 127.0.0.1 > 2012-09-05 15:13:34 [MgmtSrvr] INFO -- Node 1: Node 3 Connected > 2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Start phase 0 completed > 2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Communication to Node 4 > opened > 2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Waiting 30 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:13:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for > nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:14:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for nodes > 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:14:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for nodes > 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:14:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for nodes > 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ] > 2012-09-05 15:14:09 [MgmtSrvr] INFO -- Node 3: Waiting 58 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:12 [MgmtSrvr] INFO -- Node 3: Waiting 55 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:15 [MgmtSrvr] INFO -- Node 3: Waiting 52 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:18 [MgmtSrvr] INFO -- Node 3: Waiting 49 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:21 [MgmtSrvr] INFO -- Node 3: Waiting 46 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:24 [MgmtSrvr] INFO -- Node 3: Waiting 43 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:27 [MgmtSrvr] INFO -- Node 3: Waiting 40 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:30 [MgmtSrvr] INFO -- Node 3: Waiting 37 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:33 [MgmtSrvr] INFO -- Node 3: Waiting 34 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:36 [MgmtSrvr] INFO -- Node 3: Waiting 31 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:14:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:15:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:15:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:15:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for non > partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ] > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start potentially > partitioned with nodes 3 [ missing: 4 no-wait: ] > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: CM_REGCONF president = > 3, own Node = 3, our dynamic id = 0/1 > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 1 completed > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 2 completed > (system restart) > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 3 completed > (system restart) > 2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Restarting cluster to > GCI: 262 > 2012-09-05 15:15:10 [MgmtSrvr] INFO -- Node 3: Starting to restore > schema > 2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown > completed. Occured during startphase 4. Caused by error 2355: 'Failure to > restore schema(Resource configuration error). Permanent error, external > action needed'. > 2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected > > config.ini > > [ndb_mgmd] > hostname=localhost > datadir=/state/partition1/cluster_data/ndb_data > NodeId=1 > [ndbd default] > noofreplicas=2 > datadir=/state/partition1/cluster_data/ndb_data > DataMemory: 4000M > IndexMemory: 500M > MaxNoOfConcurrentTransactions:4096 > MaxNoOfConcurrentOperations:500000 > MaxNoOfLocalOperations:550000 > MaxNoOfAttributes: 10000 > MaxNoOfTables: 3000 > MaxNoOfOrderedIndexes: 3000 > MaxNoOfUniqueHashIndexes: 3000 > MaxNoOfTriggers: 500 > TransactionDeadlockDetectionTimeout: 60000 > [ndbd] > hostname=localhost > NodeId=3 > [ndbd] > hostname=localhost > NodeId=4 > [mysqld] > NodeId=50 > > -- > MySQL Cluster Mailing List > For list archives: http://lists.mysql.com/cluster > To unsubscribe: http://lists.mysql.com/cluster > > --bcaec54ee4981bda3004c8f26260--