List:Cluster« Previous MessageNext Message »
From:Subodh Nair Date:March 29 2010 9:09am
Subject:RE: MySQL cluster- migrating from WIndows to Linux
View as plain text  


Subject: RE: MySQL cluster- migrating from WIndows to Linux

Hello Mathew,

I think the linux node is communicating successfully with the management
node. Athe status in the ndb_mgm console shows the new Linux node (node 3 )
as starting. Earlier, there was a windows data node with the same node id.
When I shutdown the windows data node and checked the status in the console
it had displayed node 3 as not connected. I then changed the config.ini to
modify the path of the datadir in the node 3 as a linux path and restarted
the management node. All the other nodes were still with the cluster and
data was still accessible.

In the Linux node, I was running the process as root and had given full
permission to the folder which was my data directory.
When I started the deamon in Linux, I noticed the pid file was formed in
this folder along with a log file.

I have attached the log file in the mgmt node ndb_1_cluster and the linux
node ndb_3_out.log.

Ndb_1_cluster.log
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::::::::::::::::::::::::::::::::::::::
2010-03-29 07:30:45 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6933
started. Keep GCI = 140801 oldest restorable GCI = 140816
2010-03-29 07:31:49 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6934
started. Keep GCI = 140822 oldest restorable GCI = 140836
2010-03-29 07:32:53 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6935
started. Keep GCI = 140843 oldest restorable GCI = 140855
2010-03-29 07:33:58 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6936
started. Keep GCI = 140864 oldest restorable GCI = 140875
2010-03-29 07:35:02 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6937
started. Keep GCI = 140885 oldest restorable GCI = 140895
2010-03-29 07:36:06 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6938
started. Keep GCI = 140906 oldest restorable GCI = 140914
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Got initial configuration from
'C:\MySQL\config.ini', will try to set it when all ndb_mgmd(s) started
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Mgmt server state: nodeid 1
reserved for ip 10.90.90.35, m_reserved_nodes
0000000000000000000000000000000000000000000000000000000000000002.
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Node 1: Node 1 Connected
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Id: 1, Command port: *:1186
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Starting initial configuration
change
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Configuration 1 commited
2010-03-29 07:36:47 [MgmSrvr] INFO     -- Config change completed! New
generation: 1
2010-03-29 07:36:48 [MgmSrvr] INFO     -- Node 1: Node 3 Connected
2010-03-29 07:36:48 [MgmSrvr] INFO     -- Node 1: Node 2 Connected
2010-03-29 07:36:48 [MgmSrvr] INFO     -- Node 3: Prepare arbitrator node 1
[ticket=0b940003d9227845]
2010-03-29 07:36:48 [MgmSrvr] INFO     -- Node 2: Started arbitrator node 1
[ticket=0b940003d9227845]
2010-03-29 07:37:10 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6939
started. Keep GCI = 140927 oldest restorable GCI = 140934
2010-03-29 07:37:47 [MgmSrvr] ALERT    -- Node 1: Node 3 Disconnected
2010-03-29 07:37:47 [MgmSrvr] ALERT    -- Node 2: Node 3 Disconnected
2010-03-29 07:37:47 [MgmSrvr] INFO     -- Node 2: Communication to Node 3
closed
2010-03-29 07:37:47 [MgmSrvr] ALERT    -- Node 2: Network partitioning -
arbitration required
2010-03-29 07:37:47 [MgmSrvr] INFO     -- Node 2: President restarts
arbitration thread [state=7]
2010-03-29 07:37:47 [MgmSrvr] ALERT    -- Node 2: Arbitration won - positive
reply from node 1
2010-03-29 07:37:47 [MgmSrvr] INFO     -- Node 2: Started arbitrator node 1
[ticket=0b940004d9236526]
2010-03-29 07:37:51 [MgmSrvr] INFO     -- Node 2: Communication to Node 3
opened
2010-03-29 07:38:14 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6940
started. Keep GCI = 140948 oldest restorable GCI = 140954
2010-03-29 07:39:18 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6941
started. Keep GCI = 140969 oldest restorable GCI = 140973
2010-03-29 07:40:22 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6942
started. Keep GCI = 140990 oldest restorable GCI = 141005
2010-03-29 07:41:26 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6943
started. Keep GCI = 141011 oldest restorable GCI = 141024
2010-03-29 07:41:32 [MgmSrvr] INFO     -- Mgmt server state: nodeid 3
reserved for ip 10.90.90.29, m_reserved_nodes
000000000000000000000000000000000000000000000000000000000000000a.
2010-03-29 07:41:32 [MgmSrvr] INFO     -- Mgmt server state: nodeid 3 freed,
m_reserved_nodes
0000000000000000000000000000000000000000000000000000000000000002.
2010-03-29 07:41:32 [MgmSrvr] INFO     -- Node 3: Node shutdown completed,
restarting.
2010-03-29 07:41:52 [MgmSrvr] WARNING  -- Node 2: Releasing node id
allocation for node 3
2010-03-29 07:42:30 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6944
started. Keep GCI = 141032 oldest restorable GCI = 141045
2010-03-29 07:43:34 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6945
started. Keep GCI = 141053 oldest restorable GCI = 141064
2010-03-29 07:44:38 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6946
started. Keep GCI = 141074 oldest restorable GCI = 141084
2010-03-29 07:45:42 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6947
started. Keep GCI = 141095 oldest restorable GCI = 141104
2010-03-29 07:46:46 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6948
started. Keep GCI = 141116 oldest restorable GCI = 141131
2010-03-29 07:47:50 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6949
started. Keep GCI = 141137 oldest restorable GCI = 141150
2010-03-29 07:48:55 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6950
started. Keep GCI = 141158 oldest restorable GCI = 141170
2010-03-29 07:49:59 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6951
started. Keep GCI = 141179 oldest restorable GCI = 141190
2010-03-29 07:51:03 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6952
started. Keep GCI = 141200 oldest restorable GCI = 141209
2010-03-29 07:52:07 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6953
started. Keep GCI = 141221 oldest restorable GCI = 141229
2010-03-29 07:53:11 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6954
started. Keep GCI = 141242 oldest restorable GCI = 141248
2010-03-29 07:54:15 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6955
started. Keep GCI = 141263 oldest restorable GCI = 141268
2010-03-29 07:55:19 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6956
started. Keep GCI = 141284 oldest restorable GCI = 141288
2010-03-29 07:56:23 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6957
started. Keep GCI = 141305 oldest restorable GCI = 141319
2010-03-29 07:57:27 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6958
started. Keep GCI = 141326 oldest restorable GCI = 141340
2010-03-29 07:58:31 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6959
started. Keep GCI = 141347 oldest restorable GCI = 141360
2010-03-29 07:59:34 [MgmSrvr] INFO     -- Node 2: Local checkpoint 6960
started. Keep GCI = 141368 oldest restorable GCI = 141379
2010-03-29 07:59:47 [MgmSrvr] INFO     -- Mgmt server state: nodeid 3
reserved for ip 10.90.90.29, m_reserved_nodes
000000000000000000000000000000000000000000000000000000000000000a.
2010-03-29 07:59:48 [MgmSrvr] INFO     -- Node 1: Node 3 Connected
2010-03-29 07:59:50 [MgmSrvr] INFO     -- Mgmt server state: nodeid 3 freed,
m_reserved_nodes
0000000000000000000000000000000000000000000000000000000000000002.
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 3: Node 2 Connected
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 2: Node 3 Connected
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 2: Node 3: API mysql-5.1.32
ndb-7.0.5
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 3: CM_REGCONF president = 2,
own Node = 3, our dynamic id = 3
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 3: Node 2: API mysql-5.1.34
ndb-7.0.6
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 3: Start phase 1 completed 
2010-03-29 07:59:53 [MgmSrvr] INFO     -- Node 3: Start phase 2 completed
(initial node restart)
2010-03-29 07:59:54 [MgmSrvr] INFO     -- Node 3: Receive arbitrator node 1
[ticket=0b940004d9236526]
2010-03-29 07:59:59 [MgmSrvr] INFO     -- Node 2: DICT: locked by node 3 for
NodeRestart
2010-03-29 08:00:00 [MgmSrvr] INFO     -- Node 2: Node 3 enqueued is waiting
to copy table/fragment info
2010-03-29 08:00:00 [MgmSrvr] INFO     -- Node 3: Start phase 3 completed
(initial node restart)
2010-03-29 08:00:00 [MgmSrvr] INFO     -- Node 3: Local redo log file
initialization status:
#Total files: 128, Completed: 0
#Total MBytes: 2048, Completed: 0
2010-03-29 08:00:00 [MgmSrvr] INFO     -- Node 3: Local redo log file
initialization completed:
#Total files: 128, Completed: 128
#Total MBytes: 2048, Completed: 2048
2010-03-29 08:00:00 [MgmSrvr] INFO     -- Node 3: Start phase 4 completed
(initial node restart)
2010-03-29 08:00:37 [MgmSrvr] INFO     -- Node 3: Starting to restore schema
2010-03-29 08:00:38 [MgmSrvr] INFO     -- Node 2: Local checkpoint blocked
waiting for node-restart
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::::::::::::::::::::::::::

And the log in Linux node:
Ndb_3_out.log

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:::::::::::::::::::::::::::::::::

2010-03-29 07:59:47 [ndbd] INFO     -- Angel pid: 5843 
ndb pid: 5844
NDBMT: non-mt

2010-03-29 07:59:47 [ndbd] INFO     -- NDB Cluster -- DB node 3

2010-03-29 07:59:47 [ndbd] INFO     -- mysql-5.1.32 ndb-7.0.5-beta --

2010-03-29 07:59:47 [ndbd] INFO     -- Ndbd_mem_manager::init(1) min: 5124Mb
initial: 5144Mb

Adding 5144Mb to ZONE_LO (1,164607)

2010-03-29 07:59:48 [ndbd] INFO     -- Start initiated (mysql-5.1.32
ndb-7.0.5)

WOPool::init(61, 9)

RWPool::init(22, 13)

RWPool::init(42, 18)

RWPool::init(62, 13)

Using 1 fragments per node
RWPool::init(c2, 18)

RWPool::init(e2, 16)

WOPool::init(41, 8)

RWPool::init(82, 12)

RWPool::init(a2, 52)

WOPool::init(21, 10)

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:::::::::::::::::::::::::::::

Best Regards,

Subodh



-----Original Message-----
From: Matt.Montgomery@stripped [mailto:Matt.Montgomery@stripped]
Sent: Thursday, March 25, 2010 8:53 PM
To: Subodh Nair; cluster@stripped
Subject: RE: MySQL cluster- migrating from WIndows to Linux

On Thu, 2010-03-25 at 10:18 -0500, Matthew Montgomery wrote:
> email message attachment, "Forwarded message - RE: MySQL cluster- 
> migrating from WIndows to Linux"
> > -------- Forwarded Message --------
> > From: Subodh Nair <subodhnair@stripped>
> > To: Matt.Montgomery@stripped
> > Subject: RE: MySQL cluster- migrating from WIndows to Linux
> > Date: Thu, 25 Mar 2010 00:48:07 +0530
> > 
> > Hello Mathew,
> > 
> > Thanks for the reply. Yes I did try to simulate the migration under 
> > test conditions on a 5 node cluster with 2 data nodes. I shut down 
> > one of the data nodes when the cluster was alive and tried to 
> > introduce a RHEL 5.0 64 bit based data node. The servers were of similar
configuration.
> > The ndb_out log in the management node showed that the node was 
> > started and the synchronization had started. But after some time it
stopped.
> > The ndb_mgm console showed the new linux data node as starting but 
> > it never reached the started state.
> > 

At what phase does the node hang?

Show the results of
ndb_mgm> ALL STATUS;

and the management node log.  It could be that the RH box isn'tcommunicating
with the Windows box at all due to a firewall or hostname resolution
problem.

--
Matthew Montgomery
MySQL Senior Support Engineer
Sun Microsystems Inc., Database Group
San Antonio, Texas, USA

Thread
[Fwd: RE: MySQL cluster- migrating from WIndows to Linux]Matthew Montgomery25 Mar
  • RE: MySQL cluster- migrating from WIndows to LinuxMatthew Montgomery25 Mar
    • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair16 Jun
      • Re: MySQL cluster- migrating from WIndows to LinuxGeert Vanderkelen16 Jun
        • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair16 Jun
          • Re: MySQL cluster- migrating from WIndows to LinuxGeert Vanderkelen16 Jun
            • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair16 Jun
              • Re: MySQL cluster- migrating from WIndows to LinuxGeert Vanderkelen16 Jun
                • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair24 Jun
                  • Re: MySQL cluster- migrating from WIndows to LinuxGeert Vanderkelen24 Jun
                    • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair25 Jun
  • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair29 Mar
    • RE: MySQL cluster- migrating from WIndows to LinuxStewart Smith29 Mar
      • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair29 Mar
        • RE: MySQL cluster- migrating from WIndows to LinuxAndrew Morgan29 Mar
          • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair31 Mar
            • Re: MySQL cluster- migrating from WIndows to LinuxGeert Vanderkelen31 Mar
              • RE: MySQL cluster- migrating from WIndows to LinuxSubodh Nair31 Mar