AnsweredAssumed Answered

How 2 CLDB's works in 2 node cluster?

Question asked by narendrakadari on Jul 29, 2016
Latest reply on Jul 30, 2016 by narendrakadari

Hi MarR

I am fresher to MapR, I have installed MapR Enterprise Edition on 2 node cluster.
  >  2 node cluster setup

  > 1st node Master

  > 2nd node Slave

i have installed CLDB in 2 node (i.e 1 CLDB installed Master  and other installed slave )
Why CLDB is shutting down in Master when Start Sartup and Starting with Slave CLDB ?

 

And When i restarted master node then  Master CLDB  is Active  and Slave CLDB is Shutdown I didn't Understand  

====================logs  of CLDB in MASTER==========================

2016-07-28 11:48:18,609 INFO CLDB [main]: CLDBInit: Starting HTTP Server

2016-07-28 11:48:18,609 INFO HttpServer [main]: WebServer: Starting WebServer

2016-07-28 11:48:18,609 INFO HttpServer [main]: Listener started on SelectChannelConnector@0.0.0.0:7221 port 7221

2016-07-28 11:48:18,609 INFO HttpServer [main]: Starting Jetty WebServer

2016-07-28 11:48:18,609 INFO log [main]: jetty-6.1.26

2016-07-28 11:48:18,834 INFO log [main]: Started SelectChannelConnector@0.0.0.0:7221

2016-07-28 11:48:38,586 INFO ZooKeeperClient [ZK-Connect]: ZooKeeperClient: KvStore is of latest epoch CLDB trying to become Master

2016-07-28 11:48:38,625 INFO ZooKeeperClient [ZK-Connect]: ZooKeeperClient createActiveEphemeralMasterZNode: /datacenter/controlnodes/cldb/active/CLDBMaster already exists

2016-07-28 11:48:38,625 INFO ZooKeeperClient [ZK-Connect]: ZooKeeperClient: Some other CLDB become master. Current CLDB is Slave

2016-07-28 11:48:38,626 INFO ZooKeeperClient [ZK-Connect]: CLDB got role of slave

2016-07-28 11:48:38,626 INFO CLDBServer [ZK-Connect]: Starting thread to become slave CLDB

2016-07-28 11:48:41,628 INFO ZooKeeperClient [Becoming Slave Thread]: Waiting for local KvStoreContainer to become valid. KvStore ContainerInfo  Container ID:1 Master:192.168.1.40-3(895181776509246219) Servers:  192.168.1.40-3(895181776509246219) 192.168.1.79-3(2908086744414421507) Inactive:  Unused:  Epoch:3 SizeMB:0 CLDB ServerID : 2908086744414421507

2016-07-28 11:48:41,628 INFO ZooKeeperClient [Becoming Slave Thread]: Local KvStoreContainer became valid. KvStore ContainerInfo  Container ID:1 Master:192.168.1.40-3(895181776509246219) Servers:  192.168.1.40-3(895181776509246219) 192.168.1.79-3(2908086744414421507) Inactive:  Unused:  Epoch:3 SizeMB:0 CLDB ServerID : 2908086744414421507

2016-07-28 11:48:41,629 INFO BecomeSlaveThread [Becoming Slave Thread]: IPAddress of local kvstore is 192.168.1.79:5660

2016-07-28 11:48:41,645 INFO Table [Becoming Slave Thread]: KvStore Init: Opening Tables

2016-07-28 11:48:41,678 INFO BecomeSlaveThread [Becoming Slave Thread]: Slave CLDB found that size reduction feature is enabled

2016-07-28 11:48:41,679 INFO BecomeSlaveThread [Thread-17]: Prefetching container information from table 2

2016-07-28 11:48:41,679 INFO BecomeSlaveThread [Thread-20]: Prefetching container information from table 5

2016-07-28 11:48:41,679 INFO BecomeSlaveThread [Thread-16]: Prefetching container information from table 1

2016-07-28 11:48:41,679 INFO BecomeSlaveThread [Thread-15]: Prefetching container information from table 0

....

remove some log meaasges......

.....

2016-07-28 11:48:41,713 INFO BecomeSlaveThread [Thread-15]: Prefetched information of 15 containers in table 0

2016-07-28 11:48:41,713 INFO BecomeSlaveThread [Thread-15]: Exit: Thread to prefetch table 0

2016-07-28 11:48:41,713 INFO BecomeSlaveThread [Thread-24]: Prefetched information of 0 containers in table 9

2016-07-28 11:48:41,713 INFO BecomeSlaveThread [Thread-24]: Exit: Thread to prefetch table 9

2016-07-28 11:48:41,729 INFO LicenseManager [Becoming Slave Thread]: using default license validator

2016-07-28 11:48:41,817 WARN LicenseManager [Becoming Slave Thread]: license exists

2016-07-28 11:48:41,817 INFO LicenseManager [Becoming Slave Thread]: license exists

2016-07-28 11:48:41,826 WARN LicenseManager [Becoming Slave Thread]: license exists

2016-07-28 11:48:41,826 INFO LicenseManager [Becoming Slave Thread]: license exists

2016-07-28 11:48:41,834 INFO LicenseManager [Becoming Slave Thread]: 0x15: unique id: 825012035800-EDB58CB8-B1C2-B469-3424-15AF5887A995-0000522241-0000130561-0000652803

2016-07-28 11:48:41,835 FATAL BecomeSlaveThread [Becoming Slave Thread]: license not found for CLDB HA: shutting down

2016-07-28 11:48:41,835 FATAL CLDB [Becoming Slave Thread]: CLDBShutdown: license not found for CLDB HA: shutting down

2016-07-28 11:48:41,835 ERROR CLDB [Becoming Slave Thread]: Thread: Timer-0 ID: 29

2016-07-28 11:48:41,835 ERROR CLDB [Becoming Slave Thread]: java.lang.Object.wait(Native Method)

2016-07-28 11:48:41,835 ERROR CLDB [Becoming Slave Thread]: java.util.TimerThread.mainLoop(Timer.java:552)

2016-07-28 11:48:41,835 ERROR CLDB [Becoming Slave Thread]: java.util.TimerThread.run(Timer.java:505)

2016-07-28 11:48:41,835 ERROR CLDB [Becoming Slave Thread]: Thread: RMI TCP Accept-7220 ID: 11

....

remove some log meaasges......

.....

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: com.mapr.fs.cldb.util.EmailManager$EmailManagerThread.run(EmailManager.java:115)

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: java.lang.Thread.run(Thread.java:745)

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: Thread: Health-Monitor ID: 15

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: java.lang.Thread.sleep(Native Method)

2016-07-28 11:48:41,837 ERROR CLDB [Becoming Slave Thread]: com.mapr.baseutils.threadpool.HealthCheckMonitor.run(HealthCheckMonitor.java:31)

2016-07-28 11:48:41,837 INFO CLDBServer [Becoming Slave Thread]: Shutdown: Stopping CLDB

2016-07-28 11:48:41,837 INFO CLDB [Thread-13]: CLDB ShutDown Hook called

2016-07-28 11:48:41,837 INFO ZooKeeperClient [Thread-13]: Zookeeper Client: Closing client connection:

2016-07-28 11:48:41,839 INFO ClientCnxn [main-EventThread]: EventThread shut down

2016-07-28 11:48:41,839 INFO ZooKeeper [Thread-13]: Session: 0x1562fcc4fb80035 closed

2016-07-28 11:48:41,839 INFO CLDB [Thread-13]: CLDB shutdown

 

 

How 2 CLBDs Works in 2 node cluster ?

 

Could any one please explain me in detail.

 

Thanks
Narendra kadari

Outcomes