AnsweredAssumed Answered

balancer not working

Question asked by mapr_user62 on Jun 9, 2013
Latest reply on Jun 9, 2013 by mapr_user62
I see the below messages in cldb logs.

2013-06-09 17:47:35,265 WARN Containers [Repl]: ContainerCreateCopy: Could not create replicas for container: 2055
2013-06-09 17:47:35,855 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 9e3454afd9e7991c0051ab9c3e003367
2013-06-09 17:47:35,858 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 84b27588e8a879f70051ab9c3709f9d1
2013-06-09 17:47:35,861 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 2aa82c20b97d82d30051ab9c3107064a
2013-06-09 17:47:35,864 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 10448f8b5aa0866a0051a944e809d53c
2013-06-09 17:47:35,867 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 13c7a1af370162220051ab9c4402b32c
2013-06-09 17:47:35,869 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp e75b87dbcbc181250051a94a5c0bf8c3
2013-06-09 17:47:35,872 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp a9e2973bb5e8ea5d0051a9418800c300
2013-06-09 17:47:35,877 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 2061c20b0e82192e0051ab9c240daf0e
2013-06-09 17:47:35,880 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp f4ea60d3ece523440051ab9c1e0b69f3
2013-06-09 17:47:35,883 WARN DiskBalancer [DBal]: moveSomeContainersFromSp : could not move any containers from sp 17d20a3f03b0d7a40051ab9c2b029871



I have turned on aggressive balancer settings.

bash-4.1$ maprcli config load -json | grep balancer
                        "cldb.balancer.disk.delta":"0",
                        "cldb.balancer.disk.max.switches.in.nodes.percentage":"70",
                        "cldb.balancer.disk.paused":"0",
                        "cldb.balancer.disk.sleep.interval.sec":"20",
                        "cldb.balancer.disk.threshold.percentage":"5",
                        "cldb.balancer.logging":"1",
                        "cldb.balancer.role.max.switches.in.nodes.percentage":"70",
                        "cldb.balancer.role.paused":"0",
                        "cldb.balancer.role.skip.container.active.sec":"30",
                        "cldb.balancer.role.sleep.interval.sec":"30",
                        "cldb.balancer.startup.interval.sec":"20",


bash-4.1$ maprcli dump balancerinfo
ip:port               usedMB   fullnessLevel  fsid                 spid                              percentage  outTransitMB  inTransitMB  capacityMB
192.168.184.7:5660-   1334790  Average        2489213996146312774  10448f8b5aa0866a0051a944e809d53c  24          0             0            5489155
192.168.184.15:5660-  1337240  Average        6070190079856433493  13c7a1af370162220051ab9c4402b32c  24          0             0            5493251
192.168.184.11:5660-  1196989  Average        3296203233451876449  17d20a3f03b0d7a40051ab9c2b029871  21          0             0            5493251
192.168.184.10:5660-  1188560  Average        7702287163581263248  2061c20b0e82192e0051ab9c240daf0e  21          0             0            5493251
192.168.184.12:5660-  1968226  Average        6719064486339736601  2aa82c20b97d82d30051ab9c3107064a  35          0             0            5493251
192.168.184.13:5660-  1967148  Average        95646029176776480    84b27588e8a879f70051ab9c3709f9d1  35          0             0            5493251
192.168.184.14:5660-  1947224  Average        3253514581363871300  9e3454afd9e7991c0051ab9c3e003367  35          0             0            5493251
192.168.184.6:5660-   1193552  Average        5796754822430201082  a9e2973bb5e8ea5d0051a9418800c300  21          0             0            5489155
192.168.6.108:5660-   411      UnderUsed      209345053808997786   adbe4acd3e1efd020051a9125d04ecb9  0           0             0            44620
192.168.184.8:5660-   1198039  Average        6742447602535448455  e75b87dbcbc181250051a94a5c0bf8c3  21          0             0            5489155
192.168.184.9:5660-   1167820  Average        8840523635344226740  f4ea60d3ece523440051ab9c1e0b69f3  21          0             0            5493251

No active container moves


Why is it failing to balance?

Outcomes