AnsweredAssumed Answered

Cluster installation with mapr-setup failed

Question asked by dzlabs on Apr 4, 2015
Latest reply on Apr 8, 2015 by leonclayton
I'm trying to install a MapR cluster of three machine using the [mapr-setup][1] script. The installation fails and I can't figure out the problem!

Here is the content of `config.example`:

    # Each Node section can specify nodes in the following format
    # Hostname: disk1, disk2, disk3
    # Specifying disks is optional. If not provided, the installer will use the values of 'disks' from the Defaults section
    [Control_Nodes]
    192.168.2.210: /dev/sda, /dev/sdb
    192.168.2.216: /dev/sda, /dev/sdb
    192.168.2.218: /dev/sda, /dev/sdb
    [Data_Nodes]
    #data-node1.mydomain
    #data-node2.mydomain: /dev/sdb, /dev/sdc, /dev/sdd
    #data-node3.mydomain: /dev/sdd
    #data-node4.mydomain: /dev/sdb, /dev/sdd
    [Client_Nodes]
    #client1.mydomain
    #client2.mydomain
    #client3.mydomain
    [Options]
    MapReduce1 = false
    YARN = true
    HBase = false
    MapR-DB = true
    ControlNodesAsDataNodes = true
    WirelevelSecurity = false
    LocalRepo = false
    [Defaults]
    ClusterName = dz.cluster.com
    User = mapr
    Group = mapr
    Password = mapr
    UID = 2000
    GID = 2000
    Disks = /dev/sda,/dev/sdb
    StripeWidth = 3
    ForceFormat = false
    CoreRepoURL = http://package.mapr.com/releases
    EcoRepoURL = http://package.mapr.com/releases/ecosystem-4.x
    Version = 4.0.2
    MetricsDBHost =
    MetricsDBUser =
    MetricsDBPassword =
    MetricsDBSchema =
    
    #[Spark]
    #SparkVersion = 0.9.1
    #SparkMasters = control-node1.mydomain, control-node2.mydomain
    #SparkSlaves = data-node1.mydomain, data-node2.mydomain, data-node3.mydomain
    #SparkMem = 2
    #SparkWorkerMem = 1
    #SparkDaemonMem = 16
    
    #[Hive]
    #HiveVersion = 0.12
    #HiveServers = control-node1.mydomain
    #HiveMetaStore = control-node2.mydomain
    #HiveClients = client-node1.mydomain, data-node3.mydomain

The installation fails, /mapr/ is empty and no folder name /opt/mapr/ is created!
Here is the output log `/opt/mapr-installer/var/mapr-installer.log`:

    2015-04-04 14:54:18,687 mapr-install 139 [INFO]:
    2015-04-04 14:54:18,687 mapr-install 140 [INFO]: ================================
    2015-04-04 14:54:18,687 mapr-install 141 [INFO]: Installer Version: 4.1.0.68 started
    2015-04-04 14:54:18,690 common 400 [INFO]: Now querying package python-pycurl
    2015-04-04 14:54:18,702 common 405 [INFO]: Package: python-pycurl
    Status: install ok installed
    Priority: optional
    Section: python
    Installed-Size: 215
    Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
    Architecture: amd64
    Source: pycurl
    Version: 7.19.3-0ubuntu3
    Depends: libc6 (>= 2.15), libcurl3-gnutls (>= 7.35.0), python (>= 2.7), python (<< 2.8), python:any (>= 2.7.1-0ubuntu2)
    Suggests: libcurl4-gnutls-dev, python-pycurl-dbg
    Description: Python bindings to libcurl
     This module provides the Python bindings to libcurl. Please refer to
     the libcurl documentation available in libcurl4-gnutls-dev Debian package.
     .
     NOTE: the SSL support is provided by GnuTLS.
    Homepage: http://pycurl.sourceforge.net
    Original-Maintainer: Debian Python Modules Team <python-modules-team@lists.alioth.debian.org>
    
    2015-04-04 14:54:18,702 common 400 [INFO]: Now querying package openssh-client
    2015-04-04 14:54:18,714 common 405 [INFO]: Package: openssh-client
    Status: install ok installed
    Priority: standard
    Section: net
    Installed-Size: 3435
    Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
    Architecture: amd64
    Multi-Arch: foreign
    Source: openssh
    Version: 1:6.6p1-2ubuntu2
    Replaces: ssh, ssh-krb5
    Provides: rsh-client, ssh-client
    Depends: libc6 (>= 2.17), libedit2 (>= 2.11-20080614), libgssapi-krb5-2 (>= 1.10+dfsg~), libselinux1 (>= 1.32), libssl1.0.0 (>= 1.0.1), zlib1g (>= 1:1.1.4), adduser (>= 3.10), dpkg (>= 1.7.0), passwd
    Recommends: xauth
    Suggests: ssh-askpass, libpam-ssh, keychain, monkeysphere
    Conflicts: sftp
    Conffiles:
     /etc/ssh/ssh_config 7c3fc0754c5a373bac7b09d9d4f6e403
     /etc/ssh/moduli 07d36dec51c06b538f196fcea2c8707c
    Description: secure shell (SSH) client, for secure access to remote machines
     This is the portable version of OpenSSH, a free implementation of
     the Secure Shell protocol as specified by the IETF secsh working
     group.
     .
     Ssh (Secure Shell) is a program for logging into a remote machine
     and for executing commands on a remote machine.
     It provides secure encrypted communications between two untrusted
     hosts over an insecure network. X11 connections and arbitrary TCP/IP
     ports can also be forwarded over the secure channel.
     It can be used to provide applications with a secure communication
     channel.
     .
     This package provides the ssh, scp and sftp clients, the ssh-agent
     and ssh-add programs to make public key authentication more convenient,
     and the ssh-keygen, ssh-keyscan, ssh-copy-id and ssh-argv0 utilities.
     .
     In some countries it may be illegal to use any encryption at all
     without a special permit.
     .
     ssh replaces the insecure rsh, rcp and rlogin programs, which are
     obsolete for most purposes.
    Original-Maintainer: Debian OpenSSH Maintainers <debian-ssh@lists.debian.org>
    Homepage: http://www.openssh.org/
    
    2015-04-04 14:54:18,714 common 400 [INFO]: Now querying package libssl1.0.0
    2015-04-04 14:54:18,726 common 405 [INFO]: Package: libssl1.0.0
    Status: install ok installed
    Priority: important
    Section: libs
    Installed-Size: 2929
    Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
    Architecture: amd64
    Multi-Arch: same
    Source: openssl
    Version: 1.0.1f-1ubuntu2.4
    Depends: libc6 (>= 2.14), debconf (>= 0.5) | debconf-2.0
    Pre-Depends: multiarch-support
    Description: Secure Sockets Layer toolkit - shared libraries
     This package is part of the OpenSSL project's implementation of the SSL
     and TLS cryptographic protocols for secure communication over the
     Internet.
     .
     It provides the libssl and libcrypto shared libraries.
    Original-Maintainer: Debian OpenSSL Team <pkg-openssl-devel@lists.alioth.debian.org>
    
    2015-04-04 14:54:18,814 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,815 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 2
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,816 packages 85 [INFO]: Getting packages for Node Type: 5
    2015-04-04 14:54:18,817 ui 671 [INFO]: Cluster Info:
    
            Current Information (Please verify if correct)
            ==============================================
    
            Accessibility settings:
    
                Cluster Name: "dz.cluster.com"
                MapR User Name: "mapr"
                MapR Group Name: "mapr"
                MapR User UID: "2000"
                MapR User GID: "2000"
                MapR User Password (Default: mapr): "****"
    
            Functional settings:
    
                WireLevel Security: "n"
                MapReduce Services: "n"
                YARN: "y"
                MapR-DB: "y"
    
                HBase: "n"
                Disks to use: "/dev/sda,/dev/sdb"
                Client Nodes: ""
                Control Nodes: "192.168.2.210,192.168.2.216,192.168.2.218"
                Data Nodes: ""
                Repository (will download core software from here): "http://package.mapr.com/releases"
                Ecosystem Repository (will download packages like Pig, Hive etc from here): "http://package.mapr.com/releases/ecosystem-4.x"
    
                MapR Version to Install: "4.0.2"
                Java Version to Install: "OpenJDK7"
                Allow Control Nodes to function as Data Nodes (Not recommended for large clusters): "y"
                Local Repository: "n"
    
            Metrics settings:
    
                Metrics DB Host and Port: ""
                Metrics DB User Name: ""
                Metrics DB User Password: ""
                Metrics DB Schema: ""
    
    
    
    2015-04-04 14:54:20,378 __init__ 52 [INFO]: Question: "(c)ontinue with install, (m)odify options, or save current configuration and (a)bort? (c/m/a) [c]: "
    2015-04-04 14:54:20,378 __init__ 53 [INFO]: Answer: "c"
    2015-04-04 14:54:20,378 manifest 443 [INFO]: Writing Manifest file
    2015-04-04 14:54:20,390 manifest 446 [INFO]: Wrote Manifest file successfully
    2015-04-04 14:56:25,010 installrunner 199 [ERROR]: Host: 192.168.2.210 has 1 failures
    2015-04-04 14:56:25,010 common 203 [ERROR]: Control Nodes have failures. Please fix the failures and re-run the installation. For more information refer to the installer log at /opt/mapr-installer/var/mapr-installer.log

  [1]: http://package.mapr.com/releases/v4.1.0/ubuntu/mapr-setup


Outcomes