AnsweredAssumed Answered

configure.sh referring to incorrect hadoop version

Question asked by dannyman on Sep 30, 2015
Latest reply on Sep 30, 2015 by dannyman
Did an upgrade from 2 to 4.0, then a rolling upgrade to 4.1.0 ... now configure.sh, even on a new node, is confused:

    $ sudo /opt/mapr/server/configure.sh -R
    Configuring Hadoop-2.4.1 at /opt/mapr/hadoop/hadoop-2.4.1
    diff: /opt/mapr/hadoop/hadoop-0.20.2/conf/ssl-client.xml: No such file or directory
    diff: /opt/mapr/hadoop/hadoop-0.20.2/conf/ssl-server.xml: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/ssl-client.xml: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/ssl-server.xml: No such file or directory
    Done configuring Hadoop
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    chown: cannot access `/opt/mapr/hadoop/hadoop-2.4.1/bin/container-executor': No such file or directory
    chmod: cannot access `/opt/mapr/hadoop/hadoop-2.4.1/bin/container-executor': No such file or directory
    Node setup configuration:  spark-historyserver tasktracker
    Log can be found at:  /opt/mapr/logs/configure.log
    sed: can't read : No such file or directory
    sed: can't read : No such file or directory
    sed: can't read : No such file or directory
    sed: can't read : No such file or directory

    $ ls /opt/mapr/hadoop
    hadoop-0.20.2  hadoop-2.5.1  hadoopversion

   $ cat /opt/mapr/hadoop/hadoopversion
   2.5.1

    $ sudo /opt/mapr/server/configure.sh -C mapr-12.dev.qxxxxxxxd.com -Z mapr-12.dev.qxxxxxxxd.com -N mapr-test
    Configuring Hadoop-2.4.1 at /opt/mapr/hadoop/hadoop-2.4.1
    diff: /opt/mapr/hadoop/hadoop-0.20.2/conf/ssl-client.xml: No such file or directory
    diff: /opt/mapr/hadoop/hadoop-0.20.2/conf/ssl-server.xml: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/ssl-client.xml: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/ssl-server.xml: No such file or directory
    Done configuring Hadoop
    CLDB node list: mapr-12.dev.qxxxxxxxd.com:7222
    Zookeeper node list: mapr-12.dev.qxxxxxxxd.com:5181
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    sed: can't read /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/container-executor.cfg: No such file or directory
    chown: cannot access `/opt/mapr/hadoop/hadoop-2.4.1/bin/container-executor': No such file or directory
    chmod: cannot access `/opt/mapr/hadoop/hadoop-2.4.1/bin/container-executor': No such file or directory
    /opt/mapr/server/configure-hadoop.sh: line 57: /opt/mapr/hadoop/hadoop-2.4.1/etc/hadoop/yarn-site.xml.tmp: No such file or directory
    ERROR configuring yarn-site.xml.

Any ideas how to bring configure.sh up to speed with reality?

Thanks,
-danny

Outcomes