AnsweredAssumed Answered

MapR client with mavericks, buggy installation with worse results on exit=0

Question asked by jplussier on Dec 3, 2014
Latest reply on Dec 4, 2014 by jplussier
Hey MapR, I've got your sandbox running in a VM, that installation went just fine and everything seems to be working smoothly. My current problem is inside the client installation script. I'll preface by saying I've got a bootcamp/conference coming up where this stack is a requirement, and don't have any goals or objectives yet except getting the client behaving.

The first issue, which I solved, is that /conf/env.sh doesn't look in the one place where every Mac system has their JAVA_HOME. After rewriting the commented `export JAVA_HOME` line to point to `"$(/usr/libexec/java_home)"` all the Java requirement warnings went away. I thought I was out of the weeds. I'm not.

Depending on /which/ hadoop I try to run, I get a variety of errors. I have no idea which one I actually need to be running, suffice to say the "verify configuration" step totally fails on all of them. Here they are, in no particular order:

    $ ./bin/hadoop fs -ls /
    ./bin/hadoop: line 39: /usr/bin/hadoop2: No such file or directory
    ./bin/hadoop: line 39: exec: /usr/bin/hadoop2: cannot execute: No such file or directory
    
    ============================================

    $ ./hadoop/hadoop-0.20.2/bin/hadoop fs -ls /
    WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
    hdrlen bad, 12081, received from 172.16.65.131:8443
    2014-12-03 14:36:44,4282 ERROR Client fs/client/fileclient/cc/client.cc:394 Thread: 4483489792 Failed to initialize client for cluster demo.mapr.com, error Argument list too long(7)
    ls: Could not create FileClient

    ============================================
    
    $ ./hadoop/hadoop-2.4.1/bin/hadoop fs -ls /                                                                                                            14:36:44
    14/12/03 14:37:43 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    hdrlen bad, 12081, received from 172.16.65.131:8443
    2014-12-03 14:37:43,5144 ERROR Client fs/client/fileclient/cc/client.cc:394 Thread: 4371722240 Failed to initialize client for cluster demo.mapr.com, error Argument list too long(7)
    ls: Could not create FileClient

As for the client install, here's the output of my log incase that's useful:

    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2130
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2131 Node install STARTED
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2132 -----------------------
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2133 CMD: /opt/mapr/server/configure.sh -N demo.mapr.com -c -C 172.16.65.131:8443
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2156 Cluster run as secure=false
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConstructMapRClustersConfFile:657 Contructing ClusterConfFile: cldb node list: 172.16.65.131:8443
    2014-12-03 14:32:58.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConstructMapRClustersConfFile:675 Contructing ClusterConfFile: Done
    chown: mapr: illegal user name
    usage: chown [-fhv] [-R [-H | -L | -P]] owner[:group] file ...
           chown [-fhv] [-R [-H | -L | -P]] :group file ...
    chown: mapr: illegal user name
    chown: mapr: illegal user name
    chown: mapr: illegal user name
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install UpdateFileClientConfig:971 Updating file client config
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureCLDBRole:746 Skipping CLDB Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureNFSRole:828 Skipping NFS Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureWSRole:855 Skipping Webserver Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureJTRole:1003 Skipping Job Tracker Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureTTRole:1045 Skipping TaskTracker Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureDrillBitsRole:1060 Skipping Drill Bits Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureHBMRole:1159 Skipping Hbase Master Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureHBRRole:1190 Skipping Hbase RS Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureHBIRole:1174 Skipping Hbase Client Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureJMRole:426 Skipping Job Management Role configuration... Metrics not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install ConfigureOozieRole:1028 Skipping Oozie Role configuration... Not found
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install RunDiskSetup:260 Disksetup NOT run (-F or -D options not provided). Please run /opt/mapr/server/disksetup manually
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2210
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2211 Node install FINISHED
    2014-12-03 14:32:59.0 MBAdmins-MacBook-Pro.local configure.sh(55997) Install main:2212 -----------------------

Thanks very much for taking a look, once I get to the point where the client/hadoop command is working I should be all set for the bootcamp. Please let me know if there's any more information I can provide. Thanks again.

Outcomes