AnsweredAssumed Answered

hadoop command on windows (After installing maprclient) causes Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path

Question asked by vidisha on Jul 14, 2016
Latest reply on Feb 11, 2017 by karthikSpark

Hi All,

 

I installed MapR client on my windows and the configure command just ran fine

 

but when I try to run hdfs dfs -ls /

 

 

 

C:\opt\mapr\hadoop\hadoop-2.7.0\bin>hdfs dfs -ls /

==========Unable to find library on native path due to Exception. ==============

java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at com.mapr.fs.ShimLoader.loadNativeLibrary(ShimLoader.java:330)

        at com.mapr.fs.ShimLoader.load(ShimLoader.java:226)

        at org.apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:274)

        at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2147)

        at org.apache.hadoop.conf.Configuration.getProperties(Configuration.java:2362)

        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2579)

        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2531)

        at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2444)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1156)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1128)

        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1464)

        at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)

        at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

        at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)

Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886)

        at java.lang.Runtime.loadLibrary0(Runtime.java:849)

        at java.lang.System.loadLibrary(System.java:1088)

        at com.mapr.fs.shim.LibraryLoader.loadLibrary(LibraryLoader.java:43)

        ... 24 more

==========Unable to find library in jar due to exception. ==============

java.lang.RuntimeException: no native library is found for os.name=Windows and os.arch=x86_64

        at com.mapr.fs.ShimLoader.findNativeLibrary(ShimLoader.java:523)

        at com.mapr.fs.ShimLoader.loadNativeLibrary(ShimLoader.java:340)

        at com.mapr.fs.ShimLoader.load(ShimLoader.java:226)

        at org.apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:274)

        at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2147)

        at org.apache.hadoop.conf.Configuration.getProperties(Configuration.java:2362)

        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2579)

        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2531)

        at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2444)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1156)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1128)

        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1464)

        at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)

        at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

        at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)

java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at com.mapr.fs.ShimLoader.loadNativeLibrary(ShimLoader.java:330)

        at com.mapr.fs.ShimLoader.load(ShimLoader.java:226)

        at org.apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:274)

        at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2147)

        at org.apache.hadoop.conf.Configuration.getProperties(Configuration.java:2362)

        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2579)

        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2531)

        at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2444)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1156)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1128)

        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1464)

        at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)

        at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

        at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)

Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886)

        at java.lang.Runtime.loadLibrary0(Runtime.java:849)

        at java.lang.System.loadLibrary(System.java:1088)

        at com.mapr.fs.shim.LibraryLoader.loadLibrary(LibraryLoader.java:43)

        ... 24 more

Exception in thread "main" java.lang.ExceptionInInitializerError

        at com.mapr.fs.ShimLoader.load(ShimLoader.java:243)

        at org.apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:274)

        at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2147)

        at org.apache.hadoop.conf.Configuration.getProperties(Configuration.java:2362)

        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2579)

        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2531)

        at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2444)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1156)

        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1128)

        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1464)

        at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)

        at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)

        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

        at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)

Caused by: java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at com.mapr.fs.ShimLoader.loadNativeLibrary(ShimLoader.java:330)

        at com.mapr.fs.ShimLoader.load(ShimLoader.java:226)

        ... 18 more

Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886)

        at java.lang.Runtime.loadLibrary0(Runtime.java:849)

        at java.lang.System.loadLibrary(System.java:1088)

        at com.mapr.fs.shim.LibraryLoader.loadLibrary(LibraryLoader.java:43)

        ... 24 more

 

 

These are few of my settings

 

C:\opt\mapr\hadoop\hadoop-2.7.0\bin>echo %hadoop_home%

C:\opt\mapr\hadoop\hadoop-2.7.0

 

 

C:\opt\mapr\hadoop\hadoop-2.7.0\bin>echo %path%

C:\opt\mapr\hadoop\hadoop-2.7.0\bin;C:\Program Files\Actian\VectorVW\ingres\bin;C:\Program Files\Actian\VectorVW\ingres\utility;C:\Java\jdk1.7.0_79\bin;C:\Program Files\Ingres\IngresII\ingres\bin;C:\Program Files\Ingres\IngresII\ingres\utility;C:\Program Files\Actian\VectorVW\ingres\bin;C:\Program Files\Actian\VectorVW\ingres\utility;C:\Program Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Intel\OpenCL SDK\2.0\bin\x86;C:\Program Files (x86)\Intel\OpenCL SDK\2.0\bin\x64;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files (x86)\Intel\Intel(R) Management Eng

ine Components\DAL;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files\Lucidlogix Technologies\VIRTU MVP;C:\Program Files (x86)\Windows Kits\8.0\Windows Performance Toolkit\;C:\Program Files\Microsoft SQL Server\110\Tools\Binn\;C:\Program Files (x86)\Skype\Phone\;C:\Windows\System32

 

 

C:\opt\mapr\hadoop\hadoop-2.7.0\bin>echo %mapr_home%

C:\opt\mapr

 

I even editted my core-site.xml and mapred-site.xml in C:\opt\mapr\hadoop\hadoop-2.7.0\etc\hadoop

as  shown in Setting Up the Client - MapR 5.0 Documentation - doc.mapr.com

 

Can somebody please point out what am I missing and what "Caused by: java.lang.UnsatisfiedLinkError: no MapRClient in java.library.path" means in the error above and how to fix it.

Outcomes