AnsweredAssumed Answered

unable to run pig in local mode

Question asked by puchtec on Apr 29, 2014
Latest reply on Apr 29, 2014 by nabeel
Hi,

I am not able to run pig in local mode. I always receive "ERROR 2999: Unexpected internal error. Failed to create DataStorage" and pig quits immediately.

Pig Version: The version is Apache Pig version 0.12.1-mapr-1401 (rexported)

    [mapr@node01 ~]$ pig -x local
    which: no hbase in (/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/mapr/bin)
    2014-04-29 18:03:13,011 [main] INFO  org.apache.pig.Main - Apache Pig version 0.12.1-mapr-1401 (rexported) compiled Jan 30 2014, 13:51:15
    2014-04-29 18:03:13,012 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/mapr/pig_1398787393009.log
    2014-04-29 18:03:13,035 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/mapr/.pigbootup not found
    2014-04-29 18:03:13,094 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
    2014-04-29 18:03:13,176 [main] ERROR org.apache.pig.Main - ERROR 2999: Unexpected internal error. Failed to create DataStorage
    Details at logfile: /home/mapr/pig_1398787393009.log

And logfile looks like:

    [mapr@node01 ~]$ cat pig_1398787393009.log
    Error before Pig is launched
    ----------------------------
    ERROR 2999: Unexpected internal error. Failed to create DataStorage
    
    java.lang.RuntimeException: Failed to create DataStorage
            at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:76)
            at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:59)
            at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:215)
            at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:122)
            at org.apache.pig.impl.PigContext.connect(PigContext.java:301)
            at org.apache.pig.PigServer.<init>(PigServer.java:220)
            at org.apache.pig.PigServer.<init>(PigServer.java:205)
            at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:47)
            at org.apache.pig.Main.run(Main.java:538)
            at org.apache.pig.Main.main(Main.java:156)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
    Caused by: java.io.IOException: No FileSystem for scheme: file
            at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1521)
            at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:70)
            at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1558)
            at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1540)
            at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:258)
            at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:129)
            at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:73)
            ... 14 more
    ================================================================================

Does anybody could give me a hint?


Thanks
- puchtec

Outcomes