AnsweredAssumed Answered

Input path does not exist: maprfs:

Question asked by mapr123 on Sep 3, 2013
Latest reply on Sep 3, 2013 by mapr123
Hello.

I am trying to run a WordCount MR job (the one from Apache, not that comes with the MAPR install).
I added in my data files via NFS. I am getting the error "InvalidInputException: Input path does not exist: maprfs:/maprmountpoint/LARGEDATA/1992".
Not sure what the problem is? Any ideas?

Thanks,
Brian


[root LARGEDATA]#  hadoop jar wordcount.jar WordCount /maprmountpoint/LARGEDATA/* /maprmountpoint/LARGEDATA_OUTPUT/run1


13/09/03 14:09:27 INFO fs.JobTrackerWatcher: Current running JobTracker is: gullett.mitre.osis.gov/192.168.127.122:9001
13/09/03 14:09:27 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/09/03 14:09:27 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
13/09/03 14:09:27 INFO mapred.JobClient: Cleaning up the staging area maprfs:/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201308261533_0009
Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: maprfs:/maprmountpoint/LARGEDATA/1992
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:248)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:273)
        at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1033)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1050)
        at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:173)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:934)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:885)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:885)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:573)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:603)
        at WordCount.main(WordCount.java:58)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:197)



-----------------------------------
pwd is "/maprmountpoint/"
drwxrwxrwx 14 root mapr 12 Sep  3 13:37 LARGEDATA
drwxrwxrwx  5 root mapr  3 Sep  3 13:39 LARGEDATA_OUTPUT

--------------------------
Input Files (all are root:mapr with 777)

[root LARGEDATA]# ls -l
total 33
drwxrwxrwx 2 root mapr 1367 Sep  3 13:35 1992


Output Files (all are root:mapr with 777)

[root LARGEDATA_OUTPUT]# ls -lrt
total 0
drwxrwxrwx 2 root mapr 0 Sep  3 13:39 run1

Outcomes