AnsweredAssumed Answered

Map tasks can't see classes within M/R .jar file

Question asked by thealy on Oct 1, 2012
Latest reply on Oct 4, 2012 by gera
When I submit my Map/Reduce job from the command line with:

    hadoop jar  /home/xxxx/java/JC3Cron/dist/JC3Cron.jar -Djava.library.path=/opt/mapr/hadoop/hadoop-0.20.2/lib/native/Linux-amd64-64

The job starts but all the Mapper tasks fail with:

    java.lang.ClassNotFoundException: xxx.yyy.cs.jc3cron.JC3Cron$KeyComparator

Yet this class is contained in JCCron.jar as shown by jar -tvf:

    Mon Oct 01 13:58:26 EDT 2012 xxx/yyy/cs/jc3cron/JC3Cron$KeyComparator.class

Why are the nodes not able to see the classes within the main .jar file?

Outcomes