AnsweredAssumed Answered

Pig and Amazon EMR

Question asked by ray_harrison on Jan 31, 2014
Latest reply on Feb 1, 2014 by ray_harrison
I'm looking to use the EMR variant of MAPR and am having trouble with migrating my pig scripts from amazon's vanilla (but more recent) version of hadoop. I believe the pig versions are the same. Running pig seems to want to point to hadoop2.x libraries. In what way can I ensure the correct libraries get called? I tried setting PIG_HADOOP_VERSION to 103 (not sure if this correct), but to no avail.

Stack snippet:
Caused by: java.lang.RuntimeException: Could not resolve error that occured when launching map reduce job: java.lang.RuntimeException: java.lang.ref
lect.InvocationTargetException
at org.apache.pig.backend.**hadoop20**.PigJobControl.mainLoopAction(PigJobControl.java:159)
at org.apache.pig.backend.**hadoop20**.PigJobControl.run(PigJobControl.java:134)
at java.lang.Thread.run(Thread.java:724)

Outcomes