AnsweredAssumed Answered

Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.

Question asked by brianjohnson on Mar 23, 2014
> Backend error message
> --------------------- Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES;
> bailing-out.
>
> Pig Stack Trace
> --------------- ERROR 2997: Unable to recreate exception from backed error:
> Shuffle Error: Exceeded
> MAX_FAILED_UNIQUE_FETCHES;
> bailing-out.
>
> org.apache.pig.impl.logicalLayer.FrontendException:
> ERROR 1066: Unable to open iterator
> for alias user_impression_counts.
> Backend error : Unable to recreate
> exception from backed error: Shuffle
> Error: Exceeded
> MAX_FAILED_UNIQUE_FETCHES;
> bailing-out.  at
> org.apache.pig.PigServer.openIterator(PigServer.java:870)
>  at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
>  at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
>  at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
>  at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
>  at
> org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
>  at
> org.apache.pig.Main.run(Main.java:509)
>  at
> org.apache.pig.Main.main(Main.java:156)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at
> java.lang.reflect.Method.invoke(Method.java:606)
>  at
> org.apache.hadoop.util.RunJar.main(RunJar.java:197)
> Caused by:
> org.apache.pig.backend.executionengine.ExecException:
> ERROR 2997: Unable to recreate
> exception from backed error: Shuffle
> Error: Exceeded
> MAX_FAILED_UNIQUE_FETCHES;
> bailing-out.  at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:217)
>  at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:155)
>  at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:437)
>  at
> org.apache.pig.PigServer.launchPlan(PigServer.java:1322)
>  at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1307)
>  at
> org.apache.pig.PigServer.storeEx(PigServer.java:978)
>  at
> org.apache.pig.PigServer.store(PigServer.java:942)
>  at
> org.apache.pig.PigServer.openIterator(PigServer.java:855)
>  ... 12 more

Outcomes