AnsweredAssumed Answered

Can't run PIG, "Backend error : Usage threshold is not supported"

Question asked by warl0ck on Sep 8, 2013
Latest reply on Sep 15, 2013 by nabeel
Hi,

I'm running PIG 0.7.0, Hadoop Client 0.20.2-cdh3u4, and I'm running a simple script:

    A = load 'input/passwd';
    dump A;

Then I got the following error,

    Backend error message
    ---------------------
    Error: java.lang.UnsupportedOperationException: Usage threshold is not supported
     at sun.management.MemoryPoolImpl.setUsageThreshold(MemoryPoolImpl.java:95)
     at org.apache.pig.impl.util.SpillableMemoryManager.<init>(SpillableMemoryManager.java:130)
     at org.apache.pig.impl.util.SpillableMemoryManager.getInstance(SpillableMemoryManager.java:135)
     at org.apache.pig.data.BagFactory.<init>(BagFactory.java:123)
     at org.apache.pig.data.DefaultBagFactory.<init>(DefaultBagFactory.java:69)
     at org.apache.pig.data.BagFactory.getInstance(BagFactory.java:81)
     at org.apache.pig.data.BinInterSedes.<clinit>(BinInterSedes.java:124)
     at org.apache.pig.data.InterSedesFactory.getInterSedesInstance(InterSedesFactory.java:36)
     at org.apache.pig.impl.io.InterRecordWriter.<clinit>(InterRecordWriter.java:41)
     at org.apache.pig.impl.io.InterStorage$InterOutputFormat.getRecordWriter(InterStorage.java:143)
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
     at org.ap
    
    Pig Stack Trace
    ---------------
    ERROR 1066: Unable to open iterator for alias B. Backend error : Usage threshold is not supported
    
    org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias B. Backend error : Usage threshold is not supported
     at org.apache.pig.PigServer.openIterator(PigServer.java:826)
     at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:696)
     at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:320)
     at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
     at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
     at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
     at org.apache.pig.Main.run(Main.java:475)
     at org.apache.pig.Main.main(Main.java:157)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     at java.lang.reflect.Method.invoke(Method.java:597)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
    Caused by: java.lang.UnsupportedOperationException: Usage threshold is not supported
     at sun.management.MemoryPoolImpl.setUsageThreshold(MemoryPoolImpl.java:95)
     at org.apache.pig.impl.util.SpillableMemoryManager.<init>(SpillableMemoryManager.java:130)
     at org.apache.pig.impl.util.SpillableMemoryManager.getInstance(SpillableMemoryManager.java:135)
     at org.apache.pig.data.BagFactory.<init>(BagFactory.java:123)
     at org.apache.pig.data.DefaultBagFactory.<init>(DefaultBagFactory.java:69)
     at org.apache.pig.data.BagFactory.getInstance(BagFactory.java:81)
     at org.apache.pig.data.BinInterSedes.<clinit>(BinInterSedes.java:124)
     at org.apache.pig.data.InterSedesFactory.getInterSedesInstance(InterSedesFactory.java:36)
     at org.apache.pig.impl.io.InterRecordWriter.<clinit>(InterRecordWriter.java:41)
     at org.apache.pig.impl.io.InterStorage$InterOutputFormat.getRecordWriter(InterStorage.java:143)
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
    ================================================================================

Any ideas? The server is running fine.

Outcomes