AnsweredAssumed Answered

hitting java.util.concurrent.RejectedExecutionException

Question asked by sorenmacbeth on Dec 21, 2012
Latest reply on Jan 2, 2013 by yufeldman
I'm getting the following exception trying to run one of my jobflow on EMR using M3. I noticed that yeasterday a new AMI version was released and the version of mapr is used (1.2.8 previously and 2.1.2 now).
<pre>
cascading.flow.FlowException: unhandled exception
  at cascading.flow.BaseFlow.complete(BaseFlow.java:840)
  at cascalog.api$_QMARK__.doInvoke(api.clj:205)
  at clojure.lang.RestFn.invoke(RestFn.java:436)
  at ybot.analytics.sinookas.jobs.durations$_main$fn__10144$fn__10171.invoke(durations.clj:244)
  at cascalog.checkpoint$mk_runner$fn__7327.invoke(checkpoint.clj:60)
  at clojure.lang.AFn.run(AFn.java:24)
  at java.lang.Thread.run(Thread.java:662)
Caused by: java.util.concurrent.RejectedExecutionException
  at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:1768)
  at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:767)
  at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:658)
  at java.util.concurrent.AbstractExecutorService.invokeAll(AbstractExecutorService.java:200)
  at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:336)
  at cascading.tap.hadoop.io.MultiInputFormat.getSplits(MultiInputFormat.java:196)
  at cascading.tap.hadoop.io.MultiInputFormat.getSplits(MultiInputFormat.java:139)
  at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:1060)
  at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1052)
  at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:173)
  at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:934)
  at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:885)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:396)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
  at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:885)
  at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:859)
  at cascading.flow.hadoop.planner.HadoopFlowStepJob.internalNonBlockingStart(HadoopFlowStepJob.java:104)
  at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:174)
  at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
  at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
  at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
  at java.util.concurrent.FutureTask.run(FutureTask.java:138)
  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  ... 1 more

Outcomes