AnsweredAssumed Answered

Capture job metrics/counter for the completed jobs.

Question asked by lovehasija on Jul 21, 2014
Latest reply on Jul 23, 2014 by aaron

I have written an application that captures the job metrics/counters from the job tracker at regular intervals. It also captures the aggregated counters at the end of the job, when the job gets completed.

The application was all running well with the Cloudera, but as I migrated to MapR, it is not collecting the metrics from the completed jobs, as the job is  immediately moved to the retired state. Please suggest the solution for this.

P.S: I am using the JobSubmissionProtocol to capture the metrics, and I don't have the admin access to the cluster to change the configuration. Also, this would rule out the possibility of using a plugin to get intra-process callbacks of the job completion event.