AnsweredAssumed Answered

How to collect job metrics in MRv2

Question asked by nani on Jul 20, 2015
Latest reply on Jul 21, 2015 by Hao Zhu
Hi MapR team,
We know that metrics db is not supported for MRv2 applications. In MRv1,  job_metrics are stored in metrics db(my sql) and we query the database to get the job_metrics info.. Now, in YARN we are not sure where the job_metrics are stored and how to get the statistics for the same. I see job history server has API but couldn't find the location of metrics on disk. Even documentation doesn't provide this information.

Is there a way where we can collect job metrics (job_id, userid, query, start time, end time etc., )
Any help is appreciated.

Thanks in advance
n@n!
 

Outcomes