AnsweredAssumed Answered

Failed to initialize mapreduce.shuffle

Question asked by ora_dba on Feb 23, 2016
Latest reply on May 22, 2017 by maprcommunity
Hi all,

I recently attempted to perform an upgrade from version 4.x to 5.x of a MapR cluster environment. It is a sandbox cluster and I was examining the upgrade process. I performed a manual offline upgrade. The component upgrades took place successfully on all nodes.

However - I am having issues with NodeManager now not starting properly on nodes. I have reviewed the upgrade process and checked the output/logs. Any help would be appreciated?

## Error taken from Yarn log
2016-02-23 06:53:36,105 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2240)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:135)

Regards,
RL

Outcomes