AnsweredAssumed Answered

Should I configure Yarn memory allocation in MapR 6?

Question asked by rbukarev on Mar 1, 2018
Latest reply on Mar 5, 2018 by rbukarev

I'm trying to run two Yarn applications concurrently.

In one of them I've got the setting of 12 executors max, 2G each.

In another, the setting is 10 executors max, 2Gb each.

 

In the default Yarn configuration, I couldn't run two apps at the same time. One of them would hang in "ACCEPTED" state.

Then I added this config to yarn-site.xml:

<!-- YARN CONTAINER ALLOCATION SECTION START-->
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>1024</value>
</property>
<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>64000</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>120000</value>
</property>
<!-- YARN CONTAINER ALLOCATION SECTION START-->

By all means, that should be enough. Yet I still see only one app running at the same time.

Am I missing anything in the Yarn config?

Outcomes