AnsweredAssumed Answered

What files should be same in /opt/mapr/hadoop/hadoop-<version>/etc/hadoop/ across cluster

Question asked by reedv on Jun 7, 2018
Latest reply on Jun 9, 2018 by bgajjela

Recently install mapr-client on an edge node and in looking at the directory /opt/mapr/hadoop/hadoop-<version>/etc/hadoop/ and notice that the files core-site.xml, yarn-site.xml, and mapred-site/xml look different on the client than they do on the rest of the cluster (hybrid nodes). At this point I would think that I should just copy these config files from one of the existing nodes, but I find that some nodes even differ in the contents of these files, eg.

[root@mapr001 groups.d]# clush -ab cat /opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop/core-site.xml

---------------
mapr[001-003] (3)
---------------
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

<property>
<name>hadoop.proxyuser.mapr.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.mapr.groups</name>
<value>*</value>
</property>
</configuration>


---------------
mapr[005-006] (2)
---------------
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

</configuration>


---------------
mapr004
---------------
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

<property>
<name>hbase.table.namespace.mappings</name>
<value>*:/</value>
</property>
<property>
<name>hadoop.proxyuser.mapr.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.mapr.groups</name>
<value>*</value>
</property>
</configuration>

 

So basically I think I need some guidance here as to what the client node config files are supposed to look like. Does anyone know how this is supposed to go?

 

** Also, is it weird that some config files are different across internal/data/control/hybrid nodes? Which should look exactly the same if any? 

Outcomes