Hadoop节点管理器不启动,从属不满足最小分配



运行start-all.sh时,我的slave1和slave2在jps 中找不到节点管理器

使用虚拟机虚拟盒在Ubuntu 16.04上工作主

yunchi@master:~$ jps
15920 Jps
15505 SecondaryNameNode
15659 ResourceManager
15293 NameNode

从1

yunchi@slave1:~$ jps
7587 DataNode
7945 Jps

从2

yunchi@slave2:~$ jps
7138 DataNode
7374 Jps

这是我的节点管理器slave1.log

2017-10-12 17:26:59662错误org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl:启动NodeStatusUpdate时出现意外错误org.apache.hadoop.yarn.exceptions.YarnRuntimeException:收到来自Resourcemanager的SHUTDOWN信号,NodeManager注册失败,来自Resourcemanager消息:来自slave1的NodeManager不满足最小分配,正在向NodeManager发送SHUTDOWN信号。位于org.apache.hoop.syar.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:278)位于org.apache.hadop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197)网址:org.apache.hoop.service.AbstractService.start(AbstractService.java:193)网址:org.apache.hoop.service.CompositeService.serviceStart(CompositeService.java:120)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.serviceStart(nodemanager.java:272)网址:org.apache.hoop.service.AbstractService.start(AbstractService.java:193)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.initAndStartNodeManager(nodemanager.java:496)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.main(nodemanager.java:543)

2017-10-12 17:26:59710 FATAL org.apache.hadoop.yarn.server.nodemanager.nodemanager:启动nodemanager时出错org.apache.hadoop.yarn.exceptions.YarnRuntimeException:org.apache.hodoop.yar.exceptions.YanRuntimeException:接收到来自Resourcemanager的SHUTDOWN信号,NodeManager注册失败,来自Resourcemanager消息:来自slave1的NodeManager不满足最小分配,正在向NodeManager发送SHUTDOWN信号。位于org.apache.hadop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:203)网址:org.apache.hoop.service.AbstractService.start(AbstractService.java:193)网址:org.apache.hoop.service.CompositeService.serviceStart(CompositeService.java:120)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.serviceStart(nodemanager.java:272)网址:org.apache.hoop.service.AbstractService.start(AbstractService.java:193)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.initAndStartNodeManager(nodemanager.java:496)网址:org.apache.hadop.yarn.server.nodemanager.nodemanager.main(nodemanager.java:543)引起原因:org.apache.hadoop.yarn.exceptions.YarnRuntimeException:收到来自Resourcemanager的SHUTDOWN信号,NodeManager注册失败,来自Resourcemanager消息:来自slave1的NodeManager不满足最小分配,正在向NodeManager发送SHUTDOWN信号。位于org.apache.hoop.syar.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:278)位于org.apache.hadop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197)…还有6个

我找到了一些相关信息。他们告诉我添加

<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>1024</value>
</property>

但它仍然不起作用。

所以,我设置值4096,仍然不能工作

这是下面的我的yarn-site.xml

<configuration>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>master</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>master:8032</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>master:8030</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>master:8031</value>
</property>
<property>
<name>yarn.resourcemanager.admin.address</name>
<value>master:8033</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>master:8088</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>4096</value>
</property>
<property>
<name>yarn.nodemanager.local-dirs</name>
<value>/home/yunchi/yarn</value>
<final>true</final>
</property>

<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>1</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-vcores</name>
<value>1</value>
</property>

也许您的虚拟机没有足够的资源。所以不应该增加参数yarn.nodemanager.resource.memory-mb的值,因为没有资源。请尝试为此参数设置较小的值,例如256 MB。

查看此帖子。

相关内容

  • 没有找到相关文章

最新更新