Hadoop:NameNode、DataNode 和 SecondaryNameNode 未运行



我正在尝试使用本教程 http://codesfusion.blogspot.gr/2013/10/setup-hadoop-2x-220-on-ubuntu.html?m=1 在计算机上的单节点群集上安装 Hadoop 2.2.0。我一步一步地遵循我看到的每一条指令,但我每次都遇到同样的问题。NameNode 、DataNode 和 SecondaryNameNode 未运行。当我输入 start-dfs.sh 、 start-yarn.sh 和 jps 时,我看到的消息是:

hduser@victor-OEM:/usr/local/hadoop/sbin$ start-dfs.sh
Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.
Starting namenodes on []
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-victor-OEM.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-victor-OEM.out
Starting secondary namenodes [0.0.0.0]
The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established.
ECDSA key fingerprint is 62:ec:99:e3:ce:2d:f8:79:1f:f8:9a:2a:25:9d:17:95.
Are you sure you want to continue connecting (yes/no)? yes
0.0.0.0: Warning: Permanently added '0.0.0.0' (ECDSA) to the list of known hosts.
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-victor-OEM.out
hduser@victor-OEM:/usr/local/hadoop/sbin$ start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn-hduser-resourcemanager-victor-OEM.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-victor-OEM.out
hduser@victor-OEM:/usr/local/hadoop/sbin$ jps
10684 NodeManager
10745 Jps
10455 ResourceManager

你可以试试这个链接:Leraning hadoop。 它适用于 0.23.9,但也适用于 2.2.0

某些版本的代码融合教程(例如此版本)省略了代码块中的 xml 标记,以便:

#add this to foo.txt   
<bizz>bar</bizz>

成为:

#add this to foo.txt
bar

在配置中包含 xml 标记解决了该问题。

在 hadoop-env.sh 中禁用 IPv6:

export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true

我遇到了同样的问题。

我通过禁用防火墙解决了它。

只需使用此命令

sudo ufw disbale 

我尝试了以下步骤:

  1. ssh-keygen -t rsa -P "

  2. cat $HOME/.ssh/id_rsa.pub>> $HOME/.ssh/authorized_keys

之后,打开一个新终端并启动Hadoop集群,这解决了我的问题。

最新更新