Default.fs.name和hive.metastore.warehouse.dir不冲突

Question

嗨，当我尝试运行以下命令

Load data Inpath '/data' into Table Tablename;

在hive shell中抛出以下错误

Move from: hdfs://hadoopcluster/data to: file:/user/hive/warehouse/Tablename is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.

我的default.fs.name属性是

<property>
 <name>fs.defaultFS</name>
 <value>hdfs://hadoopcluster</value>
 </property>

where my hive.metastore.warehouse.dir

 <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>/user/hive/warehouse</value>
    <description>location of default database for the warehouse</description>
  </property>

有谁能帮我一下吗?

Answer 1

这是因为您的hive metastore使用的是"本地"存储位置/user/hive/warehouse，与默认fs(每个hive)冲突。

你的意思是使用"本地"存储，还是HDFS?

要使用HDFS作为Hive metastore设置，您需要指定该存储的完整HDFS URI:

hdfs://hadoopcluster/user/hive/warehouse