嗨,我有一个简单的创建表语句...
set location_stage=${env:HDFS_STAGING_DIR};
CREATE EXTERNAL TABLE IF NOT EXISTS stage.test(
TEST_ID INT,
TEST_NAME STRING
)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
WITH SERDEPROPERTIES (
"separatorChar" = ",",
"quoteChar" = """,
"escapeChar" = "\")
STORED AS TEXTFILE
LOCATION "${hivevar:location_stage}";
我不需要'hivevar:location_stage' - 我只需要'env:hdfs_staging_dir'。但是,都没有工作。我在"位置"子句中使用了这两个。我都用命令行
运行hive -f test_hive_variable.sql
但是我会收到以下错误...
FAILED: IllegalArgumentException java.net.URISyntaxException: Relative path in absolute URI: ${hivevar:location_stage%7D
Hive版本为Hive 1.2.1000.2.4.2.0-258
您的脚本可以:
CREATE EXTERNAL TABLE IF NOT EXISTS stage.test(
TEST_ID INT,
TEST_NAME STRING
)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
WITH SERDEPROPERTIES (
"separatorChar" = ",",
"quoteChar" = """,
"escapeChar" = "\")
STORED AS TEXTFILE
LOCATION "${HDFS_STAGING_DIR}";
然后通过HDFS_STAGING_DIR
,您可以使用:
hive -f test_hive_variable.hql --hivevar HDFS_STAGING_DIR="/user/hive/warehouse/staging_dir"