使用Apache Drill查询S3 bucket时出现NullPointerException

Question

我以以下方式查询带有apache drill的s3存储桶：

0: jdbc:drill:zk=local> use s3;
+-------+---------------------------------+
|  ok   |             summary             |
+-------+---------------------------------+
| true  | Default schema changed to [s3]  |
+-------+---------------------------------+
1 row selected (1.182 seconds)
0: jdbc:drill:zk=local> show tables;
+--+
|  |
+--+
+--+
No rows selected (1.438 seconds)
0: jdbc:drill:zk=local> 

常规select:也会出现同样的情况

0: jdbc:drill:zk=local> select * from s3.`directory/file.csv` limit 10;
oct 28, 2015 11:13:51 AM org.apache.calcite.sql.validate.SqlValidatorException <init>
GRAVE: org.apache.calcite.sql.validate.SqlValidatorException: Table '/denue/DENUE_INEGI_01_.csv' not found
oct 28, 2015 11:13:51 AM org.apache.calcite.runtime.CalciteException <init>
GRAVE: org.apache.calcite.runtime.CalciteContextException: From line 1, column 15 to line 1, column 42: Table '/denue/DENUE_INEGI_01_.csv' not found
Error: PARSE ERROR: From line 1, column 15 to line 1, column 42: Table '/denue/DENUE_INEGI_01_.csv' not found

[Error Id: 560c6ec3-e4b0-4fe3-8b32-fd3fa56e1dd1 on heliodromus:31010] (state=,code=0)

如果我使用select * from目录/file.csv ; ，也会发生同样的情况

我做错了什么？

我的存储插件文件如下：

{
  "type": "file",
  "enabled": true,
  "connection": "s3n://accessKeyId:secretAccesKey@red-queen/",
  "workspaces": {},
  "formats": {
    "psv": {
      "type": "text",
      "extensions": [
        "tbl"
      ],
      "delimiter": "|"
    },
    "csv": {
      "type": "text",
      "extensions": [
        "csv"
      ],
      "delimiter": ","
    },
    "tsv": {
      "type": "text",
      "extensions": [
        "tsv"
      ],
      "delimiter": "t"
    },
    "parquet": {
      "type": "parquet"
    },
    "json": {
      "type": "json"
    },
    "avro": {
      "type": "avro"
    }
  }
}

当accessKeyId和secretAccessKey明显改变时。。。

red-queen是我的s3 bucket，bucket里面是作为文件夹的directory。

Answer 1

请尝试使用backticks和您的目录名：

USE `s3`.`directory`; 
SHOW files; //should list file
SELECT * FROM `filename.extension`;

看看这个Drill pull请求和博客。