启用 DSE 统一身份验证后"DSE 火花"失败



i将DSE更新为5.1.2,并启用了DSE统一身份验证。

当我运行" dse -u xxx -p xxx spark"时,我会得到一个外壳,但是如果我使用" spark.sql"提交查询,我会收到错误:

scala> val result = spark.sql("SELECT id FROM xxx.yyy")
java.lang.RuntimeException: com.datastax.bdp.fs.client.InternalServerException: Server returned HTTP error response  500 (Internal Server Error)
Caused by: com.datastax.bdp.fs.client.InternalServerException: Server returned HTTP error response  500 (Internal Server Error)
  at com.datastax.bdp.fs.client.DseFsClient$stateMachine$macro$1$1.apply(DseFsClient.scala:132)

in/var/log/cassandra/system.log我看到:

WARN  [Native-Transport-Requests-2] 2017-08-31 12:05:29,057  DseAuthenticator.java:659 - Plain text authentication without client / server encryption is strongly discouraged
ERROR [dsefs-netty-worker-4] 2017-08-31 12:05:29,842 DSEFS RestServerHandler.scala:287 - [id: 0x1810ea2d, L:/10.225.155.31:5598 - R:/10.225.155.31:58006] RestHandler invocation failed
java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried)
    at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) ~[guava-18.0.jar:na]
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried)

任何想法如何解决此问题。顺便说一句,DSE Spark-Submit可以工作...

通过在dse.yaml中启用dsef。

解决了问题。