我如何才能在CDH 6.3.2中与凯贝罗斯一起运行齐柏林飞船



zeppelin 0.9.0不适用于Kerberos

我添加了">zeppelin.server.kerberos.keytab";以及">齐柏林飞船.服务器.kerberos.主体";在齐柏林飞船网站.xml

但我也犯了错误">客户端无法通过[TOKEN,KERBEROS]进行身份验证;主机详细信息:本地主机为:";bigdser5/10.3.87.27";;目的主机是:";bigdser1":8020";

并添加">火花.纱线.键选项卡">火花.纱线.本金";在spark解释器中,它还不起作用。

在我的spark shell中,它可以与Kerberos 一起工作

我的kerberos步骤

1.admin.local-q";addprinc jzyc/hadoop";

  1. kadmin.local-q〃;xst-k jzyc.keytab jzyc/hadoop@JJKK.COM">

  2. 将jzyc.keytab复制到其他服务器

  3. kinit-kt jzyc.keytab jzyc/hadoop@JJKK.COM

在我的生活中,我得到了错误">javax.servlet.ServletException:org.apache.hadoop.security.authentication.client.AuthenticationException:javax.security.auth.login.login异常:没有要存储的密钥">

INFO [2021-04-15 16:44:46,522] ({dispatcher-event-loop-1} Logging.scala[logInfo]:57) - Got an error when resolving hostNames. Falling back to /default-rack for all
INFO [2021-04-15 16:44:46,561] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Attempting to login to KDC using principal: jzyc/bigdser4@JOIN.COM
INFO [2021-04-15 16:44:46,574] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Successfully logged into KDC.
INFO [2021-04-15 16:44:47,124] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - getting token for: DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346508100_40, ugi=jzyc/bigdser4@JOIN.COM (auth:KERBEROS)]] with renewer yarn/bigdser1@JOIN.COM
INFO [2021-04-15 16:44:47,265] ({FIFOScheduler-interpreter_1099886208-Worker-1} DFSClient.java[getDelegationToken]:700) - Created token for jzyc: HDFS_DELEGATION_TOKEN owner=jzyc/bigdser4@JOIN.COM, renewer=yarn, realUser=, issueDate=1618476287222, maxDate=1619081087222, sequenceNumber=171, masterKeyId=21 on ha-hdfs:nameservice1
INFO [2021-04-15 16:44:47,273] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - getting token for: DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1346508100_40, ugi=jzyc/bigdser4@JOIN.COM (auth:KERBEROS)]] with renewer jzyc/bigdser4@JOIN.COM
INFO [2021-04-15 16:44:47,278] ({FIFOScheduler-interpreter_1099886208-Worker-1} DFSClient.java[getDelegationToken]:700) - Created token for jzyc: HDFS_DELEGATION_TOKEN owner=jzyc/bigdser4@JOIN.COM, renewer=jzyc, realUser=, issueDate=1618476287276, maxDate=1619081087276, sequenceNumber=172, masterKeyId=21 on ha-hdfs:nameservice1
INFO [2021-04-15 16:44:47,331] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Renewal interval is 86400051 for token HDFS_DELEGATION_TOKEN
INFO [2021-04-15 16:44:47,492] ({dispatcher-event-loop-0} Logging.scala[logInfo]:57) - Got an error when resolving hostNames. Falling back to /default-rack for all
INFO [2021-04-15 16:44:47,493] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Scheduling renewal in 18.0 h.
INFO [2021-04-15 16:44:47,494] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Updating delegation tokens.
INFO [2021-04-15 16:44:47,521] ({FIFOScheduler-interpreter_1099886208-Worker-1} Logging.scala[logInfo]:57) - Updating delegation tokens for current user.

INFO[2021-04-23 11:49:29658]({qtp1640639994-103}ManagedEnterpriseGroup.java[getOrCreateSession]:180(-创建会话:解释器组中的shared_Session:用户的md-shared_process:匿名信息[2021-04-23 11:49:29659]({qtp1640639994-103}InterpreterSetting.java[getOrCreateInterpreterGroup]:453(-为ExecutionContext创建组ID为spark-shared_process的解释器组{user='onymous',noteId='2EYUV26VR',interpreterGroupId='ull',defaultInterpreterGroup='park',inIsolatedMode=false,startTime=}信息[2021-04-23 11:49:29659]({qtp1640639994-103}InterpreterSetting.java[createInterpreters]:823(-为用户创建的Interpreter org.apache.zeppelin.spark.ParkInterpreter:匿名,sessionId:shared_session

但我启用shiro.ini

在spark.jars 中

你需要hdfs://bigdser1:8020/sparklib/tispark-组件2.3.14.jar

不是

hdfs://bigdser1:8020/sparklib/*

最新更新