配置单元LLAP抛出无法处理容器端口映射



我正试图让配置单元LLAP在我的服务器上运行。

到目前为止,我的设置是:Hadoop 3.31、tez 0.9.2、hive 3.1.2、zookeper 3.7.0,所有这些都来自tar文件。

泰兹的蜂巢正在工作。选择返回预期结果。

现在我想让LLAP运行,所以我设置了配置文件,并用生成了脚本

hive --service llap --name llap0 --instances 2 --size 6g --loglevel DEBUG --cache 2g --executors 2

纱线应用程序已成功启动,但在应用程序日志中显示:

2021-11-29 13:21:46,390 [pool-5-thread-2] WARN  instance.ComponentInstance - Unable to process container ports mapping: {}
com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
at [Source: (String)""; line: 1, column: 0]
at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4360)
at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4205)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3214)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3197)
at org.apache.hadoop.yarn.service.component.instance.ComponentInstance.updateContainerStatus(ComponentInstance.java:881)
at org.apache.hadoop.yarn.service.component.instance.ComponentInstance$ContainerStatusRetriever.run(ComponentInstance.java:1069)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

所以服务正在启动容器,但我无法连接到它。

是否缺少任何选项,或者在哪里设置端口映射?

问题的直接解决方案:在Hadoop 上设置LLAP

在这里,它讨论了如何在Hadoop集群上设置HiveLLAP来消除这些问题。

最新更新