无法使用 EMR 步骤在 EMR 中运行 flink 作业

Question

我正在尝试通过 EMR 步骤在纱线会话中提交作业。当我这样做时，我遇到以下错误

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/flink/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Command exiting with ret '1'

你能帮我解决这个问题吗

Step Configuration
Name= Custom jar
Jar location = command-runner.jar
Arguments = flink run -c com.comcast.dhome.xh.timeline.events.ProcessKafkaStream s3://aws-logs-518000940535-us-east-1/dh-xh-event-subscriber.jar --region us-east-1
Action on failure = continue

电子邮箱配置

EMR = 5.15.0
FLINK 1.4.2

Answer 1

您需要在本地下载我们的应用程序 JAR，即aws s3 cp s3://aws-logs-518000940535-us-east-1/dh-xh-event-subscriber.jar .，然后指向本地罐子flink run -c com.comcast.dhome.xh.timeline.events.ProcessKafkaStream dh-xh-event-subscriber.jar --region us-east-1。您不能直接使用放置在 s3 上的文件。