Kafka Spout ERROR



大家好,希望你做得好!请帮我解决这个错误我什么都不懂我正在使用storm和kafka对hortonworks沙盒进行实时处理,当我部署拓扑结构并用kafka生产者发送数据时,我可以用Kaf卡控制台消费者读取数据,但我在storm UI上遇到了这个错误!

java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V at storm.kafka.DynamicPartitionConnections.register(DynamicPartit

当我查看日志时,我得到了这个

2016-05-11 05:55:47.707 b.s.util [ERROR] Async loop died!
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:47.713 b.s.d.executor [ERROR] 
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:47.749 b.s.util [ERROR] Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
    at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
    at backtype.storm.daemon.worker$fn__7818$fn__7819.invoke(worker.clj:636) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.daemon.executor$mk_executor_data$fn__7078$fn__7079.invoke(executor.clj:256) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:485) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:59.156 b.s.util [ERROR] Async loop died!
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:59.162 b.s.d.executor [ERROR] 
java.lang.NoSuchMethodError: kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;IIILjava/lang/String;Ljava/lang/String;)V
    at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) ~[stormjar.jar:?]
    at storm.kafka.PartitionManager.<init>(PartitionManager.java:66) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[stormjar.jar:?]
    at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[stormjar.jar:?]
    at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:138) ~[stormjar.jar:?]
    at backtype.storm.daemon.executor$fn__7177$fn__7192$fn__7221.invoke(executor.clj:596) ~[storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:475) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]
2016-05-11 05:55:59.195 b.s.util [ERROR] Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
    at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
    at backtype.storm.daemon.worker$fn__7818$fn__7819.invoke(worker.clj:636) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.daemon.executor$mk_executor_data$fn__7078$fn__7079.invoke(executor.clj:256) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at backtype.storm.util$async_loop$fn__544.invoke(util.clj:485) [storm-core-0.10.0.2.4.0.0-169.jar:0.10.0.2.4.0.0-169]
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95]

感谢大家帮助我

检查pom中的堆栈版本和kafka版本。发生这种情况是因为版本不匹配。

最新更新