apache storm - not able to read from kafka using strom cluster -


i running strom cluster 2 supervisor , 1 nimbus running. reading kafka topic id "topic1". on ui getting below error

java.lang.runtimeexception: java.lang.runtimeexception: org.apache.zookeeper.keeperexception$nonodeexception: keepererrorcode = nonode /brokers/topics/topic1/partitions @ storm.kafka.dynamicbrok

and worker_*.log showing below error.

java.io.filenotfoundexception: file '/app/storm/supervisor/stormdist/airpushtop-1-1431081661/stormconf.ser' not exist @ org.apache.commons.io.fileutils.openinputstream(fileutils.java:299) ~[commons-io-2.4.jar:2.4] @ org.apache.commons.io.fileutils.readfiletobytearray(fileutils.java:1763) ~[commons-io-2.4.jar:2.4] @ backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212) ~[storm-core-0.9.4.jar:0.9.4] @ backtype.storm.daemon.worker$worker_data.invoke(worker.clj:182) ~[storm-core-0.9.4.jar:0.9.4] @ backtype.storm.daemon.worker$fn__5033$exec_fn__1754__auto____5034.invoke(worker.clj:398) ~[storm-core-0.9.4.jar:0.9.4] @ clojure.lang.afn.applytohelper(afn.java:185) [clojure-1.5.1.jar:na] @ clojure.lang.afn.applyto(afn.java:151) [clojure-1.5.1.jar:na] @ clojure.core$apply.invoke(core.clj:617) ~[clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker$fn__5033$mk_worker__5089.doinvoke(worker.clj:389) [storm-core-0.9.4.jar:0.9.4] @ clojure.lang.restfn.invoke(restfn.java:512) [clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker$_main.invoke(worker.clj:500) [storm-core-0.9.4.jar:0.9.4] @ clojure.lang.afn.applytohelper(afn.java:172) [clojure-1.5.1.jar:na] @ clojure.lang.afn.applyto(afn.java:151) [clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker.main(unknown source) [storm-core-0.9.4.jar:0.9.4] 2015-05-08t17:09:19.209+0530 b.s.util [error] halting process: ("error on initialization") java.lang.runtimeexception: ("error on initialization") @ backtype.storm.util$exit_process_bang_.doinvoke(util.clj:325) [storm-core-0.9.4.jar:0.9.4] @ clojure.lang.restfn.invoke(restfn.java:423) [clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker$fn__5033$mk_worker__5089.doinvoke(worker.clj:389) [storm-core-0.9.4.jar:0.9.4] @ clojure.lang.restfn.invoke(restfn.java:512) [clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker$_main.invoke(worker.clj:500) [storm-core-0.9.4.jar:0.9.4] @ clojure.lang.afn.applytohelper(afn.java:172) [clojure-1.5.1.jar:na] @ clojure.lang.afn.applyto(afn.java:151) [clojure-1.5.1.jar:na] ava.lang.runtimeexception: java.lang.runtimeexception: org.apache.zookeeper.keeperexception$nonodeexception: keepererrorcode = nonode /brokers/topics/topic1/partitions @ storm.kafka.dynamicbrokt backtype.storm.daemon.worker.main(unknown source) [storm-core-0.9.4.jar:0.9.4]

i using kafka_2.11-0.8.2.1, apache-storm-0.9.4 , zookeeper-3.4.6.

there no mismatch zookeeper jar version in kafka , cluster.

please me here.

many in advance.

did make sure topic1 exists in kafka , can read using console consumer, have seen org.apache.zookeeper.keeperexception$nonodeexception: keepererrorcode = nonode ... when topic did not exist when storm topology deployed.

also can post code on how have configured kafka spout ?

is error sporadic or consistent?


Comments