Running Kafka consumer

[stephenlee86]

Consumer and producer benchmarks were executed on different nodes.
The producer benchmark executes fine but the consumer benchmark doesn't halt or show any output. I reduced the message limit but that doesnt have any impact. Any idea?

Below is the output.

kafka-benchmark# kafka-benchmark consumer config/base_consumer.yaml 10B_100MB

kafka-benchmark# kafka-benchmark producer config/base_producer.yaml 10B_bursts
Scenario: 10B_bursts, repeat 5 times, 10 seconds pause after each
* Produced 20000000 messages (190.735 MB) in 17.409 seconds using 6 threads
    1148831 messages/s
    10.956 MB/s
* Produced 20000000 messages (190.735 MB) in 17.135 seconds using 6 threads
    1167202 messages/s
    11.131 MB/s
* Produced 20000000 messages (190.735 MB) in 17.563 seconds using 6 threads
    1138758 messages/s
    10.860 MB/s
* Produced 20000000 messages (190.735 MB) in 17.238 seconds using 6 threads
    1160227 messages/s
    11.065 MB/s
* Produced 20000000 messages (190.735 MB) in 17.135 seconds using 6 threads
    1167202 messages/s
    11.131 MB/s
Average: 1156323 messages/s, 11.028 MB/s

[stephenlee86]

The command line consumer doesnt work when I provide the broker list. Fixing this issue will probably fix the problem.

./kafka-console-consumer.sh   --bootstrap-server kafka0:9092  --topic my-topic    --from-beginning (this doesn't work).
./kafka-console-consumer.sh   --zookeeper zookeeper0:2181   --topic my-topic    --from-beginning (this works)