Kafdrop-无法使用bitnami/Kafka连接到Kafka群集设置



我使用bitnami kafka和zookeeper设置了一个kafka集群,我想使用kafdrop查看这个集群或至少一个代理。我使用docker compose来构建所有组件。我最初遵循了本教程,然后在docker-compose.yml 中添加了kafdrop配置

version: '2'
networks:
kafka-net:
driver: bridge
services:
zookeeper-server:
image: 'bitnami/zookeeper:latest'
networks:
- kafka-net
ports:
- '2181:2181'
environment:
- ALLOW_ANONYMOUS_LOGIN=yes
kafdrop:
image: obsidiandynamics/kafdrop
networks:
- kafka-net
restart: "no"
ports:
- "9000:9000"
environment:
KAFKA_BROKERCONNECT: "PLAINTEXT://localhost:9092,PLAINTEXT://localhost:9093,PLAINTEXT://localhost:9094"
JVM_OPTS: "-Xms16M -Xmx48M -Xss180K -XX:-TieredCompilation -XX:+UseStringDeduplication -noverify"
depends_on:
- "kafka-server1"
- "kafka-server2"
- "kafka-server3"
kafka-server1:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9092:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9092
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server2:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9093:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9093
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server3:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9094:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9094
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server

我的主要问题是kafdrop总是抛出这个错误:

020-08-26 10:53:53.517  WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient                    : [AdminClient clientId=kafdrop-admin] Connection to node -3 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-08-26 10:53:53.522  WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient                    : [AdminClient clientId=kafdrop-admin] Connection to node -2 (localhost/127.0.0.1:9093) could not be established. Broker may not be available.
2020-08-26 10:53:53.526  WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient                    : [AdminClient clientId=kafdrop-admin] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2020-08-26 10:53:53.627  WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient                    : [AdminClient clientId=kafdro

我尝试过用ff值更改KAFKA_BROKERCONNECT的值,但都没有成功。

  • PLAINTEXT://localhost:9092,PLAINTEXT//localhost:9093,PLAINTEXT://localhost:99094
  • localhost:9092,localhost:9093,localhost:9904
  • PLAINTEXT://kafka-server1:9092,PLAINTEXT//kafka_server2:9093,PLAINTEXT://kafka-server3:9094
  • 卡夫卡服务器1:9092、卡夫卡服务器2:9093和卡夫卡服务器3:9094

我实际上只是在猜测正确的配置语法,所以任何关于这个的解释都很感激:(。

此外,是否需要在kafdrop配置中添加networks属性?Kafdrop有一个示例docker组合文件,而这个文件没有网络配置,所以我想知道为什么/是否需要network

您的第二种方式是正确的方式。也适用于我不确定是否有必要的KAFKA_CFG_ADVERTISED_LISTENERS变量。您只需要确保使用正确的端口。这应该很好:

version: '2'
networks:
kafka-net:
driver: bridge
services:
zookeeper-server:
image: 'bitnami/zookeeper:latest'
networks:
- kafka-net
ports:
- '2181:2181'
environment:
- ALLOW_ANONYMOUS_LOGIN=yes
kafdrop:
image: obsidiandynamics/kafdrop
networks:
- kafka-net
restart: "no"
ports:
- "9000:9000"
environment:
KAFKA_BROKERCONNECT: "PLAINTEXT://kafka-server1:9092,PLAINTEXT://kafka-server2:9092,PLAINTEXT://kafka-server3:9092"
JVM_OPTS: "-Xms16M -Xmx48M -Xss180K -XX:-TieredCompilation -XX:+UseStringDeduplication -noverify"
depends_on:
- "kafka-server1"
- "kafka-server2"
- "kafka-server3"
kafka-server1:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9092:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server2:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9093:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server3:
image: 'bitnami/kafka:latest'
networks:
- kafka-net    
ports:
- '9094:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server

最新更新