Kafka Kubernetes:'0'不符合偏移量主题所需的复制因子'1'的活动代理数量



我试图在Kubernetes中设置一个Kafka pod,但我一直收到这个错误:

[2020-08-30 11:23:39,354] ERROR [KafkaApi-0] Number of alive brokers '0' does not meet the required replication factor '1' for the offsets topic (configured via 'offsets.topic.replication.factor'). This error can be ignored if the cluster is starting up and not all brokers are up yet. (kafka.server.KafkaApis)

这是我的Kafka部署:

apiVersion: apps/v1
kind: Deployment
metadata:
name: kafka
namespace: instagnam
labels:
app: instagnam
service: kafka
spec:
replicas: 1
selector:
matchLabels:
app: instagnam
template:
metadata:
labels:
app: instagnam
service: kafka
id: "0"
spec:
containers:
- name: kafka
image: wurstmeister/kafka
imagePullPolicy: Always
ports:
- containerPort: 9092
name: kafka
env:
- name: KAFKA_PORT
value: "9092"
- name: KAFKA_ADVERTISED_PORT
value: "9092"
- name: KAFKA_ADVERTISED_HOST_NAME
value: kafka
- name: KAFKA_ZOOKEEPER_CONNECT
value: zookeeper:2181
- name: KAFKA_CREATE_TOPICS
value: connessioni:2:1,ricette:2:1
- name: KAFKA_BROKER_ID
value: "0"

这是我的Kafka服务:

apiVersion: v1
kind: Service
metadata:
name: kafka
namespace: instagnam
labels:
app: instagnam
service: kafka
spec:
selector:
app: instagnam
service: kafka
id: "0"
type: LoadBalancer
ports:
- name: kafka
protocol: TCP
port: 9092

这是我的动物园管理员部署:

apiVersion: apps/v1
kind: Deployment
metadata:
name: zookeeper
namespace: instagnam
labels:
app: instagnam
service: zookeeper
spec:
replicas: 1
selector:
matchLabels:
app: instagnam
service: zookeeper
template:
metadata:
labels:
app: instagnam
service: zookeeper
spec:
containers:
- image: wurstmeister/zookeeper
name: zookeeper
imagePullPolicy: Always
ports:
- containerPort: 2181
env:
- name: ZOOKEEPER_ID
value: "1"
- name: ZOOKEEPER_SERVER_1
value: zookeeper

这是我的动物园管理员服务:apiVersion:v1

kind: Service
metadata:
name: zookeeper
namespace: instagnam
spec:
selector:
app: instagnam
service: zookeeper
ports:
- name: client
protocol: TCP
port: 2181
- name: follower
protocol: TCP
port: 2888
- name: leader
protocol: TCP
port: 3888

我在这里做错了什么?

如果您需要完整的Kafka日志,它是:https://pastebin.com/eBu8JB8A

如果你也需要的话,还有Zookeper日志:https://pastebin.com/gtnxSftW

编辑:如果可以的话,我会在minikube上运行这个。

Kafka broker.id的更改可能会导致此问题。清理zk下的kafka元数据,deleteall/brokers。。。注意:kafka数据将丢失

假设您在同一个Kafka映像上。为我解决问题的解决方案是:

替换docker镜像README中详细介绍的KAFKA_ADVERTISED_PORTKAFKA_ADVERTISED_HOST_NAME的弃用设置,请参阅当前文档(或固定的README提交(。对于CCD_ 3和CCD_;内部";以及";外部";配置。

摘要来自https://github.com/wurstmeister/kafka-docker/issues/218#issuecomment-362327563

最新更新