我用Mirrormaker 2从集群a复制主题到集群B有一个问题。我想从最近的偏移量复制这些主题,而不是从一开始复制它们。但是当我设置auto.offset.reset=latest
时,什么都没有发生,复制仍然从主题开始而不是结束。我设置错了吗?
这是我的整个MM2配置:
clusters = A, B
A.bootstrap.servers = broker-01A:9092
B.bootstrap.servers = broker-01B:9092,broker-02B:9092,broker-03B:9092
replication.policy.class = org.apache.kafka.connect.mirror.IdentityReplicationPolicy
#Enable replication between clusters and define topics which should be replicated
A->B.enabled = true
A->B.topics = .*
A->B.replication.factor=3
A->B.emit.heartbeats.enabled = true
A->B.emit.checkpoints.enabled = true
auto.offset.reset=latest
refresh.topics.enabled=true
heartbeats.topic.replication.factor=1
checkpoints.topic.replication.factor=1
offset-syncs.topic.replication.factor=1
config.storage.replication.factor = 1
offset.storage.replication.factor = 1
status.storage.replication.factor = 1
将auto.offset.reset=latest
更改为A.consumer.auto.offset.reset=latest
后,Mirrormaker日志中开始出现auto.offset.reset=latest
配置。但还是没有运气。仍然从一开始就镜像。
未修复,但发现此(当前打开)问题可能导致:https://issues.apache.org/jira/browse/KAFKA-13988