seekToTimestamp in spring-kafka

Question

我试图寻找时间戳功能，但由于某种原因，它不适合我。

在我的生产者中，我有下一个代码:

ProducerRecord<String, Obj> producer = new ProducerRecord<>("topic", 0, System.currentTimeMillis() - 10000, "key", obj);
kafkaTemplate.send(producer);

在我的Kafka监听器中，我试图从高于上面一个的时间戳中寻找偏移量:

@Component
@RequiredArgsConstructor
@KafkaListener(id = "container",
topics = "topic",
clientIdPrefix = "init_client",
autoStartup = "true")
public class KafkaList implements ConsumerSeekAware {
@Override
public void onPartitionsAssigned(Map<TopicPartition, Long> assignments, ConsumerSeekCallback callback) {
long timestamp = System.currentTimeMillis()+60*1000;
log.info("Search for a time that is great or equal then {}", timestamp);
callback.seekToTimestamp(new ArrayList<>(assignments.keySet()), timestamp);
}
@KafkaHandler
public void listen(@Header(KafkaHeaders.RECEIVED_MESSAGE_KEY) String key, Obj obj,
@Header(KafkaHeaders.RECEIVED_TIMESTAMP) Long timestamp) {
log.info("Received message timestamp: {}, date: {}", timestamp,
Instant.ofEpochMilli(timestamp).atZone(ZoneId.systemDefault()).toLocalDate());
}
}

在日志中，我看到下一个输出:

Search for a time that is great or equal then 1613079865328
Received message timestamp: 1613079798676, date: 2021-02-11

Kafka主题1613079798676中的时间戳值低于我的搜索值1613079865328，所以为什么消费者会选择这个偏移量?

Answer 1

我刚刚用你的代码测试了它，它像预期的那样为我工作;我在日志中看到这个…

2021-02-16 11:30:16.587 INFO 36721—[o66163492-0-C-1] com.example. demo.so66163492应用程序:搜索大于或等于1613493076587的时间

2011-02-16 11:30:16.590 INFO 36721—[o66163492-0-C-1] o.a.k.clients. Consumer . kafkconsumerer: [Consumer clientId= Consumer -so66163492-1, groupId=so66163492]为分区so66163492-0查找偏移1

2010-02-16 11:30:16.590 INFO 36721—[o66163492-0-C-1] o.s.k.l.KafkaMessageListenerContainer: so66163492: partitions assigned: [so66163492-0]

2010-02-16 11:30:16.611 INFO 36721—[o66163492-0-C-1] com.example.demo.So66163492Application: Received message timestamp: 1613529016472 qux

@SpringBootApplication
public class So66163492Application extends AbstractConsumerSeekAware {
private static final Logger log = LoggerFactory.getLogger(So66163492Application.class);
public static void main(String[] args) {
SpringApplication.run(So66163492Application.class, args);
}
@KafkaListener(id = "so66163492", topics = "so66163492")
public void listen(@Header(KafkaHeaders.RECEIVED_MESSAGE_KEY) String key, String obj,
@Header(KafkaHeaders.RECEIVED_TIMESTAMP) Long timestamp) {
log.info("Received message timestamp: {} {}", timestamp, obj);
}
@Bean
public NewTopic topic() {
return TopicBuilder.name("so66163492").partitions(1).replicas(1).build();
}
@Bean
public ApplicationRunner runner(KafkaTemplate<String, String> template) {
return args -> {
template.send(new ProducerRecord<>("so66163492", 0, System.currentTimeMillis() - 10_000, "foo", "bar"));
template.send(new ProducerRecord<>("so66163492", 0, System.currentTimeMillis() + 36_000_000, "baz", "qux"));
};
}
@Override
public void onPartitionsAssigned(Map<TopicPartition, Long> assignments, ConsumerSeekCallback callback) {
long timestamp = System.currentTimeMillis() + 60 * 1000;
log.info("Search for a time that is great or equal then {}", timestamp);
callback.seekToTimestamp(new ArrayList<>(assignments.keySet()), timestamp);
}
}