KSQL表无法查看数据



汇流平台:6.1.1

问题:无法查看ksql表上的数据:-

1.(第一个创建的主题:-

./kafka-topics --zookeeper localhost:2181 --create --partitions 1 --replication-factor 1 --topic COUNTRY-CSV
Created topic COUNTRY-CSV.

2.(向该主题发送了一些数据:-

./kafka-console-producer --broker-list localhost:9092 --topic COUNTRY-CSV --property parse.key=true --property key.separator=:
>AU:AU,Australia     
>IN:IN,India

3.(创建了KSQL表:-

ksql> CREATE TABLE COUNTRY_TABLE (countrycode VARCHAR PRIMARY KEY, countryname VARCHAR) WITH (KAFKA_TOPIC = 'COUNTRY-CSV', VALUE_FORMAT='DELIMITED');
Message    
---------------
Table created 
---------------
ksql>

4.(已经设置了以下属性:-

ksql> SET 'auto.offset.xreset' = 'earliest';
Successfully changed local property 'auto.offset.reset' from 'earliest' to 'earliest'.
ksql>

5.(无法看到kSQL表上的数据:-

ksql> select countrycode, countryname from COUNTRY_TABLE EMIT CHANGES;
+---------------------------------------------------------------------------+---------------------------------------------------------------------------+
|COUNTRYCODE                                |COUNTRYNAME                                |
+---------------------------------------------------------------------------+---------------------------------------------------------------------------+
^CQuery terminated
ksql>

6.(验证数据是否与密钥一起进入卡夫卡主题:-

ksql> print 'COUNTRY-CSV';
Key format: KAFKA_STRING
Value format: KAFKA_STRING
rowtime: 2021/05/09 09:34:23.799 Z, key: AU, value: AU,Australia
rowtime: 2021/05/09 09:34:29.185 Z, key: IN, value: IN,India
rowtime: 2021/05/09 09:34:39.701 Z, key: US, value: US,Unites-States

无法看到ksql表上的数据(由Kafka控制台生产者手动发布(?如有任何帮助/建议,我们将不胜感激。。

通过使用confluent local current:-查看日志来找出答案

我生成了两列用逗号分隔的值,而在ksql表中,它只需要一列。

使用此数据:-

./kafka-console-producer --broker-list localhost:9092 --topic COUNTRY-CSV --property parse.key=true --property key.separator=:
>JP:JAPAN    
>AU:AUSTRALIA    
>IN:INDIA
>BEL:BELGIUM
>SA:SOUTH-AFRICA
>GB:GREAT-BRITAIN

获得以下输出:-

ksql> select * from COUNTRY_CSV EMIT CHANGES;
+---------------------------------------------------------------------------+---------------------------------------------------------------------------+
|COUNTRYCODE                                                                |COUNTRYNAME                                                                |
+---------------------------------------------------------------------------+---------------------------------------------------------------------------+
|JP                                                                         |JAPAN                                                                      |
|AU                                                                         |AUSTRALIA                                                                  |
|IN                                                                         |INDIA                                                                      |
|BEL                                                                        |BELGIUM                                                                    |
|SA                                                                         |SOUTH-AFRICA                                                               |
^CQuery terminated
ksql> 

谢谢大家。

最新更新