Kafka连接到ElasticSearch-LOG4J2或连接被拒绝错误



我正在尝试使用Elastic搜索配置Kafka Connect。但当我尝试启动它时,我会遇到以下错误:

ERROR StatusLogger Log4j2 could not find a logging implementation.
ERROR Failed to create client to verify connection.  (io.confluent.connect.elasticsearch.Validator:120)
ElasticsearchException[java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused]; nested: ExecutionException[java.net.ConnectException: Connection refused]; nested: ConnectException[Connection refused]

我正试图在终端中用以下命令启动它:

connect-standalone.sh config/connect-standalone.properties config/elasticsearch.properties 

这是connect-standalone.properties:

key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=true
value.converter.schemas.enable=true
offset.flush.interval.ms=10000
# EDIT BELOW IF NEEDED
bootstrap.servers=localhost:9092
offset.storage.file.filename=/tmp/connect.offsets
plugin.path=/home/stjepan/kafka_2.13-3.2.3/connectors

这是elasticsearch.properties:

name=elasticsearch-sink
connector.class=io.confluent.connect.elasticsearch.ElasticsearchSinkConnector
tasks.max=1
topics=wikimedia.recentchange
key.ignore=true
connection.url=localhost:9200
# connection.url=https://kafka-course-5842482143.eu-west-1.bonsaisearch.net
# connection.username=he6de7ka5o
# connection.password=yozz8ryqmg
type.name=kafka-connect
# necessary for this connector
schema.ignore=true
behavior.on.malformed.documents=IGNORE
# OVERRIDE
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=false

我做错了什么?Wikimedia连接器运行良好。。。我没有尝试其他任何东西,因为我不知道除了端口之外我可以更改什么,但这没有帮助。。。

您可能指的是https://www.conduktor.io/apache-kafka-for-beginners(或Packt Pub的相关课程(

我使用OpenSearch Kafka Sink连接器解决了这个问题:

https://github.com/aiven/opensearch-connector-for-apache-kafka

低于https://github.com/aiven/opensearch-connector-for-apache-kafka/blob/main/config/quickstart-elasticsearch.properties有一个连接器配置,您可以将其合并到现有配置中。

希望能帮助

最新更新