Kafka 压缩在消费者端失败

Question

我通过以下更改在生产者端启用了 snappy 压缩：

props.put(ProducerConfig.COMPRESSION_TYPE_CONFIG,"snappy");

现在是否需要在消费者方面对此进行任何更改？我检查了 Consumer.config 但没有找到任何 compression_type 参数。

当我运行代码消息没有到达消费者端时，我收到以下错误：

[1/10/20 17:25:39:759 UTC] 00018027 org.apache.kafka.clients.consumer.KafkaConsumer              I [Consumer clientId=com.ora.def.lieo, groupId=group-cedm] Seeking to offset 320 for partition Party-Resolved-Check-0
[1/10/20 17:25:49:760 UTC] 00018029 com.ibm.cedm.kafka.KafkaConsumerService                      E Received exception when fetching the next record from Party-Resolved-Check-0. If needed, please seek past the record to continue consumption.

Answer 1

不需要解压配置。消费者自动处理这个。

不清楚您的错误与压缩有何关系

Kafka 压缩在消费者端失败

Kafka compression fail in comsumer side

compression

apache-kafka

kafka-consumer-api

kafka-producer-api