当我试图从Kafka中读取时,我得到了以下错误
java.lang.IllegalArgumentException: Unknown compression type id: 5
at org.apache.kafka.common.record.CompressionType.forId(CompressionType.java:46)
at org.apache.kafka.common.record.Record.compressionType(Record.java:260)
at org.apache.kafka.common.record.LogEntry.isCompressed(LogEntry.java:89)
at org.apache.kafka.common.record.RecordsIterator.makeNext(RecordsIterator.java:70)
at org.apache.kafka.common.record.RecordsIterator.makeNext(RecordsIterator.java:34)
at org.apache.kafka.common.utils.AbstractIterator.maybeComputeNext(AbstractIterator.java:79)
at org.apache.kafka.common.utils.AbstractIterator.hasNext(AbstractIterator.java:45)
at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:772)
at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:473)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1038)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995)
at org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread.run(KafkaConsumerThread.java:243)你知道这可能是什么或者我应该去哪里看吗?
发布于 2019-01-31 20:29:30
Kafka支持这些压缩编解码器- NONE,GZIP,SNAPPY,LZ4,ZSTD。并且它们的压缩类型介于0-4之间(如下所述)
如果您使用的压缩编解码器超出这些,则需要将其更改为Kafka支持的压缩编解码器。
发布于 2019-02-01 23:00:09
由于客户不兼容的版本和在旧版本的kafka上创建的主题,我也面临着同样的问题。
检查您的kafka消费者客户端版本和kafka版本。
https://stackoverflow.com/questions/54458360
复制相似问题