运行 kafka connect worker 时出现这么多异常

Question

在运行 Kafka Connect worker 时收到如此多的异常。我已经设置了所有的 worker 属性，所有的 jar 路径看起来都很好。

例外情况如下：

2020-07-23 18:41:58 WARN  Reflections:104 - could not create Dir
   using jarFile from url
   file:/kafka/bin/../clients/build/libs/kafka-clients*.jar. skipping.  
   java.lang.NullPointerException
at java.util.zip.ZipFile.<init>(ZipFile.java:213)                                                                                                                           
at java.util.zip.ZipFile.<init>(ZipFile.java:155)                                                                                                                           
at java.util.jar.JarFile.<init>(JarFile.java:166)                                                                                                                           
at java.util.jar.JarFile.<init>(JarFile.java:130)                                                                                                                           
at org.reflections.vfs.Vfs$DefaultUrlTypes.createDir(Vfs.java:216)                                                                                                        
at org.reflections.vfs.Vfs.fromURL(Vfs.java:99)                                                                                                                             
at org.reflections.vfs.Vfs.fromURL(Vfs.java:91)                                                                                                                             
at org.reflections.Reflections.scan(Reflections.java:240)                                                                                                                   
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.scan(DelegatingClassLoader.java:373)                                                
at org.reflections.Reflections.run(Reflections.java:198)                                                                                                                  
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)                                                                                                  
at java.util.concurrent.FutureTask.run(FutureTask.java:266)                                                                                                                 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)                                                                                          
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)                                                                                          
at java.lang.Thread.run(Thread.java:748)  
2020-07-23 18:41:58 WARN  Reflections:377 - could not create Vfs.Dir from url. ignoring the exception and continuing         
                                                
org.reflections.ReflectionsException: Could not open url connection at org.reflections.vfs.JarInputDir.<init>(JarInputDir.java:37)                                                                                                      
at org.reflections.vfs.JarInputDir.iterator(JarInputDir.java:33)                                                                                                      
at org.reflections.Reflections.scan(Reflections.java:243)                                                                                                               
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.scan(DelegatingClassLoader.java:373)                                            
at org.reflections.Reflections.run(Reflections.java:198)                                                                                                              
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)                                                                                              
at java.util.concurrent.FutureTask.run(FutureTask.java:266)                                                                                                             
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)                                                                                      
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)                                                                                      
at java.lang.Thread.run(Thread.java:748)  
Caused by: java.io.FileNotFoundException: /kafka/bin/../clients/build/libs/kafka-clients*.jar (No such file or directory)

   at java.io.FileInputStream.open0(Native Method)                                                                                                                             
   at java.io.FileInputStream.open(FileInputStream.java:195)                                                                                                               
at java.io.FileInputStream.<init>(FileInputStream.java:138)                                                                                                         -

kafkaconnectsladev.log

Answer 1

如果您看到 WARN Reflections，那么这是一个警告，而不是错误，可以安全地忽略。

如果需要，您可以编辑 log4j.properties 文件以消除警告。使用 Confluent Docker 图像，这是通过 CONNECT_LOG4J_LOGGERS 变量

完成的

Answer 2

谢谢大家，是的，这些都是警告，对于更新版本的 kafka 客户端库，我没有看到这些。

运行 kafka connect worker 时出现这么多异常

Getting so many Exceptions while running the kafka connect worker

apache-kafka

apache-kafka-connect