从 Infinispan 缓存读取进入无限循环

Question

我正在使用 Nifi 创建数据流管道，其中我使用 Infinispan 作为缓存服务器但是当我将 executescript 与 Groovy 脚本一起使用时，它会进入无限循环并打开许多套接字连接。我试图关闭相同但它仍然打开许多连接然后它抛出

java.net.SocketException: No buffer space available (maximum connections reached?): connect

通过以下 link 我更改了注册表 https://support.pitneybowes.com/VFP06_KnowledgeWithSidebarTroubleshoot?id=kA280000000PEE1CAO&popup=false&lang=en_US

然后检查打开的连接 netstat -n 我打开 65534 因为上面的设置。

下面是从 Infinispan 缓存中读取的 groovy 脚本

import org.infinispan.client.hotrod.RemoteCache;
import org.infinispan.client.hotrod.RemoteCacheManager;
import org.infinispan.client.hotrod.configuration.ConfigurationBuilder;
import org.apache.commons.io.IOUtils;
import java.nio.charset.StandardCharsets;

def cacheName = "mycache"

def configuration = new ConfigurationBuilder()
.addServer().host("localhost").port(11322).build();

def cacheManager = new RemoteCacheManager(configuration)

RemoteCache cacheA = cacheManager.getCache(cacheName)

flowFile = session.get()
if(!flowFile) return
key = flowFile.getAttribute('key')
id = flowFile.getAttribute('id')
jsonFromCache = cacheA.get(key + "_" + id);
if(cacheA != null) {
cacheA.stop()
}
if(cacheManager != null) {
cacheManager.stop()
}

flowFile = session.write(flowFile, {outputStream ->
  outputStream.write(jsonFromCache.getBytes(StandardCharsets.UTF_8))
} as OutputStreamCallback)
session.transfer(flowFile, REL_SUCCESS)

Answer 1

您在从会话中获取文件之前打开了缓存连接。

因此，您正在打开连接，并在以下行中退出脚本而不关闭它：

if(!flowFile) return

还有一点：您可以使用 ExecuteGroovyScript 处理器。然后可以管理处理器启动和停止。您可以在此处找到示例：https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-groovyx-nar/1.9.2/org.apache.nifi.processors.groovyx.ExecuteGroovyScript/additionalDetails.html

import org.apache.nifi.processor.ProcessContext
import java.util.concurrent.atomic.AtomicLong

class Const{
  static Date startTime = null;
  static AtomicLong triggerCount = null;
}

static onStart(ProcessContext context){
  Const.startTime = new Date()
  Const.triggerCount = new AtomicLong(0)
  println "onStart $context ${Const.startTime}"
}

static onStop(ProcessContext context){
  def alive = (System.currentTimeMillis() - Const.startTime.getTime()) / 1000
  println "onStop $context executed ${ Const.triggerCount } times during ${ alive } seconds"
}

def flowFile = session.get()
if(!flowFile)return
flowFile.'trigger.count' = Const.triggerCount.incrementAndGet()
REL_SUCCESS << flowFile

从 Infinispan 缓存读取进入无限循环

Reading from Infinispan cache goes into infinite loop

java

groovy

infinispan

apache-nifi