Ignite gridgain 生成的项目打开文件限制问题

Question

我正在尝试缓存一些表的大型数据集，我的服务器是基于 centos 的，具有 8Go ram 和 500Go 磁盘 space

我将我的本地存储策略配置为持续存在，在遇到文件打开限制问题后，我尝试按照这些步骤达到 2 000 000

 vi /etc/sysctl.conf
 fs.file-max = 2000000     (2 million)
 :wq
 sysctl -p

但即使使用此修复程序

并在 chmod -x 上设置工作目录我仍然有以下错误提示

SEVERE: Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin]]
class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin
    at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init(FilePageStore.java:448)
    at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.read(FilePageStore.java:337)
    at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:478)
    at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:462)
    at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:853)
    at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:694)
    at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.getOrAllocatePartitionMetas(GridCacheOffheapManager.java:1679)
    at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.init0(GridCacheOffheapManager.java:1507)
    at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:2137)
    at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:429)
    at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4261)
    at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3407)
    at org.apache.ignite.internal.processors.cache.GridCacheEntryEx.initialValue(GridCacheEntryEx.java:771)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.loadEntry(GridDhtCacheAdapter.java:683)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.access0(GridDhtCacheAdapter.java:103)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.apply(GridDhtCacheAdapter.java:633)
    at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.apply(GridDhtCacheAdapter.java:629)
    at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.apply(GridCacheStoreManagerAdapter.java:535)
    at org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore.call(CacheAbstractJdbcStore.java:469)
    at org.apache.ignite.cache.store.jdbc.CacheAbstractJdbcStore.call(CacheAbstractJdbcStore.java:433)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.nio.file.FileSystemException: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin: Too many open files
    at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
    at sun.nio.fs.UnixFileSystemProvider.newAsynchronousFileChannel(UnixFileSystemProvider.java:196)
    at java.nio.channels.AsynchronousFileChannel.open(AsynchronousFileChannel.java:248)
    at java.nio.channels.AsynchronousFileChannel.open(AsynchronousFileChannel.java:301)
    at org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIO.<init>(AsyncFileIO.java:56)
    at org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory.create(AsyncFileIOFactory.java:43)
    at org.apache.ignite.internal.processors.cache.persistence.file.FilePageStore.init(FilePageStore.java:420)
    ... 23 more

Nov 24, 2019 4:54:51 PM java.util.logging.LogManager$RootLogger log
SEVERE: JVM will be halted immediately due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.StorageException: Failed to initialize partition file: /home/grid-gain-server/gridgain-community-8.7.7/work/db/node00-3273af50-1e97-47fa-a237-29e7dfc2d987/cache-COrderCache/part-56.bin]]

我能做些什么来修复它

Answer 1

添加以下配置足以让我避免此异常

vi /etc/security/limits.conf
root soft nofile 10240
root hard nofile 20480

然后在 /etc/sysctl.conf 我附加了最大观察者配置

fs.inotify.max_user_watches=524288

知道root是我的用户帐号名

这些值是实验性的，我不确定这是否安全，但我的 VM 中没有任何重大问题

之前的配置我没有掉

需要重新启动

归功于@Stephen Darlington

只是为了解释这里发生了什么：fs.file-max 为操作系统设置了一个总体限制。 limits.conf 中的内容为每个用户设置了限制。我要补充的唯一一件事是，如果您运行 Ignite 不是 root 用户（推荐），您将更改用户限制。

Ignite gridgain 生成的项目打开文件限制问题

Ignite gridgain generated project openfile limit issue

java

gridgain

ignite