Problems in Azure Blob with EclipseStore

[Flo9520]

I am currently facing several issues with EclipseStore when I store my data in an Azure Blob Storage.

My setup:

• Java 21
• EclipseStore 1.1.0
• SpringBoot 3.2.0

When using the blob the data files are never merged even though they are just several KB in size leading to super slow loading times and making the application unable to scale. (see below)

My next idea was to use a PVC inside of a blob with azureblob-fuse-standard. This solved the issue from above, files are not concatinated correctly and everything works fine until I stop my cluster. Afterwards I always get an error like:

Caused by: org.eclipse.store.storage.exceptions.StorageException: Non-deleted non-empty data file not found: channel 0, file 5 at org.eclipse.store.storage.types.StorageFileManager$Default.validateStorageDataFilesLength(StorageFileManager.java:799) at org.eclipse.store.storage.types.StorageFileManager$Default.initializeStorage(StorageFileManager.java:842) at org.eclipse.store.storage.types.StorageChannel$Default.initializeStorage(StorageChannel.java:782) at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.succeed(StorageChannelTaskInitialize.java:200) at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.succeed(StorageChannelTaskInitialize.java:34) at org.eclipse.store.storage.types.StorageChannelSynchronizingTask$AbstractCompletingTask.synchronizedComplete(StorageChannelSynchronizingTask.java:78) at org.eclipse.store.storage.types.StorageChannelSynchronizingTask$AbstractCompletingTask.complete(StorageChannelSynchronizingTask.java:126) at org.eclipse.store.storage.types.StorageChannelTask$Abstract.processBy(StorageChannelTask.java:260) at org.eclipse.store.storage.types.StorageChannel$Default.work(StorageChannel.java:453) at org.eclipse.store.storage.types.StorageChannel$Default.run(StorageChannel.java:536) at java.base/java.lang.Thread.run(Unknown Source)

It feels like this occurs on a random basis. I can't really find a pattern, it seems to always be a different service.

According to the documentation Azure Blob should be supported. Does anyone have a similar issue?

[hg-ms]

StorageException is caused by a missing storage file (file 5 in channel 0). Why the file is missing is hard to say. It may be caused by the OS or azureblob-fuse not writing cached data before shutdown. Or closing the fs before Eclipse Store has been shut down.