Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store/Index Recursive Archives #124

Closed
detain opened this issue Nov 5, 2023 · 2 comments
Closed

Store/Index Recursive Archives #124

detain opened this issue Nov 5, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@detain
Copy link

detain commented Nov 5, 2023

It seems that the recursive archive contents are not cached in the index.sqlite files. Could this be added in a way that speeds up initial load time ? Im recursively mounting over 10,000 archives with over 150,000 archives inside them and it would be nice to speed up this initial mount process.

@mxmlnkn mxmlnkn changed the title [Feature Request] Store/Index Recursive Archives Store/Index Recursive Archives Nov 5, 2023
@mxmlnkn mxmlnkn added the enhancement New feature or request label Nov 5, 2023
@mxmlnkn
Copy link
Owner

mxmlnkn commented Nov 5, 2023

I kinda thought that it was possible to some extent. Guess I'll have to look into it again. I thought that the remaining difficulty was to index everything into the same index file because each recursive file would create its own index file, hopefully inside ~/.cache/ratarmount because the "folder", in which the recursive file resides in, is not writable.

Just to get a better feel. How large arge the contained archives and what compression is used for the outer and inner archive? Is it a public dataset that I can use for benchmark purposes?

@mxmlnkn
Copy link
Owner

mxmlnkn commented Feb 23, 2024

I'm still missing the exact archive formats/compressions, but I'll close it as a likely duplicate of #79.

@mxmlnkn mxmlnkn closed this as completed Feb 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants