-
Notifications
You must be signed in to change notification settings - Fork 36
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Store/Index Recursive Archives #124
Comments
I kinda thought that it was possible to some extent. Guess I'll have to look into it again. I thought that the remaining difficulty was to index everything into the same index file because each recursive file would create its own index file, hopefully inside Just to get a better feel. How large arge the contained archives and what compression is used for the outer and inner archive? Is it a public dataset that I can use for benchmark purposes? |
I'm still missing the exact archive formats/compressions, but I'll close it as a likely duplicate of #79. |
It seems that the recursive archive contents are not cached in the index.sqlite files. Could this be added in a way that speeds up initial load time ? Im recursively mounting over 10,000 archives with over 150,000 archives inside them and it would be nice to speed up this initial mount process.
The text was updated successfully, but these errors were encountered: