-
Notifications
You must be signed in to change notification settings - Fork 36
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve performance for multi-threaded access to encrypted zip files #97
Comments
@Vadiml1024 Could it be that you are running into this issue instead:
With #98 also observing performance issues I get the feeling that a better zip module must be available :/. Maybe libarchive? But, we tried. And, concurrency support in the libarchive Python-bindings was a work in progress. czipfile exists but it seems to be Python 2 and dead. So, I guess another self-written backend. |
I'look I to czipfile I suppose porting it to python3 will be not too
difficult..
Le mar. 22 nov. 2022, 21:15, Maximilian Knespel ***@***.***>
a écrit :
… @Vadiml1024 <https://github.com/Vadiml1024> Could it be that you are
running into this issue <https://docs.python.org/3/library/zipfile.html>
instead:
Decryption is extremely slow as it is implemented in native Python rather
than C.
With #98 <#98> also observing
performance issues I get the feeling that a better zip module must be
available :/. Maybe libarchive? But, we tried. And, concurrency support in
the libarchive Python-bindings was a work in progress. czipfile
<https://pypi.org/project/czipfile/> exists but it seems to be Python 2
and dead.
So, I guess another self-written backend.
—
Reply to this email directly, view it on GitHub
<#97 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAG76GLFVDCK2NRECIXVY5DWJUSUNANCNFSM6AAAAAAR7DDISI>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Somebody already ported czipfile to python3 |
Ah nice. I didn't see it on PyPI. Cython as opposed to Python is also said to be faster: https://stackoverflow.com/a/72513075/2191065 And there is this: https://github.com/TkTech/fasterzip But it seems like it might be missing some features like setting a password among others. |
#96 (comment)
This might need yet another backend like
indexed_bzip2
that works with zip files. So... a lot of work.The text was updated successfully, but these errors were encountered: