-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Loading/Saving Directly from GPU #215
Comments
I haven't tried it but I suspect that it would be possible to simply specify the zarr store when reading the data, similarly as: From the rosettasciio documentation, it should be possible to specify the zarr store when loading the file: Maybe what is needed is only to document how to use rosettasciio with kvikio? |
@ericpre I think that is the case as well. We have one computer in our lab which I should be able to get this to work on. The documentation for kvikio leaves a bit to be desired and installing it required a couple of specific cuda etc. versions. Next time I have a microscope session I'll try to see if I can get this to work and we might be able to just add this to the documentation! |
Describe the functionality you would like to see.
I'm not sure what would be required to do to get this to work with h5py but
zarr
and Nvidia have a nice little library kvikio which can be used to load files directly from zarr into a GPU. The major benefit of this is that you can reduce the overhead of loading data using a CPU and then transferring to a GPU.Describe the context
I see this being used in two places:
Additional information
In general I think that GPU processing will only continue to improve a start to outperform CPU processing. It might be good to get an idea of how difficult it is to do something like this.
https://xarray.dev/blog/xarray-kvikio
The text was updated successfully, but these errors were encountered: