Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于GPU的疑问 #351

Open
AntyRia opened this issue Jul 31, 2024 · 4 comments
Open

关于GPU的疑问 #351

AntyRia opened this issue Jul 31, 2024 · 4 comments

Comments

@AntyRia
Copy link

AntyRia commented Jul 31, 2024 •
edited
Loading

我使用的模型是sherpa-ncnn-streaming-zipformer-zh-14M-2023-02-23，目前想使用x86设备的N卡做推理，想问问这个模型是否支持GPU以及对应的操作办法。另外想咨询一下这个模型是否支持边缘计算设备上的NPU，比如RK系列开发板。
@csukuangfj
Copy link
Collaborator

你的 gpu 支持 vulkan 么？sherpa-ncnn 是通过 ncnn 的 vulkan 功能去使用 gpu.

@AntyRia
Copy link
Author

AntyRia commented Jul 31, 2024

支持的

@csukuangfj
Copy link
Collaborator

另外想咨询一下这个模型是否支持边缘计算设备上的NPU，比如RK系列开发板。

有同学移植过。我只能回答，这条路走得通。我们没提供代码。

@csukuangfj
Copy link
Collaborator

https://github.com/k2-fsa/sherpa-ncnn/blob/master/build-android-arm64-v8a-with-vulkan.sh

这个是增加 vulkan 功能的编译脚本，你自己可以看一下. 更多的关于 vulkan的问题，请移步 ncnn github repo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@csukuangfj @AntyRia