-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
In BLS mode, does the data go to the CPU #7364
Comments
CallmeZhangChenchen
changed the title
Acceleration in Bls mode bls模式下数据会不会回传到CPU上
Does the for loop data reach the CPU in BLS mode
Jun 21, 2024
CallmeZhangChenchen
changed the title
Does the for loop data reach the CPU in BLS mode
Iin BLS mode, does the data go to the CPU
Jun 21, 2024
CallmeZhangChenchen
changed the title
Iin BLS mode, does the data go to the CPU
In BLS mode, does the data go to the CPU
Jun 21, 2024
I add parameters to t2s_sdec/config.json parameters: { key: "FORCE_CPU_ONLY_INPUT_TENSORS" value: {string_value:"no"}} There's still no change in speed Suspect that BLS code inside the data ran to the CPU, but do not know how to optimize. |
same as #7373 ! close |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
model_name t2s_sdec platform: "tensorrt_plan"
I have a piece of BLS mode code here, I found that in the case of a relatively small number of cpu cores (120->24), the time will be doubled,
So I want to ask, is the data back to the CPU, not always on the GPU, is there any solution
The text was updated successfully, but these errors were encountered: