-
Notifications
You must be signed in to change notification settings - Fork 478
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
关于是否有必要添加输出量化的问题? #105
Comments
实际中会有很多多分支操作,以及混合精度量化,所以每层都是完整的对输入,权重,输出都量化会更通用 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
大佬,您好!我看您的这份开源工作中只对每一层的权值与激活值进行了量化、反量化操作,然后输出作为下一层的输入,然后再作为下一层的输入作激活的量化反量化;但是我看别的一些量化代码中,除了对每一层的激活值、权值进行量化,还对每一层的输出进行量化、反量化,想请教一下大佬这是为啥?因为该层的输出量化不就是下一层的输入激活值量化吗?
The text was updated successfully, but these errors were encountered: