-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
关于可视化的一些问题 #17
Comments
这个是用bertviz包来画的,黄色的高亮是手动画的 |
哦是这个样子的,首先,我们这边可视化的saliency,而不是attention,因为attention的大小又可能和重要性还差一些(比如有文章就说应该再用value vector的norm修正) |
哦哦,确实在streaming LLM中也有相关描述,谢谢您的解答~ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
您好~最近阅读了您的论文和代码,想问一下这个可视化是如何实现的呢?谢谢~
The text was updated successfully, but these errors were encountered: