Get cross-attention weights of fine-tuned Whisper model #687

Ar770 started this conversation in General

Ar770
Jul 12, 2023

Hi,
referring https://gist.github.com/hollance/42e32852f24243b748ae6bc1f985b13a
What is the right way to get the cross-attention weights for a Peft fine-tuned Whsiper model (on large-v2)?
How can I check it?
Thanks

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment