Skip to content

[PyTorch] Adjusted the logic of MHA and DPA to enable speculative decoding #3129

[PyTorch] Adjusted the logic of MHA and DPA to enable speculative decoding

[PyTorch] Adjusted the logic of MHA and DPA to enable speculative decoding #3129