Skip to content
yapf

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Sign in to view logs

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Run time

Learn about OS pricing on GitHub Actions
Job Run time
yapf (3.8)
1m 28s
yapf (3.9)
1m 25s
yapf (3.10)
1m 22s
yapf (3.11)
1m 7s
5m 22s