Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #64

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
yapf (3.8)	1m 11s
yapf (3.8)	1m 18s
yapf (3.8)	1m 11s
yapf (3.8)	1m 11s
yapf (3.8)	1m 11s
yapf (3.9)	1m 9s
yapf (3.9)	1m 17s
yapf (3.9)	1m 10s
yapf (3.9)	1m 10s
yapf (3.9)	1m 10s
yapf (3.10)	1m 13s
yapf (3.10)	1m 15s
yapf (3.10)	1m 9s
yapf (3.10)	1m 9s
yapf (3.10)	1m 9s
yapf (3.11)	56s
yapf (3.11)	58s
yapf (3.11)	51s
yapf (3.11)	53s
yapf (3.11)	59s
	22m 30s