Skip to content

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA … #73

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA …

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA … #73