Skip to content

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #67

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #67

Annotations

2 warnings

This job succeeded