You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this place in TE we pass "block_table" argument to either flash_attn_func or flash_attn_varlen_func functions from flash_attn package. However, this function doesn't have this argument, only flash_attn_varlen_func function does, as we can verify here. I'm attaching HEAD of main as a link, but it's the same in version 2.5.8. It results in an error when flash_attn_func is chosen.
The text was updated successfully, but these errors were encountered:
In this place in TE we pass "block_table" argument to either
flash_attn_func
orflash_attn_varlen_func
functions fromflash_attn
package. However, this function doesn't have this argument, onlyflash_attn_varlen_func
function does, as we can verify here. I'm attaching HEAD of main as a link, but it's the same in version 2.5.8. It results in an error whenflash_attn_func
is chosen.The text was updated successfully, but these errors were encountered: