Skip to content

Commit

Permalink
remove unnecessary assert
Browse files Browse the repository at this point in the history
  • Loading branch information
chengzeyi committed Dec 19, 2024
1 parent a9defb2 commit 7d11f6c
Showing 1 changed file with 0 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -146,8 +146,6 @@ def new_transformer_block_forward(
):
world_size = DP.get_world_size(seq_mesh)
if attention_mask is not None:
assert attention_mask.shape[0] == 1, "Only support batch size 1 for now"

hidden_states_len = hidden_states.shape[-2]
encoder_hidden_states_len = encoder_hidden_states.shape[-2]

Expand Down

0 comments on commit 7d11f6c

Please sign in to comment.