Skip to content

Commit

Permalink
space refinement
Browse files Browse the repository at this point in the history
  • Loading branch information
jeongin601 committed Nov 10, 2024
1 parent 1f976a0 commit bed84f2
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion vllm/spec_decode/batch_expansion.py
Original file line number Diff line number Diff line change
Expand Up @@ -314,7 +314,6 @@ def _create_target_seq_group_metadata(
# this also controls whether the probs get modified in the sampler
# (see use of _modify_greedy_probs_inplace there).
sampling_params = input_seq_group_metadata.sampling_params

target_seq_group_metadata_list: List[SequenceGroupMetadata] = []
for i, token_ids in enumerate(token_ids_to_score):
target_sampling_params = sampling_params
Expand Down

0 comments on commit bed84f2

Please sign in to comment.