Skip to content

Commit

Permalink
fix mypy
Browse files Browse the repository at this point in the history
Signed-off-by: Bill Nell <bill@neuralmagic.com>
  • Loading branch information
bnellnm committed Nov 25, 2024
1 parent 7ebd94c commit 8cf7096
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -2434,7 +2434,7 @@ def __post_init__(self):

n_slices = self.parallel_config.world_size
max_tokens = self.scheduler_config.max_num_batched_tokens
if not use_cc_kernels(max_tokens / n_slices, n_slices):
if not use_cc_kernels(int(max_tokens / n_slices), n_slices):
logger.info(
("Disabling collective fusion pass since chunked prefill size "
"%d is too small."), max_tokens)
Expand Down

0 comments on commit 8cf7096

Please sign in to comment.