vlm: increase the default max_num_batched_tokens for multimodal models#973
Merged
AlpinDale merged 1 commit intomainfrom fix-mm-prefillDec 24, 2024
+32-16
max_num_batched_tokens for multimodal models#973