Day 0 support for Mistral Large 4 on vLLM
vLLM announces day-0 support for Mistral Large 4, a 1T-parameter MoE multimodal model with 49B active parameters per token, running on the V2 model runner with breakable CUDA graphs and a new vllm/models/mistral/ package. The work adds cross-layer KV sharing, DCP/PCP context parallelism, DSpark speculative decoding, NIXL-based disaggregated serving and HiSparse KV offload, plus day-0 ROCm support on AMD Instinct MI350 Series GPUs with MXFP4 experts. Support ships in the vllm/vllm-openai:mistral-large-4 Docker image, with FP8 and NVFP4 checkpoints and serving commands documented.
Why it matters: A detailed engineering account of what it takes to land a frontier model on an inference engine, useful for teams planning long-context or disaggregated deployments.