Tags
performance77ecosystem33hardware30model-support24speculative-decoding22multimodal20large-scale-serving17disaggregation15quantization11moe11reinforcement-learning8kv_cache7kernels6community6vllm-omni5developer5models4deepseek3parallelism3nixl3speculators3post-training3attention3inference3glm2kv-cache2minimax2day-0-support2elastic-ep2expert-parallelism2amd2deployment2distributed2agentic2rlhf2dflash2prefix caching2agentic-routing2disaggregated-serving1flint1cuda-graphs1NVIDIA1rocm1reflection1watermarking1sampling1apple-silicon1qwen3.81fastvideo1fasth31cosmos31qwen3.51speculative_decoding1peagle1dspark1mixture-of-models1semantic-router1ci1evaluation1release1hpc-ops1long-context1model1learning1dgx-spark1nemotron1computex1llm-compressor1async-rl1production-serving1fault-tolerance1turboquant1benchmarking1kernel-fusion1fp81mamba1engineering1triton1frontend1