Projects tagged with vllm on GitHub.
2 projects
TokenSpeed is a speed-of-light LLM inference engine.
A self-hosted ML coding practice platform. 68 problems from ReLU to flow matching — attention, training, RLHF, diffusion, and more. Instant feedback in the browser.