vLLM: high-throughput LLM serving, OpenAI API, quantization.
vLLM: high-throughput LLM serving, OpenAI API, quantization. A reusable SKILL.md agent skill by NousResearch.
NousResearch
cli
free