vllm>=0.18.0
gradio
openai
fastapi
uvicorn
httpx