torch
transformers>=4.57.1
accelerate
bitsandbytes
uvicorn
pydantic
fastapi