hayulalab/hayula-gateway-paper

Hayula Gateway: A Unified OpenAI-Compatible API Layer for Multi-Model Local Inference — Hayula Research

Hayula AI Lab

Abstract

We present Hayula Gateway, a unified API routing layer that provides OpenAI-compatible endpoints for multiple locally-hosted large language models running on a single Apple M2 Ultra workstation (192GB unified memory). The gateway orchestrates three distinct model services—SAIF (a multi-expert cybersecurity suite on port 8443), Averroes-Q (a bilingual Arabic-English model on port 8080), and DeepSeek R1 (a reasoning-optimized model on port 8083)—exposing them through a single /v1/chat/completions

Files

File	Description
paper.md	Full paper (Markdown)
README.md	This model card

Citation

@techreport{hayulalab2026hayulagateway,
    title={Hayula Gateway: A Unified OpenAI-Compatible API Layer for Multi-Model Local Inference — Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/hayula-gateway-paper}
}

---

hayulalab — Open Source AI Research