---
title: "Hayula Gateway: A Unified OpenAI-Compatible API Layer for Multi-Model Local Inference — Hayula Research"
authors:
- Hayula AI Lab
papers:
- paper.md
tags:
- hayula
- gateway
- routing
- multi-provider
- llm
license: mit
---

# Hayula Gateway: A Unified OpenAI-Compatible API Layer for Multi-Model Local Inference — Hayula Research

**Hayula AI Lab**

## Abstract

We present Hayula Gateway, a unified API routing layer that provides OpenAI-compatible endpoints for multiple locally-hosted large language models running on a single Apple M2 Ultra workstation (192GB unified memory). The gateway orchestrates three distinct model services—SAIF (a multi-expert cybersecurity suite on port 8443), Averroes-Q (a bilingual Arabic-English model on port 8080), and DeepSeek R1 (a reasoning-optimized model on port 8083)—exposing them through a single /v1/chat/completions 

## Files

| File | Description |
|------|-------------|
| `paper.md` | Full paper (Markdown) |
| `README.md` | This model card |

## Citation

```bibtex
@techreport{hayulalab2026hayulagateway,
    title={Hayula Gateway: A Unified OpenAI-Compatible API Layer for Multi-Model Local Inference — Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/hayula-gateway-paper}
}
```

---

*hayulalab — Open Source AI Research*