FSI_ECHO / README.md
FerrellSyntheticIntelligence's picture
Upload README.md with huggingface_hub
7067541 verified
|
Raw
History Blame Contribute Delete
1.51 kB
---
title: FSI_ECHO
emoji: 🧬
colorFrom: purple
colorTo: indigo
sdk: gradio
sdk_version: "5.0.0"
app_file: app.py
pinned: false
license: apache-2.0
---
# 🧬 FSI_ECHO — Morphing Code Swarm
**World's smallest production code AI: 2.6M params, 1.3MB at Q4, runs on any phone.**
## Architecture — Novel "Morphing Code Swarm"
| Component | What it does |
|-----------|-------------|
| **Morph Embedding** | Tokens transform based on context (causal sliding window) |
| **Nanobot Swarm** | 512 nanobots with scout/combat dual-mode routing |
| **Assembly Blocks** | Multi-head attention with adaptive gating |
| **Self-Verification** | Built-in confidence scoring per token |
| **Closed-Loop Debug** | Generates, verifies syntax, and iteratively refines |
## Metrics
- Parameters: 2,621,578
- FP32 size: 10.5 MB
- Q4 size: 1.31 MB — fits on any phone
- Training loss: 8.4 → 0.0 (trained on 2400+ code examples)
- Speed: ~10 tok/s on CPU
- Context: 2048 tokens
## Usage
```python
from fsi_echo import FSIEchoModel, CodeTokenizer, ClosedLoopDebugger
import torch
model = FSIEchoModel()
tok = CodeTokenizer()
ckpt = torch.load('prod2_final.pt', map_location='cpu', weights_only=True)
model.load_state_dict(ckpt['model'])
model.eval()
# Generate code
result = model.generate(tok, 'def reverse_str', max_tokens=50)
print(result['generated'])
# Debug code
debugger = ClosedLoopDebugger(model, tok)
result = debugger.debug("def add(a, b):\n a + b")
print(result['code'])
```
## License
Apache 2.0