---
title: Distillix Chat
emoji: 🧠
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: true
license: mit
---

# Distillix Chat - The Resurrected BitNet

Interactive demo for Distillix, a 125M parameter BitNet 1.58-bit model that was **resurrected from the dead**.

## The Story

This model suffered total weight collapse during training (99% of weights became zero). 
Instead of retraining, we used **Geometric Engineering** based on manifold physics to bring it back:

1. **Wasserstein Loss** - Aligned weight distribution to BitNet lattice
2. **SVD Denoising** - Removed noise while preserving structure  
3. **Manifold Inflation** - Added redundancy back after over-compression

Now it writes working Python code!

## Try It

Ask the model to:
- Write Python functions
- Explain algorithms
- Help with code questions

[Full Model Card](https://huggingface.co/rileyseaburg/distillix)