Instructions to use iky1e/moebius-ft-celebahq-mlx-f16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use iky1e/moebius-ft-celebahq-mlx-f16 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir moebius-ft-celebahq-mlx-f16 iky1e/moebius-ft-celebahq-mlx-f16
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Add files using upload-large-folder tool
Browse files- README.md +81 -0
- manifest.json +25 -0
- unet.safetensors +3 -0
- vae_decoder.safetensors +3 -0
- vae_encoder.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,81 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: mlx
|
| 4 |
+
pipeline_tag: image-to-image
|
| 5 |
+
base_model: hustvl/Moebius
|
| 6 |
+
tags:
|
| 7 |
+
- mlx
|
| 8 |
+
- image-inpainting
|
| 9 |
+
- inpainting
|
| 10 |
+
- diffusion
|
| 11 |
+
- moebius
|
| 12 |
+
- ft_celebahq
|
| 13 |
+
- f16
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Moebius ft_celebahq MLX f16
|
| 17 |
+
|
| 18 |
+
This folder contains a converted MLX version of the **ft_celebahq** Moebius checkpoint in **f16** form.
|
| 19 |
+
|
| 20 |
+
Original upstream model: [hustvl/Moebius](https://huggingface.co/hustvl/Moebius)
|
| 21 |
+
Original source repository: [hustvl/Moebius](https://github.com/hustvl/Moebius)
|
| 22 |
+
|
| 23 |
+
Moebius checkpoint fine-tuned on CelebA-HQ. This variant is intended for face and portrait inpainting distributions.
|
| 24 |
+
|
| 25 |
+
## Identity
|
| 26 |
+
|
| 27 |
+
| Field | Value |
|
| 28 |
+
|---|---|
|
| 29 |
+
| Variant name | `ft_celebahq-f16` |
|
| 30 |
+
| Original Moebius checkpoint family | `ft_celebahq` |
|
| 31 |
+
| Original checkpoint type | CelebA-HQ fine-tune |
|
| 32 |
+
| Source PyTorch checkpoint | `Moebius-Models/ft_celebahq/diffusion_pytorch_model.bin` |
|
| 33 |
+
| MLX precision / quantization label | `f16` |
|
| 34 |
+
| Image size | 512 x 512 |
|
| 35 |
+
| Latent size | 64 x 64 |
|
| 36 |
+
| Latent channels | 4 |
|
| 37 |
+
| Mask channels | 1 |
|
| 38 |
+
| Conditioning IDs | 20 |
|
| 39 |
+
| VAE scaling factor | 0.13025 |
|
| 40 |
+
| Noise offset | 0.0357 |
|
| 41 |
+
|
| 42 |
+
## Quantization
|
| 43 |
+
|
| 44 |
+
Float16 MLX export. UNet, VAE encoder, and VAE decoder are stored as regular `*.safetensors` arrays converted to float16. This roughly halves the f32 storage while keeping the same non-quantized module layout.
|
| 45 |
+
|
| 46 |
+
- No MLX quantized module packing is used for this variant.
|
| 47 |
+
|
| 48 |
+
## Manifest-selected deployment files
|
| 49 |
+
|
| 50 |
+
These are the files selected by `manifest.json` when the Moebius-MLX runtime loads this variant.
|
| 51 |
+
|
| 52 |
+
| Component | File | Size |
|
| 53 |
+
|---|---|---:|
|
| 54 |
+
| UNet | `unet.safetensors` | 452.55 MB |
|
| 55 |
+
| VAE encoder | `vae_encoder.safetensors` | 68.34 MB |
|
| 56 |
+
| VAE decoder | `vae_decoder.safetensors` | 99.00 MB |
|
| 57 |
+
|
| 58 |
+
## Files in this folder
|
| 59 |
+
|
| 60 |
+
- `unet.safetensors` (selected by manifest)
|
| 61 |
+
- `vae_decoder.safetensors` (selected by manifest)
|
| 62 |
+
- `vae_encoder.safetensors` (selected by manifest)
|
| 63 |
+
- `manifest.json` (runtime metadata and file selection)
|
| 64 |
+
|
| 65 |
+
A minimal runtime package needs `manifest.json` and the manifest-selected files above. Extra source or fallback files are optional and are not required for inference.
|
| 66 |
+
|
| 67 |
+
## Runtime expectations
|
| 68 |
+
|
| 69 |
+
This is not a Transformers or Diffusers-native checkpoint. It is intended for the Swift/MLX runtime in [Moebius-MLX](https://github.com/kylehowells/Moebius-MLX). The runtime reads `manifest.json`, loads the selected safetensors files, builds the Moebius UNet and VAE modules, and runs the DDIM inpainting pipeline.
|
| 70 |
+
|
| 71 |
+
Pipeline constants must match the manifest:
|
| 72 |
+
|
| 73 |
+
- DDIM scheduler: `scaled_linear`, beta start 0.00085, beta end 0.012, 1000 train timesteps, clip sample false
|
| 74 |
+
- 512 x 512 image resolution and 64 x 64 latent resolution
|
| 75 |
+
- 9-channel UNet input: noisy latent, mask, and masked-image latent
|
| 76 |
+
- VAE scaling factor 0.13025
|
| 77 |
+
|
| 78 |
+
|
| 79 |
+
## Attribution
|
| 80 |
+
|
| 81 |
+
Moebius was released by the original authors as [hustvl/Moebius](https://huggingface.co/hustvl/Moebius). This folder is a format conversion and/or quantized MLX packaging of the original PyTorch weights, not a newly trained model.
|
manifest.json
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"formatVersion": 1,
|
| 3 |
+
"modelName": "ft_celebahq",
|
| 4 |
+
"sourceCheckpoint": "Moebius-Models/ft_celebahq/diffusion_pytorch_model.bin",
|
| 5 |
+
"precision": "f16",
|
| 6 |
+
"imageSize": 512,
|
| 7 |
+
"latentSize": 64,
|
| 8 |
+
"latentChannels": 4,
|
| 9 |
+
"maskChannels": 1,
|
| 10 |
+
"conditioningIDs": 20,
|
| 11 |
+
"scalingFactor": 0.13025,
|
| 12 |
+
"noiseOffset": 0.0357,
|
| 13 |
+
"scheduler": {
|
| 14 |
+
"betaStart": 0.00085,
|
| 15 |
+
"betaEnd": 0.012,
|
| 16 |
+
"trainTimesteps": 1000,
|
| 17 |
+
"betaSchedule": "scaled_linear",
|
| 18 |
+
"clipSample": false
|
| 19 |
+
},
|
| 20 |
+
"files": {
|
| 21 |
+
"unet": "unet.safetensors",
|
| 22 |
+
"vaeEncoder": "vae_encoder.safetensors",
|
| 23 |
+
"vaeDecoder": "vae_decoder.safetensors"
|
| 24 |
+
}
|
| 25 |
+
}
|
unet.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a7b2473e4bc60a7e67575b90a7f8df8605a06f31d3e52a0c9f7924489fb5b53
|
| 3 |
+
size 452551146
|
vae_decoder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:08778bbb4b48640ad16381904eeeb99635846eb24409f70ae7fdc8eb01a87e76
|
| 3 |
+
size 98995758
|
vae_encoder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f096b397453c9d77ad935eaee614fb573d2b07fd57bde80a8986ed203f08a5de
|
| 3 |
+
size 68339216
|