Text-to-Image
Diffusers
Safetensors
StableDiffusionPipeline
clover-image
diffusion
stable-diffusion
knowledge-distillation
compact
local-inference
Instructions to use neonforestmist/Clover-Image-Tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use neonforestmist/Clover-Image-Tiny with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("neonforestmist/Clover-Image-Tiny", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Publish validated Clover Image Tiny research preview
Browse files- README.md +82 -6
- checksums.json +2 -2
- research_preview.json +3 -3
README.md
CHANGED
|
@@ -37,10 +37,10 @@ claim of uniformly better output than its starting model.
|
|
| 37 |
| Checkpoint-bundle SHA-256 | `384b6515f5f26838aea33ec9a941e06610a20764f0b8637c8b7b0667bfc0d447` |
|
| 38 |
| Resolved-config SHA-256 | `80cf9395d1f587dc0c1d440d9f5b55c55c20703187998509bb306d19d463f597` |
|
| 39 |
| Dataset-manifest SHA-256 | `50c1249f1cb0d8d690a9acc451ca10c9432eb5a7f4e26f34acb5462096e72322` |
|
| 40 |
-
| Package bytes | `
|
| 41 |
| Package files | `30` |
|
| 42 |
| Validated Stage B source-package checksums SHA-256 | `d9a28d5fe6f5b675ee1b9db52e6d0493c8d3d357bb824eac590911acbd5c3ebc` |
|
| 43 |
-
| Builder source commit | `
|
| 44 |
|
| 45 |
The checkpoint completed 500 optimizer steps, 4,000 microsteps, and 4,000
|
| 46 |
sample presentations. All 500 recorded training rows were finite and had a
|
|
@@ -64,15 +64,91 @@ small engineering subset is not a general safety or quality evaluation. The
|
|
| 64 |
changes are modest and not uniformly better: the bottle example loses prompt
|
| 65 |
fidelity, hands remain weak, and some details change without clear improvement.
|
| 66 |
|
| 67 |
-
## Run
|
| 68 |
|
| 69 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
|
| 71 |
```bash
|
| 72 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 73 |
```
|
| 74 |
|
| 75 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
|
| 77 |
```python
|
| 78 |
import torch
|
|
|
|
| 37 |
| Checkpoint-bundle SHA-256 | `384b6515f5f26838aea33ec9a941e06610a20764f0b8637c8b7b0667bfc0d447` |
|
| 38 |
| Resolved-config SHA-256 | `80cf9395d1f587dc0c1d440d9f5b55c55c20703187998509bb306d19d463f597` |
|
| 39 |
| Dataset-manifest SHA-256 | `50c1249f1cb0d8d690a9acc451ca10c9432eb5a7f4e26f34acb5462096e72322` |
|
| 40 |
+
| Package bytes | `1671492371` |
|
| 41 |
| Package files | `30` |
|
| 42 |
| Validated Stage B source-package checksums SHA-256 | `d9a28d5fe6f5b675ee1b9db52e6d0493c8d3d357bb824eac590911acbd5c3ebc` |
|
| 43 |
+
| Builder source commit | `e6079eec2b91c5d026bfb461fd6c844a98b888ec` |
|
| 44 |
|
| 45 |
The checkpoint completed 500 optimizer steps, 4,000 microsteps, and 4,000
|
| 46 |
sample presentations. All 500 recorded training rows were finite and had a
|
|
|
|
| 64 |
changes are modest and not uniformly better: the bottle example loses prompt
|
| 65 |
fidelity, hands remain weak, and some details change without clear improvement.
|
| 66 |
|
| 67 |
+
## Run locally
|
| 68 |
|
| 69 |
+
This is a conventional PyTorch/Diffusers model, so it can run on macOS,
|
| 70 |
+
Windows, or Linux. Use Python 3.11 or 3.12 and allow about 2 GB of free disk
|
| 71 |
+
space for the model itself. Mac MPS is the only local runtime measured for this
|
| 72 |
+
preview; Windows/Linux CUDA and CPU execution are supported by the runner but
|
| 73 |
+
their performance is not claimed here.
|
| 74 |
+
|
| 75 |
+
### macOS Apple silicon — MPS
|
| 76 |
+
|
| 77 |
+
These commands download a complete local copy, install the pinned runtime in
|
| 78 |
+
an isolated environment, and generate through MPS:
|
| 79 |
|
| 80 |
```bash
|
| 81 |
+
mkdir clover-image-tiny-local
|
| 82 |
+
cd clover-image-tiny-local
|
| 83 |
+
|
| 84 |
+
python3.12 -m venv .venv
|
| 85 |
+
source .venv/bin/activate
|
| 86 |
+
python -m pip install --upgrade pip
|
| 87 |
+
python -m pip install "huggingface-hub==0.36.2"
|
| 88 |
+
|
| 89 |
+
hf download "neonforestmist/Clover-Image-Tiny" --local-dir model
|
| 90 |
+
python -m pip install -r model/requirements.txt
|
| 91 |
+
|
| 92 |
+
python model/examples/generate.py \
|
| 93 |
+
--model model \
|
| 94 |
+
--device mps \
|
| 95 |
+
--local-files-only \
|
| 96 |
+
--prompt "a compact modern library with arched windows" \
|
| 97 |
+
--seed 1469 \
|
| 98 |
+
--output clover-image-tiny.png
|
| 99 |
+
|
| 100 |
+
open clover-image-tiny.png
|
| 101 |
+
```
|
| 102 |
+
|
| 103 |
+
If `python3.12` is not installed but Python 3.11 is, use `python3.11` instead.
|
| 104 |
+
After the first download, `--local-files-only` keeps inference offline. The
|
| 105 |
+
script writes the resolved runtime settings beside the PNG as
|
| 106 |
+
`clover-image-tiny.png.json`. This is the PyTorch/Diffusers model; no Core ML or
|
| 107 |
+
iPhone package is required or included.
|
| 108 |
+
|
| 109 |
+
### Windows — PowerShell
|
| 110 |
+
|
| 111 |
+
On Windows, the same runner automatically selects an available NVIDIA CUDA GPU
|
| 112 |
+
and otherwise falls back to CPU:
|
| 113 |
+
|
| 114 |
+
```powershell
|
| 115 |
+
mkdir clover-image-tiny-local
|
| 116 |
+
cd clover-image-tiny-local
|
| 117 |
+
|
| 118 |
+
py -3.12 -m venv .venv
|
| 119 |
+
.venv\Scripts\Activate.ps1
|
| 120 |
+
python -m pip install --upgrade pip
|
| 121 |
+
python -m pip install "huggingface-hub==0.36.2"
|
| 122 |
+
|
| 123 |
+
hf download "neonforestmist/Clover-Image-Tiny" --local-dir model
|
| 124 |
+
python -m pip install -r model\requirements.txt
|
| 125 |
+
|
| 126 |
+
python model\examples\generate.py `
|
| 127 |
+
--model model `
|
| 128 |
+
--device auto `
|
| 129 |
+
--local-files-only `
|
| 130 |
+
--prompt "a compact modern library with arched windows" `
|
| 131 |
+
--seed 1469 `
|
| 132 |
+
--output clover-image-tiny.png
|
| 133 |
+
|
| 134 |
+
Invoke-Item .\clover-image-tiny.png
|
| 135 |
```
|
| 136 |
|
| 137 |
+
Use `py -3.11` if that is the installed supported Python. Check
|
| 138 |
+
`python -c "import torch; print(torch.cuda.is_available())"` after installation;
|
| 139 |
+
`False` means `--device auto` will use CPU. A Windows AMD/DirectML path is not
|
| 140 |
+
included or validated.
|
| 141 |
+
|
| 142 |
+
### Linux
|
| 143 |
+
|
| 144 |
+
Use the macOS shell flow with `python3.11` or `python3.12`, and replace
|
| 145 |
+
`--device mps` with `--device auto`. It selects CUDA when PyTorch can see an
|
| 146 |
+
NVIDIA GPU and otherwise uses CPU.
|
| 147 |
+
|
| 148 |
+
### Python API
|
| 149 |
+
|
| 150 |
+
The equivalent conventional configuration, with automatic CUDA/MPS/CPU
|
| 151 |
+
selection, is:
|
| 152 |
|
| 153 |
```python
|
| 154 |
import torch
|
checksums.json
CHANGED
|
@@ -4,7 +4,7 @@
|
|
| 4 |
"LICENSE-CODE": "e26a0375b714267325c27905ba947fdc41ebc0b7a36940a49ae12379ed6208d6",
|
| 5 |
"LICENSE-MODEL-CREATIVEML-OPENRAIL-M.txt": "be351ebe7ac01bcdbb018639aadcfd38f136b7dc3f2a3d4d3a24db51d1b210ef",
|
| 6 |
"MODEL_DATA_LICENSES.md": "8f6b712826f9904561fb32038635612722be61cfd776da58fb61a4848a03148e",
|
| 7 |
-
"README.md": "
|
| 8 |
"assets/clover-image-tiny-local-mps-library-seed-1469.png": "f8830346f2a9c2b9a8c2a01d8f90e6925c93d667c1bcf998aa904a150589a742",
|
| 9 |
"assets/clover-image-tiny-paired-contact-sheet.png": "8653d1105b7b0c56e2385a127336dbe9b3a1a03c8518edb4934353a9d8e13bfa",
|
| 10 |
"evidence/clover-image-tiny-local-mps-library-seed-1469.json": "1ddd86de0be992987214266720e0f341f25791402aae637065d6d09a6ea67b27",
|
|
@@ -13,7 +13,7 @@
|
|
| 13 |
"feature_extractor/preprocessor_config.json": "205d45875859846dc1ca211b9a19f5db72f47e953b396954ee34d48d8e95c3c6",
|
| 14 |
"model_index.json": "792073e269e5caff40b3f8c553387540c17a5d900ed0e9cbfab309d650e708dd",
|
| 15 |
"requirements.txt": "9dbb74869a34e3b610f737bce8a9d2a20691fd0fa416cf6bb42354b78e0a3861",
|
| 16 |
-
"research_preview.json": "
|
| 17 |
"safety_checker/config.json": "241bd8fb1ba6feff0d7421f7af0f85743711c5d76353626f71f7e2cc8009ac7c",
|
| 18 |
"safety_checker/model.safetensors": "57ecdfa243b170f9b4cb3eefaf0f64552ef78fc0bf0eb1c5b9675308447184f6",
|
| 19 |
"scheduler/scheduler_config.json": "184bc33ed887951dd86e37f20c878710c4e18e1c5fd4461256a3825679b53d15",
|
|
|
|
| 4 |
"LICENSE-CODE": "e26a0375b714267325c27905ba947fdc41ebc0b7a36940a49ae12379ed6208d6",
|
| 5 |
"LICENSE-MODEL-CREATIVEML-OPENRAIL-M.txt": "be351ebe7ac01bcdbb018639aadcfd38f136b7dc3f2a3d4d3a24db51d1b210ef",
|
| 6 |
"MODEL_DATA_LICENSES.md": "8f6b712826f9904561fb32038635612722be61cfd776da58fb61a4848a03148e",
|
| 7 |
+
"README.md": "0200ca5dddc849ea3ce88861990f91254e04957f50f2ac96b6802e9efbc2698a",
|
| 8 |
"assets/clover-image-tiny-local-mps-library-seed-1469.png": "f8830346f2a9c2b9a8c2a01d8f90e6925c93d667c1bcf998aa904a150589a742",
|
| 9 |
"assets/clover-image-tiny-paired-contact-sheet.png": "8653d1105b7b0c56e2385a127336dbe9b3a1a03c8518edb4934353a9d8e13bfa",
|
| 10 |
"evidence/clover-image-tiny-local-mps-library-seed-1469.json": "1ddd86de0be992987214266720e0f341f25791402aae637065d6d09a6ea67b27",
|
|
|
|
| 13 |
"feature_extractor/preprocessor_config.json": "205d45875859846dc1ca211b9a19f5db72f47e953b396954ee34d48d8e95c3c6",
|
| 14 |
"model_index.json": "792073e269e5caff40b3f8c553387540c17a5d900ed0e9cbfab309d650e708dd",
|
| 15 |
"requirements.txt": "9dbb74869a34e3b610f737bce8a9d2a20691fd0fa416cf6bb42354b78e0a3861",
|
| 16 |
+
"research_preview.json": "335222a4369df359b01bb403eae165831cf3269a14b7b1c3a458c3bd1b9c4f38",
|
| 17 |
"safety_checker/config.json": "241bd8fb1ba6feff0d7421f7af0f85743711c5d76353626f71f7e2cc8009ac7c",
|
| 18 |
"safety_checker/model.safetensors": "57ecdfa243b170f9b4cb3eefaf0f64552ef78fc0bf0eb1c5b9675308447184f6",
|
| 19 |
"scheduler/scheduler_config.json": "184bc33ed887951dd86e37f20c878710c4e18e1c5fd4461256a3825679b53d15",
|
research_preview.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"build": {
|
| 3 |
-
"repository_commit": "
|
| 4 |
"sources": {
|
| 5 |
"LICENSE-CODE": {
|
| 6 |
"sha256": "e26a0375b714267325c27905ba947fdc41ebc0b7a36940a49ae12379ed6208d6",
|
|
@@ -27,7 +27,7 @@
|
|
| 27 |
"tracked_at_commit": true
|
| 28 |
},
|
| 29 |
"hf/stage_b_preview/README.template.md": {
|
| 30 |
-
"sha256": "
|
| 31 |
"tracked_at_commit": true
|
| 32 |
},
|
| 33 |
"hf/stage_b_preview/examples/generate.py": {
|
|
@@ -116,7 +116,7 @@
|
|
| 116 |
"human_review": "not_measured",
|
| 117 |
"quality_evaluation": "not_measured"
|
| 118 |
},
|
| 119 |
-
"metadata_sha256": "
|
| 120 |
"release_ready": false,
|
| 121 |
"runtime_contract": {
|
| 122 |
"denoiser_calls": 51,
|
|
|
|
| 1 |
{
|
| 2 |
"build": {
|
| 3 |
+
"repository_commit": "e6079eec2b91c5d026bfb461fd6c844a98b888ec",
|
| 4 |
"sources": {
|
| 5 |
"LICENSE-CODE": {
|
| 6 |
"sha256": "e26a0375b714267325c27905ba947fdc41ebc0b7a36940a49ae12379ed6208d6",
|
|
|
|
| 27 |
"tracked_at_commit": true
|
| 28 |
},
|
| 29 |
"hf/stage_b_preview/README.template.md": {
|
| 30 |
+
"sha256": "345bf548f79f97dfa2eebc57911f9073416ce558ad5b7e51425cdfe6841e2109",
|
| 31 |
"tracked_at_commit": true
|
| 32 |
},
|
| 33 |
"hf/stage_b_preview/examples/generate.py": {
|
|
|
|
| 116 |
"human_review": "not_measured",
|
| 117 |
"quality_evaluation": "not_measured"
|
| 118 |
},
|
| 119 |
+
"metadata_sha256": "5e6874ce0dd7a762fe0ef043fed3311299e2f191f48e20f4c022a584d803cfe3",
|
| 120 |
"release_ready": false,
|
| 121 |
"runtime_contract": {
|
| 122 |
"denoiser_calls": 51,
|