Update README.md
Browse files
README.md
CHANGED
|
@@ -3,8 +3,15 @@ license: mit
|
|
| 3 |
base_model:
|
| 4 |
- facebook/dinov2-small
|
| 5 |
tags:
|
| 6 |
-
- VAE,
|
| 7 |
- SD
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
# SD/E2E-SD VAE to DINOv2 Bridge
|
| 10 |
GET Dino v2 features from SD VAE latents
|
|
@@ -157,7 +164,7 @@ pred_norm = F.normalize(pred_dino_features[0].float(), dim=-1)
|
|
| 157 |
target_norm = F.normalize(sample_target.to(device).float(), dim=-1)
|
| 158 |
sim = F.cosine_similarity(pred_norm, target_norm, dim=-1).mean().item()
|
| 159 |
print(f"Average Cosine Similarity for this sample: {sim:.4f}")
|
| 160 |
-
``
|
| 161 |
|
| 162 |
|
| 163 |
|
|
@@ -179,4 +186,4 @@ print(f"Average Cosine Similarity for this sample: {sim:.4f}")
|
|
| 179 |
| Best logged Retrieval@5 | `0.996364` |
|
| 180 |
| Best logged Retrieval@10 | `0.998636` |
|
| 181 |
|
| 182 |
-
The training log shows validation improving consistently from epoch 1 to epoch 6: cosine rose from `0.624136` to `0.759174`, NMSE fell from `0.610722` to `0.420825`, and Retrieval@1 rose from `0.751818` to `0.988182`. The run was interrupted during the final `latest.pt` save after `epoch_006.pt` had already been saved, so `best.pt` / `epoch_006.pt` are the safer checkpoints. :contentReference[oaicite:0]{index=0}
|
|
|
|
| 3 |
base_model:
|
| 4 |
- facebook/dinov2-small
|
| 5 |
tags:
|
|
|
|
| 6 |
- SD
|
| 7 |
+
- representation-learning,
|
| 8 |
+
- repa
|
| 9 |
+
- dinov2
|
| 10 |
+
- VAE
|
| 11 |
+
- stable-diffusion
|
| 12 |
+
- pytroch
|
| 13 |
+
datasets:
|
| 14 |
+
- kingsidharth/zangei-dit-stage-1-250k
|
| 15 |
---
|
| 16 |
# SD/E2E-SD VAE to DINOv2 Bridge
|
| 17 |
GET Dino v2 features from SD VAE latents
|
|
|
|
| 164 |
target_norm = F.normalize(sample_target.to(device).float(), dim=-1)
|
| 165 |
sim = F.cosine_similarity(pred_norm, target_norm, dim=-1).mean().item()
|
| 166 |
print(f"Average Cosine Similarity for this sample: {sim:.4f}")
|
| 167 |
+
```
|
| 168 |
|
| 169 |
|
| 170 |
|
|
|
|
| 186 |
| Best logged Retrieval@5 | `0.996364` |
|
| 187 |
| Best logged Retrieval@10 | `0.998636` |
|
| 188 |
|
| 189 |
+
The training log shows validation improving consistently from epoch 1 to epoch 6: cosine rose from `0.624136` to `0.759174`, NMSE fell from `0.610722` to `0.420825`, and Retrieval@1 rose from `0.751818` to `0.988182`. The run was interrupted during the final `latest.pt` save after `epoch_006.pt` had already been saved, so `best.pt` / `epoch_006.pt` are the safer checkpoints. :contentReference[oaicite:0]{index=0}
|