File size: 625 Bytes
2695ee4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
language:
- en
license: apache-2.0
tags:
- glove
- lora
- msmarco
- hard-negatives
- infonce
base_model: jsanzolac/drifting-glove-distilled-r300
datasets:
- sentence-transformers/msmarco-msmarco-distilbert-base-v3
---

# drifting-glove-distilled-r300_msmarco_ft

Stage 2 supervised fine-tuning of `jsanzolac/drifting-glove-distilled-r300` on MS MARCO `triplet-50` with
**InfoNCE-only** (no MSE), 1 epoch, batch=256, K=6 mined hard negatives per anchor, τ=0.02.

Trainable: `A.weight`, `B.weight` only. `E` (frozen 300-d cl100k GloVe from `jsanzolac/drifting-glove-distilled-r300`) is excluded from the saved state dict.