jsanzolac's picture
Upload README.md with huggingface_hub
2695ee4 verified
metadata
language:
  - en
license: apache-2.0
tags:
  - glove
  - lora
  - msmarco
  - hard-negatives
  - infonce
base_model: jsanzolac/drifting-glove-distilled-r300
datasets:
  - sentence-transformers/msmarco-msmarco-distilbert-base-v3

drifting-glove-distilled-r300_msmarco_ft

Stage 2 supervised fine-tuning of jsanzolac/drifting-glove-distilled-r300 on MS MARCO triplet-50 with InfoNCE-only (no MSE), 1 epoch, batch=256, K=6 mined hard negatives per anchor, τ=0.02.

Trainable: A.weight, B.weight only. E (frozen 300-d cl100k GloVe from jsanzolac/drifting-glove-distilled-r300) is excluded from the saved state dict.