Thanks for the careful read. Your understanding is correct and we flag it in the post: the ordering among negatives is rank distillation from the miner, biases included.
One reason we suspect it's not mainly bias reproduction: the gains transfer outside the miner's distribution. The miners are GTE-ModernBERT / Nomic, yet the lead holds when we swap the first stage to Qwen3-VL-Embedding, and the model transfers zero-shot from EN to FR. A model that had mostly memorized miner quirks should be more brittle across those shifts. But that's indirect evidence, not the ablation you're asking for.
You're right that we haven't ablated the supervision source directly, though shuffled negatives and a pos-vs-neg-only partial order are cheap to run and would cleanly answer this. Adding them to the list, thanks for the suggestion!
Ishrat Jahan Ananya
coreprinciple
AI & ML interests
Information Retrieval, Multimodal AI, Agentic AI, Evaluations
Recent Activity
commentedon an article 1 day ago
One Adapter, Both Modalities: Field Notes from Building and Serving a Multimodal Reranker commentedon an article 3 days ago
One Adapter, Both Modalities: Field Notes from Building and Serving a Multimodal Reranker published an article 6 days ago
One Adapter, Both Modalities: Field Notes from Building and Serving a Multimodal Reranker