How to use OpenVINO/Qwen3-Reranker-0.6B-fp16-ov with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov") model = AutoModelForCausalLM.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov", device_map="auto")
