Instructions to use Qwen/Qwen3-Embedding-0.6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Qwen/Qwen3-Embedding-0.6B with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Qwen/Qwen3-Embedding-0.6B") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use Qwen/Qwen3-Embedding-0.6B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Qwen/Qwen3-Embedding-0.6B")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-Embedding-0.6B") model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen3-Embedding-0.6B") - Inference
- Notebooks
- Google Colab
- Kaggle
FileNotFoundError: [Errno 2] No such file or directory: 'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'
使用sentence-transformers加载qwen3 embedding报错,找不到'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'
版本如下:
sentence-transformers 4.1.0
transformers 4.52.4
请问这个是什么错误呢?我使用的代码就是demo中的代码,没有一点修改。
完整报错信息如下:
"""
Traceback (most recent call last):
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1808, in _load_sbert_model
module = module_class(model_name_or_path, cache_dir=cache_folder, backend=self.backend, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 81, in init
self._load_model(model_name_or_path, config, cache_dir, backend, is_peft_model, **model_args)
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 181, in _load_model
self.auto_model = AutoModel.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 571, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 309, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4508, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/models/qwen3/modeling_qwen3.py", line 389, in init
self.post_init()
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/transformers/modeling_utils.py", line 1969, in post_init
if v not in ALL_PARALLEL_STYLES:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: argument of type 'NoneType' is not iterable
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/data/zhaoxinpeng-slurm/workspace/embeddding/test.py", line 10, in
model = SentenceTransformer("Qwen/Qwen3-Embedding-0.6B")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 309, in init
modules, self.module_kwargs = self._load_sbert_model(
^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1810, in _load_sbert_model
module = module_class.load(model_name_or_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/zhaoxinpeng-slurm/miniconda3/envs/rag4sdu/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 536, in load
with open(sbert_config_path) as fIn:
^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'Qwen/Qwen3-Embedding-0.6B/sentence_xlnet_config.json'
"""
我也一样,包已经安装到最新的了
我发现transformers版本在4.51.0时候可以正常工作
非常感谢,我试了4.51.0,确实没有报错了