Sentence Similarity
GGUF
Q4_K_M
text-embeddings
feature-extraction
retrieval
semantic-search
rag
lm-studio
llama-cpp
Instructions to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF", filename="nemotron-3-embed-1b-q4_k_m.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
Use Docker
docker model run hf.co/zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with Ollama:
ollama run hf.co/zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
- Unsloth Studio
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF to start chatting
- Atomic Chat new
- Docker Model Runner
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with Docker Model Runner:
docker model run hf.co/zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
- Lemonade
How to use zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Nemotron-3-Embed-1B-Q4_K_M-GGUF-Q4_K_M
List all available models
lemonade list
Publish Nemotron-3-Embed-1B Q4_K_M GGUF
Browse filesIndependent llama.cpp b10015 conversion of nvidia/Nemotron-3-Embed-1B-BF16 at revision 0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b. Includes OpenMDW-1.1 license, NVIDIA notices, exact checksum, conversion provenance, LM Studio instructions, limitations, and validation results.
- .gitattributes +1 -0
- LICENSE +55 -0
- NOTICE +5 -0
- QUANTIZATION.md +72 -0
- README.md +162 -0
- SHA256SUMS +1 -0
- THIRD_PARTY_NOTICES.md +471 -0
- nemotron-3-embed-1b-q4_k_m.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
nemotron-3-embed-1b-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
|
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
All binary model files and source code files are licensed under the OpenMDW-1.1 License.
|
| 2 |
+
|
| 3 |
+
------------
|
| 4 |
+
Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
OpenMDW License Agreement, version 1.1 (OpenMDW-1.1)
|
| 8 |
+
|
| 9 |
+
By exercising rights granted to you under this agreement, you accept and agree
|
| 10 |
+
to its terms.
|
| 11 |
+
|
| 12 |
+
As used in this agreement, "Model Materials" means the materials provided to
|
| 13 |
+
you under this agreement, consisting of: (1) one or more machine learning
|
| 14 |
+
models (including architecture and parameters); and (2) all related artifacts
|
| 15 |
+
(including associated data, documentation and software) that are provided to
|
| 16 |
+
you hereunder.
|
| 17 |
+
|
| 18 |
+
Subject to your compliance with this agreement, permission is hereby granted,
|
| 19 |
+
free of charge, to deal in the Model Materials without restriction, including
|
| 20 |
+
under all copyright, patent, database, and trade secret rights included or
|
| 21 |
+
embodied therein.
|
| 22 |
+
|
| 23 |
+
If you distribute any portion of the Model Materials, you shall retain in your
|
| 24 |
+
distribution (1) a copy of this agreement, and (2) all copyright notices and
|
| 25 |
+
other notices of origin included in the Model Materials that are applicable to
|
| 26 |
+
your distribution.
|
| 27 |
+
|
| 28 |
+
If you file, maintain, or voluntarily participate in a lawsuit against any
|
| 29 |
+
person or entity asserting that the Model Materials directly or indirectly
|
| 30 |
+
infringe any patent or copyright, then all rights and grants made to you
|
| 31 |
+
hereunder are terminated, unless that lawsuit was in response to a
|
| 32 |
+
corresponding lawsuit first brought against you.
|
| 33 |
+
|
| 34 |
+
This agreement does not impose any restrictions or obligations with respect to
|
| 35 |
+
any use, modification, or sharing of any outputs generated by using the Model
|
| 36 |
+
Materials.
|
| 37 |
+
|
| 38 |
+
THE MODEL MATERIALS ARE PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
|
| 39 |
+
OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 40 |
+
FITNESS FOR A PARTICULAR PURPOSE, TITLE, NONINFRINGEMENT, ACCURACY, OR THE
|
| 41 |
+
ABSENCE OF LATENT OR OTHER DEFECTS OR ERRORS, WHETHER OR NOT DISCOVERABLE, ALL
|
| 42 |
+
TO THE GREATEST EXTENT PERMISSIBLE UNDER APPLICABLE LAW.
|
| 43 |
+
|
| 44 |
+
YOU ARE SOLELY RESPONSIBLE FOR (1) CLEARING RIGHTS OF OTHER PERSONS THAT MAY
|
| 45 |
+
APPLY TO THE MODEL MATERIALS OR ANY USE THEREOF, INCLUDING WITHOUT LIMITATION
|
| 46 |
+
ANY PERSON'S COPYRIGHTS OR OTHER RIGHTS INCLUDED OR EMBODIED IN THE MODEL
|
| 47 |
+
MATERIALS; (2) OBTAINING ANY NECESSARY CONSENTS, PERMISSIONS OR OTHER RIGHTS
|
| 48 |
+
REQUIRED FOR ANY USE OF THE MODEL MATERIALS; OR (3) PERFORMING ANY DUE
|
| 49 |
+
DILIGENCE OR UNDERTAKING ANY OTHER INVESTIGATIONS INTO THE MODEL MATERIALS OR
|
| 50 |
+
ANYTHING INCORPORATED OR EMBODIED THEREIN.
|
| 51 |
+
|
| 52 |
+
IN NO EVENT SHALL THE PROVIDERS OF THE MODEL MATERIALS BE LIABLE FOR ANY CLAIM,
|
| 53 |
+
DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
|
| 54 |
+
OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE MODEL MATERIALS, THE
|
| 55 |
+
USE THEREOF OR OTHER DEALINGS THEREIN.
|
NOTICE
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
mistralai/Ministral-3-3B-Instruct-2512 is licensed under the Apache-2.0 License.
|
| 2 |
+
|
| 3 |
+
- You must cause any modified files to carry prominent notices stating that You changed the files.
|
| 4 |
+
- You must retain, in the Source form of any Derivative Works that You distribute, all copyright, patent, trademark, and attribution notices from the Source form of the Work, excluding those notices that do not pertain to any part of the Derivative Works.
|
| 5 |
+
- If the Work includes a "NOTICE" text file as part of its distribution, then any Derivative Works that You distribute must include a readable copy of the attribution notices contained within such NOTICE file, excluding those notices that do not pertain to any part of the Derivative Works, in at least one of the following places: within a NOTICE text file distributed as part of the Derivative Works; within the Source form or documentation, if provided along with the Derivative Works; or within a display generated by the Derivative Works, if and wherever such third-party notices normally appear. The contents of the NOTICE file are for informational purposes only and do not modify the License. You may add Your own attribution notices within Derivative Works that You distribute, alongside or as an addendum to the NOTICE text from the Work, provided that such additional attribution notices cannot be construed as modifying the License.
|
QUANTIZATION.md
ADDED
|
@@ -0,0 +1,72 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Quantization and reproducibility record
|
| 2 |
+
|
| 3 |
+
## Source
|
| 4 |
+
|
| 5 |
+
- Model: `nvidia/Nemotron-3-Embed-1B-BF16`
|
| 6 |
+
- Revision: `0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b`
|
| 7 |
+
- Source format: BF16 Safetensors
|
| 8 |
+
- Upstream license: OpenMDW License Agreement 1.1
|
| 9 |
+
|
| 10 |
+
## Toolchain
|
| 11 |
+
|
| 12 |
+
- Project: `ggml-org/llama.cpp`
|
| 13 |
+
- Tag/build: `b10015`
|
| 14 |
+
- Commit: `12127defda4f41b7679cb2477a4b0d65ee6a0c8f`
|
| 15 |
+
- Converter: `convert_hf_to_gguf.py`
|
| 16 |
+
- Quantizer: `llama-quantize`
|
| 17 |
+
- Importance matrix: none
|
| 18 |
+
|
| 19 |
+
Equivalent command outline (local paths omitted):
|
| 20 |
+
|
| 21 |
+
```bash
|
| 22 |
+
python convert_hf_to_gguf.py \
|
| 23 |
+
nvidia--Nemotron-3-Embed-1B-BF16-snapshot \
|
| 24 |
+
--outfile nemotron-3-embed-1b-f16.gguf \
|
| 25 |
+
--outtype f16
|
| 26 |
+
|
| 27 |
+
llama-quantize \
|
| 28 |
+
nemotron-3-embed-1b-f16.gguf \
|
| 29 |
+
nemotron-3-embed-1b-q4_k_m.gguf \
|
| 30 |
+
Q4_K_M
|
| 31 |
+
```
|
| 32 |
+
|
| 33 |
+
## Output identity
|
| 34 |
+
|
| 35 |
+
- File: `nemotron-3-embed-1b-q4_k_m.gguf`
|
| 36 |
+
- Size: `749352096` bytes
|
| 37 |
+
- SHA-256: `9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d`
|
| 38 |
+
- GGUF version: 3
|
| 39 |
+
- Quantization version: 2
|
| 40 |
+
- GGUF file type: 15 (`Q4_K_M`)
|
| 41 |
+
- Tensor count: 146
|
| 42 |
+
- Metadata/data boundary: byte `7869600`
|
| 43 |
+
|
| 44 |
+
Selected embedded architecture metadata:
|
| 45 |
+
|
| 46 |
+
| Key | Value |
|
| 47 |
+
|---|---:|
|
| 48 |
+
| `general.architecture` | `mistral3` |
|
| 49 |
+
| `general.name` | `nvidia/Nemotron-3-Embed-1B-BF16` |
|
| 50 |
+
| `general.finetune` | `0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b` |
|
| 51 |
+
| `mistral3.block_count` | 16 |
|
| 52 |
+
| `mistral3.context_length` | 262144 |
|
| 53 |
+
| `mistral3.embedding_length` | 2048 |
|
| 54 |
+
| `mistral3.feed_forward_length` | 6144 |
|
| 55 |
+
| `mistral3.attention.head_count` | 24 |
|
| 56 |
+
| `mistral3.attention.head_count_kv` | 8 |
|
| 57 |
+
| `mistral3.attention.causal` | false |
|
| 58 |
+
| `mistral3.pooling_type` | 1 (mean) |
|
| 59 |
+
| `mistral3.vocab_size` | 131072 |
|
| 60 |
+
|
| 61 |
+
## Integrity check
|
| 62 |
+
|
| 63 |
+
```bash
|
| 64 |
+
shasum -a 256 nemotron-3-embed-1b-q4_k_m.gguf
|
| 65 |
+
```
|
| 66 |
+
|
| 67 |
+
Expected output:
|
| 68 |
+
|
| 69 |
+
```text
|
| 70 |
+
9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d nemotron-3-embed-1b-q4_k_m.gguf
|
| 71 |
+
```
|
| 72 |
+
|
README.md
CHANGED
|
@@ -1,3 +1,165 @@
|
|
| 1 |
---
|
| 2 |
license: openmdw-1.1
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: openmdw-1.1
|
| 3 |
+
base_model: nvidia/Nemotron-3-Embed-1B-BF16
|
| 4 |
+
base_model_relation: quantized
|
| 5 |
+
library_name: gguf
|
| 6 |
+
pipeline_tag: sentence-similarity
|
| 7 |
+
language:
|
| 8 |
+
- multilingual
|
| 9 |
+
- en
|
| 10 |
+
- ar
|
| 11 |
+
- as
|
| 12 |
+
- bn
|
| 13 |
+
- bg
|
| 14 |
+
- zh
|
| 15 |
+
- da
|
| 16 |
+
- nl
|
| 17 |
+
- fi
|
| 18 |
+
- fr
|
| 19 |
+
- de
|
| 20 |
+
- hi
|
| 21 |
+
- id
|
| 22 |
+
- it
|
| 23 |
+
- ja
|
| 24 |
+
- ko
|
| 25 |
+
- ms
|
| 26 |
+
- mr
|
| 27 |
+
- ne
|
| 28 |
+
- "no"
|
| 29 |
+
- fa
|
| 30 |
+
- pt
|
| 31 |
+
- ro
|
| 32 |
+
- ru
|
| 33 |
+
- es
|
| 34 |
+
- sw
|
| 35 |
+
- sv
|
| 36 |
+
- ta
|
| 37 |
+
- te
|
| 38 |
+
- th
|
| 39 |
+
- uk
|
| 40 |
+
- ur
|
| 41 |
+
- vi
|
| 42 |
+
tags:
|
| 43 |
+
- gguf
|
| 44 |
+
- Q4_K_M
|
| 45 |
+
- text-embeddings
|
| 46 |
+
- feature-extraction
|
| 47 |
+
- retrieval
|
| 48 |
+
- semantic-search
|
| 49 |
+
- rag
|
| 50 |
+
- lm-studio
|
| 51 |
+
- llama-cpp
|
| 52 |
+
- arxiv:2407.14679
|
| 53 |
+
- arxiv:2502.13595
|
| 54 |
---
|
| 55 |
+
|
| 56 |
+
# Nemotron-3-Embed-1B Q4_K_M GGUF
|
| 57 |
+
|
| 58 |
+
An independently converted and quantized GGUF of NVIDIA's
|
| 59 |
+
[`nvidia/Nemotron-3-Embed-1B-BF16`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16),
|
| 60 |
+
prepared for local embedding inference in LM Studio and llama.cpp-compatible runtimes.
|
| 61 |
+
|
| 62 |
+
This repository is not an official NVIDIA release and is not affiliated with or endorsed by NVIDIA.
|
| 63 |
+
|
| 64 |
+
## File
|
| 65 |
+
|
| 66 |
+
| File | Quantization | Size | SHA-256 |
|
| 67 |
+
|---|---:|---:|---|
|
| 68 |
+
| `nemotron-3-embed-1b-q4_k_m.gguf` | Q4_K_M | 749,352,096 bytes (714.6 MiB) | `9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d` |
|
| 69 |
+
|
| 70 |
+
The model produces 2,048-dimensional, L2-normalized embeddings. Its GGUF metadata declares a
|
| 71 |
+
262,144-token maximum context. The release was functionally tested at a 4,096-token context; very
|
| 72 |
+
large contexts were not validated and require substantially more memory.
|
| 73 |
+
|
| 74 |
+
## Use with LM Studio
|
| 75 |
+
|
| 76 |
+
Download the GGUF from **Files and versions**, then drag it into LM Studio or place it in LM Studio's
|
| 77 |
+
models directory. LM Studio should classify it as an embedding model.
|
| 78 |
+
|
| 79 |
+
Load it with a 4,096-token context and full GPU offload, start the local server, and call the
|
| 80 |
+
OpenAI-compatible embeddings endpoint:
|
| 81 |
+
|
| 82 |
+
```bash
|
| 83 |
+
curl http://127.0.0.1:1234/v1/embeddings \
|
| 84 |
+
-H 'Content-Type: application/json' \
|
| 85 |
+
-d '{
|
| 86 |
+
"model": "nemotron-3-embed-1b-q4",
|
| 87 |
+
"input": [
|
| 88 |
+
"query: What is retrieval-augmented generation?",
|
| 89 |
+
"passage: Retrieval-augmented generation adds retrieved documents to a model prompt."
|
| 90 |
+
]
|
| 91 |
+
}'
|
| 92 |
+
```
|
| 93 |
+
|
| 94 |
+
The exact model identifier can differ if LM Studio assigns another load name; check
|
| 95 |
+
`http://127.0.0.1:1234/v1/models` when needed.
|
| 96 |
+
|
| 97 |
+
## Retrieval format
|
| 98 |
+
|
| 99 |
+
Use the prefixes specified by NVIDIA:
|
| 100 |
+
|
| 101 |
+
- Queries: `query: <text>`
|
| 102 |
+
- Documents: `passage: <text>`
|
| 103 |
+
|
| 104 |
+
Embeddings are normalized, so cosine similarity and dot product give equivalent rankings (within
|
| 105 |
+
normal floating-point tolerance).
|
| 106 |
+
|
| 107 |
+
## Conversion provenance
|
| 108 |
+
|
| 109 |
+
- Upstream repository: [`nvidia/Nemotron-3-Embed-1B-BF16`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16)
|
| 110 |
+
- Exact upstream revision: [`0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16/commit/0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b)
|
| 111 |
+
- Conversion and quantization: [`llama.cpp`](https://github.com/ggml-org/llama.cpp) build `b10015`, commit [`12127defda4f41b7679cb2477a4b0d65ee6a0c8f`](https://github.com/ggml-org/llama.cpp/commit/12127defda4f41b7679cb2477a4b0d65ee6a0c8f)
|
| 112 |
+
- Conversion path: upstream BF16 Safetensors → F16 GGUF → Q4_K_M GGUF
|
| 113 |
+
- Importance matrix: none
|
| 114 |
+
- Output GGUF version: 3
|
| 115 |
+
- Quantization version: 2
|
| 116 |
+
|
| 117 |
+
The conversion was mechanical. The model was not fine-tuned or otherwise trained. See
|
| 118 |
+
[`QUANTIZATION.md`](QUANTIZATION.md) for the reproducibility record and embedded metadata summary.
|
| 119 |
+
|
| 120 |
+
## Validation
|
| 121 |
+
|
| 122 |
+
Validated on an Apple M3 Max with LM Studio 0.4.19 Build 2 and its llama.cpp runtime 2.25.2, using
|
| 123 |
+
full GPU offload and a 4,096-token context.
|
| 124 |
+
|
| 125 |
+
| Check | Result |
|
| 126 |
+
|---|---:|
|
| 127 |
+
| Output dimensions | 2,048 |
|
| 128 |
+
| L2 norm (three test vectors) | 1.00000002 / 1.00000001 / 0.99999997 |
|
| 129 |
+
| Relevant query/passage cosine | 0.654999 |
|
| 130 |
+
| Unrelated query/passage cosine | 0.044103 |
|
| 131 |
+
| Median latency, one input | 30.46 ms |
|
| 132 |
+
| Median batch time, 32 inputs | 974.98 ms |
|
| 133 |
+
| Median batch throughput | 32.82 texts/s |
|
| 134 |
+
|
| 135 |
+
Latency includes local HTTP and JSON serialization. These numbers are a runtime smoke test, not a
|
| 136 |
+
retrieval-quality evaluation. Hardware, text length, context settings, and runtime versions affect
|
| 137 |
+
performance.
|
| 138 |
+
|
| 139 |
+
## Limitations
|
| 140 |
+
|
| 141 |
+
- Q4_K_M is lossy and can change retrieval scores or rankings relative to the upstream BF16 model.
|
| 142 |
+
- No MTEB/MMTEB accuracy evaluation was run on this quantization; consult NVIDIA's upstream model
|
| 143 |
+
card for BF16 benchmark results.
|
| 144 |
+
- This model is intended for embeddings, retrieval, semantic search, and reranking pipelines. It is
|
| 145 |
+
not a chat or text-generation model.
|
| 146 |
+
- Users remain responsible for evaluating model behavior, data handling, and suitability for their
|
| 147 |
+
application.
|
| 148 |
+
|
| 149 |
+
## License and attribution
|
| 150 |
+
|
| 151 |
+
The model materials are distributed under the
|
| 152 |
+
[OpenMDW License Agreement 1.1](https://openmdw.ai/license/1-1/). The upstream model incorporates
|
| 153 |
+
Ministral-3-3B-Instruct-2512 materials released under Apache 2.0.
|
| 154 |
+
|
| 155 |
+
This repository retains NVIDIA's [`LICENSE`](LICENSE), [`NOTICE`](NOTICE), and
|
| 156 |
+
[`THIRD_PARTY_NOTICES.md`](THIRD_PARTY_NOTICES.md). By using or distributing the model, you agree to
|
| 157 |
+
the applicable license terms. NVIDIA retains ownership of its names and trademarks; their use here
|
| 158 |
+
is solely to identify the upstream model.
|
| 159 |
+
|
| 160 |
+
## Upstream resources
|
| 161 |
+
|
| 162 |
+
- [NVIDIA upstream model card](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16)
|
| 163 |
+
- [NVIDIA Nemotron-3-Embed blog post](https://huggingface.co/blog/nvidia/nemotron-3-embed-wins-rteb)
|
| 164 |
+
- [Compact Language Models via Pruning and Knowledge Distillation](https://arxiv.org/abs/2407.14679)
|
| 165 |
+
- [MMTEB: Massive Multilingual Text Embedding Benchmark](https://arxiv.org/abs/2502.13595)
|
SHA256SUMS
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d nemotron-3-embed-1b-q4_k_m.gguf
|
THIRD_PARTY_NOTICES.md
ADDED
|
@@ -0,0 +1,471 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Copyright "Hugging Face, Inc." - Apache License 2.0
|
| 2 |
+
|
| 3 |
+
License Text([https://github.com/huggingface/sentence-transformers/blob/main/LICENSE](https://github.com/huggingface/sentence-transformers/blob/main/LICENSE))
|
| 4 |
+
|
| 5 |
+
This notice applies to **sentence-transformers**.
|
| 6 |
+
|
| 7 |
+
Copyright 2019-2025
|
| 8 |
+
|
| 9 |
+
Ubiquitous Knowledge Processing (UKP) Lab
|
| 10 |
+
|
| 11 |
+
Technische Universität Darmstadt
|
| 12 |
+
|
| 13 |
+
Copyright 2025-present
|
| 14 |
+
|
| 15 |
+
Hugging Face, Inc.
|
| 16 |
+
|
| 17 |
+
Apache License
|
| 18 |
+
Version 2.0, January 2004
|
| 19 |
+
http://www.apache.org/licenses/
|
| 20 |
+
|
| 21 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 22 |
+
|
| 23 |
+
1. Definitions.
|
| 24 |
+
|
| 25 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 26 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 27 |
+
|
| 28 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 29 |
+
the copyright owner that is granting the License.
|
| 30 |
+
|
| 31 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 32 |
+
other entities that control, are controlled by, or are under common
|
| 33 |
+
control with that entity. For the purposes of this definition,
|
| 34 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 35 |
+
direction or management of such entity, whether by contract or
|
| 36 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 37 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 38 |
+
|
| 39 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 40 |
+
exercising permissions granted by this License.
|
| 41 |
+
|
| 42 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 43 |
+
including but not limited to software source code, documentation
|
| 44 |
+
source, and configuration files.
|
| 45 |
+
|
| 46 |
+
"Object" form shall mean any form resulting from mechanical
|
| 47 |
+
transformation or translation of a Source form, including but
|
| 48 |
+
not limited to compiled object code, generated documentation,
|
| 49 |
+
and conversions to other media types.
|
| 50 |
+
|
| 51 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 52 |
+
Object form, made available under the License, as indicated by a
|
| 53 |
+
copyright notice that is included in or attached to the work
|
| 54 |
+
(an example is provided in the Appendix below).
|
| 55 |
+
|
| 56 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 57 |
+
form, that is based on (or derived from) the Work and for which the
|
| 58 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 59 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 60 |
+
of this License, Derivative Works shall not include works that remain
|
| 61 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 62 |
+
the Work and Derivative Works thereof.
|
| 63 |
+
|
| 64 |
+
"Contribution" shall mean any work of authorship, including
|
| 65 |
+
the original version of the Work and any modifications or additions
|
| 66 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 67 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 68 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 69 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 70 |
+
means any form of electronic, verbal, or written communication sent
|
| 71 |
+
to the Licensor or its representatives, including but not limited to
|
| 72 |
+
communication on electronic mailing lists, source code control systems,
|
| 73 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 74 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 75 |
+
excluding communication that is conspicuously marked or otherwise
|
| 76 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 77 |
+
|
| 78 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 79 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 80 |
+
subsequently incorporated within the Work.
|
| 81 |
+
|
| 82 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 83 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 84 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 85 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 86 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 87 |
+
Work and such Derivative Works in Source or Object form.
|
| 88 |
+
|
| 89 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 90 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 91 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 92 |
+
(except as stated in this section) patent license to make, have made,
|
| 93 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 94 |
+
where such license applies only to those patent claims licensable
|
| 95 |
+
by such Contributor that are necessarily infringed by their
|
| 96 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 97 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 98 |
+
institute patent litigation against any entity (including a
|
| 99 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 100 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 101 |
+
or contributory patent infringement, then any patent licenses
|
| 102 |
+
granted to You under this License for that Work shall terminate
|
| 103 |
+
as of the date such litigation is filed.
|
| 104 |
+
|
| 105 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 106 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 107 |
+
modifications, and in Source or Object form, provided that You
|
| 108 |
+
meet the following conditions:
|
| 109 |
+
|
| 110 |
+
(a) You must give any other recipients of the Work or
|
| 111 |
+
Derivative Works a copy of this License; and
|
| 112 |
+
|
| 113 |
+
(b) You must cause any modified files to carry prominent notices
|
| 114 |
+
stating that You changed the files; and
|
| 115 |
+
|
| 116 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 117 |
+
that You distribute, all copyright, patent, trademark, and
|
| 118 |
+
attribution notices from the Source form of the Work,
|
| 119 |
+
excluding those notices that do not pertain to any part of
|
| 120 |
+
the Derivative Works; and
|
| 121 |
+
|
| 122 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 123 |
+
distribution, then any Derivative Works that You distribute must
|
| 124 |
+
include a readable copy of the attribution notices contained
|
| 125 |
+
within such NOTICE file, excluding those notices that do not
|
| 126 |
+
pertain to any part of the Derivative Works, in at least one
|
| 127 |
+
of the following places: within a NOTICE text file distributed
|
| 128 |
+
as part of the Derivative Works; within the Source form or
|
| 129 |
+
documentation, if provided along with the Derivative Works; or,
|
| 130 |
+
within a display generated by the Derivative Works, if and
|
| 131 |
+
wherever such third-party notices normally appear. The contents
|
| 132 |
+
of the NOTICE file are for informational purposes only and
|
| 133 |
+
do not modify the License. You may add Your own attribution
|
| 134 |
+
notices within Derivative Works that You distribute, alongside
|
| 135 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 136 |
+
that such additional attribution notices cannot be construed
|
| 137 |
+
as modifying the License.
|
| 138 |
+
|
| 139 |
+
You may add Your own copyright statement to Your modifications and
|
| 140 |
+
may provide additional or different license terms and conditions
|
| 141 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 142 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 143 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 144 |
+
the conditions stated in this License.
|
| 145 |
+
|
| 146 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 147 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 148 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 149 |
+
this License, without any additional terms or conditions.
|
| 150 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 151 |
+
the terms of any separate license agreement you may have executed
|
| 152 |
+
with Licensor regarding such Contributions.
|
| 153 |
+
|
| 154 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 155 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 156 |
+
except as required for reasonable and customary use in describing the
|
| 157 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 158 |
+
|
| 159 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 160 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 161 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 162 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 163 |
+
implied, including, without limitation, any warranties or conditions
|
| 164 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 165 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 166 |
+
appropriateness of using or redistributing the Work and assume any
|
| 167 |
+
risks associated with Your exercise of permissions under this License.
|
| 168 |
+
|
| 169 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 170 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 171 |
+
unless required by applicable law (such as deliberate and grossly
|
| 172 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 173 |
+
liable to You for damages, including any direct, indirect, special,
|
| 174 |
+
incidental, or consequential damages of any character arising as a
|
| 175 |
+
result of this License or out of the use or inability to use the
|
| 176 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 177 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 178 |
+
other commercial damages or losses), even if such Contributor
|
| 179 |
+
has been advised of the possibility of such damages.
|
| 180 |
+
|
| 181 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 182 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 183 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 184 |
+
or other liability obligations and/or rights consistent with this
|
| 185 |
+
License. However, in accepting such obligations, You may act only
|
| 186 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 187 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 188 |
+
defend, and hold each Contributor harmless for any liability
|
| 189 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 190 |
+
of your accepting any such warranty or additional liability.
|
| 191 |
+
|
| 192 |
+
END OF TERMS AND CONDITIONS
|
| 193 |
+
|
| 194 |
+
-----
|
| 195 |
+
|
| 196 |
+
|
| 197 |
+
Copyright "Hugging Face, Inc." - Apache License 2.0
|
| 198 |
+
License Text([https://github.com/huggingface/transformers/blob/main/LICENSE](https://github.com/huggingface/transformers/blob/main/LICENSE))
|
| 199 |
+
|
| 200 |
+
This notice applies to **transformers**.
|
| 201 |
+
|
| 202 |
+
Copyright 2018- The Hugging Face team. All rights reserved.
|
| 203 |
+
|
| 204 |
+
Apache License
|
| 205 |
+
Version 2.0, January 2004
|
| 206 |
+
http://www.apache.org/licenses/
|
| 207 |
+
|
| 208 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 209 |
+
|
| 210 |
+
1. Definitions.
|
| 211 |
+
|
| 212 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 213 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 214 |
+
|
| 215 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 216 |
+
the copyright owner that is granting the License.
|
| 217 |
+
|
| 218 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 219 |
+
other entities that control, are controlled by, or are under common
|
| 220 |
+
control with that entity. For the purposes of this definition,
|
| 221 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 222 |
+
direction or management of such entity, whether by contract or
|
| 223 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 224 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 225 |
+
|
| 226 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 227 |
+
exercising permissions granted by this License.
|
| 228 |
+
|
| 229 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 230 |
+
including but not limited to software source code, documentation
|
| 231 |
+
source, and configuration files.
|
| 232 |
+
|
| 233 |
+
"Object" form shall mean any form resulting from mechanical
|
| 234 |
+
transformation or translation of a Source form, including but
|
| 235 |
+
not limited to compiled object code, generated documentation,
|
| 236 |
+
and conversions to other media types.
|
| 237 |
+
|
| 238 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 239 |
+
Object form, made available under the License, as indicated by a
|
| 240 |
+
copyright notice that is included in or attached to the work
|
| 241 |
+
(an example is provided in the Appendix below).
|
| 242 |
+
|
| 243 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 244 |
+
form, that is based on (or derived from) the Work and for which the
|
| 245 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 246 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 247 |
+
of this License, Derivative Works shall not include works that remain
|
| 248 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 249 |
+
the Work and Derivative Works thereof.
|
| 250 |
+
|
| 251 |
+
"Contribution" shall mean any work of authorship, including
|
| 252 |
+
the original version of the Work and any modifications or additions
|
| 253 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 254 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 255 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 256 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 257 |
+
means any form of electronic, verbal, or written communication sent
|
| 258 |
+
to the Licensor or its representatives, including but not limited to
|
| 259 |
+
communication on electronic mailing lists, source code control systems,
|
| 260 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 261 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 262 |
+
excluding communication that is conspicuously marked or otherwise
|
| 263 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 264 |
+
|
| 265 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 266 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 267 |
+
subsequently incorporated within the Work.
|
| 268 |
+
|
| 269 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 270 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 271 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 272 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 273 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 274 |
+
Work and such Derivative Works in Source or Object form.
|
| 275 |
+
|
| 276 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 277 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 278 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 279 |
+
(except as stated in this section) patent license to make, have made,
|
| 280 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 281 |
+
where such license applies only to those patent claims licensable
|
| 282 |
+
by such Contributor that are necessarily infringed by their
|
| 283 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 284 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 285 |
+
institute patent litigation against any entity (including a
|
| 286 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 287 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 288 |
+
or contributory patent infringement, then any patent licenses
|
| 289 |
+
granted to You under this License for that Work shall terminate
|
| 290 |
+
as of the date such litigation is filed.
|
| 291 |
+
|
| 292 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 293 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 294 |
+
modifications, and in Source or Object form, provided that You
|
| 295 |
+
meet the following conditions:
|
| 296 |
+
|
| 297 |
+
(a) You must give any other recipients of the Work or
|
| 298 |
+
Derivative Works a copy of this License; and
|
| 299 |
+
|
| 300 |
+
(b) You must cause any modified files to carry prominent notices
|
| 301 |
+
stating that You changed the files; and
|
| 302 |
+
|
| 303 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 304 |
+
that You distribute, all copyright, patent, trademark, and
|
| 305 |
+
attribution notices from the Source form of the Work,
|
| 306 |
+
excluding those notices that do not pertain to any part of
|
| 307 |
+
the Derivative Works; and
|
| 308 |
+
|
| 309 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 310 |
+
distribution, then any Derivative Works that You distribute must
|
| 311 |
+
include a readable copy of the attribution notices contained
|
| 312 |
+
within such NOTICE file, excluding those notices that do not
|
| 313 |
+
pertain to any part of the Derivative Works, in at least one
|
| 314 |
+
of the following places: within a NOTICE text file distributed
|
| 315 |
+
as part of the Derivative Works; within the Source form or
|
| 316 |
+
documentation, if provided along with the Derivative Works; or,
|
| 317 |
+
within a display generated by the Derivative Works, if and
|
| 318 |
+
wherever such third-party notices normally appear. The contents
|
| 319 |
+
of the NOTICE file are for informational purposes only and
|
| 320 |
+
do not modify the License. You may add Your own attribution
|
| 321 |
+
notices within Derivative Works that You distribute, alongside
|
| 322 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 323 |
+
that such additional attribution notices cannot be construed
|
| 324 |
+
as modifying the License.
|
| 325 |
+
|
| 326 |
+
You may add Your own copyright statement to Your modifications and
|
| 327 |
+
may provide additional or different license terms and conditions
|
| 328 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 329 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 330 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 331 |
+
the conditions stated in this License.
|
| 332 |
+
|
| 333 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 334 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 335 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 336 |
+
this License, without any additional terms or conditions.
|
| 337 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 338 |
+
the terms of any separate license agreement you may have executed
|
| 339 |
+
with Licensor regarding such Contributions.
|
| 340 |
+
|
| 341 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 342 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 343 |
+
except as required for reasonable and customary use in describing the
|
| 344 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 345 |
+
|
| 346 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 347 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 348 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 349 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 350 |
+
implied, including, without limitation, any warranties or conditions
|
| 351 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 352 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 353 |
+
appropriateness of using or redistributing the Work and assume any
|
| 354 |
+
risks associated with Your exercise of permissions under this License.
|
| 355 |
+
|
| 356 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 357 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 358 |
+
unless required by applicable law (such as deliberate and grossly
|
| 359 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 360 |
+
liable to You for damages, including any direct, indirect, special,
|
| 361 |
+
incidental, or consequential damages of any character arising as a
|
| 362 |
+
result of this License or out of the use or inability to use the
|
| 363 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 364 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 365 |
+
other commercial damages or losses), even if such Contributor
|
| 366 |
+
has been advised of the possibility of such damages.
|
| 367 |
+
|
| 368 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 369 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 370 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 371 |
+
or other liability obligations and/or rights consistent with this
|
| 372 |
+
License. However, in accepting such obligations, You may act only
|
| 373 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 374 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 375 |
+
defend, and hold each Contributor harmless for any liability
|
| 376 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 377 |
+
of your accepting any such warranty or additional liability.
|
| 378 |
+
|
| 379 |
+
END OF TERMS AND CONDITIONS
|
| 380 |
+
|
| 381 |
+
-----
|
| 382 |
+
|
| 383 |
+
Copyright "PyTorch Contributors" - BSD-style License
|
| 384 |
+
License Text([https://github.com/pytorch/pytorch/blob/main/LICENSE](https://www.google.com/search?q=https://github.com/pytorch/pytorch/blob/main/LICENSE))
|
| 385 |
+
|
| 386 |
+
This notice applies to **torch**.
|
| 387 |
+
|
| 388 |
+
From PyTorch:
|
| 389 |
+
|
| 390 |
+
Copyright (c) 2016- Facebook, Inc (Adam Paszke)
|
| 391 |
+
Copyright (c) 2014- Facebook, Inc (Soumith Chintala)
|
| 392 |
+
Copyright (c) 2011-2014 Idiap Research Institute (Ronan Collobert)
|
| 393 |
+
Copyright (c) 2012-2014 Deepmind Technologies (Koray Kavukcuoglu)
|
| 394 |
+
Copyright (c) 2011-2012 NEC Laboratories America (Koray Kavukcuoglu)
|
| 395 |
+
Copyright (c) 2011-2013 NYU (Clement Farabet)
|
| 396 |
+
Copyright (c) 2006-2010 NEC Laboratories America (Ronan Collobert, Leon Bottou, Iain Melvin, Jason Weston)
|
| 397 |
+
Copyright (c) 2006 Idiap Research Institute (Samy Bengio)
|
| 398 |
+
Copyright (c) 2001-2004 Idiap Research Institute (Ronan Collobert, Samy Bengio, Johnny Mariethoz)
|
| 399 |
+
|
| 400 |
+
From Caffe2:
|
| 401 |
+
|
| 402 |
+
Copyright (c) 2016-present, Facebook Inc. All rights reserved.
|
| 403 |
+
|
| 404 |
+
All contributions by Facebook:
|
| 405 |
+
Copyright (c) 2016 Facebook Inc.
|
| 406 |
+
|
| 407 |
+
All contributions by Google:
|
| 408 |
+
Copyright (c) 2015 Google Inc.
|
| 409 |
+
All rights reserved.
|
| 410 |
+
|
| 411 |
+
All contributions by Yangqing Jia:
|
| 412 |
+
Copyright (c) 2015 Yangqing Jia
|
| 413 |
+
All rights reserved.
|
| 414 |
+
|
| 415 |
+
All contributions by Kakao Brain:
|
| 416 |
+
Copyright 2019-2020 Kakao Brain
|
| 417 |
+
|
| 418 |
+
All contributions by Cruise LLC:
|
| 419 |
+
Copyright (c) 2022 Cruise LLC.
|
| 420 |
+
All rights reserved.
|
| 421 |
+
|
| 422 |
+
All contributions by Tri Dao:
|
| 423 |
+
Copyright (c) 2024 Tri Dao.
|
| 424 |
+
All rights reserved.
|
| 425 |
+
|
| 426 |
+
All contributions by Arm:
|
| 427 |
+
Copyright (c) 2021, 2023-2025 Arm Limited and/or its affiliates
|
| 428 |
+
|
| 429 |
+
All contributions from Caffe:
|
| 430 |
+
Copyright(c) 2013, 2014, 2015, the respective contributors
|
| 431 |
+
All rights reserved.
|
| 432 |
+
|
| 433 |
+
All other contributions:
|
| 434 |
+
Copyright(c) 2015, 2016 the respective contributors
|
| 435 |
+
All rights reserved.
|
| 436 |
+
|
| 437 |
+
Caffe2 uses a copyright model similar to Caffe: each contributor holds
|
| 438 |
+
copyright over their contributions to Caffe2. The project versioning records
|
| 439 |
+
all such contribution and copyright details. If a contributor wants to further
|
| 440 |
+
mark their specific copyright on a particular contribution, they should
|
| 441 |
+
indicate their copyright solely in the commit message of the change when it is
|
| 442 |
+
committed.
|
| 443 |
+
|
| 444 |
+
All rights reserved.
|
| 445 |
+
|
| 446 |
+
Redistribution and use in source and binary forms, with or without
|
| 447 |
+
modification, are permitted provided that the following conditions are met:
|
| 448 |
+
|
| 449 |
+
1. Redistributions of source code must retain the above copyright
|
| 450 |
+
notice, this list of conditions and the following disclaimer.
|
| 451 |
+
|
| 452 |
+
2. Redistributions in binary form must reproduce the above copyright
|
| 453 |
+
notice, this list of conditions and the following disclaimer in the
|
| 454 |
+
documentation and/or other materials provided with the distribution.
|
| 455 |
+
|
| 456 |
+
3. Neither the names of Facebook, Deepmind Technologies, NYU, NEC Laboratories America
|
| 457 |
+
and IDIAP Research Institute nor the names of its contributors may be
|
| 458 |
+
used to endorse or promote products derived from this software without
|
| 459 |
+
specific prior written permission.
|
| 460 |
+
|
| 461 |
+
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
|
| 462 |
+
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
| 463 |
+
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
| 464 |
+
ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE
|
| 465 |
+
LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
|
| 466 |
+
CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
|
| 467 |
+
SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
|
| 468 |
+
INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
|
| 469 |
+
CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
|
| 470 |
+
ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
|
| 471 |
+
POSSIBILITY OF SUCH DAMAGE.
|
nemotron-3-embed-1b-q4_k_m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d
|
| 3 |
+
size 749352096
|