zenmagnets commited on
Commit
06df1fd
·
verified ·
1 Parent(s): ccbad67

Publish Nemotron-3-Embed-1B Q4_K_M GGUF

Browse files

Independent llama.cpp b10015 conversion of nvidia/Nemotron-3-Embed-1B-BF16 at revision 0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b. Includes OpenMDW-1.1 license, NVIDIA notices, exact checksum, conversion provenance, LM Studio instructions, limitations, and validation results.

Files changed (8) hide show
  1. .gitattributes +1 -0
  2. LICENSE +55 -0
  3. NOTICE +5 -0
  4. QUANTIZATION.md +72 -0
  5. README.md +162 -0
  6. SHA256SUMS +1 -0
  7. THIRD_PARTY_NOTICES.md +471 -0
  8. nemotron-3-embed-1b-q4_k_m.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ nemotron-3-embed-1b-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ All binary model files and source code files are licensed under the OpenMDW-1.1 License.
2
+
3
+ ------------
4
+ Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
5
+
6
+
7
+ OpenMDW License Agreement, version 1.1 (OpenMDW-1.1)
8
+
9
+ By exercising rights granted to you under this agreement, you accept and agree
10
+ to its terms.
11
+
12
+ As used in this agreement, "Model Materials" means the materials provided to
13
+ you under this agreement, consisting of: (1) one or more machine learning
14
+ models (including architecture and parameters); and (2) all related artifacts
15
+ (including associated data, documentation and software) that are provided to
16
+ you hereunder.
17
+
18
+ Subject to your compliance with this agreement, permission is hereby granted,
19
+ free of charge, to deal in the Model Materials without restriction, including
20
+ under all copyright, patent, database, and trade secret rights included or
21
+ embodied therein.
22
+
23
+ If you distribute any portion of the Model Materials, you shall retain in your
24
+ distribution (1) a copy of this agreement, and (2) all copyright notices and
25
+ other notices of origin included in the Model Materials that are applicable to
26
+ your distribution.
27
+
28
+ If you file, maintain, or voluntarily participate in a lawsuit against any
29
+ person or entity asserting that the Model Materials directly or indirectly
30
+ infringe any patent or copyright, then all rights and grants made to you
31
+ hereunder are terminated, unless that lawsuit was in response to a
32
+ corresponding lawsuit first brought against you.
33
+
34
+ This agreement does not impose any restrictions or obligations with respect to
35
+ any use, modification, or sharing of any outputs generated by using the Model
36
+ Materials.
37
+
38
+ THE MODEL MATERIALS ARE PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
39
+ OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
40
+ FITNESS FOR A PARTICULAR PURPOSE, TITLE, NONINFRINGEMENT, ACCURACY, OR THE
41
+ ABSENCE OF LATENT OR OTHER DEFECTS OR ERRORS, WHETHER OR NOT DISCOVERABLE, ALL
42
+ TO THE GREATEST EXTENT PERMISSIBLE UNDER APPLICABLE LAW.
43
+
44
+ YOU ARE SOLELY RESPONSIBLE FOR (1) CLEARING RIGHTS OF OTHER PERSONS THAT MAY
45
+ APPLY TO THE MODEL MATERIALS OR ANY USE THEREOF, INCLUDING WITHOUT LIMITATION
46
+ ANY PERSON'S COPYRIGHTS OR OTHER RIGHTS INCLUDED OR EMBODIED IN THE MODEL
47
+ MATERIALS; (2) OBTAINING ANY NECESSARY CONSENTS, PERMISSIONS OR OTHER RIGHTS
48
+ REQUIRED FOR ANY USE OF THE MODEL MATERIALS; OR (3) PERFORMING ANY DUE
49
+ DILIGENCE OR UNDERTAKING ANY OTHER INVESTIGATIONS INTO THE MODEL MATERIALS OR
50
+ ANYTHING INCORPORATED OR EMBODIED THEREIN.
51
+
52
+ IN NO EVENT SHALL THE PROVIDERS OF THE MODEL MATERIALS BE LIABLE FOR ANY CLAIM,
53
+ DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
54
+ OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE MODEL MATERIALS, THE
55
+ USE THEREOF OR OTHER DEALINGS THEREIN.
NOTICE ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ mistralai/Ministral-3-3B-Instruct-2512 is licensed under the Apache-2.0 License.
2
+
3
+ - You must cause any modified files to carry prominent notices stating that You changed the files.
4
+ - You must retain, in the Source form of any Derivative Works that You distribute, all copyright, patent, trademark, and attribution notices from the Source form of the Work, excluding those notices that do not pertain to any part of the Derivative Works.
5
+ - If the Work includes a "NOTICE" text file as part of its distribution, then any Derivative Works that You distribute must include a readable copy of the attribution notices contained within such NOTICE file, excluding those notices that do not pertain to any part of the Derivative Works, in at least one of the following places: within a NOTICE text file distributed as part of the Derivative Works; within the Source form or documentation, if provided along with the Derivative Works; or within a display generated by the Derivative Works, if and wherever such third-party notices normally appear. The contents of the NOTICE file are for informational purposes only and do not modify the License. You may add Your own attribution notices within Derivative Works that You distribute, alongside or as an addendum to the NOTICE text from the Work, provided that such additional attribution notices cannot be construed as modifying the License.
QUANTIZATION.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Quantization and reproducibility record
2
+
3
+ ## Source
4
+
5
+ - Model: `nvidia/Nemotron-3-Embed-1B-BF16`
6
+ - Revision: `0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b`
7
+ - Source format: BF16 Safetensors
8
+ - Upstream license: OpenMDW License Agreement 1.1
9
+
10
+ ## Toolchain
11
+
12
+ - Project: `ggml-org/llama.cpp`
13
+ - Tag/build: `b10015`
14
+ - Commit: `12127defda4f41b7679cb2477a4b0d65ee6a0c8f`
15
+ - Converter: `convert_hf_to_gguf.py`
16
+ - Quantizer: `llama-quantize`
17
+ - Importance matrix: none
18
+
19
+ Equivalent command outline (local paths omitted):
20
+
21
+ ```bash
22
+ python convert_hf_to_gguf.py \
23
+ nvidia--Nemotron-3-Embed-1B-BF16-snapshot \
24
+ --outfile nemotron-3-embed-1b-f16.gguf \
25
+ --outtype f16
26
+
27
+ llama-quantize \
28
+ nemotron-3-embed-1b-f16.gguf \
29
+ nemotron-3-embed-1b-q4_k_m.gguf \
30
+ Q4_K_M
31
+ ```
32
+
33
+ ## Output identity
34
+
35
+ - File: `nemotron-3-embed-1b-q4_k_m.gguf`
36
+ - Size: `749352096` bytes
37
+ - SHA-256: `9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d`
38
+ - GGUF version: 3
39
+ - Quantization version: 2
40
+ - GGUF file type: 15 (`Q4_K_M`)
41
+ - Tensor count: 146
42
+ - Metadata/data boundary: byte `7869600`
43
+
44
+ Selected embedded architecture metadata:
45
+
46
+ | Key | Value |
47
+ |---|---:|
48
+ | `general.architecture` | `mistral3` |
49
+ | `general.name` | `nvidia/Nemotron-3-Embed-1B-BF16` |
50
+ | `general.finetune` | `0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b` |
51
+ | `mistral3.block_count` | 16 |
52
+ | `mistral3.context_length` | 262144 |
53
+ | `mistral3.embedding_length` | 2048 |
54
+ | `mistral3.feed_forward_length` | 6144 |
55
+ | `mistral3.attention.head_count` | 24 |
56
+ | `mistral3.attention.head_count_kv` | 8 |
57
+ | `mistral3.attention.causal` | false |
58
+ | `mistral3.pooling_type` | 1 (mean) |
59
+ | `mistral3.vocab_size` | 131072 |
60
+
61
+ ## Integrity check
62
+
63
+ ```bash
64
+ shasum -a 256 nemotron-3-embed-1b-q4_k_m.gguf
65
+ ```
66
+
67
+ Expected output:
68
+
69
+ ```text
70
+ 9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d nemotron-3-embed-1b-q4_k_m.gguf
71
+ ```
72
+
README.md CHANGED
@@ -1,3 +1,165 @@
1
  ---
2
  license: openmdw-1.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: openmdw-1.1
3
+ base_model: nvidia/Nemotron-3-Embed-1B-BF16
4
+ base_model_relation: quantized
5
+ library_name: gguf
6
+ pipeline_tag: sentence-similarity
7
+ language:
8
+ - multilingual
9
+ - en
10
+ - ar
11
+ - as
12
+ - bn
13
+ - bg
14
+ - zh
15
+ - da
16
+ - nl
17
+ - fi
18
+ - fr
19
+ - de
20
+ - hi
21
+ - id
22
+ - it
23
+ - ja
24
+ - ko
25
+ - ms
26
+ - mr
27
+ - ne
28
+ - "no"
29
+ - fa
30
+ - pt
31
+ - ro
32
+ - ru
33
+ - es
34
+ - sw
35
+ - sv
36
+ - ta
37
+ - te
38
+ - th
39
+ - uk
40
+ - ur
41
+ - vi
42
+ tags:
43
+ - gguf
44
+ - Q4_K_M
45
+ - text-embeddings
46
+ - feature-extraction
47
+ - retrieval
48
+ - semantic-search
49
+ - rag
50
+ - lm-studio
51
+ - llama-cpp
52
+ - arxiv:2407.14679
53
+ - arxiv:2502.13595
54
  ---
55
+
56
+ # Nemotron-3-Embed-1B Q4_K_M GGUF
57
+
58
+ An independently converted and quantized GGUF of NVIDIA's
59
+ [`nvidia/Nemotron-3-Embed-1B-BF16`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16),
60
+ prepared for local embedding inference in LM Studio and llama.cpp-compatible runtimes.
61
+
62
+ This repository is not an official NVIDIA release and is not affiliated with or endorsed by NVIDIA.
63
+
64
+ ## File
65
+
66
+ | File | Quantization | Size | SHA-256 |
67
+ |---|---:|---:|---|
68
+ | `nemotron-3-embed-1b-q4_k_m.gguf` | Q4_K_M | 749,352,096 bytes (714.6 MiB) | `9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d` |
69
+
70
+ The model produces 2,048-dimensional, L2-normalized embeddings. Its GGUF metadata declares a
71
+ 262,144-token maximum context. The release was functionally tested at a 4,096-token context; very
72
+ large contexts were not validated and require substantially more memory.
73
+
74
+ ## Use with LM Studio
75
+
76
+ Download the GGUF from **Files and versions**, then drag it into LM Studio or place it in LM Studio's
77
+ models directory. LM Studio should classify it as an embedding model.
78
+
79
+ Load it with a 4,096-token context and full GPU offload, start the local server, and call the
80
+ OpenAI-compatible embeddings endpoint:
81
+
82
+ ```bash
83
+ curl http://127.0.0.1:1234/v1/embeddings \
84
+ -H 'Content-Type: application/json' \
85
+ -d '{
86
+ "model": "nemotron-3-embed-1b-q4",
87
+ "input": [
88
+ "query: What is retrieval-augmented generation?",
89
+ "passage: Retrieval-augmented generation adds retrieved documents to a model prompt."
90
+ ]
91
+ }'
92
+ ```
93
+
94
+ The exact model identifier can differ if LM Studio assigns another load name; check
95
+ `http://127.0.0.1:1234/v1/models` when needed.
96
+
97
+ ## Retrieval format
98
+
99
+ Use the prefixes specified by NVIDIA:
100
+
101
+ - Queries: `query: <text>`
102
+ - Documents: `passage: <text>`
103
+
104
+ Embeddings are normalized, so cosine similarity and dot product give equivalent rankings (within
105
+ normal floating-point tolerance).
106
+
107
+ ## Conversion provenance
108
+
109
+ - Upstream repository: [`nvidia/Nemotron-3-Embed-1B-BF16`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16)
110
+ - Exact upstream revision: [`0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b`](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16/commit/0677b2025cbc37daf92d7b9c7a225de8cfbc5b0b)
111
+ - Conversion and quantization: [`llama.cpp`](https://github.com/ggml-org/llama.cpp) build `b10015`, commit [`12127defda4f41b7679cb2477a4b0d65ee6a0c8f`](https://github.com/ggml-org/llama.cpp/commit/12127defda4f41b7679cb2477a4b0d65ee6a0c8f)
112
+ - Conversion path: upstream BF16 Safetensors → F16 GGUF → Q4_K_M GGUF
113
+ - Importance matrix: none
114
+ - Output GGUF version: 3
115
+ - Quantization version: 2
116
+
117
+ The conversion was mechanical. The model was not fine-tuned or otherwise trained. See
118
+ [`QUANTIZATION.md`](QUANTIZATION.md) for the reproducibility record and embedded metadata summary.
119
+
120
+ ## Validation
121
+
122
+ Validated on an Apple M3 Max with LM Studio 0.4.19 Build 2 and its llama.cpp runtime 2.25.2, using
123
+ full GPU offload and a 4,096-token context.
124
+
125
+ | Check | Result |
126
+ |---|---:|
127
+ | Output dimensions | 2,048 |
128
+ | L2 norm (three test vectors) | 1.00000002 / 1.00000001 / 0.99999997 |
129
+ | Relevant query/passage cosine | 0.654999 |
130
+ | Unrelated query/passage cosine | 0.044103 |
131
+ | Median latency, one input | 30.46 ms |
132
+ | Median batch time, 32 inputs | 974.98 ms |
133
+ | Median batch throughput | 32.82 texts/s |
134
+
135
+ Latency includes local HTTP and JSON serialization. These numbers are a runtime smoke test, not a
136
+ retrieval-quality evaluation. Hardware, text length, context settings, and runtime versions affect
137
+ performance.
138
+
139
+ ## Limitations
140
+
141
+ - Q4_K_M is lossy and can change retrieval scores or rankings relative to the upstream BF16 model.
142
+ - No MTEB/MMTEB accuracy evaluation was run on this quantization; consult NVIDIA's upstream model
143
+ card for BF16 benchmark results.
144
+ - This model is intended for embeddings, retrieval, semantic search, and reranking pipelines. It is
145
+ not a chat or text-generation model.
146
+ - Users remain responsible for evaluating model behavior, data handling, and suitability for their
147
+ application.
148
+
149
+ ## License and attribution
150
+
151
+ The model materials are distributed under the
152
+ [OpenMDW License Agreement 1.1](https://openmdw.ai/license/1-1/). The upstream model incorporates
153
+ Ministral-3-3B-Instruct-2512 materials released under Apache 2.0.
154
+
155
+ This repository retains NVIDIA's [`LICENSE`](LICENSE), [`NOTICE`](NOTICE), and
156
+ [`THIRD_PARTY_NOTICES.md`](THIRD_PARTY_NOTICES.md). By using or distributing the model, you agree to
157
+ the applicable license terms. NVIDIA retains ownership of its names and trademarks; their use here
158
+ is solely to identify the upstream model.
159
+
160
+ ## Upstream resources
161
+
162
+ - [NVIDIA upstream model card](https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16)
163
+ - [NVIDIA Nemotron-3-Embed blog post](https://huggingface.co/blog/nvidia/nemotron-3-embed-wins-rteb)
164
+ - [Compact Language Models via Pruning and Knowledge Distillation](https://arxiv.org/abs/2407.14679)
165
+ - [MMTEB: Massive Multilingual Text Embedding Benchmark](https://arxiv.org/abs/2502.13595)
SHA256SUMS ADDED
@@ -0,0 +1 @@
 
 
1
+ 9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d nemotron-3-embed-1b-q4_k_m.gguf
THIRD_PARTY_NOTICES.md ADDED
@@ -0,0 +1,471 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Copyright "Hugging Face, Inc." - Apache License 2.0
2
+
3
+ License Text([https://github.com/huggingface/sentence-transformers/blob/main/LICENSE](https://github.com/huggingface/sentence-transformers/blob/main/LICENSE))
4
+
5
+ This notice applies to **sentence-transformers**.
6
+
7
+ Copyright 2019-2025
8
+
9
+ Ubiquitous Knowledge Processing (UKP) Lab
10
+
11
+ Technische Universität Darmstadt
12
+
13
+ Copyright 2025-present
14
+
15
+ Hugging Face, Inc.
16
+
17
+ Apache License
18
+ Version 2.0, January 2004
19
+ http://www.apache.org/licenses/
20
+
21
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
22
+
23
+ 1. Definitions.
24
+
25
+ "License" shall mean the terms and conditions for use, reproduction,
26
+ and distribution as defined by Sections 1 through 9 of this document.
27
+
28
+ "Licensor" shall mean the copyright owner or entity authorized by
29
+ the copyright owner that is granting the License.
30
+
31
+ "Legal Entity" shall mean the union of the acting entity and all
32
+ other entities that control, are controlled by, or are under common
33
+ control with that entity. For the purposes of this definition,
34
+ "control" means (i) the power, direct or indirect, to cause the
35
+ direction or management of such entity, whether by contract or
36
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
37
+ outstanding shares, or (iii) beneficial ownership of such entity.
38
+
39
+ "You" (or "Your") shall mean an individual or Legal Entity
40
+ exercising permissions granted by this License.
41
+
42
+ "Source" form shall mean the preferred form for making modifications,
43
+ including but not limited to software source code, documentation
44
+ source, and configuration files.
45
+
46
+ "Object" form shall mean any form resulting from mechanical
47
+ transformation or translation of a Source form, including but
48
+ not limited to compiled object code, generated documentation,
49
+ and conversions to other media types.
50
+
51
+ "Work" shall mean the work of authorship, whether in Source or
52
+ Object form, made available under the License, as indicated by a
53
+ copyright notice that is included in or attached to the work
54
+ (an example is provided in the Appendix below).
55
+
56
+ "Derivative Works" shall mean any work, whether in Source or Object
57
+ form, that is based on (or derived from) the Work and for which the
58
+ editorial revisions, annotations, elaborations, or other modifications
59
+ represent, as a whole, an original work of authorship. For the purposes
60
+ of this License, Derivative Works shall not include works that remain
61
+ separable from, or merely link (or bind by name) to the interfaces of,
62
+ the Work and Derivative Works thereof.
63
+
64
+ "Contribution" shall mean any work of authorship, including
65
+ the original version of the Work and any modifications or additions
66
+ to that Work or Derivative Works thereof, that is intentionally
67
+ submitted to Licensor for inclusion in the Work by the copyright owner
68
+ or by an individual or Legal Entity authorized to submit on behalf of
69
+ the copyright owner. For the purposes of this definition, "submitted"
70
+ means any form of electronic, verbal, or written communication sent
71
+ to the Licensor or its representatives, including but not limited to
72
+ communication on electronic mailing lists, source code control systems,
73
+ and issue tracking systems that are managed by, or on behalf of, the
74
+ Licensor for the purpose of discussing and improving the Work, but
75
+ excluding communication that is conspicuously marked or otherwise
76
+ designated in writing by the copyright owner as "Not a Contribution."
77
+
78
+ "Contributor" shall mean Licensor and any individual or Legal Entity
79
+ on behalf of whom a Contribution has been received by Licensor and
80
+ subsequently incorporated within the Work.
81
+
82
+ 2. Grant of Copyright License. Subject to the terms and conditions of
83
+ this License, each Contributor hereby grants to You a perpetual,
84
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
85
+ copyright license to reproduce, prepare Derivative Works of,
86
+ publicly display, publicly perform, sublicense, and distribute the
87
+ Work and such Derivative Works in Source or Object form.
88
+
89
+ 3. Grant of Patent License. Subject to the terms and conditions of
90
+ this License, each Contributor hereby grants to You a perpetual,
91
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
92
+ (except as stated in this section) patent license to make, have made,
93
+ use, offer to sell, sell, import, and otherwise transfer the Work,
94
+ where such license applies only to those patent claims licensable
95
+ by such Contributor that are necessarily infringed by their
96
+ Contribution(s) alone or by combination of their Contribution(s)
97
+ with the Work to which such Contribution(s) was submitted. If You
98
+ institute patent litigation against any entity (including a
99
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
100
+ or a Contribution incorporated within the Work constitutes direct
101
+ or contributory patent infringement, then any patent licenses
102
+ granted to You under this License for that Work shall terminate
103
+ as of the date such litigation is filed.
104
+
105
+ 4. Redistribution. You may reproduce and distribute copies of the
106
+ Work or Derivative Works thereof in any medium, with or without
107
+ modifications, and in Source or Object form, provided that You
108
+ meet the following conditions:
109
+
110
+ (a) You must give any other recipients of the Work or
111
+ Derivative Works a copy of this License; and
112
+
113
+ (b) You must cause any modified files to carry prominent notices
114
+ stating that You changed the files; and
115
+
116
+ (c) You must retain, in the Source form of any Derivative Works
117
+ that You distribute, all copyright, patent, trademark, and
118
+ attribution notices from the Source form of the Work,
119
+ excluding those notices that do not pertain to any part of
120
+ the Derivative Works; and
121
+
122
+ (d) If the Work includes a "NOTICE" text file as part of its
123
+ distribution, then any Derivative Works that You distribute must
124
+ include a readable copy of the attribution notices contained
125
+ within such NOTICE file, excluding those notices that do not
126
+ pertain to any part of the Derivative Works, in at least one
127
+ of the following places: within a NOTICE text file distributed
128
+ as part of the Derivative Works; within the Source form or
129
+ documentation, if provided along with the Derivative Works; or,
130
+ within a display generated by the Derivative Works, if and
131
+ wherever such third-party notices normally appear. The contents
132
+ of the NOTICE file are for informational purposes only and
133
+ do not modify the License. You may add Your own attribution
134
+ notices within Derivative Works that You distribute, alongside
135
+ or as an addendum to the NOTICE text from the Work, provided
136
+ that such additional attribution notices cannot be construed
137
+ as modifying the License.
138
+
139
+ You may add Your own copyright statement to Your modifications and
140
+ may provide additional or different license terms and conditions
141
+ for use, reproduction, or distribution of Your modifications, or
142
+ for any such Derivative Works as a whole, provided Your use,
143
+ reproduction, and distribution of the Work otherwise complies with
144
+ the conditions stated in this License.
145
+
146
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
147
+ any Contribution intentionally submitted for inclusion in the Work
148
+ by You to the Licensor shall be under the terms and conditions of
149
+ this License, without any additional terms or conditions.
150
+ Notwithstanding the above, nothing herein shall supersede or modify
151
+ the terms of any separate license agreement you may have executed
152
+ with Licensor regarding such Contributions.
153
+
154
+ 6. Trademarks. This License does not grant permission to use the trade
155
+ names, trademarks, service marks, or product names of the Licensor,
156
+ except as required for reasonable and customary use in describing the
157
+ origin of the Work and reproducing the content of the NOTICE file.
158
+
159
+ 7. Disclaimer of Warranty. Unless required by applicable law or
160
+ agreed to in writing, Licensor provides the Work (and each
161
+ Contributor provides its Contributions) on an "AS IS" BASIS,
162
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
163
+ implied, including, without limitation, any warranties or conditions
164
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
165
+ PARTICULAR PURPOSE. You are solely responsible for determining the
166
+ appropriateness of using or redistributing the Work and assume any
167
+ risks associated with Your exercise of permissions under this License.
168
+
169
+ 8. Limitation of Liability. In no event and under no legal theory,
170
+ whether in tort (including negligence), contract, or otherwise,
171
+ unless required by applicable law (such as deliberate and grossly
172
+ negligent acts) or agreed to in writing, shall any Contributor be
173
+ liable to You for damages, including any direct, indirect, special,
174
+ incidental, or consequential damages of any character arising as a
175
+ result of this License or out of the use or inability to use the
176
+ Work (including but not limited to damages for loss of goodwill,
177
+ work stoppage, computer failure or malfunction, or any and all
178
+ other commercial damages or losses), even if such Contributor
179
+ has been advised of the possibility of such damages.
180
+
181
+ 9. Accepting Warranty or Additional Liability. While redistributing
182
+ the Work or Derivative Works thereof, You may choose to offer,
183
+ and charge a fee for, acceptance of support, warranty, indemnity,
184
+ or other liability obligations and/or rights consistent with this
185
+ License. However, in accepting such obligations, You may act only
186
+ on Your own behalf and on Your sole responsibility, not on behalf
187
+ of any other Contributor, and only if You agree to indemnify,
188
+ defend, and hold each Contributor harmless for any liability
189
+ incurred by, or claims asserted against, such Contributor by reason
190
+ of your accepting any such warranty or additional liability.
191
+
192
+ END OF TERMS AND CONDITIONS
193
+
194
+ -----
195
+
196
+
197
+ Copyright "Hugging Face, Inc." - Apache License 2.0
198
+ License Text([https://github.com/huggingface/transformers/blob/main/LICENSE](https://github.com/huggingface/transformers/blob/main/LICENSE))
199
+
200
+ This notice applies to **transformers**.
201
+
202
+ Copyright 2018- The Hugging Face team. All rights reserved.
203
+
204
+ Apache License
205
+ Version 2.0, January 2004
206
+ http://www.apache.org/licenses/
207
+
208
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
209
+
210
+ 1. Definitions.
211
+
212
+ "License" shall mean the terms and conditions for use, reproduction,
213
+ and distribution as defined by Sections 1 through 9 of this document.
214
+
215
+ "Licensor" shall mean the copyright owner or entity authorized by
216
+ the copyright owner that is granting the License.
217
+
218
+ "Legal Entity" shall mean the union of the acting entity and all
219
+ other entities that control, are controlled by, or are under common
220
+ control with that entity. For the purposes of this definition,
221
+ "control" means (i) the power, direct or indirect, to cause the
222
+ direction or management of such entity, whether by contract or
223
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
224
+ outstanding shares, or (iii) beneficial ownership of such entity.
225
+
226
+ "You" (or "Your") shall mean an individual or Legal Entity
227
+ exercising permissions granted by this License.
228
+
229
+ "Source" form shall mean the preferred form for making modifications,
230
+ including but not limited to software source code, documentation
231
+ source, and configuration files.
232
+
233
+ "Object" form shall mean any form resulting from mechanical
234
+ transformation or translation of a Source form, including but
235
+ not limited to compiled object code, generated documentation,
236
+ and conversions to other media types.
237
+
238
+ "Work" shall mean the work of authorship, whether in Source or
239
+ Object form, made available under the License, as indicated by a
240
+ copyright notice that is included in or attached to the work
241
+ (an example is provided in the Appendix below).
242
+
243
+ "Derivative Works" shall mean any work, whether in Source or Object
244
+ form, that is based on (or derived from) the Work and for which the
245
+ editorial revisions, annotations, elaborations, or other modifications
246
+ represent, as a whole, an original work of authorship. For the purposes
247
+ of this License, Derivative Works shall not include works that remain
248
+ separable from, or merely link (or bind by name) to the interfaces of,
249
+ the Work and Derivative Works thereof.
250
+
251
+ "Contribution" shall mean any work of authorship, including
252
+ the original version of the Work and any modifications or additions
253
+ to that Work or Derivative Works thereof, that is intentionally
254
+ submitted to Licensor for inclusion in the Work by the copyright owner
255
+ or by an individual or Legal Entity authorized to submit on behalf of
256
+ the copyright owner. For the purposes of this definition, "submitted"
257
+ means any form of electronic, verbal, or written communication sent
258
+ to the Licensor or its representatives, including but not limited to
259
+ communication on electronic mailing lists, source code control systems,
260
+ and issue tracking systems that are managed by, or on behalf of, the
261
+ Licensor for the purpose of discussing and improving the Work, but
262
+ excluding communication that is conspicuously marked or otherwise
263
+ designated in writing by the copyright owner as "Not a Contribution."
264
+
265
+ "Contributor" shall mean Licensor and any individual or Legal Entity
266
+ on behalf of whom a Contribution has been received by Licensor and
267
+ subsequently incorporated within the Work.
268
+
269
+ 2. Grant of Copyright License. Subject to the terms and conditions of
270
+ this License, each Contributor hereby grants to You a perpetual,
271
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
272
+ copyright license to reproduce, prepare Derivative Works of,
273
+ publicly display, publicly perform, sublicense, and distribute the
274
+ Work and such Derivative Works in Source or Object form.
275
+
276
+ 3. Grant of Patent License. Subject to the terms and conditions of
277
+ this License, each Contributor hereby grants to You a perpetual,
278
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
279
+ (except as stated in this section) patent license to make, have made,
280
+ use, offer to sell, sell, import, and otherwise transfer the Work,
281
+ where such license applies only to those patent claims licensable
282
+ by such Contributor that are necessarily infringed by their
283
+ Contribution(s) alone or by combination of their Contribution(s)
284
+ with the Work to which such Contribution(s) was submitted. If You
285
+ institute patent litigation against any entity (including a
286
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
287
+ or a Contribution incorporated within the Work constitutes direct
288
+ or contributory patent infringement, then any patent licenses
289
+ granted to You under this License for that Work shall terminate
290
+ as of the date such litigation is filed.
291
+
292
+ 4. Redistribution. You may reproduce and distribute copies of the
293
+ Work or Derivative Works thereof in any medium, with or without
294
+ modifications, and in Source or Object form, provided that You
295
+ meet the following conditions:
296
+
297
+ (a) You must give any other recipients of the Work or
298
+ Derivative Works a copy of this License; and
299
+
300
+ (b) You must cause any modified files to carry prominent notices
301
+ stating that You changed the files; and
302
+
303
+ (c) You must retain, in the Source form of any Derivative Works
304
+ that You distribute, all copyright, patent, trademark, and
305
+ attribution notices from the Source form of the Work,
306
+ excluding those notices that do not pertain to any part of
307
+ the Derivative Works; and
308
+
309
+ (d) If the Work includes a "NOTICE" text file as part of its
310
+ distribution, then any Derivative Works that You distribute must
311
+ include a readable copy of the attribution notices contained
312
+ within such NOTICE file, excluding those notices that do not
313
+ pertain to any part of the Derivative Works, in at least one
314
+ of the following places: within a NOTICE text file distributed
315
+ as part of the Derivative Works; within the Source form or
316
+ documentation, if provided along with the Derivative Works; or,
317
+ within a display generated by the Derivative Works, if and
318
+ wherever such third-party notices normally appear. The contents
319
+ of the NOTICE file are for informational purposes only and
320
+ do not modify the License. You may add Your own attribution
321
+ notices within Derivative Works that You distribute, alongside
322
+ or as an addendum to the NOTICE text from the Work, provided
323
+ that such additional attribution notices cannot be construed
324
+ as modifying the License.
325
+
326
+ You may add Your own copyright statement to Your modifications and
327
+ may provide additional or different license terms and conditions
328
+ for use, reproduction, or distribution of Your modifications, or
329
+ for any such Derivative Works as a whole, provided Your use,
330
+ reproduction, and distribution of the Work otherwise complies with
331
+ the conditions stated in this License.
332
+
333
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
334
+ any Contribution intentionally submitted for inclusion in the Work
335
+ by You to the Licensor shall be under the terms and conditions of
336
+ this License, without any additional terms or conditions.
337
+ Notwithstanding the above, nothing herein shall supersede or modify
338
+ the terms of any separate license agreement you may have executed
339
+ with Licensor regarding such Contributions.
340
+
341
+ 6. Trademarks. This License does not grant permission to use the trade
342
+ names, trademarks, service marks, or product names of the Licensor,
343
+ except as required for reasonable and customary use in describing the
344
+ origin of the Work and reproducing the content of the NOTICE file.
345
+
346
+ 7. Disclaimer of Warranty. Unless required by applicable law or
347
+ agreed to in writing, Licensor provides the Work (and each
348
+ Contributor provides its Contributions) on an "AS IS" BASIS,
349
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
350
+ implied, including, without limitation, any warranties or conditions
351
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
352
+ PARTICULAR PURPOSE. You are solely responsible for determining the
353
+ appropriateness of using or redistributing the Work and assume any
354
+ risks associated with Your exercise of permissions under this License.
355
+
356
+ 8. Limitation of Liability. In no event and under no legal theory,
357
+ whether in tort (including negligence), contract, or otherwise,
358
+ unless required by applicable law (such as deliberate and grossly
359
+ negligent acts) or agreed to in writing, shall any Contributor be
360
+ liable to You for damages, including any direct, indirect, special,
361
+ incidental, or consequential damages of any character arising as a
362
+ result of this License or out of the use or inability to use the
363
+ Work (including but not limited to damages for loss of goodwill,
364
+ work stoppage, computer failure or malfunction, or any and all
365
+ other commercial damages or losses), even if such Contributor
366
+ has been advised of the possibility of such damages.
367
+
368
+ 9. Accepting Warranty or Additional Liability. While redistributing
369
+ the Work or Derivative Works thereof, You may choose to offer,
370
+ and charge a fee for, acceptance of support, warranty, indemnity,
371
+ or other liability obligations and/or rights consistent with this
372
+ License. However, in accepting such obligations, You may act only
373
+ on Your own behalf and on Your sole responsibility, not on behalf
374
+ of any other Contributor, and only if You agree to indemnify,
375
+ defend, and hold each Contributor harmless for any liability
376
+ incurred by, or claims asserted against, such Contributor by reason
377
+ of your accepting any such warranty or additional liability.
378
+
379
+ END OF TERMS AND CONDITIONS
380
+
381
+ -----
382
+
383
+ Copyright "PyTorch Contributors" - BSD-style License
384
+ License Text([https://github.com/pytorch/pytorch/blob/main/LICENSE](https://www.google.com/search?q=https://github.com/pytorch/pytorch/blob/main/LICENSE))
385
+
386
+ This notice applies to **torch**.
387
+
388
+ From PyTorch:
389
+
390
+ Copyright (c) 2016- Facebook, Inc (Adam Paszke)
391
+ Copyright (c) 2014- Facebook, Inc (Soumith Chintala)
392
+ Copyright (c) 2011-2014 Idiap Research Institute (Ronan Collobert)
393
+ Copyright (c) 2012-2014 Deepmind Technologies (Koray Kavukcuoglu)
394
+ Copyright (c) 2011-2012 NEC Laboratories America (Koray Kavukcuoglu)
395
+ Copyright (c) 2011-2013 NYU (Clement Farabet)
396
+ Copyright (c) 2006-2010 NEC Laboratories America (Ronan Collobert, Leon Bottou, Iain Melvin, Jason Weston)
397
+ Copyright (c) 2006 Idiap Research Institute (Samy Bengio)
398
+ Copyright (c) 2001-2004 Idiap Research Institute (Ronan Collobert, Samy Bengio, Johnny Mariethoz)
399
+
400
+ From Caffe2:
401
+
402
+ Copyright (c) 2016-present, Facebook Inc. All rights reserved.
403
+
404
+ All contributions by Facebook:
405
+ Copyright (c) 2016 Facebook Inc.
406
+
407
+ All contributions by Google:
408
+ Copyright (c) 2015 Google Inc.
409
+ All rights reserved.
410
+
411
+ All contributions by Yangqing Jia:
412
+ Copyright (c) 2015 Yangqing Jia
413
+ All rights reserved.
414
+
415
+ All contributions by Kakao Brain:
416
+ Copyright 2019-2020 Kakao Brain
417
+
418
+ All contributions by Cruise LLC:
419
+ Copyright (c) 2022 Cruise LLC.
420
+ All rights reserved.
421
+
422
+ All contributions by Tri Dao:
423
+ Copyright (c) 2024 Tri Dao.
424
+ All rights reserved.
425
+
426
+ All contributions by Arm:
427
+ Copyright (c) 2021, 2023-2025 Arm Limited and/or its affiliates
428
+
429
+ All contributions from Caffe:
430
+ Copyright(c) 2013, 2014, 2015, the respective contributors
431
+ All rights reserved.
432
+
433
+ All other contributions:
434
+ Copyright(c) 2015, 2016 the respective contributors
435
+ All rights reserved.
436
+
437
+ Caffe2 uses a copyright model similar to Caffe: each contributor holds
438
+ copyright over their contributions to Caffe2. The project versioning records
439
+ all such contribution and copyright details. If a contributor wants to further
440
+ mark their specific copyright on a particular contribution, they should
441
+ indicate their copyright solely in the commit message of the change when it is
442
+ committed.
443
+
444
+ All rights reserved.
445
+
446
+ Redistribution and use in source and binary forms, with or without
447
+ modification, are permitted provided that the following conditions are met:
448
+
449
+ 1. Redistributions of source code must retain the above copyright
450
+ notice, this list of conditions and the following disclaimer.
451
+
452
+ 2. Redistributions in binary form must reproduce the above copyright
453
+ notice, this list of conditions and the following disclaimer in the
454
+ documentation and/or other materials provided with the distribution.
455
+
456
+ 3. Neither the names of Facebook, Deepmind Technologies, NYU, NEC Laboratories America
457
+ and IDIAP Research Institute nor the names of its contributors may be
458
+ used to endorse or promote products derived from this software without
459
+ specific prior written permission.
460
+
461
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
462
+ AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
463
+ IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
464
+ ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE
465
+ LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
466
+ CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
467
+ SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
468
+ INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
469
+ CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
470
+ ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
471
+ POSSIBILITY OF SUCH DAMAGE.
nemotron-3-embed-1b-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d
3
+ size 749352096