herMaster commited on
Commit
c823efd
·
verified ·
1 Parent(s): 6ea1313

Added README.md

Browse files
Files changed (1) hide show
  1. README.md +135 -0
README.md ADDED
@@ -0,0 +1,135 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model: jinaai/jina-code-embeddings-1.5b
4
+ tags:
5
+ - embeddings
6
+ - code
7
+ - gguf
8
+ - llama.cpp
9
+ - ollama
10
+ - vector-search
11
+ - retrieval
12
+ ---
13
+
14
+ # 🧠 jina-code-embeddings-1.5b — Q8_0 GGUF
15
+
16
+ This repository provides **GGUF-format builds** of
17
+ **Jina AI’s `jina-code-embeddings-1.5b`** for efficient local inference using:
18
+
19
+ - llama.cpp
20
+ - LM Studio
21
+ - Ollama
22
+ - KoboldCpp
23
+ - any GGUF-compatible runtime
24
+
25
+ These files allow you to run a **state-of-the-art code embedding model locally** on CPU or GPU without PyTorch.
26
+
27
+ ## 🔹 Model files
28
+
29
+ | File | Description |
30
+ |------|------------|
31
+ | `jina-code-embeddings-1.5b-Q8_0.gguf` | Full precision conversion |
32
+
33
+ ---
34
+
35
+ ## 🔗 Original model
36
+
37
+ This is a **format conversion only** of the original Jina AI model:
38
+
39
+ **Upstream model:**
40
+ https://huggingface.co/jinaai/jina-code-embeddings-1.5b
41
+
42
+ **Paper:**
43
+ *Efficient Code Embeddings from Code Generation Models* (Kryvosheieva et al., 2025)
44
+
45
+ All model weights, training, and research belong to **Jina AI**.
46
+ This repository only provides **GGUF format conversions** by **herMaster**.
47
+
48
+ ---
49
+
50
+ ## 🧩 What this model does
51
+
52
+ This is a **code embedding model**, not a chat LLM.
53
+
54
+ It generates **vector embeddings** for:
55
+
56
+ - Text → Code search
57
+ - Code → Code similarity
58
+ - Code → Text explanation
59
+ - Code completion retrieval
60
+ - Technical Q&A
61
+
62
+ It supports **15+ programming languages** and produces **1536-dimensional embeddings** (which can be truncated for smaller vectors).
63
+
64
+ ---
65
+
66
+ ## ⚠️ Important: GGUF usage notes
67
+
68
+ Unlike the original Transformers version, GGUF engines **do not apply instruction prefixes or pooling automatically**.
69
+
70
+ To get correct embeddings you must:
71
+
72
+ 1. Add the correct **instruction prefix**
73
+ 2. Run inference
74
+ 3. Use the **last token embedding** as the vector
75
+
76
+ ### Example (NL → Code)
77
+
78
+ Query:
79
+ ```markdown
80
+ Find the most relevant code snippet given the following query:
81
+ print hello world in python
82
+ ```
83
+
84
+ Candidate code:
85
+
86
+ ```python
87
+ Candidate code snippet:
88
+ print("Hello world")
89
+ ```
90
+
91
+
92
+ If you do **not** include the instruction text, embedding quality will be significantly worse.
93
+
94
+ ---
95
+
96
+ ## 🛠 llama.cpp example (https://github.com/ggml-org/llama.cpp)
97
+
98
+ ```bash
99
+ ./llama-embedding \
100
+ -m jina-code-embeddings-1.5b-Q8_0.gguf \
101
+ -p "Find the most relevant code snippet given the following query:
102
+ print hello world in python"
103
+ ```
104
+
105
+ This returns a 1536-dimension vector you can store in FAISS, Qdrant, Milvus, etc.
106
+
107
+ ## 📜 License
108
+ This model is licensed under:
109
+ > Creative Commons Attribution-NonCommercial 4.0 (CC-BY-NC-4.0)
110
+
111
+ You may:
112
+ - Use it for research
113
+ - Use it for personal projects
114
+ - Share it freely
115
+
116
+ You may not:
117
+ - Use it in commercial products
118
+ - Run it in paid APIs or SaaS
119
+ - Sell access to it
120
+
121
+ This license is inherited from the original Jina AI release.
122
+
123
+ ## 🙏 Credits
124
+
125
+ - Model & training: Jina AI
126
+ - GGUF conversion: herMaster
127
+
128
+ All model weights, architecture, and training data belong to Jina AI.
129
+ This repository only provides format-converted GGUF files for easier local inference.
130
+
131
+ If you use this model in academic or technical work, please cite the original Jina AI paper:
132
+ > Efficient Code Embeddings from Code Generation Models
133
+ > Daria Kryvosheieva, Saba Sturua, Michael Günther, Scott Martens, Han Xiao (2025)
134
+
135
+ This ensures proper credit is given to the original authors and helps support continued research in high-quality code embeddings.