Feature Extraction
sentence-transformers
Safetensors
English
bert
sentence-similarity
e8-lattice
rf-snap
latticememory
Eval Results (legacy)
text-embeddings-inference
Instructions to use dfrokido/bge-large-e8-snap with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use dfrokido/bge-large-e8-snap with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("dfrokido/bge-large-e8-snap") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Clarify E8 key is an added lookup layer, not a footprint reduction: the full embedding is retained in every mode and never discarded
Browse files
README.md
CHANGED
|
@@ -64,10 +64,16 @@ library README's own benchmark table for the real, mode-by-mode picture (includi
|
|
| 64 |
this mechanism scores 0% on real asymmetric RAG).
|
| 65 |
|
| 66 |
> **Compression basis:** 1 address byte per 8-dim block × 128 blocks = 128 bytes for a
|
| 67 |
-
> 1024-dim embedding, vs 4,096 bytes for float32 = 32x. This
|
| 68 |
-
>
|
| 69 |
-
>
|
| 70 |
-
>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
|
| 72 |
## Usage
|
| 73 |
|
|
|
|
| 64 |
this mechanism scores 0% on real asymmetric RAG).
|
| 65 |
|
| 66 |
> **Compression basis:** 1 address byte per 8-dim block × 128 blocks = 128 bytes for a
|
| 67 |
+
> 1024-dim embedding, vs 4,096 bytes for float32 = 32x. This describes the *added* E8 key
|
| 68 |
+
> structure's size, not a reduction in what's stored — LatticeMemory retains a full-precision
|
| 69 |
+
> embedding for every document permanently (used for exact-hit scoring), in every mode,
|
| 70 |
+
> whether or not a dense fallback is configured; there's no path to discard it once a document
|
| 71 |
+
> is keyed. The E8 key is an O(1) hash-bucket lookup layer added on top of the retained
|
| 72 |
+
> embedding, not a replacement for it — it buys lookup **speed** for exact/near-exact hits, not
|
| 73 |
+
> smaller total memory. See [LatticeMemory's README](https://github.com/sangmorg1-debug/latticememory#readme)
|
| 74 |
+
> for the full breakdown, including hybrid mode's separate dense (Int8/float32) fallback index
|
| 75 |
+
> for asymmetric retrieval — that fallback, not the E8 key, is what actually serves
|
| 76 |
+
> paraphrase/RAG queries today.
|
| 77 |
|
| 78 |
## Usage
|
| 79 |
|