dfrokido commited on
Commit
fc0c33a
·
verified ·
1 Parent(s): 16eb21b

Clarify E8 key is an added lookup layer, not a footprint reduction: the full embedding is retained in every mode and never discarded

Browse files
Files changed (1) hide show
  1. README.md +10 -4
README.md CHANGED
@@ -64,10 +64,16 @@ library README's own benchmark table for the real, mode-by-mode picture (includi
64
  this mechanism scores 0% on real asymmetric RAG).
65
 
66
  > **Compression basis:** 1 address byte per 8-dim block × 128 blocks = 128 bytes for a
67
- > 1024-dim embedding, vs 4,096 bytes for float32 = 32x. This applies to E8 key storage only;
68
- > see [LatticeMemory](https://github.com/sangmorg1-debug/latticememory) for hybrid mode,
69
- > which also stores a dense (Int8/float32) fallback index for asymmetric retrieval that
70
- > fallback, not the E8 key, is what actually serves paraphrase/RAG queries today.
 
 
 
 
 
 
71
 
72
  ## Usage
73
 
 
64
  this mechanism scores 0% on real asymmetric RAG).
65
 
66
  > **Compression basis:** 1 address byte per 8-dim block × 128 blocks = 128 bytes for a
67
+ > 1024-dim embedding, vs 4,096 bytes for float32 = 32x. This describes the *added* E8 key
68
+ > structure's size, not a reduction in what's stored — LatticeMemory retains a full-precision
69
+ > embedding for every document permanently (used for exact-hit scoring), in every mode,
70
+ > whether or not a dense fallback is configured; there's no path to discard it once a document
71
+ > is keyed. The E8 key is an O(1) hash-bucket lookup layer added on top of the retained
72
+ > embedding, not a replacement for it — it buys lookup **speed** for exact/near-exact hits, not
73
+ > smaller total memory. See [LatticeMemory's README](https://github.com/sangmorg1-debug/latticememory#readme)
74
+ > for the full breakdown, including hybrid mode's separate dense (Int8/float32) fallback index
75
+ > for asymmetric retrieval — that fallback, not the E8 key, is what actually serves
76
+ > paraphrase/RAG queries today.
77
 
78
  ## Usage
79