mteb/stsbenchmark-sts
Viewer β’ Updated β’ 8.63k β’ 30.2k β’ 18
wav2vec2 audio embeddings compressed 29x while preserving 97.1% similarity ranking
| Metric | Value |
|---|---|
| Compression Ratio | 29.5x |
| Spearman Ο | 97.1% |
| Source Dimension | 768D |
| Compressed Dimension | 26D |
| Storage Savings | 96.6% |
from aqea import AQEACompressor
# Load pre-trained compressor
compressor = AQEACompressor.from_pretrained("nextxag/aqea-wav2vec2-base-960h-29x")
# Compress embeddings
embeddings = model.encode(texts) # 768D
compressed = compressor.compress(embeddings) # 26D
# Decompress for retrieval
reconstructed = compressor.decompress(compressed) # 768D
weights.aqwt - Binary weights (AQEA native format)config.json - Model configurationAQEA (Adaptive Quantized Embedding Architecture) uses learned linear projections with Pre-Quantify rotation to compress embeddings while maximally preserving pairwise similarity rankings (measured by Spearman correlation).
@software{aqea2024,
title = {AQEA: Adaptive Quantized Embedding Architecture},
author = {AQEA Team},
year = {2024},
url = {https://huggingface.co/nextxag}
}
Apache 2.0
Base model
facebook/wav2vec2-base-960h