AQEA: aqea-text-embedding-3-small-29x

OpenAI text-embedding-3-small compressed 29x while preserving 90.6% similarity ranking

📊 Performance

Metric	Value
Compression Ratio	29.5x
Spearman ρ	90.6%
Source Dimension	1536D
Compressed Dimension	52D
Storage Savings	96.6%

🚀 Usage

from aqea import AQEACompressor

# Load pre-trained compressor
compressor = AQEACompressor.from_pretrained("nextxag/aqea-text-embedding-3-small-29x")

# Compress embeddings
embeddings = model.encode(texts)  # 1536D
compressed = compressor.compress(embeddings)  # 52D

# Decompress for retrieval
reconstructed = compressor.decompress(compressed)  # 1536D

📁 Files

• weights.aqwt - Binary weights (AQEA native format)
• config.json - Model configuration

🔬 How It Works

AQEA (Adaptive Quantized Embedding Architecture) uses learned linear projections with Pre-Quantify rotation to compress embeddings while maximally preserving pairwise similarity rankings (measured by Spearman correlation).

📚 Citation

@software{aqea2024,
  title = {AQEA: Adaptive Quantized Embedding Architecture},
  author = {AQEA Team},
  year = {2024},
  url = {https://huggingface.co/nextxag}
}

📄 License

Apache 2.0