smallevals — CPU-fast, GPU-blazing fast offline retrieval evaluation for RAG systems with tiny QA models.
-
Updated
Dec 4, 2025 - Python
smallevals — CPU-fast, GPU-blazing fast offline retrieval evaluation for RAG systems with tiny QA models.
Sanity-check your RAG evaluation metrics before trusting them — detects threshold artifacts, k-truncation traps, and hit@k vs proportion-recall divergence
Conceptual path finding in high-dimensional embedding space via Grassmann manifold geometry. Replaces cosine similarity with tangent space distance — paths follow domain-coherent lanes instead of converging to vocabulary hubs. GPU-accelerated Julia compute worker
Small demo project for evaluating RAG retrieval quality using a simple BM25-style retriever and standard metrics (Hit@k, Recall@k, MRR).
Add a description, image, and links to the retrieval-metrics topic page so that developers can more easily learn about it.
To associate your repository with the retrieval-metrics topic, visit your repo's landing page and select "manage topics."