
01 — Retrieval
2,100 q/s
retrieval on a laptop CPU
E-commerce product search
Self-hosted semantic search that runs on CPU, with no per-query fees.
A retriever and a cross-encoder reranker fine-tuned on Amazon’s ESCI data, so that a query like “pan that doesnt stick eggs” finds the right product. Both run on CPU with no per-query fees; the repository is the whole factory — every training script, eval and chart. Five open artifacts, including a 31 MB static model for edge deployment.
nDCG@10 0.748 held-out · 45 ms rerank · 5 open artifacts · $2.20 total GPU spend
sentence-transformers · cross-encoder · ONNX · model2vec
GitHub ↗Hugging Face ↗Demo ↗2,091 downloads



















