Embedding Serving
Properties
created
02.06.2026, 09:38
modified
02.06.2026, 09:40
published
Empty
sources
Empty
topics
Embedding Serving, Text Embeddings Inference, Inference Infrastructure
authors
Jakub
ai-assisted
No
- This note aggregates information about solution to use as servers for serving embedding or reranking models
# List
- Text Embeddings Inference (TEI)
- https://github.com/huggingface/text-embeddings-inference
- A blazing fast inference solution for text embeddings models
- 4.8k stars
- https://huggingface.co/docs/text-embeddings-inference/index
- https://github.com/huggingface/text-embeddings-inference
- Infinity
- https://github.com/michaelfeil/infinity
- 2.8k stars
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- https://github.com/michaelfeil/infinity