What is the cheapest way to generate text embeddings? And how do they compare to OpenAI?
To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/RabbitHoleSyndrome. The first 200 of you will get 20% off Brilliant’s annual premium subscription.
This video was sponsored by Brilliant.
The video is going to explore the world of open source embedding models, how to use them, and how they compare to OpenAI’s text-embedding-ada-002.
Source code: https://github.com/rabbit-hole-syndrome/open-source-embeddings
Sentence Embeddings (SBERT): https://sbert.net/
MTEB Leaderboard: https://huggingface.co/spaces/mteb/leaderboard
02:02 Project setup
03:29 Embeddings 101
05:07 Server-side Embeddings
06:14 SBERT & Hugging Face
10:22 Sentence Transformers Models
28:35 Inference API
1:10:38 Embeddings in the Browser
1:20:19 The Future of Embeddings
1:24:23 Thanks for watching!