$0 Embeddings (OpenAI vs. free & open source)

Rabbit Hole Syndrome

What is the cheapest way to generate text embeddings? And how do they compare to OpenAI?
To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/RabbitHoleSyndrome. The first 200 of you will get 20% off Brilliant’s annual premium subscription.

This video was sponsored by Brilliant.

The video is going to explore the world of open source embedding models, how to use them, and how they compare to OpenAI’s text-embedding-ada-002.

Source code: https://github.com/rabbit-hole-syndrome/open-source-embeddings

Sentence Embeddings (SBERT): https://sbert.net/
MTEB Leaderboard: https://huggingface.co/spaces/mteb/leaderboard

00:00 Intro
02:02 Project setup
03:29 Embeddings 101
05:07 Server-side Embeddings
06:14 SBERT & Hugging Face
10:22 Sentence Transformers Models
17:18 MTEB
28:35 Inference API
55:37 Transformers.js
1:10:38 Embeddings in the Browser
1:20:19 The Future of Embeddings
1:24:23 Thanks for watching!