I love fireflies. But in recent years, they stopped coming for reasons I don’t know. No tiny, glowing dots in the dark like they used to. I miss them more than I expected.
Few weeks ago, I decided to make my own fireflies. I discovered something called an Astable Multivibrator. It looked like magic to me TBH. A tiny circuit, with minimal components, that could automatically switch from ON to OFF and OFF to ON state (without an explicit “timer” component).
In this article we go through the fundamentals of embeddings. We will cover what embeddings are, how they evolved over time from statistical methods to modern techniques, check out how they're implemented in practice, look at some of the most important embedding techniques, and how the embeddings of an LLM (DeepSeek-R1-Distill-Qwen-1.5B) look like as a graph representation.