Word2Vec: Efficient Estimation of Word Representations in Vector Space
An AI-generated review of Word2Vec, the 2013 method that made cheap, high-quality word embeddings the foundation of modern NLP.
9 reports · 2013–2023
Reasoning, retrieval and prompting: the techniques that turn a base model into a usable system.
An AI-generated review of Word2Vec, the 2013 method that made cheap, high-quality word embeddings the foundation of modern NLP.
Sentence-BERT adapts BERT with siamese networks so sentence embeddings are fast to compare — making semantic search over millions of sentences viable.
An AI-generated review of retrieval-augmented generation (RAG), a framework that grounds language models in external knowledge to improve factual accuracy.
Chain-of-thought prompting shows that step-by-step examples unlock multi-step reasoning in large models — no training changes, just better prompts.
ReAct interleaves chain-of-thought reasoning with tool actions like search and lookup, grounding language models in external feedback.
Whisper trained on 680,000 hours of weakly supervised web audio and showed that scale plus multitask formatting beats hand-curated speech datasets.
An AI-generated review of Self-Consistency decoding, showing how sampling multiple reasoning paths and selecting the most consistent answer improves.
A synthetic proposal combining structured self-critique with episodic memory so autonomous language agents catch and correct their own errors.
Tree of Thoughts explores multiple reasoning branches with search and self-evaluation, solving problems where single-pass chain-of-thought fails.
Narrated films that touch this topic, with chapters, captions and transcripts.
1:40Explainer · 4 chapters
Why a language model feels like it understands, what it is actually doing, and three questions that replace “does it understand?”.