This Week I Learned - Week 26 2026
This Week I Learned - * "Hallucination is a feature when you’re being creative." - S Anand * "AI doesn't have to be right to be useful. The goal is outputs you can iterate over time — not perfection on the first try." - Agentic Thinking 101, Udacity * "...language models hallucinate because the training and evaluation procedures reward guessing over acknowledging uncertainty" - Why Language Models Hallucinate * "Large language models (LLMs) do not work like databases, storing facts in neat rows and columns, and retrieving the right answer when asked. They are trained on enormous collections of text and learn statistical patterns in language. When prompted, they generate a response by predicting what will come next, one piece at a time. An LLM generates text one word at a time, each word a probability drawn from patterns it absorbed during training. A setting called the temperature governs how adventurous those draws are. If the temperature is l...