Interactive explainers

Drips.

A drip is a short, interactive explainer. Learn one AI concept, change a variable, and see how it works.

48 published · read the idea, then try the mechanism

New here?

Start with one of these.

The full shelf

Every drip, by topic.

Core Concepts 11

  1. LoRA & qLoRAFine-tune massive LLMs on consumer hardware. Learn about Low-Rank Adaptation and 4-bit Quantization.
  2. TokenizationBefore AI can read, it must chop. Learn how text is broken down into the fundamental atoms of meaning.
  3. LLM SamplingHow do LLMs decide what to say next? Explore greedy vs. probabilistic sampling and log probabilities.
  4. Context EngineeringBeyond the prompt: Curate the perfect information to feed your LLM's limited attention span.
  5. Prompt EngineeringLearn how Zero-Shot, Few-Shot, and Chain-of-Thought prompting steer LLM probabilities.
  6. KV Cache (Inference)Why doesn't ChatGPT re-read your whole chat every time it types a word? Memory optimization explained.
  7. QuantizationIn the queueSame model, a quarter of the memory — if you protect the 1% of weights that matter. FP16→INT4, the AWQ trick, and which of GPTQ/AWQ/GGUF/FP8 to reach for in 2026.
  8. Naive BayesPredicting the future by assuming simplicity. Learn how this probabilistic algorithm uses Bayes' Theorem for classification.
  9. Random ForestStrength in numbers. See how an ensemble of diverse decision trees can vote to make robust predictions.
  10. Support Vector MachinesThe classic algorithm that finds the widest possible street between two classes of data.
  11. Recommender SystemsFrom collaborative filtering to matrix factorization: how Netflix knows what you want before you do.

Architectures 8

  1. Seq2Seq (Encoder-Decoder)The architecture that solved translation before Transformers. Learn about the Context Vector bottleneck.
  2. AlexNet (The Big Bang)The 2012 breakthrough that started the Deep Learning era. ReLU, Dropout, and GPUs.
  3. Bahdanau AttentionBefore Transformers, RNNs learned to focus. The mechanism that solved the bottleneck problem.
  4. Recurrent Neural NetworksUnderstand how AI processes sequential data using hidden states and memory loops.
  5. BERT & BidirectionalitySee how 'Masked Language Model' training enables deep context from both directions.
  6. Vision Transformer (ViT)Learn how breaking images into 16x16 patches allowed pure Transformers to beat CNNs.
  7. U-Net & Skip ConnectionsDiscover the architecture behind precise image segmentation and preserving fine details.
  8. YOLO (Object Detection)'You Only Look Once': Real-time object detection framed as a single regression problem.

Agents & RAG 18

  1. Multi-MCP ArchitectureNew Research: 10 connected MCP servers = ~8K tokens of schemas loaded before your prompt starts. Many-small > one-big, and how to lazy-load.
  2. Agent Long-Term MemoryIn the queueNew Research: Your agent forgets because nobody wrote anything down. Three places to put memory — and why only a temporal store survives a fact that changes.
  3. Eval-Driven DevelopmentNew Research: Prompts are code. The four-stage CI pipeline (local dev → PR check → deploy gate → production monitor) that replaces saturated benchmarks.
  4. Verifying AI CodeNew Research: 66% of developers said the same thing — AI code that is almost right. The verification cascade and the four error classes it catches.
  5. Harness EngineeringNew Research: 60% of all LLM errors are rate limits, not model errors. The five harness layers that decide reliability.
  6. Agentic Context EngineeringNew Research: Why your agent forgets the rules by turn 15 — and the four operations (Write, Select, Compress, Isolate) production teams converged on.
  7. Agentic ETLNew Research: What 1,200+ production deployments taught us about putting LLM agents into the extract-transform-load loop — and the two-layer sandwich that survives contact with real data.
  8. Build: A Multi-MCP RouterBuild Along: 80 lines, no dependencies. Three small MCP servers, the tool-bloat problem they create together, and the router that fixes it. Companion code to Multi-MCP Architecture.
  9. Build: An Eval HarnessBuild Along: the smallest honest eval suite — dataset, system under test, scorers, and a CI gate that exits non-zero below threshold. Companion code to Eval-Driven Development.
  10. Build: An Agentic ETL PipelineBuild Along: 70 lines that show the two-layer sandwich — a fuzzy LLM transform wrapped in deterministic validation on both sides. Companion code to Agentic ETL.
  11. Build: An AI Code VerifierBuild Along: the generate → verify → feed-failure-back loop in 60 lines. The model writes; the verifier decides. Companion code to Verifying AI Code.
  12. HyPA-RAG (Legal AI)New Research: A hybrid, parameter-adaptive RAG system designed specifically for high-stakes legal applications.
  13. Agentic RAGWhen RAG gets smart. Learn how adding an autonomous agent loop enables multi-hop reasoning and self-correction.
  14. Agentic Hybrid RAGNew Research: Combining GraphRAG and VectorRAG with an autonomous router for scientific literature review.
  15. Agentic Design PatternsGoogle Cloud Architecture: From simple prompts to complex multi-agent systems.
  16. RAG (Retrieval-Augmented)Give AI an open-book test. Connect LLMs to external knowledge bases for accurate answers.
  17. Advanced RAG TechniquesGo beyond basic vector search with Reranking, Hybrid Search, and Query Expansion for production-grade accuracy.
  18. The Future of Agentic AIResearch Deep Dive: Why Small Language Models (SLMs) are replacing monolithic LLMs.

Latest Research 13

  1. Three Agent Papers, April 2026In the queueNew Research: Hyperagents (Meta FAIR), Recursive Language Models (MIT), and GMPO (Microsoft / ICLR). Three architectural moves from a single month.
  2. AI OverthinkingNew Research: When models think too much, they often talk themselves out of the correct answer.
  3. Latent Reasoning (Coconut)New Research: What if LLMs didn't have to 'think' in words? Explore reasoning directly in continuous latent space.
  4. Qwen3 (Unified Thinking)New Research: A single model that can dynamically switch between fast responses and deep reasoning modes.
  5. DeepSeekMath (GRPO)New Research: How a 7B model approached GPT-4 math performance by ditching the RL 'Critic' model.
  6. Kimi K2 ThinkingNew Research: An open-source thinking agent that interleaves reasoning with tool use (300+ steps).
  7. DeepSeek-OCRNew Research: Compressing long documents into highly efficient 2D visual tokens instead of text.
  8. CoT MonitoringNew Research: Can AI models learn to hide their dangerous thoughts from safety monitors?
  9. Transformer SensitivityNew Research: Why are Transformers so robust? They naturally learn 'low sensitivity' functions.
  10. Coherence (Segmentation)New Research: An unsupervised method that uses 'sticky' keywords to find topic boundaries.
  11. SFT vs. RL GeneralizationNew Research: Does Supervised Fine-Tuning just memorize while RL actually learns rules?
  12. Natural Language AutoencodersNew Research: Anthropic's 2026 method for translating Claude's internal activations directly into human-readable English.
  13. RLVR & Process RewardsIn the queueNew Research: The recipe behind 2026 reasoning models — swap the gameable reward model for a verifier, watch reward hacking vanish, and run it cheaply with GRPO.