Index / Writing / Page 5
Notes on building things.
Business, startups, product, software architecture and applied AI. 92 posts. Subscribe via RSS.
Page 5
49–60 of 92Reward Hacking: When AI Wins the Wrong Game
From a boat circling a lagoon to coding agents that edit the tests: why AI learns to game its reward, how labs catch it, and what it means for your metrics.

Glitch Tokens: The Strange Words That Broke GPT-3
Why ' SolidGoldMagikarp' broke GPT-3: how tokenizers and models are trained apart, under-trained tokens, how labs fixed it, and other tokenizer quirks.

How Image Generators Work: Diffusion Explained
How AI image generators turn random noise into pictures: denoising, text encoders, latent diffusion, guidance, why hands failed, and the copyright fights.

How AI Sees: Vision Transformers and CLIP
Why a paper note saying "iPod" fooled an AI looking at an apple, and how vision transformers, CLIP and chat models really turn pictures into tokens.

Why AI Runs on GPUs
From two gaming cards in 2012 to clusters of 16,000 chips: why AI runs on GPUs, why memory speed matters more than raw power, and what it costs.

Shrinking AI: Quantization and Distillation Explained
How big AI models get small enough for a laptop or phone: quantization, distillation, pruning, what each one costs, and the licence questions.

Long Context and the KV Cache: How AI Reads a Whole Book at Once
How AI models read hundreds of thousands of tokens at once: why attention gets expensive, what the KV cache is, and when long context beats RAG.

Mixture of Experts: Why Giant Models Only Use Part of Their Brain
How mixture-of-experts models work: routers, top-k experts, load balancing, what experts really learn, and why total and active parameters differ.

Interpretability: How Scientists Look Inside an AI's Mind
Superposition, sparse autoencoders, Golden Gate Claude and attribution graphs: how researchers find concepts inside a model, and what they still can't see.

Do You Need a Channel Manager at 1–10 Listings?
Channel manager, PMS or plain calendar sync? A plain-English guide for hosts with 1 to 10 listings, with prices, hidden costs and a 2-week trial checklist.

An Airbnb Cleaning Schedule in Google Sheets That Builds Itself From Check-outs
Type each booking once and let Google Sheets build the cleaning list: turnovers, same-day turns, time windows and a simple view for your cleaner.

5 Famous AI Demos That Weren't What They Looked Like
Google, Tesla, Amazon, Humane and Builder.ai: what five famous AI demos showed, what was reported later, and one rule from each.
