The Hidden Cost of Running AI Applications in Production
The token price didn't change between prototype and production. The architecture did. Where AI app costs really come from, and how to cut them.
Practical AI engineering — how AI systems are designed, built, debugged and shipped. Guides, architecture, experiments and production lessons.
Every build in this room is a variation of this path.
Explore the room
Eight areas of practical AI engineering. Each one filters the builds below.
Latest builds
Experiments, engineering notes and production lessons. Filter by topic, or search above.
Build by problem
Start from what you're building. Each problem opens the builds that solve it, in reading order.
I want to… debug an AI Application3 builds
The token price didn't change between prototype and production. The architecture did. Where AI app costs really come from, and how to cut them.
Token prices are the visible part of the bill. Retries, oversized context, evaluation runs and idle infrastructure are the parts that surprise teams.
Non-deterministic output, hidden prompts and multi-step pipelines make AI bugs hard to reproduce. A systematic approach that turns 'it gave a weird answer' into a fix.