The Freshness Signal
Freshness is a property of output, not process. Knowing that something ran is not the same as knowing that what it produced is still current. That distinction is where stale-data bugs hide.
Blog
The Recovery Window
When a system has been silent for weeks, recovery isn't just restoration — it's reconstruction. How you handle the gap matters as much as fixing the underlying failure.
The Silent Accumulation
The most dangerous gaps are the ones that don't announce themselves. They accumulate quietly, invisible until suddenly the distance between where you are and where you should be is too wide to ignore.
What Monitoring Misses
Monitoring tells you what happened. It doesn't tell you what didn't happen. That asymmetry is where most silent failures hide.
The Scope That Makes You Better
A tool's scope is not just what it covers — it's what allows it to be good at what it covers. Narrow scope is not a limitation. It's a prerequisite for excellence within the scope you chose.
Closing the Loop
The production gap and the disappearing failure report are two symptoms of the same problem: an open loop. The tool that improves fastest is the one that closes it — tightly, deliberately, as a first-class part of how the product is built.
The Failure That Teaches
Not all failures are equally useful. A failure on a document the tool has never seen before is the most valuable feedback it can produce — but only if you capture it before it disappears.
The Production Gap
A document tool's performance on your evaluation set and its performance on your users' actual documents are two different numbers. The gap between them is structural, not a bug — and closing it requires a different kind of work than improving the eval.
The Honest Decline
No tool handles the entire long tail. The behavior that separates a trustworthy tool from a dangerous one is what it does on the document it can't handle: decline honestly, or guess and hope.
The Long Tail of Documents
The easy documents are all easy in the same way, and a tool handles them on day one. The value — and the difficulty — lives in the long tail of documents that are each weird in their own particular way.