Retention Can't Tell You Whether a Kid Is Learning
In a synthetic staggered rollout of two learner features, a daily-streak feature wins on retention by a wide margin while a guided-tutoring …
Read More
Field Testing · Trail & Data
Boulder
Boulder
Gear Lab
Testing gear on mountains. Testing ideas with mountains of data.
Scroll to explore
100,000+
Miles Tested
Trails, roads & mountains
200+
Reviews Contributed
Honest, in-depth analysis
5M+
Feet of Elevation
Colorado's high country
100B+
Rows Analyzed
Mountains of data
Fresh from the Lab
Latest Posts
Gear reviews and data projects from Boulder, Colorado
The Refusal Tax
A synthetic replication of a safety-classifier rollout shows a naive retention comparison overstates the true friction cost of …
Read More
What Losing Responses Have in Common
Human preference votes contain enough structure to calibrate a quality judge from scratch. Applied to the losing responses, that judge maps …
Read More
adidas Terrex Agravic Speed 2 Review
A light, agile trail racer with excellent dry-surface grip and a secure heel, best suited to short-to-mid-distance mountain efforts.
Read Full Review
The Value of Failure Taxonomy
Detecting that an AI system is failing is the easier problem. A failure taxonomy maps observable loss signals to the system layer …
Read More
How Users Vote With Their Prompts
When GPT-4 launched in March 2023, the topic mix of real user prompts shifted in the exact direction the model quality gaps would predict: …
Read More