If your team runs on DORA
A measurement playbook. For each DORA metric: what to measure under RACE Programming, where to pull it from, what target to hold, and the one thing to actually watch. Plus the three RACE-native metrics DORA does not have and you now need.
During a rollout, the TPM, who organizes the transition, brings these readings into the cross-team status rhythm and the risk register. The numbers stay with the teams that produce them.
The one reframe that drives all of this: DORA measures commit to production. AI collapses the part from commit to production-ready almost by construction, and the rest of that clock, like deployment frequency, simply follows the client's release cadence. Neither is the interesting number any more. Re-point your instrumentation at two things instead: quality at the Pit Stop, and the idea-to-production clock.
Deployment Frequency
- Measure: Pit Stops shipped per week, per Pit Crew.
- Source: your CD pipeline, tagged by release. One Pit Stop is one production release.
- Target: whatever the client's release cadence sets, from several a week down to one a quarter. The team should never be the reason a Pit Stop slips.
- Watch: not the count, which the client's cadence sets, but the share of Pit Stops that cleared all four Definition-of-Done gates on the first pass.
Lead Time for Changes (run two clocks)
- Measure, execution clock: median hours from a commit to all four Definition-of-Done gates green, ready for the next Pit Stop.
- Measure, RACE-native clock: median days from a Team Principal idea logged in the Executable Product Backlog to the Pit Stop that releases it.
- Source: Executable Product Backlog timestamps (idea logged, EUS accepted) joined to the release timestamp.
- Target: execution clock in hours, not days. The idea-to-production clock is your real number; benchmark it against itself over time.
- Watch: the gap between the two clocks. Tiny execution time plus a large idea-to-production time means the constraint is upstream (specification and acceptance), not engineering.
Change Failure Rate
- Measure: Pit Stops that need an unplanned fix within your incident window (for example seven days) divided by total Pit Stops.
- Source: incident tracker joined to Pit Stop releases.
- Control it with: the four-gate Definition of Done (unit coverage at or above 80%, integration, end-to-end, automated acceptance) plus the Gherkin acceptance criteria in every EUS. A failed gate returns to Build; nothing reaches a Pit Stop ungated.
- Target: flat or falling as throughput rises. If CFR climbs, it is a gate problem, not a speed problem; tighten the gate, do not slow the agent.
- Watch: always plot it on the same chart as EUS per week. A velocity gain with a rising CFR is not a win.
Failed Deployment Recovery Time
- Measure: median time from a failed Pit Stop detected to service restored.
- Source: incident tracker (opened to resolved), filtered to deploy-caused incidents.
- Target: minutes, not hours. Everything as Code makes rollback a deterministic config revert, not a firefight.
- Watch: slow recovery means your pipeline is not yet fully Everything as Code. That is the fix.
Deployment Rework Rate (the 2025 fifth key)
- Measure: unplanned Pit Stops caused by a production incident divided by total Pit Stops.
- Source: tag every Pit Stop as planned or unplanned-incident-driven.
- Target: near zero. Each unplanned Pit Stop is a defect that slipped the gates.
- Watch: this is your earliest signal the Definition of Done is too loose. When it rises, tighten the specific gate that let the defect class through.
Add these, or you are measuring the half that got easy
EUS throughput (your real velocity)
- Measure: Executable User Stories accepted (passed the Definition of Done, shipped in a Pit Stop) per week, per team.
- Source: the Executable Product Backlog / delivery board.
- Use it instead of: story points and commit counts, both of which break the moment the agent writes the code.
Idea-to-Pit-Stop lead time
- Measure: median time from a Team Principal idea logged to the Pit Stop that releases it (the RACE-native clock above, tracked as a first-class metric).
- Why: once execution is free, this is the number that actually reflects how fast you turn intent into production.
Team Principal absorption capacity (the new ceiling)
- Measure: EUS the Team Principal can specify and accept per week, divided by EUS the Pit Crew can ship per week.
- Source: Executable Product Backlog (accepted-by-Team-Principal timestamps) versus Pit Crew throughput.
- Target: ratio approaching 1. Below 1, the client is the bottleneck, and that is where to add Pit Wall capacity (see the staffing guide).
- Why: when the team can outproduce the client, this metric sets your pace. It is the one DORA cannot see.
Keep the DORA five as guardrails. Manage to EUS throughput, the idea-to-production clock, and absorption capacity. DORA tells you the old bottleneck is gone; these tell you where the new one is.