Reliable forecasts come from historical system behavior rather than conjecture about individual work items.

  • When predicting outcomes, models based on historical system behavior outperform models based on speculative task estimates.
  • Because speculative estimates introduce large variance and bias.
  • When many tasks are estimated, variance explodes.
  • When predicting delivery based on historical throughput, variance exists, but it is bounded by observed system behavior.
  • Speculative estimates suffer from Optimism Bias
  • Speculative estimates suffer from Unknown unknowns. Estimation assumes complete task knowledge which is rarely ever known.
DomainEvidenceRelationshipSpeculation
Probabilistic ForecastingThroughput>Estimates
Hypothesis-Driven DevelopmentExperiments>Opinions
Evidence-Based ManagementMetrics>Intuition
Customer DiscoveryValidated customer pain>Guessed demand

Works Consulted

  1. How to Predict When the Team Will Complete a Specific Backlog Item, Part 1
  2. Jason Fried, 37signals
  3. Story Points Are Not the Problem, Velocity Is