Return on Investment (ROI)

📖 12 min read

Return on investment (ROI) compares what an investment returns with what it costs. For architects, it’s the language for explaining why a platform migration, an observability investment, or a reliability project deserves funding, in terms the people who fund it already use. It also works as a discipline for the architect. An investment whose benefits can’t be described concretely enough to estimate is one whose value is still unclear.

Where total cost of ownership asks what an option costs over its life, ROI asks whether the benefits justify that cost. The cost side of an ROI calculation is the TCO estimate.

Quantifying Benefits

Benefits are harder to estimate than costs, because costs appear on invoices and benefits mostly appear as things that didn’t happen, happened faster, or happened more often. Converting them to money requires a stated mechanism: what changes, how much, and what that change is worth.

Benefit Mechanism How to value it
Revenue More conversions, new customers, reduced churn, new markets Change in the business metric × value per unit, such as orders × average margin
Cost reduction Lower infrastructure, license, or support spend Before cost − after cost, per period
Risk reduction Fewer or less severe incidents, breaches, or compliance failures Change in expected loss, probability × impact before and after
Productivity Engineers or staff spending less time on toil Hours saved × loaded rate, counted only where the time is redeployed to valuable work
Time to market Delivering a capability sooner Cost of delay, the value lost per week the capability isn’t available

Direct Savings

Direct savings are the easiest to defend. Automating a deployment that takes an engineer four hours by hand, at a loaded rate of $100 an hour, saves about $375 per deployment if the automated version takes 15 minutes of attention. Across 50 deployments a year, that’s roughly $18,750. The figures here and throughout this guide are illustrative.

Risk Reduction as Expected Value

Risk reduction is valued as the change in expected loss. If the chance of a major outage in a year is 10% and an outage would cost $500K in lost revenue, recovery work, and contractual penalties, the expected annual loss is $50K. An investment that lowers the probability to 2% reduces the expected loss to $10K, a benefit of $40K a year. The method makes assumptions explicit, which is its main value, since the probability estimates are uncertain and stakeholders can challenge them directly.

Productivity Gains

Productivity gains are the benefit most often overstated. Saving each of 20 engineers two hours a week is 2,080 hours a year, but it becomes money only if those hours go to work that produces value, or if the organization needs fewer hires as a result. Hours saved in fragments of a few minutes throughout the day rarely turn into anything measurable. Presenting productivity as capacity freed for specific work, such as “the equivalent of one engineer’s time for the roadmap,” tends to be more credible than a large dollar figure.

Time to Market

Delivering a capability earlier is worth the value that would have been lost while waiting, often called the cost of delay. If a feature is expected to contribute $20K a month once live, each month of delay costs $20K. Cost of delay turns speed improvements into money, and it also helps rank investments, since those with high cost of delay and short duration usually belong first in the queue.

Calculation Methods

Four methods cover most investment cases. Each answers a different question, and each misses something the others catch. The examples below use one investment: $100K up front, returning $40K a year for five years.

Simple ROI

ROI = (total benefits − total costs) / total costs

Total benefits are $200K against $100K of cost, so ROI is 100%. Simple ROI is easy to explain but ignores when benefits arrive, so a return delivered over ten years looks the same as one delivered over one year. It fits quick comparisons of short-lived investments.

Payback Period

Payback period = up-front investment / annual net benefit

The investment pays back in $100K / $40K = 2.5 years. Payback shows how long money is at risk, which matters when cash is tight or the future is uncertain. It ignores everything after the payback point, so an investment that pays back in two years and then stops is ranked above one that pays back in three years and keeps returning for a decade.

Net Present Value

Money received later is worth less than money received now, because money available now can be invested elsewhere. Net present value (NPV) discounts each future cash flow to its present value and subtracts the investment:

NPV = Σ [net cash flow in year t / (1 + r)^t] − up-front investment

The discount rate r reflects the organization’s cost of capital and the risk of the investment, and finance teams usually specify it. At a 10% rate:

Year Net benefit Discount factor Present value
1 $40K 0.909 $36.4K
2 $40K 0.826 $33.1K
3 $40K 0.751 $30.1K
4 $40K 0.683 $27.3K
5 $40K 0.621 $24.8K
Total     $151.6K

NPV is $151.6K − $100K = $51.6K. A positive NPV means the investment returns more than the discount rate requires. NPV is the most reliable single measure for comparing investments, since it accounts for timing, scale, and the full horizon, but it depends on a discount rate that non-finance audiences may not find intuitive.

Internal Rate of Return

The internal rate of return (IRR) is the discount rate at which NPV equals zero. For this investment it’s about 28.6%. If the organization’s required return, its hurdle rate, is lower than the IRR, the investment clears the bar. IRR is easy to compare across investments of different sizes, which is also its weakness. A small project with a 60% IRR can create less total value than a large one with a 25% IRR, and when the two measures disagree about which of two alternatives to choose, NPV is the one to follow.

Method Answers Misses
Simple ROI How much does it return per unit of cost? When returns arrive
Payback How long until the investment is recovered? Everything after payback
NPV How much value does it create in today’s money? Intuitiveness for non-finance audiences, and relative efficiency across sizes
IRR What rate of return does it earn? Scale, so it can rank a small investment above a more valuable large one

Handling Uncertainty

Every input to an ROI estimate is uncertain, and a single number hides how uncertain. Three practices expose it.

Ranges Instead of Points

Estimating each uncertain input as a range, such as “incident reduction between 15% and 40%,” says more than a single figure and makes clear where the uncertainty lies. Douglas Hubbard’s work on calibrated estimation shows that people can learn to give ranges that contain the true value about as often as they claim, which a single number can’t be checked for at all.

Sensitivity Analysis

Sensitivity analysis recalculates the result while varying one input at a time. For the example investment, varying the annual benefit shows how much the conclusion depends on it:

Annual benefit NPV at 10% over 5 years
$25K −$5.2K
$40K $51.6K
$55K $108.5K

Break-Even Values

The break-even value of an input is the value at which the investment stops making sense. Here, the annual benefit at which NPV reaches zero is $100K divided by the five-year discount factor total of 3.791, about $26.4K. Stakeholders can then debate a concrete question, “are we confident the benefit is at least $26K a year?”, instead of arguing over a single projection.

Chart

NPV Sensitivity and Break-Even

NPV against annual benefit, crossing zero at the break-even value.

Net present value against annual benefit for the example investment A straight line of NPV at 10 percent over five years against the annual benefit of a $100K investment. At $25K a year NPV is minus $5.2K, at $40K it is $51.6K, and at $55K it is $108.5K. The line crosses zero at the break-even benefit of about $26.4K a year. $20K $30K $40K $50K $60K −$40K $0K $40K $80K $120K $25K: −$5.2K $40K: $51.6K $55K: $108.5K break-even ≈ $26.4K annual benefit NPV at 10% over 5 years, for a $100K investment NPV below zero

Estimation Bias

Estimates of technology investments tend to err in one direction. Benefits are overestimated and costs and durations underestimated, a pattern known as optimism bias. Daniel Kahneman and Amos Tversky named the tendency to underestimate the time and cost of planned work the planning fallacy. The people proposing an investment usually want it approved, which adds motivated reasoning on top.

Several practices counteract the bias:

  • Reference class forecasting. Bent Flyvbjerg’s approach bases estimates on the actual outcomes of similar past projects, rather than on the details of the current plan. An organization’s own history of past estimates versus actuals is the most relevant reference class it has.
  • Explicit assumptions. Listing every assumption lets reviewers challenge the ones they doubt, instead of rejecting or accepting the conclusion whole.
  • Pre-mortems. Imagining the investment has failed and asking why surfaces risks that an optimistic plan leaves out.
  • Independent review. Someone without a stake in the outcome checking the benefit estimates catches the assumptions the proposer is too close to see.

Worked Example

The figures below are illustrative, chosen to show the method, not benchmarks.

An organization with frequent production incidents is considering an observability investment. It costs $100K to implement and $125K a year in licenses and upkeep. The organization has about ten major incidents a year, each costing around $50K, for $500K a year in expected losses. Twenty engineers each spend about 5% of their time on incident response, and at a $180K loaded cost that time is worth $180K a year.

The proposal estimates that better visibility will cut incident costs by 30%, through fewer incidents and shorter ones, and cut engineer incident time by 40%.

Item Annual value
Incident cost reduction, 30% of $500K $150K
Engineer time recovered, 40% of $180K $72K
Total annual benefit $222K
Annual running cost −$125K
Annual net benefit $97K

Over three years at a 10% discount rate, the net benefits are worth $97K × 2.487 = $241.2K today, and NPV is $241.2K − $100K = $141.2K. Payback takes a little over a year. Simple ROI over the three years is ($666K − $475K) / $475K, about 40%.

The incident reduction is the least certain input and the largest benefit. If it turns out to be 15% rather than 30%, the annual net benefit falls to $22K and NPV becomes −$45.3K. The break-even reduction, where NPV is zero, is about 19%. The decision therefore rests on one question the organization can investigate. Given how its past incidents were detected and diagnosed, is a reduction of at least 19% in incident cost realistic? Reviewing recent incidents for how much time was spent finding the cause would answer it far better than refining the other inputs.

Beyond the Numbers

Some investments shouldn’t be decided by ROI. Mandatory compliance work has to be done regardless of return, so the useful question becomes which way of meeting the requirement costs least. Security controls protect against losses that are hard to estimate and potentially severe, so expected-value estimates may understate what the organization is willing to pay to avoid them.

Other investments create options rather than direct returns. A platform that makes new products cheaper to build, or an architecture that makes a future migration possible, has value that depends on decisions not yet made. Estimating that value precisely is rarely possible, but naming the options explicitly, and what they would be worth if exercised, keeps them from being dropped from the case entirely.

When several non-financial criteria matter, a weighted scoring model can make the trade-off explicit. Each option is scored against criteria such as cost, time to implement, scalability, and risk, and each score is multiplied by a weight reflecting the criterion’s importance. The weights are subjective, so the model’s value lies in making disagreements about priorities visible rather than in the precision of the total.

Post-Implementation Reviews

An ROI estimate is a prediction, and checking predictions against outcomes is what makes the next estimate better. A post-implementation review, held once the investment has had time to produce its benefits, compares actual costs and benefits with the original estimate, identifies which assumptions were wrong and why, and records what to do differently.

The reviews are most useful when they feed back into the organization’s estimation practice. A record showing that productivity benefits have consistently come in at half their estimates is the reference class the next proposal should be judged against. Reviews held to assign blame for a missed estimate teach people to stop making honest estimates, so framing them around learning matters as much as holding them.

Common Pitfalls

  • A formula that double-counts cost. ROI is total benefits minus total costs, divided by total costs. Subtracting cost from a benefit figure that is already net of cost understates the return.
  • Counting hours saved as cash. Productivity benefits become money only when the time goes to valuable work or reduces hiring.
  • Ignoring timing. Simple ROI and payback treat distant returns like near ones. Use NPV for multi-year investments.
  • Choosing by IRR alone. A high rate on a small investment can create less value than a lower rate on a larger one.
  • Single-point estimates. One number per input hides which assumption decides the outcome. Use ranges, sensitivity analysis, and break-even values.
  • Optimistic benefits. Benefit estimates tend to run high. Compare them with the organization’s own past estimates versus actuals.
  • Never checking. Without post-implementation reviews, estimation errors repeat indefinitely.

Quick Reference

Measure Formula Use when Watch for
Simple ROI (benefits − costs) / costs Quick comparison of short-lived investments Ignores timing
Payback period Up-front investment / annual net benefit Cash or risk exposure matters Ignores returns after payback
NPV Σ discounted net cash flows − investment Comparing multi-year investments Depends on the discount rate finance provides
IRR Discount rate where NPV = 0 Comparing against a hurdle rate Ignores scale, can mis-rank alternatives
Expected loss reduction (probability × impact) before − after Valuing reliability and security work Uncertain probabilities
Cost of delay Value lost per period of waiting Valuing speed and sequencing work Value estimates for unreleased capabilities
Break-even value Input value at which NPV = 0 Focusing debate on the assumption that matters Treating the break-even as a forecast

Found this guide helpful? Share it with your team:

Share on LinkedIn