AI in Real Estate · Practitioner Guide
When Your AVM Should Say "I Don't Know"
The most important thing an automated valuation model can do is refuse to give you an answer.
That sounds counterintuitive. You buy an AVM for speed and coverage. You want a number for every property in your portfolio, instantly, at negligible cost. And the commercial pressure on AVM providers pushes in exactly this direction: broader coverage, higher hit rates, a valuation for every address you throw at it. But this pressure, left unchecked, produces a system that is confident when it should be cautious and silent when it should be shouting a warning.
The technical term is suppression: the decision by an AVM to withhold a valuation when the conditions for reliable automated estimation are not met. Suppression is not a bug. It is, or should be, a core design feature. And if your AVM never declines to value a property, it is lying to you some of the time.
What makes a property unvaluable (by machine)
AVMs are pattern-recognition systems. They learn relationships between property characteristics and transaction prices from large volumes of historical data, then apply those learned relationships to estimate the value of properties they have not seen before. This works remarkably well when the property in question resembles properties the model has seen plenty of: a standard three-bedroom semi-detached in a suburb with active transaction volumes and dozens of recent comparable sales.
It works poorly, sometimes dangerously, in several identifiable situations.
Thin markets. When transaction volumes are low (rural areas, niche property types, markets in prolonged stagnation), the model has insufficient data to learn reliable patterns. A valuation produced in these conditions may look precise but carries wide uncertainty that the headline number conceals.
Unusual properties. A converted chapel, a property with extensive land, a mixed-use building with a flat above a commercial unit: these properties fall outside the distribution the model was trained on. The model will still produce a number, because that is what models do. But it is extrapolating beyond its experience, and extrapolation is where machine learning fails most spectacularly.
Data gaps. If the property's records are incomplete (missing floor area, unrecorded extensions, ambiguous tenure), the model is working with corrupted inputs. The old principle applies: garbage in, garbage out. But unlike a human valuer, who would notice the gap and investigate, an AVM will silently impute or ignore the missing data and produce a confident estimate regardless.
Market dislocation. In rapidly shifting markets (a sudden correction, a localised boom driven by a new infrastructure announcement, a pandemic-era repricing of urban versus rural), historical patterns may no longer hold. The model's learned relationships were calibrated to a world that has just changed, and it has not yet seen enough post-change transactions to recalibrate.
The metrics that signal unreliability
A well-designed AVM does not simply produce a point estimate. It also produces a measure of how much it trusts that estimate, and this is where the decision to suppress or proceed should be made.
The key metric is the Forecast Standard Deviation (FSD), which quantifies the model's confidence in a specific valuation. Think of it as a margin of error attached to each individual property, not to the portfolio as a whole. An FSD of 0.05 means the model is reasonably confident the true value is within about five per cent of its estimate. An FSD of 0.18 means the uncertainty band is wide enough that the estimate could be twenty per cent off in either direction. At that point, you are not valuing; you are guessing with mathematical decoration.
Responsible AVM deployment sets clear thresholds. Above a certain FSD (commonly around 0.15), the valuation is suppressed and a human appraisal is triggered instead. Below the threshold, the valuation is released with its confidence score attached, so that downstream users (underwriters, portfolio managers, tax assessors) can make risk-adjusted decisions about how much weight to place on it.
The commercial pressure to override suppression
Here is where things get uncomfortable. Every suppressed valuation costs money. If the AVM declines to value a property, someone has to order a traditional appraisal: slower, more expensive, and a bottleneck in the lending process. The commercial incentive is therefore to lower the suppression threshold, to tolerate wider uncertainty, and to push the AVM to produce valuations for properties it should really leave alone.
This pressure is real, and it is rational from a short-term cost perspective. But it creates a specific, measurable risk. The valuations that get produced when suppression thresholds are loosened are precisely the ones most likely to be wrong, and they are wrong in ways that are invisible until a transaction reveals the gap. A lender who overrides suppression to speed up origination is trading visible cost savings now for invisible risk accumulation that will surface later, possibly much later, and possibly all at once when the market turns.
What good looks like
A trustworthy AVM should meet several conditions before releasing a valuation. The property should have a validated address with accurate geolocation. The surrounding area should have sufficient data coverage, commonly defined as at least seventy per cent coverage at the local census level. The property-level confidence score should fall below the suppression threshold. And there should be a minimum number of genuinely comparable recent sales available, commonly at least five within the preceding twelve months.
When any of these conditions is not met, the right answer is not a valuation with a caveat. The right answer is no valuation at all, accompanied by a clear signal that human judgement is required.
This is the discipline of suppression: building a system that is not just accurate when it speaks, but honest when it cannot be.
What to do about it
If you are a lender, asset manager, or valuation professional who relies on AVM outputs, three steps are worth taking now.
First, ask your AVM provider what their suppression rate is and at what confidence threshold they suppress. If they cannot answer, or if the answer is that they do not suppress, treat that as a red flag, not a selling point.
Second, insist on property-level confidence scores attached to every valuation, not just portfolio-level accuracy statistics. Portfolio averages hide the individual cases where the model is least reliable, which are exactly the cases where you are most exposed.
Third, build a human review process around the edges. The properties that sit just above the suppression threshold, the ones the AVM values but with lower confidence, deserve a second look. Automated valuation and professional judgement are not competing approaches; they are complementary layers in a system that is only as trustworthy as its weakest link.
An AVM that always gives you an answer is not a more capable product. It is a less honest one.
🎓
Need your team to understand when to trust an AVM and when to override it?
Bespoke corporate training on AVM governance, suppression policy, and confidence-score interpretation for lenders, asset managers, and valuation professionals.