A shortlist should be explainable
The products that appear in a comparison shape its answer. A broad but arbitrary list can make a ranking look comprehensive while concealing important alternatives. Clear inclusion rules let readers understand the scope and limits before they interpret the outcome.
Include products because they meet published relevance, availability, status and evidence rules for a stated user decision—not because of payment, familiarity or a convenient feature list. Exclude products when they cannot be assessed fairly, are unavailable for the stated reader, fail a red line or lack sufficient current evidence; explain material omissions.
Set rules before choosing names
User relevance
The product addresses the comparison’s stated task, setting and reader—not merely the broad category.
Comparable conditions
Price, plan, size, version, region and included service can be compared meaningfully.
Current status
The product is available or clearly labelled as discontinued, pre-release, region-limited or otherwise exceptional.
Sufficient evidence
Important claims can be sourced, checked or explicitly marked as unresolved.
Relevant alternatives
The shortlist includes realistic alternatives, not only market leaders or commercial partners.
Clear exclusions
A material omitted option has a stated reason when a reader could reasonably expect to see it.
Do not let commercial convenience decide inclusion
Commercial relationships, affiliate availability, free samples and vendor access can create incentives. They must not decide whether a product is included or give it an unexplained advantage. If a comparison cannot assess relevant alternatives fairly, its scope should be narrower or the conclusion should be withheld.
For general consumer context, the CMA says sites publishing reviews should give users the full picture and disclose interests. See CMA review-site guidance.
Inclusion FAQs
Should the most popular products always be included?
Popularity can be a useful signal of reader interest, but it is not enough on its own. The option still needs to fit the stated scope and have enough current, comparable evidence.
Can an older product be included?
Yes when it remains relevant, available and supportable for the reader. Its age, support status and replacement context should be clear.
What if a product cannot be assessed fairly?
Mark the gap, narrow the scope or leave it out with a reason. Guessing, copying an unverified claim or using a paid relationship to fill the gap would reduce trust.
Read comparisons with the right context
Use these guides to understand what a comparison can and cannot tell you. A useful result makes the inclusion, evidence, uncertainty, regional limits and commercial context visible before a reader acts.
