Template Diversification Ratio

Template Diversification Ratio (TDR) measures how your crawlable URLs are split across page templates. It matters because a site with 80% of URLs on one template usually has a crawl and indexing problem, not just a content inventory quirk.

What TDR actually tells you

TDR is simple: count crawlable URLs by template, then divide each template count by total crawlable URLs. Product pages, category pages, editorial hubs, FAQs, comparison pages, location pages. Whatever your real template set is.

On large sites, this exposes structural bias fast. If an e-commerce site sits at 74% product, 18% category, 5% editorial, 3% support, Googlebot is likely spending too much time on low-differentiation URLs. That usually means slower discovery of new high-value pages and weaker internal PageRank flow to commercial hubs.

Use Screaming Frog for the crawl, then classify templates with URL patterns, body classes, structured data markers, or CMS exports. For sites above 500,000 URLs, pair crawls with server logs and Google Search Console crawl stats. If you are not checking logs, you are guessing.

Why advanced SEOs care

TDR is not a Google metric. That is the point. It is an operational metric that helps explain why indexation and crawl efficiency look bad in GSC.

• Crawl allocation: If one template owns 70%+ of crawlable URLs, Googlebot often over-recrawls repetitive pages while strategic templates stay under-fetched.
• Intent coverage: A healthy site usually spans multiple search intents. If informational or comparison templates sit below 5%, you are probably leaving upper-funnel demand to competitors.
• Internal equity: Template sprawl dilutes link equity. Thousands of thin variants can bury category or solution pages that should rank first.
• Forecasting: TDR helps estimate where pruning or expansion will matter. Cutting 200,000 low-value URLs is easier to defend when one template is clearly bloated.

How to calculate it properly

Start with indexable, canonical, crawlable URLs. Not every discovered URL. Exclude parameter junk, blocked URLs, and obvious duplicates. Then group by template and calculate percentage share.

Good tooling stack: Screaming Frog for extraction, Ahrefs or Semrush for template-level traffic checks, Moz or Ahrefs for link signals, and GSC for validation on crawl and indexation. Surfer SEO is not a TDR tool, but it can help evaluate whether underrepresented editorial templates are actually competitive once you decide to build them.

A practical threshold: if a single template exceeds 60% of crawlable URLs, review it. If it exceeds 75%, assume there is structural waste until proven otherwise.

Where TDR breaks down

Do not treat TDR like a universal KPI. A marketplace with 10 million valid product URLs will naturally skew hard toward product templates. That is not automatically a problem. The issue is when the dominant template also has weak demand, poor uniqueness, or low conversion value.

Classification is another weak spot. Regex-based template mapping breaks on hybrid layouts, faceted navigation, and JavaScript-heavy rendering. Validate with a manual sample of at least 200 URLs per major template. Google's John Mueller has repeatedly said crawl budget is mostly a concern for very large sites, and he was still making that point in 2025. So for a 5,000-page site, TDR is usually a prioritization aid, not a ranking lever.