# We crawled GOV.UK with Crawl Cove: 4,963 pages, every one a 200

Source: https://crawlcove.com/teardowns/gov-uk
Published 2026-10-29 · Updated 2026-11-02 · By Lewis Jones

> A GOV.UK technical SEO audit through a crawler's eyes: 4,963 pages, no errors, no broken links, and the handful of things even GOV.UK leaves on the table.

## Key takeaways
- 4,963 URLs crawled before the 5,000 cap, all of them HTTP 200, no fetch errors, no broken internal links
- 781,000 further URLs were discovered and not crawled; robots.txt kept the crawler out of 1,299 and 3,965 pointed at other gov.uk hosts
- 55 URLs redirect, 13 of them in chains of two or more hops, one of three
- 0 pages with a missing title; 19 indexable pages share a title with another; 252 indexable pages carry no canonical tag
- 411 pages have no meta description and 1,218 have one longer than 160 characters
- 1,282 titles run past 60 characters
- 1,066 guide pages carry two H1s, by design
- 3,356 images on the crawled pages, 21 of them without alt text, all the same licence logo

GOV.UK is the benchmark. It is the most audited public website in the country, built
by a team that publishes its own standards, so we crawled it first to show what a
clean site looks like inside Crawl Cove, and what is still left over when a site is
that clean. Everything below is what the crawler saw on 29 October 2026 from a crawl
capped at 5,000 URLs, which is a thin slice of a site that lists hundreds of thousands
of pages. It is a reading of that slice, not a verdict on GOV.UK.

## The crawl

4,963 URLs fetched before the cap; every one of them answered 200. No server errors,
no client errors, no timeouts, no broken internal links. The crawler discovered another
781,000 URLs it did not fetch, which is the honest measure of how much of GOV.UK five
thousand pages covers: the Overview's health score says so itself ("scores the 1% of
discovered URLs this crawl reached"). robots.txt kept us out of 1,299 URLs, and 3,965
links pointed at other gov.uk hosts (assets.publishing.service.gov.uk alone accounted
for 1,844), which a single-host crawl leaves alone.

**Figure:**
src: /media/teardowns/gov-uk/overview.png
alt: Crawl Cove Overview for GOV.UK after a 4,963-page crawl: health score 41 out of 100 on the 1% of discovered URLs reached, no Search Console connected, and the next jobs list led by five duplicate-title groups
label: Overview after the crawl
caption: The Overview. The 41/100 health score is a per-page tally of every check on this 1% slice, with no Search Console weighting, so read it as a description of the crawl rather than a grade for the site.

What good looks like, in numbers: 0 missing titles across 4,902 HTML pages, 3,356
images with only 21 missing alt text, redirects on just 55 URLs out of 4,963, and a
site that answered 4,963 requests at two a second without a single hiccup.

**Figure:**
src: /media/teardowns/gov-uk/findings.png
alt: Crawl Cove Findings for GOV.UK: 16,991 findings, 0 urgent, 7,149 improvements and 9,842 opportunities, led by duplicate titles and H1 counts
label: Findings, sorted by severity
caption: 16,991 findings across 4,963 pages sounds like a lot until you read the tabs: 0 urgent. Most of the volume is three or four sitewide patterns, each counted once per page.

## Five things the GOV.UK technical SEO audit noticed

### 1. Thirteen redirect chains, one of them three hops

What it is: 55 crawled URLs redirect. 42 are single hops; 13 take two or more, and one
(a National Insurance statement page) takes three 301s to land on its current guidance
URL. Three chains pass through an http:// URL on the way to https. Why it matters: each
hop costs the visitor time and the crawler budget, and search engines follow only a few
before they stop. On a site this size 13 chains is a rounding error, which is the point:
they still exist. The [free redirect checker](https://crawlcove.com/tools/redirect-checker) runs the same check on a single URL.

**Figure:**
src: /media/teardowns/gov-uk/evidence-redirect-chain.png
alt: Crawl Cove evidence drawer for a GOV.UK redirect-chain finding, showing the 55 affected pages, the hop list for one URL and the recommendation to point internal links at the final destination
label: Evidence drawer for a redirect chain
caption: Each chain is listed hop by hop. The drawer also lists which crawled pages still link to the old URL, which is the list you would hand to whoever edits the content.

### 2. Nineteen indexable pages sharing a title

What it is: 73 title strings are used by more than one crawled page, 490 pages in all,
but the crawler raised only 19 pages as duplicates. The rest are search listing pages
("News and communications - GOV.UK" appears 78 times) that canonicalise to a single URL
or carry noindex, so they are the same page to Google and the check leaves them alone.
The 19 that remain are real pairs: a publication and the guidance page that replaced it,
a consultation and its outcome. Why it matters: Google picks one page per title to rank
and quietly suppresses the other. Fix: a distinct title for whichever of the pair is
meant to rank.

**Figure:**
src: /media/teardowns/gov-uk/findings-duplicate-title.png
alt: Crawl Cove Findings filtered to duplicate-title on GOV.UK: 19 high-severity rows, each naming the title shared and the other page using it
label: Duplicate titles, filtered
caption: The duplicate-title check only counts indexable pages. The search listing URLs that share a title are excluded because their canonical tags already say which one counts.

### 3. Meta descriptions: 411 missing, 1,218 too long

What it is: of 4,902 HTML pages, 411 have no meta description, 1,218 have one over 160
characters and 666 have one under 70. Why it matters: Google writes its own snippet
when the description is missing or cut, and GOV.UK's content is exactly the kind where
the first sentence is a good snippet anyway, which is why this sits at medium, not high.
The long ones are mostly publication summaries pasted whole into the tag.

### 4. 252 indexable pages with no canonical tag, 392 pointing elsewhere

What it is: 252 pages that can be indexed carry no rel=canonical at all, and 392 declare
a canonical that is a different URL (the filtered search listings above, mostly, which
is correct). Why it matters: a missing canonical is harmless until the same page is
reachable at two URLs, and GOV.UK's redirect discipline means it rarely is. It is a
belt-and-braces fix. The [canonical issue page](https://crawlcove.com/issues/meta) explains the check.

**Figure:**
src: /media/teardowns/gov-uk/evidence-canonical.png
alt: Crawl Cove evidence drawer for a canonical finding on a GOV.UK page: no rel=canonical link on an indexable page, with the why-it-matters text and recommendation
label: Evidence drawer for a missing canonical
caption: Every finding says what was read from the page. Here: no rel=canonical on an indexable page.

### 5. Two H1s on 1,066 guide pages, and 21 alt-less copies of one logo

What it is: GOV.UK's multi-part guides (Universal Credit, eVisas, HMRC sign-in) put the
guide title and the part title both in an H1, so 1,066 pages report two. That is a
design decision the crawler flags because most sites that have two H1s did not mean to;
here it is deliberate and consistent, and we note it rather than score it. The 21
images without alt text are all one file: the Open Government Licence logo in
publication footers. One template fix clears all 21. The
[image alt text checker](https://crawlcove.com/tools/image-alt-text-checker) runs the same check on one URL.

**Figure:**
src: /media/teardowns/gov-uk/evidence-image-alt.png
alt: Crawl Cove evidence drawer for an image-alt finding on a GOV.UK publication page, naming the one image with no alt attribute, the Open Government Licence logo
label: Evidence drawer for missing alt text
caption: All 21 image-alt findings name the same asset, which is the clue that it is one template rather than 21 editors.

Also seen and left alone: 2,269 Article and 225 NewsArticle JSON-LD nodes without a
headline property (Google lists headline as recommended, so this is a tidy-up), 1,282
titles over 60 characters (GOV.UK favours full descriptive titles and accepts the cut in
the result), 66 noindex pages, and 651 near-duplicate pairs, almost all of them
multi-part guides whose parts share the same frame.

## What we'd fix first

1. Point the internal links behind the 13 chained redirects at their final URL, starting
   with the three-hop National Insurance page.
2. Give the 19 duplicate-title pairs distinct titles, choosing which of each pair should
   rank.
3. Add alt text to the Open Government Licence logo in the publication template (clears
   all 21 image findings in one edit), then write meta descriptions for the 411 pages
   without one, starting with the most-visited.

That is the whole list for one of the best-run sites in the country, which is roughly
what we expected. The crawl itself took 45 minutes at two requests a second.
