Auditing Site for Common Problems

Discover how to diagnose and fix some common technical problems that almost always arise into the website in this lesson.

Duplicate content

One common battle that content developers often encounter is against duplicate content. Duplicate content is the situation where we have identical or near-identical content on multiple pages of our own site or on other sites.

Examples of duplicate content

Even when we attempt to create and upload unique content to our site’s pages, there are cases where duplicate content issues pop up unintentionally. Sometimes, our CMS creates multiple versions of the same page that appear on different URLs.

In e-commerce sites where there can be individual pages for multiple variations of the same product in different colors, for example, search engines might suspect duplicate content.

Such pages are nearly identical, apart from the slight differences, such as in the product name. There can be several different variations of the same product. This means that if there are 13 variations of a product, there will be 13 pages with near-identical content. Though a human visitor to the site is smart enough to understand the difference, it might confuse a search engine, making all the page variations struggle for ranking.

Letting duplicate content exist on our site without the necessary fixes can hurt our site’s ranking. The most popular technical solution to onsite duplicate content is the use of canonical tags.

Using canonical tags

Pages with similar content can be grouped together using canonical tags. It’s a marker added to the <head> section of the page’s HTML code to specify the original copy of the page or the copy we want to rank for.

For the example above where there were 13 variations for the throw blanket, let’s say we want to mark the ‘Faux Knit’ color as the main one. To do so, include the following code on all 13 pages, including the original one:

<link rel=“canonical” href=“https://www.walmart.com/ip/Mainstays-Extra-Plush-Cozy-Lightweight-Sherpa-Throw-Blanket-50-X-60-Gray/826870015” />
Canonical tags

If we’re using the Yoast SEO plugin on WordPress, it automatically adds self-referencing canonical URLs to all our pages. Self-referencing canonical tags are those that simply specify the page’s URL that they are on as the original, which is the default case. We can customize canonicals using the “Advanced” settings on each page.

Check for duplicate content issues

Other than adding a canonical tag to every page on our website, we can audit our site to detect any duplicate content issues that still remain. Ahrefs Site Audit lets us identify unconsolidated duplicates in the “Content Quality” section.

We can also detect duplicate content using the URL Inspection Tool in Google Search Console.

Broken links

Having a bunch of broken links on our site downgrades user experience. It’s frustrating to click a link and find out the page does not exist!

Press + to interact
Broken Link
Broken Link

Dead links also eat away our crawl budget (discussed later). Broken internal links make it difficult for Googlebot to crawl and index our site’s pages. All of these issues resulting from broken links bring us to one point—broken links need fixing.

How to find broken links on our website

Semrush’s Site Audit tool crawls our site’s pages. Among other audits, it also points out the broken links. Ahrefs Site Audit, Ubersuggest Site Audit, and Screaming Frog are also good resources to detect dead links.

Here’s where we can spot broken links in Ubersuggest Site Audit.

Press + to interact
Image from Ubersuggest
Image from Ubersuggest

There are no broken links in this case. However, if “broken links” appear in “TOP SEO ISSUES” on the right, we can click “View Details” to spot which links are broken.

How to resolve broken links

Broken links are resolved by either fixing it or redirecting to new, live URLs. We can either apply the redirects manually or use a WordPress plugin to make our job easier.

Manual approach

There are multiple ways to do the task manually. One approach is to use the meta refresh tag in the <head> section of the HTML page. Paste the following code with the address of the new URL we want to redirect to:

<meta http-equiv="refresh" content="0; URL='http://new-content-webpage.com'" />
meta refresh tag

Another approach is to access and edit the .htaccess file from the root folder of our WordPress website. Here’s a complete guide on the different methods to apply 301 redirects to broken links.

Plugins

If we don’t want to spend time placing redirects manually, there are a bunch of WordPress plugins that make it easier for us. Simple 301 Redirects lets us check and redirect dead links in just a few steps.

Broken Link Checker is another free tool that scans our website for broken links. It also lets us "Edit" the link with a new URL. Since the plugin slows down our site’s performance while it is active, remember to remove the tool once its job is done.

Test your knowledge

Match the ways to fix broken links on the left to their most appropriate techniques on the right.

Match The Answer
Select an option from the left-hand side

Resolve broken links manually

Edit the .htaccess file

Resolve broken links with plugins

Redirect dead links using a tool


Choose the best answer for the question below.

Q

How can canonical tags help address duplicate content issues on a website?

A)

By deleting duplicate pages

B)

By redirecting duplicate pages to a single URL

C)

By marking the original or preferred version of a page

D)

By adding unique content to all pages

Get hands-on with 1300+ tech skills courses.