Key concepts · SEO

What is SEO? Why does it matter?

Short answer

SEO (Search Engine Optimization) is the combined technical, content and experience work that lets your site be found in relevant searches on search engines like Google, be understood correctly and look worth clicking. If a search engine can’t find or understand your page, it won’t appear in search, however good your content is.

How does a search engine work?

According to Google, search works in three stages:

  1. Crawling: Googlebot finds pages by following links and downloads their text, images and videos.
  2. Indexing: Google analyses the text, images and videos on the page and stores this information in its index.
  3. Serving results: When someone searches, Google shows the pages in its index that are most relevant to the query.

If a page gets stuck at any of these stages, it doesn’t appear in search. Google doesn’t guarantee that it will crawl, index or serve a page, and it doesn’t accept payment to crawl a site more often or rank it higher.

A page that isn’t indexed doesn’t appear in search

A noindex tag added to a page by mistake doesn’t stop it being crawled, but it does stop it being indexed: however good the content, it won’t appear in results.

Problem: the page has noindex; it’s crawled but not indexed
Fixed: the page is crawled, indexed and shown in results

Why does SEO matter?

If a search engine can’t find, read or understand your site, your content won’t reach the person searching for it. SEO removes these obstacles and makes the page appear in results accurately and in a way that’s worth clicking:

  • Findability: pages can be crawled and indexed (robots.txt, noindex, internal links, sitemap).
  • Clarity: the page’s topic is stated clearly through headings, text and structured data.
  • How it looks in results: Google says the title link is often the primary piece of information people use to decide which result to click.
  • Page experience: Google says Core Web Vitals are used by its ranking systems; but a good experience alone doesn’t guarantee a top ranking, because Google always seeks to show the most relevant content.

The title and description drive the click

The same page with two different titles: a generic title like “Home” and a description taken from a cookie notice don’t tell the user what they’ll find. A descriptive title and summary show that the page answers the query.

Problem: generic title, random description: the user goes to another result
Fixed: a title and summary that match the query: the user clicks

If the page shifts, users tap the wrong thing

If an ad that loads late pushes the content down, the user taps something they didn’t mean to. The CLS metric in Core Web Vitals measures this shift.

Problem: content shifts when the ad loads, and the finger lands on the ad
Fixed: the ad space is reserved in advance, and the button stays put

The layers of SEO

Technical SEO

Making pages crawlable and indexable: robots.txt, canonical, redirects, sitemap, HTTP status codes, speed.

Content

Reliable, people-first content that answers the user’s question; a clear heading structure and the right terms.

Page experience

Pages that load fast, don’t shift, respond to taps right away and are easy to use on mobile (Core Web Vitals).

Links and structured data

Google finds pages by following links; structured data tells machines explicitly what the page is about and makes it eligible for rich results.

Is your content in the initial HTML?

Google can run JavaScript across its crawling, rendering and indexing phases; but as Google itself notes, not all bots can run JavaScript, and server-side rendering is still a great idea. Having important content in the initial HTML response is the safest approach for both search engines and AI bots.

What does a bot that doesn’t run JavaScript see?

If content is only built by JavaScript in the browser, the initial HTML response is an empty shell. On a server-rendered page, the text is ready in the first response.

Problem: the initial HTML is an empty shell; the bot finds no content
Fixed: the text is in the initial HTML; every bot can read it

What SEO isn’t

  • It isn’t a guarantee: in Google’s words, no one can guarantee a #1 ranking on Google; beware of anyone promising guaranteed rankings or a “special relationship” with Google.
  • It isn’t a trick: practices like keyword stuffing, cloaking and buying links violate Google’s spam policies; sites that violate these policies may rank lower or not appear in results at all.
  • It isn’t a one-off job: as a site changes, new technical problems appear; regular audits are needed.

Where to start

  1. Crawl your site with the Technical SEO Audit: find pages that can’t be crawled or indexed, and broken pages.
  2. Check the title, description and content structure of your most important pages with the On-Page SEO Checker.
  3. Measure the real user experience with the Core Web Vitals Test.
  4. See what Googlebot and AI bots can access with the Robots.txt Tester.

Frequently asked questions

How long does SEO take to work?

There’s no fixed timeframe: how long it takes for changes to be crawled, reflected in the index and affect rankings varies from site to site. Google suggests asking up front what results to expect from SEO work and in what timeframe; no one can guarantee a #1 ranking.

What’s the difference between SEO and ads?

Ads are shown for a fee and labelled “sponsored”. You don’t pay to appear in organic results: Google doesn’t accept payment to rank a site higher or crawl it more often.

Is GEO replacing SEO?

No. To be shown as a source in Google’s AI features (AI Overviews, AI Mode), a page must be indexed and eligible to be shown in Google Search with a snippet; Google says there are no additional requirements. For details, see the What is GEO? page.

Sources

Last updated:

Related concepts