Keyword research is where SEO strategy begins — and where most businesses go wrong. Targeting the wrong keywords wastes months of effort on traffic that never converts. Targeting the right keywords can transform an SEO programme from a cost centre to your most profitable acquisition channel. This guide covers the full process: from finding keyword ideas to prioritising the ones worth pursuing.
Understanding search intent: the foundation of keyword research
Every search query has intent — what the person is trying to do. Google classifies these as informational (learning something), navigational (finding a specific website), commercial (comparing options before buying), and transactional (ready to buy). Matching your content to search intent is more important than exact keyword usage. A page optimised for 'how to choose an SEO agency' (informational) should not try to also rank for 'hire SEO agency' (transactional) — the search intent is different, Google knows it, and your conversion rate will reflect it.
Keyword research tools worth using
- Ahrefs Keywords Explorer: the most comprehensive paid tool for keyword research. Shows search volume, keyword difficulty, traffic potential, and SERP analysis for any keyword in any country.
- SEMrush Keyword Magic Tool: excellent for finding keyword clusters and semantic variations. Strong competitor keyword analysis features.
- Google Keyword Planner: free but limited. Useful for validating search volumes and getting CPC data for Google Ads targeting.
- Google Search Console: shows you the keywords your site already ranks for. Invaluable for identifying 'low-hanging fruit' — keywords where you rank on page 2 and are close to breaking into the top 10.
- Google\'s autocomplete and 'People Also Ask': free, real-time data on how Google completes queries and what related questions users ask.
How to conduct keyword research: a step-by-step process
- Step 1 — Seed keywords: list 10–20 broad terms that describe your business, services, and problems you solve. These are the starting points, not the final targets.
- Step 2 — Expand: put each seed keyword into your research tool and extract 50–100 related keywords, variations, and questions.
- Step 3 — Filter for intent: remove keywords with informational intent if you\'re building service pages; keep them for blog content. Remove navigational and branded competitor keywords.
- Step 4 — Evaluate difficulty and volume: prioritise keywords with a realistic chance of ranking based on your site\'s current Domain Rating (DR) — don\'t target DR 80 sites when you\'re at DR 25.
- Step 5 — Map to pages: assign each target keyword to one specific page. Every page on your site should target a distinct keyword cluster with a clear intent.
- Step 6 — Identify quick wins: search Google Search Console for terms ranking positions 5–20. These are closest to generating traffic and can often be improved with on-page optimisation alone.
Long-tail vs. short-tail keywords: where to focus
Short-tail keywords (1–2 words, e.g., 'SEO agency') have high volume but fierce competition. Long-tail keywords (3–5+ words, e.g., 'SEO agency for law firms in London') have lower individual volume but convert significantly better and are easier to rank for. New sites and lower-authority domains should focus 80% of effort on long-tail keywords. As domain authority grows, short-tail keywords become attainable. The fastest path to SEO ROI is usually a cluster of 20–50 long-tail keywords, not one or two high-volume terms.
Competitor keyword gap analysis
Keyword gap analysis compares your keyword rankings to competitors and identifies keywords they rank for that you do not. In Ahrefs and SEMrush, this is called 'content gap' or 'keyword gap' analysis. The highest-priority targets from this analysis are keywords where multiple competitors rank in the top 10 but you have no ranking — this confirms the keyword has real search demand and that it\'s achievable for a site like yours.
The most common keyword research mistake is targeting keywords based on search volume alone. A keyword with 50 monthly searches in your target industry where your prospect is explicitly looking for what you offer is worth more than a keyword with 5,000 monthly searches from a general audience that has no purchase intent.
Build my proposal