Jump to content
🔥 Clickflame
FreeScreaming Frog (free tier)About 30 min

Crawl Your Site (Free Tier)

A crawler walks your whole site the way a search engine does. It lists every page and flags problems. You'll often find pages you forgot about, and errors nobody told you were there.

Why This Matters
You can't fix what you can't see. A crawl finds broken links, missing titles, and messy redirects. Then you fix the base before chasing rankings. Skip it and you can spend months writing content on top of pages that return errors.

✓ How To Do It

  1. Download Screaming Frog SEO Spider. The free version crawls up to 500 URLs.
  2. Enter your domain and run the crawl. Wait until the progress bar reaches the end before you judge the results.
  3. Sort by Status Code to find 4xx and 5xx errors and redirects. A 200 means the page loaded fine. A 301 is a redirect. A 404 is a missing page.
  4. Check the Page Titles and Meta Description tabs for missing, duplicate, or too-long entries.
  5. Export the results to a spreadsheet. This is your master to-do list for the On-Page and Technical phases.
  6. Name the file with today's date, so you can compare it with your re-crawl later.
Done WhenThe crawl export is saved as a dated spreadsheet.
Tips & Pitfalls
  • Over 500 pages? Crawl your most important sections first, one batch at a time. The free version can't save crawls, so export before you close it.
  • If the crawl stops after one page, the site may be blocking crawlers, or every link may be built by a script. Check your robots.txt first.
  • Don't start fixing while you're crawling. Finish the audit module, then fix in order of what matters most.
Done with this step? Mark it complete to track your campaign progress. Not a fan of reading lessons? Take this one as a quest.
Stuck on a step? Ask in our free Facebook group. Real people who run these campaigns every day answer, and you can share your wins.Join The Free Group