FreeScreaming Frog (free tier)About 30 min
Crawl Your Site (Free Tier)
A crawler walks your whole site the way a search engine does. It lists every page and flags problems. You'll often find pages you forgot about, and errors nobody told you were there.
Why This Matters
You can't fix what you can't see. A crawl finds broken links, missing titles, and messy redirects. Then you fix the base before chasing rankings. Skip it and you can spend months writing content on top of pages that return errors.
✓ How To Do It
- Download Screaming Frog SEO Spider. The free version crawls up to 500 URLs.
- Enter your domain and run the crawl. Wait until the progress bar reaches the end before you judge the results.
- Sort by Status Code to find 4xx and 5xx errors and redirects. A 200 means the page loaded fine. A 301 is a redirect. A 404 is a missing page.
- Check the Page Titles and Meta Description tabs for missing, duplicate, or too-long entries.
- Export the results to a spreadsheet. This is your master to-do list for the On-Page and Technical phases.
- Name the file with today's date, so you can compare it with your re-crawl later.
Done WhenThe crawl export is saved as a dated spreadsheet.
Tools For This StepScreaming Frog SEO Spider
Tips & Pitfalls
- Over 500 pages? Crawl your most important sections first, one batch at a time. The free version can't save crawls, so export before you close it.
- If the crawl stops after one page, the site may be blocking crawlers, or every link may be built by a script. Check your robots.txt first.
- Don't start fixing while you're crawling. Finish the audit module, then fix in order of what matters most.
Email Me The Free Course
Get your course link in your inbox so you can pick it up on any device. It's free, with no card.