SEO Crawlers
Screaming Frog SEO Spider
by Screaming Frog
Desktop SEO crawler for technical site audits.
Commercial
Free Tier
Visit website ↗
Specifications
- Pricing
- Free (500 URL limit); Licence £259/yr
- Free tier / OSS
- Yes — 500 URLs free forever
- License
- Commercial
- Testing type
- SEO / Site Audit
- Languages / SDKs
- N/A (desktop app with Python/API access)
- Supported platforms
- Windows, macOS, Ubuntu
- Parallel testing
- N/A
- Speed
- Fast — desktop multithreaded crawler
- Key integrations
- Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs
- Learning curve
- Easy to moderate
- Community / Support
- Very large — industry standard SEO tool
- Maintained by
- Screaming Frog Ltd
- First released
- 2010
- Latest version
- See website
- Best suited for
- SEO professionals & QA teams auditing site structure
- Official site
- www.screamingfrog.co.uk/seo-spider/ ↗