The free SEO crawler for your desktop.
Crawl any site and find broken links, redirect chains, missing titles, orphan pages and 50+ other issues. No licence key, no URL limit.
Beta Version 0.3.1 for macOS and Windows. Linux coming soon.
| Address | Status | Indexability | Title | Title len | Inlinks | Resp. ms |
|---|---|---|---|---|---|---|
| / | 200 | Indexable | Acme Outdoor | Tents, packs and trail gear | 42 | 1,102 | 182 |
| /tents/ | 200 | Indexable | Tents for every trip | Acme Outdoor | 36 | 844 | 211 |
| /tents/ridgeline-2p | 200 | Indexable | Ridgeline 2P ultralight backpacking tent, 1.2 kg, freestanding | 63 | 37 | 240 |
| /sale | 301 | Non-indexable | 612 | 48 | ||
| /packs/summit-40 | 200 | Indexable | Summit 40 | Acme Outdoor | 24 | 22 | 198 |
| /blog/how-to-pitch-a-tent | 200 | Indexable | 0 | 9 | 305 | |
| /packs/trailhead-28 | 404 | Non-indexable | Page not found | 14 | 17 | 91 |
| /stores/stockholm | 200 | Indexable | Acme Outdoor Stockholm | 22 | 4 | 1,420 |
| /account/login | — | Non-indexable | Blocked by robots.txt | 1,102 | ||
| /sleeping-bags/ | 200 | Indexable | Sleeping bags | Acme Outdoor | 28 | 790 | 176 |
What it checks
Every crawl ends with a list of problems, sorted worst first. These are the ones people fix most.
-
Broken links and redirects
Every 4xx and 5xx, every redirect chain and loop, and the pages that link to them.
-
Titles, meta and headings
Missing, duplicated, too long or too short. Multiple H1s or none at all.
-
Site health score
One number from 0 to 100 per crawl, so you can see whether last week's fixes worked.
-
XML sitemap audit
Orphan pages nothing links to, plus errors and noindex URLs that shouldn't be in the sitemap.
-
Crawl as Googlebot
Switch user agent to Googlebot, Bingbot or a browser. The crawler then follows that bot's robots.txt rules.
-
Duplicate and thin content
Pages with the same content, and pages with too few words to rank.
-
Projects and crawl history
Each site is a project. Every crawl is saved, with its own settings, ready to reopen.
-
CSV export
Any table, any tab, straight into a spreadsheet or a client report.
How it works
- 1
Download and open CrawlDude.
- 2
Paste your site's URL and press Start.
- 3
Work through the issue list, worst first.
Why CrawlDude
Desktop crawlers usually cost a licence fee and stop at a few hundred URLs until you pay. This one doesn't. See how it compares with Screaming Frog.
- Free, with no URL cap
- Crawl ten pages or a hundred thousand. Your computer is the only limit.
- Your data stays put
- Crawls run and are stored on your computer. Nothing is uploaded, and there is no account.
- Free, and it stays free
- Built on open-source software and made by one developer. The code may be opened up later, with contributions carefully reviewed. Ideas and improvements are always welcome: hello@crawldude.com.
- Polite by default
- Respects robots.txt and crawl delays, so you won't knock over a client's server.
Download
Beta Version 0.3.1.
| Platform | File | Download |
|---|---|---|
| macOS, Apple Silicon | CrawlDude-mac-arm64.dmg | Download |
| macOS, Intel | CrawlDude-mac-x64.dmg | Download |
| Windows 10 and 11, 64-bitNot code-signed yet: SmartScreen asks once | CrawlDude-win-x64.exe | Download |
| Linux, AppImage | CrawlDude-linux-x64.AppImage | Coming soon |
| Linux, Debian and Ubuntu | CrawlDude-linux-x64.deb | Coming soon |
Questions
Something else? Email hello@crawldude.com.
Is it really free?
Yes, and it will stay free. There is no URL limit, no trial and no paid tier. CrawlDude is built on open-source software. Its own code may be open-sourced later, but one developer has limited time to review outside changes, so for now suggestions are best sent by email.
Is it finished?
CrawlDude is in beta: it works and is used on real sites, but features still change from release to release and you may hit rough edges. Updates install with one click. If something breaks or you miss a feature, email hello@crawldude.com.
Is my data sent anywhere?
No. Crawls run on your computer and are saved there. CrawlDude only talks to the sites you crawl, and to GitHub to check for new versions.
Does it render JavaScript?
Yes, if you turn it on. Tick Render JavaScript in the project settings and each page loads in a built-in browser before it is checked, so sites built with React, Vue or Angular crawl like any other. It is off by default because it is slower, and CrawlDude still notes which pages need JavaScript, since most AI crawlers don't run it.
Is it safe to install?
Yes. On a Mac, CrawlDude is signed with an Apple Developer ID and notarized by Apple, so it opens like any other app. The Windows version isn't code-signed yet; see below.
Windows says it protected my PC
The Windows version isn't code-signed yet, so SmartScreen warns about it. Click More info, then Run anyway. The installer is checked against a signed list of release files before the app updates itself.
How do I update?
CrawlDude checks for new versions when it starts. When one is out, click Install and restart and it updates itself. Your projects and crawls are kept. See what changed in each version in the changelog.
What do I need to run it?
macOS 11 or later, Windows 10 or later, or a recent 64-bit Linux.