Last updated: September 4, 2026
By signing in and using Crawe ("the Service"), you agree to be bound by these Terms & Conditions. If you do not agree, do not use the Service.
Crawe crawls a website you submit, following same-origin links up to a depth you choose, and streams back an audit covering SEO metadata, Open Graph/Twitter tags, structured data (JSON-LD), images and technical markup, security headers, internal/external link health, and sitemap and robots.txt/llms.txt coverage. It can also look up domain registration data (WHOIS/RDAP) for the scanned domain. Results are provided for informational purposes only, without warranty of accuracy, completeness, or that following any recommendation will improve a site's ranking or performance.
You may only submit websites you own or have explicit permission to crawl. The Service will refuse to scan URLs that resolve to private, internal, or non-public network addresses, but it does not otherwise verify that you are authorized to crawl a given target — that responsibility is yours. You agree not to use the Service to overload third-party servers or to crawl a site in a way that violates that site's own terms of use.
Access requires signing in with a Google account via OAuth; you are responsible for all activity under your account. Each account is limited to a daily number of scans (10 by default), which we may adjust at any time. We record each sign-in and each scan you run (email, URL, crawl depth, and timestamp), and keep a short history of your recent scan results so you can revisit them later — all stored in our own database, not shared with the sites you scan.
The Service relies on Google for sign-in and on public domain registries (via RDAP) for WHOIS lookups. Some report views include an optional "Ask Claude" link that opens a pre-filled query on claude.ai in a new tab; using it is your choice and is subject to Anthropic's own terms — we do not send your scan data to any AI service ourselves.
The Service is provided "as is" without warranties of any kind, express or implied, including fitness for a particular purpose or non-infringement.
To the fullest extent permitted by law, we are not liable for any indirect, incidental, or consequential damages arising from your use of, or inability to use, the Service.
We may update these Terms from time to time. Continued use of the Service after changes take effect constitutes acceptance of the revised Terms.
Questions about these Terms can be sent to your account administrator.