robots.txt & Sitemap Viewer

Read robots.txt and sample linked sitemaps.

Site URL

Calculated Result

Enter a target and run

Formula: GET /robots.txt + linked sitemap samples

About this calculator

Fetches /robots.txt on the origin, then up to three sitemap URLs mentioned there (or /sitemap.xml).

FormulaGET /robots.txt + linked sitemap samples

Parse Sitemap: directives → GET each sitemap → count <loc> tags.

Resolve A, AAAA, MX, NS, TXT, CNAME, SOA, and CAA.

Check if a domain looks free via public RDAP.

Registrar, status, dates, and nameservers from RDAP.

Age from the RDAP registration date.