robofinder

v0.2.2Verified publisher

Lists every path a site ever put in robots.txt, from the Wayback Machine's historical snapshots

Community-packaged from github.com/Spix0r/robofinder: the registry's community pins the upstream release; the tool is its authors' work. Maintain that project? Claim this package.

Report this package

Reports go to the registry's reviewers. You don't need an account; sign in if you want a reply. The acceptable-use policy says what isn't allowed. A bug in the tool itself is better reported to its authors at github.com/Spix0r/robofinder.