gogetcrawl

v1.1.3Verified publisher

Lists archived URLs for a domain and its subdomains from the Wayback Machine and Common Crawl

Community-packaged from github.com/karust/gogetcrawl: the registry's community pins the upstream release; the tool is its authors' work. Maintain that project? Claim this package.

Run

TerminalAgent

Through ot mcp, an agent calls run_tool with this; ot asks you before anything that goes online or touches a target. Set it up: ot mcp install claude (or cursor, vscode, codex, gemini).

{"tool":"osintverse-community/gogetcrawl","target":"example.com","input_type":"domain"}

Or just say: "Run osintverse-community/gogetcrawl on example.com with OTInstaller." The registry's read-only MCP server at api.otinstaller.com/mcp can find tools without installing anything.

ot run osintverse-community/gogetcrawl d:example.com --format table

ot install osintverse-community/gogetcrawl

Docker image in a read-only container · network allowed · no key · up to 30 min. The first ot run installs the tool after asking once. The example value is the registry's own test input, so this command has run. Drop --format table for JSON.

Don't have ot? Install it in one line

macOS / LinuxWindows

curl -fsSL https://get.otinstaller.com/ot | sh

What this script does

Downloads the latest ot release for your machine from GitHub Releases.
Checks its SHA-256 against checksums.txt, and the Ed25519 signature on that file against the key built into the script.
Puts ot in /usr/local/bin or ~/.local/bin. Nothing else is written. Read the script.

irm https://get.otinstaller.com/ot.ps1 | iex

What this script does

Downloads the latest ot release for your machine from GitHub Releases.
Checks its SHA-256 against checksums.txt, and the Ed25519 signature on that file against the key built into the script.
Puts ot in %LOCALAPPDATA%\Programs\ot, and adds it to your PATH. Nothing else is written. Read the script.

Evidence

Security tab →

Pinnedimage sha256:925170e4…921721. The same bytes on every install; ot pulls by digest, never by tag.
Signedby https://github.com/osintverse-community/gogetcrawl/.github/workflows/otinstaller-release.yml@refs/heads/main via token.actions.githubusercontent.com, verified by the registry on 22 Oct 2026. ot checks the same identity before every install and refuses another signer.
Scan warnings22 Oct 2026: 0 critical, 1 high, 0 medium, 0 low vulnerabilities (1 high or critical with a fix available); 0 embedded secrets, 0 malware heuristics; SBOM with 32 packages.
Workssmoke test passed on 22 Oct 2026 (exit 0 in 55.1 s, offline sandbox); the nightly health check has not run yet.
Backed upa copy of this image is on the registry's mirror. If the original registry refuses it, ot pulls the same digest from the mirror and checks the same signature.
Reviewedosintverse-community is a verified publisher: the registry confirmed who runs it, and a person reviewed its first release against the acceptable-use rules.

What you get back

Result envelope →

{
  "envelope": 1,
  "tool": "osintverse-community/gogetcrawl@1.1.3",
  "runtime": "docker",
  "input": {
    "domain": "example.com"
  },
  "started_at": "2026-10-21T09:00:00Z",
  "duration_ms": 4100,
  "exit_code": 0,
  "entities": [
    {
      "type": "url",
      "value": "https://example.com/page"
    }
  ],
  "warnings": []
}

Every tool returns this shape, shaped here from what this tool declares it finds. --format table to read it; ot extract and ot auto to continue.

gogetcrawl (community package)

This repository packages github.com/karust/gogetcrawl for the OTInstaller Registry as osintverse-community/gogetcrawl. The tool is the work of its authors, under the MIT license; this repository only holds the manifest and release workflow.

Report problems with the tool upstream, and problems with the packaging here. If you maintain the upstream project and want to publish it yourself, open an issue or run ot claim osintverse-community/gogetcrawl: the package is transferred to you.

The Dockerfile here builds the upstream release at a pinned version, and the otinstaller release workflow builds, signs and publishes the image.

The domain is searched as the pattern *.<domain>/*, so subdomains are included, and --collapse keeps one line per unique URL. Without a limit, large domains can return millions of URLs; set --limit for a quick look. Archive errors are silent unless you run the tool with -v.

ot run osintverse-community/gogetcrawl --domain …

Packaged version: 1.1.3.

What next

gogetcrawl finds url. Tools that take those:

url → 10 tools ot auto, with a saved result

Other domain tools

All domain tools →

Alternatives to gogetcrawl that also take a domain; ot auto runs every installed one on the same value.