bdy crawl run

View as Markdown

$bdy crawl run [options] [url]

Crawl a URL and download the package (PNG/JPEG/MD/HTML) to --outputDir

ARGUMENTS

url

URL to crawl (optional; defaults to crawl suite URL) (optional)

OPTIONS

--follow

Follow same-origin links and crawl all reachable pages (default: false)

--respectRobots

Respect robots.txt (default: false)

--outputType <type>

Output type (choices: "jpeg", "png", "md", "html")

--outputTypes <json>

Output types as JSON array (e.g., --outputTypes '[{"type":"md","selector":{"type":"CSS","value":".main"}},{"type":"jpeg","quality":80,"fullPage":true}]')

--quality <quality>

JPEG output quality (1-100)

--fullPage

Capture full-page screenshots (not just the viewport) (default: false)

--cssSelector <selector>

CSS selector to scope the snapshot/extraction

--xpathSelector <selector>

XPath selector to scope the snapshot/extraction

--colorScheme <scheme>

Color scheme to use (LIGHT, DARK, LIGHT_AND_DARK) (choices: "LIGHT", "DARK", "LIGHT_AND_DARK")

--browsers <browsers>

Browsers to use (comma-separated: chrome,firefox,safari)

--devices <devices>

Devices definition as JSON array (e.g., --devices '[{"viewport":"1920x1080","screen":"1920x1080","devicePixelRatio":1,"isMobile":false}]')

--waitFor <waitFors...>

Wait for elements to appear before taking screenshot (format: [scope::]type=value, e.g.,

--waitFor

"CSS=#content" "example.com::XPATH=//div[@class='loaded']")

--cookie <cookies...>

Set cookies used when visiting the URLs (format: [scope::]cookie_value, e.g., --cookie "session=abc123" "example.com::auth=token123; Path=/; Secure; HttpOnly")

--header <headers...>

Set HTTP headers used when visiting the URLs (format: [scope::]name=value, e.g., --header "Authorization=Bearer token" "example.com::Accept=application/json")

--localStorage <items...>

Set localStorage values used when visiting URLs (format: [scope::]key=value)

--delay <delays...>

Delay in milliseconds before capture (format: [scope::]ms)

--outputDir <dir>

Output directory (default: ".")

-h, --help

display help for command

Documentation for bdy v1.22.49

Last modified on May 19, 2026

link create

Examples

## crawl a single page and save md/html into current dir
bdy crawl run https://example.com --outputType md$

## follow links and capture full-page screenshots in dark mode
bdy crawl run https://example.com --follow --fullPage --outputType png --colorScheme DARK --outputDir ./out$

## crawl with multiple output types and a specific css selector
bdy crawl run https://example.com --outputTypes '["jpeg","md"]' --cssSelector "main"$