llmcrawl

Dashboard

Manage API keys, runs, schemas, datasets and webhooks in the llmcrawl console.

The dashboard is the console for your llmcrawl account: keys, runs, schemas, datasets and webhooks all live there. Everything the dashboard does is also available through the REST API — the dashboard is simply the fastest way to try something and see the result.

Overview

Your starting point: a summary of recent activity and quick actions to start a scrape, start a crawl or create an extraction schema.

Scrape

A playground for a single URL. Enter a page, choose the formats you want, run the scrape and preview the result as markdown, JSON or HTML — then copy the exact request for your application. Useful for checking how a page converts before wiring it into code.

Crawl Jobs

Start crawls and watch them work: status, completed/total pages, and the documents collected so far. From here you can open a crawl's results and cancel a crawl that is still running.

Extraction

A schema builder for structured extraction. Start from a template (product, article, company, event, restaurant) or build a custom schema, add field descriptions, instructions and validation rules, then run the extraction against a live page to see the JSON it produces. Saved schemas are reusable; paste them into the extract block of a /v1/scrape request when you are ready to automate.

Datasets

Snapshot crawl results into durable datasets you can browse and export, so long-running crawls do not have to be re-run to get at their data.

Webhooks

Manage webhook endpoints, choose which events each endpoint receives, and review the delivery log (status codes, attempts, failures). Endpoints can be paused, resumed, tested with a sample delivery, or deleted.

API Keys

Create and revoke API keys. A new key is shown once, so copy it immediately — the dashboard only stores a hash of it afterwards.

Billing

Track usage and credits, view invoices and manage your subscription.

Settings

Your profile, the dashboard theme and your active session.

On this page