The idea
Spin any site into a scraper.
Paste one URL or a batch. Weaver respects robots.txt, discovers the useful fields, verifies the rows, and hands you a scraper that runs without AI.
- Rows extracted
- 0
- Scrapers woven
- 0
Live pipeline · ready
Paste one URL or a batch. Weaver respects robots.txt, discovers the useful fields, verifies the rows, and hands you a scraper that runs without AI.
The idea
Live pipeline · ready
The loom
Weaver checks permission on every page, maps a representative record, verifies the generated Python, then follows same-origin next links until the data ends, repeats, or reaches your safety caps.
Schema — what Weaver tied down
Nothing woven yet. Every field Weaver tags on the page lands here, tied to its selector and type.
Recommended for this category
spec.yml — the whole scraper, declared
# written as Weaver ties fields down
Pipeline log
idlescraper.py — live output
waiting for generated PythonThe bolt
Every passing run keeps its proof: the spec, deterministic scraper, cached fixture, QA report, data exports, and optional correlated images.
No rows yet. Spin a scraper above and the validated output lands here, straight from the run.
Scraper QA feedback
Waiting for a verified scraper.
Woven files
A passing run writes the spec, scraper, fixture, QA report, every export format, and a portable bundle.
AI designs the validated spec once. The generated Scrapling runtime is plain Python and preserves the run's explicit robots policy.
scraper.py — woven, not written
The shuttle
Give Weaver a public page and a small field contract. The response is the verified Python scraper. If that runtime later breaks, it can report the failure, trigger a rebuild, and refresh your portal with the replacement run.
/api/runs → /latest
Name the values your UI needs. Hints can describe custom fields.
One public collection page · active robots policy is reported in logs · private networks blocked. Runtime failures send only a bounded error summary—never page HTML—and each scraper artifact may request one replacement run.
Run a test to weave scraper.py. The code shown here will be the actual verified Python artifact—not a mock response.
Developer portal preview
Illustrative Pokémon card-sale layout. Values always come from the public URL you run above.
systemWaiting for the first verified scraper.