How to Extract JSON-LD from Web Pages and Verify Its Claims
Inventory embedded JSON-LD with a tested Python example, select the right entity, and check extracted fields against readable page evidence.
AnyCrawler guides
Practical guides to web scraping and AI agents.
Learn how to find web sources, extract readable content, and handle JavaScript pages in AI workflows. Browse guides by topic and choose the next task you need to solve.
Published guides
Markdown extraction guides
14 guides
How to Extract Web Tables Without Losing Headers, Units, and Sources
Preserve table header paths, raw cell text, units, notes and sources before normalizing web data. Includes tested acquisition and parsing examples plus review rules.
Web Crawler API vs Page Fetch API: Do You Need Discovery or One URL?
Choose a single-page Fetch, query-driven Search, or bounded site crawl by the URLs you know and the coverage you need. Includes a tested public probe and verification checklist.
How to Evaluate Web Extraction Quality Before Sending Content to an LLM
Check extracted documents for missing facts, sidebar noise, broken structure, and unknown provenance before admitting them to model context.
How to Extract Links from a Web Page Without Losing Context
Extract useful links as reviewable records that retain origin page, raw and resolved URL, anchor text, nearby context, scope, and failure evidence.
HTML vs Markdown vs Structured JSON for AI Agent Context
Choose HTML, Markdown, or structured JSON from the next operation's contract, then preserve provenance and validate what each transformation keeps or drops.
Search API vs Scraping API: Discovery and Extraction Are Different Jobs
Choose Search for source discovery and a scraping or page-read API for known-URL extraction, then connect them with a verifiable handoff contract.
Web Scraping API vs Browser Automation for AI Agents
Choose between page extraction and browser interaction using task contracts, verified outcomes, session boundaries, and a tested public-page read example.
Web Search APIs for AI Agents: Discovery Is Not Extraction
Compare web search API response contracts, bundled content, source provenance, and verification gates before choosing an integration for your AI agent.
