firecrawl

<h3 align="center"> <a name="readme-top"></a> <img src="https://raw.githubusercontent.com/firecrawl/firecrawl/main/img/firecrawl_logo.png" height="200" > </h3> <div align="center"> <a href="https://github.com/firecrawl/firecrawl/blob/main/LICENSE"> <img src="https://img.shields.io/github/license/firecrawl/firecrawl" alt="License"> </a> <a href="https://pepy.tech/project/firecrawl-py"> <img src="https://static.pepy.tech/badge/firecrawl-py" alt="Downloads"> </a> <a href="https://GitHub.com/firecrawl/firecrawl/graphs/contributors"> <img src="https://img.shields.io/github/contributors/firecrawl/firecrawl.svg" alt="GitHub Contributors"> </a> <a href="https://firecrawl.dev"> <img src="https://img.shields.io/badge/Visit-firecrawl.dev-orange" alt="Visit firecrawl.dev"> </a> </div> <div> <p align="center"> <a href="https://twitter.com/firecrawl"> <img src="https://img.shields.io/badge/Follow%20on%20X-000000?style=for-the-badge&logo=x&logoColor=white" alt="Follow on X" /> </a> <a href="https://www.linkedin.com/company/104100957"> <img src="https://img.shields.io/badge/Follow%20on%20LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white" alt="Follow on LinkedIn" /> </a> <a href="https://discord.gg/firecrawl"> <img src="https://img.shields.io/badge/Join%20our%20Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white" alt="Join our Discord" /> </a> </p> </div> --- **🔥 Firecrawl** **The API to search, scrape, and interact with the web at scale. 🔥** The web context API to find sources, extract content, and turn it into clean Markdown or structured data your agents can ship with. Open source and available as a hosted service. _Pst. Hey, you, join our stargazers :)_ <a href="https://github.com/firecrawl/firecrawl"> <img src="https://img.shields.io/github/stars/firecrawl/firecrawl.svg?style=social&label=Star&maxAge=2592000" alt="GitHub stars"> </a> --- Why Firecrawl? - **Industry-leading reliability**: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks) - **Blazingly fast**: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps - **LLM-ready output**: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps - **We handle the hard stuff**: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration - **Agent ready**: Connect Firecrawl to any AI agent or MCP client with a single command - **Media parsing**: Parse and extract content from web-hosted PDFs, DOCX, and more - **Actions**: Click, scroll, write, wait, and press before extracting content - **Open source**: Developed transparently and collaboratively — join our community --- Feature Overview **Core Endpoints** | Feature | Description | |---------|-------------| | **Search** | Search the web and get full page content from results | | **Scrape** | Convert any URL to markdown, HTML, screenshots, or structured JSON | | **Interact** | Scrape a page, then interact with it using AI prompts or code | **More** | Feature | Description | |---------|-------------| | **Agent** | Automated data gathering, just describe what you need | | **Crawl** | Scrape all URLs of a website with a single request | | **Map** | Discover all URLs on a website instantly | | **Batch Scrape** | Scrape thousands of URLs asynchronously | --- Quick Start Sign up at firecrawl.dev to get your API key. Try the playground to test it out. Search Search the web and get full content from results. <details> <summary><b>Node.js / cURL / CLI</b></summary> **Node.js** **cURL** **CLI** </details> Output: Scrape Get LLM-ready data from any website — markdown, JSON, screenshots, and more. <details> <summary><b>Node.js / cURL / CLI</b></summary> **Node.js** **cURL** **CLI** </details> Output: Interact Scrape a page, then interact with it using AI prompts or code. <details> <summary><b>Node.js / cURL / CLI</b></summary> **Node.js** **cURL** **CLI** </details> Output: --- Power Your Agent Connect Firecrawl to any AI agent or MCP client in minutes. Skill Give your agent easy access to real-time web data with one command. Restart your agent after installing. Works with Claude Code, Antigravity, OpenCode, and more. MCP Connect any MCP-compatible client to the web in seconds. Agent Onboarding Are you an AI agent? Fetch t