Scrapegraph-ai

ScrapeGraphAI is an AI-supported Python web browsing library. The specified information prompt and source allow you to create automatic data-pull pipelines from web pages in line with URL. Langchain can work integrated with various LLM frameworks such as Llama Index and Crew.ai.

SC

ScrapeGraphAI · Web Scraping & Automation

STARS32.4K
FORKS3.3K
COMMITS3.0K
CONTRIBUTORS120
VERSIONv2.2.4
UPDATED25 days ago
PythonWeb ScrapingAILLMMIT

Common commercial products in this category: Bright Data, Apify, ScrapingBee

What can it do?
  • You extract automated data from web pages by specifying the information you want.
  • In addition to websites, you also set up scratch pipelines for local documents such as XML, HTML, JSON and Markdown.
  • You provide integration with different language models and low-code platforms.
User reviews
  • ↓ NegativeGitHub Issue

    [1.14.0+] pydantic ValidationError with SmartScraperGraph

    “**Describe the bug** Since version 1.14.0 (tested here on 1.15.0), SmartScraperGraph on OpenAI stopped working with a pydantic-related error: ``` /venv/lib/python3.12/site-packages/google_crc32c/__init__.py:29: RuntimeWarning: As the c extension couldn't be imported,…”

  • ↓ NegativeGitHub Issue

    v1.15.0: OmniScraperGraph not working: Error parsing input keys for ImageToText

    “**Describe the bug** OmniScraperGraph throws error. Tested on minimal example on GitHub. [omni_scraper_openai.py]( **To Reproduce** ```bash mkdir test cd test python3 -m venv venv source venv/bin/activate ``` ```bash pip install scrapegraphai \ "scrapegraphai[burr]" \…”

Verified against README · Oct 26, 2026 · source

My note

Alternative pages

More in: Web Scraping & Automation