Scraperr
Scraperr is a self-hosted scraping tool that allows you to extract data from websites without writing code. It offers basic features such as XPath-based element extraction, job queue management, domain name spiker, custom title addition, and media download. You can view the data obtained in table format, export it as Markdown or CSV, and receive notifications through various channels.
Scraperr
10jaypyles · Web Scraping & Automation
Common commercial products in this category: Bright Data, Apify, ScrapingBee
- With the XPath based element selection, you pull data from target web pages without writing code
- You manage multiple scraping jobs by adding them to the queue and export the results as CSV or Markdown
- You start a batch announcer to scan all pages under the same domain
- • Repository is archived (no longer maintained)
- • Last update over 1 year ago
- • NeutralHacker News
Scraperr – A Self Hosted Webscraper
“From the repo (clipped): When using Scraperr, please remember to: Respect robots.txt Terms of Service Rate Limiting Kudos for promoting ethical usage; makes a change from some of the grifters selling borderline ddos-bots as crawlers.”
- • NeutralGitHub Issue
404
“Trying to start the Scraperr but just getting a 404 when trying to access localhots > junk@junkbox scraperr]# make up > docker compose -f docker-compose.yml --env-file .env up -d --force-recreate > [+] Running 4/4 > ✔ Network scraperr_web Created 0.1s > ✔ Container scraperr…”