scrape-it
scrape-it is a simple module used to extract data from Node.js-based websites. Through its Promise-based interface, you can parse the target URL HTML data through selectors and obtain structured objects. It also supports the .scrapeHTML method to parse local files or preloaded HTML content.
SC
IonicaBizau · Web Scraping & Automation
STARS4.1K
FORKS218
COMMITS0
CONTRIBUTORS0
VERSION6.1.15
UPDATED10 days ago
JavaScriptNode.jsWeb ScrapingParserMIT
Common commercial products in this category: Bright Data, Apify, ScrapingBee
What can it do?
- Using selectors from a target web page, you pull data such as title, description, and link.
- Using the Promise or Async-Await structure, you perform data-pulling asynchronously.
- You parse data from local files or uploaded HTML contents with the .scrapeHTML method.
User reviews
- • NeutralGitHub Issue
Add support for crawling
“It would be nice to add support for crawling pages and follow links. I suggest: - Concurrency support - Request delay”
- • NeutralGitHub Issue
Add a Dockerfile to build a container
“This will help to distribute scrape-it as a service.”