autoscraper
AutoScraper is a Python library that automates the process of extracting data from web pages. It learns page structure using set sample data sets and automatically detects similar content. Working through URL or HTML content, the text can parse the URL and HTML tag values.
AU
alirezamika · Web Scraping & Automation
STARS8.1K
FORKS835
COMMITS0
CONTRIBUTORS0
VERSIONv1.1.14
UPDATED3 mo ago
PythonWeb ScrapingAutomationVeri ÇıkarmaMIT
Common commercial products in this category: Bright Data, Apify, ScrapingBee
What can it do?
- With the sample data you provide, you can automatically pull similar content from web pages.
- You can speed up data collection by using learned scratching rules on different URLs.
- By configuring proxy and custom title settings, you can get the data you are targeting from web pages.
User reviews
- • NeutralGitHub Issue
Scrapping a private website page
“Hi, I would like to scrap a private webpage where I need to be logged in. Is there a way to do that? Thank you”
- ↑ PositiveGitHub Issue
Pulling tables would be awesome
“Perhaps I missed it somewhere, but it would be great to go here: And grab the entire table(s): Premier League Player Statistics Premier League Assist to Goal Scorer”