newspaper

Newspaper3k is a news and article data extraction library developed with Python 3. It can automatically shoot full text, author information, date of publication, main visual and embedded videos from web pages. It also works speed-oriented with lxml infrastructure and offers summary production with NLP-based keyword.

NE

codelucas · Web Scraping & Automation

STARS15.2K
FORKS2.1K
COMMITS670
CONTRIBUTORS85
VERSION0.0.9
UPDATED5 days ago
PythonWeb ScrapingNLPMakale AnaliziMIT

Common commercial products in this category: Bright Data, Apify, ScrapingBee

What can it do?
  • You can access article lists by scanning the URL structure of targeted news sites.
  • You can extract authors, release dates, main visuals and videos from article texts.
  • With the NLP module, you can extract keywords and summary of articles.
Heads up
  • • High number of open issues (513)

My note

Alternative pages

More in: Web Scraping & Automation