Website-downloader

This tool allows you to download all the source code and assets of the target websites using Node.js and wget. The downloaded files are compressed with the archiver and transmitted to the user via the socket channel. It converts connections to relative location for offline viewing and allows size quotas to be defined to prevent disk stuffing.

WE

AhmadIbrahiim · Web Scraping & Automation

STARS6.1K
FORKS1.4K
COMMITS0
CONTRIBUTORS0
VERSION—
UPDATED2 mo ago
Node.jswgetHTMLWeb ScrapingMIT

Common commercial products in this category: Bright Data, Apify, ScrapingBee

What can it do?
  • You can download all the source code and associated assets of any website.
  • You can convert downloaded site links to relative format for offline viewing purposes.
  • You can limit downloads to timeouts and size quotas.
Heads up
  • • No published release
User reviews
  • • NeutralGitHub Issue

    Clicking "Enter" pulls a 404 page

    “If I click "Enter" inside the text field it goes to a 404 Not Found page. Here's the error that is printing: ``` NotFoundError: Not Found at /var/www/html/dloader/app.js:27:8 at Layer.handle [as handle_request]…”

  • • NeutralGitHub Issue

    Stuck at Last

    “It stuck their: `> [email protected] start C:\Users\Fasih4444\Website-downloader > node ./bin/www`”

My note

Alternative pages

More in: Web Scraping & Automation