Crawlee JS

Crawlee is a library of web scraping and browser automation for Node.js, written in JavaScript and TypeScript, covering scanning and data scraping from end to end. By acting human-like even with the default configuration, it allows you to scan connections, extract data, and save data to disk or cloud without being plugged into modern bot protections. The only interface for HTTP and headless browser scanning offers permanent URL queue, automatic scaling, and integrated proxy rotation.