MechanicalSoup
MechanicalSoup is a Python library developed to automate website interactions. It is built on Requests for HTTP sessions and BeautifulSoup libraries for document navigation. It stores cookies automatically, sends them, follows directions, tracks links, and sends forms.
MechanicalSoup · Web Scraping & Automation
Common commercial products in this category: Bright Data, Apify, ScrapingBee
- You automate interactions by filling out and sending forms on websites.
- You visit websites by automatically managing cookies and following directions.
- You follow the links on the pages and navigate through the document content.
- • NeutralHacker News
Show HN: MechanicalSoup, Python library for automating interaction with websites
“Mechanize is a core part in quite a few of my projects lately and the fact that it hasn't been modified in over 2 years has been very worrisome. There are lots of edge cases out there on websites. Mechanize has built up years of fixes and workarounds for these, I hope that…”
- • NeutralHacker News
Show HN: MechanicalSoup, Python library for automating interaction with websites
“This is fantastic. I've used python mechanize in some very large projects and it was very frustrating - their lack of documentation and, well, the fact that it's complete "abandonware". I've had mechanize repository cloned for a year now, planning to do something with it - never…”