This was tested on node 0.12.x. It can be run as a module export, or a command line script.
npm install deep-scrape
// or clone the repository and run it as a script.
- You don't mind trading a bit of performance for more detailed scraping data.
- You would like to find potential DOM sinks and sources on your pages (Possibly for vulnerability scanning).
- You need the most detailed metadata, metrics, and analyitics on your scraped pages.
- You would like to fingerprint possible technologies a certain site or page uses.
(3 years ago)