lightscrape
Simple Node.js module for scraping various sites
Last updated 3 months ago by lightx1334 .
ISC · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install lightscrape 
SYNC missed versions from official npm registry.

lightscrape

Downloads
Simple Node.js module for scraping various sites

Installing

npm i lightscrape const lightscrape = require('lightscrape');

Available functions

Every function returns a promise that resolves to an array of results

  • free_proxy_list(): [http]
  • live_socks(): [socks5]
  • pastebin(language): [id<=49] invalid or empty language results in no filter
  • duckduckgo(query): [url<=29] only the first page of results
  • google(query): [url] risk for getting temporarily blocked if you search too much

Scraping 49 javascript pastes

lightscrape.pastebin('javascript').then(ids => {
    console.log(ids.length + ' JavaScript pastes:', ids);
});

More samples can be found in test.js

Current Tags

  • 3.0.0                                ...           latest (3 months ago)

6 Versions

  • 3.0.0                                ...           3 months ago
  • 2.0.1                                ...           a year ago
  • 2.0.0                                ...           a year ago
  • 1.0.2                                ...           a year ago
  • 1.0.1                                ...           2 years ago
  • 1.0.0                                ...           2 years ago
Maintainers (1)
Downloads
Today 0
This Week 0
This Month 6
Last Day 0
Last Week 6
Last Month 0
Dependencies (2)
Dev Dependencies (0)
None
Dependents (0)
None

Copyright 2014 - 2016 © taobao.org |