seo-crawler
Simple node.js SEO content crawler for SPAs with cache
Last updated 10 months ago by manuelxaguilar .
ISC · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install seo-crawler 
SYNC missed versions from official npm registry.

seo-crawler

Simple node.js SEO content crawler for SPAs using Puppeteer and Reddis (for cache) via Kue

TODO

Documentation and tests need to be added. This will be done shortly.

Also, currently working on making the module more robust by adding the following (among others):

  • Make sure this works with multiple Node frameworks
  • Ask if user wants to use cache or crawl every single time
  • Update cached routes that have been modified
  • Make more stuff configurable (cache time, for instance)
  • Dynamic database content handling

All suggestions to improve this module are welcome.

Current Tags

  • 1.0.8                                ...           latest (10 months ago)

8 Versions

  • 1.0.8                                ...           10 months ago
  • 1.0.7                                ...           a year ago
  • 1.0.6                                ...           a year ago
  • 1.0.5                                ...           a year ago
  • 1.0.4                                ...           a year ago
  • 1.0.3                                ...           a year ago
  • 1.0.2                                ...           a year ago
  • 1.0.1                                ...           a year ago
Maintainers (1)
Downloads
Today 0
This Week 0
This Month 2
Last Day 0
Last Week 0
Last Month 9
Dependencies (3)
Dev Dependencies (0)
None
Dependents (0)
None

Copyright 2014 - 2016 © taobao.org |