@applegamer22/social-scraper
Social media web scarper for post file downloads.
Last updated 8 days ago by applegamer22 .
MIT · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install @applegamer22/social-scraper 
SYNC missed versions from official npm registry.

Social-Scraper

Instagram web scarper for social post file(s) downloads.

Contributing Requirements

  1. Separate Git branch to the master branch
  2. Separate fork to this repository

Usage Responsibilities

  • You can't attempt to create accounts or access or collect information in unauthorized ways. This includes creating accounts or collecting information in an automated way without our express permission.

Requirements and/or Recommendations:

  • Google Chrome browser
  • Unix-style terminal and/or npm capable command-line
  • Node.js
  • Node Package Manager (NPM)
  • TypeScript

Before Using The CLI:

General Usage

Install via NPM by running:

  • $ sudo npm i @applegamer22/social-scraper -g (Unix)

Development

  1. Clone this repository by running $ git clone https://github.com/AppleGamer22/Social-Scraper.git in your command-line.
  2. Run $ npm install in the root directory of the downloaded copy.
  3. Run $ scr auth --<instagram or vsco>.
  4. A Chromium broswer will be opened at https://www.instagram.com/accounts/login/.
  5. Sign-in to your Instagram account.
  6. Your Instagram credentials will be securely saved in the CLI's private Chromium instance.
  7. After a successful Instagram authentication, Chromium will be closed.

Using The CLI:

  1. Run $ scr <instagram or vsco> post_id in you command line.
  2. Wait until the program says:

Downloading...Done.

Please Make Sure That:

  • The correct Instagram credentials are entered when using the auth command.

How Does It Work?

  1. The user puts Instagram/VSCO credentials ahead of post scraping.
  2. The Chromium bot will remember the credentials entered the login form of the selected social network.
  3. The user specifies the social network and the desired post ID.
  4. The Chromium bot browser is opened.
  5. Puppeteer navigates to the post.
  6. Puppeteer loads all available files and their URLs.
  7. The CLI downloads the files to the current codebase directory.
  8. The bot browser is closed.
  9. The command is terminated by the Node.js runtime.

Current Tags

  • 1.0.0-alpha.13                                ...           latest (8 days ago)

35 Versions

  • 1.0.0-alpha.13                                ...           8 days ago
  • 1.0.0-alpha.12                                ...           18 days ago
  • 1.0.0-alpha.11                                ...           19 days ago
  • 1.0.0-alpha.10.2                                ...           21 days ago
  • 1.0.0-alpha.10.1                                ...           22 days ago
  • 1.0.0-alpha.10                                ...           22 days ago
  • 1.0.0-alpha.9                                ...           24 days ago
  • 1.0.0-alpha.8.1                                ...           a month ago
  • 1.0.0-alpha.8                                ...           a month ago
  • 1.0.0-alpha.7                                ...           a month ago
  • 1.0.0-alpha.6.5                                ...           a month ago
  • 1.0.0-alpha.6.4                                ...           a month ago
  • 1.0.0-alpha.6.3                                ...           a month ago
  • 1.0.0-alpha.6.2                                ...           a month ago
  • 1.0.0-alpha.6.1                                ...           a month ago
  • 1.0.0-alpha.6                                ...           a month ago
  • 1.0.0-alpha.5.17.1                                ...           a month ago
  • 1.0.0-alpha.5.17.0                                ...           a month ago
  • 1.0.0-alpha.5.17                                ...           a month ago
  • 1.0.0-alpha.5.16                                ...           a month ago
  • 1.0.0-alpha.5.15                                ...           a month ago
  • 1.0.0-alpha.5.14                                ...           a month ago
  • 1.0.0-alpha.5.13                                ...           a month ago
  • 1.0.0-alpha.5.12                                ...           a month ago
  • 1.0.0-alpha.5.11                                ...           a month ago
  • 1.0.0-alpha.5.10                                ...           a month ago
  • 1.0.0-alpha.5.9                                ...           a month ago
  • 1.0.0-alpha.5.8                                ...           a month ago
  • 1.0.0-alpha.5.7                                ...           a month ago
  • 1.0.0-alpha.5.6                                ...           a month ago
  • 1.0.0-alpha.5.4                                ...           a month ago
  • 1.0.0-alpha.5.3                                ...           a month ago
  • 1.0.0-alpha.5.2                                ...           a month ago
  • 1.0.0-alpha.5.1                                ...           a month ago
  • 1.0.0-alpha.5                                ...           a month ago
Maintainers (1)
Downloads
Today 0
This Week 70
This Month 118
Last Day 0
Last Week 14
Last Month 511
Dev Dependencies (17)
Dependents (0)
None

Copyright 2014 - 2016 © taobao.org |