Skip to content

Latest commit

 

History

History
35 lines (26 loc) · 1.46 KB

README.md

File metadata and controls

35 lines (26 loc) · 1.46 KB
Raw

AlphaReign Scraper

AlphaReigns DHT Scraper, includes peer updater and categorizer

More Info Here: https://github.com/AlphaReign/AlphaReign

Notes

This scrape relies on storing the torrent data in a database. I recommend either mariadb or mysql. It will work with sqlite if you wish to have a portable database but doing so will require a high level of disk usage as sqlite writes to a single file.

Installation

  • Download or clone the repository
  • Install node (Version 8 Required. Higher versions might work)
  • Install yarn
  • Install elasticsearch
  • Install mysql / mariadb / sqlite
  • Install pm2 globally (yarn global add pm2)
  • Update config/index.js (ElasticSearch variables if on a different host, Database variables)
  • Run yarn (yarn)
  • Run yarn migrate (yarn migrate)
  • Start pm2 with Ecosystem file (pm2 start ecosystem.config.js)

Updating

  • Stop running pm2 instances (pm2 stop all)
  • Download or pull the repository
  • Run yarn migrate (yarn migrate)
  • Start pm2 (pm2 start all)

Docker

  • Build the image: docker build -t alphareign/scraper:latest .
  • Update config/index.js (Elasticsearch & Database may be on e.g. 172.17.0.1)
  • Run yarn migrate: docker run --rm -v $(pwd)/config/index.js:/scraper/config/index.js alphareign/scraper:latest yarn migrate
  • Start the scraper: docker run -d --name alphareign-scraper -v $(pwd)/config/index.js:/scraper/config/index.js -p 6881:6881/udp alphareign/scraper:latest