Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update README.md #98

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update README.md #98

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@
# NewsGrabber

THIS IS STILL IN BETA
This is now in PRODUCTION (ish!)

An Archive Team project to save every news article from every newswebsite. The dashboard of this grab can be viewed here: http://newsgrabber.harrycross.me:29000 and historical lists of grabbed URLs can be seen here: http://newsgrabber.harrycross.me . The channel for NewsGrabber is #newsgrabber at irc.efnet.org .
An Archive Team project to (try to) save every news article from every newswebsite. Utilising the Archive Team warrior's and tracking utilities (Dashboard of the grab is here: https://tracker.archiveteam.org/newsgrabber/). The channel for NewsGrabber is #newsgrabber at irc.efnet.org.

Mothballed in 2018, NewsGrabber is BACK! Now with no more reliance on Python 2! The original wpull binary has now been replaced with wpull version 1.2.3 from the pip repository. In addition, it has been re-written enough to allow it to be run within a docker container in isolation. The docker version is the preffered option, as all features are working within it.

How does this work?
-------------------
Expand Down