Web Scraper

A Python-based web scraper designed to efficiently extract data from specified web pages and store it in a MongoDB database. This project demonstrates how to set up the environment, run the scraper, and manage data.

MongoDB Manager

A Python module for managing MongoDB databases and collections efficiently. This module allows for the creation of databases and collections (if they do not already exist) and provides methods to append new documents seamlessly.

Requirements

• Python Version: >= 3.8
• MongoDB: Please ensure that MongoDB is installed and running on your machine. You can download and install MongoDB from the official MongoDB website.

Installation

1. Install MongoDB: Follow the instructions in the official MongoDB installation guide for your operating system.

2. Install pymongo: Use pip to install the pymongo library, which is required for MongoDB operations. Run the following command:

   pip install pymongo

3. Install MongoDB: Run main.py file to execute scraper