/Apex

Apex is a web crawler and search engine that allows users to input multiple URLs and keywords to extract and return relevant URLs and snippets of content. It is designed to be efficient, responsive,making it a practical tool for gathering data from various sources in one place.

Primary LanguagePython

APEX

Apex is a lightweight web crawler and search engine that allows users to input multiple URLs and keywords to extract and return relevant URLs and snippets of content. It is designed to be efficient, responsive, and easy to deploy, making it a practical tool for gathering data from various sources in one place.

Features

  • Crawl multiple URLs and extract content efficiently
  • Keyword-based search for relevant data
  • Responsive web interface for displaying crawl results
  • Lightweight and easy to set up

Run Locally

Clone the project

  git clone https://github.com/AkshayaPujitha/Apex.git

Go to the project directory

  cd Apex

Run Shell Script

  chmod +x run.sh
  ./run.sh

Run Flask Server

  python app.py

Running Tests

To run tests, run the following command

  python -m unittest test_cases.webcrawl_test