justt1n/crawl

Crawler API

This is a simple FastAPI application for a web crawler.

Installation

1. Clone the repository
2. Set up a virtual environment:

   python -m venv venv
   source venv/bin/activate  # On Windows use `venv\Scripts\activate`

3. Install dependencies:

   pip install -r requirements.txt

Running the Application

Use the following command to run the application:

uvicorn app.main:app --reload

api docs

http://127.0.0.1:8000/docs
http://127.0.0.1:8000/redoc