/drugs-database

I'm scraping drug details from drugs, and I want to store them in a PostgreSQL database. My future plans, use this database and make a full-stack app.

Primary LanguagePython

drugs database:

I'm scraping drugs details from drugs, and i want to store them in a postgresql database. My future plans, use this data base and make a full stack app.

P.S: docker is required

installation:

  1. clone the repo git clone https://github.com/cs-fedy/drugs-database
  2. run docker compose up -d --build to start the db.
  3. install virtualenv using pip: sudo pip install virtualenv
  4. create a new virtualenv: virtualenv venv
  5. activate the virtualenv: source venv/bin/activate
  6. install requirements: pip install requirements.txt
  7. run the script and enjoy: python main.py

used tools:

  1. selenium: Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should) also be automated as well.
  2. BeautifulSoup: Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.
  3. python-dotenv: Add .env support to your django/flask apps in development and deployments.
  4. psycopg2: psycopg2 - Python-PostgreSQL Database Adapter.
  5. tabulate: Pretty-print tabular data.
  6. requests: Python HTTP for Humans.
  7. markdownify: Convert HTML to markdown.

Author:

created at 🌙 with 💻 and ❤ by f0ody