/real-time-scraping

Primary LanguageJupyter Notebook

Installation

Python (Python 3.8.1) and Django installation

    pip install -r requirements.txt
Virtual environment setup
Database configuration
Dependencies installation (mention requirements.txt)
Django migrations
    python manage.py makemigrations
    python manage.py migrate

Running server:
    python manage.py process_tasks
    python manage.py runserver
(two command in two terminal in same folder)

Dependencies

List all external dependencies used in the project and their versions. This is typically found in the requirements.txt file.

Configuration

To Explain any configuration settings that the user might need to modify. This could include settings in settings.py or environment variables.

Models

Document the database models used in the project, including their fields and relationships.

Views

To Describe the views and their functions. Mention any class-based views or generic views used.

Templates

To Explain the structure of your templates and how they are organized.

Static Files

To Describe how static files (CSS, JavaScript, images) are managed and served in your project.

Background Tasks

To Explain any background tasks or periodic tasks and how they are implemented.

  1. Download WebDriver

You also need to download the WebDriver executable corresponding to the browser you want to automate. For this example, I'll use the Chrome WebDriver.

ChromeDriver Download

Make sure to place the downloaded executable in a directory included in your system's PATH.

more explcations, visite : https://linuxhint.com/using_selenium_firefox_driver/ https://www.bacancytechnology.com/qanda/qa-automation/configuring-geckodriver-in-linux-to-use-with-selenium

العناصر الضرورية للمنتج هي: اسم المنتج وصف المنتج الفئة السعر الخصم السعر بعد الخصم رابط المنتج  الصور الوقت الذي يتم ادخاله هنا يظهر في جدول المنتجات

!!! ( اي هيرب - https://sa.iherb.com/

)

درعة* https://www.deraahstore.com/ نايس ون* niceonesa.com اكسترا* - https://www.extra.com/ar-sa/ سيفالي* - https://cvaley.com/ar/

تيمو - https://www.temu.com/sa نون - https://www.noon.com/saudi-ar/

اديداس - https://www.adidas.sa/ar نايك - https://www.nike.sa/ar/home نمشي - https://www.namshi.com/saudi-ar/

سنتربوينت - https://www.centrepointstores.com/sa/ar ماكس - https://www.maxfashion.com/sa/ar/ ساكو - https://www.saco.sa/ar/

جرير - https://www.jarir.com/sa-ar/ إيكيا - https://www.ikea.com/sa/ar/ هوم سنتر - https://www.homecentre.com/sa/ar/ هوم بوكس - https://www.homeboxstores.com/sa/ar

ردسي https://redsea.com/ النهدي https://www.nahdionline.com/ الدواء https://www.al-dawaa.com/ بندة https://panda.com.sa/ الدانوب https://danube.sa/ كارفور www.carrefourksa.com لولو https://www.luluhypermarket.com/ العثيم https://www.othaimmarkets.com/ أمازون - https://www.amazon.sa