code for automatically editing and updating the dataset that DLD provides
To install requirements, run the command below in your terminal
pip install -r requirements.txt
To use the code below without any security issues run simply these instructions:
- To work with API provided by DLD you must have Security and access keys. include your keys in environmental variables using the following commands
export DUBAI_KEY=<YOUR KEY>
export DUBAI_SEC=<YOUR SECURITY>
- Run the command below in the current working directory
export PYTHONPATH=${PWD}
-
Download your base dataset from this LINK and place it in Data folder in ./src
note: do not rename the dataset file -
Datasets provided by DLD have some structural issues. To solve them run the code provided in the csv_edit folder by using the below command
python ./src/csv_edit/main.py
- run the API call code for receiving the newest data like below:
python ./src/API-call/main.py
- After running any of the part 4 or 5 commands you will get a massage to select the dataset you want to do processes on it. Select it using a valid entry
the final file will be replaced in your Data folder