The WOS Downloader App is a sophisticated tool designed to facilitate the efficient downloading of data from the Web of Science (WOS) platform. This application automates the retrieval of publication information, optimizing the research workflow for academics and data analysts.
- Automated downloading of publication metadata, including full record and cited references.
- Support for data export in tab-delimited file format.
- Streamlined, user-friendly interface for seamless user experience.
The app leverages the following frameworks and technologies:
- Python: For scripting and automation.
- Streamlit: To construct the interactive web interface.
- Selenium: For programmatically navigating the Web of Science website and extracting data.
- Install Anaconda to manage packages and environments for Python.
- Ensure Python is installed on your system (Python 3.9 and above is recommended).
- Clone the repository to your local machine.
- Open Anaconda Command Prompt and navigate to the cloned repository's directory.
- Create a new environment using the
wos.yml
file by executingconda env create -f wos.yml
. This will copy all necessary dependencies within the environment. - Activate the newly created environment with
conda activate wos
. - Please ensure that you download the specified versions of Chrome and Chromedriver via the provided Google Drive link. This application is configured to work with particular versions of both to avoid mismatches between the browser and the webdriver, which could lead to unexpected errors.
Below is the folder structure of the WOS Downloader:
/Chrome
: Chrome folder/Chromedriver
: Chromedriver folderapp.py
: The main Python script to run the WOS Downloader.launcher.py
: The script that is used to launch app.pywos.yml
: cloned environment
- To start the WOS Downloader App, use the
launcher.py
script to launch thelauncher.py
script (make sure you're using a dedicated terminal with thewos
environment activated). - There should be a pop-up for the Streamlit UI (Homepage).
- You can access the app through your web browser at
http://localhost:8501
as long as the script is running. - Input your search link or URL (WOS) into the app's search bar.
- Initiate the search by pressing
Start
and sign into the WOS if necessary (if you're using a network outside of the University's). - Find the downloaded files in your
Download
folder. - If you need to do another search, just input your next link and press
Start
again.
When using the WOS Downloader App from a network outside the University, it is crucial to end your session and log out from any active services from WOS before initiating a download with this application. Failure to do so may lead to the app encountering a page that detects residual activity, which can cause errors.
In the event that you encounter an error, please take the following steps:
- Refresh the WOS Downloader App interface.
- Confirm that you have completed the End your session and log out process from all WOS services.
- Proceed with your download again.