lilingxi01/wikidl
WikiDL is an efficient wikipedia data dump downloader for researchers. It uses multiprocessing for maxing out the bandwidth and CPUs, and is friendly with task schedulers like Slurm.
PythonGPL-2.0
No issues in this repository yet.
WikiDL is an efficient wikipedia data dump downloader for researchers. It uses multiprocessing for maxing out the bandwidth and CPUs, and is friendly with task schedulers like Slurm.
PythonGPL-2.0
No issues in this repository yet.