π A ranked list of awesome Python open-source libraries & tools. Updated weekly.
This curated list contains 390 awesome open-source projects with a total of 1.6M stars grouped into 28 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome!
π§ββοΈ Discover other best-of lists or create your own.
π« Subscribe to our newsletter for updates and trending projects.
Contents
- Data Serialization 16 projects
- Data Containers & Dataframes 30 projects
- Data Structures 15 projects
- Data Validation 15 projects
- Algorithms & Design Patterns 4 projects
- Date & Time Utilities 9 projects
- File & Path Utilities 10 projects
- Compatiblity 7 projects
- Cryptography 7 projects
- Infrastructure & DevOps 19 projects
- Process Utilities 4 projects
- Asynchronous Programming 7 projects
- Configuration 9 projects
- CLI Development 19 projects
- Development Tools 1 projects
- Data Caching 6 projects
- GUI Development 10 projects
- Computer & Machine Vision 1 projects
- Machine Learning & Data Engineering 1 projects
- Text Data 12 projects
- Web Development 1 projects
- Database Clients 64 projects
- Data Loading & Extraction 30 projects
- Data Pipelines & Streaming 43 projects
- File Formats 3 projects
- Code Inspection 4 projects
- General Utilities 15 projects
- Python Implementations 6 projects
- Others 21 projects
Explanation
- π₯π₯π₯ Combined project-quality score
- βοΈ Star count from GitHub
- π£ New project (less than 6 months old)
- π€ Inactive project (6 months no activity)
- π Dead project (12 months no activity)
- ππ Project is trending up or down
- β Project was recently added
- βοΈ Warning (e.g. missing/risky license)
- π¨βπ» Contributors count from GitHub
- π Fork count from GitHub
- π Issue count from GitHub
- β±οΈ Last update timestamp on package manager
- π₯ Download count from package manager
- π¦ Number of dependent projects
- Pandas related project
Data Serialization
protobuf (π₯50 Β· β 60K) - Protocol Buffers - Googles data interchange format. BSD-3
-
GitHub (π¨βπ» 1.1K Β· π 15K Β· π₯ 32M Β· π¦ 420K Β· π 5.8K - 15% open Β· β±οΈ 01.06.2023):
git clone https://github.com/protocolbuffers/protobuf
-
PyPi (π₯ 120M / month Β· π¦ 16K Β· β±οΈ 30.01.2023):
pip install protobuf
-
Conda (π₯ 14M Β· β±οΈ 31.05.2023):
conda install -c conda-forge protobuf
-
npm (π₯ 5.8M / month Β· π¦ 3.4K Β· β±οΈ 10.10.2022):
npm install google-protobuf
flatbuffers (π₯43 Β· β 21K) - FlatBuffers: Memory Efficient Serialization Library. Apache-2
-
GitHub (π¨βπ» 640 Β· π 3.1K Β· π₯ 210K Β· π¦ 59K Β· π 2.2K - 5% open Β· β±οΈ 31.05.2023):
git clone https://github.com/google/flatbuffers
-
PyPi (π₯ 10M / month Β· π¦ 280 Β· β±οΈ 21.01.2023):
pip install flatbuffers
-
Conda (π₯ 710K Β· β±οΈ 28.05.2023):
conda install -c conda-forge flatbuffers
-
npm (π₯ 900K / month Β· π¦ 260 Β· β±οΈ 26.05.2023):
npm install flatbuffers
marshmallow (π₯38 Β· β 6.6K) - A lightweight library for converting complex objects to and from.. MIT
-
GitHub (π¨βπ» 200 Β· π 630 Β· π¦ 81K Β· π 1.2K - 13% open Β· β±οΈ 16.05.2023):
git clone https://github.com/marshmallow-code/marshmallow
-
PyPi (π₯ 21M / month Β· π¦ 10K Β· β±οΈ 11.11.2022):
pip install marshmallow
-
Conda (π₯ 1.8M Β· β±οΈ 13.11.2022):
conda install -c conda-forge marshmallow
cloudpickle (π₯36 Β· β 1.4K) - Extended pickling support for Python objects. BSD-3
-
GitHub (π¨βπ» 55 Β· π 150 Β· π₯ 21 Β· π¦ 80K Β· π 240 - 33% open Β· β±οΈ 25.03.2023):
git clone https://github.com/cloudpipe/cloudpickle
-
PyPi (π₯ 25M / month Β· π¦ 2.8K Β· β±οΈ 19.01.2023):
pip install cloudpickle
-
Conda (π₯ 13M Β· β±οΈ 20.01.2023):
conda install -c conda-forge cloudpickle
orjson (π₯35 Β· β 4.6K) - Fast, correct Python JSON library supporting dataclasses, datetimes,.. Apache-2
ultrajson (π₯34 Β· β 4.1K) - Ultra fast JSON decoder and encoder written in C with Python bindings. BSD-3
dill (π₯34 Β· β 1.9K) - serialize all of python. BSD-3
-
GitHub (π¨βπ» 42 Β· π 160 Β· π₯ 290K Β· π¦ 100K Β· π 470 - 33% open Β· β±οΈ 29.05.2023):
git clone https://github.com/uqfoundation/dill
-
PyPi (π₯ 24M / month Β· π¦ 3.8K Β· β±οΈ 23.10.2022):
pip install dill
-
Conda (π₯ 4.1M Β· β±οΈ 24.10.2022):
conda install -c conda-forge dill
msgpack (π₯34 Β· β 1.8K) - MessagePack serializer implementation for Python msgpack.org[Python]. Apache-2
-
GitHub (π¨βπ» 78 Β· π 220 Β· π₯ 990 Β· π 270 - 2% open Β· β±οΈ 23.05.2023):
git clone https://github.com/msgpack/msgpack-python
-
PyPi (π₯ 31M / month Β· π¦ 2.2K Β· β±οΈ 18.01.2023):
pip install msgpack
-
Conda (π₯ 12M Β· β±οΈ 08.03.2023):
conda install -c conda-forge msgpack-python
jsonpickle (π₯34 Β· β 1.1K) - Python library for serializing any arbitrary object graph into.. BSD-3
python-rapidjson (π₯29 Β· β 480) - Python wrapper around rapidjson. MIT
-
GitHub (π¨βπ» 22 Β· π 44 Β· π¦ 4K Β· π 100 - 11% open Β· β±οΈ 15.03.2023):
git clone https://github.com/python-rapidjson/python-rapidjson
-
PyPi (π₯ 1.1M / month Β· π¦ 270 Β· β±οΈ 17.10.2022):
pip install python-rapidjson
-
Conda (π₯ 1.2M Β· β±οΈ 15.03.2023):
conda install -c conda-forge python-rapidjson
pysimdjson (π₯25 Β· β 590 Β· π€) - Python bindings for the simdjson project. MIT
Show 2 hidden projects...
- simplejson (π₯35 Β· β 1.6K Β· π) - simplejson is a simple, fast, extensible JSON..
βUnlicensed
- pyasn1 (π₯33 Β· β 230 Β· π) - Generic ASN.1 library for Python.
BSD-2
Data Containers & Dataframes
General-purpose data containers as well as utilities & extensions for pandas.
pandas (π₯52 Β· β 39K) - Flexible and powerful data analysis / manipulation library for.. BSD-3
-
GitHub (π¨βπ» 3.4K Β· π 16K Β· π₯ 200K Β· π¦ 1.2M Β· π 25K - 14% open Β· β±οΈ 01.06.2023):
git clone https://github.com/pandas-dev/pandas
-
PyPi (π₯ 110M / month Β· π¦ 70K Β· β±οΈ 19.01.2023):
pip install pandas
-
Conda (π₯ 40M Β· β±οΈ 29.05.2023):
conda install -c conda-forge pandas
numpy (π₯51 Β· β 24K) - The fundamental package for scientific computing with Python. BSD-3
-
GitHub (π¨βπ» 1.6K Β· π 8K Β· π₯ 730K Β· π¦ 1.7M Β· π 12K - 18% open Β· β±οΈ 01.06.2023):
git clone https://github.com/numpy/numpy
-
PyPi (π₯ 150M / month Β· π¦ 130K Β· β±οΈ 26.12.2022):
pip install numpy
-
Conda (π₯ 58M Β· β±οΈ 23.04.2023):
conda install -c conda-forge numpy
h5py (π₯41 Β· β 1.9K) - HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5.. BSD-3
polars (π₯40 Β· β 17K) - Fast multi-threaded, hybrid-out-of-core DataFrame library in Rust | Python.. MIT
Modin (π₯38 Β· β 8.7K) - Modin: Scale your Pandas workflows by changing a single line of.. Apache-2
-
GitHub (π¨βπ» 120 Β· π 610 Β· π₯ 200K Β· π¦ 1.1K Β· π 3.7K - 24% open Β· β±οΈ 01.06.2023):
git clone https://github.com/modin-project/modin
-
PyPi (π₯ 1.2M / month Β· π¦ 40 Β· β±οΈ 26.01.2023):
pip install modin
-
Conda (π₯ 240K Β· β±οΈ 25.05.2023):
conda install -c conda-forge modin-core
PyTables (π₯36 Β· β 1.2K) - A Python package to manage extremely large amounts of data. BSD-3
-
GitHub (π¨βπ» 120 Β· π 250 Β· π₯ 170 Β· π¦ 46K Β· π 680 - 22% open Β· β±οΈ 31.05.2023):
git clone https://github.com/PyTables/PyTables
-
PyPi (π₯ 730K / month Β· π¦ 2.5K Β· β±οΈ 23.12.2022):
pip install tables
-
Conda (π₯ 6M Β· β±οΈ 08.04.2023):
conda install -c conda-forge pytables
docarray (π₯34 Β· β 2.2K) - Represent, send, and store multimodal data Neural Search Vector.. Apache-2
numexpr (π₯33 Β· β 2K) - Fast numerical array expression evaluator for Python, NumPy, PyTables,.. MIT
zarr (π₯33 Β· β 1.2K) - An implementation of chunked, compressed, N-dimensional arrays for Python. MIT
-
GitHub (π¨βπ» 87 Β· π 220 Β· π¦ 2.3K Β· π 610 - 41% open Β· β±οΈ 29.05.2023):
git clone https://github.com/zarr-developers/zarr-python
-
PyPi (π₯ 250K / month Β· π¦ 370 Β· β±οΈ 16.01.2023):
pip install zarr
-
Conda (π₯ 2.4M Β· β±οΈ 16.03.2023):
conda install -c conda-forge zarr
Bottleneck (π₯33 Β· β 900) - Fast NumPy array functions written in C. BSD-2
-
GitHub (π¨βπ» 30 Β· π 93 Β· π¦ 41K Β· π 230 - 18% open Β· β±οΈ 04.04.2023):
git clone https://github.com/pydata/bottleneck
-
PyPi (π₯ 620K / month Β· π¦ 1.6K Β· β±οΈ 20.01.2023):
pip install Bottleneck
-
Conda (π₯ 3.4M Β· β±οΈ 09.03.2023):
conda install -c conda-forge bottleneck
TinyDB (π₯32 Β· β 5.9K) - TinyDB is a lightweight document oriented database optimized for your.. MIT
Koalas (π₯32 Β· β 3.3K) - Koalas: pandas API on Apache Spark. Apache-2
spark
-
GitHub (π¨βπ» 51 Β· π 340 Β· π₯ 1K Β· π¦ 300 Β· π 590 - 18% open Β· β±οΈ 14.12.2022):
git clone https://github.com/databricks/koalas
-
PyPi (π₯ 1.9M / month Β· π¦ 16 Β· β±οΈ 19.10.2021):
pip install koalas
-
Conda (π₯ 290K Β· β±οΈ 20.10.2021):
conda install -c conda-forge koalas
pandera (π₯32 Β· β 2.3K) - A light-weight, flexible, and expressive statistical data testing.. MIT
-
GitHub (π¨βπ» 91 Β· π 190 Β· π¦ 850 Β· π 590 - 34% open Β· β±οΈ 01.06.2023):
git clone https://github.com/pandera-dev/pandera
-
PyPi (π₯ 840K / month Β· π¦ 70 Β· β±οΈ 02.11.2022):
pip install pandera
-
Conda (π₯ 23K Β· β±οΈ 10.05.2023):
conda install -c conda-forge pandera-core
datasketch (π₯30 Β· β 2K) - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++,.. MIT
Vaex (π₯29 Β· β 7.9K) - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization.. MIT
datatable (π₯29 Β· β 1.7K) - A Python package for manipulating 2-dimensional tabular data.. MPL-2.0
StaticFrame (π₯28 Β· β 340) - Immutable and grow-only Pandas-like DataFrames with a more explicit.. MIT
-
GitHub (π¨βπ» 21 Β· π 30 Β· π¦ 18 Β· π 560 - 6% open Β· β±οΈ 28.05.2023):
git clone https://github.com/InvestmentSystems/static-frame
-
PyPi (π₯ 3.5K / month Β· π¦ 2 Β· β±οΈ 01.07.2022):
pip install static-frame
-
Conda (π₯ 260K Β· β±οΈ 28.05.2023):
conda install -c conda-forge static-frame
PandaralΒ·lel (π₯27 Β· β 3.1K) - A simple and efficient tool to parallelize Pandas.. BSD-3
jupyter
Pandas Summary (π₯26 Β· β 470) - Engine for ML/Data tracking, visualization,.. Apache-2
pickleDB (π₯22 Β· β 790) - pickleDB is an open source key-value store using Pythons json module. BSD-3
Bounter (π₯18 Β· β 940 Β· π€) - Efficient Counter that uses a limited (bounded) amount of memory.. MIT
Show 6 hidden projects...
- Blaze (π₯30 Β· β 3.1K Β· π) - NumPy and Pandas interface to Big Data.
BSD-3
- Arctic (π₯30 Β· β 3K) - Arctic is a high performance datastore for numeric data.
βοΈLGPL-2.1
- sklearn-pandas (π₯29 Β· β 2.7K Β· π€) - Pandas integration with sklearn.
βοΈZlib
sklearn
- pandasql (π₯27 Β· β 1.2K Β· π) - sqldf for pandas.
MIT
- bcolz (π₯26 Β· β 950 Β· π) - A columnar data container that can be compressed.
BSD-3
- PandaPy (π₯12 Β· β 540 Β· π) - PandaPy has the speed of NumPy and the usability of Pandas 10x to..
MIT
Data Structures
python-sortedcontainers (π₯34 Β· β 3K Β· π€) - Python Sorted Container Types: Sorted List, Sorted.. Apache-2
-
GitHub (π¨βπ» 23 Β· π 190 Β· π¦ 120K Β· π 180 - 14% open Β· β±οΈ 06.11.2022):
git clone https://github.com/grantjenks/python-sortedcontainers
-
PyPi (π₯ 20M / month Β· π¦ 2.2K Β· β±οΈ 16.05.2021):
pip install sortedcontainers
-
Conda (π₯ 10M Β· β±οΈ 17.05.2021):
conda install -c conda-forge sortedcontainers
pyrsistent (π₯34 Β· β 1.9K) - Persistent/Immutable/Functional data structures for Python. MIT
-
GitHub (π¨βπ» 69 Β· π 140 Β· π¦ 280K Β· π 170 - 13% open Β· β±οΈ 29.12.2022):
git clone https://github.com/tobgu/pyrsistent
-
PyPi (π₯ 55M / month Β· π¦ 2.3K Β· β±οΈ 29.12.2022):
pip install pyrsistent
-
Conda (π₯ 18M Β· β±οΈ 02.01.2023):
conda install -c conda-forge pyrsistent
multidict (π₯31 Β· β 340) - The multidict implementation. Apache-2
-
GitHub (π¨βπ» 47 Β· π 81 Β· π₯ 3.5K Β· π 140 - 11% open Β· β±οΈ 30.05.2023):
git clone https://github.com/aio-libs/multidict
-
PyPi (π₯ 69M / month Β· π¦ 3.2K Β· β±οΈ 24.12.2022):
pip install multidict
-
Conda (π₯ 9.3M Β· β±οΈ 29.12.2022):
conda install -c conda-forge multidict
glom (π₯29 Β· β 1.7K) - Pythons nested data operator (and CLI), for all your declarative.. BSD-3
python-benedict (π₯29 Β· β 1.1K) - dict subclass with keylist/keypath support, built-in I/O.. MIT
-
GitHub (π¨βπ» 5 Β· π 41 Β· π¦ 1.4K Β· π 88 - 10% open Β· β±οΈ 31.05.2023):
git clone https://github.com/fabiocaccamo/python-benedict
-
PyPi (π₯ 950K / month Β· π¦ 27 Β· β±οΈ 12.01.2023):
pip install python-benedict
-
Conda (π₯ 130K Β· β±οΈ 23.05.2023):
conda install -c conda-forge python-benedict
munch (π₯29 Β· β 670) - A Munch is a Python dictionary that provides attribute-style access (a la.. MIT
ordered-set (π₯28 Β· β 180 Β· π€) - A mutable set that remembers the order of its entries. One of.. MIT
-
GitHub (π¨βπ» 19 Β· π 43 Β· π¦ 7.9K Β· π 40 - 12% open Β· β±οΈ 06.09.2022):
git clone https://github.com/rspeer/ordered-set
-
PyPi (π₯ 8.5M / month Β· π¦ 370 Β· β±οΈ 26.01.2022):
pip install ordered-set
-
Conda (π₯ 330K Β· β±οΈ 26.01.2022):
conda install -c conda-forge ordered-set
python-box (π₯26 Β· β 2.2K) - Python dictionaries with advanced dot notation access. MIT
immutables (π₯26 Β· β 1K Β· π€) - A high-performance immutable mapping type for Python. Apache-2
-
GitHub (π¨βπ» 13 Β· π 53 Β· π¦ 5.8K Β· π 49 - 32% open Β· β±οΈ 18.11.2022):
git clone https://github.com/MagicStack/immutables
-
PyPi (π₯ 1.3M / month Β· π¦ 120 Β· β±οΈ 19.09.2022):
pip install immutables
-
Conda (π₯ 920K Β· β±οΈ 30.10.2022):
conda install -c conda-forge immutables
sqlitedict (π₯26 Β· β 1K) - Persistent dict, backed by sqlite3 and pickle, multithread-safe. Apache-2
-
GitHub (π¨βπ» 40 Β· π 130 Β· π¦ 3.2K Β· π 100 - 33% open Β· β±οΈ 03.12.2022):
git clone https://github.com/RaRe-Technologies/sqlitedict
-
PyPi (π₯ 230K / month Β· π¦ 220 Β· β±οΈ 03.12.2022):
pip install sqlitedict
-
Conda (π₯ 72K Β· β±οΈ 04.03.2022):
conda install -c conda-forge sqlitedict
Show 2 hidden projects...
- addict (π₯29 Β· β 2.4K Β· π) - The Python Dict thats better than heroin.
MIT
- cleverdict (π₯14 Β· β 96 Β· π) - A JSON-friendly data structure which allows both object attributes..
MIT
Data Validation
pydantic (π₯45 Β· β 14K) - Data validation using Python type hints. MIT
-
GitHub (π¨βπ» 360 Β· π 1.2K Β· π¦ 200K Β· π 2.5K - 10% open Β· β±οΈ 01.06.2023):
git clone https://github.com/samuelcolvin/pydantic
-
PyPi (π₯ 68M / month Β· π¦ 7K Β· β±οΈ 02.01.2023):
pip install pydantic
-
Conda (π₯ 5M Β· β±οΈ 23.05.2023):
conda install -c conda-forge pydantic
jsonschema (π₯40 Β· β 4.2K) - An implementation of the JSON Schema specification for Python. MIT
-
GitHub (π¨βπ» 110 Β· π 560 Β· π¦ 390K Β· π 740 - 3% open Β· β±οΈ 30.05.2023):
git clone https://github.com/Julian/jsonschema
-
PyPi (π₯ 67M / month Β· π¦ 19K Β· β±οΈ 29.11.2022):
pip install jsonschema
-
Conda (π₯ 20M Β· β±οΈ 30.11.2022):
conda install -c conda-forge jsonschema
validators (π₯33 Β· β 760) - Python Data Validation for Humans. MIT
-
GitHub (π¨βπ» 44 Β· π 130 Β· π¦ 71K Β· π 140 - 10% open Β· β±οΈ 23.05.2023):
git clone https://github.com/kvesteri/validators
-
PyPi (π₯ 5.4M / month Β· π¦ 1.7K Β· β±οΈ 05.06.2022):
pip install validators
-
Conda (π₯ 390K Β· β±οΈ 19.02.2023):
conda install -c conda-forge validators
param (π₯32 Β· β 320) - Param: Make your Python code clearer and more reliable by declaring.. BSD-3
voluptuous (π₯31 Β· β 1.8K) - CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data.. BSD-3
-
GitHub (π¨βπ» 90 Β· π 200 Β· π¦ 13K Β· π 240 - 16% open Β· β±οΈ 22.02.2023):
git clone https://github.com/alecthomas/voluptuous
-
PyPi (π₯ 2.1M / month Β· π¦ 1.4K Β· β±οΈ 07.04.2022):
pip install voluptuous
-
Conda (π₯ 290K Β· β±οΈ 07.04.2022):
conda install -c conda-forge voluptuous
strictyaml (π₯30 Β· β 1.2K) - Type-safe YAML parser and validator. MIT
-
GitHub (π¨βπ» 20 Β· π 56 Β· π¦ 1.5K Β· π 160 - 54% open Β· β±οΈ 25.05.2023):
git clone https://github.com/crdoconnor/strictyaml
-
PyPi (π₯ 510K / month Β· π¦ 230 Β· β±οΈ 08.10.2022):
pip install strictyaml
-
Conda (π₯ 200K Β· β±οΈ 12.03.2023):
conda install -c conda-forge strictyaml
dirty-equals (π₯22 Β· β 670) - Doing dirty (but extremely useful) things with equals. MIT
-
GitHub (π¨βπ» 11 Β· π 25 Β· π¦ 160 Β· π 21 - 42% open Β· β±οΈ 02.05.2023):
git clone https://github.com/samuelcolvin/dirty-equals
-
PyPi (π₯ 23K / month Β· π¦ 20 Β· β±οΈ 30.08.2022):
pip install dirty-equals
-
Conda (π₯ 30K Β· β±οΈ 03.05.2023):
conda install -c conda-forge dirty-equals
typical (π₯22 Β· β 180) - Typical: Fast, simple, & correct data-validation using Python 3 typing. MIT
Show 6 hidden projects...
- cerberus (π₯34 Β· β 3K Β· π) - Lightweight, extensible data validation library for Python.
ISC
- schema (π₯32 Β· β 2.8K Β· π) - Schema validation just got Pythonic.
MIT
- schematics (π₯30 Β· β 2.6K Β· π) - Python Data Structures for Humans.
BSD-3
- python-email-validator (π₯28 Β· β 780) - A robust email syntax and deliverability validation..
βοΈCC0-1.0
- validr (π₯18 Β· β 210 Β· π) - A simple, fast, extensible python library for data validation.
MIT
- dataklasses (π₯7 Β· β 760 Β· π) - A different spin on dataclasses.
βUnlicensed
Algorithms & Design Patterns
π python-patterns ( β 37K) - Collection of design patterns/idioms in Python.
algorithms (π₯29 Β· β 23K) - Minimal examples of data structures and algorithms in Python. MIT
transitions (π₯29 Β· β 4.9K) - A lightweight, object-oriented finite state machine implementation.. MIT
-
GitHub (π¨βπ» 75 Β· π 510 Β· π¦ 3K Β· π 430 - 2% open Β· β±οΈ 06.01.2023):
git clone https://github.com/pytransitions/transitions
-
PyPi (π₯ 410K / month Β· π¦ 270 Β· β±οΈ 24.02.2022):
pip install transitions
-
Conda (π₯ 440K Β· β±οΈ 02.09.2022):
conda install -c conda-forge transitions
Show 1 hidden projects...
Date & Time Utilities
python-dateutil (π₯39 Β· β 2.1K) - Useful extensions to the standard Python datetime features. Apache-2
-
GitHub (π¨βπ» 130 Β· π 430 Β· π₯ 35K Β· π¦ 1.1M Β· π 720 - 45% open Β· β±οΈ 03.12.2022):
git clone https://github.com/dateutil/dateutil
-
PyPi (π₯ 250M / month Β· π¦ 4.1K Β· β±οΈ 14.07.2021):
pip install python-dateutil
-
Conda (π₯ 45M Β· β±οΈ 14.07.2021):
conda install -c conda-forge python-dateutil
dateparser (π₯37 Β· β 2.3K) - python parser for human readable dates. BSD-3
-
GitHub (π¨βπ» 130 Β· π 440 Β· π¦ 20K Β· π 660 - 44% open Β· β±οΈ 16.05.2023):
git clone https://github.com/scrapinghub/dateparser
-
PyPi (π₯ 4.8M / month Β· π¦ 1.2K Β· β±οΈ 17.03.2022):
pip install dateparser
-
Conda (π₯ 140K Β· β±οΈ 23.03.2023):
conda install -c conda-forge dateparser
pendulum (π₯34 Β· β 5.5K) - Python datetimes made easy. MIT
-
GitHub (π¨βπ» 88 Β· π 320 Β· π₯ 100 Β· π¦ 20K Β· π 500 - 47% open Β· β±οΈ 25.02.2023):
git clone https://github.com/sdispater/pendulum
-
PyPi (π₯ 11M / month Β· π¦ 1.2K Β· β±οΈ 23.11.2022):
pip install pendulum
-
Conda (π₯ 740K Β· β±οΈ 04.02.2023):
conda install -c conda-forge pendulum
holidays (π₯33 Β· β 980) - Generate and work with holidays in Python. MIT
-
GitHub (π¨βπ» 210 Β· π 380 Β· π₯ 170 Β· π 410 - 19% open Β· β±οΈ 15.05.2023):
git clone https://github.com/dr-prodigy/python-holidays
-
PyPi (π₯ 5.1M / month Β· π¦ 430 Β· β±οΈ 30.01.2023):
pip install holidays
-
Conda (π₯ 3.1M Β· β±οΈ 15.05.2023):
conda install -c conda-forge holidays
tzlocal (π₯31 Β· β 170) - A Python module that tries to figure out what your local timezone is. MIT
Show 2 hidden projects...
- parsedatetime (π₯29 Β· β 670 Β· π) - Parse human-readable date/time strings.
Apache-2
- isodate (π₯29 Β· β 130 Β· π) - ISO 8601 date/time parser.
BSD-3
File & Path Utilities
filesystem_spec (π₯39 Β· β 590) - A specification that python filesystems should adhere to. BSD-3
watchdog (π₯38 Β· β 5.8K Β· π) - Python library and shell utilities to monitor filesystem events. Apache-2
-
GitHub (π¨βπ» 140 Β· π 670 Β· π¦ 94K Β· π 620 - 27% open Β· β±οΈ 14.05.2023):
git clone https://github.com/gorakhargosh/watchdog
-
PyPi (π₯ 13M / month Β· π¦ 8.1K Β· β±οΈ 02.01.2023):
pip install watchdog
-
Conda (π₯ 2.1M Β· β±οΈ 20.03.2023):
conda install -c conda-forge watchdog
appdirs (π₯31 Β· β 980) - A small Python module for determining appropriate platform-specific dirs,.. MIT
pyfilesystem2 (π₯30 Β· β 1.9K Β· π€) - Pythons Filesystem abstraction layer. MIT
Show 3 hidden projects...
- zipp (π₯31 Β· β 38) - Backport of pathlib-compatible object wrapper for zip files.
MIT
- scandir (π₯29 Β· β 510 Β· π) - Better directory iterator and faster os.walk(), now in the Python..
BSD-3
- Unipath (π₯22 Β· β 510 Β· π) - An object-oriented approach to Python file/directory operations.
MIT
Compatiblity
future (π₯38 Β· β 1.2K) - Easy, clean, reliable Python 2/3 compatibility. MIT
-
GitHub (π¨βπ» 110 Β· π 280 Β· π¦ 280K Β· π 400 - 50% open Β· β±οΈ 29.01.2023):
git clone https://github.com/PythonCharmers/python-future
-
PyPi (π₯ 32M / month Β· π¦ 17K Β· β±οΈ 13.01.2023):
pip install future
-
Conda (π₯ 11M Β· β±οΈ 13.01.2023):
conda install -c conda-forge future
typing (π₯31 Β· β 1.4K) - Python static typing home. Hosts the documentation and a user help.. Python-2.0
futures (π₯27 Β· β 230 Β· π€) - Backport of the concurrent.futures package to Python 2.6 and 2.7. Python-2.0
Show 3 hidden projects...
- dataclasses (π₯27 Β· β 560 Β· π) - A backport of the dataclasses module for Python 3.6.
Apache-2
- pathlib2 (π₯27 Β· β 72 Β· π) - Backport of pathlib aiming to support the full stdlib Python API.
MIT
- contextlib2 (π₯26 Β· β 37 Β· π) - contextlib2 is a backport of the standard librarys contextlib..
βοΈpsfrag
Cryptography
cryptography (π₯46 Β· β 5.6K) - cryptography is a package designed to expose cryptographic.. Apache-2
-
GitHub (π¨βπ» 290 Β· π 1.2K Β· π¦ 470K Β· π 2.2K - 1% open Β· β±οΈ 01.06.2023):
git clone https://github.com/pyca/cryptography
-
PyPi (π₯ 160M / month Β· π¦ 21K Β· β±οΈ 07.02.2023):
pip install cryptography
-
Conda (π₯ 39M Β· β±οΈ 30.05.2023):
conda install -c conda-forge cryptography
pycryptodomex (π₯38 Β· β 2.4K) - A self-contained cryptographic library for Python. BSD-3
-
GitHub (π¨βπ» 140 Β· π 440 Β· π¦ 69K Β· π 550 - 10% open Β· β±οΈ 19.05.2023):
git clone https://github.com/Legrandin/pycryptodome
-
PyPi (π₯ 29M / month Β· π¦ 1.6K Β· β±οΈ 28.01.2023):
pip install pycryptodomex
-
Conda (π₯ 1.3M Β· β±οΈ 19.05.2023):
conda install -c conda-forge pycryptodomex
tink (π₯36 Β· β 13K) - Tink is a multi-language, cross-platform, open source library that.. Apache-2
-
GitHub (π¨βπ» 110 Β· π 1.2K Β· π₯ 1.1K Β· π¦ 46 Β· π 480 - 10% open Β· β±οΈ 28.04.2023):
git clone https://github.com/google/tink
-
PyPi (π₯ 150K / month Β· π¦ 3 Β· β±οΈ 10.08.2021):
pip install tink
-
npm (π₯ 270 / month Β· π¦ 1 Β· β±οΈ 02.05.2023):
npm install tink-crypto
bcrypt (π₯33 Β· β 1K) - Modern(-ish) password hashing for your software and your servers. Apache-2
asn1crypto (π₯33 Β· β 290 Β· π€) - Python ASN.1 library with a focus on performance and a pythonic API. MIT
Infrastructure & DevOps
ansible (π₯48 Β· β 58K) - Ansible is a radically simple IT automation platform that makes your.. βοΈGPL-3.0
botocore (π₯44 Β· β 1.3K) - The low-level, core functionality of boto3 and the AWS CLI. Apache-2
paramiko (π₯43 Β· β 8.4K) - The leading native Python SSHv2 protocol library. βοΈLGPL-2.1
docker-compose (π₯42 Β· β 30K) - Define and run multi-container applications with Docker. Apache-2
-
GitHub (π¨βπ» 470 Β· π 4.9K Β· π₯ 130M Β· π¦ 12K Β· π 6.9K - 2% open Β· β±οΈ 01.06.2023):
git clone https://github.com/docker/compose
-
PyPi (π₯ 1.7M / month Β· π¦ 1.2K Β· β±οΈ 10.05.2021):
pip install docker-compose
-
Conda (π₯ 330K Β· β±οΈ 04.11.2022):
conda install -c conda-forge docker-compose
pulumi (π₯42 Β· β 16K) - Pulumi - Infrastructure as Code in any programming language. Build.. Apache-2
-
GitHub (π¨βπ» 230 Β· π 900 Β· π₯ 230K Β· π¦ 2.6K Β· π 6.1K - 29% open Β· β±οΈ 01.06.2023):
git clone https://github.com/pulumi/pulumi
-
PyPi (π₯ 2.3M / month Β· π¦ 130 Β· β±οΈ 25.01.2023):
pip install pulumi
-
npm (π₯ 1.1M / month Β· π¦ 580 Β· β±οΈ 19.05.2023):
npm install @pulumi/pulumi
docker (π₯41 Β· β 6.3K) - A Python library for the Docker Engine API. Apache-2
-
GitHub (π¨βπ» 440 Β· π 1.6K Β· π₯ 550 Β· π¦ 62K Β· π 1.6K - 26% open Β· β±οΈ 11.05.2023):
git clone https://github.com/docker/docker-py
-
PyPi (π₯ 29M / month Β· π¦ 3.8K Β· β±οΈ 02.11.2022):
pip install docker
-
Conda (π₯ 3.4M Β· β±οΈ 08.05.2023):
conda install -c conda-forge docker-py
netmiko (π₯39 Β· β 3.1K) - Multi-vendor library to simplify Paramiko SSH connections to network.. MIT
kubernetes (π₯38 Β· β 5.7K) - Official Python client library for kubernetes. Apache-2
pyinfra (π₯29 Β· β 2.3K) - pyinfra automates infrastructure super fast at massive scale. It can be.. MIT
pypyr (π₯21 Β· β 520) - pypyr task-runner cli & api for automation pipelines. Automate anything.. Apache-2
Show 4 hidden projects...
- fabtools (π₯25 Β· β 1.3K Β· π) - Tools for writing awesome Fabric files.
BSD-2
- parallel-ssh (π₯25 Β· β 1.1K Β· π€) - Asynchronous parallel SSH client library.
βοΈLGPL-2.1
- storm (π₯24 Β· β 3.9K Β· π) - Manage your SSH like a boss.
MIT
- wssh (π₯17 Β· β 1.3K Β· π) - SSH to WebSockets Bridge.
MIT
Process Utilities
pexpect (π₯37 Β· β 2.4K) - A Python module for controlling interactive programs in a pseudo-terminal. ISC
-
GitHub (π¨βπ» 100 Β· π 460 Β· π₯ 4.3K Β· π¦ 280K Β· π 470 - 38% open Β· β±οΈ 02.04.2023):
git clone https://github.com/pexpect/pexpect
-
PyPi (π₯ 31M / month Β· π¦ 16K Β· β±οΈ 21.01.2020):
pip install pexpect
-
Conda (π₯ 14M Β· β±οΈ 01.11.2022):
conda install -c conda-forge pexpect
supervisor (π₯36 Β· β 7.8K) - Supervisor process control system for Unix.. βοΈRepoze Public License
-
GitHub (π¨βπ» 180 Β· π 1.2K Β· π¦ 9.2K Β· π 1.1K - 12% open Β· β±οΈ 27.05.2023):
git clone https://github.com/Supervisor/supervisor
-
PyPi (π₯ 1.2M / month Β· π¦ 2K Β· β±οΈ 24.12.2022):
pip install supervisor
-
Conda (π₯ 250K Β· β±οΈ 29.12.2022):
conda install -c conda-forge supervisor
Show 1 hidden projects...
- ptyprocess (π₯26 Β· β 190 Β· π) - Run a subprocess in a pseudo terminal.
ISC
Asynchronous Programming
uvloop (π₯37 Β· β 9.4K) - Ultra fast asyncio event loop. Apache-2
-
GitHub (π¨βπ» 56 Β· π 540 Β· π₯ 390 Β· π¦ 80K Β· π 320 - 22% open Β· β±οΈ 15.01.2023):
git clone https://github.com/MagicStack/uvloop
-
PyPi (π₯ 6.5M / month Β· π¦ 1.9K Β· β±οΈ 19.09.2022):
pip install uvloop
-
Conda (π₯ 590K Β· β±οΈ 26.10.2022):
conda install -c conda-forge uvloop
greenlet (π₯37 Β· β 1.5K) - Lightweight in-process concurrent programming. MIT
-
GitHub (π¨βπ» 63 Β· π 220 Β· π¦ 250K Β· π 210 - 11% open Β· β±οΈ 28.01.2023):
git clone https://github.com/python-greenlet/greenlet
-
PyPi (π₯ 56M / month Β· π¦ 10K Β· β±οΈ 28.01.2023):
pip install greenlet
-
Conda (π₯ 6.9M Β· β±οΈ 14.05.2023):
conda install -c conda-forge greenlet
anyio (π₯37 Β· β 1.3K) - High level asynchronous concurrency and networking framework that works on.. MIT
Show 2 hidden projects...
Configuration
python-dotenv (π₯37 Β· β 6K) - Reads key-value pairs from a .env file and can set them as.. BSD-3
-
GitHub (π¨βπ» 91 Β· π 360 Β· π¦ 470K Β· π 240 - 12% open Β· β±οΈ 17.04.2023):
git clone https://github.com/theskumar/python-dotenv
-
PyPi (π₯ 27M / month Β· π¦ 8.1K Β· β±οΈ 21.01.2023):
pip install python-dotenv
-
Conda (π₯ 2.4M Β· β±οΈ 24.02.2023):
conda install -c conda-forge python-dotenv
traitlets (π₯36 Β· β 560) - A lightweight Traits like module. BSD-3
-
GitHub (π¨βπ» 110 Β· π 190 Β· π₯ 130 Β· π¦ 320K Β· π 280 - 31% open Β· β±οΈ 06.05.2023):
git clone https://github.com/ipython/traitlets
-
PyPi (π₯ 23M / month Β· π¦ 15K Β· β±οΈ 30.01.2023):
pip install traitlets
-
Conda (π₯ 21M Β· β±οΈ 30.01.2023):
conda install -c conda-forge traitlets
Dynaconf (π₯34 Β· β 3K) - Configuration Management for Python. MIT
-
GitHub (π¨βπ» 110 Β· π 260 Β· π¦ 6.6K Β· π 440 - 23% open Β· β±οΈ 24.05.2023):
git clone https://github.com/rochacbruno/dynaconf
-
PyPi (π₯ 1.8M / month Β· π¦ 250 Β· β±οΈ 22.09.2022):
pip install dynaconf
-
Conda (π₯ 51K Β· β±οΈ 06.03.2023):
conda install -c conda-forge dynaconf
python-decouple (π₯32 Β· β 2.4K) - Strict separation of config from code. MIT
-
GitHub (π¨βπ» 35 Β· π 180 Β· π₯ 11 Β· π¦ 100K Β· π 85 - 4% open Β· β±οΈ 17.04.2023):
git clone https://github.com/henriquebastos/python-decouple
-
PyPi (π₯ 1.4M / month Β· π¦ 3.3K Β· β±οΈ 09.01.2023):
pip install python-decouple
-
Conda (π₯ 62K Β· β±οΈ 02.03.2023):
conda install -c conda-forge python-decouple
omegaconf (π₯31 Β· β 1.5K) - Flexible Python configuration system. The last one you will ever need. BSD-3
configobj (π₯29 Β· β 290) - Python 3+ compatible port of the configobj library. BSD-3
-
GitHub (π¨βπ» 9 Β· π 69 Β· π₯ 81 Β· π¦ 27K Β· π 160 - 41% open Β· β±οΈ 18.01.2023):
git clone https://github.com/DiffSK/configobj
-
PyPi (π₯ 2.3M / month Β· π¦ 3.4K Β· β±οΈ 18.01.2023):
pip install configobj
-
Conda (π₯ 640K Β· β±οΈ 20.01.2023):
conda install -c conda-forge configobj
hydra (π₯28 Β· β 7.1K) - Hydra is a framework for elegantly configuring complex applications. MIT
gin-config (π₯28 Β· β 1.8K) - Gin provides a lightweight configuration framework for Python. Apache-2
CLI Development
rich (π₯43 Β· β 43K) - Rich is a Python library for rich text and beautiful formatting in the terminal. MIT
python-prompt-toolkit (π₯38 Β· β 8.4K) - Library for building powerful interactive command.. BSD-3
-
GitHub (π¨βπ» 210 Β· π 680 Β· π 1.1K - 50% open Β· β±οΈ 28.04.2023):
git clone https://github.com/prompt-toolkit/python-prompt-toolkit
-
PyPi (π₯ 24M / month Β· π¦ 1.4K Β· β±οΈ 06.12.2022):
pip install prompt_toolkit
-
Conda (π₯ 16M Β· β±οΈ 28.02.2023):
conda install -c conda-forge prompt-toolkit
python-fire (π₯37 Β· β 25K Β· π) - Python Fire is a library for automatically generating.. Apache-2
colorama (π₯36 Β· β 3.2K Β· π€) - Simple cross-platform colored terminal text in Python. BSD-3
argcomplete (π₯36 Β· β 1.2K) - Python and tab completion, better together. Apache-2
-
GitHub (π¨βπ» 64 Β· π 110 Β· π₯ 270 Β· π¦ 44K Β· π 240 - 21% open Β· β±οΈ 29.05.2023):
git clone https://github.com/kislyuk/argcomplete
-
PyPi (π₯ 20M / month Β· π¦ 2.2K Β· β±οΈ 06.03.2023):
pip install argcomplete
-
Conda (π₯ 1.1M Β· β±οΈ 24.04.2023):
conda install -c conda-forge argcomplete
wcwidth (π₯32 Β· β 330) - Python library that measures the width of unicode strings rendered to a.. MIT
cleo (π₯31 Β· β 1.1K) - Cleo allows you to create beautiful and testable command-line interfaces. MIT
asciimatics (π₯29 Β· β 3.3K) - A cross platform package to do curses-like operations, plus.. Apache-2
-
GitHub (π¨βπ» 42 Β· π 240 Β· π¦ 850 Β· π 290 - 8% open Β· β±οΈ 16.04.2023):
git clone https://github.com/peterbrittain/asciimatics
-
PyPi (π₯ 62K / month Β· π¦ 120 Β· β±οΈ 23.04.2022):
pip install asciimatics
-
Conda (π₯ 130K Β· β±οΈ 21.04.2023):
conda install -c conda-forge asciimatics
questionary (π₯28 Β· β 1.1K) - Python library to build pretty command line user prompts Easy to use.. MIT
docopt-ng (π₯21 Β· β 120 Β· π) - Humane command line arguments parser. Now with maintenance,.. MIT
colout (π₯17 Β· β 1.1K) - Color text streams with a polished command line interface. βοΈGPL-3.0
Show 6 hidden projects...
- docopt (π₯35 Β· β 7.8K Β· π) - Pythonic command line arguments parser, that will make you smile.
MIT
- blessings (π₯28 Β· β 1.4K Β· π) - A thin, practical wrapper around terminal capabilities in Python.
MIT
- ConfigArgParse (π₯27 Β· β 640 Β· π) - A drop-in replacement for argparse that allows options to..
MIT
- clint (π₯24 Β· β 88 Β· π) - Python Command-line Application Tools.
ISC
- bashplotlib (π₯22 Β· β 1.7K Β· π) - plotting in the terminal.
MIT
- Click Extra (π₯22 Β· β 32) - Extra colorization and configuration loading for Click.
βοΈGPL-2.0
Development Tools
π best-of-python-dev ( β 730) - A ranked list of awesome python developer tools and libraries. Updated..
Data Caching
cachetools (π₯32 Β· β 1.7K) - Extensible memoizing collections and decorators. MIT
pylibmc (π₯27 Β· β 470 Β· π€) - A Python wrapper around the libmemcached interface from TangentOrg. BSD-3
-
GitHub (π¨βπ» 52 Β· π 130 Β· π₯ 160 Β· π¦ 4.6K Β· π 190 - 11% open Β· β±οΈ 26.08.2022):
git clone https://github.com/lericson/pylibmc
-
PyPi (π₯ 210K / month Β· π¦ 2.4K Β· β±οΈ 30.08.2022):
pip install pylibmc
-
Conda (π₯ 210K Β· β±οΈ 30.10.2022):
conda install -c conda-forge pylibmc
cachier (π₯25 Β· β 440) - Persistent, stale-free, local and cross-machine caching for Python.. MIT
Show 1 hidden projects...
- cached-property (π₯30 Β· β 670 Β· π) - A decorator for caching properties in classes.
BSD-3
GUI Development
π best-of-web-python - Web UI ( β 1.9K) - Collection of libraries to implement web-based UIs.
kivy (π₯41 Β· β 16K) - Open source UI framework written in Python, running on Windows, Linux, macOS,.. MIT
PySimpleGUI (π₯37 Β· β 12K) - PySimpleGUI is a Python package that enables Python.. βοΈLGPL-3.0
-
GitHub (π¨βπ» 18 Β· π 1.7K Β· π¦ 8.5K Β· π 3.3K - 21% open Β· β±οΈ 29.05.2023):
git clone https://github.com/PySimpleGUI/PySimpleGUI
-
PyPi (π₯ 340K / month Β· π¦ 310 Β· β±οΈ 10.10.2022):
pip install pysimplegui
-
Conda (π₯ 110K Β· β±οΈ 25.05.2023):
conda install -c conda-forge pysimplegui
DearPyGui (π₯33 Β· β 10K) - Dear PyGui: A fast and powerful Graphical User Interface Toolkit for.. MIT
Eel (π₯31 Β· β 5.6K) - A little Python library for making simple Electron-like HTML/JS GUI apps. MIT
Show 3 hidden projects...
- Gooey (π₯29 Β· β 18K Β· π) - Turn (almost) any Python command line program into a full GUI..
MIT
- Phoenix (π₯27 Β· β 2K) - wxPythons Project Phoenix. A new implementation of wxPython,..
βοΈwxWindows
- enaml (π₯26 Β· β 1.5K) - Declarative User Interfaces for Python.
βUnlicensed
Computer & Machine Vision
π best-of-ml-python - Computer Vision ( β 14K) - Collection of computer vision and image processing..
Machine Learning & Data Engineering
π best-of-ml-python ( β 14K) - A ranked list of awesome machine learning Python libraries. Updated..
Text Data
π best-of-ml-python - NLP ( β 14K) - Collection of text processing and NLP libraries.
phonenumbers (π₯35 Β· β 3.2K) - Python port of Googles libphonenumber. Apache-2
-
GitHub (π¨βπ» 27 Β· π 410 Β· π 160 - 3% open Β· β±οΈ 30.05.2023):
git clone https://github.com/daviddrysdale/python-phonenumbers
-
PyPi (π₯ 4.7M / month Β· π¦ 1.4K Β· β±οΈ 29.01.2023):
pip install phonenumbers
-
Conda (π₯ 750K Β· β±οΈ 30.05.2023):
conda install -c conda-forge phonenumbers
chardet (π₯32 Β· β 1.9K) - Python character encoding detector. βοΈLGPL-2.1
-
GitHub (π¨βπ» 48 Β· π 240 Β· π 140 - 39% open Β· β±οΈ 02.12.2022):
git clone https://github.com/chardet/chardet
-
PyPi (π₯ 49M / month Β· π¦ 39K Β· β±οΈ 01.12.2022):
pip install chardet
-
Conda (π₯ 20M Β· β±οΈ 02.12.2022):
conda install -c conda-forge chardet
-
npm (π₯ 18 / month Β· π¦ 3 Β· β±οΈ 20.08.2017):
npm install @pypi/chardet
python-slugify (π₯30 Β· β 1.3K) - Returns unicode slugs. MIT
inflect (π₯30 Β· β 820) - Correctly generate plurals, ordinals, indefinite articles; convert numbers.. MIT
pyahocorasick (π₯28 Β· β 800) - Python module (C extension and plain python) implementing Aho-.. BSD-3
-
GitHub (π¨βπ» 29 Β· π 120 Β· π¦ 1.8K Β· π 130 - 18% open Β· β±οΈ 14.01.2023):
git clone https://github.com/WojciechMula/pyahocorasick
-
PyPi (π₯ 640K / month Β· π¦ 120 Β· β±οΈ 14.01.2023):
pip install pyahocorasick
-
Conda (π₯ 190K Β· β±οΈ 16.01.2023):
conda install -c conda-forge pyahocorasick
coolname (π₯22 Β· β 120) - Random Name and Slug Generator. BSD-2
-
GitHub (π¨βπ» 3 Β· π 11 Β· π¦ 1.5K Β· π 9 - 22% open Β· β±οΈ 09.01.2023):
git clone https://github.com/alexanderlukanin13/coolname
-
PyPi (π₯ 280K / month Β· π¦ 54 Β· β±οΈ 09.01.2023):
pip install coolname
-
Conda (π₯ 59K Β· β±οΈ 09.01.2023):
conda install -c conda-forge coolname
price-parser (π₯20 Β· β 270 Β· π€) - Extract price amount and currency symbol from a raw text.. BSD-3
Show 2 hidden projects...
- awesome-slugify (π₯22 Β· β 480 Β· π) - Python flexible slugify function.
βοΈGPL-3.0
- millify (π₯15 Β· β 76 Β· π) - Convert long numbers into a human-readable format in Python.
MIT
Web Development
π best-of-web-python ( β 1.9K) - A ranked list of awesome python libraries for web development. Updated..
Database Clients
Libraries for connecting to, operating, and querying databases.
SQLAlchemy (π₯46 Β· β 7.3K) - The Database Toolkit for Python. MIT
-
GitHub (π¨βπ» 630 Β· π 1.2K Β· π₯ 43K Β· π¦ 580K Β· π 7.3K - 2% open Β· β±οΈ 31.05.2023):
git clone https://github.com/sqlalchemy/sqlalchemy
-
PyPi (π₯ 72M / month Β· π¦ 47K Β· β±οΈ 26.01.2023):
pip install SQLAlchemy
-
Conda (π₯ 12M Β· β±οΈ 20.05.2023):
conda install -c conda-forge sqlalchemy
azure-storage-blob (π₯42 Β· β 3.7K) - This repository is for active development of the Azure SDK.. MIT
-
GitHub (π¨βπ» 590 Β· π 2.4K Β· π¦ 2.2K Β· π 8.2K - 11% open Β· β±οΈ 01.06.2023):
git clone https://github.com/Azure/azure-sdk-for-python
-
PyPi (π₯ 37M / month Β· π¦ 640 Β· β±οΈ 15.06.2022):
pip install azure-storage-blob
-
Conda (π₯ 940K Β· β±οΈ 18.04.2023):
conda install -c conda-forge azure-storage-blob
google-cloud-storage (π₯41 Β· β 4.2K) - Google Cloud Client Library for Python. Apache-2
-
GitHub (π¨βπ» 330 Β· π 1.5K Β· π 3.6K - 6% open Β· β±οΈ 31.05.2023):
git clone https://github.com/googleapis/google-cloud-python
-
PyPi (π₯ 41M / month Β· π¦ 1.9K Β· β±οΈ 07.12.2022):
pip install google-cloud-storage
-
Conda (π₯ 3.5M Β· β±οΈ 05.05.2023):
conda install -c conda-forge google-cloud-storage
elasticsearch (π₯40 Β· β 4K) - Official Python client for Elasticsearch. Apache-2
-
GitHub (π¨βπ» 190 Β· π 1.2K Β· π₯ 2.9K Β· π¦ 38K Β· π 1K - 4% open Β· β±οΈ 26.05.2023):
git clone https://github.com/elastic/elasticsearch-py
-
PyPi (π₯ 14M / month Β· π¦ 6.1K Β· β±οΈ 27.01.2023):
pip install elasticsearch
-
Conda (π₯ 840K Β· β±οΈ 28.05.2023):
conda install -c conda-forge elasticsearch
kafka-python (π₯39 Β· β 5.2K) - Python client for Apache Kafka. Apache-2
-
GitHub (π¨βπ» 210 Β· π 1.3K Β· π₯ 1.8K Β· π¦ 18K Β· π 1.5K - 19% open Β· β±οΈ 02.03.2023):
git clone https://github.com/dpkp/kafka-python
-
PyPi (π₯ 7.5M / month Β· π¦ 1.4K Β· β±οΈ 30.09.2020):
pip install kafka-python
-
Conda (π₯ 400K Β· β±οΈ 30.09.2020):
conda install -c conda-forge kafka-python
MongoEngine (π₯38 Β· β 4K Β· π) - A Python Object-Document-Mapper for working with MongoDB. MIT
-
GitHub (π¨βπ» 380 Β· π 1.2K Β· π¦ 20K Β· π 1.7K - 22% open Β· β±οΈ 18.04.2023):
git clone https://github.com/MongoEngine/mongoengine
-
PyPi (π₯ 990K / month Β· π¦ 3.6K Β· β±οΈ 20.01.2023):
pip install mongoengine
-
Conda (π₯ 210K Β· β±οΈ 21.01.2023):
conda install -c conda-forge mongoengine
AWS Data Wrangler (π₯37 Β· β 3.5K) - pandas on AWS - Easy integration with Athena, Glue,.. Apache-2
-
GitHub (π¨βπ» 130 Β· π 620 Β· π₯ 190K Β· π¦ 1.1K Β· π 930 - 2% open Β· β±οΈ 01.06.2023):
git clone https://github.com/awslabs/aws-data-wrangler
-
PyPi (π₯ 27M / month Β· π¦ 54 Β· β±οΈ 09.01.2023):
pip install awswrangler
-
Conda (π₯ 370K Β· β±οΈ 16.05.2023):
conda install -c conda-forge awswrangler
SQLAlchemy-Utils (π₯37 Β· β 1.1K) - Various utility functions and datatypes for SQLAlchemy. BSD-3
-
GitHub (π¨βπ» 120 Β· π 310 Β· π¦ 23K Β· π 420 - 43% open Β· β±οΈ 01.06.2023):
git clone https://github.com/kvesteri/sqlalchemy-utils
-
PyPi (π₯ 4.5M / month Β· π¦ 2.1K Β· β±οΈ 23.12.2022):
pip install sqlalchemy-utils
-
Conda (π₯ 460K Β· β±οΈ 27.04.2023):
conda install -c conda-forge sqlalchemy-utils
python-bigquery (π₯37 Β· β 610) - Google BigQuery API client library. Apache-2
-
GitHub (π¨βπ» 130 Β· π 240 Β· π¦ 20K Β· π 580 - 15% open Β· β±οΈ 01.06.2023):
git clone https://github.com/googleapis/python-bigquery
-
PyPi (π₯ 28M / month Β· π¦ 1.1K Β· β±οΈ 09.06.2022):
pip install google-cloud-bigquery
-
Conda (π₯ 2.6M Β· β±οΈ 20.04.2023):
conda install -c conda-forge google-cloud-bigquery
confluent-kafka-python (π₯36 Β· β 3.3K) - Confluents Kafka Python Client. Apache-2
-
GitHub (π¨βπ» 110 Β· π 830 Β· π¦ 6.2K Β· π 1.1K - 22% open Β· β±οΈ 03.05.2023):
git clone https://github.com/confluentinc/confluent-kafka-python
-
PyPi (π₯ 9M / month Β· π¦ 420 Β· β±οΈ 24.01.2023):
pip install confluent-kafka
-
Conda (π₯ 700K Β· β±οΈ 26.04.2023):
conda install -c conda-forge python-confluent-kafka
Ibis (π₯35 Β· β 2.8K) - The flexibility of Python with the scale and performance of modern SQL. Apache-2
-
GitHub (π¨βπ» 140 Β· π 400 Β· π₯ 76 Β· π¦ 510 Β· π 2.1K - 3% open Β· β±οΈ 01.06.2023):
git clone https://github.com/ibis-project/ibis
-
PyPi (π₯ 80K / month Β· π¦ 53 Β· β±οΈ 25.01.2023):
pip install ibis-framework
-
Conda (π₯ 290K Β· β±οΈ 11.04.2023):
conda install -c conda-forge ibis-framework
mysqlclient (π₯35 Β· β 2.3K) - MySQL database connector for Python (with Python 3 support). βοΈGPL-2.0
-
GitHub (π¨βπ» 78 Β· π 410 Β· π₯ 5.2K Β· π¦ 130K Β· π 310 - 2% open Β· β±οΈ 20.05.2023):
git clone https://github.com/PyMySQL/mysqlclient
-
PyPi (π₯ 4M / month Β· π¦ 7.2K Β· β±οΈ 22.06.2022):
pip install mysqlclient
-
Conda (π₯ 260K Β· β±οΈ 06.04.2023):
conda install -c conda-forge mysqlclient
Elasticsearch DSL (π₯34 Β· β 3.7K) - High level Python client for Elasticsearch. Apache-2
-
GitHub (π¨βπ» 130 Β· π 780 Β· π₯ 170 Β· π¦ 9.1K Β· π 1.3K - 11% open Β· β±οΈ 01.03.2023):
git clone https://github.com/elastic/elasticsearch-dsl-py
-
PyPi (π₯ 2.8M / month Β· π¦ 980 Β· β±οΈ 15.07.2021):
pip install elasticsearch-dsl
-
Conda (π₯ 7.4K Β· β±οΈ 16.03.2023):
conda install -c anaconda elasticsearch-dsl
tortoise-orm (π₯34 Β· β 3.6K) - Familiar asyncio ORM for python, built with relations in mind. Apache-2
-
GitHub (π¨βπ» 120 Β· π 310 Β· π₯ 10 Β· π¦ 5.6K Β· π 920 - 48% open Β· β±οΈ 16.05.2023):
git clone https://github.com/tortoise/tortoise-orm
-
PyPi (π₯ 83K / month Β· π¦ 98 Β· β±οΈ 30.01.2023):
pip install tortoise-orm
-
Conda (π₯ 13K Β· β±οΈ 03.02.2023):
conda install -c conda-forge tortoise-orm
Motor (π₯34 Β· β 2.2K) - Motor - the async Python driver for MongoDB and Tornado or asyncio. Apache-2
libcloud (π₯34 Β· β 1.9K) - Apache Libcloud is a Python library which hides differences between.. Apache-2
Cassandra Driver (π₯34 Β· β 1.3K) - DataStax Python Driver for Apache Cassandra. Apache-2
s3transfer (π₯34 Β· β 170) - Amazon S3 Transfer Manager for Python. Apache-2
neo4j-driver (π₯33 Β· β 800 Β· π) - Neo4j Bolt driver for Python. Apache-2
-
GitHub (π¨βπ» 41 Β· π 180 Β· π¦ 4.5K Β· π 230 - 2% open Β· β±οΈ 29.05.2023):
git clone https://github.com/neo4j/neo4j-python-driver
-
PyPi (π₯ 170K / month Β· π¦ 230 Β· β±οΈ 27.01.2023):
pip install neo4j-driver
-
Conda (π₯ 180K Β· β±οΈ 26.05.2023):
conda install -c conda-forge neo4j-python-driver
Prometheus Client (π₯32 Β· β 3.4K) - Prometheus instrumentation library for Python.. Apache-2
-
GitHub (π¨βπ» 130 Β· π 730 Β· π 480 - 16% open Β· β±οΈ 30.05.2023):
git clone https://github.com/prometheus/client_python
-
PyPi (π₯ 19M / month Β· π¦ 740 Β· β±οΈ 23.01.2023):
pip install prometheus_client
-
Conda (π₯ 11M Β· β±οΈ 24.05.2023):
conda install -c conda-forge prometheus_client
pandas-gbq (π₯32 Β· β 370) - Google BigQuery connector for pandas. BSD-3
-
GitHub (π¨βπ» 42 Β· π 120 Β· π₯ 290 Β· π¦ 7K Β· π 300 - 16% open Β· β±οΈ 25.05.2023):
git clone https://github.com/googleapis/python-bigquery-pandas
-
PyPi (π₯ 7M / month Β· π¦ 320 Β· β±οΈ 30.01.2023):
pip install pandas-gbq
-
Conda (π₯ 1.8M Β· β±οΈ 08.02.2023):
conda install -c conda-forge pandas-gbq
sqlmodel (π₯31 Β· β 10K) - SQL databases in Python, designed for simplicity, compatibility, and.. MIT
pydantic
influxdb (π₯31 Β· β 1.6K Β· π€) - Python client for InfluxDB. MIT
-
GitHub (π¨βπ» 140 Β· π 500 Β· π¦ 7.1K Β· π 520 - 27% open Β· β±οΈ 15.11.2022):
git clone https://github.com/influxdata/influxdb-python
-
PyPi (π₯ 1.7M / month Β· π¦ 1.3K Β· β±οΈ 11.11.2020):
pip install influxdb
-
Conda (π₯ 120K Β· β±οΈ 12.11.2020):
conda install -c conda-forge influxdb
dataset (π₯30 Β· β 4.5K) - Easy-to-use data handling for SQL data stores with support for implicit.. MIT
cx-Oracle (π₯30 Β· β 860 Β· π€) - Python interface to Oracle Database now superseded by python-.. BSD-3
-
GitHub (π¨βπ» 17 Β· π 350 Β· π¦ 7.4K Β· π 640 - 6% open Β· β±οΈ 08.06.2022):
git clone https://github.com/oracle/python-cx_Oracle
-
PyPi (π₯ 2.8M / month Β· π¦ 320 Β· β±οΈ 04.11.2021):
pip install cx-Oracle
-
Conda (π₯ 410K Β· β±οΈ 29.10.2022):
conda install -c conda-forge cx_oracle
py2neo (π₯29 Β· β 1.2K Β· π) - Py2neo is a comprehensive Neo4j driver library and toolkit for.. Apache-2
prisma (π₯28 Β· β 1.2K) - Prisma Client Python is an auto-generated and fully type-safe.. Apache-2
piccolos (π₯28 Β· β 1K) - A fast, user friendly ORM and query builder which supports asyncio. MIT
HappyBase (π₯27 Β· β 600 Β· π€) - A developer-friendly Python library to interact with Apache HBase. MIT
-
GitHub (π¨βπ» 19 Β· π 160 Β· π¦ 760 Β· π 220 - 14% open Β· β±οΈ 12.07.2022):
git clone https://github.com/python-happybase/happybase
-
PyPi (π₯ 170K / month Β· π¦ 230 Β· β±οΈ 14.05.2019):
pip install happybase
-
Conda (π₯ 140K Β· β±οΈ 01.07.2019):
conda install -c conda-forge happybase
ODMantic (π₯22 Β· β 800) - Sync and Async ODM (Object Document Mapper) for MongoDB based on python.. ISC
aioprometheus (π₯18 Β· β 150) - A Prometheus Python client library for asyncio-based applications. MIT
psycopg3 (π₯17 Β· β 1K) - New generation PostgreSQL database adapter for the Python.. βοΈLGPL-3.0
-
GitHub (π¨βπ» 37 Β· π 100 Β· π 320 - 13% open Β· β±οΈ 22.05.2023):
git clone https://github.com/psycopg/psycopg
Show 16 hidden projects...
- psycopg2 (π₯39 Β· β 2.9K) - PostgreSQL database adapter for the Python..
βοΈBSD-3-Clause-Attribution
- pyodbc (π₯34 Β· β 2.7K) - Python ODBC bridge.
βοΈMIT-0
- PyPika (π₯32 Β· β 2K Β· π) - PyPika is a python SQL query builder that exposes the full richness..
Apache-2
- google-cloud-bigtable (π₯31 Β· β 51) - Google Cloud Bigtable API client library.
Apache-2
- redis-py-cluster (π₯29 Β· β 1.1K Β· π) - Python cluster client for the official redis cluster...
MIT
- gino (π₯28 Β· β 2.6K Β· π) - GINO Is Not ORM - a Python asyncio ORM on SQLAlchemy core.
BSD-3
- mongo-connector (π₯27 Β· β 1.9K Β· π) - MongoDB data stream pipeline tools by YouGov (adopted..
Apache-2
- cloudant (π₯27 Β· β 160 Β· π) - A Python library for Cloudant and CouchDB.
Apache-2
- pyhdb (π₯25 Β· β 300 Β· π) - SAP HANA Connector in pure Python.
Apache-2
- PyMODM (π₯23 Β· β 350 Β· π) - A Pythonic, object-oriented interface for working with MongoDB.
Apache-2
- db.py (π₯21 Β· β 1.2K Β· π) - db.py is an easier way to interact with your databases.
BSD-2
- PugSQL (π₯20 Β· β 610 Β· π) - A HugSQL-inspired database library for Python.
Apache-2
- gsheets-db-api (π₯20 Β· β 190 Β· π) - A Python DB-API and SQLAlchemy dialect to Google Spreasheets.
MIT
- Queries (π₯19 Β· β 260 Β· π) - PostgreSQL database access simplified.
BSD-3
- SuperSQLite (π₯15 Β· β 710 Β· π) - A supercharged SQLite library for Python.
MIT
- lazydata (π₯14 Β· β 630 Β· π) - Lazydata: Scalable data dependencies for Python projects.
Apache-2
Data Loading & Extraction
Libraries for loading, collecting, and extracting data from a variety of data sources and formats.
Datasets (π₯43 Β· β 16K) - The largest hub of ready-to-use datasets for ML models with fast,.. Apache-2
-
GitHub (π¨βπ» 510 Β· π 2.2K Β· π¦ 17K Β· π 2.3K - 26% open Β· β±οΈ 01.06.2023):
git clone https://github.com/huggingface/datasets
-
PyPi (π₯ 3.4M / month Β· π¦ 480 Β· β±οΈ 26.01.2023):
pip install datasets
-
Conda (π₯ 300K Β· β±οΈ 28.04.2023):
conda install -c conda-forge datasets
xlwings (π₯37 Β· β 2.6K) - xlwings is a Python library that makes it easy to call Python from.. BSD-3
-
GitHub (π¨βπ» 61 Β· π 470 Β· π₯ 21K Β· π¦ 28K Β· π 1.7K - 15% open Β· β±οΈ 30.05.2023):
git clone https://github.com/xlwings/xlwings
-
PyPi (π₯ 93K / month Β· π¦ 640 Β· β±οΈ 29.01.2023):
pip install xlwings
-
Conda (π₯ 610K Β· β±οΈ 30.05.2023):
conda install -c conda-forge xlwings
python-magic (π₯33 Β· β 2.3K) - A python wrapper for libmagic. MIT
-
GitHub (π¨βπ» 58 Β· π 260 Β· π¦ 43K Β· π 190 - 18% open Β· β±οΈ 30.03.2023):
git clone https://github.com/ahupp/python-magic
-
PyPi (π₯ 5.5M / month Β· π¦ 3.3K Β· β±οΈ 07.06.2022):
pip install python-magic
-
Conda (π₯ 210K Β· β±οΈ 03.11.2022):
conda install -c conda-forge python-magic
csvkit (π₯32 Β· β 5.5K) - A suite of utilities for converting to and working with CSV, the king of.. MIT
xmltodict (π₯32 Β· β 5.1K) - Python module that makes working with XML feel like you are working.. MIT
-
GitHub (π¨βπ» 49 Β· π 460 Β· π¦ 54K Β· π 240 - 33% open Β· β±οΈ 12.03.2023):
git clone https://github.com/martinblech/xmltodict
-
PyPi (π₯ 24M / month Β· π¦ 5.5K Β· β±οΈ 08.05.2022):
pip install xmltodict
-
Conda (π₯ 2.8M Β· β±οΈ 08.05.2022):
conda install -c conda-forge xmltodict
gdown (π₯32 Β· β 3.1K) - Download a large file from Google Drive (curl/wget fails because of the.. MIT
Intake (π₯32 Β· β 900) - Intake is a lightweight package for finding, investigating, loading and.. BSD-2
smart-open (π₯31 Β· β 2.9K) - Utils for streaming large files (S3, HDFS, gzip, bz2...). MIT
-
GitHub (π¨βπ» 100 Β· π 350 Β· π 390 - 20% open Β· β±οΈ 19.01.2023):
git clone https://github.com/RaRe-Technologies/smart_open
-
PyPi (π₯ 13M / month Β· π¦ 610 Β· β±οΈ 12.12.2022):
pip install smart-open
-
Conda (π₯ 1.8M Β· β±οΈ 08.01.2023):
conda install -c conda-forge smart_open
snorkel (π₯30 Β· β 5.5K) - A system for quickly generating training data with weak supervision. Apache-2
-
GitHub (π¨βπ» 78 Β· π 850 Β· π₯ 1K Β· π¦ 310 Β· π 980 - 2% open Β· β±οΈ 17.02.2023):
git clone https://github.com/snorkel-team/snorkel
-
PyPi (π₯ 43K / month Β· π¦ 13 Β· β±οΈ 29.07.2022):
pip install snorkel
-
Conda (π₯ 42K Β· β±οΈ 29.07.2022):
conda install -c conda-forge snorkel
img2dataset (π₯27 Β· β 2.3K) - Easily turn large sets of image urls to an image dataset. Can.. MIT
rows (π₯23 Β· β 840) - A common, beautiful interface to tabular data, no matter the format. βοΈLGPL-3.0
Upgini (π₯19 Β· β 220) - Data search & enrichment library for Machine Learning Easily find and add.. BSD-3
Squirrel (π₯15 Β· β 260) - A Python library that enables ML teams to share, load, and transform.. Apache-2
-
GitHub (π¨βπ» 14 Β· π 6 Β· π¦ 2 Β· π 9 - 77% open Β· β±οΈ 26.05.2023):
git clone https://github.com/merantix-momentum/squirrel-core
-
PyPi (π₯ 1K / month Β· π¦ 1 Β· β±οΈ 31.01.2023):
pip install squirrel-core
-
Conda (π¦ 1 Β· β±οΈ 18.11.2022):
conda install -c anaconda squirrel-core
Show 14 hidden projects...
- SDV (π₯33 Β· β 1.5K) - Synthetic data generation for tabular data.
βοΈSSPL-1.0
- xlrd (π₯32 Β· β 2.1K Β· π) - Please use openpyxl where you can...
BSD-3
- PDFMiner (π₯29 Β· β 5K Β· π) - Python PDF Parser (Not actively maintained). Check out pdfminer.six.
MIT
- pandas-datareader (π₯28 Β· β 2.7K Β· π) - Extract data from a wide range of Internet sources..
BSD-3
- textract (π₯27 Β· β 3.5K Β· π) - extract text from any document. no muss. no fuss.
MIT
- tabulator-py (π₯27 Β· β 240 Β· π) - Python library for reading and writing tabular data via streams.
MIT
- Singer (π₯25 Β· β 1.1K Β· π) - Standard for moving data between databases, web APIs, files,..
βοΈAGPL-3.0
- messytables (π₯25 Β· β 380 Β· π) - Tools for parsing messy tabular data. This is now superseded by..
MIT
- pyexcel-xlsx (π₯24 Β· β 110 Β· π) - A wrapper library to read, manipulate and write data in xlsx..
BSD-3
- deepdish (π₯22 Β· β 260 Β· π) - Flexible HDF5 saving/loading and other data science tools from the..
BSD-3
- datatest (π₯21 Β· β 280 Β· π) - Tools for test driven data-wrangling and data validation.
Apache-2
- borb (π₯20 Β· β 3K) - borb is a library for reading, creating and manipulating PDF files in..
βUnlicensed
- excalibur (π₯19 Β· β 1.3K Β· π) - A web interface to extract tabular data from PDFs.
MIT
- csvs-to-sqlite (π₯17 Β· β 760 Β· π) - Convert CSV files into a SQLite database.
Apache-2
Data Pipelines & Streaming
Libraries for data batch- and stream-processing, workflow automation, job scheduling, and other data pipeline tasks.
Airflow (π₯47 Β· β 31K) - Platform to programmatically author, schedule, and monitor workflows. Apache-2
-
GitHub (π¨βπ» 2.9K Β· π 12K Β· π₯ 480K Β· π¦ 7K Β· π 7.5K - 11% open Β· β±οΈ 01.06.2023):
git clone https://github.com/apache/airflow
-
PyPi (π₯ 5.6M / month Β· π¦ 280 Β· β±οΈ 30.04.2023):
pip install apache-airflow
-
Conda (π₯ 890K Β· β±οΈ 17.05.2023):
conda install -c conda-forge airflow
-
Docker Hub (π₯ 120M Β· β 450 Β· β±οΈ 16.05.2023):
docker pull apache/airflow
Celery (π₯45 Β· β 22K) - Asynchronous task queue/job queue based on distributed message passing. BSD-3
Prefect (π₯42 Β· β 12K) - The easiest way to orchestrate and observe your data pipelines. Apache-2
Beam (π₯42 Β· β 6.9K) - Unified programming model to define and execute data processing.. Apache-2
-
GitHub (π¨βπ» 1.5K Β· π 4K Β· π¦ 2 Β· π 5.9K - 72% open Β· β±οΈ 01.06.2023):
git clone https://github.com/apache/beam
-
PyPi (π₯ 6.4M / month Β· π¦ 190 Β· β±οΈ 13.01.2023):
pip install apache-beam
-
Conda (π₯ 44K Β· β±οΈ 11.05.2023):
conda install -c conda-forge apache-beam-with-aws
Dagster (π₯40 Β· β 7.5K) - An orchestration platform for the development, production, and.. Apache-2
Great Expectations (π₯39 Β· β 8.4K) - Always know what to expect from your data. Apache-2
-
GitHub (π¨βπ» 390 Β· π 1.3K Β· π 1.7K - 10% open Β· β±οΈ 01.06.2023):
git clone https://github.com/great-expectations/great_expectations
-
PyPi (π₯ 10M / month Β· π¦ 31 Β· β±οΈ 04.11.2022):
pip install great_expectations
-
Conda (π₯ 650K Β· β±οΈ 26.05.2023):
conda install -c conda-forge great-expectations
luigi (π₯37 Β· β 17K) - Luigi is a Python module that helps you build complex pipelines of batch.. Apache-2
dbt (π₯37 Β· β 7K) - dbt enables data analysts and engineers to transform their data using the.. Apache-2
-
GitHub (π¨βπ» 280 Β· π 1.3K Β· π₯ 1.7K Β· π¦ 2.7K Β· π 4.1K - 11% open Β· β±οΈ 01.06.2023):
git clone https://github.com/dbt-labs/dbt-core
-
PyPi (π₯ 410K / month Β· π¦ 30 Β· β±οΈ 06.12.2021):
pip install dbt
-
Conda (π₯ 240K Β· β±οΈ 09.12.2021):
conda install -c conda-forge dbt
Kedro (π₯36 Β· β 8.4K) - A Python framework for creating reproducible, maintainable and modular.. Apache-2
Activeloop (π₯32 Β· β 6K) - Database for AI. Store Vectors, Images, Texts, Videos, etc. Use.. MPL-2.0
ploomber (π₯29 Β· β 3.1K) - The fastest way to build data pipelines. Develop iteratively,.. Apache-2
whylogs (π₯29 Β· β 2.2K) - Open standard for end-to-end data and ML monitoring for any scale in.. Apache-2
PyFunctional (π₯26 Β· β 2.2K) - Python library for creating data pipelines with chain functional.. MIT
dbnd (π₯26 Β· β 240) - DBND is an agile pipeline framework that helps data engineering teams.. Apache-2
streamparse (π₯25 Β· β 1.5K Β· π€) - Run Python in Apache Storm topologies. Pythonic API, CLI.. Apache-2
Optimus (π₯25 Β· β 1.4K) - Agile Data Preparation Workflows madeeasy with Pandas, Dask,.. Apache-2
spark
pysparkling (π₯22 Β· β 260 Β· π€) - A pure Python implementation of Apache Sparks RDD and DStream.. MIT
-
GitHub (π¨βπ» 10 Β· π 48 Β· π¦ 170 Β· π 30 - 30% open Β· β±οΈ 13.11.2022):
git clone https://github.com/svenkreiss/pysparkling
-
PyPi (π₯ 11K / month Β· π¦ 8 Β· β±οΈ 13.11.2022):
pip install pysparkling
-
Conda (π₯ 4.2K Β· β±οΈ 23.03.2021):
conda install -c conda-forge pysparkling
BatchFlow (π₯22 Β· β 190) - BatchFlow helps you conveniently work with random or sequential.. Apache-2
Mara Pipelines (π₯18 Β· β 2K) - A lightweight opinionated ETL framework, halfway between plain.. MIT
Databolt Flow (π₯17 Β· β 950 Β· π€) - Python library for building highly effective data science.. MIT
bodywork-core (π₯16 Β· β 420 Β· π€) - ML pipeline orchestration and model deployments on.. βοΈAGPL-3.0
RasgoQL (π₯13 Β· β 260 Β· π€) - Write python locally, execute SQL in your data warehouse. βοΈAGPL-3.0
datajob (π₯12 Β· β 100 Β· π€) - Build and deploy a serverless data pipeline on AWS with no effort. Apache-2
Show 8 hidden projects...
- mrjob (π₯31 Β· β 2.6K Β· π) - Run MapReduce jobs on Hadoop or Amazon Web Services.
Apache-2
- bonobo (π₯25 Β· β 1.5K Β· π) - Extract Transform Load for Python 3.5+.
Apache-2
- dpark (π₯21 Β· β 2.7K Β· π) - Python clone of Spark, a MapReduce alike framework in Python.
BSD-3
spark
- mrq (π₯21 Β· β 870 Β· π) - Mr. Queue - A distributed worker task queue in Python using Redis & gevent.
MIT
- spark-deep-learning (π₯19 Β· β 2K Β· π) - Deep Learning Pipelines for Apache Spark.
Apache-2
spark
- riko (π₯18 Β· β 1.6K Β· π) - A Python stream processing engine modeled after Yahoo! Pipes.
MIT
- kale (π₯16 Β· β 600 Β· π) - Kubeflows superfood for Data Scientists.
Apache-2
jupyter
- Botflow (π₯14 Β· β 1.2K Β· π) - Python Fast Dataflow programming framework for Data pipeline work(..
BSD-3
File Formats
XlsxWriter (π₯37 Β· β 3.3K) - A Python module for creating Excel XLSX files. BSD-2
-
GitHub (π¨βπ» 47 Β· π 600 Β· π¦ 61K Β· π 880 - 2% open Β· β±οΈ 29.05.2023):
git clone https://github.com/jmcnamara/XlsxWriter
-
PyPi (π₯ 11M / month Β· π¦ 3.9K Β· β±οΈ 14.01.2023):
pip install xlsxwriter
-
Conda (π₯ 2.7M Β· β±οΈ 28.05.2023):
conda install -c conda-forge xlsxwriter
Code Inspection
deepdiff (π₯35 Β· β 1.7K) - DeepDiff: Deep Difference and search of any Python object/data... MIT
typing_inspect (π₯26 Β· β 300) - Runtime inspection utilities for Python typing module. MIT
-
GitHub (π¨βπ» 17 Β· π 28 Β· π 55 - 36% open Β· β±οΈ 24.05.2023):
git clone https://github.com/ilevkivskyi/typing_inspect
-
PyPi (π₯ 19M / month Β· π¦ 310 Β· β±οΈ 17.08.2022):
pip install typing_inspect
-
Conda (π₯ 1.5M Β· β±οΈ 19.01.2023):
conda install -c conda-forge typing_inspect
Show 2 hidden projects...
- importlib-resources (π₯31 Β· β 46) - Backport of the importlib.resources module.
MIT
- entrypoints (π₯24 Β· β 71 Β· π) - Discover and load entry points from installed packages.
MIT
General Utilities
more-itertools (π₯40 Β· β 3.1K) - More routines for operating on iterables, beyond itertools. MIT
-
GitHub (π¨βπ» 100 Β· π 240 Β· π₯ 2.7K Β· π¦ 180K Β· π 270 - 10% open Β· β±οΈ 21.05.2023):
git clone https://github.com/more-itertools/more-itertools
-
PyPi (π₯ 35M / month Β· π¦ 8.7K Β· β±οΈ 18.10.2022):
pip install more-itertools
-
Conda (π₯ 11M Β· β±οΈ 27.02.2023):
conda install -c conda-forge more-itertools
boltons (π₯35 Β· β 6.2K) - Like builtins, but boltons. 250+ constructs, recipes, and snippets.. BSD-3
-
GitHub (π¨βπ» 85 Β· π 340 Β· π₯ 23 Β· π¦ 4.4K Β· π 160 - 37% open Β· β±οΈ 06.05.2023):
git clone https://github.com/mahmoud/boltons
-
PyPi (π₯ 4.1M / month Β· π¦ 430 Β· β±οΈ 17.05.2021):
pip install boltons
-
Conda (π₯ 2M Β· β±οΈ 27.02.2023):
conda install -c conda-forge boltons
python-dependency-injector (π₯32 Β· β 2.9K) - Dependency injection framework for Python. BSD-3
-
GitHub (π¨βπ» 29 Β· π 220 Β· π¦ 2.1K Β· π 500 - 29% open Β· β±οΈ 19.12.2022):
git clone https://github.com/ets-labs/python-dependency-injector
-
PyPi (π₯ 1M / month Β· π¦ 93 Β· β±οΈ 19.12.2022):
pip install dependency-injector
-
Conda (π₯ 25K Β· β±οΈ 19.12.2022):
conda install -c conda-forge dependency_injector
returns (π₯31 Β· β 2.8K) - Make your functions return something meaningful, typed, and safe!. BSD-2
ubelt (π₯26 Β· β 680) - A Python utility library with a stdlib like feel and extra batteries... Apache-2
Show 5 hidden projects...
- retrying (π₯27 Β· β 1.9K Β· π) - Retrying is an Apache 2.0 licensed general-purpose retrying..
Apache-2
- ratelimit (π₯24 Β· β 620 Β· π) - API Rate Limit Decorator.
MIT
- CommonRegex (π₯23 Β· β 1.5K Β· π) - A collection of common regular expressions bundled with an easy..
MIT
- pampy (π₯22 Β· β 3.5K Β· π) - Pampy: The Pattern Matching for Python you always dreamed of.
MIT
- pinject (π₯22 Β· β 1.3K Β· π) - A pythonic dependency injection library.
Apache-2
Python Implementations
cpython (π₯42 Β· β 54K) - The Python programming language. MIT
-
GitHub (π¨βπ» 2.5K Β· π 27K Β· π 65K - 12% open Β· β±οΈ 01.06.2023):
git clone https://github.com/python/cpython
-
PyPi (π₯ 69K / month Β· π¦ 5 Β· β±οΈ 22.07.2020):
pip install cpython
-
Conda (π₯ 2.7M Β· β±οΈ 01.05.2021):
conda install -c conda-forge typing
-
npm (π¦ 3 Β· β±οΈ 03.08.2017):
npm install @buckpkg/python
micropython (π₯35 Β· β 17K) - MicroPython - a lean and efficient Python implementation for.. Python-2.0
pyston (π₯22 Β· β 2.4K) - A faster and highly-compatible implementation of the Python.. Apache-2
-
GitHub (π¨βπ» 1K Β· π 85 Β· π₯ 19K Β· π 99 - 44% open Β· β±οΈ 28.02.2023):
git clone https://github.com/pyston/pyston
Show 3 hidden projects...
- grumpy (π₯21 Β· β 11K Β· π) - Grumpy is a Python to Go source code transcompiler and runtime.
Apache-2
- stackless (π₯18 Β· β 930 Β· π) - The Stackless Python programming language.
βUnlicensed
- cl-python (π₯11 Β· β 350 Β· π) - An implementation of Python in Common Lisp.
βUnlicensed
Others
pyparsing (π₯39 Β· β 1.8K) - Python library for creating PEG parsers. MIT
-
GitHub (π¨βπ» 55 Β· π 260 Β· π₯ 7.9K Β· π¦ 790K Β· π 300 - 9% open Β· β±οΈ 20.05.2023):
git clone https://github.com/pyparsing/pyparsing
-
PyPi (π₯ 72M / month Β· π¦ 32K Β· β±οΈ 10.05.2022):
pip install pyparsing
-
Conda (π₯ 36M Β· β±οΈ 14.07.2022):
conda install -c conda-forge pyparsing
cookiecutter (π₯38 Β· β 20K Β· π€) - A cross-platform command-line utility that creates projects.. BSD-3
-
GitHub (π¨βπ» 290 Β· π 1.8K Β· π¦ 20K Β· π 840 - 32% open Β· β±οΈ 09.09.2022):
git clone https://github.com/cookiecutter/cookiecutter
-
PyPi (π₯ 2.1M / month Β· π¦ 1.6K Β· β±οΈ 01.06.2022):
pip install cookiecutter
-
Conda (π₯ 700K Β· β±οΈ 01.06.2022):
conda install -c conda-forge cookiecutter
py4j (π₯34 Β· β 1.1K) - Py4J enables Python programs to dynamically access arbitrary Java objects. BSD-3
pyscaffold (π₯31 Β· β 1.8K) - Python project template generator with batteries included. MIT
Copier (π₯29 Β· β 1.1K) - Library and command-line utility for rendering projects templates. MIT
python-mss (π₯28 Β· β 840) - An ultra fast cross-platform multiple screenshots module in pure.. MIT
Send2Trash (π₯28 Β· β 230) - Python library to natively send files to Trash (or Recycle bin) on.. BSD-3
powerline-shell (π₯27 Β· β 6.1K Β· π€) - A beautiful and useful prompt for your shell. MIT
pyscreenshot (π₯26 Β· β 470) - Python screenshot library, replacement for the Pillow ImageGrab.. BSD-2
Show 3 hidden projects...
Related Resources
- Best-of lists: Discover other best-of lists with awesome open-source projects on all kinds of topics.
- best-of-ml-python: A ranked list of awesome machine learning Python libraries.
- best-of-web-python: A ranked list of awesome Python libraries for web development.
- best-of-python-dev: A ranked list of awesome Python developer tools and libraries.
- awesome-python: A curated list of awesome Python frameworks, libraries, software and resources.
Contribution
Contributions are encouraged and always welcome! If you like to add or update projects, choose one of the following ways:
- Open an issue by selecting one of the provided categories from the issue page and fill in the requested information.
- Modify the projects.yaml with your additions or changes, and submit a pull request. This can also be done directly via the Github UI.
If you like to contribute to or share suggestions regarding the project metadata collection or markdown generation, please refer to the best-of-generator repository. If you like to create your own best-of list, we recommend to follow this guide.
For more information on how to add or update projects, please read the contribution guidelines. By participating in this project, you agree to abide by its Code of Conduct.