dianaclarke/ibis

A pandas-like deferred expression system, with first-class SQL support

Ibis: Python data analysis framework for Hadoop and SQL engines

Service	Status
Documentation
Conda packages
PyPI
GitHub Actions
Coverage

Ibis is a toolbox to bridge the gap between local Python environments, remote storage, execution systems like Hadoop components (HDFS, Impala, Hive, Spark) and SQL databases. Its goal is to simplify analytical workflows and make you more productive.

Install Ibis from PyPI with:

pip install ibis-framework

or from conda-forge with

conda install ibis-framework -c conda-forge

Ibis currently provides tools for interacting with the following systems:

• Apache Impala
• Apache Kudu
• Hadoop Distributed File System (HDFS)
• PostgreSQL
• MySQL
• SQLite
• Pandas DataFrames
• Clickhouse
• BigQuery
• OmniSciDB
• PySpark
• Dask (Experimental)

Learn more about using the library at http://ibis-project.org.