/10_Python_Pandas_Module

Pandas is a high-level data manipulation tool developed by Wes McKinney. It is built on the Numpy package and its key data structure is called the DataFrame. DataFrames allow you to store and manipulate tabular data in rows of observations and columns of variables.

Primary LanguageJupyter NotebookMIT LicenseMIT

Last Commit Last Commit Stars Badge Forks Badge Size Pull Requests Badge Issues Badge Language MIT License

binder colab

10_Python_Pandas_Module

Introduction 👋

What is Pandas in Python?

Pandas is the most famous python library providing fast, flexible, and expressive data structures designed to make working with "relational" or "labeled" data both easy and intuitive. It aims to be the fundamental high-level building block for doing practical, real world data analysis in Python. Additionally, it has the broader goal of becoming the most powerful and flexible open source data analysis / manipulation tool available in any language. It is already well on its way towards this goal.

In Pandas, the data is usually utilized to support the statistical analysis in SciPy, plotting functions from Matplotlib, and machine learning algorithms in Scikit-learn.

Main Features

Here are just a few of the things that pandas does well:

  • Easy handling of missing data (represented as NaN) in floating point as well as non-floating point data
  • Size mutability: columns can be inserted and deleted from DataFrame and higher dimensional objects
  • Automatic and explicit data alignment: objects can be explicitly aligned to a set of labels, or the user can simply ignore the labels and let Series, DataFrame, etc. automatically align the data for you in computations
  • Powerful, flexible group by functionality to perform split-apply-combine operations on data sets, for both aggregating and transforming data
  • Make it easy to convert ragged, differently-indexed data in other Python and NumPy data structures into DataFrame objects
  • Intelligent label-based slicing, fancy indexing, and subsetting of large data sets
  • Intuitive merging and joining datasets
  • Flexible reshaping and pivoting of datasets
  • Hierarchical labeling of axes (possible to have multiple labels per tick)
  • Robust IO tools for loading data from flat files (CSV and delimited), Excel files, databases, and saving/loading data from the ultrafast HDF5 format
  • Time series-specific functionality: date range generation and frequency conversion, moving window statistics, moving window linear regressions, date shifting and lagging, etc.

Core Components of Pandas Data Structure

Pandas have two core data structure components, and all operations are based on those two objects. Organizing data in a particular way is known as a data structure. Here are the two pandas data structures:

  • Series
  • DataFrame

Table of contents 📋

No. Name
01 Python_Pandas_DataFrame
1.1 001_Python_Pandas_DataFrame_from_Dictionary
1.2 Python_Pandas_DataFrame_from_List
1.3 Python_Pandas_DataFrame_head()_and_tail()
1.4 004_Python_Pandas_DataFrame_drop_columns
1.5 Python_Pandas_DataFrame_drop_duplicates
1.6 Python_Pandas_DataFrame_drop_columns_with_NA
1.7 Python_Pandas_DataFrame_rename_columns
1.8 Python_Pandas_DataFrame_to_Python_dictionary
1.9 Python_Pandas_DataFrame_set_index
1.10 Python_Pandas_DataFrame_reset_index
02 Python_Pandas_Exercise_1
03 Python_Pandas_Exercise_2
automobile_data.csv
pokemon_data.csv
04 Pandas Cheat Sheet Data Wrangling in Python.pdf
05 Pandas Cheat Sheet for Data Science in Python.pdf

These are online read-only versions. However you can Run ▶ all the codes online by clicking here ➞ binder


Install Pandas Module:

Open your Anaconda Prompt propmt and type and run the following command (individually):

  •   pip install pandas  
    

Once Installed now we can import it inside our python code.


Frequently asked questions ❔

How can I thank you for writing and sharing this tutorial? 🌷

You can Star Badge and Fork Badge Starring and Forking is free for you, but it tells me and other people that it was helpful and you like this tutorial.

Go here if you aren't here already and click ➞ ✰ Star and ⵖ Fork button in the top right corner. You will be asked to create a GitHub account if you don't already have one.


How can I read this tutorial without an Internet connection? GIF

  1. Go here and click the big green ➞ Code button in the top right of the page, then click ➞ Download ZIP.

    Download ZIP

  2. Extract the ZIP and open it. Unfortunately I don't have any more specific instructions because how exactly this is done depends on which operating system you run.

  3. Launch ipython notebook from the folder which contains the notebooks. Open each one of them

    Kernel > Restart & Clear Output

This will clear all the outputs and now you can understand each statement and learn interactively.

If you have git and you know how to use it, you can also clone the repository instead of downloading a zip and extracting it. An advantage with doing it this way is that you don't need to download the whole tutorial again to get the latest version of it, all you need to do is to pull with git and run ipython notebook again.


Authors ✍️

I'm Dr. Milaan Parmar and I have written this tutorial. If you think you can add/correct/edit and enhance this tutorial you are most welcome🙏

See github's contributors page for details.

If you have trouble with this tutorial please tell me about it by Create an issue on GitHub. and I'll make this tutorial better. This is probably the best choice if you had trouble following the tutorial, and something in it should be explained better. You will be asked to create a GitHub account if you don't already have one.

If you like this tutorial, please give it a ⭐ star.


Licence 📜

You may use this tutorial freely at your own risk. See LICENSE.