LAB | Data Cleaning and Formatting

Learning Goals

This lab allows you to practice and apply the concepts and techniques taught in class.

Upon completion of this lab, you will be able to:

Apply Python programming to perform data cleaning and formatting, including identifying and handling with missing values, duplicates, outliers, errors
Use various formatting techniques such as changing data types, renaming columns, and handling string values, to prepare data for analysis.

Prerequisites

Before this starting this lab, you should have learnt about:

Python Programming
Introduction to Pandas DataFrames and Series
Data Cleaning: handling null values and duplicates
Data Formatting: dealing with strings, dates, renaming columns, using map, apply and mapapply methods

Introduction

Welcome to our data cleaning and formatting lab! In this lab, we will focus on the essential skills required to clean and format data to ensure it is accurate, consistent, and usable.

Data cleaning is a critical step in the data analysis process. It involves identifying and resolving errors, inconsistencies, and missing values in datasets, which may arise from different data sources. Data formatting, on the other hand, involves transforming raw data into a proper format that can be easily analyzed.

By the end of this lab, you will have gained the knowledge and skills to confidently clean and format your data, enabling you to perform effective data analysis and produce high-quality reports.

Happy coding! ❤️

Requirements

Fork this repo
Clone it to your machine

Getting Started

Complete the challenges in the Jupyter Notebook file. Follow the instructions and add your code and explanations as necessary.

Submission

Upon completion, run the following commands:

git add .
git commit -m "Solved lab"
git push origin master

Paste the link of your lab in Student Portal.

FAQs

I am stuck in the exercise and don't know how to solve the problem or where to start.

If you are stuck in your code and don't know how to solve the problem or where to start, you should take a step back and try to form a clear question about the specific issue you are facing. This will help you narrow down the problem and come up with potential solutions.

For example, is it a concept that you don't understand, or are you receiving an error message that you don't know how to fix? It is usually helpful to try to state the problem as clearly as possible, including any error messages you are receiving. This can help you communicate the issue to others and potentially get help from classmates or online resources.

Once you have a clear understanding of the problem, you will be able to start working toward the solution.

I am unable to push changes to the repository. What should I do?

There are a couple of possible reasons why you may be unable to push changes to a Git repository:

You have not committed your changes: Before you can push your changes to the repository, you need to commit them using the git commit command. Make sure you have committed your changes and try pushing again. To do this, run the following terminal commands from the project folder:

git add .
git commit -m "Your commit message"
git push

You do not have permission to push to the repository: If you have cloned the repository directly from the main Ironhack repository without making a Fork first, you do not have write access to the repository. To check which remote repository you have cloned, run the following terminal command from the project folder:

git remote -v

If the link shown is the same as the main Ironhack repository, you will need to fork the repository to your GitHub account first and then clone your fork to your local machine to be able to push the changes.

Note: You should make a copy of your local code to avoid losing it in the process.

ManelAitAmer/lab-dw-data-cleaning-and-formatting