/feature-selection-in-machine-learning-book

Code repository for the book feature selection in machine learning

Primary LanguageJupyter NotebookOtherNOASSERTION

PythonVersion License https://github.com/solegalli/feature-selection-in-machine-learning/blob/main/LICENSE Sponsorship https://www.trainindata.com/

Feature Selection in Machine Learning Book - Code Repository

Published August, 2022

Links

Table of Contents

  1. Basic Selection Methods

    1. Removing Constant Features
    2. Removing Quasi-Constant Features
    3. Removing Duplicated Features

  2. Correlation Feature Selection

    1. Removing Correlated Features
    2. Smart Correlation

  3. Filter Methods: Univariate Statistical Methods

    1. Chi-square distribution
    2. Anova
    3. Correlation
    4. Mutual information

  4. Univariate Methods

    1. Single feature classifier
    2. Target mean encoding

  5. Wrapper Methods

    1. Exhaustive Feature Selection
    2. Step Forward Feature Selection
    3. Step Backward Feature Selection

  6. Embedded Methods: Linear Model Coefficients

    1. Lasso
    2. Decision tree feature importance
    3. Recursive feature elimination based on importance

  7. Hybrid Feature Selection Methods

    1. Feature Shuffling
    2. Recursive Feature Elimination
    3. Recursive Feature Addition