AM-I-Human/AM-I-Awesome

AM-I-Awesome

A collection of usefull stuf to remember.

Python

AI

• nltk
• cleantext
• spacy
• nlp
• evidently - monitor production models
• Metrics - Collection of common metrics
• A complete list=https://pythonawesome.com/a-ranked-list-of-awesome-machine-learning-python-libraries/

Deep Learning

• tensorflow
• tensorflow-io
• keras
• pytorch
  • Pytorch lightning
• huggingface

Model Size Reduction

• DeepSpeed

Recommender System

• annoy - Approximate Nearest Neighbors in C++/Python optimized for memory usage.
• fastFM - A library for Factorization Machines.
• implicit - A fast Python implementation of collaborative filtering for implicit datasets.
• libffm - A library for Field-aware Factorization Machine (FFM).
• lightfm - A Python implementation of a number of popular recommendation algorithms.
• spotlight - Deep recommender models using PyTorch.
• Surprise - A scikit for building and analyzing recommender systems.
• tensorrec - A Recommendation Engine Framework in TensorFlow.

Data Manipulation

• Jupyter
  • Jupyter-lab
  • databooks - manipulate and handle jupyter notebooks
  • jupyterlab-tensorboard-pro - TensorBoard support for JupyterLab.
  • jupyterlab-sql - a GUI to navigate a db on notebooks
  • ipysheet - work with sheet on jupyter
• Pandas
• csvkit
• modin a parallel pandas alternative
• polarsa blazing fast alternative to pandas with better memory management
• data table a pandas alternative for very big dataset:)

Data Visualization

• AutoViz
• altair
• bokeh
• AutoViz
• ipyvizzu - for make animations
• pandas-profiling
• Pandas-Bokeh

Scraping

• Scrapy
• Selenium

Distributed Computing

• dask - A flexible parallel computing library for analytic computing.
• luigi - A module that helps you build complex pipelines of batch jobs.
• mrjob - Run MapReduce jobs on Hadoop or Amazon Web Services.
• PySpark - Apache Spark Python API.
• Ray - A system for parallel and distributed Python that unifies the machine learning ecosystem.

Python Development

• requests
• faster-than-requests
• fastapi
• pydantic
• Pillow
• python-opencv
• DJANGO
• flask
• numba
• prisma

APPs

• Kivy

Logging

• loguru

CLI

UI

• Textual: a library for gui on terminal
• typer
• fire
• click

CLI Bars

• tqdm
• rich

Pipes and more

• ploomber
  • soopervisor

BIG Data

• https://github.com/0xnr/awesome-bigdata

Parameters Optimization

• Hydra
• H2O

Kubernetes

• KubeFLow
  • Kubeflow - Pipelines
• KubeDB
• Rancher

Testing

• Robot Framework Perfect for integration tests
• Behave Perfect for unit tests using BDD
• Hypothesis Perfect for input data generation coverage