A curated list of articles that cover software engineering (SE) best practices for building machine learning (ML) applications.
βοΈ Must-read
π Scientific publication
- Broad Overviews
- Data Management
- Managing Model Training
- Deployment and Operation
- Social aspects
- Tooling
These publications cover all aspects.
- Hidden Technical Debt in Machine Learning Systems πβοΈ
- Rules of Machine Learning: Best Practices for ML Engineering βοΈ
- Software Engineering for Machine Learning: A Case Study πβοΈ
How to manage the data sets you use in machine learning.
- A Survey on Data Collection for Machine Learning A Big Data - AI Integration Perspective_2019 π
- Automating Large-Scale Data Quality Verification π
- Data management challenges in production machine learning
- How to organize data labelling for ML
- The curse of big data labeling and three ways to solve it
- The Data Linter: Lightweight, Automated Sanity Checking for ML Data Sets π
- The ultimate guide to data labeling for ML
How to organize your model training experiments.
- 10 Best Practices for Deep Learning
- How do you manage your Machine Learning Experiments?
- Machine Learning Testing: Survey, Landscapes and Horizons π
- On human intellect and machine failures: Troubleshooting integrative machine learning systems π
- Preparing and Architecting for Machine Learning
- Preliminary Systematic Literature Review of Machine Learning System Development Process π
- Software development best practices in a deep learning environment
- Testing and Debugging in Machine Learning
- What Went Wrong and Why? Diagnosing Situated Interaction Failures in the Wild π
How to deploy and operate your models in a production environment.
- Best Practices in Machine Learning Infrastructure
- Continuous Delivery for Machine Learning βοΈ
- Continuous Training for Production ML in the TensorFlow Extended (TFX) Platform π
- Fairness Indicators: Scalable Infrastructure for Fair ML Systems π
- Machine Learning Logistics
- Machine learning: Moving from experiments to production
- ML Ops: Machine Learning as an engineered disciplined
- Model Governance Reducing the Anarchy of Production π
- ModelOps: Cloud-based lifecycle management for reliable and trusted AI
- Operational Machine Learning
- TFX: A tensorflow-based Production-Scale ML Platform π
- Versioning for end-to-end machine learning pipelines π
- Whatβs your ML Test Score? A rubric for ML production systems π
How to organize teams and projects to ensure effective collaboration and accountability.
- Data Scientists in Software Teams: State of the Art and Challenges π
- How do teams work together on an automated machine learning project?
- Machine Learning Interviews
- Managing Machine Learning Projects
- Principled Machine Learning: Practices and Tools for Efficient Collaboration
- Team Data Science Process Documentation
- Responsible AI practices βοΈ
Tooling can make your life easier.
We only share open source tools, or commercial platforms that offer substantial free packages for research.
- Airflow
- Auto-PyTorch
- Ax
- Data Version Control (DVC)
- Facets Overview / Facets Dive
- Git Large File System (LFS)
- HParams
- Kubeflow
- MLFlow
- Neptune.ai
- Neuraxle
- Spark Machine Learning
- Sacred
- TensorBoard
- Tensorflow Extended (TFX)
- Weights & Biases
Contributions welcomed! Read the contribution guidelines first.
To the extent possible under law, se-ml.github.io has waived all copyright and related or neighboring rights to this work.