/BioSB-MachineLearning-2022

2022 edition of the BioSB Machine Learning course

GNU General Public License v3.0GPL-3.0

Machine Learning for Bioinformatics & Systems Biology

A yearly course, part of the BioSB Research School

Lecturers

  • dr. ir. Perry Moerland (Amsterdam UMC, location: Academic Medical Center)
  • prof. dr. ir. Marcel Reinders (Delft University of Technology)
  • prof. dr. Lodewyk Wessels (Netherlands Cancer Institute)

Course coordinator:

For more information about the course programme, please contact Perry Moerland; for more information about registration or logistics, please contact Mascha Jansen.

Learning objectives

After having followed this course, the student has a good understanding of a wide range of machine learning techniques and is able to recognize what method is most applicable to data analysis problems (s)he encounters in bioinformatics and systems biology applications.

Target audience

The course is aimed at PhD students with a background in bioinformatics, systems biology, computer science or a related field, and life sciences. Participants from the private sector are also welcome. A working knowledge of basic statistics and linear algebra is assumed. Preparation material on statistics and linear algebra will be distributed before the course, to be studied by students missing the required background.

Description

Modern biology is a data-rich science, driven by our ability to measure the detailed molecular characteristics of cells, organs, and individuals at many different levels. Interpretation of these large-scale biological data requires the detection of statistical dependencies and patterns in order to establish useful models of complex biological systems. Techniques from machine learning are key in this endeavour. Typical examples are the visualization of single-cell RNA-seq data using dimensionality reduction methods, base calling for nanopore sequencing data using hidden Markov models and (recurrent) neural networks, and classification of high-throughput microscopy image data using convolutional neural networks.

In this one-week course, the foundations of machine learning will be laid out and commonly used methods for unsupervised (clustering, dimensionality reduction, visualization) and supervised (mainly classification) learning will be explained in detail. Methods will be illustrated using recent examples from the fields of systems biology and bioinformatics. Methods discussed in the morning lectures will be put into practice during the afternoon computer lab sessions. The course can optionally be extended with an assignment in which you write a 5-10 page report describing the analysis of a biological dataset using some of the methods taught in the course.

Registration

You can register for this course by filling out the BioSB registration form. The maximum number of participants is 25, so register soon to be sure of a course seat! Update: we reached the maximum number of participants for the 2022 edition. Registration is closed. If you would like to be put on the waiting list, please use the registration form. If you are interested in the 2023 edition of the course please fill out the pre-registration form.

The course fee includes all course material. Lecture slides, a computer lab manual and software required for the computer labs (MATLAB toolboxes) will be made available online.

  • Catering: Coffee, tea, soft drinks and lunch will be provided.

Course material

All course materials are available below and include the handouts of the slides, a computer lab manual and the required data and Matlab toolboxes.

Have a look at the following documents before the start of the course:

  • A self-evaluation test on the prerequisite prior knowledge (probability theory and linear algebra). If you have a lot of trouble answering some of these exercises, consult the text books mentioned in the PDF, or a few primers on these topics.
  • The computer labs make extensive use of Matlab. You do not need to be a fluent programmer, but if you have never worked with Matlab before it may help to have a look at the Appendices of the computer lab manual. An extensive Matlab primer is also available.

To use the code and data, download the ZIP file, unpack everything in the same directory and run prstartup from the Matlab command prompt. If you do not have access to a Matlab campus license, install the 30-day free trial. When indicating toolboxes to install, you should at least select the Deep Learning, Optimization and Statistics and Machine Learning toolboxes.

Assignment

Participants requiring a certificate of successful completion (3 ECTS) should make a final assignment. The student will analyse a biological dataset (preferably one from his/her own practice) using some of methods taught in the course, and write a small report (5-10 pages) on the results. If the student has no dataset available, one will be provided. The report will have to be mailed to Perry Moerland no later than three weeks after the course has finished (October 21, 2022). We will strictly adhere to this deadline; if you require extension, you should contact us well in advance. The proposal will be graded "fail" or "pass", with one possible resubmission. Those who choose not to make the final assignment will receive a certificate of participation (1.5 ECTS).

Location and travel information

Course class rooms are located in and around the Amsterdam UMC, location Academic Medical Center (AMC; in Dutch: Academisch Medisch Centrum), Meibergdreef 9, Amsterdam.

Detailed travel information to the AMC can be found at https://www.amsterdamumc.nl/en/location-amc/address.htm. The metro/train station is at about 10 minutes walking distance from the class rooms and can be reached in less than 30 minutes from Amsterdam Central Station and Schiphol Airport.

Schedule

The course will run in the week of September 26-30 2022.

Each course day will have the following schedule:

  • 9.00 - 12.00: Lecture
  • 12.00 - 13.00: Lunch break
  • 13.00 - 17.00: Computer lab

Note that the course material is still going to change before and during ;-) the course week.

Monday (September 26) - Introduction
Lecturer Marcel Reinders
Subjects Introduction to machine learning: measurements, features, classification. Supervised vs. unsupervised learning, relation to regression. Bayesian framework: risk, cost; evaluation: ROCs, cross-validation. Density estimation: histograms, nearest neighbour, Parzen, Gaussian Bayesian classification.

Tuesday (September 27) - Classifiers
Lecturer Perry Moerland
Subjects Parametric classifiers: (D)LDA, (D)QDA. Nonparametric classifiers: k-NN, Parzen. Discriminant analysis: LDA, logistic regression. Decision trees and random forests.

Wednesday (September 28) - Feature selection and extraction
Lecturer Lodewyk Wessels
Subjects Feature selection: criteria, search algorithms (forward, backward, branch & bound). Sparse classifiers: Ridge, LASSO. Feature extraction: PCA, Fisher. Embeddings: MDS.

Thursday (September 29) - Clustering and HMMs
Lecturer Perry Moerland
Subjects Hierarchical clustering. Agglomerative clustering. Model-based clustering: mixtures-of-Gaussians, Expectation-Maximization. Hidden Markov models.

Friday (September 30) - Selected advanced topics
Lecturer Marcel Reinders
Subjects Artificial neural networks. Support vector machines. Classifier ensembles. Complexity and regularisation. Deep learning.

Pointers

Additional tools (not required for the course, but perhaps interesting):

  • scikit-learn is a free software machine learning library for the Python programming language
  • R is very popular for solving data analysis problems. Here is a short reference that provides a mapping between Matlab and R commands.
  • R packages relevant for some of the topics treated in the course are (spread out over a whole range of packages, list is far from complete):
  • WEKA, a Java-based collection of machine learning algorithms for data mining
  • Shogun, a machine learning library particularly suitable for large scale kernel methods

Some good material for further reading: