July 13-31, 2020
Objectives: Introduce traditional and emerging computational neuroscience tools, their complementarity, and what they can tell us about the brain. A main focus is on modeling choices, model creation, model evaluation and understanding how they relate to biological questions.
Tutorial microstructure: ~5min talk, ~15min hands-on (repeated)
Day structure: Opening keynote, 3h15min lecture/live Q&A/tutorial modules, 40min group discussion, 55min interpretation lecture (Outro) + live Q&As (what did we learn today, what does it mean, underlying philosophy). There will also be many networking activities (professional development sessions, yoga, social hangouts etc)! Details below.
Note for visitors from China: This repository contains many links to YouTube and Google Colab. We have a version of the repository with those same videos posted on bilibili, and the Google Colab links replaced with links to Aliyun. Please visit the China Accessible Neuromatch Course-Content
Prerequisites: See here
Group projects are offered for the interactive track only and will be running during all 3 weeks of NMA!
Description Two-day workshop for absolute Python beginners. Learn essential Python skills for course tutorials and practice by coding a neuronal simulation.
Description Introduce different example model types (Marr 1-3, what/how/why) and the kinds of questions they can answer. Realize how different models map onto different datasets.
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Model classifications |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | "What"/"How" models |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | "Why" model & discussion |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, The role of models in discovery |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Introduction to the process of building models.
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | How to approach modeling |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Framing the question |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break | BREAK |
| 2:55-4:10 | Tutorials + nano-lectures II | Model implementation and testing |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, the modeling process |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Fit models to data, quantify uncertainty, compare models
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Why and how to fit models |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Fit a model 1 (linear regression), Get error bars |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Compare models, cross-validation, hyperparameters, Fit a model 2 (nonlinear models) |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Critical evaluation of model fitting |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Introduction to machine learning. The commonly used approaches, how to avoid false positives, how to do it well
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | We want to predict (scikit learn) |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Introduction to GLMs and predicting neural responses |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Logistic regression, regularization, and decoding neural activity |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Promises and pitfalls of ML for Neuroscience |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Concept of dimensionality reduction, ways of doing it, what it means
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Manifolds to understand |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | PCA 1 (orthonormal basis), PCA 2 (eigenvalues) |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break | BREAK |
| 2:55-4:10 | Tutorials + nano-lectures II | MNIST with PCA, MNIST with t-SNE |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, The link between high-dimensional brain signals and low-dimensional behavior |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Weekend 1: Professional Development & Social
Description Professional development sessions and social activities will be offered on the weekend. More information, including exact times are available on the Neurostars Calendar
Description Bayesian statistics, modeling of behavior, modeling of neural data, quantifying information
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Uncertainty |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Bayes rule: cue combination and marginalization |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Bayesian Decision Theory & Causal inference |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Advanced Bayesian methods |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description How to make estimates over time, how the brain does it
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | World has time |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Linear systems theory I (ND deterministic) and Markov process |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break | BREAK |
| 2:55-4:10 | Tutorials + nano-lectures II | Linear systems theory II (1D stochastic = OU process; ND stocastic = AR(1)) and State space model |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Linear systems rule the world |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description How we can make decisions when information comes in over time
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | We need to decide stuff |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Information theory, Sequential Probability Ratio Test (SPRT) |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Hidden Markov Model inference (DDM), Kalman filter |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Decisions, decisions, decisions ... |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description We need to move gain info and reach goals
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | We want to control our actions... |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Expected utility / Cost, Markov decision process (MDP) |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | LQG control (MDP for linear systems), Motor control (signal-dependent noise, time cost, ...) |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Advanced motor control |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description The setting of reinforcement learning and how it approximates the real world, behavior, and potential brain implementations
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | We want reward now and in the future... |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Predicting rewards, learning to act in one-step tasks, Exploration vs exploitation |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break | BREAK |
| 2:55-4:10 | Tutorials + nano-lectures II | Learning to act in multi-step tasks, on-policy vs. off-policy control, Model-based vs model-free RL |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, RL and the brain |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Weekend 2: Professional Development & Social
Description Professional development sessions and social activities will be offered on the weekend. More information, including exact times are available on the Neurostars Calendar
Description The things neurons are made of, channels, morphologies, neuromodulators, and plasticity
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Real neurons ftw |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Reduced neuron models and transfer of synchrony |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Short-term plasticity of synapses and Hebbian plasticity & STDP |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, A variety of neuron models |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:05-7:05 | Social hour | Social hour |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description How single neurons create population dynamics
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Mechanistic models of different types of brain actvivity |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | 2D dynamical systems, Wilson-Cowen model (coarse-grained), oscillations & synchrony |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break | BREAK |
| 2:55-4:10 | Tutorials + nano-lectures II | Attractors & local linearization around fixed points, Balanced Amplification & Inhibition-stabilized network |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, A theory of the whole brain |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:05-7:05 | Social hour | Social hour |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Ways of discovering causal relations, ways of estimating networks, what we can do with networks
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | Causality - different views |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Pittfalls of Granger and Centrality |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Instrumental Variables and interventions |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Ladders of causality |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description The concept of ANNs, how to train them,what they are made out of, convnets, and how to fit them to brains
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro / keynote & tutorial setup | DL = crucial tool |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:35 | Tutorials + nano-lectures I | Pytorch intro & model components, Training it & inductive bias |
| 1:35-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big break + Physical Activity | BREAK incl. 20min yoga session |
| 2:55-4:10 | Tutorials + nano-lectures II | Convolutional Neural Network, Fit to brain (RSA - represenatational similarity analysis) |
| 4:10-4:30 | Pod Discussion III | Discussion with pod TA |
| 4:35-5:05** | Outro | Recap session, Digging deep |
| 5:05-6:05 | Q&A | Q&A with lecturers/Mentors |
| 6:00-7:00 | Social Activity | Hangout in Mozilla Hubs |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
Description Deep learning and autoencoders for structure discovery + end-of-course celebration
| Time (Hour) | Lecture | Details |
|---|---|---|
| -0:30-0:00* | Intro | DL for structure |
| 0:00-0:15 | Pod Discussion I | Lecture discussion with pod TA |
| 0:20-1:40 | Tutorial | Variational autoencorders and uses in Neuroscience |
| 1:45-1:55 | Pod Discussion II | Discussion with pod TA |
| 1:55-2:55 | Big Break | |
| 3:00-3:30** | Outro | Application of DL autoencoders |
| 3:35-4:05 | Faculty QA | Shortened QA |
| 4:05-4:30 | Evals | Fill in our end of term evaluation survey |
| 4:30-5:15 | Project presentations | Presentation and discussion of projects in small groups in your superpod |
| 5:15-5:30 | Pod farewell | Closing discussion of NMA with your pod |
| 5:40-6:10 | NMA project highlights | Highlights and discussion of the project experience |
| 6:15-7:00 | NMA closing | Celebration, shared experience, credits, memories, call to action and the future! |
* the Intro / keynote will be watched asynchronously, which means that you can watch this lecture before the start of the day ** please watch the Outro on your own after having completed the tutorials and before the Q&A session
- Meet a prof about your group's project
- Meet a prof about your career
- Meet a prof about your own project
- Meet other participants interested in similar topics
- Meet a group of likeminded people
- Meet people that are local to you (same city, country)
These are hour-long live-streamed events with a panel of speakers that will discuss a topic and answer audience questions. For times in the relevant time-zones, see the Neurostars Calendar. These sessions will be recorded for later replay. Some sessions are duplicated to ensure coverage for students in different time-zones.
| Session | Date | Description |
|---|---|---|
| 2.1: Data Sharing and Management | July 18, 13:00 UTC | Dimitri Yatsenko (DataJoint), Edgar Walker (DataJoint), Ben Dichter (NWB) Software tools for efficient management, analysis, and sharing of experimental data. https://www.crowdcast.io/e/nma/18 |
| 2.2: Data Sharing and Management | July 18, 23:00 UTC | Russ Poldrack (Stanford) Efficient data management and sharing strategies focusing on fMRI data. https://www.crowdcast.io/e/nma/20 |
| 3.1 Open Science | July 19, 0:00 UTC | Nici Pfeiffer (COS), Mark Musen (CEDAR, Stanford) The Center for Open Science develops tools for project management, collaboration, preregistration, and data sharing. CEDAR enables investigators to author metadata, annotating experimental datasets to make data more findable, accessible, interoperable, and reusable (FAIR). https://www.crowdcast.io/e/nma/21 |
| 4.1 Visualization | July 18 16:00 UTC | Colin Prahl (Artist), Amy Robinson Sterling (Eyewire), Helena Ledmyr (INCF) Data Visualization and communication. Neuroscience-inspired art. https://www.crowdcast.io/e/nma/19 |
| 5.1 Publishing | July 19, 18:00 UTC | Brett Mensh (Optimize Science) Maximizing the impact of your paper and the journal it gets into. https://www.crowdcast.io/e/nma/24 |
| 6.1 Philosophy | July 19, 1:00 UTC | Lisa Miracchi (U Penn) What is the difference between “what a cognitive agent does” and “what processes happen inside an agent”? Lisa Miracchi, philosophy professor at UPenn, talks about how this distinction relates to selecting models. https://www.crowdcast.io/e/nma/22 |
| 6.2 Philosophy | July 19, 15:00 UTC | Lisa Miracchi (U Penn) What is the difference between “the content of representations” and “the content of perceptions and thoughts”? Lisa Miracchi, philosophy professor at UPenn, talks about Marr’s Computational Level and how these questions relate to what robots might internally represent. https://www.crowdcast.io/e/nma/23 |
| Session | Date | Description |
|---|---|---|
| 1.1 Inclusive Neuroscience | July 25, 16:00 UTC | NMA Staff A goal of the NMA is to lower the barriers for learning about neuroscience. These barriers take many forms and this session will feature organizers discussing what we have done to make our platform more inclusive. We will wrap up with suggestions from students about how we can improve for next year. Bring your suggestions please! http://neuromatchacademy.org/stream |
| 3.1 Open Science | July 25, 15:00 UTC | Nici Pfeiffer (COS), Mark Musen (CEDAR, Stanford) The Center for Open Science develops tools for project management, collaboration, preregistration, and data sharing. CEDAR enables investigators to author metadata, annotating experimental datasets to make data more findable, accessible, interoperable, and reusable (FAIR). http://neuromatchacademy.org/stream |
| 7.1 FRL Career Forum | July 26 01:00 UTC | Facebook Reality Labs (FRL) researchers, developers, and engineers are building the future of connection within AR/VR. Join our ‘FRL Career Forum’ to hear from our scientists about how we use computational neuroscience & machine learning – and from our recruiters about job opportunities. Excited to meet the many diverse talents from NMA! http://neuromatchacademy.org/stream |
| 7.2 FRL Career Forum | July 26 14:00 UTC | Facebook Reality Labs (FRL) researchers, developers, and engineers are building the future of connection within AR/VR. Join our ‘FRL Career Forum’ to hear from our scientists about how we use computational neuroscience & machine learning – and from our recruiters about job opportunities. Excited to meet the many diverse talents from NMA! http://neuromatchacademy.org/stream |
| 8.1 Careers in Industry | July 25 20:00 UTC | Becky Clarkson (Apple), Kyle Frankovich (Insight Data Science), Kachi Odoememe (APL) Research careers in industry. http://neuromatchacademy.org/stream |
| 8.2 Careers in Industry | July 25 18:00 UTC | Feryal Behbahani (DeepMind), Sophie Kenny (Vpixx), Graeme Moffat (System2 Neurotechnology) Research careers in industry. http://neuromatchacademy.org/stream |
| 9.1 Careers in Academia | July 26 05:00 UTC | S.P. Arun (IISc), Minhae Kwon (Soongsil University), Taro Toyoizumi (RIKEN) Research careers in academia. http://neuromatchacademy.org/stream |
| 9.3 Careers in Academia | July 26 16:00 UTC | Russ Poldrack (Stanford), Xiao-Jing Wang (NYU) Research careers in academia. http://neuromatchacademy.org/stream |
| 10.1 How We Built This | July 26 20:00 UTC | Ella Batty, Patrick Mineault, Madineh Sarvestani, Tara van Viegen, Michael Waskom, 2000 students, 200 TAs, 200 volunteers, 20 days of content, 20 hours of video - how we built and launched NMA in 2 months. http://neuromatchacademy.org/stream |
Shield:
This work and everything in this repo is licensed under a Creative Commons Attribution 4.0 International License.
