Instructors: Brenden Lake and Todd Gureckis
Teaching Assistants: Guy Davidson and Aysja Johnson
Meeting time and location:
Lecture. We have a "flipped classroom" model.
Lectures will be pre-recorded and available to watch on Vimeo. Please watch the lecture before the date it is listed under, so that we have a productive live discussion. Please come ready with your questions.
Live discussion of the lectures is blended on Mondays 1:35-2:35 PM.
In person GCASL_C95 - Global Center for Academic & Spiritual Life, 238 Thompson Street (capacity = 56).
Zoom link: https://nyu.zoom.us/j/92201764817 (see also in NYU Classes), password provided on EdStem site.
Labs. We have two times. Attend only one, whichever is more convenient for you.
Option 1: Tuesdays 8:00-8:50 AM
Online only, Zoom link: https://nyu.zoom.us/j/94450481642 (see also in NYU Classes), password provided on EdStem site.
Option 2: Tuesdays 2:40-3:30 PM
Blended (60 Fifth Avenue, Room 150 , capacity 17 students)
OR Zoom link: https://nyu.zoom.us/j/98468890846 (see also in NYU Classes), password provided on EdStem site.
(Labs are remote only for the first two weeks.)
Course numbers:
DS-GA 1016.003 (Data Science)
PSYCH-GA 3405.004 (Psychology)
Contact information and EdStem:
EdStem is the main point of contact. We use EdStem for questions and class discussion. Rather than emailing questions to the teaching staff, please post your questions on EdStem. It will get you a faster response and the answer will benefit others with the same question.
The signup link for our EdStem page is available here (https://edstem.org/us/join/v3nFw8).
Once signed up, our class EdStem page is available here (https://edstem.org/us/courses/4281/discussion/).
If you have a question that isn't suitable for EdStem and there is a need to email the teaching staff directly, please use the following email address: instructors-ccm-spring2021@nyuccl.org
Office hours (via Zoom. Look for links posted on EdStem):
Todd Gureckis (Tuesdays 11am-12, Wednesday 4-5pm, https://nyu.zoom.us/my/todd.gureckis)
Brenden Lake (Wednesdays 1-2pm)
Guy Davidson (Tuesdays 1-2pm, link on EdStem)
Aysja Johnson (Mondays 3-4pm) https://nyu.zoom.us/my/aysja.johnson
Summary: This course surveys the leading computational frameworks for understanding human intelligence and cognition. Both psychologists and data scientists are working with increasingly large quantities of human behavioral data. Computational cognitive modeling aims to understand behavioral data and the mind and brain, more generally, by building computational models of the cognitive processes that produce the data. This course introduces the goals, philosophy, and technical concepts behind computational cognitive modeling.
The lectures cover artificial neural networks (deep learning), reinforcement learning, Bayesian modeling, model comparison and fitting, classification, probabilistic graphical models, and program induction. Modeling examples span a broad set of psychological abilities including learning, categorization, language, memory, decision making, and reasoning. The homework assignments include examining and implementing the models surveyed in class. Students will leave the course with a richer understanding of how computational modeling advances cognitive science, how cognitive science can inform research in machine learning and AI, and how to fit and evaluate cognitive models to understand behavioral data.
Please note that this syllabus is not final and there may be further adjustments.
-
Math: We will use concepts from linear algebra, calculus, and probability. If you had linear algebra and calculus as an undergrad, or if you have taken Math Tools in the psychology department, you will be in a good position for approaching the material. Familiarity with probability is also assumed. We will review some of the basic technical concepts in lab.
-
Programming: Previous experience with Python is required. Previous IN CLASS experience with Python is strongly recommend---it’s assumed you know how to program in Python. The assignments will use Python 3 and Jupyter Notebooks (http://jupyter.org)
The final grade is based on the homeworks (60%) and the final project (40%).
Class participation may be used to decide grades in borderline cases.
The final project proposal is due Monday, April 5 (0.5 pages written). Please submit via email to instructors-ccm-spring2021@nyuccl.org with the file name lastname1-lastname2-lastname3-ccm-proposal.pdf. Make sure to include the names of all of your group members at the top of the document too.
The final project is due Wednesday 5/12. Please submit via email to instructors-ccm-spring2021@nyuccl.org with the file name lastname1-lastname2-lastname3-ccm-final.pdf. Make sure to include the names of all of your group members at the top of the document too.
The final project will be done in groups of 3-4 students. A short paper will be turned in describing the project (approximately 6 pages). The project will represent either an substantial extension of one of the homeworks (e.g., exploring some new aspect of one of the assignments), implementing and extending an existing cognitive modeling paper, or a cognitive modeling project related to your research. We provide a list of project ideas here, but of course you do not have to choose from this list.
The final project must relate to computational cognitive modeling and cannot be a purely machine learning / data science project. Thus, your project must connect, in some way, to the human mind and behavior. This could be collecting (informally) behavioral data to compare your computational model to. Or you could compare your model against results in the literature or particular dataset of human behavior or ratings. Or you could compare your algorithm with human intelligence in a more abstract sense. There are many ways to make the connection, but your final project must connect to computational cognitive modeling.
Write-ups should be organized and written as a scientific paper. It must include the following sections: Introduction (with review of related work), Methods/Models, Results, and Discussion/Conclusion. A good example would be to follow the structure of this paper from the class readings:
- Peterson, J., Abbott, J., & Griffiths, T. (2016). Adapting Deep Network Features to Capture Psychological Representations. Presented at the 38th Annual Conference of the Cognitive Science Society. link here
Code submission is not required for the final project.
Live discussion is on Mondays 1:35-2:35 PM (in person and via NYU classes Zoom tool)
- Mon Feb 01: Introduction (video)(slides-intro)(slides-logistics)
- Mon Feb 08: Neural networks / Deep learning (part 1)(video)(slides)
- Homework 1 assigned on 2/8 (Due 2/22) (instructions for accessing here)
- Mon Feb 15: No class, President's Day
- Thursday Feb 18 (Legislative Day, with Monday schedule): Neural networks / Deep learning (part 2)(video)(slides)
- Mon Feb 22: Reinforcement learning (part 1)
- Mon Mar 01: Reinforcement learning (part 2)
- Homework 2 assigned (Due 3/15) (instructions for accessing here)
- Mon Mar 08: Reinforcement learning (part 3)
- Mon Mar 15: Bayesian modeling (part 1)
- Homework 3 assigned (Due 3/29) (instructions for accessing here)
- Mon Mar 22: Bayesian modeling (part 2)
- Mon Mar 29: Model comparison and fitting, tricks of the trade
- Mon Apr 05: Categorization
- Project proposal is due
- Homework 4 assigned (Due 4/19) (instructions for accessing here)
- Mon Apr 12: Probabilistic Graphical models
- Mon Apr 19: No class, Long Weekend (Spring Break Replacement)
- Mon Apr 26: Information sampling and active learning
- Mon May 03: Program induction and language of thought models
- Mon May 10: Computational Cognitive Neuroscience
- Final project due (Due Wed 5/12)
Tuesdays 8am-8:50am (online via NYU Zoom only) OR 2:40-3:30 PM (in person and via NYU classes Zoom tool)
- Tue Feb 02, Python and Jupyter notebooks review (remote only this week)
- Tue Feb 09, Introduction to PyTorch (remote only this week)
- Tue Feb 16, HW 1 Review (remote only this week)
- Tue Feb 23, TBD
- Tue Mar 02, TBD
- Tue Mar 09, HW 2 Review
- Tue Mar 16, Probability Review
- Tue Mar 23, HW 3 Review
- Tue Mar 30, TBD
- Tue Apr 06, TBD
- Tue Apr 13, HW 4 Review
- Tue Apr 20, TBD
- Tue Apr 27, TBD
- Tue May 04, TBD
For each major topic, there are assigned readings that go with the lectures. The papers were selected to be fundamental readings on this topic any computational cognitive scientist would be expected to know. You should aim to read these over the course of the semester, especially during the periods when we are covering the same topic. The papers should be downloadable on Google Scholar via NYU Library. However, they are available for download on EdStem website under the "resources" tab (see the down pointing arrow along the top bar or this link).
Neural networks and deep learning
- McClelland, J. L., Rumelhart, D. E., & Hinton, G. E. The Appeal of Parallel Distributed Processing. Vol I, Ch 1.
- LeCun, Y., Bengio, Y. & Hinton, G. (2015). Deep learning. Nature 521:436–44.
- McClelland, J. L., & Rogers, T. T. (2003). The parallel distributed processing approach to semantic cognition. Nature Reviews Neuroscience, 4(4), 310-322.
- Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179-211.
- Peterson, J., Abbott, J., & Griffiths, T. (2016). Adapting Deep Network Features to Capture Psychological Representations. Presented at the 38th Annual Conference of the Cognitive Science Society.
Reinforcement learning and decision making
- Gureckis, T.M. and Love, B.C. (2015) Reinforcement learning: A computational perspective. Oxford Handbook of Computational and Mathematical Psychology, Edited by Busemeyer, J.R., Townsend, J., Zheng, W., and Eidels, A., Oxford University Press, New York, NY.
- Daw, N.S. (2013) "Advanced Reinforcement Learning" Chapter in Neuroeconomics: Decision making and the brain, 2nd edition
- Niv, Y. and Schoenbaum, G. (2008) “Dialogues on prediction errors” Trends in Cognitive Science, 12(7), 265-72.
- Nathaniel D. Daw, John P. O'Doherty, Peter Dayan, Ben Seymour & Raymond J. Dolan (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
Bayesian modeling
- Russel, S. J., and Norvig, P. Artificial Intelligence: A Modern Approach. Chapter 13, Uncertainty.
- Tenenbaum, J. B., and Griffiths, T. L. (2001). Generalization, similarity, and Bayesian inference. Behavioral and Brain Sciences, 24(4), 629-640.
- Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011). How to grow a mind: Statistics, structure, and abstraction. Science, 331(6022), 1279-1285.
- Ghahramani, Z. (2015). Probabilistic machine learning and artificial intelligence. Nature, 521(7553), 452.
- MacKay, D. (2003). Chapter 29: Monte Carlo Methods. In Information Theory, Inference, and Learning Algorithms.
Rational versus mechanistic modeling approaches
- Jones, M. & Love, B.C. (2011). Bayesian Fundamentalism or Enlightenment? On the Explanatory Status and Theoretical Contributions of Bayesian Models of Cognition. Behavioral and Brain Sciences (target article).
- Griffiths, T.L., Lieder, F., & Goodman, N.D. (2015). Rational use of cognitive resources: Levels of analysis between the computational and the algorithmic. Topics in Cognitive Science, 7(2), 217-229.
Model comparison and fitting, tricks of trade
- Wilson, R.C. and Collins, A.G.E. (2019). Ten simple rules for the computational modeling of behavioral data. eLife 2019;8:e49547
- Pitt, M.A. and Myung, J (2002) When a good fit can be bad. Trends in Cognitive Science, 6, 10, 421-425.
- Roberts, S. & Pashler, H. (2000) How persuasive is a good fit? A comment on theory testing. Psychological Review, 107, 358-367.
- [optional] Myung, I.J. (2003). Tutorial on maximum likelihood estimation. Journal of Mathematical Psychology, 47, 90-100.
Probabilistic graphical models
- Charniak (1991). Bayesian networks without tears. AI Magazine, 50-63.
- Kemp, C., & Tenenbaum, J. B. (2008). The discovery of structural form. Proceedings of the National Academy of Sciences, 105(31), 10687-10692.
- [optional] Russel, S. J., and Norvig, P. Artificial Intelligence: A Modern Approach. Chapter 14, Probabilistic reasoning systems.
Program induction and language of thought models
- Ghahramani, Z. (2015). Probabilistic machine learning and artificial intelligence. Nature, 521(7553), 452.
- Goodman, N. D., Tenenbaum, J. B., & Gerstenberg, T. (2014). Concepts in a probabilistic language of thought. Center for Brains, Minds and Machines (CBMM).
- Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015). Human-level concept learning through probabilistic program induction. Science, 350(6266), 1332-1338.
Computational Cognitive Neuroscience
- Kreigeskorte, N. and Douglas, P.K. (2018) Cognitive computational neuroscience. Nature Neuroscience. 21(9): 1148-1160. doi:10.1038/s41593-018-0210-5
- Turner, B.M., Forstmann, B.U., Love, B.C., Palmeri, T.J., Van Maanen, L. (2017). Approaches to analysis in model-based cognitive neuroscience. Journal of Mathematical Psychology. 76(B), 65-79.
Auditing:
We can't accommodate in-person auditors.
Collaboration and honor code:
We take the collaboration policy and academic integrity very seriously. Violations of the policy will result in zero points and possible disciplinary referral. You may discuss the homework assignments with your classmates, but you must run the simulations and complete the write-ups for the homeworks on your own. Under no circumstance should students look at each other’s code or write ups, or code/write-ups from previous years of this course. Do not share your write up or code with any of your classmates under any circumstances.
Late work:
We will take off 10% for each day a homework or final project is late. Assignments should be turned in all-at-once and not in pieces. If an assignment is incomplete and later completed, the late penalty is applied to the entire assignment.
Extensions:
If you are requesting an extension, email the teaching team (instructors-ccm-spring2021@nyuccl.org) and explain the reason. You must submit a request for extension at least 24 hours before the due date of the assignment.
Regrading:
If you feel there was a mistake in the grading of your assignment, you can formally request a regrade by emailing the teaching team. This will prompt us to regrade the entire assignment and could lead to your grade being either raised or lowered depending on what the regrade finds. You can submit a regrade request via gradescope.
Did you forget to turn in part of the homework, or did it print improperly?:
Before turning in your assignment, double check that all of your answers appear clearly in the PDF printout. We will not regrade a homework because your answer did not display correctly in the version you submitted.
Extra credit:
No extra credit will be given, out of interest of fairness.
Students registered for the course have the option of completing homework assignments on their personal computers, or in a cloud Jupyter environment with all required packages pre-installed. Students can log onto the environment using their nyu net ids https://dsga-1016003-spring.rcnyu.org.