Methods in Complex Systems

Setup

Start here and familiarize yourself with the tools we will be using:

Intro to Github, Colab, and Overleaf: https://www.youtube.com/watch?v=50wdMpfO9t0

Github: https://github.com/join

Github Commands:

  • git clone url
  • git status
  • git add .
  • git commit -m "update"
  • git push origin

Colab: https://colab.research.google.com/notebooks/welcome.ipynb

Lab Report: https://www.overleaf.com/read/qpfrmtfdjvbp

Lab Presentation: https://www.overleaf.com/read/xhsvcwnrkzns

Rex's Guide to Preparing a Lab Report

https://drive.google.com/file/d/196l0JJO8sb0kdSkceEly6b10h0xwng_w/view?usp=sharing

Data Project Format

Choose at least two categories (ie. cat vs dog) and collect at least 100 images from the internet or with a camera. Make sure to choose a diverse collection of images. On your Google Drive create a new folder called FinalProjectData. In that folder create two new folders one called train and the other called val. In each of those folders create a folder for each catagory. The directory structure should look as follows:

Example

Ants and Bees

Final Project Notebook

General Lab Format

For each Lab the following will be submitted the following week to your Github:

  1. Commented and Documented Colab Notebook (Upload .ipynb)
  2. Written Lab Report Typed in Latex
  3. Report Reformatted into Presentation Slides

Course Topical Outline

  • Week 1: Agent-based Models
  • Week 2: Stochastic Processes Random Walks
  • Week 3: Gradient Descent
  • Week 4: Monte Carlo Methods Simulated Annealing
  • Week 5: Non-convex Optimization Particle Swarm Optimization
  • Week 6: Linear Models
  • Week 7: Nonlinear Models Neural Networks
  • Week 8: Loading and Manipulating Data
  • Week 9: Representations and Visualization
  • Week 10: Convolution
  • Week 11: Dot-product Attention Units
  • Week 12: Dynamical Systems Simulation
  • Week 13: Dynamical Systems Simulation II
  • Week 14: Generative Models
  • Week 15: Adversarial Networks

Slides

https://docs.google.com/presentation/d/1dhsaqSF3eITIOZq_CN3nxSEjZAp4suaW9tiyCcKLwSg/edit?usp=sharing

Videos

Circuits in Stone

Richard Feynman Computer Heuristics Lecture

Beauty in physics, mathematics and biology, Gregory Chaitin

Leibniz on Complexity, Gregory Chaitin

Alan Turing, Cybernetics and the Secrets of Life

The Computer Chronicles - Parallel Processing

Connection Machine Applications

Connection Machine CM-1 & CM-2

Project Tierra

History of Computer Graphics (1972)

Sketchpad 1/3 (1963)

Sketchpad 2/3 (1963)

Sketchpad 3/3 (1963)

Bio-Sensor (1984)

Natural Phenomena (1988)

Silicon Graphics Promo (1987)

Pixar Visualization on Image Computer (1987)

Evans & Sutherland 'The Tactical Edge' 1/2

Evans & Sutherland 'The Tactical Edge' 2/2

Evans & Sutherland CT5 Flight Simulator (1981)

Magi and the History of Computer Animation

The Lighthill debate on Artificial Intelligence

The Machine that Changed the World 1/5

Chua Lectures

Understanding the Analog Computer

Readings

Notebooks

Random Walk - https://colab.research.google.com/drive/1uaxnLSrwAoNLoxNVHiniaZ-bSAjmtSIx?usp=sharing

Random Walk2 - https://colab.research.google.com/drive/1nGo3ZyI5ZWbo8EzDZzMlt-Qgs2VLU3QF?usp=sharing

Percolation - https://colab.research.google.com/drive/1WsnJu04hnZCcP1ZJk3eSrA9ST9P4Cylu?usp=sharing

Boids - https://colab.research.google.com/drive/1v76j1jEJYwkxFwhAPLHdslXm_tpBy8Pd?usp=sharing

SA https://colab.research.google.com/drive/1FuIDVMJROQ0-Rz0j7_TdA8xAuH_7ZjOe?usp=sharing

TSP - https://colab.research.google.com/drive/1iXzwIunLzpwY641gQkE-Up0yJ1ANbvmQ?usp=sharing

ACO - https://colab.research.google.com/drive/1Zc_34O5DlaBEILdnoGU8OTu4fa9rBhKK?usp=sharing

PSO - https://colab.research.google.com/drive/17wmY4QgVV_GGIh1StridYqWUIoDRVWpb?usp=sharing

Sudoku - https://colab.research.google.com/drive/11Br_Wg-0LcVL3nqfH5dGbd8ri9pM2oBh?usp=sharing

Dual Numbers - https://colab.research.google.com/drive/1ozQf-cf92bXWXqluITeZo0v9Y7hJ3ELz?usp=sharing

Convolution and PDE - https://colab.research.google.com/drive/1kf9AZatPxjy6Hd8KizG1lJh7mHX1T8Fy?usp=sharing

Wireworld - https://colab.research.google.com/drive/1kIQySWs_20iqEHlWwgxBcZ3qGy78Lj_0?usp=sharing

Turing Machine - https://colab.research.google.com/drive/1Dvw0fE_K4o9uMFPIoR5aRHIf5vRodoIU?usp=sharing

Linear MNIST - https://colab.research.google.com/drive/1hvsRSiaAKzXiM4yMxaXLyCd5fUFZnBVk?usp=sharing

Linear MNIST 2 - https://colab.research.google.com/drive/1Kf9qkNLxLkCANZpFZ6jqR3KFP2duJO6O?usp=sharing

Convolutional Neural Network - https://colab.research.google.com/drive/1lBq2AR6AS4PHPTNMHQVbH-pyp5UNgEGF?usp=sharing

Autoencoder - https://colab.research.google.com/drive/1LngBKwWdbfD28Hn-OyIW1Ib9p2wsEdYK?usp=sharing

Generative Networks - https://colab.research.google.com/drive/1zP2y8ZVaDeq8bOxwoMBjvNVBVlb4Jmca?usp=sharing

Chua Network - https://colab.research.google.com/drive/1Q5hk-p3Djgj9CK0UDU38ca8VLBUqpWL1?usp=sharing

LSTM - https://colab.research.google.com/drive/13B0aWLKqsnqNMv8UyDAz5woa8l_Lm8mB?usp=sharing

Compressed Sensing - https://colab.research.google.com/drive/1Plu_pq5IkFSB4ff-_hgeRk74G12r5VZu?usp=sharing

LCA GPU - https://colab.research.google.com/drive/11cI42s0OskZFFWbhC2CO8ww4UN3oAgVF?usp=sharing

LCA TPU - https://colab.research.google.com/drive/17kLEZrpRAuHs5hUvceTR9hA5r3c2LCFf?usp=sharing

X Cubed Dictionary - https://colab.research.google.com/drive/1rZYUj74lgXW4EjKtvcRndBGfa7ZO2X5L?usp=sharing

Izhikevich Neuron - https://colab.research.google.com/drive/1uB4LseklU6fEWVhNMDVOSvL0IrjwzDTr?usp=sharing

Wolfram Automata - https://colab.research.google.com/drive/1ketaUHO4KdVsGwDjgGp9M7SVQNG5bxiU?usp=sharing

Wolfram Automata 2 - https://colab.research.google.com/drive/1v7iEiXEMq-2YBWQwZ8q8y_slWBNdEcQo?usp=sharing

Reservoir Computing - https://colab.research.google.com/drive/1kS6hMAy4WXdA_IZej3sbXHdkjBVWbvrW?usp=sharing

Extreme Learning Machine - https://colab.research.google.com/drive/1i1ywkkuyYQclX8asz0N0cMAA2x8gxQwf?usp=sharing

Hypervectors - https://colab.research.google.com/drive/1WL_fr5TP-MLf-0kFKfBzu65wC5cL4daI?usp=sharing

PDE Raindrops - https://colab.research.google.com/drive/13J8tUsqhCVJAWa740TQarNj_w3SmnmrA?usp=sharing

PDE Network - https://colab.research.google.com/drive/1R_Gf_7qHLrhJgJvw1lup33EZAb9hCMB7?usp=sharing

Automata Roll - https://colab.research.google.com/drive/1IeQs9Wh6WrdUUoUDiWDDd25nBdsZbCz0?usp=sharing

Alexnet - https://colab.research.google.com/drive/1dTvnh39fHOtMABnUtNJW_ylZoEZzehj8?usp=sharing

RAM Model - https://colab.research.google.com/drive/1AcDJ5qYgtt7fnKnweMNtwV0AJOFlFZkB?usp=sharing