Pinned Repositories
CADL
ARCHIVED: Contains historical course materials/Homework materials for the FREE MOOC course on "Creative Applications of Deep Learning w/ Tensorflow" #CADL
dance2dance
Discrete Figures AI: Seq2Seq of Dance Data (Mikiko + Daito Manabe + Kyle McDonald)
flask-uwsgi-tensorflow
Example of serving a TensorFlow model with Flask and UWSGI
KinectHandAnalysis
Does finger tracking, contour analysis, and different types of shape description for the hand contour using a 3D ROI around the hand-tracked by NITE middleware, using OpenCV 2.2, an OpenGL scene, and OpenNI.
pkmFace
facial shape modeling, appearance modeling, and head pose recognition. Uses Jason Mora Saragih's FaceTracker code to track facial landmarks; GreatYao's aam-library for building/reprojecting the model (which may in fact be an uncited port of Jason's DeMoLib).
pkmFFT
pkmFFT provide simple interfaces to the Accelerate.framework for performing vectorized FFT. pkmSTFT builds on pkmFFT to perform Short Time Fourier Transform efficiently using vectorized ops. Also handles options for windowing. pkmDCT provides a simple discrete cosine transform using Accelerate and pkmMatrix.
pycadl
Python package with source code from the course "Creative Applications of Deep Learning w/ TensorFlow"
Real-Time-Object-Detection
real time object detection using opencv and simple UI to select the object to track
tensorflow_tutorials
From the basics to slightly more interesting applications of Tensorflow
time-domain-neural-audio-style-transfer
NIPS2017 "Time Domain Neural Audio Style Transfer" code repository
pkmital's Repositories
pkmital/pkmFace
facial shape modeling, appearance modeling, and head pose recognition. Uses Jason Mora Saragih's FaceTracker code to track facial landmarks; GreatYao's aam-library for building/reprojecting the model (which may in fact be an uncited port of Jason's DeMoLib).
pkmital/KinectHandAnalysis
Does finger tracking, contour analysis, and different types of shape description for the hand contour using a 3D ROI around the hand-tracked by NITE middleware, using OpenCV 2.2, an OpenGL scene, and OpenNI.
pkmital/StickFigureOSC
Streams PrimeSense NITE's Skeleton Data via OSC (XCode Project)
pkmital/CARPE
CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. See http://thediemproject.wordpress.com for more details. Compuational and Algorithmic Representation and Processing of Eye-movements - OSX Version
pkmital/pkmBlobTracker
Background modeling for foreground subtraction, tracks multiple blobs (people), their orientations (using leading motion vector), and has a nice visual display for seeing the results... video demonstration here: http://vimeo.com/22054133 - more info here: http://pkmital.com
pkmital/pkmSIFTImage
Creates a dense SIFT image description and displays the image based on a PCA reprojection. Based on SIFT Flow code by Ce Lui, Jenny Yuen, and Antonio Torralba.
pkmital/pkmColorBlobTracker
track overhead using color and map tracked points to a new geometry using a homography transformation and calibration routine - some example test videos are provided in the bin/data directory of an overhead capture. The tracking transformation is useful for when you need a defined metric space of your tracking parameters, or need to account for different user heights in tracking their paths in a space.
pkmital/pkmDetector
3d Object Tracking and Pose Estimation for the iPhone
pkmital/pkmPhaseVocoder
Phase vocoder using pkmFFT and pkmMatrix. Does not seem to do as well as commerical applications. Would love it if anyone made use of this and improved upon it.
pkmital/pkmProjectionMapper
openFrameworks based projection mapping for distorting or mapping a collection of drawing commands/videos/images etc... needed a lightweight and robust projection mapping utility though lpmt was too heavy. homography code stolen from lpmt.
pkmital/videoSPAM
[in progress] synthesis of audiovisual material from youtube!
pkmital/pkmPoseCalibrator
Calibrate head pose with respect to a screen (television/monitor) for an attention-based measure. Uses Jason Mora Saragih's FaceTracker, please contact him for the code.
pkmital/DIEM
Matlab scripts specific to the DIEM database
pkmital/Responsive-Ecologies
Code from the Responsive Ecologies exhibition. Using overhead motion capture and 4 channels of video projection, users are invited to interact in an immersive cinematic environment. This code was developed for the installation in Waterman's Art Centre, London, UK, where artists captincaptin and Parag K Mital have been collaborating to install their piece, "Responsive Ecologies" for their residency during December 2010 and January 2011. The work occurs as part of a larger on-going collaboration with ZSL London Zoo and the Musion Academy.