WREQI/huia_experience

Interactive 3D Website Experience using ThreeJS and TensorflowJS

Huia Experience

Huia is a Design & Tech Studio from Brazil and also the name of a rare and extinct bird from New Zealand. This project uses Artificial Intelligence and 3D to digitally recreate an interactive Huia. Using computer vision we capture webcam images to understand the user's pose in real time and react with fun actions.

Learn more about this project

Read my medium article about this project to learn about all the details necessary to build an artificial intelligence experience on the browser from end-to-end.

Try out the Live Demo (you need a webcam)

https://experience.huia.haus

These are the poses the Huia responds to

Me trying out the experience at an event and having fun!

The project is divided into 3 parts:

• 01 Capturing Data
• 02 Training
• 03 Interactive Experience

Technical Details

This project was created with

• VueJS
• ThreeJS
• Tensorflow 2 Alpha and TensorflowJS

This project was made possible with the help from:

• Artificial Intelligence: Alessandro Cauduro
• Art Direction & Design: Caio Ogata and Carolina Dutra Silveira
• 3D Modeling and Animations: Funn
• 3D Interactive Huia: Luiz Sordi
• Docker and Site Infrastructure: Mauricio Klagenberg
• Body Data used for pose training: Alessandro Cauduro, Carolina Dutra Silveira, André Gonçalves, Mauricio Klagenberg and Paulo Araújo.