/Virtual-fitting-room

virtual firring room using kinect v2

Primary LanguageC#

Virtual fitting room using Kinect V2

This README file is to accompany code for Virtual Try-on System, produced by Khalil M. Ahmad Yousef, Bassam J. Mohd, and Malak AL-Omari as a companion to their paper: Kinect-Based Virtual Try-on System: A Case Study, which was accepted at the 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), 9-11 April 2019, Amman, Jordan (https://jeeit.net/). The paper is currently being submitted to the IEEE Xplore Digital Library and to be indexed in SCOPUS.

If you use this code in project that results in a publication, please cite the paper above.

Comments/Bugs/Problems: malak21alomari@gmail.com, khalil@hu.edu.jo

Required Software’s and Dependencies:

  1. Unity 3D.
  2. openCv DLLs

Description

An Augmented Reality Virtual fitting room allows customers to virtually try on clothes and accessories items before buying it, made using Unity (C#) and OpenCV.

Process

Mapping model to the user body

Fitting process is done by using Iterative closest point (ICP) algorithm to transform the three dimensional model to the joints of human body. The algorithm iteratively revises the transformation (combination of translation and rotation) needed to minimize an error metric, usually a distance from the source to the reference point cloud, such as the sum of squared differences between the coordinates of the matched pairs.

Now, to finally place the model on the user's body, the coordinates of ICP transformation are set to the anchors of model.

The following 2 transformational components are then set and passed to Unity,

  1. Position: The model is placed on the position of body joints
  2. Rotation: The model is rotated by an angle equal to the angle made by the joints of human body

How it works?

  1. Run virtualFittingRoom.exe OR run /Assets/FittingRoom.unity to open it in edit mode.
  2. Stand in front of the Kinect sensor and open your arms as T-Pose to be in control.
  3. the controllers will be moved depending on the movement of your hands.
  4. move the controller to select your gender; male/female.
  5. according to your gender a list of clothes and accessories items will be shown in different categories.
  6. you can select different items from different categories to be fit in your body.
  7. you can resize the item by clicking on plus and minus button.
  8. you can change the texture of the item by select one of the texture in the textures list.

Models

you can add or change the models by uploading it to /Assets/Models/ and then add them to the unity scene then add DetectJoints.cs script to the model item and that's it.