AR-VR-Project-Physical-Exercise-School

VR Simulator built with Unity3D.

Contributors:

Features

  • Immersive School Environment: Experience a lifelike school environment in VR.
  • Six Degrees of Freedom (6DoF): Move freely within the virtual environment in all directions.
  • Interactive Instructor Guidance: Interact with an instructor guiding you through various physical exercises.
  • Exercise Following: Follow along with exercises demonstrated by the instructor.
  • Computer Vision Integration: Utilizes standalone computer vision technology to detect and track exercise movements.
  • Exercise Rep Counter: Automatically counts exercise repetitions based on detected movements.

Instructions for Execution for Unity

Software Dependencies

Unity Version used: Unity 2022.3.11

Getting Started

1. Clone the Repository

git clone https://github.com/aratimo/AR-VR-Project-Physical-Exercise-School.git

2. Unity Setup

  • Launch Unity and open the cloned project.
  • Check and set the required Unity version for the project.

3. Importing External Assets

  • Download the Environment Folder from here and drag it into the Assets folder in Unity.

Usage

Go to Assets -> Scenes -> SchoolSceneDay1.unity and drag it to the Hierarchy pane (left side in default layout).

Launching the Simulator

  • Navigate to the Game pane and make sure the Display is set to Display 3, and then hit the Play Button.

Navigating the Simulator

  • Use mouse controls to look around, as well as up and down.
  • Use the WASD keys to navigate around the environment.
  • Once the instructor is visible, use the 'f' button to start the Forward Raises exercise and the 'b' button to start the Bicep Curls exercise.
  • Press 't' to stop the exercise at any point in time.

Check out CV

  • Install dependencies (Mediapipe, openCV)
  • Run the main.py file using latest Python interpreter
  • Future works can include using socket programming to transfer data from python program to unity interface

Troubleshooting

  • If the Ground texture is not loaded by default, click on 'Terrain' in the Hierarchy pane (under SchoolSceneDay1) and manually set Terrain Data to 'SchoolTerrain' in the Inspector Panel.