PoseEstimation-MLKit

This project is Pose Estimation on iOS with ML Kit.
If you are interested in iOS + Machine Learning, visit here you can see various DEMOs.

Jointed Keypoints	Concatenated heatmap
	(preparing...)

How it works

Video source: https://www.youtube.com/watch?v=EM16LBKBEgI

Requirements

Xcode 9.2+
iOS 11.0+
Swift 4.1

Download model

Get PoseEstimationForMobile's model

Pose Estimation model for TensorFlow Lite(model.tflite)
☞ Download TensorFlow Lite model model_cpm.tflite or hourglass.tflite.

input_name_shape_dict = {"image:0":[1,224,224,3]} image_input_names=["image:0"]
output_feature_names = ['Convolutional_Pose_Machine/stage_5_out:0']

－in https://github.com/edvardHua/PoseEstimationForMobile

Matadata

	cpm	hourglass
Input shape	`[1, 192, 192, 3]`	`[1, 192, 192, 3]`
Output shape	`[1, 96, 96, 14]`	`[1, 48, 48, 14]`
Input node name	`image`	`image`
Output node name	`Convolutional_Pose_Machine/stage_5_out`	`hourglass_out_3`

Inference Time

	cpm	hourglass
iPhone XS	(`TODO`)	(`TODO`)
iPhone XS Max	(`TODO`)	(`TODO`)
iPhone XR	(`TODO`)	(`TODO`)
iPhone X	57 ms	33 ms
iPhone 8+	(`TODO`)	(`TODO`)
iPhone 8	(`TODO`)	(`TODO`)
iPhone 7	(`TODO`)	(`TODO`)
iPhone 6	(`TODO`)	(`TODO`)

Get your own model

Or you can use your own PoseEstimation model

Build & Run

1. Prerequisites

1.1 Import pose estimation model

1.2 Add permission in info.plist for device's camera access

2. Dependencies

3. Code

(Preparing...)

tucan9389/PoseEstimation-MLKit