/KinectV2_YOLO

Use kinect for YOLO

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Intro

I would just like to note that I could not have put this together with out the work of others. To the caretakers of PYkinect2,YOLO2 darkflow and PYlogix to name a few, thank you. Also shout out to the Python community.

"I can touch the stars because I stand on the shoulders of the open source believers" Richard Watterson

The next 3 lines are not my work,but you will need this info to setup YOLO on youre machine:

Real-time object detection and classification. Paper: version 1, version 2.

Read more about YOLO (in darknet) and download weight files here. In case the weight file cannot be found, I uploaded some of mine here, which include yolo-full and yolo-tiny of v1.0, tiny-yolo-v1.1 of v1.1 and yolo, tiny-yolo-voc of v2.

Dependencies

Python3, tensorflow 1.0, numpy, opencv 3. PYkinect2

bin/tiny-yolo.weights --json

This uses Pykinect2 to get the color and depth streams from the Kinect V2. Then the color stream is feed to the YOLO model. This uses TINY-YOLO beacaus my machines is a slug: Then it takes the X,Y cordinates of the centers of the bounding boxes and Uses those cordinates to find the depth data from the depth stream. Then it adds the depth data to bounding box label. It also puts a colored circle(the same color as the bounding box) on the depth data window where it is reading the depth data pixel.

PLC support for Allen Bradley CLX 5000 has been added Check out screen shot

Kinect_yolo depth.py: is the one to run.Its the combines all the features

Kinect_yolo.py : is just the color and depth stream.

Image description