I would just like to note that I could not have put this together with out the work of others. To the caretakers of PYkinect2,YOLO2 darkflow and PYlogix to name a few, thank you. Also shout out to the Python community.
"I can touch the stars because I stand on the shoulders of the open source believers" Richard Watterson
The next 3 lines are not my work,but you will need this info to setup YOLO on youre machine:
Real-time object detection and classification. Paper: version 1, version 2.
Read more about YOLO (in darknet) and download weight files here. In case the weight file cannot be found, I uploaded some of mine here, which include yolo-full
and yolo-tiny
of v1.0, tiny-yolo-v1.1
of v1.1 and yolo
, tiny-yolo-voc
of v2.
Python3, tensorflow 1.0, numpy, opencv 3. PYkinect2
bin/tiny-yolo.weights --json
This uses Pykinect2 to get the color and depth streams from the Kinect V2. Then the color stream is feed to the YOLO model. This uses TINY-YOLO beacaus my machines is a slug: Then it takes the X,Y cordinates of the centers of the bounding boxes and Uses those cordinates to find the depth data from the depth stream. Then it adds the depth data to bounding box label. It also puts a colored circle(the same color as the bounding box) on the depth data window where it is reading the depth data pixel.
PLC support for Allen Bradley CLX 5000 has been added Check out screen shot
Kinect_yolo depth.py: is the one to run.Its the combines all the features
Kinect_yolo.py : is just the color and depth stream.