/computer_vision

ROS nodes for robust lane detection on grass and automatic inverse perspective transformation

Primary LanguageC++GNU General Public License v3.0GPL-3.0

Computer Vision

Overview of the subsystem:

VISION Overview

Note: Ellipses correspond to ROS Nodes and Rectangles correspond to the corresponding topics.

Build and Working Status

Node Build Status Working Status Credits Future Work
birds_eye build_passing Status_working - -
classifier build_passing Status_working IGVC IITK
(Built from scratch)		 Improving training model for better accuracy
gSLICr/gslicr_ros build_passing Status_working gSLICr Tuning Parameters
masker build_passing Status_working IGVC IITK
(Built from scratch)		 -
top_view build_passing Status_working IGVC IITK
(Built from scratch)		 -
zed-ros-wrapper build_passing Status_working ZED ROS wrapper -

classifier

This package contains the classifier_node and the launchfile for the full vision pipeline. The classifier_node takes averaged image and uses pre-trained random forrest model to predict each superpixel as lane/not lane and publishes the prediction array to rostopic /predictions. pipeline.launch is the launch file for the vision pipeline. Sequentially executes the following ros nodes :

  • top_view
  • gslicr_ros
  • classifier
  • masker

gslicr_ros

gSLICr is a GPU accelerated implementation of SLIC (Simple Linear Iterative Clustering) for real-time superpixel segmentation of images.

Modified for averaging of colors of pixels in each superpixel.

gslicr_ros is the ROS implementation of gSLICr. It subscribes to the top_view image and publishes

  • averaged rgb values of superpixels on the rostopic /gslicr/averages
  • superpixel id of each pixel on the rostopic /gslicr/segmentation

masker

This package contains a node 'masker_node' that simply takes all the predictions from the classifer and all the superpixel id from gSLICr and masks the corresponding superpixels with the prediction values. It finally publishes the binary image on the rostopic /final_image.

Masked Image

top_view

This node takes IMU sensor data to dynamically perform inverse perspective transform to get the top view of camera images and publishes the transformed image to the rostopic /top_view.

Transformed Image

zed-ros-wrapper

ZED ROS wrapper lets you use the ZED stereo camera with ROS. It outputs the camera left and right images, depth map, point cloud, odometry information and supports the use of multiple ZED cameras.