We are the BenchBotics! An amazing team working together from several different locations around the United States and the world. We have deployed a great use case for the OAK-D Camera system for one of our main projects: "The BenchBot".
Please take a look at the folders within the "Code Section" to replicate the use of the camera in similar conditions. This system is totally open-source. For more details and a longer description per section, please visit our Wiki page.
Here is a brief description, enjoy this repo as much as we enjoyed this deployment.
The BenchBot is a plant phenotyping platform, which consists of two major components: a semi-automatic image acquisition device and a central processing unit to control the platform and camera movement. The BenchBot is low-cost, modular, upgradeable, portable, and easy to use. Specifically, the BenchBot can be adjusted to work in benches of different dimensions and the camera height can be changed to accommodate plants of different heights and sizes. We are currently examining image acquisition and processing approaches that work best under greenhouse conditions(i.e. high levels of light and heat). Furthermore, we are developing image-processing algorithms needed to detect and identify plants, detect leaves, determine leaf area and estimate plant biomass.
Our first prototype consisted of a frame that can be moved along greenhouse benches with a mounted camera system (camera and lights) that stops at each potted plant to take individual RGB and depth images. We are currently developing the semi-autonomous system, which requires minimal human intervention. Expected products include a stable control application and a suitable database that enables biomass measurements and plant detection algorithms. We are also working on full automation of the platform and image acquisition. We anticipate broad adoption of this technology among public and private plant breeders.
It is possible to install different kind of cameras under 5 kg directly to the top slider. First testing was with D-435 Intel RGB-D camera, and now we are submitting the results using the OAK-D camera within the second OpenCV AI competition.
The second BenchBot version has integrated a mechanical system to adjust the BenchBot structure to different bench sizes. Also, this new design has motorized wheels with control system to automatize its movement along the bench.
