Multispectral dataset
Please head to dataset for the multispectral images (NIR, Red, and NDVI with their labels).
Due to several requests for raw multi-spectral images (4ch), we unofficially made this available raw dataset (1.8GB) and you can checkout this branch for sample RGB images. Please note that these datasets do not have the corresponding labels and we couldn't guarantee the maintenance of them due to limited resources. Thank you for your understandings and hope this helps.
Training weedNet
If you want to know more about how to train a network (using a caffe framework) with this dataset, here we have an experimental repo that allows you to do this (courtesy by Marija Popovic).
Annotated ground truth images
The annotated ground truth images for training and testing are indexed images meaning that they were filled with class IDs rather than RGB values. For example, the background is 0, crop is 1, and weed is 2. You can directly use these indexed files for model training using Caffe SegNet (or other networks) without any data conversions. If you want to visualize these files (e.g., https://github.com/inkyusa/weedNet/blob/master/data/Sequoia/SequoiaRed_30/testannot/0000.png) the following MATLAB code snippet may help;
im=imread('./0000.png');
plantColor=[0 1 0]; %green
weedColor=[1 0 0]; %red
map=[plantColor;weedColor];
rgb=label2rgb(im,map,[0,0,0]); %label img, map, bg color
imshow(rgb);
Publications
If our work helps your works in an academic/research context, please cite the following publication(s):
- I. Sa, Z. Chen, M. Popovic, R. Khanna, F. Liebisch, J. Nieto and R. Siegwart, "weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming", 2018, IEEE Robotics and Automation Letters or (arxiv pdf)
@ARTICLE{8115245,
author={I. Sa and Z. Chen and M. Popović and R. Khanna and F. Liebisch and J. Nieto and R. Siegwart},
journal={IEEE Robotics and Automation Letters},
title={weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming},
year={2018},
volume={3},
number={1},
pages={588-595},
keywords={agriculture;agrochemicals;autonomous aerial vehicles;control engineering computing;convolution;crops;feature extraction;image classification;learning (artificial intelligence);neural nets;vegetation;MAV;SegNet;convolutional neural network;crop health;crop management;curve classification metrics;dense semantic classes;dense semantic weed classification;encoder-decoder;input image channels;multispectral images;selective weed treatment;vegetation index;weed detection;Agriculture;Cameras;Image segmentation;Robots;Semantics;Training;Vegetation mapping;Aerial systems;agricultural automation;applications;robotics in agriculture and forestry},
doi={10.1109/LRA.2017.2774979},
ISSN={},
month={Jan},}