/DMD-Driver-Monitoring-Dataset

DMD - Driver Monitoring Dataset

Primary LanguagePython

Driver Monitoring Dataset (DMD)

The Driver Monitoring Dataset is the largest visual dataset for real driving actions, with footage from synchronized multiple cameras (body, face, hands) and multiple streams (RGB, Depth, IR) recorded in two scenarios (real car, driving simulator). Different annotated labels related to distraction, fatigue and gaze-head pose can be used to train Deep Learning models for Driver Monitor Systems.

This project includes a tool to annotate the dataset, inspect the annotated data and export training sets. Output annotations are formatted using OpenLABEL language VCD (Video Content Description).

Dataset details

More details of the recording and video material of DMD can be found at the official website

In addition, this repository wiki has useful information about the DMD dataset and the annotation process.

Available tools:

  • Temporal Annotation Tool (TaTo) - (more info here)
  • Dataset Explorer Tool (DEx) - (more info here)

Annotation Instructions

Depending the annotation problem, different annotation criteria should be defined to guarantee all the annotators produce the same output annotations.

We have defined the following criteria to be used with tool to produce consistent annotations:

Known Issues

  • The version of OpenLABEL in the annotation files (OpenLabel) and in the tools in this repository has been updated to VCD>=5.0. Make sure you download the annotations files again and update the tools.
  • There was an error when uploading IR videos. They have to be .mp4 format, and they were uploaded as .avi. This is fixed now but requires the user to download them again.

Credits

Development of DMD was supported and funded by the European Commission (EC) Horizon 2020 programme (project VI-DAS, grant agreement 690772)

Developed with 💙 by:

Contributions of ideas and comments: Marcos Nieto, Mikel Garcia, Gonzalo Pierola, Itziar Sagastiberri, Itziar Urbieta, Eneritz Etxaniz, Orti Senderos.

License

Copyright ©️ 2024 Vicomtech

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.