VersaVIS -- An Open Versatile Multi-Camera Visual-Inertial Sensor Suite
VersaVIS provides a complete, open-source hardware, firmware and software bundle to perform time synchronization of multiple cameras with an IMU featuring exposure compensation, host clock translation and independent and stereo camera triggering.
Supported camera drivers
- Basler (not open-source) tested with acA1920-155uc
- MatrixVision tested with Bluefox 2 MLC200WG, needs adaption for new format
- PointGrey/Flir tested with Chameleon 3, Blackfly S
- CamBoard tested with CamBoard pico monstar
Citing
Please cite the following paper when using VersaVIS for your research:
@article{Tschopp2020,
author = {Tschopp, Florian and Riner, Michael and Fehr, Marius and Bernreiter, Lukas and Furrer, Fadri and Novkovic, Tonci and Pfrunder, Andreas and Cadena, Cesar and Siegwart, Roland and Nieto, Juan},
doi = {10.3390/s20051439},
journal = {Sensors},
number = {5},
pages = {1439},
publisher = {Multidisciplinary Digital Publishing Institute},
title = {{VersaVIS—An Open Versatile Multi-Camera Visual-Inertial Sensor Suite}},
url = {https://www.mdpi.com/1424-8220/20/5/1439},
volume = {20},
year = {2020}
}
Additional information can be found here.
Install
Clone and build
cd ~/catkin_ws/src/
git clone git@github.com:ethz-asl/versavis.git --recursive
catkin build versavis
cd versavis/firmware
./setup.sh
Setup udev rule
Add yourself to dialout
group
sudo adduser <username> dialout
Copy udev rule file to your system:
sudo cp firmware/98-versa-vis.rules /etc/udev/rules.d/98-versa-vis.rules
Afterwards, use the following commands to reload the rules
sudo udevadm control --reload-rules
sudo udevadm trigger
sudo ldconfig
Note: You might have to reboot your computer for this to take effect. You can check by see whether a /dev/versavis
is available and pointing to the correct device.
Configure
Adapt the configuration file to your setup needs. Also check the datasheet for how to configure the hardware switches.
Flash firmware on the VersaVIS board
- Install the arduino IDE from here. Use version 1.8.2!
- Open
firmware/versavis/versavis.ino
in the IDE - Go to
File -> Preferences
- Change Sketchbook location to
versavis/firmware/
- Install board support:
- For AVI 2.1 (the green one): Tools -> Boards -> Boards Manager -> Arduino SAMD Boards (32-bits ARM Cortex-M0+) -> Use version 1.6.20!
- For VersaVIS 1.0 (the black one): Check here
- Set
Tools -> Port -> tty/ACM0 (Arduino Zero)
, andTools -> Board -> VersaVIS
. - Compile using the Verify menu option
- Flash using the Upload menu option
Calibration
Typically, a VI Setup needs to be carefully calibrated for camera intrinsics and camera-camera extrinsics and camera-imu extrinsics. Refer to Kalibr for a good calibration framework. Note: To enable a good calibration, a high-quality calibration target needs to be available. Furthermore, a good and uniform light source is needed in order to reduce motion blur, especially during camera-imu calibration.
Usage
- Adapt
versavis/launch/run_versavis.launch
to your needs. - Run with
roslaunch versavis run_versavis.launch
- Wait for successfull initialization.
Troubleshooting
My sensor is stuck at initialization
Main symptoms are:
- No IMU message published.
- Cameras are not triggered or only very slowly (e.g. 1 Hz).
Troubleshooting steps:
- Check that your camera receives a triggering signal by checking the trigger LED (Note: As the trigger pulse is very short, look for a dim flicker.).
- Check that all topics are correctly set up and connected.
- If the USB3 blackfly is powered over the Hirose plug, there seems to be a longer delay (0.2s+) until the image arrives on the host computer. Initialization does not succeed because it only allows successful synchronization if the image message is not older than 0.1s compared to the time message coming from the triggering board. With power over USB things seem to work fine. One can increase the threshold kMaxImageDelayThreshold but keep in mind that
kMaxImageDelayThreshold >> 1/f_init
. Decrease initialization frequencyf_init
if necessairy.
The board is not doing what I expect / How can I enter debug mode
Easiest way to debug is to enable DEBUG
mode in firmware/libraries/versavis/versavis_configuration.h
and check the debug output using the Arduino Serial Monitor or screen /dev/versavis
.
Note: In debug mode, ROS/rosserial communication is deactivated!
/versavis/imu
I don't get any IMU messages on This is normal during initialization as no IMU messages are published. Check Inintialization issues for further info.
After uploading a new firmware, I am unable to communicate with the VersaVIS board
This is most likely due to an infinite loop in the code in an error case. Reset the board by double clicking the reset button and upload your code in DEBUG
mode. Then check your debug output.
IMU shows strange data or spikes
To decrease the bandwidth between VersaVIS and host but keep all information, only the IMu raw data is transferred and later scaled. If there is a scale offset, adapt the scale/sensitivity parameters in your launch file.
Depending on the IMU, recursive data grabbing is implemented with a CRC or temperature check. If this fails multiple time, the latest message is used. Check your IMU if this persists.
It looks like my exposure time is not correctly compensated
Check whether your board can correctly detect your exposure time in the debug output. Troubleshooting steps:
- Enable exposure/strobe output on your camera.
- Check that all dip switches are set according to the datasheet.
- Check that the exposure LED on the board flashes with exposure time.