This project demonstrates the Opsero RPi Camera FMC used to connect 4x Raspberry Pi cameras (or compatible cameras) to one of the target FPGA/MPSoC boards listed below. The designs contain:
- 4x MIPI CSI capture pipelines
- VVAS MultiScaler kernel for hardware accelerated image processing
- Video Mixer IP based display pipeline to DisplayPort output
- Video Codec Unit (VCU)
The high level block diagram below illustrates the design:
The video pipe sub-blocks are illustrated below:
Important links:
- The RPi Camera FMC datasheet
- The user guide for these reference designs
- To report an issue
- For technical support: Contact Opsero
This project is designed for version 2022.1 of the Xilinx tools (Vivado/Vitis/PetaLinux). If you are using an older version of the Xilinx tools, then refer to the release tags to find the version of this repository that matches your version of the tools.
In order to test this design on hardware, you will need the following:
- Vivado 2022.1
- Vitis 2022.1
- PetaLinux Tools 2022.1
- Linux PC for build
- One or more Raspberry Pi Camera Module 2 and/or Digilent Pcam 5C cameras
- 1x RPi Camera FMC
- 1x DisplayPort monitor that supports 1080p video
- One of the supported target boards listed below
| Target board | Target design | FMC slot used | Cameras | VCU |
|---|---|---|---|---|
| ZCU104 | zcu104 |
LPC | 4 | YES |
| ZCU102 | zcu102_hpc0 |
HPC0 | 4 | NO |
| ZCU102 | zcu102_hpc1 |
HPC1 | 2 (note 1) | NO |
| ZCU106 | zcu106_hpc0 |
HPC0 | 4 | YES |
| PYNQ-ZU | pynqzu |
LPC | 2 (note 2) | NO |
| Genesys-ZU | genesyszu |
LPC | 2 (note 2) | YES |
| UltraZed EV carrier | uzev |
HPC | 4 | YES |
Notes:
- The HPC1 connector of the ZCU102 board can only support 2 cameras due to it's pin assignment. This design
supports the
CAM0andCAM1slots as labelled on the RPi Camera FMC. - The
pynqzuandgenesyszutarget designs have video pipelines for only 2 cameras:CAM1andCAM2as labelled on the RPi Camera FMC. This is due to the resource limitations of the devices on these boards.
This repo contains submodules. To clone this repo, run:
git clone --recursive https://github.com/fpgadeveloper/rpi-camera-fmc.git
Source Vivado and PetaLinux tools:
source <path-to-petalinux>/2022.1/settings.sh
source <path-to-vivado>/2022.1/settings64.sh
Build all (Vivado project, accelerator kernel and PetaLinux):
cd rpi-camera-fmc/PetaLinux
make petalinux TARGET=uzev
We strongly encourage community contribution to these projects. Please make a pull request if you would like to share your work:
- if you've spotted and fixed any issues
- if you've added designs for other target platforms
- if you've added software support for other cameras
Thank you to everyone who supports us!
- Develop PYNQ support
- Get a Genesys-ZU board and test the design on hardware.
- Software support for more cameras (this will be an ongoing task due to the number of cameras available).
Opsero Inc. is a team of FPGA developers delivering FPGA products and design services to start-ups and tech companies. Follow our blog, FPGA Developer, for news, tutorials and updates on the awesome projects we work on.