This project demonstrates the Opsero RPi Camera FMC used to connect 4x Raspberry Pi cameras (or compatible cameras) to one of the target FPGA/MPSoC boards listed below. The designs contain:

• 4x MIPI CSI capture pipelines
• VVAS MultiScaler kernel for hardware accelerated image processing
• Video Mixer IP based display pipeline to DisplayPort output
• Video Codec Unit (VCU)

The high level block diagram below illustrates the design:

The video pipe sub-blocks are illustrated below:

Important links:

• The RPi Camera FMC datasheet
• The user guide for these reference designs
• To report an issue
• For technical support: Contact Opsero

This project is designed for version 2022.1 of the Xilinx tools (Vivado/Vitis/PetaLinux). If you are using an older version of the Xilinx tools, then refer to the release tags to find the version of this repository that matches your version of the tools.

In order to test this design on hardware, you will need the following:

• Vivado 2022.1
• Vitis 2022.1
• PetaLinux Tools 2022.1
• Linux PC for build
• One or more Raspberry Pi Camera Module 2 and/or Digilent Pcam 5C cameras
• 1x RPi Camera FMC
• 1x DisplayPort monitor that supports 1080p video
• One of the supported target boards listed below

Notes:

1. The HPC1 connector of the ZCU102 board can only support 2 cameras due to it's pin assignment. This design supports the CAM0 and CAM1 slots as labelled on the RPi Camera FMC.
2. The pynqzu and genesyszu target designs have video pipelines for only 2 cameras: CAM1 and CAM2 as labelled on the RPi Camera FMC. This is due to the resource limitations of the devices on these boards.

This repo contains submodules. To clone this repo, run:

git clone --recursive https://github.com/fpgadeveloper/rpi-camera-fmc.git

Source Vivado and PetaLinux tools:

source <path-to-petalinux>/2022.1/settings.sh
source <path-to-vivado>/2022.1/settings64.sh

Build all (Vivado project, accelerator kernel and PetaLinux):

cd rpi-camera-fmc/PetaLinux
make petalinux TARGET=uzev

We strongly encourage community contribution to these projects. Please make a pull request if you would like to share your work:

• if you've spotted and fixed any issues
• if you've added designs for other target platforms
• if you've added software support for other cameras

Thank you to everyone who supports us!

• Develop PYNQ support
• Get a Genesys-ZU board and test the design on hardware.
• Software support for more cameras (this will be an ongoing task due to the number of cameras available).

Opsero Inc. is a team of FPGA developers delivering FPGA products and design services to start-ups and tech companies. Follow our blog, FPGA Developer, for news, tutorials and updates on the awesome projects we work on.