ESP32 Cam and Edge Impulse

How to run custom inference on a ESP32 cam using Edge Impulse.

Material

This code has been tested the AI Thinker ESP32 Cam module. It should work the same with the Wrover board or an board that has PSRAM.

To use this board, please select your board in the Arduino code the following lines:

// Select camera model

#define CAMERA_MODEL_WROVER_KIT // Has PSRAM
//#define CAMERA_MODEL_ESP_EYE // Has PSRAM
//#define CAMERA_MODEL_M5STACK_PSRAM // Has PSRAM
//#define CAMERA_MODEL_M5STACK_V2_PSRAM // M5Camera version B Has PSRAM
//#define CAMERA_MODEL_M5STACK_WIDE // Has PSRAM
//#define CAMERA_MODEL_M5STACK_ESP32CAM // No PSRAM
//#define CAMERA_MODEL_AI_THINKER // Has PSRAM
//#define CAMERA_MODEL_TTGO_T_JOURNAL // No PSRAM

Steps

Create your Image Classification model using Edge Impulse.

Due to the board limitations, you may need to train your model with 48x48 images and use the MobileNetV2 0.05:

Download the Arduino library under the Deployment tab in the Edge Impulse studio

Basic Image Classification Example

Note: This project does not do a proper resize of the image capture but cutout the data

Open the Basic-Image-Classification.ino file under the /Basic-Image-Classification folder.
Import the .zip library you have downloaded from Edge Impulse Studio
Change the #include <esp32-cam_image-classification_inference.h> line according to your project name.
Compile and deploy the code to your board
Open the serial monitor and use the provided IP to capture an image and run the inference:

Advanced Image Classification Example

Note: Here we use the ESP SDK to resize the image in RGB888 format using the bilinear interpolation technique. You can see the funtion declaration on Espressif's Github repository.

Open the Basic-Image-Classification.ino file under the /Advanced-Image-Classification folder.
Set your WIFI credentials
Navigate to the app_httpd.cpp tab.
Import the .zip library you have downloaded from Edge Impulse Studio like on the previous example:
Change the #include <euros_coins_classification_inference.h> line according to your project name.
Compile and deploy the code to your board
Open the serial monitor and use the provided IP to capture an image and run the inference:
On your brower navigate to the IP provided by your Serial Console
Use the toggle button to activate the Edge Impulse Inference (you need to select an image resolution lower or equal to QVGA).
Click on Run inference:

Ressources