- This demo is based on RKNN and OpenCV-Mobile for image capture, image processing, and image recognition inference.
- The inference results can be displayed on a TFT screen or terminal.
- Model conversion scripts based on RKNN-Toolkit2 are provided.
- This convolutional neural network inference demo is specifically designed for the Luckfox Pico series development boards.
Demo | System | Camera | Screen |
---|---|---|---|
luckfox_pico_retinaface_facenet | Buildroot | sc3336 | Pico-1.3-LCD LF40-480480-ARK |
luckfox_pico_retinaface_facenet_spidev | Buildroot | sc3336 | Pico-ResTouch-LCD-2.8 Pico-ResTouch-LCD-3.5 |
luckfox_pico_yolov5 | Buildroot | sc3336 | Pico-1.3-LCD LF40-480480-ARK |
Note: The Luckfox Pico supports different screens. You can refer to the Compatibility List for details. If a compatible screen is not available, you can also view the inference results via the terminal.
- Set environment variables
Note: Use the absolute path.
export LUCKFOX_SDK_PATH=<path to luckfox-pico SDK>
- Obtain the repository source code and set execution permissions for the automatic build script
chmod a+x ./build.sh ./build.sh
- After running
./build.sh
, select the demo to compile1) luckfox_pico_retinaface_facenet 2) luckfox_pico_retinaface_facenet_spidev 3) luckfox_pico_yolov5 Enter your choice [1-3]:
- The
luckfox_pico_retinaface_facenet_spidev
option is specifically adapted for Pico-ResTouch-LCD. You need to select the Luckfox Pico model to determine the pin configuration.1) LUCKFOX_PICO_PLUS 2) LUCKFOX_PICO_PRO_MAX Enter your choice [1-2]:
- After compilation, the corresponding deployment folder will be generated in the
install
directory (referred to as<Demo Dir>
below).luckfox_pico_retinaface_facenet_demo luckfox_pico_retinaface_facenet_spidev_pro_max_demo luckfox_pico_retinaface_facenet_spidev_plus_demo luckfox_pico_yolov5_demo
- Upload the generated
<Demo Dir>
to the Luckfox Pico (using adb, ssh, etc.), and then run:# Run on the Luckfox Pico board, where <Demo Target> is the executable in the deployment folder cd <Demo Dir> chmod a+x <Demo Target>
- luckfox_pico_retinaface_facenet
./luckfox_pico_retinaface_facenet <retinaface model> <facenet model> <reference image> #Example: ./luckfox_pico_retinaface_facenet ./model/RetinaFace.rknn ./model/mobilefacenet.rknn ./model/test.jpg
- luckfox_pico_retinaface_facenet_spidev
./luckfox_pico_retinaface_facenet_spidev <retinaface model> <facenet model> <reference image> #Example: ./luckfox_pico_retinaface_facenet_spidev ./model/RetinaFace.rknn ./model/mobilefacenet.rknn ./model/test.jpg
- luckfox_pico_yolov5
./luckfox_pico_yolov5 <yolov5 model> #Example: ./luckfox_pico_yolov5 ./model/yolov5.rknn
- Before running the demo, please execute
RkLunch-stop.sh
to stop the default background processrkicp
that is started by Luckfox Pico at boot, releasing the camera for use. - The RKNN models and related configuration files for the demos are placed in the
<Demo Dir>/model
directory, allowing for quick validation.