Virtual brush

MediaPipe is a cross-platform machine learning framework that can process key point detection such as hands, faces, and postures in videos and images in real time.

1. Virtual brush

MediaPipe virtual brush can track finger status through hand detection and switch different modes according to finger status:

When the index finger and middle finger of the right hand are combined, it is the selection state, and the color selection box pops up at the same time. When the two fingertips move to the corresponding color position, the color is selected (black is the eraser);

When the index finger and middle finger are separated, it is the painting state, and you can draw anything on the drawing board.

2. Effect preview

2.1. USB camera

cd ~/mediapipe

xxxxxxxxxx
python3 05.virtual_brush_usb.py

Note: Select the camera screen and press q to exit the program!

2.2, CSI camera

xxxxxxxxxx
cd ~/mediapipe

xxxxxxxxxx
python3 05.virtual_brush_csi.py

Note: Select the camera image and press q to exit the program!