Virtual Brush

MediaPipe is a cross-platform machine learning framework that can process keypoint detection of hands, faces, poses, etc. in videos and images in real time.

1. Virtual Brush

MediaPipe virtual brush can track the finger state through hand detection and switch between different modes based on the finger state:

When the index finger and middle finger of the right hand are together, it is the selection state, and a color picker pops up at the same time. When the two fingertips move to the corresponding color position, that color is selected (black is the eraser);

When the index finger and middle finger are apart, it is the drawing state, and you can draw freely on the canvas.

2. Effect Preview

2.1 USB Camera

cd ~/mediapipe

xxxxxxxxxx
python3 05.virtual_brush_usb.py

Note: Click on the camera window and press q to exit the program!

2.2 CSI Camera

xxxxxxxxxx
cd ~/mediapipe

xxxxxxxxxx
python3 05.virtual_brush_csi.py

Note: Click on the camera window and press q to exit the program!