yahboom
HomeTutorialsProduct
Solution
Blog
Online Store
About Us
EN/中文
Store
Jetson Orin NANO Developer Kit📖
01.Get started
  • 01. Learning route
  • 02. Get started quickly
  • 03. System Update Notes
  • 04. Disabling automatic updates and troubleshooting issues
  • 05. Jetson Orin Nano official kit screwdriver instructions
02.Jetson basic course
  • 01.Jetson board introduction
  • 02.Write Jetson original system
  • 03.Installing Jetson environment
  • 04.Backup SSD system
  • 05.Restore initial image system
  • 06.Upgrade to SUPER version (Optional)
  • 07.Write SUPER boot (Must read)
  • 08.SSD expansion
  • 09.Jetpack old system upgraded to Yahboom SUPER factory system
  • 10.Write the system onto your own SSD
03.Basic setting course
  • 01.Basic knowledge
  • 02.Network configuration
  • 03.SSH remote login
  • 04.VNC remote control
  • 05.RDP remote control
  • 06.Remote file transfer
  • 07.Jtop tool
  • 08.Exchange space expansion
  • 09.Use VSCode
  • 10.Use VMware
  • 11.Modify screen resolution
04.GPIO control course
  • 01.GPIO description
  • 02.GPIO library installation
  • 03.GPIO reading
  • 04.GPIO output
  • 05.Serial communication
  • 06.I2C communication
05.Vision basic course
  • 01.CSI camera preview
  • 02.USB camera preview
  • 03.Use Jupyter Lab
  • 04.Use JetCam
06.OpenCV basic course
  • 01.Image reading
  • 02.Image saving
  • 03.Image modification
  • 04.Image scaling
  • 05.Image cropping
  • 06.Image translation
  • 07.Image mirroring
  • 08.Image grayscale conversion
  • 09.Image binarization
  • 10.Image edge detection
  • 11.Add line segments
  • 12.Add rectangles
  • 13.Add circular shape
  • 14.Add ellipses
  • 15.Add polygons
  • 16.Add Text
  • 17.Preview USB camera image
  • 18.Preview CSI camera image
07.Vision advanced course
01.Environment construction
  • 01.TensorFlow
  • 02.PyTorch
  • 03.Torchvision
02.DeepStream development
  • 01.DeepStream environment
  • 02.License plate detection and recognition
  • 03.Parallel multi-model inference
  • 04.Object embedding vector generation
  • 05.Pose recognition
  • 06.NV optical flow anomaly detection
  • 07.Single-view 3D tracking
  • 08.Multi-view 3D tracking
03.NVIDIA TAO toolkit application
  • 01.Traffic scene object detection
  • 02.Person object detection
  • 03.Vehicle brand classification
  • 04.Vehicle model classification
  • 05.License plate detection and recognition
  • 06.Person semantic segmentation
  • 07.Retail product detection and recognition
  • 08.Person feature extraction and matching (ReID)
  • 09.Person action and pose classification
  • 10.Transformer-based person detection
  • 11.3D human skeleton detection
  • 12.LiDAR 3D point cloud detection
04.YOLO11 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
05.Mediapipe development
  • 01.Mediapipe environment
  • 02.Hand detection
  • 03.Face detection
  • 04.Face effects
  • 05.3D object recognition
  • 06.Virtual brush
  • 07.Gesture recognition
  • 08.Finger control
  • 09.Posture estimation
  • 10.Face mask
  • 11.Overall detection
  • 12.Green scene removal(Human)
06.YOLO26 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
07.QR code recognition
  • QR code recognition
08.Docker basic course
  • 01.Docker introduction
  • 02.Docker installation
  • 03.Docker command
  • 04.Docker usage
  • 05.Docker interaction
09.ROS2-Jazzy
01.ROS2 basic course
  • 1.Introduction to ROS2
  • 2.ROS2 install Jazzy
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
02.ROS2 vision course
  • 01.Camera preview (USB)
  • 02.Camera preview (CSI)
  • 03.Camera calibration (USB)
  • 04.Camera calibration (CSI)
  • 05.AR vision (USB)
  • 06.AR vision (CSI)
10.Large model basic course
01.Offline large model
  • 01.AI large model environment deployment
  • 02.Install large model dialogue platform
  • 03.Meta AI - Llama model
  • 04.Alibaba Cloud - Qwen model
  • 05.Microsoft - Phi-4-mini model
  • 06.DeepSeek - DeepSeek model
  • 07.Alibaba Cloud - Qwen-VL visual multimodal large model
  • 08.Google - Gemma visual multimodal large model
  • 9.Llava visual multimodal large model
  • 10.MiniCPM-V visual multimodal large model
  • 11.High-quality vision-language grounding (LocateAnything)
02.Online large model
  • 01.Tongyi Qianwen large model
  • 02.OpenRouter large model API aggregation platform
11.Large model application practice
01.Voice interaction application
  • 1.Voice interaction hardware connection (Must read)
  • 2.Offline speech to text (ASR)
  • 3.Offline text to speech (TTS)
  • 4.AI large model voice interaction
  • 5.AI large model offline voice assistant
02.Multimodal large model application (Online_Offline large model + Text_Voice interaction)
  • 01.Multimodal visual understand application
  • 02.Multimodal text image application
  • 03.Multimodal video analysis application
  • 04.Multi module visual position application
  • 05.Multimodal table scanning application
  • 06.Multimodal autonomous agent application
12.NVIDIA Isaac ROS course
  • 01.Build Isaac ROS environment
  • 02.Deep segmentation
  • 03.DNN stereoscopic depth
  • 04.Free space segmentation
  • 05.Image distortion processing
  • 06.Image segmentation
  • 07.3D scene reconstruction and mapping
  • 08.Object detection
  • 09.3D attitude estimation
  • 10.Visual SLAM
13.OpenClaw deployment and basic usage
01.OpenClaw deployment and introduction
  • 01.Quick start with the pre-configured environment (Recommended)
  • 02.OpenClaw Deployment
  • 03.OpenClaw WhatsApp Plugin Application
  • 04.OpenClaw WebChat Interaction
  • 05.OpenClaw TUI Interaction
  • 06.OpenClaw Tools Introduction
  • 07.OpenClawGate Gateway User Manual
  • 08.OpenClaw Features Overview
  • 09.OpenClawHub Introduction (Skill Installation)
02.OpenClaw basic application
  • 01.OpenClaw Application - File Management
  • 02.OpenClaw Application - Camera
  • 03.OpenClaw Application - Browser Control
  • 04.OpenClaw Application - Script Execution
  • 05.OpenClaw Application - AI Programming (Peripheral & GPIO Control)
  • 06.OpenClaw Application - Dedicated AI Assistant
  • 07.OpenClaw Web Search Capability Configuration
03.NVIDIA official Agent Skills application
  • 01.AI-assisted development with VS Code or Cursor
  • 02.Jetson device skills
  • 03.Jetson BSP custom agent skills
14.OpenClaw advanced development
01.Preparation Before Use
  • 01.Peripheral Hardware Configuration
  • 02.OpenClaw API-KEY Configuration
  • 03.OpenClaw Model Switching
  • 04.OpenClaw Prompts
  • 05.AI Voice Interaction Configuration
  • 06.Three Dialogue Configuration Tests
02.OpenClaw AI Programming Peripheral Control
  • 1. Servo Control
  • 2. RGB Strip
  • 3. OLED Display
  • 4. Temperature and Humidity Sensor
  • 5. Camera Application
  • 6. AI Script Peripheral Control
03.OpenClaw Peripheral Integration Applications
  • 1. Plant Care Assistant
  • 2. AI Calorie Estimation
  • 3. AI Rock Paper Scissors Game
  • 4. AI Pet
  • 5. AI Weather Station
  • 6. Temperature Humidity Dashboard
  • 7. Scheduled Tasks
Download
  • System_File
  • VMFile_BootFile
  • 3D Model File
  • DataSheet
  • Software_Tools
  • Code
  • Manual
Download ZIP

Welcome to Jetson Orin NANO Developer Kit repository

05.Pose recognition

DeepStream Human Pose Recognition and Action Classification

DeepStream Human Pose Recognition and Action Classification1. Example Goal and Processing Chain2. NVIDIA Official Deployment Method (For Environment Restoration Reference Only)3. Course Script Entry Points and Output Rules4. Local Dual-Video Pose Classification4.1 Running4.2 Changing the Videos4.3 Video Output5. Real-Time Pose Classification with a USB Camera5.1 Direct Run5.2 Common Parameters6. Real-Time Pose Classification with a CSI Camera6.1 Direct Run6.2 Common Parameters7. Notes on the Current Implementation8. Stopping and Troubleshooting

Applicable environment: JetPack 7.2.1, Ubuntu 24.04, DeepStream 9.1, CUDA 13.2, Jetson Orin Nano Super. The factory system has already completed model download, TensorRT engine building, application compilation, and course entry deployment. For normal study, run directly from Section 3; consult Section 2 to restore the environment only when the program, models, or engines are missing.

After the power mode is set to MAXN, running the example may pop up an over-current warning; just ignore it

1. Example Goal and Processing Chain

Based on NVIDIA's official deepstream-pose-classification, this example recognizes persons in the frame, draws the human skeleton, and determines the action category from continuous motion.

The complete processing chain is as follows:

Input video or camera
        ↓
PeopleNet: detect persons
        ↓
NvDCF Tracker: assign and maintain track IDs for persons
        ↓
BodyPose3DNet: output 34 2D/3D body keypoints
        ↓
Pose post-processing: draw the skeleton
        ↓
Temporal preprocessing: accumulate 300 frames of keypoints for the same track ID
        ↓
PoseClassificationNet (ST-GCN): output the action category

The red boxes in the frame are person detection boxes, and the colored line segments and dots are the human skeleton. Text inside the box such as person 3 walking means: person 3 is the Tracker's target ID, and walking is the current action classification result for that target.

This example is not "single-image classification". The input to the action classification model is temporal data of 300 consecutive frames with 34 keypoints per frame. Therefore, when a person first appears, while the keypoint sequence has not yet accumulated enough data, there may only be a person box and a skeleton at first, and the stable action label is displayed later. With 30 FPS input, 300 frames correspond to about 10 seconds of action history.

2. NVIDIA Official Deployment Method (For Environment Restoration Reference Only)

Official source code and README: https://github.com/NVIDIA/DeepStream/tree/main/src/apps/tao_apps/apps/tao_others/deepstream-pose-classification

Source directory:

xxxxxxxxxx
~/DeepStream/src/apps/tao_apps/apps/tao_others/deepstream-pose-classification

The first environment restoration requires Eigen, the CUDA NVTX headers, and the PeopleNet, BodyPose3DNet, PoseClassificationNet, and ReIdentificationNet models. The current system corresponds to CUDA 13.2, and the compile command must specify the version explicitly:

​x
# Create only when /usr/include/Eigen does not exist; the symlink persists and survives reboots
sudo ln -sf /usr/include/eigen3/Eigen /usr/include/Eigen

# Install only when nvtx3/nvToolsExt.h is missing
sudo apt install cuda-nvtx-13-2

cd ~/DeepStream/src/apps/tao_apps/apps/tao_others/deepstream-pose-classification
make CUDA_VER=13.2

On the first run, DeepStream may need to build engines according to the local GPU, CUDA, and TensorRT versions, which takes considerably longer. The current course environment has already generated and verified the required engines; do not casually delete the .engine files under the models/ directory.

3. Course Script Entry Points and Output Rules

The current unified launch script is located at ~/DeepStream/deepstream-shell-demo/:

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
Input SourceLaunch Command
Local dual video./run_video.sh pose
USB camera./run_usb.sh pose
CSI camera./run_csi.sh pose

The real-time window is displayed on the Jetson local desktop or the VNC desktop. All three entry points use the same PeopleNet → Tracker → BodyPose3DNet → PoseClassificationNet model chain; only the input source and the output method differ.

When stopping early in all modes, press Ctrl+C only once, then wait for the terminal to show End of stream and exit automatically. Do not press Ctrl+C repeatedly, close the terminal directly, or use kill -9.

4. Local Dual-Video Pose Classification

4.1 Running

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_video.sh pose

The current course YAML configures two inputs:

xxxxxxxxxx
source-list:
  list: file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_walk.mov;file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_run.mov

Therefore the preview window has one video on each side, each independently performing person detection, skeleton drawing, and action classification; they are not repeated displays of the same frame. The Tiler combines the two streams into one window for simultaneous observation.

4.2 Changing the Videos

Edit the source-list.list of the following file:

xxxxxxxxxx
~/DeepStream/src/apps/tao_apps/configs/app/deepstream_pose_classification_config.yaml

The two videos are separated by a semicolon, for example:

xxxxxxxxxx
source-list:
  list: file:///home/jetson/videos/a.mp4;file:///home/jetson/videos/b.mp4

When only one URI is kept, the program switches to single-stream file input. The path must be an absolute path on the Jetson; MP4/H.264 material that DeepStream can decode easily is recommended.

4.3 Video Output

The video mode previews in real time and simultaneously saves a complete MP4 with detection boxes, skeletons, and action labels:

xxxxxxxxxx
~/DeepStream/src/apps/tao_apps/apps/tao_others/deepstream-pose-classification/out.mp4

The current implementation sends EOS at the first Ctrl+C and exits after the MP4 index has been written. Only after normal playback ends or the EOS wrap-up completes is out.mp4 a complete, playable file.

5. Real-Time Pose Classification with a USB Camera

5.1 Direct Run

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_usb.sh pose

The default parameters fit the commonly used USB UVC camera:

xxxxxxxxxx
Device: /dev/video0
Format: YUY2
Resolution: 640×480
Frame rate: 30 FPS

The USB mode only previews in real time, forces the display sink, and does not create or overwrite the out.mp4 in the pose classification application directory.

5.2 Common Parameters

Before running, you can check the formats, resolutions, and frame rates supported by the camera:

xxxxxxxxxx
v4l2-ctl -d /dev/video0 --list-formats-ext

xxxxxxxxxx
# View all parameters
./run_usb.sh pose --help

# Use another video device
./run_usb.sh pose --device /dev/video1

# Choose among the supported configurations listed above; here 1280×720, 9 FPS is used
./run_usb.sh pose --width 1280 --height 720 --fps 9

The current course entry uses the raw YUY2 format by default. If the camera only supports MJPEG, first confirm the actual format, then add a dedicated decoding adaptation for MJPEG;

6. Real-Time Pose Classification with a CSI Camera

6.1 Direct Run

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_csi.sh pose

The CSI mode uses the Jetson native nvarguscamerasrc, with the default parameters:

xxxxxxxxxx
sensor-id: 0
Resolution: 1280×720
Frame rate: 30 FPS

6.2 Common Parameters

Before running, you can check the formats, resolutions, and frame rates supported by the camera; this needs to be run in a graphical interface:

xxxxxxxxxx
gst-launch-1.0 nvarguscamerasrc

xxxxxxxxxx
# View all parameters
./run_csi.sh pose --help

# Use the second CSI camera
./run_csi.sh pose --sensor-id 1

# Adjust the input size and frame rate
./run_csi.sh pose --width 1920 --height 1080 --fps 30

The current course environment has verified that the CSI entry can complete single-source pipeline initialization, model loading, and the EOS wrap-up; if the terminal reports No cameras available, Argus currently does not recognize a CSI sensor, and the flex cable, camera module, sensor-id, and nvargus-daemon status should be checked.

7. Notes on the Current Implementation

The official example originally creates the input sources from the file URIs in the YAML. Without modifying the video YAML, the course version adds two kinds of camera sources:

xxxxxxxxxx
USB: v4l2src → videoconvert → nvvideoconvert → NVMM
CSI: nvarguscamerasrc → nvvideoconvert → NVMM

The USB/CSI entries select the camera source via environment variables and force the output policy to "preview only"; the local video entry keeps "preview + MP4 recording". This is why the three scripts share the same main program but behave differently in output.

To make the pose classification model correctly receive the upstream data, the course environment also fixed two configuration linkages in the official example:

  1. PeopleNet uses GIE ID 1, BodyPose3DNet/post-processing uses ID 2, and PoseClassificationNet classifies the human pose results of ID 2.

  2. The Tracker uses the ReIdentificationNet TensorRT engine already present in the current environment, avoiding a reference to the legacy missing .etlt model.

These are already fixed in the current environment; when using the course entry points normally, no manual changes are needed.

8. Stopping and Troubleshooting

SymptomPriority Checks
No person box or skeletonWhether the person appears fully in the frame, whether the size is sufficient, and whether the lighting is too dark.
Skeleton present but no action text yetThe 300-frame keypoint sequence of the same person has not finished accumulating; keep the target continuously in the frame.
USB reports Device ... is busyAnother program is using that /dev/video*; close the program occupying the camera and run again.
USB shows no picture or negotiation failsUse v4l2-ctl -d /dev/video0 --list-formats-ext to verify the device number, format, resolution, and frame rate.
CSI reports No cameras availableCheck the CSI module, flex cable, sensor-id, and nvargus-daemon.
Nvdslogger unavailable appearsThe current system lacks the optional OpenTelemetry runtime library; the course program skips the FPS logger, which does not affect pose inference.
Unable to acquire a user meta buffer appearsA known Tracker warning that does not block this example; do not blindly increase the metadata pool, as it may degrade performance.
The video out.mp4 cannot be playedCheck whether it was force-terminated before the EOS wrap-up; run again and wait for End of stream.
Object embedding vector generation
NV optical flow anomaly detection

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文