Welcome to Jetson Orin NANO Developer Kit repository
06.Person semantic segmentation
TAO PeopleSemSegNet Human Semantic Segmentation
TAO PeopleSemSegNet Human Semantic Segmentation1. Case Goal and Processing Flow2. Pre-Run Checks3. Starting Detection4. USB Camera Real-Time Detection4.1 Direct Run4.2 Common Parameters5. CSI Camera Real-Time Detection5.1 Direct Run5.2 Common Parameters6. Common Issues
Applicable environment: Jetson Orin Nano, JetPack 7.2.1, DeepStream 9.1
After setting the power mode to MAXN, running the case may pop up an over-current warning; just ignore it.
1. Case Goal and Processing Flow
Semantic segmentation predicts a class for every pixel. This model classifies pixels into person/background, does not distinguish adjacent person instances, and does not output identity IDs.
video/USB/CSI → PeopleSemSegNet mask → person/background → semi-transparent overlay on the original frame → desktop/VNC preview2. Pre-Run Checks
xxxxxxxxxxcd ~/DeepStream/tao-toolkit-shell-demols -lh video_in/bodypose3d_test.mp4Operate in a Jetson desktop or VNC graphical session. In video mode, check that the material exists; in USB/CSI modes, use the connected real-time camera entry.
3. Starting Detection
xxxxxxxxxx./run_video.sh peoplesemThe application uses the demo-specific bin/ds-tao-segmentation-overlay to overlay the mask on the preview frame:

The current -d display mode only previews and does not generate a segmentation MP4 in video_out/. Wait for the process to exit when playback ends naturally; to stop early, press Ctrl+C once and wait for the pipeline to wrap up.
Replacing the test video: the input is video_in/bodypose3d_test.mp4. When replacing, place the new file at the path referenced by the current video configuration, or check the configuration and then modify the URI; confirm the Jetson can decode it before running. Keep the original material to avoid unrecoverable direct overwriting.
4. USB Camera Real-Time Detection
4.1 Direct Run
USB mode supports live preview. The dedicated camera entry feeds frames to the application through a local RTSP relay; do not treat the video file output path as camera recording results.
After confirming the USB camera device node exists, run:
xxxxxxxxxxls -l /dev/video*cd ~/DeepStream/tao-toolkit-shell-demo./run_usb.sh peoplesem
4.2 Common Parameters
Before running, you can check the formats, resolutions, and frame rates supported by the camera:
xxxxxxxxxxv4l2-ctl -d /dev/video0 --list-formats-ext
Note: the USB pipeline of Object Embedding Vector Generation is fixed to MJPEG, so among the parameters below, choose the MJPEG parameters
x# View all parameters./run_usb.sh peoplesem --help
# Use another video device./run_usb.sh peoplesem --device /dev/video1
# Choose from the configurations found above that the camera supports; here we use 1280×720, 60FPS./run_usb.sh peoplesem --width 1280 --height 720 --fps 605. CSI Camera Real-Time Detection
5.1 Direct Run
CSI mode supports live preview; the entry captures via Argus and sends frames into the dedicated application through a local RTSP relay.
xxxxxxxxxxcd ~/DeepStream/tao-toolkit-shell-demo./run_csi.sh peoplesem
USB/CSI stream continuously and will not end naturally. To stop, press Ctrl+C once in the launching terminal, wait for the application and camera relay to exit, then start other camera tasks.
5.2 Common Parameters
Before running, you can check the formats, resolutions, and frame rates supported by the camera; this must be run in a graphical interface:
xxxxxxxxxxgst-launch-1.0 nvarguscamerasrc
xxxxxxxxxx# View all parameters./run_csi.sh peoplesem --help
# Use the second CSI camera./run_csi.sh peoplesem --sensor-id 1
# Adjust input size and frame rate./run_csi.sh peoplesem --width 1920 --height 1080 --fps 306. Common Issues
| Symptom | Check and Handling |
|---|---|
| No preview | Check the graphical session, input path, model configuration, and the dedicated overlay binary. |
| Missed or flickering segmentation regions | Affected by viewing angle, occlusion, person scale, and the training data domain; transparency only changes the display effect. |
| Recording file not found | The current entry is designed to preview only and does not generate an MP4. |
| No USB/CSI image | First distinguish unknown parameter/old launch script errors from camera streaming failure; check the corresponding entry, camera occupancy, driver, and graphical session. |