yahboom
HomeTutorialsProduct
Solution
Blog
Online Store
About Us
EN/中文
Store
Jetson Orin NANO Developer Kit📖
01.Get started
  • 01. Learning route
  • 02. Get started quickly
  • 03. System Update Notes
  • 04. Disabling automatic updates and troubleshooting issues
  • 05. Jetson Orin Nano official kit screwdriver instructions
02.Jetson basic course
  • 01.Jetson board introduction
  • 02.Write Jetson original system
  • 03.Installing Jetson environment
  • 04.Backup SSD system
  • 05.Restore initial image system
  • 06.Upgrade to SUPER version (Optional)
  • 07.Write SUPER boot (Must read)
  • 08.SSD expansion
  • 09.Jetpack old system upgraded to Yahboom SUPER factory system
  • 10.Write the system onto your own SSD
03.Basic setting course
  • 01.Basic knowledge
  • 02.Network configuration
  • 03.SSH remote login
  • 04.VNC remote control
  • 05.RDP remote control
  • 06.Remote file transfer
  • 07.Jtop tool
  • 08.Exchange space expansion
  • 09.Use VSCode
  • 10.Use VMware
  • 11.Modify screen resolution
04.GPIO control course
  • 01.GPIO description
  • 02.GPIO library installation
  • 03.GPIO reading
  • 04.GPIO output
  • 05.Serial communication
  • 06.I2C communication
05.Vision basic course
  • 01.CSI camera preview
  • 02.USB camera preview
  • 03.Use Jupyter Lab
  • 04.Use JetCam
06.OpenCV basic course
  • 01.Image reading
  • 02.Image saving
  • 03.Image modification
  • 04.Image scaling
  • 05.Image cropping
  • 06.Image translation
  • 07.Image mirroring
  • 08.Image grayscale conversion
  • 09.Image binarization
  • 10.Image edge detection
  • 11.Add line segments
  • 12.Add rectangles
  • 13.Add circular shape
  • 14.Add ellipses
  • 15.Add polygons
  • 16.Add Text
  • 17.Preview USB camera image
  • 18.Preview CSI camera image
07.Vision advanced course
01.Environment construction
  • 01.TensorFlow
  • 02.PyTorch
  • 03.Torchvision
02.DeepStream development
  • 01.DeepStream environment
  • 02.License plate detection and recognition
  • 03.Parallel multi-model inference
  • 04.Object embedding vector generation
  • 05.Pose recognition
  • 06.NV optical flow anomaly detection
  • 07.Single-view 3D tracking
  • 08.Multi-view 3D tracking
03.NVIDIA TAO toolkit application
  • 01.Traffic scene object detection
  • 02.Person object detection
  • 03.Vehicle brand classification
  • 04.Vehicle model classification
  • 05.License plate detection and recognition
  • 06.Person semantic segmentation
  • 07.Retail product detection and recognition
  • 08.Person feature extraction and matching (ReID)
  • 09.Person action and pose classification
  • 10.Transformer-based person detection
  • 11.3D human skeleton detection
  • 12.LiDAR 3D point cloud detection
04.YOLO11 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
05.Mediapipe development
  • 01.Mediapipe environment
  • 02.Hand detection
  • 03.Face detection
  • 04.Face effects
  • 05.3D object recognition
  • 06.Virtual brush
  • 07.Gesture recognition
  • 08.Finger control
  • 09.Posture estimation
  • 10.Face mask
  • 11.Overall detection
  • 12.Green scene removal(Human)
06.YOLO26 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
07.QR code recognition
  • QR code recognition
08.Docker basic course
  • 01.Docker introduction
  • 02.Docker installation
  • 03.Docker command
  • 04.Docker usage
  • 05.Docker interaction
09.ROS2-Jazzy
01.ROS2 basic course
  • 1.Introduction to ROS2
  • 2.ROS2 install Jazzy
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
02.ROS2 vision course
  • 01.Camera preview (USB)
  • 02.Camera preview (CSI)
  • 03.Camera calibration (USB)
  • 04.Camera calibration (CSI)
  • 05.AR vision (USB)
  • 06.AR vision (CSI)
10.Large model basic course
01.Offline large model
  • 01.AI large model environment deployment
  • 02.Install large model dialogue platform
  • 03.Meta AI - Llama model
  • 04.Alibaba Cloud - Qwen model
  • 05.Microsoft - Phi-4-mini model
  • 06.DeepSeek - DeepSeek model
  • 07.Alibaba Cloud - Qwen-VL visual multimodal large model
  • 08.Google - Gemma visual multimodal large model
  • 9.Llava visual multimodal large model
  • 10.MiniCPM-V visual multimodal large model
  • 11.High-quality vision-language grounding (LocateAnything)
02.Online large model
  • 01.Tongyi Qianwen large model
  • 02.OpenRouter large model API aggregation platform
11.Large model application practice
01.Voice interaction application
  • 1.Voice interaction hardware connection (Must read)
  • 2.Offline speech to text (ASR)
  • 3.Offline text to speech (TTS)
  • 4.AI large model voice interaction
  • 5.AI large model offline voice assistant
02.Multimodal large model application (Online_Offline large model + Text_Voice interaction)
  • 01.Multimodal visual understand application
  • 02.Multimodal text image application
  • 03.Multimodal video analysis application
  • 04.Multi module visual position application
  • 05.Multimodal table scanning application
  • 06.Multimodal autonomous agent application
12.NVIDIA Isaac ROS course
  • 01.Build Isaac ROS environment
  • 02.Deep segmentation
  • 03.DNN stereoscopic depth
  • 04.Free space segmentation
  • 05.Image distortion processing
  • 06.Image segmentation
  • 07.3D scene reconstruction and mapping
  • 08.Object detection
  • 09.3D attitude estimation
  • 10.Visual SLAM
13.OpenClaw deployment and basic usage
01.OpenClaw deployment and introduction
  • 01.Quick start with the pre-configured environment (Recommended)
  • 02.OpenClaw Deployment
  • 03.OpenClaw WhatsApp Plugin Application
  • 04.OpenClaw WebChat Interaction
  • 05.OpenClaw TUI Interaction
  • 06.OpenClaw Tools Introduction
  • 07.OpenClawGate Gateway User Manual
  • 08.OpenClaw Features Overview
  • 09.OpenClawHub Introduction (Skill Installation)
02.OpenClaw basic application
  • 01.OpenClaw Application - File Management
  • 02.OpenClaw Application - Camera
  • 03.OpenClaw Application - Browser Control
  • 04.OpenClaw Application - Script Execution
  • 05.OpenClaw Application - AI Programming (Peripheral & GPIO Control)
  • 06.OpenClaw Application - Dedicated AI Assistant
  • 07.OpenClaw Web Search Capability Configuration
03.NVIDIA official Agent Skills application
  • 01.AI-assisted development with VS Code or Cursor
  • 02.Jetson device skills
  • 03.Jetson BSP custom agent skills
14.OpenClaw advanced development
01.Preparation Before Use
  • 01.Peripheral Hardware Configuration
  • 02.OpenClaw API-KEY Configuration
  • 03.OpenClaw Model Switching
  • 04.OpenClaw Prompts
  • 05.AI Voice Interaction Configuration
  • 06.Three Dialogue Configuration Tests
02.OpenClaw AI Programming Peripheral Control
  • 1. Servo Control
  • 2. RGB Strip
  • 3. OLED Display
  • 4. Temperature and Humidity Sensor
  • 5. Camera Application
  • 6. AI Script Peripheral Control
03.OpenClaw Peripheral Integration Applications
  • 1. Plant Care Assistant
  • 2. AI Calorie Estimation
  • 3. AI Rock Paper Scissors Game
  • 4. AI Pet
  • 5. AI Weather Station
  • 6. Temperature Humidity Dashboard
  • 7. Scheduled Tasks
Download
  • System_File
  • VMFile_BootFile
  • 3D Model File
  • DataSheet
  • Software_Tools
  • Code
  • Manual
Download ZIP

Welcome to Jetson Orin NANO Developer Kit repository

06.NV optical flow anomaly detection

DeepStream NV Optical Flow and Motion Direction Analysis

DeepStream NV Optical Flow and Motion Direction Analysis1. Example Goal and Processing Chain2. Official Application and Environment3. Running Entry Points4. Local Video Run5. Camera Runs and Hardware Limitations6. Observation and Acceptance7. Stopping and Common Issues8. References

Applicable environment: JetPack 7.2.1, Ubuntu 24.04, DeepStream 9.1, CUDA 13.2, TensorRT 10.16, Jetson Orin Nano Super. The example is based on the NVIDIA DeepStream reference_apps/anomaly. It demonstrates TrafficCamNet object detection, NVIDIA hardware optical flow, and motion direction analysis

After the power mode is set to MAXN, running the example may pop up an over-current warning; just ignore it

1. Example Goal and Processing Chain

This example displays both the detection results and the motion information between adjacent video frames:

Input video/camera
       ↓
Decode and nvstreammux
       ↓
TrafficCamNet object detection
       ↓
nvof hardware optical flow → dsdirection direction analysis
       ↓                       ↓
nvofvisual optical flow preview       Detection/direction information preview

nvof computes pixel motion vectors, nvofvisual renders them into a pseudo-color image, and dsdirection performs direction analysis based on the target motion information. The optical flow window shows motion vectors, not anomaly categories or anomaly probabilities; specific business alerts still require scene rules and application-layer logic.

2. Official Application and Environment

Official reference application: https://github.com/NVIDIA/DeepStream/tree/main/src/apps/reference_apps/anomaly

Source directory:

xxxxxxxxxx
~/DeepStream/src/apps/reference_apps/anomaly/apps/deepstream-anomaly-detection-test

The course device already has the application, the TrafficCamNet model and TensorRT engine, and the unified launch script ready. Daily runs do not require re-downloading models, deleting engines, or recompiling the program. The engines are tied to the TensorRT/CUDA environment on the device; when restoring the environment, check and build on the target Jetson according to the official instructions, and do not directly copy engines generated on other devices.

3. Running Entry Points

The unified launch script is located at:

xxxxxxxxxx
~/DeepStream/deepstream-shell-demo/
Input SourceCommandCurrent Output
Local video./run_video.sh anomalyDetection preview; whether the hardware optical flow works must be verified per Section 5
USB camera./run_usb.sh anomalyReal-time object detection preview; the current configuration bypasses the unavailable PVA optical flow chain
CSI camera./run_csi.sh anomalyReal-time object detection preview; the current configuration bypasses the unavailable PVA optical flow chain

The entry points above only preview, and do not generate or overwrite an MP4. The desktop window requires the Jetson local graphical desktop or a VNC graphical session; a pure SSH session without graphical display cannot view the preview.

4. Local Video Run

Run from the Jetson local desktop or a VNC terminal:

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_video.sh anomaly

The default input is the DeepStream sample video sample_1080p_h264.mp4. A detection window is displayed during the run; devices with available PVA/hardware optical flow should also display the optical flow visualization window. On the first launch, if the log shows the TensorRT engine is being loaded or built, wait for it to complete; do not delete the existing .engine files.

Replacing the test video:

xxxxxxxxxx
./run_video.sh anomaly --source /home/jetson/videos/test.mp4

The path must be an absolute path that exists on the Jetson. To process multiple video streams, you can specify --source repeatedly; the actual input capability is still limited by the course entry and device resources.

5. Camera Runs and Hardware Limitations

USB camera:

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_usb.sh anomaly

CSI camera:

xxxxxxxxxx
cd ~/DeepStream/deepstream-shell-demo
./run_csi.sh anomaly

Before running, confirm that the camera is connected and not occupied by another program. The following commands show the devices and supported formats:

xxxxxxxxxx
v4l2-ctl --list-devices
v4l2-ctl -d /dev/video0 --list-formats-ext      # USB
gst-launch-1.0 nvarguscamerasrc                 # CSI

You can add parameters such as resolution and frame rate yourself. Note: the USB pipeline of LPR is fixed to MJPEG, so when choosing the USB parameters, select the MJPEG ones

​x
# View all parameters
./run_usb.sh anomaly --help
./run_csi.sh anomaly --help

# Use the second CSI camera
./run_usb.sh anomaly --device /dev/video1
./run_csi.sh anomaly --sensor-id 1

# Adjust the input size and frame rate
./run_usb.sh anomaly --width 1280 --height 720 --fps 60
./run_csi.sh anomaly --width 1920 --height 1080 --fps 30

The PVA device node of the current Orin Nano Super system is unavailable. The USB/CSI entries therefore bypass dsdirection and nvof, and only run the TrafficCamNet detection preview; the video entry keeps the official hardware optical flow processing graph.

6. Observation and Acceptance

The detection preview should show the target boxes and categories detected by TrafficCamNet. On devices with hardware optical flow enabled, when an object in the frame moves or the camera moves, the optical flow pseudo-color image should change continuously with the motion; few motion vectors in a static scene is normal.

Acceptance of valid optical flow requires all of the following:

  1. The log contains no persistent PVA device-open errors.

  2. A moving scene produces optical flow results that change over time, rather than fixed noise.

  3. The target boxes in the detection window change with the input frame.

7. Stopping and Common Issues

Press Ctrl+C once in the terminal where the launch command was run, and wait for the program to exit and return to the shell. Do not send interrupt signals repeatedly or use kill -9; the camera can be used by other programs after it exits.

SymptomHandling
Failed to open PVA device nodeThe current hardware/device tree does not provide a usable PVA; the USB/CSI detection preview can continue to be used, but the hardware optical flow cannot pass acceptance.
OF METADATA NOT FOUND or the optical flow window is noiseMeans no valid optical flow metadata was obtained; the window itself does not mean the optical flow succeeded. Check the PVA/driver status.
USB reports the device is busy or shows no pictureUse v4l2-ctl --list-devices and --list-formats-ext to check the device node, format, and occupancy.
CSI reports no camerasCheck the CSI flex cable, sensor, sensor-id, and nvargus-daemon; first confirm the basic CSI example can run.
Only a window, no target boxesCheck whether the targets are clearly visible and the lighting is sufficient, and confirm the TrafficCamNet engine loads normally.
No window after launching over SSHRun from the Jetson desktop/VNC session, and check DISPLAY and X11 authorization.
The usb/csi optical flow window does not show a personThe person needs to move; only continuous changes produce a response

8. References

  • NVIDIA DeepStream Anomaly Detection: https://github.com/NVIDIA/DeepStream/tree/main/src/apps/reference_apps/anomaly

  • NVIDIA DeepStream SDK: https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html

Pose recognition
Single-view 3D tracking

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文