yahboom
HomeLearn
Solution
Blog
Online Store
About Us
EN/中文
AI View Depth camera📖
01.Linux basic course
  • 1.Introduction to Linux system
  • 2.Ubuntu file system
  • 3.Ubuntu common commands
  • 4.Ubuntu common editors
  • 5.Ubuntu software operation commands
  • 6.Virtual machine installation
  • 7.SSH remote control
  • 8.VNC remote control
  • 9.Transfer files remotely
  • 10.Driver library and communication
  • 11.Static IP and hotspot mode
  • 12.Bind device ID
  • 13.Capacity expansion and resource allocation
  • 14.Update system software sources
  • 15.Set root user password
  • 16.sudo free password
  • 17.Connect to WiFi network
  • 18.View system version
  • 19.Customized service management
  • 20.Back up system image
02.ROS1-camera usage course
  • 1. Camera usage instructions
  • 2. Environment Construction
  • 3. Camera recording video
03.ROS1-OpenCV course
  • 1.Opencv Source CV Introduction
  • 2.Image reading and display
  • 3.Picture writing
  • 4.Picture Quality
  • 5.Pixel Operation
  • 6.Picture scaling
  • 7.Picture cutting
  • 8.Picture translation
  • 9.Picture mirroring
  • 10.Affine transformation
  • 11.Picture rotation
  • 12.Perspective transformation
  • 13.Grayscale processing
  • 14.Image binarization
  • 15.Edge detection
  • 16.Line segment drawing
  • 17.Rectangle and circle drawing
  • 18.Text and picture drawing
4.ROS1-basic course
  • 1.ROS introduction
  • 2.ROS installation
  • 3.ROS common command tools
  • 4.ROS workspace
  • 5.ROS function package
  • 6.ROS node
  • 7.ROS topic publisher
  • 8.ROS topic subscribers
  • 9.ROS service client
  • 10.ROS service server
  • 11.ROS action client
  • 12.ROS action server
  • 13.ROS custom message reception
  • 14.ROS-launch file
  • 15.ROS-TF transformation
  • 16.ROS parameter service
  • 17.ROS-rviz use
  • 18.ROS-rqt tool usage
  • 19.Topic message recording and playback
  • 20.urdf model introduction
  • 21.gazebo introduction
  • 22.ROS distributed communication
5.ROS1-Mediapipe course
  • 1.Hand detection
  • 2.Posture detection
  • 3.Overall detection
  • 4.Face detection
  • 5.Face recognition
  • 6.Face effects
  • 7.3D object recognition
  • 8.Brush
  • 9.Finger control
  • 10.Gesture recognition
6.ROS+Opencv application
  • 1.Camera calibration
  • 2.QR code
  • 3.Human body pose estimation
  • 4.Target detection
  • 5.ROS+Opencv basics
  • 6.Face recognition
  • 7.Harris corner detection
  • 8.Target tracking algorithm
  • 9.Contour moment
  • 10.Polygon outline
  • 11.Discrete Fourier transform algorithm
  • 12.Edge detection algorithm
  • 13.Face detection algorithm
  • 14.Optical flow detection algorithm
  • 15.Contour detection
  • 16.General contour detection
  • 17.Feature point tracking
  • 18.HLS color filtering
  • 19.Hough circle detection
  • 20.Hough line detection
  • 21.HSV color filtering
  • 22.LK optical flow algorithm
  • 23.Human body detection algorithm
  • 24.Phase-related displacement detection
  • 25.Image pyramid sampling algorithm
  • 26.RGB color filtering
  • 27.Clear background detection algorithm
  • 28.Simplified optical flow algorithm
  • 29.Simple filter
  • 30.Threshold image processing
  • 31.Watershed segmentation algorithm
  • 32.View point cloud data
  • 33.AR vision
  • 34.AR QR code tracking
  • 35.Color tracking
  • 36.Object tracking
07.ROS2-camera usage course
  • Instructions for using camera
08.ROS2-basic course
  • 1.Introduction to ROS2
  • 2.ROS2 install Humble
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
09.ROS2-OpenCV course
  • 1. ROS+opencv application
  • 2. QR code creation and recognition
  • 3. AR vision
10.ROS2-Mediapipe course
  • 1.Hand detection
  • 2.Posture detection
  • 3.Overall detection
  • 4.Face detection
  • 5.Personal insurance identification
11.ROS2-Depth camera course
  • 1. Use of depth camera
  • 2. Camera internal parameter calibration
  • 3. Color tracking
  • 4. KCF object tracking
  • 5. ORB_SLAM2 basics
  • 6. ORB_SLAM2 PCL mapping
  • 7. ORB_SLAM2 Octomap mapping
12.Bracket installation video
  • Bracket installation video
Download
  • VM_ROS1
  • VM_ROS2
  • Code-ROS1
  • Code-ROS2
  • 3D_File
  • ROS_Basic_VM
Download ZIP

Welcome to AI View Depth camera repository

7. ORB_SLAM2 Octomap mapping

7. ORB_SLAM2 Octomap Map Building

This example is implemented on Orin NX, and cannot be implemented on a virtual machine. It just explains how the process is implemented. If you want to implement this function on your own motherboard, you need to compile the entire function package and connect related peripherals.

7. ORB_SLAM2 Octomap Map Building7.1, Introduction7.2 , octomap map based on camera7.3, Octomap construction based on orbslam and pointcloud_mapping7.4、Node analysis7.3.1、Display calculation graph7.3.2、Details of each node7.3.3、TF transformation

octomap official website: http://octomap.github.io/

octomap source code: https://github.com/OctoMap/octomap

octomap wiki: http://wiki.ros.org/octomap

octomap_server: http://wiki.ros.org/octomap_server

The operating environment and reference configuration of software and hardware are as follows:

  • Reference vehicle: ROSMASTER X3

  • Robot hardware configuration: Arm series master control, Silan A1 laser radar, depth camera

  • Robot system: Ubuntu 20.04

  • PC virtual machine: Ubuntu (20.04) + ROS2 (Foxy)

  • Usage scenario: Use on a relatively clean 2D plane

7.1, Introduction

Octomap is an octree-based 3D map creation tool that can display complete 3D graphics including barrier-free areas and unmapped areas, and sensor data based on occupancy grids can be fused and updated in multiple measurements; Maps are available in multiple resolutions, data can be compressed, and storage is compact. In fact, the code of octomap mainly consists of two modules: octomap, a 3D map creation tool, and octovis, a visualization tool. Compared with point clouds, it can save a lot of space. The map created by octomap looks like this: (different resolutions from left to right)

image-20230418105440406

7.2 , octomap map based on camera

Execute the following launch file in the terminal:

  1. Start the camera

xxxxxxxxxx
#gemini camera startup
ros2 launch astra_camera gemini.launch.xml
  1. Start octomap_server map

xxxxxxxxxx
ros2 launch yahboomcar_slam camera_octomap_launch.py
  1. Start rviz in docker or virtual machine [recommended]:

xxxxxxxxxx
ros2 launch yahboomcar_slam display_octomap_launch.py
  1. Use the remote control or keyboard to control the node to slowly move the robot to build the map. Losing key frames may cause the map to fail.

image-20230419155015007

7.3, Octomap construction based on orbslam and pointcloud_mapping

1, Start the camera

xxxxxxxxxx
#gemini camera startup
ros2 launch astra_camera gemini.launch.xml

2, Start orbslam to publish the camera pose, color map and depth map. Depending on the performance of different master controllers, the waiting time here is about 10 seconds

xxxxxxxxxx
ros2 launch yahboomcar_slam orbslam_base_launch.py

image-20230418094624816

3, Start octomap_server to build a map

xxxxxxxxxx
ros2 launch yahboomcar_slam orbslam_pcl_octomap_launch.py 
  1. Start rviz:

xxxxxxxxxx
ros2 launch yahboomcar_slam display_octomap_launch.py
  1. Use the remote control or keyboard to control the node to slowly move the robot to build a map. Losing key frames may cause the map to fail.

image-20230419164316466

7.4、Node analysis

7.3.1、Display calculation graph

xxxxxxxxxx
rqt_graph

7.3.2、Details of each node

image-20230419121854299

image-20230419162344199

7.3.3、TF transformation

xxxxxxxxxx
ros2 run tf2_tools view_frames.py

image-20230419162522062

ORB_SLAM2 PCL mapping
Bracket installation video

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文