yahboom
HomeTutorialsProduct
Solution
Blog
Online Store
About Us
EN/中文
Store
ROSMASTER A1 PRO📖
00.Configuration and Operation Guide
  • 0. Unboxing and Review
  • 1.Assembly Videos
  • 2.User Manual
  • 3.Enter Docker (For Raspberry Pi)
  • 4.A1Pro Front Wheel Servo Calibration
  • 5.USB Camera Calibration
  • 6.Depth Camera Calibration
  • 7.FAQ
  • 8.Desktop Configuration Center and Remote Control Guide
01.Chassis Control Course
  • 1.Robot Information Publishing
  • 2.Robot Handle Control
  • 3.Robot Keyboard Control
  • 4.Linear Velocity Calibration
  • 5.Angular Velocity Calibration
  • 6.Robot URDF Model
  • 7.Robot EKF State Estimation
02.Lidar Course
  • 1.Lidar Introduction and Use
  • 2.Lidar Obstacle Avoidance
  • 3.Lidar Following
  • 4.Lidar Patrol
  • 5.GMapping-SLAM Mapping
  • 6.Cartographer-SLAM Mapping
  • 7.Slam-Toolbox Mapping
  • 8.Lifelong Mode Mapping
  • 9.Navigation2 Single Point Navigation
  • 10.Navigation2 Multi Point Navigation
  • 11.Cartographer Relocalization Navigation
  • 12.Slam-Toolbox Localization Navigation
  • 13.Synchronous Mapping And Navigation
  • 14.Aruco Visual Relocalization Navigation
  • 15.Mobile App Mapping And Navigation
  • 16.AprilTag Transport
  • 17.Color Block Transport
03.USB Camera-Depth Camera Course
  • 1.USB Camera Introduction
  • 2.USB Camera Intrinsic Calibration
  • 3.Nuwa-HP60C Camera Introduction (Depth Camera Only)
  • 4.Depth Camera Distance Measurement (Depth Camera Only)
  • 5.Depth Pseudo Color Image (Depth Camera Only)
  • 6.Block Volume Calculation (Depth Camera Only)
  • 7.Edge Detection (Depth Camera Only)
  • 8.RTAB-Map SLAM Mapping (Depth Camera Only)
  • 9.RTAB-Map Navigation (Depth Camera Only)
04.Robotic Arm and 3D Space Gripping Course
  • 0.Robotic Arm Basic Usage
  • 1.Robotic Arm Kinematics
  • 2.Robotic Arm Chassis Coordination Control
  • 3.AprilTag ID Sorting
  • 4.AprilTag Height Anomaly Sorting
  • 5.AprilTag Tracking and Grasping
  • 6.Color Block Sorting
  • 7.Color Block Height Anomaly Sorting
  • 8.Color Block Tracking and Grasping
  • 9.Wood Block Shape Sorting
  • 10.KCF Tracking and Grasping Objects
  • 11.Mediapipe Gesture ID Sorting AprilTag
  • 12.Mediapipe Gesture Height Sorting AprilTag
  • 13.Desktop Tracking and Grasping AprilTag
  • 14.3D Spatial Tracking AprilTag
  • 15.Line Following Obstacle Clearing
  • 16.Transformer Model Tracking Algorithm
05.Road Network Planning and Navigation
  • 1.Introduction To Road Network Planning
  • 2.Road Network Annotation
  • 3.Planning And Navigation Between Waypoints
  • 4.Road Network Navigation In Any Pose
  • 5.Path Re-planning
06.OpenClaw Basic Course
  • 1.Introduction to OpenClaw
  • 2.OpenClaw Core Concepts
  • 3.OpenClaw API-KEY Configuration
  • 4.OpenClaw Switch Models
  • 5.OpenClaw System Prompt Words
  • 6.OpenClaw Common CLI Commands
07.OpenClaw Interaction Method
  • 1.OpenClaw Webchat Interaction
  • 2.OpenClaw Tui Interaction
  • 3.OpenClaw Voice Dialogue Interaction
  • 4.OpenClaw WhatsApp Interaction
08.OpenClaw Development
  • 1.OpenClaw Connecting to Robot MCP Service
  • 2.Robot CLI Command Tool
  • 3.robot-control plugin tool
  • 4.reply-bridge plugin tool
  • 5.OpenClaw Multimodal Vision
  • 6.OpenClaw Chassis Control
  • 7.OpenClaw Robotic Arm Control
  • 8.OpenClaw Skills Development
  • 9.OpenClaw Scheduled Tasks
  • 10.OpenClaw Multi-Agent Intelligent Agent
  • 11.OpenClaw Active Interaction
  • 12.OpenClaw Vector Memory
09.OpenClaw Embodied Intelligent Application
  • 1.OpenClaw Target Tracking
  • 2.OpenClaw Arm Tracking And Grasping
  • 3.OpenClaw Arm Fixed-point Placement
  • 4.OpenClaw Waste Sorting
  • 5.OpenClaw SLAM Mapping And Navigation
  • 6.OpenClaw Navigation Transport
  • 7.OpenClaw AprilTag Grasping
  • 8.OpenClaw Color Line Patrol
  • 9.OpenClaw Visual Distance Measurement
10.OpenClaw Scenario Sandbox
  • 1.Map Description and Prop Placement
  • 2.Build Sand Table Map
  • 3.Visual Relocation Markers
  • 4.Map Mapping Markers
  • 5.OpenClaw Scenario Sandbox Comprehensive Case
11.AI Model Basics
  • 1.AI Large Model Types and Principles
  • 2.RAG Retrieval Enhancement and Model Training Samples
  • 3.Embodied Intelligent Robot System Architecture
  • 4.Embodied Intelligent Functions Core Source Code
12.AI Model Development
  • 1.Register a Model Service Provider Aaccount
  • 2.Configuring API-KEY
  • 3.Introduction to Dify
  • 4.Basic Dify Features
  • 5.AI Large Model Development - chatbot
  • 6.Deploy the RAG Knowledge Base
  • 7.RAG Knowledge Base + chatbot
  • 8.AI Agent Workflow
  • 9.Custom Wake-up Response
13.AI Model - Text Version
  • 1.Semantic Understand and Command Follow
  • 2.Multimodal Visual Understand
  • 3.Multimodal Visual Understand + Robotic Arm Gripping
  • 4.Multimodal Visual Understand+SLAM Navigation
  • 5.Robotic Arm Gripping+Multimodal Visual Understand+SLAM Navigation
  • 6.Intention Estimation
14.AI Model - Voice Version
  • 1.Semantic Understand and Command Follow
  • 2.Multimodal Visual Understand
  • 3. Multimodal Large Model+Robotic Arm Gripping
  • 4.Multimodal Visual Understand+SLAM Navigation
  • 5.Robotic Arm Gripping+Multimodal Visual Understand+SLAM Navigation
  • 6.Intention Estimation
15.Mediapipe Visual Course
  • 1.Hand Detection
  • 2.Posture Detection
  • 3.Overall Detection
  • 4.Facial Landmark Detection
  • 5.Face Detection
  • 6.Face Special Effects
  • 7.3D Object Recognition
  • 8.Brush
  • 9.Finger Control
  • 10.Palm Target Positioning
  • 11.Fingertip Trajectory Recognition
  • 12.Fingertip Gesture Control Cobotic Arm
  • 13.Gesture Grabbing and Releasing Objects
  • 14.Finger Control Robotic Arm
  • 15.Medipipe Gesture Control Robotic arm Cction Group
16.MoveIt2 Simulation Course
  • 1.MovelT2 Configuration
  • 2.MovelT2 Simulation-Reality Linkage
  • 3.Random Movement
  • 4.Forward Kinematics Design
  • 5.Inverse Kinematics Design
  • 6.Cartesian Path
  • 7.Scene Design
  • 8.Trajectory Planning
  • 9.Collision Detection
  • 10.3D Perception Obstacle‑Avoidance
17.Multi-vehicle Course
  • 1.Multi-vehicle Control
  • 2.Multi-vehicle Navigation
  • 3.Multi-vehicle Formation
18.YOLO26 Development
  • 1.CLI Use
  • 2.Object Detection
  • 3.Instance Segmentation
  • 4.Pose Estimation
  • 5.Image Classification
  • 6.Oriented Object Detection
  • 7.YOLOv26 + DeepSORT Tracking
  • 8.Monocular Depth Estimation
19.Control Board STM32 Driver Course
  • 0.Notes (Must Read)
  • 1.About Expansion Board
  • 2.STM32 Development Environment
  • 3.Button Control
  • 4.FreeRTOS Application
  • 5.Serial Communication
  • 6.SBUS Model Aircraft Remote Control
  • 7.CAN Bus Communication
  • 8.RGB Colorful Light Bar
  • 9.Timer Interrupt to Control PWM Servo
  • 10.Control Serial Port Servos
  • 11.Nine-axis Attitude Sensor to Obtain Data
  • 12.Control Motor
  • 13.Timer Captures the Encoder Data
  • 14.1 Kinematic Analysis of Mecanum Wheel
  • 14.2 Kinematic Analysis of Ackerman
  • 14.3 Kinematic Analysis of 4WD
  • 15.PID Control Robot Movement
20.Docker Course
  • 1.Docker Introduction and Installation
  • 2.Docker Basic Commands
  • 3.Docker Submission and Multi-Terminal Access
  • 4. Docker Startup Script
  • 5.Docker-Vscode Environment Construction
21.Image Processing Basics Course
  • 1. Introduction to Open Source CV
  • 2. Image reading and display
  • 3. Image writing
  • 4. Image quality
  • 5. Pixel Operation
  • 6. Image zoom
  • 7. Image cutting
  • 8. Image translation
  • 9. Image Mirroring
  • 10. Affine Transformation
  • 11. Image Rotation
  • 12. Perspective Transformation
  • 13. Grayscale processing
  • 14. Image Binarization
  • 15. Edge Detection
  • 16. Line drawing
  • 17. Rectangle and circle drawing
  • 18. Drawing text and pictures
22.Linux System Course
  • 1.Introduction to Linux system
  • 2.Ubuntu file system
  • 3.Ubuntu common commands
  • 4.Ubuntu common editors
  • 5.Ubuntu software operation commands
  • 6.Virtual machine installation
  • 7.SSH remote control
  • 8.VNC remote control
  • 9.Transfer files remotely
  • 10.Driver library and communication
  • 11.Static IP and hotspot mode
  • 12.Bind device ID
  • 13.Capacity expansion and resource allocation
  • 14.Update system software sources
  • 15.Set root user password
  • 16.sudo free password
  • 17.Connect to WiFi network
  • 18.View system version
  • 19.Customized service management
  • 20.Back up system image
23.ROS2 Basic Course
  • 1.Introduction to ROS2
  • 2.ROS2 install Humble
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
24.Main Control Course
Jetson Orin Nano_NX
  • 1.Jetson Orin board introduction
  • 2.Restore the factory image system
  • 3.Backup SSD system
  • 4.SSD expansion
  • 5.Network configuration
  • 6.SSH remote login
  • 7.VNC remote control
  • 8.Remote file transfer
  • 9.Jtop tool
  • 10.Exchange space expansion
Raspberry Pi
  • 1. Introduction to Raspberry PI 5
  • 2. Raspberry PI system installation and backup
  • 3. Powering the Raspberry PI 5
  • 4. Startup of Raspberry PI 5
  • 5. Update and upgrade operating system
  • 6. Introduction to raspi-config tool
  • 7. config.txt file description
  • 8. Network Configuration
  • 9. remote access
  • 10. Transfer files remotely
  • 11. Set display resolution and rotation
  • 12. Set screen to sleep
  • 13. Play audio and video
  • 14. Using USB camera
  • 15. Using MIPI camera
  • 16. Get real-time temperature of Raspberry Pi
RDKX5
  • 1.Introduction to RDK X5 board
  • 2.Write system file
  • 3.Hardware interface description
  • 4.Install case and other accessories
  • 5.Network configuration
  • 6.Remote login
  • 7.Update system
  • 8.srpi-config user guide
  • 9.config. txt configuration file
  • 10.Self-startup setting
  • 11.RDK exclusive command usage
  • 12.Linux command usage
  • 13.GPIO readwrite operation
  • 14.Image classification algorithm
  • 15.Use USB camera
  • 16.Use MIPI camera
  • 17.Binocular camera depth algorithm
  • 18. Controlling RGB Cooling Fans
Download
  • SystemFile
  • Code
  • 3D_Model_File
  • Software_Tools
  • Hardware_Info
  • Introduction_Manual
  • Script_File
  • Dify AI Agent
Download ZIP

Welcome to ROSMASTER A1 PRO repository

8.Desktop Configuration Center and Remote Control Guide

Desktop Configuration Center and Remote Control Guide

 

0. Course Content and Tools Overview

Important
To facilitate developers and end users from the tedious work of modifying YAML configuration files, repeatedly executing colcon build compilation, and manually typing complex ROS 2 terminal commands, the system has two built-in modern lightweight graphical interaction tools. The two tools have independent responsibilities and work together:

  1. 🛠️ robot_config_app (Yahboom Robot System Comprehensive Configuration Center): Specialized in centralized configuration of system bottom layer and algorithm parameters. Includes bottom hardware peripheral selection, Ackerman chassis power limit and odometry calibration, robotic arm space grasping and monocular depth compensation, embodied vision positioning large model, OpenClaw gateway and Dify agent credential management.

  2. 🎮 robot_joy_app (Yahboom Robot Remote Control System): Specialized in real-time robot motion and joint control. Provides joystick remote control and keyboard control dual-mode drive, built-in chassis driver intelligent anti-pull-up mechanism, thoroughly solving the underlying serial exclusive conflict problem.


Part 1: robot_config_app Comprehensive Configuration Center Detailed Guide

1.1 Tool Positioning and Application Scenarios

robot_config_app is the car's "Control Brain Central Settings Console". When you need:

  • Replace LiDAR model (Slamtec C1 / Ydlidar T-mini Plus) or camera type (USB 2D / Angstrong 3D);

  • Adjust ROS Domain ID to avoid multi-car communication interference on LAN, or enable CycloneDDS acceleration;

  • Limit chassis maximum traveling speed, or fine-tune odometry straight-line/turning accuracy;

  • Calibrate robotic arm grasping millimeter-level spatial physical offset when grabbing targets;

  • Configure embodied vision large model (Base URL, API Key, Model) and Dify / OpenClaw agent credentials;

  • One-click sync modifications to src source and install run image directories.


1.2 robot_config_app Startup Methods

You can start the system comprehensive configuration center in the following three ways:

Method A: Desktop Shortcut Direct Open (Most Intuitive)

On the robot system desktop, double-click the 【System Comprehensive Configuration Center】 icon to start directly.

Desktop Shortcut Icon


Method B: Terminal Graphical Interface Startup (Recommended for Development and Debugging)

In the vehicle screen terminal or VNC desktop terminal, enter:

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_config_app/config_app.py

The system will automatically pop up a modern dark GUI configuration main window:

Configuration Center GUI Interface


Method C: Pure Terminal Command-Line Interaction Mode (Desktop-free, SSH Environment Dedicated)

In a pure SSH terminal connection without monitor or graphical desktop, enter:

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_config_app/config_app.py --cli
# Or directly execute python3 ~/yahboomcar_ros2_ws/robot_config_app/config_app.py (system will automatically detect no desktop and downgrade to terminal mode)

The system will directly display a clean dashboard and digital modification menu in the terminal, supporting direct numeric input, modification and save without graphics:

image-20260908165442151

Tip
If you only need to quickly view all current system parameter configurations, use the ultra-fast read-only command:

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_config_app/config_app.py --show

1.3 robot_config_app Five Core Function Panel Details

The interface is divided into 5 major core tabs, each tab is for a dedicated scenario:

1.3.1 Tab 1: Robot Hardware and Chassis (Hardware & Chassis)

This page is responsible for underlying ROS 2 communication network and chassis motion dynamics parameter configuration:

  1. ROS 2 Basic Environment and Peripheral Selection:

    • CycloneDDS Middleware Switch: When enabled, will enable rmw_cyclonedds_cpp, which can significantly reduce ROS 2 communication latency and packet loss rate on Wi-Fi LAN.

    • ROS Domain ID: Range is 0 ~ 232. When multiple cars are on the same Wi-Fi router, be sure to assign different Domain ID to each car, to prevent topics and nodes from interfering with each other.

    • Vehicle Model Selection: Supports A1P (Ackerman steering wheel robotic arm) and M1P (Mecanum wheel robotic arm) quick switch.

    • LiDAR Model: Quickly switch c1 (Slamtec C1) and tmini (Ydlidar T-mini Plus).

    • Camera Type: Quickly switch usb (monocular USB 2D camera) and nuwa (Angstrong 3D depth camera).

    After modification, saving will automatically write to the corresponding environment variables in ~/.bashrc.

  2. Chassis Power Limit and Odometry Calibration:

    • Maximum Linear Velocity (m/s): Limit chassis maximum straight-line speed (default 1.0 m/s, indoor beginner debugging recommended to set to 0.3 ~ 0.5 m/s to prevent collision).

    • Maximum Angular Velocity (rad/s): Limit steering servo maximum angular velocity (default 3.0 rad/s).

    • Odometry Linear Velocity Scaling Factor (odom_linear_scale_x): When the car actually travels 1 meter but odometer shows deviation, compensate by this factor product (default 1.0).

    • Odometry Angular Velocity Scaling Factor (odom_angular_scale_z): Compensate when car in-place rotation or turning angle has deviation (default 1.0).

    • 【Start Front Wheel Servo Center Angle Calibration Tool】 Button: One-click call calibrate_akm_angle.py interactive graphical program, calibrate Ackerman steering center and 1-meter straight-line yaw.

Tab 1 Hardware and Chassis Interface


1.3.2 Tab 2: Robotic Arm and Grasping Calibration (Arm & Vision Calibration)

This page is specifically for solving robotic arm vision grasping spatial coordinate offset and monocular ranging error:

  1. Angstrong 3D Depth Camera Vision Grasping Offset (offset_value.yaml):

    • Adjust X-axis (front-rear), Y-axis (left-right), Z-axis (up-down depth) grasping offset in 3D space.

    • Provide -5, -1, +1, +5 millimeter-level fine adjustment step buttons, each click can precisely step adjust 1mm (0.001m).

  2. USB 2D Camera Vision Grasping Offset (usb_offset_value.yaml):

    • Used for USB 2D camera color block sorting and AprilTag label grasping end offset correction.

  3. USB Monocular Camera Depth Estimation and Calibration Parameters (usb_camera_params.yaml):

    • AprilTag Depth Compensation Factor (apriltag.depth_scale): QR code monocular ranging scaling factor (default 0.9749).

    • AprilTag Depth Bias (apriltag.depth_bias): Monocular ranging fixed constant bias (default 0.0 meters).

    • Color Block Depth Compensation Factor (color.depth_scale): Color wooden block monocular ranging scaling factor (default 0.9561).

    • Color Block Reference Length/Width (color.target_width): Calibrated color wooden block physical size (default 0.03m i.e. 3cm).

Note

📐 depth_scale Calibration Principle

Monocular camera has no depth sensor, ranging relies on small hole imaging formula: Measured distance = focal length × object actual size ÷ object pixel width

  • Focal length: Obtained from camera calibration (this camera is 558.96)

  • Object actual size: AprilTag calibration block side length is 2cm (0.02m) the size of the black border inside the machine code circle

  • Pixel width: How many pixels the recognized QR code occupies in the picture

Because wide-angle lens has distortion, the distance calculated by the formula will have deviation. For example, placing the calibration block at true distance 0.225m, the formula calculates 0.231m, biased larger, compensate with factor: Calibration factor = 0.225 ÷ 0.231 ≈ 0.9749 Final ranging formula: True distance = measured distance × calibration factor + offset correction.

Tab 2 Robotic Arm Grasping Calibration Interface


1.3.3 Tab 3: AI Large Model and Multi-Agent Gateway (AI & Multi-Agent)

Integrate high-level embodied decision model and knowledge base gateway into two clean core cards:

Card 1: Embodied Vision Positioning Large Model (common.yaml: mcp_service)

Specialized for natural language embodied robotic arm grasping positioning, natural object recognition and 3D bounding box inference:

  • Vision Positioning Base URL: OpenAI protocol compatible endpoint, click the [*] button on the right to one-click fill 【Bailian Compatible Endpoint】 or 【Bailian MaaS Endpoint】;

  • Vision Positioning API Key: Alibaba Cloud Bailian platform credential key (starts with sk-), right side provides one-click copy and password mask toggle;

  • Vision Model Name (Model): Supports any OpenAI protocol multimodal vision large model (click to quickly fill recommended qwen3-vl-plus, qwen-vl-max or gpt-4o);

  • Target Detection Recognition Mode:

    • OnlyOnline (Online large model only): Large model directly end-to-end outputs spatial bounding box and labels;

    • Hybrid (Offline + online hybrid): First local YOLO real-time detects candidate targets, then large model performs semantic verification;

  • AprilTag Actual Side Length (meters): Corresponding to factory calibrated square label physical side length default 0.02m the size of the black border inside the machine code circle, USB camera subsequent letting large model grasp machine code will calculate depth based on this size.

Tab 3 Embodied Vision Large Model Configuration

Card 2: OpenClaw & Dify Agent Gateway Application

Unified management of high-level autonomous scheduling brain and knowledge base agent:

  • OpenClaw Base URL: Alibaba Cloud Bailian link (supports clicking【[*] Same as Vision Model Configuration】to one-click clone);

  • OpenClaw API Key: Alibaba Cloud Bailian obtained key;

  • Dify API Key: Corresponds to multi_brains_setting.yaml middle DIFY_API_KEY, need to go to Dify backend to get the corresponding agent's application key.

Tab 3 OpenClaw and Dify Configuration


1.3.4 Tab 4: Voice and Interaction Language (Speech & Language)

Configure the car's interactive voice recognition and synthesis engine:

  • System Interaction Language: Switch Chinese (zh) or English (en).

    • When Chinese is selected, the system bottom automatically associates the service provider as Alibaba Cloud (aliyun), streaming ASR uses Alibaba Paraformer, TTS uses high-fidelity CosyVoice;

    • When English is selected, the system bottom automatically associates the service provider as iFlytek (xunfei).

  • Online ASR / Online TTS Switch: Can separately enable or disable online cloud transcription and voice broadcast functions.

Tab 4 Voice and Language Settings


1.3.5 Tab 5: File Sync and System Operations (Diagnostics & Ops)

  1. Configuration File Bidirectional Sync Status Monitoring:

    • Real-time monitoring of the existence status of the underlying 7 groups of core configuration files (display green Normal or red Not Found).

  2. Native Joystick Boot Auto-Start Switch:

    • Enable: After the car is powered on and boots up, automatically pull up joystick remote control service, control as you open it;

    • Disable: Do not load joystick service on boot, automatically release /dev/myserial chassis serial port, convenient to directly run mapping, navigation, keyboard control and other ROS 2 custom nodes.

  3. Operations Tool Box:

    • One-Click Restart OpenClaw Gateway: Seamlessly restart agent gateway process;

    • Backup Current Configuration Snapshot: Export all current interface configurations to ~/.yahboom_config_snapshot.json;

    • Restore Configuration from Snapshot: If parameters were messed up during debugging, can one-click restore backup snapshot.

Tab 5 File Diagnostics and Operations

Snapshot Backup Restore Management


1.4 Core Guarantee of Save Mechanism: Dual-Sync Bidirectional Security Sync

Important
In ROS 2 system development, after conventionally modifying configuration files in src/ source directory, if colcon build is not executed, the configuration in the install/ run image directory will not be updated, often causing users to think the configuration has not taken effect.

When clicking 【Save and Sync All Configurations】 at the bottom, this configuration center automatically adopts atomic bidirectional write mechanism:

  1. Simultaneously write to src/ source file and install/ run image file;

  2. Automatically sync OpenClaw corresponding language workspace;

  3. Completely avoid the tedious process of interrupting the development flow to re-compile colcon build after each parameter modification!

Save Success Bidirectional Sync Prompt


Part 2: robot_joy_app Robot Remote Control System Detailed Guide

2.1 Tool Positioning and Core Anti-Pull Mechanism

robot_joy_app is the car's "Real-Time Manipulation Interaction Console". Used for wireless joystick control without keyboard monitor, or for using keyboard on computer to quickly test chassis movement and robotic arm posture.

Warning

🛡️ Core Mechanism: Chassis Driver Intelligent Anti-Pull-Up (Ackman_driver_A1P)

The Ackerman car bottom motor and steering servo driver node communicates with the lower computer through serial device node /dev/myserial. This serial port has exclusive ownership under Linux. If multiple ROS nodes simultaneously try to open /dev/myserial, the system will throw SerialException: Device or resource busy fatal error.

robot_joy_app internally implements a set of highly reliable intelligent process management logic:

  1. When starting joystick control:

    • Automatically pull up chassis driver and joystick control node;

  2. When starting keyboard control:

    • If chassis driver is already running (for example, previously started via joystick, or system background already has driver): The App will automatically detect driver process PID, only separately start keyboard control node, never pull up chassis driver again, thoroughly preventing serial conflict errors;

    • If chassis driver is not running: The App will first auto-start chassis driver in the background, wait for driver to be ready, then seamlessly start keyboard control terminal!

  3. When clicking【Stop All Control】:

    • Safely and smoothly terminate joystick node and chassis driver process, release underlying serial port resources.


2.2 robot_joy_app Startup Methods

Method A: Desktop Shortcut Direct Open

On the robot system desktop, double-click the 【Robot Remote Control Center】 icon to start directly.

Remote Center Desktop Icon


Method B: Terminal Graphical Interface Startup

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_joy_app/joy_app.py

The system will pop up a control window containing real-time hardware sensing capsules:

Remote Center GUI Main Interface


Method C: Pure Terminal Command-Line Interaction Mode (Desktop-free, SSH Environment Dedicated)

In an SSH command-line terminal without desktop, enter:

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_joy_app/joy_app.py --cli
# Or directly execute python3 ~/yahboomcar_ros2_ws/robot_joy_app/joy_app.py (automatically downgrade to terminal mode)

The system will output hardware sensing dashboard and numeric shortcut commands in the terminal, input 1 to start/stop joystick, input 3 to directly enter keyboard remote control in the current terminal foreground!

image-20260908165340084

Tip
When you only need to quickly view the current joystick, chassis driver and keyboard PID running status, enter:

xxxxxxxxxx
python3 ~/yahboomcar_ros2_ws/robot_joy_app/joy_app.py --status

2.3 Mode 1: Wireless Joystick Remote Control Practice

  1. Hardware preparation:

    • Insert the USB wireless receiver attached to the joystick into any USB port on the car;

    • Turn on the joystick power switch, ensure the indicator light on the joystick is solidly lit (indicating successful pairing with the receiver).

  2. Start control:

    • Click the 【Start Joystick Control】 button on the interface;

    • The top status capsule will turn green: Chassis Driver: Running, Joystick Node: Running.

  3. Key Function Mapping Quick Reference:

    • START key: Safety unlock / emergency stop lock. Boot anti-misoperation lock, press START key once to hear 3 beeps from the car's buzzer to unlock and take effect; press again for emergency stop lock.

    • Left rocker: Push/pull to control chassis forward and backward; push rocker left/right to control front wheel servo steering (Ackerman car does not support in-place rotation, needs initial speed).

    • L1 / L2 keys: Press L1 to cycle fine-tune linear velocity (0.05~1.0 m/s); press L2 to cycle fine-tune angular velocity.

    • R2 key: Press R2 to switch control mode (joints 1/2 or 5/6).

    • A/X/Y/B and Back keys: A/X adjust joint 3; Y/B adjust joint 4; key 7 (Back/Select) robotic arm one-click posture safe reset.

    • Directional pad: Control the two joints in current mode (such as 1/2 or 5/6 joints)

image-20260918160810376

Joystick Control Running Status


2.4 Mode 2: Keyboard Control Car Practice (Ultra-Fast Call)

For scenarios where joystick battery is dead or no joystick is at hand, keyboard control provides an excellent debugging channel.

  1. Start control:

    • Click the 【Start Keyboard Control (Independent Terminal)】 button on the interface;

    • The App will automatically call the system's graphical terminal (such as gnome-terminal / xfce4-terminal), pop up a dedicated keyboard key interaction window.

Keyboard Control Pop-up Interaction Terminal

  1. Key Control Mapping Table (Classic ROS Key Layout):

KeyFunction DescriptionKeyFunction Description
iForward (straight line)kDecelerate to stop (park)
,Backward (straight line)SpaceEmergency brake
uAccelerate left turnoAccelerate right turn
q / zMax linear velocity increase / decrease 10%w / xLinear velocity increase / decrease 10% only
e / cMax angular velocity increase / decrease 10%r / vAngular velocity increase / decrease 10% only
1 ~ 6Select robotic arm joints 1 to 6a / dIncrease / decrease selected joint angle (±5°)
0Robotic arm posture one-click resetsTemporarily stop control
  1. Exit keyboard control:

    • In the popped-up key terminal window, directly press keyboard combination key Ctrl + C to exit keyboard control, the car will automatically safety brake and stop.

FAQ
Robot Information Publishing

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文