Welcome to ROSMASTER A1 repository
1.Semantic understand and command follow
Semantic understand and command follow(Voice Version)
Semantic understand and command follow(Voice Version)1. Course Content2. Preparation2.1 Content Description3. Run Example3.1 Launch the Program3.2 Test Cases3.2.1 Case 13.2.2 Case 24. Code Analysis5. Common Problem Solutions5.1 Microphone Recording Too Sensitive5.2 Microphone Recording Insensitivity5.3 Incomplete Speech Recognition5.4 Voice Module Recognition Error
1. Course Content
- After running the large model program, users can interact with the robot through voice conversation. User voice commands are first converted into text by the voice recognition large model. The text is then used by the large model and visual multimodality to accurately understand the user's commands and voice. Finally, the robot performs the specified actions according to the user's commands and responds to the user.
2. Preparation
2.1 Content Description
This course uses the Jetson Orin NANO as an example. This is for users of the gimbal servo USB camera version. For Raspberry Pi and Jetson Nano boards, you need to open a terminal on the host computer and enter the command to enter the Docker container. Once inside the Docker container, enter the commands mentioned in this course in the terminal. For instructions on entering the Docker container on the host computer, refer to [01. Robot Configuration and Operation Guide] -- [5.Enter Docker (For JETSON Nano and RPi 5)]. For RDKX5 and Orin boards, simply open a terminal and enter the commands mentioned in this course.
3. Run Example
3.1 Launch the Program
Open the host terminal and start the Dify environment.
sh ~/bringup_dify.sh

Open the terminal on the car and enter the command: