8.AI large model online voice assistant

1. Online Voice Configuration

Before setting up automatic startup, we must ensure that the program itself can operate independently in an online state. This can be accomplished by modifying the configuration file.

1. Locate the Configuration File: In your project code, find and open the configuration file:

config/yahboom.yaml

2. Modify Configuration Parameters: Please check the following parameters in the file and ensure that their values ​​match those shown below. If the parameters do not exist, add them.

   ​x
   asr:                                    #Voice node parameters
     ros__parameters:
       VAD_MODE: 2                         #vad sensitivity
       sample_rate: 16000                  #asr recording audio sampling rate
       frame_duration_ms:  30              #vad frame size in ms
       use_oline_asr: True                #Whether to use online ASR recognition (True uses online, False uses offline)
       mic_serial_port: "/dev/ttyUSB0"     #Microphone serial port alias
       mic_index: 0                        #Microphone Index
       language: 'zh'                      #asr language
   ​
   model_service:                          #Model server node parameters
     ros__parameters:
       language: 'zh'                      #Large Model Interface Language
       useolinetts: True                   #Whether to use online speech synthesis (True uses online, False uses offline)
   ​
        # Large model configuration
       # llm_platform: 'ollama'              # Optional platforms:'ollama', 'tongyi', 'spark', 'qianfan', 'openrouter'
       llm_platform: 'tongyi'              # Here we take Tongyi as an example
   ​
   

   • use_oline_asr and useolinetts must be set to tongyi.
   • llm_platform must be set to tongyi.

With this setup, everything is online.

3. Save the file and recompile the project to apply the changes:

   xxxxxxxxxx
   cd ~/yahboom_ws
   colcon build
   source install/setup.bash
   

After completing this step, the program is now a fully online voice service.

2. Create a Startup Service (Systemd)

Now, we will create a systemd service to automatically run largemodel_control.launch.py at system startup.

2.1 Create a Startup Script

To ensure systemd can correctly load the ROS2 environment, it's best to create a simple bash script to encapsulate our startup commands.

1. Create a Script File: In the directory (~/yahboom_ws/src/largemodel/), create a file named start_largemodel.sh.

   xxxxxxxxxx
   vim ~/yahboom_ws/src/largemodel/start_largemodel.sh
   

2. Write the script: Copy and paste the following content into the script file.

   xxxxxxxxxx
   #!/bin/bash
   ​
   # Source ROS2 Humble Environment
   source /opt/ros/humble/setup.bash
   ​
   # Source Yahboom Workspace environment
   source /home/jetson/yahboom_ws/install/set
    Multimodal autonomous proxy application
   Build lsaac ROS environment