Voice Interaction Control

This tutorial is a comprehensive experiment combining multiple peripherals. You can first understand individual peripherals before proceeding with this experiment.

I. Software-Hardware

• KEIL

• MSPM0G3507 Development Board

• Type-C Data Cable or DAP-Link

• Voice Interaction Integrated Module

• K230 Vision Module

  For program download or simulation to the development board

II. Basic Principle

1. Hardware Schematic Diagram

2. Physical Connection Diagram

Wiring Pins

Motor Wiring (Note: The wiring diagram below is for position reference only. We provide dual-head PH2.0 6Pin all-black cables with fool-proof design, so you don't need to worry about wiring issues)

Voice Module Wiring (Note: The wiring diagram below is for position reference only. We provide dual-head PH2.0 4Pin all-black cables for the voice module with fool-proof design, so you don't need to worry about wiring issues)

K230 Wiring (Note: The wiring diagram below is for position reference only. We provide dual-head PH2.0 4Pin all-black cables for K230 with fool-proof design, so you don't need to worry about wiring issues)

3. Control Principle

Program Flowchart

After power on, we need to first wake up the voice interaction module. When we say "Xiao Ya Xiao Ya" to the voice module, the voice module will send a data frame to the microcontroller, but the host does not need to send data back to the module. Then the voice module will broadcast "I'm here". After hearing the broadcast, we can issue voice commands to the voice module. The voice module and microcontroller will send data frames to each other for communication.

Voice module: After receiving voice commands, it sends data frames to the microcontroller's serial port.

Microcontroller part: Receives data frames and then judges each byte of the data frame. Our data frame protocol is hexadecimal byte stream, format: AA 55 00 XX FB (active broadcast), AA 55 FF XX FB (passive broadcast), where the frame header is the first two bytes AA 55, the frame end is a fixed byte FB, the third byte controls the active and passive broadcast of the voice module, the fourth byte is the command data we need. We return the fourth byte data, and then through processing the data, make the car give corresponding feedback. After the car completes the feedback, the microcontroller will send specified content to the voice module again, and the voice module will broadcast after receiving it.

III. Main Functions

Mainly introduces user-written functional code, for detailed code, you can open the project file we provided and enter the Bsp folder to view the source code.

1. User Functions

Function: rgb_SetColor

Function: rgb_SetRGB

Function: get_voice

Function: Pto_Loop

Function: Human_Face_Track

Function: Color_Trace

Function: Control_RGB_ALL

IV. Voice Module Commands

V. Experimental Phenomenon

After successfully downloading the program and connecting the voice interaction module wiring, we need to wake up the voice interaction module. The wake-up method is to say "Hi, yahboom" to the voice interaction module, and the module will reply "I'm here".

After hearing the reply, we can issue commands to the car. This tutorial mainly controls the indicator lights on the expansion board. Car motion control commands are not available (Command issuance and the interval between commands need to be within 20 seconds, otherwise you need to re-wake the voice interaction module.)

After each command operation, the voice interaction module will have corresponding broadcast replies.

For specific commands, please refer to the attached voice module protocol table.

For program download, refer to [Chapter 3: Development environment setup and usage → 3.Uniflash burning]
The voice interaction module needs to be flashed with firmware compatible with MSPM0 car. For firmware programming, refer to [Chapter 8: Extended application course (Sold separately) → 1. Voice interaction module communication]. If already programmed, no need to repeat programming.