yahboom
HomeTutorialsProduct
Solution
Blog
Online Store
About Us
EN/中文
Store
Jetson Orin NANO Developer Kit📖
01.Get started
  • 01. Learning route
  • 02. Get started quickly
  • 03. System Update Notes
  • 04. Disabling automatic updates and troubleshooting issues
  • 05. Jetson Orin Nano official kit screwdriver instructions
02.Jetson basic course
  • 01.Jetson board introduction
  • 02.Write Jetson original system
  • 03.Installing Jetson environment
  • 04.Backup SSD system
  • 05.Restore initial image system
  • 06.Upgrade to SUPER version (Optional)
  • 07.Write SUPER boot (Must read)
  • 08.SSD expansion
  • 09.Jetpack old system upgraded to Yahboom SUPER factory system
  • 10.Write the system onto your own SSD
03.Basic setting course
  • 01.Basic knowledge
  • 02.Network configuration
  • 03.SSH remote login
  • 04.VNC remote control
  • 05.RDP remote control
  • 06.Remote file transfer
  • 07.Jtop tool
  • 08.Exchange space expansion
  • 09.Use VSCode
  • 10.Use VMware
  • 11.Modify screen resolution
04.GPIO control course
  • 01.GPIO description
  • 02.GPIO library installation
  • 03.GPIO reading
  • 04.GPIO output
  • 05.Serial communication
  • 06.I2C communication
05.Vision basic course
  • 01.CSI camera preview
  • 02.USB camera preview
  • 03.Use Jupyter Lab
  • 04.Use JetCam
06.OpenCV basic course
  • 01.Image reading
  • 02.Image saving
  • 03.Image modification
  • 04.Image scaling
  • 05.Image cropping
  • 06.Image translation
  • 07.Image mirroring
  • 08.Image grayscale conversion
  • 09.Image binarization
  • 10.Image edge detection
  • 11.Add line segments
  • 12.Add rectangles
  • 13.Add circular shape
  • 14.Add ellipses
  • 15.Add polygons
  • 16.Add Text
  • 17.Preview USB camera image
  • 18.Preview CSI camera image
07.Vision advanced course
01.Environment construction
  • 01.TensorFlow
  • 02.PyTorch
  • 03.Torchvision
02.DeepStream development
  • 01.DeepStream environment
  • 02.License plate detection and recognition
  • 03.Parallel multi-model inference
  • 04.Object embedding vector generation
  • 05.Pose recognition
  • 06.NV optical flow anomaly detection
  • 07.Single-view 3D tracking
  • 08.Multi-view 3D tracking
03.NVIDIA TAO toolkit application
  • 01.Traffic scene object detection
  • 02.Person object detection
  • 03.Vehicle brand classification
  • 04.Vehicle model classification
  • 05.License plate detection and recognition
  • 06.Person semantic segmentation
  • 07.Retail product detection and recognition
  • 08.Person feature extraction and matching (ReID)
  • 09.Person action and pose classification
  • 10.Transformer-based person detection
  • 11.3D human skeleton detection
  • 12.LiDAR 3D point cloud detection
04.YOLO11 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
05.Mediapipe development
  • 01.Mediapipe environment
  • 02.Hand detection
  • 03.Face detection
  • 04.Face effects
  • 05.3D object recognition
  • 06.Virtual brush
  • 07.Gesture recognition
  • 08.Finger control
  • 09.Posture estimation
  • 10.Face mask
  • 11.Overall detection
  • 12.Green scene removal(Human)
06.YOLO26 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
07.QR code recognition
  • QR code recognition
08.Docker basic course
  • 01.Docker introduction
  • 02.Docker installation
  • 03.Docker command
  • 04.Docker usage
  • 05.Docker interaction
09.ROS2-Jazzy
01.ROS2 basic course
  • 1.Introduction to ROS2
  • 2.ROS2 install Jazzy
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
02.ROS2 vision course
  • 01.Camera preview (USB)
  • 02.Camera preview (CSI)
  • 03.Camera calibration (USB)
  • 04.Camera calibration (CSI)
  • 05.AR vision (USB)
  • 06.AR vision (CSI)
10.Large model basic course
01.Offline large model
  • 01.AI large model environment deployment
  • 02.Install large model dialogue platform
  • 03.Meta AI - Llama model
  • 04.Alibaba Cloud - Qwen model
  • 05.Microsoft - Phi-4-mini model
  • 06.DeepSeek - DeepSeek model
  • 07.Alibaba Cloud - Qwen-VL visual multimodal large model
  • 08.Google - Gemma visual multimodal large model
  • 9.Llava visual multimodal large model
  • 10.MiniCPM-V visual multimodal large model
  • 11.High-quality vision-language grounding (LocateAnything)
02.Online large model
  • 01.Tongyi Qianwen large model
  • 02.OpenRouter large model API aggregation platform
11.Large model application practice
01.Voice interaction application
  • 1.Voice interaction hardware connection (Must read)
  • 2.Offline speech to text (ASR)
  • 3.Offline text to speech (TTS)
  • 4.AI large model voice interaction
  • 5.AI large model offline voice assistant
02.Multimodal large model application (Online_Offline large model + Text_Voice interaction)
  • 01.Multimodal visual understand application
  • 02.Multimodal text image application
  • 03.Multimodal video analysis application
  • 04.Multi module visual position application
  • 05.Multimodal table scanning application
  • 06.Multimodal autonomous agent application
12.NVIDIA Isaac ROS course
  • 01.Build Isaac ROS environment
  • 02.Deep segmentation
  • 03.DNN stereoscopic depth
  • 04.Free space segmentation
  • 05.Image distortion processing
  • 06.Image segmentation
  • 07.3D scene reconstruction and mapping
  • 08.Object detection
  • 09.3D attitude estimation
  • 10.Visual SLAM
13.OpenClaw deployment and basic usage
01.OpenClaw deployment and introduction
  • 01.Quick start with the pre-configured environment (Recommended)
  • 02.OpenClaw Deployment
  • 03.OpenClaw WhatsApp Plugin Application
  • 04.OpenClaw WebChat Interaction
  • 05.OpenClaw TUI Interaction
  • 06.OpenClaw Tools Introduction
  • 07.OpenClawGate Gateway User Manual
  • 08.OpenClaw Features Overview
  • 09.OpenClawHub Introduction (Skill Installation)
02.OpenClaw basic application
  • 01.OpenClaw Application - File Management
  • 02.OpenClaw Application - Camera
  • 03.OpenClaw Application - Browser Control
  • 04.OpenClaw Application - Script Execution
  • 05.OpenClaw Application - AI Programming (Peripheral & GPIO Control)
  • 06.OpenClaw Application - Dedicated AI Assistant
  • 07.OpenClaw Web Search Capability Configuration
03.NVIDIA official Agent Skills application
  • 01.AI-assisted development with VS Code or Cursor
  • 02.Jetson device skills
  • 03.Jetson BSP custom agent skills
14.OpenClaw advanced development
01.Preparation Before Use
  • 01.Peripheral Hardware Configuration
  • 02.OpenClaw API-KEY Configuration
  • 03.OpenClaw Model Switching
  • 04.OpenClaw Prompts
  • 05.AI Voice Interaction Configuration
  • 06.Three Dialogue Configuration Tests
02.OpenClaw AI Programming Peripheral Control
  • 1. Servo Control
  • 2. RGB Strip
  • 3. OLED Display
  • 4. Temperature and Humidity Sensor
  • 5. Camera Application
  • 6. AI Script Peripheral Control
03.OpenClaw Peripheral Integration Applications
  • 1. Plant Care Assistant
  • 2. AI Calorie Estimation
  • 3. AI Rock Paper Scissors Game
  • 4. AI Pet
  • 5. AI Weather Station
  • 6. Temperature Humidity Dashboard
  • 7. Scheduled Tasks
Download
  • System_File
  • VMFile_BootFile
  • 3D Model File
  • DataSheet
  • Software_Tools
  • Code
  • Manual
Download ZIP

Welcome to Jetson Orin NANO Developer Kit repository

05.AI Voice Interaction Configuration

OpenClaw AI Voice Interaction Configuration

OpenClaw AI Voice Interaction Configuration1. Course Overview2. Voice Interaction Overall Pipeline3. Voice Configuration File Description3.1 Configuration File Location3.2 Minimum Configuration to Check Before Startup4. Key Parameter Description4.1 Voice Recognition Engine4.2 Microphone and Speaker Devices4.3 DashScope Authentication and ASR Model4.4 TTS Voice Broadcast Configuration4.5 OpenClaw Gateway Configuration Reference4.6 Serial Wake Configuration4.7 Chinese-English Switching Steps5. Start Voice Interaction5.1 Prepare Virtual Environment5.2 Startup Method5.3 If Other Interaction Methods Need Broadcast6. Configuration Verification Methods6.1 Verify Voice Program Can Start6.2 Verify Recognition and Publishing Process6.4 Verify TTS [Optional]7. Common Issues7.1 Program Startup Failure7.2 No Recognition Result After Wake7.3 Recognition Successful But OpenClaw Not Responding7.4 Can Recognize But No Voice Broadcast7.5 Serial Wake Failure8. Recommended Debugging Order

1. Course Overview

This course will introduce how to configure OpenClaw's AI voice interaction pipeline, including voice configuration file location, key parameter descriptions, startup methods, and common troubleshooting.

After completing this course, you will be able to:

  • Know which configuration file is used for AI voice interaction

  • Understand the meaning of key parameters in .env

  • Correctly start the voice program

2. Voice Interaction Overall Pipeline

OpenClaw's current voice interaction process can be simply understood as:

  1. Microphone collects voice

  2. Program performs silence detection and segmentation

  3. ASR engine recognizes voice into text

  4. Recognition results are published to OpenClaw

  5. OpenClaw returns results

  6. [Optional] TTS broadcasts the returned results (reply content may be long, you can choose whether to broadcast)

The core configuration file for this pipeline is:

/home/jetson/voice_to_openclaw/.env

3. Voice Configuration File Description

3.1 Configuration File Location

xxxxxxxxxx
/home/jetson/voice_to_openclaw/.env

If this file does not exist, you can first copy from the template:

xxxxxxxxxx
cd /home/jetson/voice_to_openclaw/
cp .env.example .env

3.2 Minimum Configuration to Check Before Startup

It is recommended to at least confirm the following items:

  • ASR_ENGINE

  • DASHSCOPE_API_KEY

  • DEVICE

  • SPEAKER_DEVICE

  • OPENCLAW_CONFIG_PATH

  • ENABLE_SERIAL_WAKE

4. Key Parameter Description

4.1 Voice Recognition Engine

xxxxxxxxxx
ASR_ENGINE=dashscope

Currently supports two modes:

  • dashscope: Tongyi Bailian native voice recognition interface, suitable for direct online use

For most beginners, it is recommended to keep:

xxxxxxxxxx
ASR_ENGINE=dashscope

4.2 Microphone and Speaker Devices

xxxxxxxxxx
DEVICE=0
SPEAKER_DEVICE=0

These two parameters determine which audio input device and output device the program uses.

Scenarios suitable for modification:

  • Multiple microphone devices

  • USB microphone is not the system default device

  • Speaker output is on the wrong device

If the voice program can start but cannot hear sound or record sound, check here first.

4.3 DashScope Authentication and ASR Model

Please log in to Alibaba Cloud Bailian to apply for an API key yourself

Link: Large Model Service Platform Bailian Console

image-20260428112611830

xxxxxxxxxx
DASHSCOPE_API_KEY=
DASHSCOPE_API_URL=https://dashscope.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
DASHSCOPE_ASR_MODEL=qwen3-asr-flash

Where:

  • DASHSCOPE_API_KEY: Must be filled with a valid API-KEY

  • DASHSCOPE_API_URL: Default is already provided

  • DASHSCOPE_ASR_MODEL: Default voice recognition model

If this is not configured correctly, common symptoms are:

  • Recognition failure after program startup

  • Authentication error return

  • Voice recognition request timeout or model error

4.4 TTS Voice Broadcast Configuration

xxxxxxxxxx
ENABLE_TTS=false
WAKE_ACK_TEXT=I am here。

If you want voice broadcast after voice recognition, you can enable:

xxxxxxxxxx
ENABLE_TTS=true

Current common TTS parameters include:

  • DASHSCOPE_TTS_MODEL

  • DASHSCOPE_TTS_VOICE

  • DASHSCOPE_TTS_VOLUME

  • DASHSCOPE_TTS_SPEECH_RATE

It is recommended to first get ASR working, then consider enabling TTS.

4.5 OpenClaw Gateway Configuration Reference

xxxxxxxxxx
OPENCLAW_CONFIG_PATH=~/.openclaw/openclaw.json
OPENCLAW_TIMEOUT=70  #Maximum retry time, waiting for OpenClaw reply. For long tasks, this time should be increased
OPENCLAW_RETRY=1

This part of the configuration determines how the voice program sends recognition results to OpenClaw.

By default:

  • The program will read openclaw.json

  • Automatically derive local gateway port

  • Automatically read gateway authentication token

Therefore, if voice recognition is successful but OpenClaw does not execute commands, check here first.

4.6 Serial Wake Configuration

xxxxxxxxxx
ENABLE_SERIAL_WAKE=true
MIC_SERIAL_PORT=/dev/ttyUSB0
MIC_SERIAL_BAUDRATE=115200
SERIAL_WAKE_REQUIRED=true

If you use the matching voice module, it usually adopts serial wake mode.

Main functions are:

  • Normally wait for wake signal

  • Start collecting next voice segment after receiving wake signal

  • Return to waiting state after processing is complete

If there is no matching serial wake module, you can adjust as needed:

xxxxxxxxxx
ENABLE_SERIAL_WAKE=false

4.7 Chinese-English Switching Steps

If you need to switch voice interaction from Chinese to English, it is recommended to directly modify the language parameters in .env, then restart the program.

Currently voice_to_openclaw/.env enables the domestic version (Bailian) by default.

Method 1: Overseas version (iFlytek International)

Main configuration items:

xxxxxxxxxx
XUNFEI_ASR_LANGUAGE=en_us
# XUNFEI_ASR_ACCENT=mandarin   # not needed for English recognition
# Terminal log language: zh / en
UI_LANGUAGE=en
  • Chinese recognition: XUNFEI_ASR_LANGUAGE=zh_cn

  • English recognition: XUNFEI_ASR_LANGUAGE=en_us

  • When recognition language is changed to English, XUNFEI_ASR_ACCENT is no longer needed; it can be commented out or kept with original value without being used

Example:

​x
# Chinese recognition
XUNFEI_ASR_LANGUAGE=zh_cn
XUNFEI_ASR_ACCENT=mandarin

# English recognition
XUNFEI_ASR_LANGUAGE=en_us
# XUNFEI_ASR_ACCENT=mandarin

If TTS is also enabled and you want English broadcast, you also need to change TTS_VOICE to an English voice tone you have activated; if you only want to verify English recognition first, just change the ASR language.

Method 2: Domestic version (Bailian)

Main configuration items:

xxxxxxxxxx
DASHSCOPE_LANGUAGE=zh
  • Chinese recognition: DASHSCOPE_LANGUAGE=zh

  • English recognition: DASHSCOPE_LANGUAGE=en

Example:

xxxxxxxxxx
# Chinese recognition
DASHSCOPE_LANGUAGE=zh
# Terminal log language: zh / en
UI_LANGUAGE=zh

If the Bailian solution also enables TTS, it is recommended to switch to the corresponding English voice tone simultaneously, otherwise it may happen that English recognition is normal but the broadcast still sounds like Chinese voice.

After modification is complete, re-execute the following startup command to take effect.

5. Start Voice Interaction

5.1 Prepare Virtual Environment

This step is not needed for factory images. If dependencies have not been installed, first execute:

xxxxxxxxxx
cd /home/jetson/voice_to_openclaw
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

5.2 Startup Method

xxxxxxxxxx
cd /home/jetson/voice_to_openclaw
source .venv/bin/activate
python -m src.main

If startup is successful, the program will enter waiting for wake or waiting for voice input state.

image-20260529185856108

If you start English log, it will look like this,

xxxxxxxxxx
# Terminal log language: zh / en
UI_LANGUAGE=en

image-20260529185937321

5.3 If Other Interaction Methods Need Broadcast

  • Change broadcast parameter configuration to True

xxxxxxxxxx
ENABLE_TTS=true 
  • Additionally start an independent listener, terminal input

xxxxxxxxxx
cd ~/voice_to_openclaw
source .venv/bin/activate
python -m src.openclaw_session_tts

image-20260529190000402

6. Configuration Verification Methods

6.1 Verify Voice Program Can Start

Execute:

xxxxxxxxxx
cd /home/jetson/voice_to_openclaw
source .venv/bin/activate
python -m src.main

If the program starts successfully and does not report errors immediately, it indicates that the basic environment is probably normal.

6.2 Verify Recognition and Publishing Process

Say "Hello, yahboom" to wake up, then you can try saying:

  • Tell me a joke

  • Display hello on OLED

If you can see OpenClaw returning text, it indicates:

  • Microphone collection is normal

  • ASR is normal

  • OpenClaw gateway publishing is normal

image-20260529190054382

It has a cropping function; if it's too short, you can tell it a joke via voice.

6.4 Verify TTS [Optional]

If enabled:

xxxxxxxxxx
ENABLE_TTS=true

Then after OpenClaw returns results, you should be able to hear voice broadcast.

7. Common Issues

7.1 Program Startup Failure

Check first:

  • Whether .venv exists

  • Whether dependencies have been installed

  • Whether .env exists

7.2 No Recognition Result After Wake

Check first:

  • Whether ASR_ENGINE is configured correctly

  • Whether DASHSCOPE_API_KEY is valid

  • Whether microphone device number DEVICE is correct

7.3 Recognition Successful But OpenClaw Not Responding

Check first:

  • Whether OPENCLAW_CONFIG_PATH is correct

  • Whether the gateway port in openclaw.json is normal

  • Whether OpenClaw gateway has been started

7.4 Can Recognize But No Voice Broadcast

Check first:

  • Whether ENABLE_TTS is true

  • Whether SPEAKER_DEVICE is correct

  • Whether speaker is properly connected

7.5 Serial Wake Failure

Check first:

  • Whether ENABLE_SERIAL_WAKE is true

  • Whether MIC_SERIAL_PORT is correct

  • Whether MIC_SERIAL_BAUDRATE is correct

  • Whether voice module serial device has been recognized by the system

8. Recommended Debugging Order

It is recommended to troubleshoot the voice pipeline in the following order:

  1. First confirm the .env file exists

  2. Then confirm DASHSCOPE_API_KEY has been filled in

  3. Start the program and confirm no immediate errors

  4. Check if wake is effective

  5. Check if recognition is effective

  6. Check if OpenClaw receives text

  7. Finally check TTS broadcast

OpenClaw Prompts
Three Dialogue Configuration Tests

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文