yahboom
HomeTutorialsProduct
Solution
Blog
Online Store
About Us
EN/中文
Store
Jetson Orin NANO Developer Kit📖
01.Get started
  • 01. Learning route
  • 02. Get started quickly
  • 03. System Update Notes
  • 04. Disabling automatic updates and troubleshooting issues
  • 05. Jetson Orin Nano official kit screwdriver instructions
02.Jetson basic course
  • 01.Jetson board introduction
  • 02.Write Jetson original system
  • 03.Installing Jetson environment
  • 04.Backup SSD system
  • 05.Restore initial image system
  • 06.Upgrade to SUPER version (Optional)
  • 07.Write SUPER boot (Must read)
  • 08.SSD expansion
  • 09.Jetpack old system upgraded to Yahboom SUPER factory system
  • 10.Write the system onto your own SSD
03.Basic setting course
  • 01.Basic knowledge
  • 02.Network configuration
  • 03.SSH remote login
  • 04.VNC remote control
  • 05.RDP remote control
  • 06.Remote file transfer
  • 07.Jtop tool
  • 08.Exchange space expansion
  • 09.Use VSCode
  • 10.Use VMware
  • 11.Modify screen resolution
04.GPIO control course
  • 01.GPIO description
  • 02.GPIO library installation
  • 03.GPIO reading
  • 04.GPIO output
  • 05.Serial communication
  • 06.I2C communication
05.Vision basic course
  • 01.CSI camera preview
  • 02.USB camera preview
  • 03.Use Jupyter Lab
  • 04.Use JetCam
06.OpenCV basic course
  • 01.Image reading
  • 02.Image saving
  • 03.Image modification
  • 04.Image scaling
  • 05.Image cropping
  • 06.Image translation
  • 07.Image mirroring
  • 08.Image grayscale conversion
  • 09.Image binarization
  • 10.Image edge detection
  • 11.Add line segments
  • 12.Add rectangles
  • 13.Add circular shape
  • 14.Add ellipses
  • 15.Add polygons
  • 16.Add Text
  • 17.Preview USB camera image
  • 18.Preview CSI camera image
07.Vision advanced course
01.Environment construction
  • 01.TensorFlow
  • 02.PyTorch
  • 03.Torchvision
02.DeepStream development
  • 01.DeepStream environment
  • 02.License plate detection and recognition
  • 03.Parallel multi-model inference
  • 04.Object embedding vector generation
  • 05.Pose recognition
  • 06.NV optical flow anomaly detection
  • 07.Single-view 3D tracking
  • 08.Multi-view 3D tracking
03.NVIDIA TAO toolkit application
  • 01.Traffic scene object detection
  • 02.Person object detection
  • 03.Vehicle brand classification
  • 04.Vehicle model classification
  • 05.License plate detection and recognition
  • 06.Person semantic segmentation
  • 07.Retail product detection and recognition
  • 08.Person feature extraction and matching (ReID)
  • 09.Person action and pose classification
  • 10.Transformer-based person detection
  • 11.3D human skeleton detection
  • 12.LiDAR 3D point cloud detection
04.YOLO11 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
05.Mediapipe development
  • 01.Mediapipe environment
  • 02.Hand detection
  • 03.Face detection
  • 04.Face effects
  • 05.3D object recognition
  • 06.Virtual brush
  • 07.Gesture recognition
  • 08.Finger control
  • 09.Posture estimation
  • 10.Face mask
  • 11.Overall detection
  • 12.Green scene removal(Human)
06.YOLO26 development
  • 01.YOLO environment construction
  • 02.CLI use
  • 03.Object detection
  • 04.Instance segmentation
  • 05.Pose estimation
  • 06.Image classification
  • 07.Oriented object detection
  • 08.Model conversion
  • 09.Dataset annotation
  • 10.Model training conversion
  • 11.Model prediction
07.QR code recognition
  • QR code recognition
08.Docker basic course
  • 01.Docker introduction
  • 02.Docker installation
  • 03.Docker command
  • 04.Docker usage
  • 05.Docker interaction
09.ROS2-Jazzy
01.ROS2 basic course
  • 1.Introduction to ROS2
  • 2.ROS2 install Jazzy
  • 3.ROS2 development environment
  • 4.ROS2 workspace
  • 5.ROS2 function package
  • 6.ROS2 node
  • 7.ROS2 topic communication
  • 8.ROS2 service communication
  • 9.ROS2 action communication
  • 10.ROS2 custom interface message
  • 11.ROS2 parameter service case
  • 12.ROS2 meta-function package
  • 13.ROS2 distributed communication
  • 14.ROS2 DDS
  • 15.ROS2 time related API
  • 16.ROS2 common command tools
  • 17.ROS2 rviz2 use
  • 18.ROS2 rqt toolbox
  • 19.ROS2 Launch startup file configuration
  • 20.ROS2 recording and playback tool
  • 21.ROS2 URDF model
  • 22.ROS2 Gazebo simulation platform
  • 23.ROS2 TF2 coordinate transformation
02.ROS2 vision course
  • 01.Camera preview (USB)
  • 02.Camera preview (CSI)
  • 03.Camera calibration (USB)
  • 04.Camera calibration (CSI)
  • 05.AR vision (USB)
  • 06.AR vision (CSI)
10.Large model basic course
01.Offline large model
  • 01.AI large model environment deployment
  • 02.Install large model dialogue platform
  • 03.Meta AI - Llama model
  • 04.Alibaba Cloud - Qwen model
  • 05.Microsoft - Phi-4-mini model
  • 06.DeepSeek - DeepSeek model
  • 07.Alibaba Cloud - Qwen-VL visual multimodal large model
  • 08.Google - Gemma visual multimodal large model
  • 9.Llava visual multimodal large model
  • 10.MiniCPM-V visual multimodal large model
  • 11.High-quality vision-language grounding (LocateAnything)
02.Online large model
  • 01.Tongyi Qianwen large model
  • 02.OpenRouter large model API aggregation platform
11.Large model application practice
01.Voice interaction application
  • 1.Voice interaction hardware connection (Must read)
  • 2.Offline speech to text (ASR)
  • 3.Offline text to speech (TTS)
  • 4.AI large model voice interaction
  • 5.AI large model offline voice assistant
02.Multimodal large model application (Online_Offline large model + Text_Voice interaction)
  • 01.Multimodal visual understand application
  • 02.Multimodal text image application
  • 03.Multimodal video analysis application
  • 04.Multi module visual position application
  • 05.Multimodal table scanning application
  • 06.Multimodal autonomous agent application
12.NVIDIA Isaac ROS course
  • 01.Build Isaac ROS environment
  • 02.Deep segmentation
  • 03.DNN stereoscopic depth
  • 04.Free space segmentation
  • 05.Image distortion processing
  • 06.Image segmentation
  • 07.3D scene reconstruction and mapping
  • 08.Object detection
  • 09.3D attitude estimation
  • 10.Visual SLAM
13.OpenClaw deployment and basic usage
01.OpenClaw deployment and introduction
  • 01.Quick start with the pre-configured environment (Recommended)
  • 02.OpenClaw Deployment
  • 03.OpenClaw WhatsApp Plugin Application
  • 04.OpenClaw WebChat Interaction
  • 05.OpenClaw TUI Interaction
  • 06.OpenClaw Tools Introduction
  • 07.OpenClawGate Gateway User Manual
  • 08.OpenClaw Features Overview
  • 09.OpenClawHub Introduction (Skill Installation)
02.OpenClaw basic application
  • 01.OpenClaw Application - File Management
  • 02.OpenClaw Application - Camera
  • 03.OpenClaw Application - Browser Control
  • 04.OpenClaw Application - Script Execution
  • 05.OpenClaw Application - AI Programming (Peripheral & GPIO Control)
  • 06.OpenClaw Application - Dedicated AI Assistant
  • 07.OpenClaw Web Search Capability Configuration
03.NVIDIA official Agent Skills application
  • 01.AI-assisted development with VS Code or Cursor
  • 02.Jetson device skills
  • 03.Jetson BSP custom agent skills
14.OpenClaw advanced development
01.Preparation Before Use
  • 01.Peripheral Hardware Configuration
  • 02.OpenClaw API-KEY Configuration
  • 03.OpenClaw Model Switching
  • 04.OpenClaw Prompts
  • 05.AI Voice Interaction Configuration
  • 06.Three Dialogue Configuration Tests
02.OpenClaw AI Programming Peripheral Control
  • 1. Servo Control
  • 2. RGB Strip
  • 3. OLED Display
  • 4. Temperature and Humidity Sensor
  • 5. Camera Application
  • 6. AI Script Peripheral Control
03.OpenClaw Peripheral Integration Applications
  • 1. Plant Care Assistant
  • 2. AI Calorie Estimation
  • 3. AI Rock Paper Scissors Game
  • 4. AI Pet
  • 5. AI Weather Station
  • 6. Temperature Humidity Dashboard
  • 7. Scheduled Tasks
Download
  • System_File
  • VMFile_BootFile
  • 3D Model File
  • DataSheet
  • Software_Tools
  • Code
  • Manual
Download ZIP

Welcome to Jetson Orin NANO Developer Kit repository

5.AI large model offline voice assistant

10. AI Large Model Voice Assistant (Online/Offline)

10. AI Large Model Voice Assistant (Online/Offline)1. Online/Offline Voice Configuration2. Creating a Boot Autostart Service (Systemd)2.1 Creating a Startup Script2.2 Creating the Systemd Service File2.3 Managing and Debugging the Service

1. Online/Offline Voice Configuration

Note: Due to performance limitations, the Jetson Orin Nano 4GB may not be able to run a fully offline combination smoothly; you can select an online LLM, ASR, or TTS in this chapter, or refer to the corresponding section in <Online Large Model (Voice Interaction)>.

Before setting up autostart, first confirm that the voice assistant works properly in the selected mode. ASR, LLM, and TTS can each select online or offline; only when the corresponding part is set to online is that service provider's network and API credentials required.

  1. Locate the configuration file: In your project code, find and open the configuration file: ~/yahboom_ws/src/largemodel/config/yahboom.yaml

  2. Modify the configuration parameters: Check the following parameters in the file and make sure their values match those shown below. If a parameter does not exist, add it.

    ​x
    asr:                                    #Voice node parameters
      ros__parameters:
        VAD_MODE: 2                         #vad sensitivity
        sample_rate: 16000                  #asr recording audio sample rate
        frame_duration_ms:  30              #vad frame size in ms
        use_oline_asr: False                # False: offline ASR; True: online ASR
        mic_serial_port: "/dev/ttyUSB0"     #microphone serial port alias
        mic_index: 0                        #microphone index
        language: 'zh'                      #asr language
        regional_setting : "China"          #international: international edition  China: China edition
    
    
    model_service:                          #model server node parameters
      ros__parameters:
        language: 'zh'                      #large model interface language
        useolinetts: False                  # False: offline TTS; True: online TTS
    
    
         # Large model configuration
        # llm_platform: 'ollama'              # Available platforms: 'ollama', 'tongyi', 'spark', 'qianfan', 'openrouter'
        llm_platform: 'ollama'              # 'ollama': offline LLM; 'tongyi': online Tongyi
        regional_setting : "China" 
    
    
    • Fully offline: use_oline_asr: False, useolinetts: False, llm_platform: 'ollama'.

    • Fully online example: use_oline_asr: True, useolinetts: True, llm_platform: 'tongyi'. Online ASR/TTS still requires configuring the respective service provider credentials; follow articles 1 and 2 of this chapter.

    • ASR, TTS, and LLM can be selected in mixed combinations; for example, an online LLM with offline ASR/TTS.

  3. Save the file and rebuild the project to apply the changes:

    xxxxxxxxxx
    cd ~/yahboom_ws
    colcon build
    source install/setup.bash

The online Tongyi LLM requires qianwen_api_key and the model name to be filled in; online ASR requires online_asr_api_key to be filled in; online TTS requires the corresponding service provider credentials to be filled in. In offline mode, confirm that the Ollama model, SenseVoiceSmall, and Piper model paths exist. See articles 1–3 of this chapter for detailed fields and examples.

Starting in online mode additionally requires the network to be available; offline mode requires the local models to be installed.

Note: If you are using the factory image, the scripts and service-related configurations are already complete, and the following operations are not required

2. Creating a Boot Autostart Service (Systemd)

Now we will create a systemd service so that largemodel_control.launch.py runs automatically at system startup. In online mode, it is recommended to wait until the network is ready before starting; if the device connects to the network slowly, you can check interface connectivity and the service logs after the service starts.

2.1 Creating a Startup Script

In order for systemd to load the ROS 2 environment correctly, the best practice is to create a simple bash script to wrap our startup command.

  1. Create the script file: In the directory (~/yahboom_ws/src/largemodel/), create a file named start_largemodel.sh.

    xxxxxxxxxx
    vim ~/yahboom_ws/src/largemodel/start_largemodel.sh
  2. Write the script content: Copy and paste the following content into the script file.

    xxxxxxxxxx
    #!/bin/bash
    
    
    # Source the ROS 2 Jazzy environment
    source /opt/ros/jazzy/setup.bash
    
    
    # Source the Yahboom workspace environment
    source /home/jetson/yahboom_ws/install/setup.bash
    
    
    # Start the largemodel control script
    ros2 launch largemodel largemodel_control.launch.py

    First run whoami to confirm the Linux user name and run echo $HOME to confirm the home directory; replace /home/jetson in the script with the actual home directory of the device.

  3. Save and exit

  4. Grant the script execute permission:

    xxxxxxxxxx
    chmod +x ~/yahboom_ws/src/largemodel/start_largemodel.sh

2.2 Creating the Systemd Service File

This is the most essential step. We will tell the system that we have a new service to manage.

  1. Create the service file: You need to use sudo privileges to create this file.

    xxxxxxxxxx
    sudo vim /etc/systemd/system/largemodel.service
  2. Write the service configuration: Copy and paste the following content completely into the service file.

    xxxxxxxxxx
    [Unit]
    Description=Robot Service
    After=network-online.target sound.target graphical.target
    Wants=network-online.target sound.target graphical.target
    
    
    [Service]
    Type=simple
    User=jetson
    Group=jetson
    Environment=DISPLAY=:0
    Environment=XDG_RUNTIME_DIR=/run/user/1000
    Environment=PULSE_SERVER=unix:/run/user/1000/pulse/native
    SupplementaryGroups=audio video
    ExecStartPre=/bin/sleep 10
    ExecStart=/home/jetson/yahboom_ws/src/largemodel/start_largemodel.sh
    Restart=on-failure
    StandardOutput=journal
    StandardError=journal
    
    
    [Install]
    WantedBy=multi-user.target

    Change the user name, UID, and paths in User, Group, XDG_RUNTIME_DIR, PULSE_SERVER, and ExecStart to the actual values of the device (you can query them with whoami, id -u, and echo $HOME). ExecStart must point to the script created in the previous step that has execute permission. Online mode uses network-online.target; the system also needs the wait-online service of the corresponding network manager enabled in order to wait until the network is truly ready.

  3. Save and exit.

2.3 Managing and Debugging the Service

Now that your service has been created, we need to have systemd load it and set it to start on boot.

  1. Reload the systemd daemon so that it reads our newly created service file:

    xxxxxxxxxx
    sudo systemctl daemon-reload
  2. Set the service to start on boot:

    xxxxxxxxxx
    sudo systemctl enable largemodel.service
  3. Start the service immediately:

    xxxxxxxxxx
    sudo systemctl start largemodel.service
  4. Check the service status: This is the most important command for verifying whether the service is running successfully.

    xxxxxxxxxx
    sudo systemctl status largemodel.service

    If you see Active: active (running), the service process has started; if it is failed, continue checking the service logs and verify the configuration, network, and audio devices.

  5. View the service logs (essential for debugging): If the service fails to start, you can view all real-time logs generated by the ros2 launch command with the following command, which is crucial for locating the problem.

    xxxxxxxxxx
    journalctl -u largemodel.service -f

After completing the steps above, the system will start the largemodel voice service according to the selected online or offline configuration.

AI large model voice interaction
Multimodal visual understand application

COMPANY

  • About us
  • Team Style
  • Blog

LEARNING & EXPLORATION

  • Tutorials
  • Edge AI hardware
  • Educational robots
  • Embedded intelligent hardware

WHERE TO BUY

  • Yahboom Online Store
  • Amazon
  • Alibaba
  • AliExpress
  • Mercado

TECHNOLOGY SUPPORT

  • Email: support@yahboom.com

BE A DISTRIBUTOR

  • Email: sales@yahboom.com
QR Code

Copyright © 2017-2026 Yahboom. All Rights Reserved.

EN/中文