1. Environment Installation

1. Preparation Before Use

This section teaches you how to set up a Raspberry Pi 5 using AI HAT+2.

Required Items

Hardware:

• Raspberry Pi 5
• AI HAT+2
• Thermal pad (included in the kit)
• Optional: Heatsink
• Optional: Official Raspberry Pi camera (e.g., Camera Module 3 or a high-quality camera)
• Optional: USB camera

We used a Raspberry Pi 5 model with the official active cooler and a 27W USB-C power supply. We recommend using the official USB-C power supply or a power supply that supports the Raspberry Pi 5 power protocol to ensure the motherboard can provide sufficient power to AI HAT+2.

Use the provided four screws and mounting pads. Press firmly onto the bottom of the Raspberry Pi GPIO 40-pin header; ensure all pins are in place. Disconnect the ribbon cable from the AI HAT+2 and insert the other end into the Raspberry Pi's PCIe port. Lift the ribbon cable brackets from both sides and insert the ribbon cable with the copper contacts facing inwards toward the USB port. After fully and evenly inserting the ribbon cable into the PCIe port, pull down the ribbon cable brackets from both sides to secure the cable in place.

The installation should look like the image below:

For information on CSI camera connections, please refer to the Raspberry Pi 5 camera example.

Software:

The Raspberry Pi needs to be flashed with the image shown below.

Note: The Raspberry Pi 5's SD card needs to contain a bootable image. Please refer to our Raspberry Pi 5 tutorial for image burning.

The interface that appears after successful boot.

Update System

Note: (The following steps are only necessary for DIY setups. If you are using the image we provide, you do not need to rebuild.)

This will update your system to the latest Raspberry Pi kernel, including AI HAT+2 driver support.

sudo apt update

xxxxxxxxxx
sudo apt full-upgrade -y

xxxxxxxxxx
sudo rpi-eeprom-update -a

Then, restart.

xxxxxxxxxx
sudo reboot

Set PCIe to Gen3

To achieve optimal performance for your AI HAT+2 device, it's necessary to set PCIe to Gen3. While using Gen2 is an option, it will result in performance degradation.

Open the Raspberry Pi Configuration Tool:

xxxxxxxxxx
sudo raspi-config

Select option "6 Advanced Options," then select option "A8 PCIe Speed." Select "Yes" to enable PCIe Gen 3 mode. Click "Finish" to exit. After exiting, you will be prompted to restart; select "Yes" to restart the Raspberry Pi.

Install AI HAT+ 2 Dependencies

Install all necessary software for the Raspberry Pi AI HAT+ 2 to function correctly. To do this, run the following command from a terminal window:

xxxxxxxxxx
sudo apt install dkms
sudo apt install hailo-h10-all -y

The image below shows that the installation has been successful.

Restart your Raspberry Pi.

xxxxxxxxxx
sudo reboot

2. Installing the Large Language Model Environment

1. Installing the Hailo Ollama Server

The Hailo Ollama server provides:

Pre-trained LLM models optimized for the Hailo-10H NPU.

A REST API for model inference.

To install the Hailo Ollama server, first download version 5.1.1 of the Hailo Model Zoo GenAI Debian package for Raspberry Pi 5.

Download link：https://dev-public.hailo.ai/2025_12/Hailo10/hailo_gen_ai_model_zoo_5.1.1_arm64.deb

Then use the following command in the Raspberry Pi terminal to install:

xxxxxxxxxx
sudo dpkg -i hailo_gen_ai_model_zoo_5.1.1_arm64.deb

2. Install Docker (for Open WebUI)

Note: Users in China need a VPN to install this program. Please search online for instructions on how to set up a VPN.

xxxxxxxxxx
sudo apt update

xxxxxxxxxx
sudo apt install ca-certificates curl

xxxxxxxxxx
sudo install -m 0755 -d /etc/apt/keyrings

xxxxxxxxxx
sudo curl -fsSL https://download.docker.com/linux/debian/gpg -o /etc/apt/keyrings/docker.asc

xxxxxxxxxx
sudo chmod a+r /etc/apt/keyrings/docker.asc

xxxxxxxxxx
sudo tee /etc/apt/sources.list.d/docker.sources <<EOF
Types: deb
URIs: https://download.docker.com/linux/debian
Suites: $(. /etc/os-release && echo "$VERSION_CODENAME")
Components: stable
Signed-By: /etc/apt/keyrings/docker.asc
EOF

xxxxxxxxxx
sudo apt update

Check if the docker.sources file has been created correctly:

xxxxxxxxxx
cat /etc/apt/sources.list.d/docker.sources

Install and run the Docker service:

xxxxxxxxxx
sudo apt install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin -y

xxxxxxxxxx
sudo systemctl start docker

Running docker commands without using sudo

xxxxxxxxxx
sudo groupadd docker

xxxxxxxxxx
sudo usermod -aG docker $USER

xxxxxxxxxx
newgrp docker

xxxxxxxxxx
docker version

Install Open WebUI

xxxxxxxxxx
docker pull ghcr.io/open-webui/open-webui:main

3. Install the Hailo application

Terminal input

xxxxxxxxxx
git clone https://github.com/hailo-ai/hailo-apps.git

xxxxxxxxxx
cd hailo-apps

Install dependencies

xxxxxxxxxx
sudo ./install.sh

The following is a message indicating that the installation is complete.

For more information on installation, please refer to hailo-apps/doc/user_guide/installation.md at main · hailo-ai/hailo-apps · GitHub