Welcome to RDK X5 Board repository
2.LLM-Conversation-Platform-Installation
Open WebUI
Open WebUIEnvironmental requirementsDocker setupOfficial installation of DockerAlibaba Cloud installation of DockerOpen WebUI installationOpen WebUI operationAdministrator accountRegister and log inUse interfaceModel dialogueSwitch modelCommon ProblemsClose Open WebUICommon ErrorsUnable to start Open WebUIService connection timed out
Users who use the AI large model image have already set up the environment, and all the setup-related operations in the tutorial do not need to be performed. You can jump directly to running.
Demonstration Environment
Development Board: RDK X5
SD (TF) Card: 64G
RDK X5 (8G RAM): Runs models with 8B and below parametersRDK X5 (4G RAM): Runs models with 3B and below parameters
Open WebUI is an open source project that aims to provide a simple and easy-to-use user interface (UI) for managing and monitoring open source software and services.
xxxxxxxxxxThere is a high probability that there will be no response or timeout in the dialogue when using Open WebUI. You can try to restart Open WebUI or use the Ollama tool to run the model instead!
Environmental requirements
Host and Conda installation of Open WebUI: requires Node.js >= 20.10, Python = 3.11:
| Environment Setup Method | Difficulty (relative) |
|---|---|
| Host | High |
| Conda | Medium |
| Docker | Low |
The tutorial demonstrates the installation of Open WebUI with Docker.
Docker setup
Official installation of Docker
If Docker is not installed, you can use a script to install Docker with one click.
xxxxxxxxxxThe image we provide has Docker installed, so you don't need to install it yourself!Domestic users may not be able to install Docker through the official method. We recommend using Alibaba Cloud to install Docker or using our image directly.
Update the local package list
xxxxxxxxxxsudo apt update
Download and run the script
Download the get-docker.sh file and save it in the current directory.
xxxxxxxxxxsudo apt install curl
xxxxxxxxxxcurl -fsSL https://get.docker.com -o get-docker.sh
Run the get-docker.sh script file with sudo permission.
xxxxxxxxxxsudo sh get-docker.sh
Alibaba Cloud installation of Docker
If you cannot install it yourself, please use the image we provide.
Update the local package list
xxxxxxxxxxsudo apt update
Install necessary software
xxxxxxxxxxsudo apt install apt-transport-https ca-certificates curl gnupg2 lsb-release software-properties-common
Add the GPG key for the software source
xxxxxxxxxxcurl -fsSL https://mirrors.aliyun.com/docker-ce/linux/debian/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
Add Alibaba Cloud mirror software source
xxxxxxxxxxecho "deb [arch=arm64 signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://mirrors.aliyun.com/docker-ce/linux/debian bookworm stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
Install Docker
xxxxxxxxxxsudo apt updatesudo apt install docker-ce docker-ce-cli containerd.io docker-compose-plugin
Open WebUI installation
For systems with Docker installed, you can directly enter the following command in the terminal:
xxxxxxxxxxsudo docker pull ghcr.io/open-webui/open-webui:main

Open WebUI operation
Enter the following command in the terminal to start the specified Docker:
xxxxxxxxxxsudo docker run --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

After successful startup, use the following URL in your browser to access it:
xxxxxxxxxxhttp://localhost:8080/
Or use the motherboard IP:8080
Administrator account
When you use it for the first time, you need to register an account yourself. This account is an administrator account, and the information can be filled in as required!
xxxxxxxxxxSince all the content of our image has been set up and tested, users can log in directly with the account we registered:Username: yahboomEmail: yahboom@163.comPassword: yahboom
Register and log in



Use interface

Model dialogue
Dialogue with Open WebUI will be slower than running directly with the Ollama tool, and may even experience timeout service connection failures. This is related to the motherboard's memory and cannot be avoided!
xxxxxxxxxxUsers with ideas can switch to other Linux environments to build Ollama tools and Open WebUI tools for dialogue.
Switch model
Click Select a model to select a specified model for dialogue.
xxxxxxxxxxThe model pulled by ollama will be automatically added to the Open WebUI model options. Refresh the webpage and the new model will appear!

Common Problems
Close Open WebUI
Close the auto-starting Open WebUI.
View running Docker
xxxxxxxxxxdocker ps
Close the running Docker
xxxxxxxxxxdocker stop [CONTAINER ID] # Example docker stop 5f42ee9cf784
View stopped containers
xxxxxxxxxxdocker ps -a
Clean up stopped containers
xxxxxxxxxxdocker rm [CONTAINER ID] # Example docker rm 5f42ee9cf784
Clean up all stopped containers:
xxxxxxxxxxdocker container prune
Common Errors
Unable to start Open WebUI
docker: Error response from daemon: Conflict. The container name "/open-webui" is already in use by container "cfc05c84f8e38b290337e7178c76fd1c49076f94b11ed3d49d9448be72b7f20f". You have to remove (or rename) that container to be able to reuse that name.
Solution: Close Open WebUI once and restart it!
Service connection timed out
Open WebUI: Server Connection Error
Close Open WebUI once and restart it, then ask the question again or switch to the Ollama tool to run the model and ask the question!