Open WebUI

Demonstration environment

Development Board : Raspberry Pi 500

SD(TF)card：32G（Above 16G, the larger the capacity, the more models can be experienced）


Raspberry Pi 500 (8G RAM): Run 8B and below parameter models

Open WebUI is an open-source project aimed at providing a simple and easy-to-use user interface (UI) for managing and monitoring open-source software and services.


xxxxxxxxxx
There is a high probability of unresponsive or timeout conversations when using Open WebUI. You can try restarting Open WebUI or using Ollama tools to run the model!

Environmental requirements

Host and Conda installation of Open WebUI: Node. js>=20.10, Python=3.11 required

Environmental construction method	Difficulty level
Host	High
Conda	Middle
Docker	Low

Tutorial demonstration of Docker installing Open WebUI.

Docker build

Official installation of Docker

If Docker is not installed, you can use a script to install Docker.


xxxxxxxxxx
The Raspberry Pi 5 image provided by Yahboom has Docker installed, so you don't need to install it yourself!

Input the following command to update the local package list


xxxxxxxxxx
sudo apt update

Input the following command to upgrade installed software packages


xxxxxxxxxx
sudo apt upgrade

Download and run scripts

Download the get docker. sh file and save it in the current directory.


xxxxxxxxxx
sudo apt install curl


xxxxxxxxxx
curl -fsSL https://get.docker.com -o get-docker.sh

Input the following command to run the get docker. sh script file with sudo permissions.


xxxxxxxxxx
sudo sh get-docker.sh

Install Docker on Alibaba Cloud

If you cannot install it by yourself, please use the image Yahboom provided.

Input the following command to update the local package list


xxxxxxxxxx
sudo apt update

Input the following command to install essential software


xxxxxxxxxx
sudo apt install apt-transport-https ca-certificates curl gnupg2 lsb-release software-properties-common

Input the following command to add GPG key for software source


xxxxxxxxxx
curl -fsSL https://mirrors.aliyun.com/docker-ce/linux/debian/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg

Input the following command to add Alibaba Cloud mirror software source


xxxxxxxxxx
echo "deb [arch=arm64 signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://mirrors.aliyun.com/docker-ce/linux/debian bookworm stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null

Install Docker


xxxxxxxxxx
sudo apt update
sudo apt install docker-ce docker-ce-cli containerd.io docker-compose-plugin

Install Open WebUI

For systems with Docker installed, you can directly enter the following command on the terminal.


xxxxxxxxxx
sudo docker pull ghcr.io/open-webui/open-webui:main

Run Open WebUI

Input the following command to start Docker


xxxxxxxxxx
sudo docker run --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

After successful startup, access the following website in your browser.


xxxxxxxxxx
http://localhost:8080/

Administrator account

The first time you use it, you need to register an account yourself. This account is an administrator account, and you can fill in the information according to the requirements!


xxxxxxxxxx
Since all the contents of our mirror have been set up and tested, users can directly log in with our registered account:
Name: admin
Email: admin@qq.com
Password: admin

Register and log in

Using the interface

Model dialogue

Using Open WebUI for conversations can run slower than directly using Ollama tools, and even cause timeout service connection failures, which is related to the memory of Raspberry Pi 5 and cannot be avoided!

Switch models

Click on 'Select a model' to select the specified model dialogue.


xxxxxxxxxx
The model pulled using Ollama will be automatically added to the Open WebUI model option, and a new model will appear when refreshing the webpage!

Llama3


xxxxxxxxxx
Why is the sky blue?

Qwen2


xxxxxxxxxx
Tell me something about large language models.

LLaVA

Raspberry Pi 5 8G RAM version may cause service connection timeout when recognizing images. It is recommended to directly use the Ollama tool to run the LLaVA model for image recognition!


xxxxxxxxxx
Tell me a joke

Phi-3


xxxxxxxxxx
Tell me a bedtime story

Gemma


xxxxxxxxxx
print HelloWorld in C

WizardLM2


xxxxxxxxxx
How to learn a programming language?

FAQ

Close Open WebUI

Turn off self-booting Open WebUI

View running Dockers


xxxxxxxxxx
docker ps

Close running Dockers


xxxxxxxxxx
docker stop [CONTAINER ID]  # Eg: docker stop 5f42ee9cf784

Viewing stopped containers


xxxxxxxxxx
docker ps -a

Clean stopped containers


xxxxxxxxxx
docker rm [CONTAINER ID]    # Eg: docker rm 5f42ee9cf784

Clean up all containers that have stopped running


xxxxxxxxxx
docker container prune

Common mistake

Unable to start Open WebUI

docker: Error response from daemon: Conflict. The container name "/open-webui" is already in use by container "cfc05c84f8e38b290337e7178c76fd1c49076f94b11ed3d49d9448be72b7f20f". You have to remove (or rename) that container to be able to reuse that name.

Solution: Close Open WebUI once and restart!

Service connection timeout

Open WebUI: Server Connection Error

Close Open WebUI once and restart, then ask again or use Ollama tool to run the model for questioning!