Open WebUI

Demonstration Environment

Development Board: Jetson nano

SD (TF) Card: 64GB

It is recommended to run models with 4B or fewer parameters.

Open WebUI is an open source project that aims to provide a simple and easy-to-use user interface (UI) for managing and monitoring open source software and services.

xxxxxxxxxx
When using Open WebUI, the dialog may become unresponsive or timeout. Try restarting Open WebUI or switching to the Ollama tool to run the model.

Environment Requirements

Host and Conda Installation of Open WebUI: Requires Node.js 20.10 or higher and Python 3.11:

This tutorial demonstrates installing Open WebUI using Docker.

Docker Setup

Official Docker Installation

If Docker is not installed, you can use a script to install it in one click.

​x
The large model image we provide already has Docker installed, so you don't need to install it yourself!
​
Users in China may not be able to install Docker through official methods. We recommend installing Docker using Alibaba Cloud or using our images directly.

• Update the local package list

xxxxxxxxxx
sudo apt update

• Upgrade installed packages

xxxxxxxxxx
sudo apt upgrade

• Download and run the script

Download the get-docker.sh file and save it in the current directory.

xxxxxxxxxx
sudo apt install curl
curl -fsSL https://get.docker.com -o get-docker.sh

Run the get-docker.sh script with sudo privileges.

xxxxxxxxxx
sudo sh get-docker.sh

Installing Open WebUI

For systems with Docker installed, you can directly enter the following command in the terminal: The image is the result of the pull.

xxxxxxxxxx
sudo docker pull ghcr.io/open-webui/open-webui:main

Running Open WebUI

Enter the following command in the terminal to start the specified Docker:

xxxxxxxxxx
sudo docker run --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

After successfully launching, access the following URL in your browser:

xxxxxxxxxx
http://localhost:8080/

Administrator Account

For first-time users, you will need to register an administrator account. Please fill in the required information.

xxxxxxxxxx
Since all content in our image has been set up and tested, users can log in directly using our registered account:
Username: yahboom
Email: yahboom@163.com
Password: yahboom

Register and Login

User Interface

Model Dialog

Using Open Using the WebUI will be slower than using the Ollama tool directly, and may even result in timeouts and service connection failures. This is related to the Jetson Nano's memory and is unavoidable!

xxxxxxxxxx
Expert users can switch to another Linux environment to set up the Ollama tool and communicate with the Open WebUI tool.

Switching Models

Click Select a model to select a specific model for communication.

xxxxxxxxxx
Models pulled using Ollama will automatically be added to the Open WebUI model selection. Refresh the page to see the new model!

Demo: Qwen2

xxxxxxxxxx
Tell me something about large language models.

FAQ

Shut down Open WebUI

Shut down the automatically started Open WebUI.

• View running Docker containers

xxxxxxxxxx
docker ps

• Shut down running Docker containers

xxxxxxxxxx
docker stop [CONTAINER ID] # Example: docker stop 5f42ee9cf784

• View stopped containers

xxxxxxxxxx
docker ps -a

• Clean up stopped containers

xxxxxxxxxx
docker rm [CONTAINER ID] # Example: docker rm 5f42ee9cf784

Clean up all stopped containers:

xxxxxxxxxx
docker container prune

Common Errors

Unable to start Open WebUI

• docker: Error response from daemon: Conflict. The container name "/open-webui" is already in use by container "cfc05c84f8e38b290337e7178c76fd1c49076f94b11ed3d49d9448be72b7f20f". You must remove (or rename) the container to reuse the name.

Solution: Close Open WebUI and restart it!

Service Connection Timeout

• Open WebUI: Server Connection Error

Close Open WebUI and restart it, then try again or run the model in the Ollama tool.