Ollama

Demo Environment

Development Boards: RDK X5, Jetson Orin, Raspberry Pi 5

Ollama is an open-source tool designed to simplify the deployment and operation of large language models, allowing users to use high-quality language models in their local environment.

1. Large Language Models (LLMs)

Large Language Models (LLMs) are a class of advanced text generation systems based on artificial intelligence. Their main characteristic is their ability to learn and understand human language through large-scale training data and generate natural and fluent text.

2. Ollama Installation

Note: It is recommended to use a pre-configured environment image from Yabo Smart. Personal environment configuration takes a long time, and installation may encounter issues depending on the system version.

This tutorial demonstrates installing Ollama using a script on an RDK X5 motherboard. (The large language model image provided by Yabo Intelligence is already configured; no further installation is required.)

Script Installation

xxxxxxxxxx
sudo apt install curl -y
sudo curl -fsSL https://ollama.com/install.sh | sh
​

The entire installation process takes a relatively long time; please be patient!

Note: Ollam download failures are normal. Try multiple times, or use a proxy to download. You'll need to search online for instructions on using a proxy.

Once the installation is complete, it should display:

xxxxxxxxxx
​

3. Using Ollam

Type ollama in the terminal to see the following prompts:

4. Uninstalling Ollama

• Delete the service

xxxxxxxxxx
sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service
​

• Delete a file

xxxxxxxxxx
sudo rm $(which ollama)
​

• Delete a model and service user and group

xxxxxxxxxx
sudo rm -r /usr/share/ollama
sudo userdel ollama
sudo groupdel ollama

References

Ollama

Official Website: https://ollama.com/

GitHub: https://github.com/ollama/ollama