Ollama

Ollama1. Large Language Model (LLM)2. Ollama InstallationScript Installation3. Use of Ollama4. Uninstall OllamaReferences

Demonstration environment

Development board: RDK X5 motherboard

SD card: 64G

Tutorial application scope

Mother board model	Support
rdk x5 4gb	√
rdk x5 8gb	√

Ollama is an open source tool that aims to simplify the deployment and operation of large language models, allowing users to use high-quality language models in local environments.

1. Large Language Model (LLM)

Large Language Models (LLM) are a type of advanced text generation system based on artificial intelligence technology. Its main feature is that it can learn and understand human language through large-scale training data and can generate natural and fluent text.

2. Ollama Installation

Note: It is recommended to use the image of the environment configured by Yabo Intelligent. It takes a long time to configure the environment personally, and there may be exceptions when installing different system versions.

The tutorial demonstrates the use of scripts to install Ollama on the rdk x5 motherboard. (The image of the large language model provided by Yabo Intelligent has already configured the environment, no need to install it again)

Script Installation


sudo apt install curl -y
sudo curl -fsSL https://ollama.com/install.sh | sh

The entire installation process takes a long time, please wait patiently!

When the installation is complete, it will show.

Check the Ollama version number.

3. Use of Ollama

Type ollama in the terminal and you will see the prompt.

Command	Function
ollama serve	Start ollama
ollama create	Creating a model from a model file
ollama show	Display model information
ollama run	Run model
ollama pull	Pulling models from the registry
ollama push	Pushing the model to the registry
ollama list	List models
ollama ps	List models run
ollama cp	Copy model
ollama rm	Delete model
ollama help	Get help information about any command

4. Uninstall Ollama

Delete service


xxxxxxxxxx
sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service

Deleting files


xxxxxxxxxx
sudo rm $(which ollama)

Deleting model and service users and groups


xxxxxxxxxx
sudo rm -r /usr/share/ollama
sudo userdel ollama
sudo groupdel ollama

References

Ollama

Website：https://ollama.com/

GitHub：https://github.com/ollama/ollama