Ollama

OllamaLarge Language Models (LLM)Ollama InstallationScript InstallationOllama usageReferences

Demo Environment

Development board: Jetson Orin series motherboard

SSD: 128G

Tutorial Scope

Motherboard model	Support
Jetson Orin NX 16GB	√
Jetson Orin NX 8GB	√
Jetson Orin Nano 8GB	√
Jetson Orin Nano 4GB	√

Ollama is an open source tool that aims to simplify the deployment and operation of large language models, allowing users to use high-quality language models in local environments.

Large Language Models (LLM)

Large Language Models (LLM) are a type of advanced text generation system based on artificial intelligence technology. Its main feature is that it can learn and understand human language through large-scale training data and can generate natural and fluent text.

Ollama Installation

The tutorial demonstrates the use of scripts to install Ollama on Jetson Orin series motherboards.

Script Installation


xxxxxxxxxx
sudo apt install curl
curl -fsSL https://ollama.com/install.sh | sh

The entire installation process takes a long time, please be patient!


xxxxxxxxxx
The prompt curl: (22) The requested URL returned error: 404 appears, you can ignore it!

Ollama usage

Type ollama in the terminal and you will see the prompt:

Command	Purpose
ollama serve	Start ollama
ollama create	Create a model from a model file
ollama show	Show model information
ollama run	Run a model
ollama pull	Pull a model from a registry
ollama push	Push a model to a registry
ollama list	List models
ollama ps	List running models
ollama cp	Copy a model
ollama rm	Delete a model
ollama help	Get help information about any command

Delete service


xxxxxxxxxx
sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service

Delete Files


xxxxxxxxxx
sudo rm $(which ollama)

Deleting model and service users and groups


xxxxxxxxxx
sudo rm -r /usr/share/ollama
sudo userdel ollama
sudo groupdel ollama

References

Ollama

Official website: https://ollama.com/

GitHub: https://github.com/ollama/ollama