Welcome to ROSMASTER X3 repository

4.Gemma model

Gemma

GemmaModel sizePull GemmaUse GemmaRun GemmaStart a conversationEnd the conversationReferences

Demo Environment

Development board: Jetson Orin series motherboard

SSD: 128G

Tutorial application scope: Whether the motherboard can run is related to the available memory of the system. The user's own environment and the programs running in the background may cause the model to fail to run

Motherboard model	Ollama	Open WebUI
Jetson Orin NX 16GB	√	√
Jetson Orin NX 8GB	√（Need to run the small parameter version）	√（Need to run the small parameter version）
Jetson Orin Nano 8GB	√（Need to run the small parameter version）	√（Need to run the small parameter version）
Jetson Orin Nano 4GB	√（Need to run the small parameter version）	√（Need to run the small parameter version）

Gemma is a new open model developed by Google and its DeepMind team.

Model size

Model	Parameters
Gemma	2B
Gemma	7B

Pull Gemma

Using the pull command will automatically pull the model of the Ollama model library:


xxxxxxxxxx
ollama pull gemma:7b

Model with small parameters: motherboards with 8G or less memory can run this


xxxxxxxxxx
ollama pull gemma:2b

Use Gemma

Run Gemma

If the system does not have a running model, the system will automatically pull the Gemma 7B model and run it:


xxxxxxxxxx
ollama run gemma:7b

Model with small parameters: motherboards with 8G or less memory can run this


xxxxxxxxxx
ollama run gemma:2b

Start a conversation


xxxxxxxxxx
print HelloWorld in C

The time to reply to the question depends on the hardware configuration, please be patient!

End the conversation

Use the Ctrl+d shortcut key or /bye to end the conversation!

References

Ollama

Official website: https://ollama.com/

GitHub: https://github.com/ollama/ollama

Gemma

GitHub: https://github.com/google-deepmind/gemma

Ollama corresponding model: https://ollama.com/library/gemma

WizardLM2 model