Welcome to ROSMASTER X3 Plus repository
2.Qwen2 model
Qwen2
Qwen2Model sizePerformancePull Qwen2Use Qwen2Run Qwen2Have a conversationEnd the conversationReferences
Demo Environment
Development board: Jetson Orin series motherboard
SSD: 128G
Tutorial application scope: Whether the motherboard can run is related to the available memory of the system. The user's own environment and the programs running in the background may cause the model to fail to run
| Motherboard model | Ollama | Open WebUI |
|---|---|---|
| Jetson Orin NX 16GB | √ | √ |
| Jetson Orin NX 8GB | √ | √ |
| Jetson Orin Nano 8GB | √ | √ |
| Jetson Orin Nano 4GB | √((Need to run the small parameter version)) | √((Need to run the small parameter version)) |
Alibaba Qwen2 is an advanced open source large language model developed by Alibaba, designed to provide powerful natural language processing capabilities.
Model size
| Model | Parameters |
|---|---|
| Qwen2 | 0.5B |
| Qwen2 | 1.5B |
| Qwen2 | 7B |
| Qwen2 | 72B |
Performance

Pull Qwen2
Using the pull command will automatically pull the model of the Ollama model library:
xxxxxxxxxxollama pull qwen2:7b
Small parameter version model: motherboards with 8G memory or less can run this
xxxxxxxxxxollama pull qwen2:1.5b

Use Qwen2
Run Qwen2
If the system does not have a running model, the system will automatically pull the Qwen2 7B model and run it:
xxxxxxxxxxollama run qwen2:7b
Small parameter version model: motherboards with 8G or less memory can run this
xxxxxxxxxxollama run qwen2:1.5b
Have a conversation
xxxxxxxxxxTell me something about large language models.
The time to reply to the question is related to the hardware configuration, please be patient!

End the conversation
Use the Ctrl+d shortcut key or /bye to end the conversation!

References
Ollama
Official website: https://ollama.com/
GitHub: https://github.com/ollama/ollama
Qwen2
GitHub: https://github.com/QwenLM/Qwen2
Ollama corresponding model: https://ollama.com/library/qwen2