Welcome to ROSMASTER A1 repository
9.Microsoft Orca Mini
Orca Mini
Orca MiniModel SizePulling the Orca MiniUsing the Orca MiniRunning Orca MiniStart a conversationEnd the conversationReferences
Demonstration Environment
Development Board: Jetson Nano
SD (TF) Card: 64GB
Recommended for models with 4 bytes or less parameters
Model Storage Location
xxxxxxxxxx/usr/share/ollama/.ollama/models
Model Size
| Model | Parameters |
|---|---|
| Orca Mini | 3 Bytes |
Pulling the Orca Mini
Using the pull command will automatically pull the model from the Ollama model repository:
xxxxxxxxxxollama pull orca-mini:3b

Using the Orca Mini
Running Orca Mini
If the system doesn't have a running model, the system will automatically download and run the Orca Mini 1.1B model:
xxxxxxxxxxollama run orca-mini:3b
Start a conversation
xxxxxxxxxxHow to learn a programming language?
Response time depends on your hardware configuration, so please be patient!

End the conversation
Use the Ctrl+d shortcut or /bye to end the conversation!

References
Ollama
Official Website: https://ollama.com/
GitHub: https://github.com/ollama/ollama
Orca Mini
Ollama Model: https://ollama.com/library/orca-mini