Welcome to ROSMASTER X3 repository
2.TinyLlama model
TinyLlama model
TinyLlama modelModel scaleGot TinyLlamaUse TinyLlamaRun TinyLlamaHave a conversationEnd the conversationReferences
Demo environment
Development Boards:Jetson Nano
SD (TF) card:64G
It is recommended to run the 4B and below parameter models
Model scale
| Model | Parameter |
|---|---|
| TinyLlama | 1.1B |
Got TinyLlama
Using the pull command will automatically pull the model from the Ollama model library.
xxxxxxxxxxollama pull tinyllama:1.1b

Use TinyLlama
Run TinyLlama
If the system does not have a running model, the system will automatically pull the TinyLlama 1.1B model and run it.
xxxxxxxxxxollama run tinyllama:1.1b
Have a conversation
xxxxxxxxxxWhy is the sky blue?
The response time is related to the hardware configuration, please wait patiently.

End the conversation
Use the Ctrl+d shortcut or /bye to end the conversation.

References
Ollama
Website:https://ollama.com/
GitHub:https://github.com/ollama/ollama
TinyLlama
GitHub:https://github.com/jzhang38/TinyLlama
Ollama corresponding model:https://ollama.com/library/tinyllama