4.TinyLlama model
4.TinyLlama modelModel scaleGot TinyLlamaUse TinyLlamaRun TinyLlamaHave a conversationEnd the conversationReferences
Demo environment
Development Boards：Jetson Nano
SD (TF) card：64G
xIt is recommended to run the 4B and below parameter models
Model scale
| Model | Parameter |
|---|---|
| TinyLlama | 1.1B |
Got TinyLlama
Using the pull command will automatically pull the model from the Ollama model library.
xxxxxxxxxxollama pull tinyllama:1.1b
Use TinyLlama
Run TinyLlama
If the system does not have a running model, the system will automatically pull the TinyLlama 1.1B model and run it.
xxxxxxxxxxollama run tinyllama:1.1b
Have a conversation
xxxxxxxxxxWhy is the sky blue?
The response time is related to the hardware configuration, please wait patiently.
End the conversation
Use the Ctrl+d shortcut or /bye to end the conversation.
References
Ollama
Website：https://ollama.com/
GitHub：https://github.com/ollama/ollama
TinyLlama
GitHub：https://github.com/jzhang38/TinyLlama
Ollama corresponding model：https://ollama.com/library/tinyllama