8.StarCoder2 model
8.StarCoder2 modelModel scaleGot StarCoder2Use StarCoder2Run StarCoder2Have a conversationEnd the conversationReferences
Demo Environment
Development boards：Jetson Nano
SD（TF）card：64G
xIt is recommended to run the 4B and below parameter models
Model scale
| Model | Parameter |
|---|---|
| StarCoder2 | 3B |
| StarCoder2 | 7B |
| StarCoder2 | 15B |
Got StarCoder2
Using the pull command will automatically pull the model from the TinyLlama model library.
xxxxxxxxxxollama pull starcoder2:3b
Use StarCoder2
Run StarCoder2
If the system does not have a running model, the system will automatically pull the StarCoder2 3B model and run it.
xxxxxxxxxxollama run starcoder2:3b
Have a conversation
xxxxxxxxxxWrite me a function that outputs the fibonacci sequence
The response time is related to the hardware configuration, please be patient.
End the conversation
Use the Ctrl+d shortcut or /bye to end the conversation.
References
Ollama
Website：https://ollama.com/
GitHub：https://github.com/ollama/ollama
StarCoder2
GitHub：https://ollama.com/library/starcoder2
Ollama corresponding model：https://ollama.com/library/starcoder2