Welcome to ROSMASTER M1 repository
10.NVIDIA StarCoder2
StarCoder2
StarCoder2Model SizePulling StarCoder2Using StarCoder2Running StarCoder2Starting a conversationEnding the conversationReferences
Demo Environment
Development Board: Jetson Nano
SD (TF) Card: 64GB
Recommended for models with 4 bytes or less parameters
Model Storage Location
xxxxxxxxxx/usr/share/ollama/.ollama/models
Model Size
| Model | Parameters |
|---|---|
| StarCoder2 | 3 Bytes |
| StarCoder2 | 7 Bytes |
| StarCoder2 | 15 Bytes |
Pulling StarCoder2
Using the pull command will automatically pull models from the TinyLlama model library:
xxxxxxxxxxollama pull starcoder2:3b

Using StarCoder2
Running StarCoder2
If the system does not have a running model, the system will automatically pull the StarCoder2 3B model and run it:
xxxxxxxxxxollama run starcoder2:3b
Starting a conversation
xxxxxxxxxxWrite me a function that outputs the fibonacci sequence
Response time depends on your hardware configuration, so please be patient!

Ending the conversation
Use the Ctrl+d shortcut or /bye to end the conversation!

References
Ollama
Official Website: https://ollama.com/
GitHub: https://github.com/ollama/ollama
StarCoder2
GitHub: https://ollama.com/library/starcoder2
Ollama Compatible Model: https://ollama.com/library/starcoder2