Welcome to Jetson Orin NANO Developer Kit repository
10.MiniCPM-V visual multimodal large model
MiniCPM-V
MiniCPM-V1. Model Size2. Performance3. Using MiniCPM-V3.1 Running MiniCPM-V3.2 Starting a Conversation3.3 Visual Function3.4 Ending the ConversationReferences
Demo Environment
Development board: Jetson Orin series mainboard
Note: Due to performance limitations, the Jetson Orin Nano 4GB cannot run this model.
1. Model Size
| Model | Size |
|---|---|
| minicpm-v:8b | 5.5GB |
2. Performance

3. Using MiniCPM-V
3.1 Running MiniCPM-V
If there is no running model in the system, the system will automatically pull the minicpm-v:8b model and run it:
ollama run minicpm-v:8b
3.2 Starting a Conversation
xxxxxxxxxxTell me a mathematician story
Response time depends on the hardware; please be patient.

3.3 Visual Function

xxxxxxxxxxWhat do you see in this picture? :./test_pic.png#Use ": + image path" in the conversation to enable the model to use its visual function and interpret the information in the image

3.4 Ending the Conversation
Use the Ctrl+d shortcut or /bye to end the conversation!
References
Ollama
Official website: https://ollama.com/
GitHub: https://github.com/ollama/ollama
MiniCPM-V
GitHub: https://github.com/OpenBMB/MiniCPM-o
Ollama corresponding model: https://ollama.com/library/minicpm-v