Phi-3 model
Phi-3 modelModel scalePerformanceGot Phi-3Use Phi-3Run Phi-3Have a conversationEnd the conversationReferences
Demo environment
Development boards：Jetson Nano
SD (TF) card：64G
xIt is recommended to run the 4B and below parameter models
Phi-3 is a powerful, cost-effective Small Language Model (SLM) from Microsoft that outperforms models of the same and larger size on a variety of language, reasoning, encoding, and math benchmarks.
Model scale
| Model | Parameter |
|---|---|
| Phi-3（Mini） | 3.8B |
| Phi-3（Medium） | 14B |
xJetson Nano: Tested with Phi-3 model with 3.8B parameters
Performance
Got Phi-3
Using the pull command will automatically pull the model from the Ollama model library.
xxxxxxxxxxollama pull phi3:3.8b
Use Phi-3
Run Phi-3
If the system does not have a running model, the system will automatically pull the Phi-3 3.8B model and run it.
xxxxxxxxxxollama run phi3:3.8b
Have a conversation
xxxxxxxxxxTell me a bedtime story
The response time is related to the hardware configuration, please wait patiently.
End the conversation
Use the Ctrl+d shortcut or /bye to end the conversation.
References
Ollama
Website：https://ollama.com/
GitHub：https://github.com/ollama/ollama
Phi-3
Ollama corresponding model：https://ollama.com/library/phi3