Llama3
Llama31、Model scale2、Performance3. Run Llama34. Use Llama 34.1. Run Llama 34.2. Have a conversation4.5. End the conversationReferences
Demonstration environment
Development board: RDK X5 series board
sd card: 64G
Tutorial application scope: Whether the motherboard can run is related to the available memory of the system. The user's own environment and the program running in the background may cause the model to fail to run
| Motherboard model | Ollama direct operation |
|---|---|
| rdk x5 8GB | √ |
| rdk x5 4GB | × |
Meta Llama3 is a family of advanced open source Large Language Models (LLMs) developed by the Meta AI division.
1、Model scale
| Model | Parameter |
|---|---|
| Llama3 | 8B |
2、Performance
3. Run Llama3
Only rdk x5 8Gb motherboard can run this model
Using the pull command will automatically pull the model of the Ollama model library:
ollama pull llama3:8b
4. Use Llama 3
4.1. Run Llama 3
If the system does not have a running model, the system will automatically pull the Llama3 8B model and run it:
xxxxxxxxxxollama run llama3:8b
4.2. Have a conversation
xxxxxxxxxxHow many minutes are there in a day?
The response time is related to the hardware configuration, please be patient!
4.5. End the conversation
Use the Ctrl+d shortcut key or /bye to end the conversation!
References
Ollama
Website：https://ollama.com/
GitHub：https://github.com/ollama/ollama
Llama 3
GitHub：https://github.com/meta-llama/llama3
Ollama model：https://ollama.com/library/llama3