WizardLM-2

WizardLM-2Model scaleGot WizardLM-2Use WizardLM-2Run WizardLM-2DialogueEnd conversationReference material

Demonstration environment

Development Board : Raspberry Pi 500

SD(TF)card:32G(Above 16G, the larger the capacity, the more models can be experienced)

WizardLM-2 is Microsoft's latest advanced large-scale language model, which improves performance in complex dialogue, multilingualism, inference, and intelligent proxy capabilities.

Model scale

ModelParameter
WizardLM-27B
WizardLM-270B
WizardLM-28x22B

Got WizardLM-2

Using the pull command will automatically pull the models from the Ollama model library.

image-20240625161905481

Use WizardLM-2

Run WizardLM-2

If the system does not have a running model, the system will automatically pull the WizardLM-2 7B model and run it: The Pi500_AI_Pure image does not provide this model!

Dialogue

The response time to the question is related to the hardware configuration, please be patient and wait.

image-20240625162939795

End conversation

The response time to the question is related to the hardware configuration, please be patient and wait.

image-20240625163703234

Reference material

Ollama

Website:https://ollama.com/

GitHub:https://github.com/ollama/ollama

WizardLM-2

Ollama model:https://ollama.com/library/wizardlm2