meta

Llama 3.2 3B Instruct

Fine-tunable
text-to-text
Optimized for multilingual dialogue, agentic tasks, and efficient on-device use, supporting eight languages and a 128K context for privacy-focused applications.
About
Released: 10/25/2024

meta-llama/Llama-3.2-3B-Instruct is an LLM designed for multilingual dialogue, agentic retrieval, and summarization tasks. It excels in supporting up to eight officially recognized languages, offers a long context length of 128,000 tokens, and is optimized for efficient on-device use where privacy and low latency are important.

Some other noteworthy use cases of meta-llama/Llama-3.2-3B-Instruct include tool use (such as extracting action items or sending calendar invites) and customizable fine-tuning for domain-specific applications.

MetricValue
Parameter Count3.21 billion
Mixture of ExpertsNo
Context Length128,000 tokens
MultilingualYes
Quantized*No

*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.