Models/Llama 3.1 405B Instruct
MetaMeta / Llama 3.1 405B Instruct
Released: 7/23/2024
texttext
Input: $3.00 / Output: $3.00

Llama 3.1 405B Instruct is an LLM that excels in a wide variety of tasks, such as question answering, reasoning, and code generation. It is optimized for multilingual dialogue use cases and supports multiple languages, including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.

Some noteworthy use cases of Llama 3.1 405B Instruct include synthetic data generation and judging outputs from smaller models.

MetricValue
Parameter Count405 billion
Mixture of ExpertsNo
Context Length128,000 tokens
MultilingualYes
Quantized*Unknown

*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.

Meta models available on Oxen.ai
ModalityPrice (1M tokens)
ModelInference providerInputOutputInputOutput
Fireworks AIFireworks AI
texttext$3.00$3.00
Together.aiTogether.ai
texttext$3.50$3.50
Fireworks AIFireworks AI
texttext$0.90$0.90
Together.aiTogether.ai
texttext$0.88$0.88
GroqGroq
texttext$0.05$0.08
Fireworks AIFireworks AI
texttext$0.20$0.20
Together.aiTogether.ai
texttext$0.18$0.18
Together.aiTogether.ai
texttext$0.90$0.90
GroqGroq
imagetext$0.18$0.18
GroqGroq
texttext$0.04$0.04
GroqGroq
texttext$0.06$0.06
Together.aiTogether.ai
texttext$0.06$0.06
GroqGroq
imagetext$0.90$0.90
Fireworks AIFireworks AI
texttext$0.90$0.90
Together.aiTogether.ai
texttext$0.88$0.88
GroqGroq
texttext$0.59$0.59
GroqGroq
texttext$0.59$0.79
Fireworks AIFireworks AI
text, imagetext$0.22$0.88
Together.aiTogether.ai
text, imagetext$0.27$0.85
Together.aiTogether.ai
text, imagetext$0.18$0.59
Fireworks AIFireworks AI
text, imagetext$0.15$0.60
See all models available on Oxen.ai