Run Llama 3.1 8B on your data

Llama 3.1 8B is an LLM designed for multilingual dialogue use cases and optimized for tool use. It excels in tasks requiring strong reasoning and integration with external tools, making it a valuable choice for applications involving function calling, API interactions, or structured data manipulation. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to enhance safety and helpfulness.

Metric	Value
Parameter Count	8 billion
Mixture of Experts	No
Context Length	128,000 tokens
Multilingual	Yes
Quantized*	Unknown

*Quantization is specific to the inference provider and may vary.

	Modality	Price (1M tokens)
Llama 3.1 405B Instruct	Fireworks AI	text	text	$3.00	$3.00
Llama 3.1 70B Instruct	Fireworks AI	text	text	$0.90	$0.90
Llama 3.1 8B	Groq	text	text	$0.05	$0.08
Llama 3.1 8B Instruct	Fireworks AI	text	text	$0.20	$0.20
Llama 3.2 3B Instruct	Lambda Labs	text	text	$0.02	$0.02
Llama 3.3 70B Instruct	Fireworks AI	text	text	$0.90	$0.90
Llama 3.3 70B Speculative Decoding	Groq	text	text	$0.59	$0.59
Llama 3.3 70B Versatile 128k	Groq	text	text	$0.59	$0.79
Llama 4 Maverick	Fireworks AI	text, image	text	$0.22	$0.88
Llama 4 Scout	Fireworks AI	text, image	text	$0.15	$0.60

Modality

Price (1M tokens)

Model

Inference provider

Input

Output

Input

Output

Llama 3.1 405B Instruct

Fireworks AI