Mistral AI/open-mixtral-8x7b/Released Dec 2023

Mixtral 8x7B

Efficient open MoE model

Text

About Mixtral 8x7B

Mixtral 8x7B is an LLM designed for efficient processing and optimized model size. It excels in multilingual capabilities and cost-performance efficiency, making it a strong contender against models like GPT-3.5.

MetricValue
Parameter Count47 billion
Mixture of ExpertsYes
Active Parameter Count13 billion
Context Length32,768 tokens
MultilingualYes
Quantized*Unknown

*Quantization is specific to the inference provider and may vary.

Ready to build with Mixtral 8x7B?

Try Mixtral 8x7B in the Workbench to prompt it, compare outputs, and iterate on prompts without writing any code. When you're ready to ship, call the same model from our API and build your own apps on top of it.

curl -sSf -X POST https://hub.oxen.ai/api/ai/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $OXEN_API_KEY" \
    -d '{
  "model": "open-mixtral-8x7b",
  "messages": [
    {
      "role": "user",
      "content": "Try sending a message."
    }
  ]
}'

API endpoint

See the API reference for request and response formats.

POSThttps://hub.oxen.ai/api/ai/chat/completions