Mistral Large
Mistral 7B is a powerful language model with 73B parameters that outperforms other models on various benchmarks. It can be easily finetuned for different tasks and is available under the Apache 2.0 license.
Listed in categories:
Developer ToolsOpen SourceArtificial Intelligence
Description
Mistral 7B is a 73B parameter model that outperforms other models on various benchmarks and is designed for language processing tasks.
How to use Mistral Large?
Download Mistral 7B under the Apache 2.0 license and use it for language processing tasks. Deploy it on any cloud platform using vLLM inference server and skypilot. Finetune the model for specific tasks like chatbots.
Core features of Mistral Large:
1️⃣
Outperforms Llama 2 13B on all benchmarks
2️⃣
Outperforms Llama 1 34B on many benchmarks
3️⃣
Approaches CodeLlama 7B performance on code tasks
4️⃣
Uses Groupedquery attention GQA for faster inference
5️⃣
Uses Sliding Window Attention SWA to handle longer sequences efficiently
Why could be used Mistral Large?
| # | Use case | Status | |
|---|---|---|---|
| # 1 | Language processing tasks | ✅ | |
| # 2 | Code tasks | ✅ | |
| # 3 | Chatbot finetuning | ✅ | |
Who developed Mistral Large?
Mistral AI team is proud to release Mistral 7B, the most powerful language model for its size to date. The team has worked on optimizing the model for performance and efficiency in various tasks.