Mistral

36 summarised stories about Mistral, each linking back to the original source. Browse all topics →

Tuesday, 16 July 2024

Codestral Mamba

Mistral AI 2 years ago

Mistral released Codestral Mamba, a code-focused AI model based on the Mamba architecture rather than Transformers, available for free use and modification. The model contains 7.3 billion parameters, supports context windows up to 256,000 tokens, and performs comparably to state-of-the-art Transformer-based code models while offering linear-time inference. Developers can now deploy it locally or via Mistral's platform for code assistance tasks, with support coming to llama.cpp for easier integration.

Architecture Innovation Code Generation Mistral Open Source

MathΣtral

Mistral AI 2 years ago

Mistral AI released Mathstral, a 7-billion-parameter language model specialized for mathematics and STEM reasoning, developed in collaboration with Project Numina. The model scores 56.6% on the MATH benchmark and 63.47% on MMLU, improving to 74.59% on MATH when using a reward model to rank multiple candidate answers. Researchers and developers can now access Mathstral through HuggingFace for direct use or fine-tuning on domain-specific mathematical tasks.

Benchmarking Code Generation Mistral