Mistral AI Launches Open-Source LLM, Mistral 7B


Mistral AI, a burgeoning startup in the AI sector, has set out on a mission to revolutionize generative artificial intelligence (AI) with its first large language model (LLM), Mistral 7B.

The company hopes the new 7-billion-parameter model will become an open-source alternative to current AI solutions.

Mistral 7B And Mistral 7B Instruct Models

While others have set the industry standard with their “black-box” models, Mistral AI believes an open-source, community-driven approach can outpace them.

Drawing comparisons with the open-source movements in web browsers and operating systems, Mistral suggests that community-backed models are the future.

Mistral 7 B’s release comes as the company’s first significant step toward creating specialized models that compete with larger, more established AI solutions.

The raw model weights are distributed with Bittorrent and on Hugging Face. This documentation details the deployment bundle that allows to quickly spin a completion API on any major cloud provider with NVIDIA GPUs.

Screenshot from Mistral AI, September 2023

Mistral AI’s open models aim to offer superior adaptability, enabling customization to specific tasks and user needs.

This approach is touted as advantageous for businesses aiming to keep costs low while maintaining performance.

Additionally, the company believes that open-source models will be critical tools in combating the ethical challenges associated with AI, such as censorship and bias.

As generative models continue to influence society, the ability to audit them for flaws and misuse is becoming increasingly vital.

How To Use Mistral 7B For Free

The Mistral 7B model is available for download, with documentation on GitHub or through Hugging Face.

In addition, you can chat with the Mistral 7B Instruct model on Perplexity Labs.

mistral 7b instruct perplexity chat labs 6516288d2f065 sej - Mistral AI Launches Open-Source LLM, Mistral 7BScreenshot from Perplexity, September 2023

Mistral AI Made Headlines With Seed Funding

Mistral AI made headlines this summer when it raised $113 million in seed funding in June, underlining investor confidence in the open-source approach.

Funding was led by Lightspeed Venture Partners, with over a dozen investors, including Eric Schmidt, ex-Google CEO, who often discusses AI.

Mistral AI’s team is comprised of data scientists, software engineers, and machine learning engineers plucked from DeepMind, Meta, Hugging Face, and others.

Arthur Mensch, Co-founder and CEO of Mistral AI expressed excitement about what the company planned to achieve:

“Our training as AI researchers, combined with our respective professional experiences within the world’s leading technology companies, has convinced us that there is a way forward for an alternative, innovative project that will enable us to responsibly disseminate the most promising technology of our generation as widely as possible.

We are proud to initiate this global project from France, our home country, and to contribute, at our level, to the emergence of a credible new player in generative artificial intelligence from Europe. Over the coming months, we will focus all our energy and passion on honoring the trust placed in us by our investors.”

According to the pitch deck, Mistral’s plans include developing AI models superior to OpenAI’s in 2024.

In that round (Q3 2024), we expect to need to raise 200M, in order to train models exceeding GPT-4 capacities. Strong financing will allow us to train models on larger infrastructures, thereby establishing us as a research leader in AI that will be the go-to provider of the European industry.

Mistral AI hopes to progressively release new models that bridge the performance gap between its open-source solutions and proprietary offerings as part of its ongoing strategy.

France Positioned As Next Leader In AI Development?

In June, French President Emmanuel Macron, a big promoter of French tech startups, was at VivaTech, Paris’s largest European tech trade show.

He wanted to support French startups, help them expand internationally, and attract more investment in AI research and projects in France.

Technology experts have also noted that most developers (11 of 14) of Meta AI’s open-source Llama technology are French, making the latest AI developments unsurprising.

The Future Of Open-Source AI

A potentially robust and open-source competitor to existing LLMs like Mistral 7B could offer new opportunities for businesses to utilize AI, with broader customization possibilities and enhanced control over data security.

The move to open-source generative models represents a significant shift in the AI industry, challenging traditional proprietary models on ethical and performance grounds.


Featured Image: The Hornbills Studio/Shutterstock





Source link

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

We Know You Better!
Subscribe To Our Newsletter
Be the first to get latest updates and
exclusive content straight to your email inbox.
Yes, I want to receive updates
No Thanks!
close-link

Subscribe to our newsletter

Sign-up to get the latest marketing tips straight to your inbox.
SUBSCRIBE!
Give it a try, you can unsubscribe anytime.