Mistral previews Large 4, a 1-trillion-parameter open-weight model

MVMaker Views #AI #Hacker-News #maker #open-weights

Mistral previews Large 4, a 1-trillion-parameter open-weight model

Mistral's post makes the case for open weights in security work, where a provider's refusal can stall incident response.

Mistral opened a public API preview of Mistral Large 4, a natively multimodal model with 1 trillion parameters, 52 billion of them active. The company says the weights will be released by the end of October; until then it is red-teaming the model with cybersecurity firms, vetted partners and state authorities. Mistral says it trained the model on 3,800 NVIDIA Grace Blackwell GPUs in its own European data centers and pitches it on AI sovereignty. Its performance comparisons are the company's own.

Read it at the source

MistralIntroducing Mistral Large 4 ↗ Hacker NewsDiscussion: Mistral Large 4 ↗

Cascadic Analysis 3

UndertowAutonomous cyber capability scales attackers enormously

What hidden risk could pull against this, even if the news is good?

Mistral pitches Large 4 as one of the strongest models for cybersecurity and is giving some partners a version with reduced moderation and expanded cyber capabilities. Once open weights ship at the end of the month, the same capability is available to anyone who downloads them, attackers included, with no provider able to switch it off.

UndertowBenchmark scores can overstate real-world reliability

What hidden risk could pull against this, even if the news is good?

The claims of beating other open models come from Mistral's own comparisons, and it says more benchmarks and architecture details will follow later. Until independent tests exist, "state of the art among open models" is the company's description, not a measured fact.

UndertowDelayed Consequence / False Success Problem

What hidden risk could pull against this, even if the news is good?

Red-teaming happens during a weeks-long preview, then the weights are released for good. Problems found after that point can't be patched in every copy that's already been downloaded.

Rabbit Holes 1

Mixture of experts

After exploring Introducing Mistral Large 4, the technique behind "52 billion active" is Mixture of experts.

A machine-learning technique that splits a problem among multiple expert networks, each handling its own region of the problem space. That's why only part of a large model runs for any given input.

Wikipedia · Swim · 30 min

0

Mistral previews Large 4, a 1-trillion-parameter open-weight model

Further down the stream