Run Mistral Small 24B (Jan 2025) locally: hardware requirements
Mistral Small 24B (Jan 2025) by Mistral installs on a paired computer through idapt's local engine. RAM decides whether a build fits; a GPU only changes speed. Local runs are not billed.
- Download
- 14 GB
- RAM needed
- 20 GB
- Builds
- 1
Will it run on your machine?
Enter your system RAM to get verdicts. RAM decides whether a build fits; a GPU only changes speed.
Every build
| Build | Quantization | Download | RAM needed |
|---|---|---|---|
| 24b-instruct-2501-q4_K_MDefault | q4_K_M | 14 GB | 20 GB |
RAM figures are working-set recommendations: when GPU memory is short, the runtime spills to CPU and system memory instead of failing.
Install it
Pair a computer with idapt and install Mistral Small 24B (Jan 2025) from the model page: the local engine bootstraps itself, pulls the build you pick, and streams progress. Or pull it directly:
ollama pull mistral-small:24b-instruct-2501-q4_K_MFrequently asked
How much RAM do I need to run Mistral Small 24B (Jan 2025) locally?
The smallest Mistral Small 24B (Jan 2025) build runs with about 20 GB of system RAM; the largest needs 20 GB. RAM is the binding requirement: when GPU memory is short, the runtime spills to CPU and system memory instead of failing.
Which quantization of Mistral Small 24B (Jan 2025) should I pick?
Start with the default 24b-instruct-2501-q4_K_M build: a 14 GB download that wants about 20 GB of RAM. Smaller quantizations shrink the download and memory needs at some cost in output quality; larger ones do the reverse.
Do I need a GPU to run Mistral Small 24B (Jan 2025)?
No. A GPU with enough VRAM makes generation faster, but Mistral Small 24B (Jan 2025) runs on CPU and system RAM alone. Whether a build fits is decided by RAM; the GPU only changes speed.
How big is the Mistral Small 24B (Jan 2025) download?
About 14 GB for the single available build.
Can idapt install Mistral Small 24B (Jan 2025) for me?
Yes. Pair a computer with idapt and install Mistral Small 24B (Jan 2025) from this page: the local engine bootstraps itself, pulls the build you pick (ollama pull mistral-small), and streams download progress. Local runs are not billed.
Part of the Mistral Small 24B (Jan 2025) model page · Mistral Small 24B (Jan 2025) pricing · Check every local model against your hardware