If you want the fastest local installation for this model, use Docker.
Simply follow the directions outlined below.
The setup auto-downloads all needed files (several GBs).
The deployment tool scans your environment and automatically chooses the ideal parameters for your OS.
| 🛡️ Checksum: ddab9963907e9405645518664f18763f — ⏰ Updated on: 2026-06-28
|
| Parameter Count | ≈ 125M |
| Context Length | 2048 tokens |