# Reddit homelab runs 2.8‑trillion‑parameter AI model on CPU with Optane memory

> A Reddit builder used second‑gen Intel Optane PMem 200 modules and a 40‑core Xeon CPU to run Moonshot AI’s Kimi K3 model, but needed strong cooling.

Oossa · 2026-11-08 · https://oossa.com/en/reddit-homelab-runs-2-8-trillion-parameter-ai-model-on-cpu-with-optane-memory

A Reddit user built a homelab that runs Moonshot AI’s 2.8‑trillion‑parameter Kimi K3 model using only a 40‑core 3rd‑gen Xeon Scalable CPU and discontinued second‑gen Intel Optane PMem 200 memory sticks. No GPU is involved. The system produces about 0.85 tokens per second with 1‑bit quantization, which is very slow. The builder warns that the Optane modules get extremely hot, so dual 12‑watt blower fans are required to keep them from overheating and damaging nearby DRAM.

## The facts

- Model: Moonshot AI Kimi K3, 2.8 trillion parameters
- Performance: ~0.85 tokens / second with 1‑bit quantization
- Hardware: 40‑core 3rd‑gen Xeon CPU, Intel Optane PMem 200 sticks, dual 12 W blower fans

## Why it matters

Shows that massive language models can be run without a GPU, but only with heavy cooling and accept very low speeds, limiting practical use.

## Sources & references

1. [Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone](https://www.tomshardware.com/tech-industry/artificial-intelligence/homelabber-uses-second-gen-optane-memory-sticks-to-run-a-2-8-trillion-parameter-ai-model-on-cpu-alone-warns-that-optanes-extreme-heat-can-burn-out-nearby-memory-dram-used-blower-fans-to-prevent-melting-ram) – Tom's Hardware, 2026-11-08

Last updated: 2026-11-08