A Reddit user built a homelab that runs Moonshot AI’s 2.8‑trillion‑parameter Kimi K3 model using only a 40‑core 3rd‑gen Xeon Scalable CPU and discontinued second‑gen Intel Optane PMem 200 memory sticks. No GPU is involved. The system produces about 0.85 tokens per second with 1‑bit quantization, which is very slow. The builder warns that the Optane modules get extremely hot, so dual 12‑watt blower fans are required to keep them from overheating and damaging nearby DRAM.
Why it matters
Shows that massive language models can be run without a GPU, but only with heavy cooling and accept very low speeds, limiting practical use.
