MoE inference

Run a 744-Billion Parameter AI Model on Your Laptop. For Real.

A pure C engine runs a 744B-parameter MoE model on a laptop with no GPU. Here is what it actually takes, what it delivers, and where it makes sense.