From the creator of Redis; run LLM locally with ds4

CORE 01 Asymmetric 2-bit quantization Compress the routed experts, keep critical shared paths precise. That is how the supported routed-MoE builds fit their target machines.