Tencent Hunyuan Hy3 Quantized Models: 295B Parameters, Single-GPU Deployment
Tencent Hunyuan Hy3 in quantized formats: 295B parameters compressed to 85.5GiB (1-bit) and 169.9GiB (4-bit). MTP speculative decoding adds 50-60% throughput. Available on HuggingFace.