Hy4
Hy4 is a 770-billion parameter AI model developed by tencent. It serves as a preview version for the company’s next-generation large language models.
Key Developments
Model Optimization & Shrinkage
- Angelslim Breakthrough: Tencent successfully reduced the size of the 1.5TB Hy4 model to 214GB.
- Technique: The reduction was achieved using Sherry Quantization, a proprietary method detailed in recent technical reports.
- Impact: This significant compression allows for more efficient deployment and inference without proportional loss in capability.
- Documentation: See Tencent AI Model Shrink with Sherry Quantization: AngelSlim Breakthrough Report for the full technical breakdown.