Tencent
Tencent is a Chinese multinational technology conglomerate and investment company. In the context of artificial intelligence, it is a major developer of large language models and AI infrastructure.
AI Research & Development
Model Optimization: AngelSlim
Tencent has achieved significant breakthroughs in reducing the footprint of massive AI models, enhancing efficiency and accessibility.
- Angelslim Breakthrough: Successfully reduced the size of the 1.5TB Hy4 preview model (770 billion parameters) to 214GB.
- Technique: Utilized Sherry Quantization to achieve this compression without proportional loss in performance.
- Impact: Demonstrates Tencent’s capability in deploying large-scale models in resource-constrained environments.
- Detailed Analysis: Tencent AI Model Shrink with Sherry Quantization: AngelSlim Breakthrough Report