
华为详解麒麟9050如何在端侧运行300亿参数模型
来源标题:Huawei details how Kirin 9050 runs a 30-billion-parameter model on device
华为详解麒麟9050系列可在无网络连接的情况下本地运行300亿参数AI模型。该芯片的新达芬奇NPU采用低位量化并协调内存与算力,使模型能在手机上运行;该混合专家模型每次约激活20亿参数。华为还介绍了同一处理器支持AI读屏和眼动翻页等功能。
以下正文同步自 动点科技 TechNode,版权归原站所有,已转换为易读排版。
Huawei on Wednesday detailed how the Kirin 9050 series runs a 30-billion-parameter AI model locally without an internet connection. The chip’s new Da Vinci neural processing unit uses low-bit quantization and coordinates memory and compute to run the model on a phone. The mixture-of-experts model activates about 2 billion parameters at a time. Huawei previously disclosed that figure at its October chip briefing and this week described how the same processor supports features such as AI screen reading and eye-tracked page turning. [IT Home, in Chinese] [October briefing, in Chinese]
正文由 探How 从来源站点 RSS 同步,内容未经改写;遇到排版缺失或需要图片、视频时请以原文为准。