群联电子 – 凌华科技在 NVIDIA GTC 2025 上推进边缘 AI 和 Gen AI 创新

作者 | 2025年3月19日 | 群联新闻

Summary:

. . .

Accelerating Economical Generative AI at the Edge
Generative AI adoption at edge devices is often limited by DRAM capacity constraints when running large language models (LLM). The DLAP Supreme series, featuring NVIDIA Jetson AGX Orin, elevates AI power with Phison aiDAPTIV+ technology, effectively overcoming token length limitations and enhancing inference speed.  For instance, using the DLAP-411 Orin Supreme equipped with an NVIDIA Jetson AGX Orin 64GB configuration alongside the Llama3.1-70B model, the inference TTFT is improved by 52 times, and token length increased by 4 times. The DLAP Super series, geared up with NVIDIA Jetson Orin Super Mode, offers a robust, software-optimized framework with AI TOPS increased by up to 1.7 times and GenAI model performance improved by up to 2 times. The DLAP Super and Supreme series aim to accelerate the deployment of generative AI applications at the edge.”- morningstar.com

来源: morningstar.com

加速创新的基础™

zh_CN简体中文