{"id":83568,"date":"2025-01-30T08:00:21","date_gmt":"2025-01-30T16:00:21","guid":{"rendered":"https:\/\/phisonblog.com\/?p=83568"},"modified":"2025-01-31T10:05:04","modified_gmt":"2025-01-31T18:05:04","slug":"phison-affordably-expands-ai-processing-capacity-for-use-on-premises-and-at-the-edge","status":"publish","type":"post","link":"https:\/\/phisonblog.com\/ko\/phison-affordably-expands-ai-processing-capacity-for-use-on-premises-and-at-the-edge\/","title":{"rendered":"Phison, \ud604\uc7a5 \ubc0f \uc5e3\uc9c0\uc5d0\uc11c \uc0ac\uc6a9\ud560 AI \ucc98\ub9ac \uc6a9\ub7c9 \ud655\uc7a5"},"content":{"rendered":"

[et_pb_section fb_built=”1″ _builder_version=”4.16″ _module_preset=”default” custom_margin=”0px||||false|false” custom_padding=”0px||||false|false” locked=”off” global_colors_info=”{}”][et_pb_row _builder_version=”4.16″ _module_preset=”default” width=”100%” max_width=”100%” custom_margin=”||||false|false” custom_padding=”0px||||false|false” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” header_line_height=”1.7em” header_2_line_height=”1.7em” header_3_line_height=”1.7em” custom_margin=”||-10px||false|false” custom_padding=”||0px||false|false” locked=”off” global_colors_info=”{}”]<\/p>\n

Generative AI is becoming more common across industries as organizations seek to benefit from the technology. However, AI applications at the edge often face memory constraints, limiting the quality of the output<\/span>\u00a0<\/span><\/p>\n

 <\/p>\n

To address these challenges, Phison has leveraged its expertise in high-performance NAND flash technology with its <\/span>aiDAPTIV+<\/span><\/a> solution, enabling a groundbreaking approach to expanding AI capabilities. By integrating SSDs as extended memory for Large Language Models (LLMs), Phison\u2019s technology unlocks new possibilities for edge IoT and robotic devices, PCs, engineering workstations, and data center servers. These advancements empower devices to load larger models and achieve both fine-tuning and better inferencing results\u2014capabilities previously unattainable.<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n

For instance, Phison\u2019s measurements reveal that PCs and newly release IoT devices from NVIDIA and others can now fine-tune models in the 1-8 billion parameter range, beyond merely performing inference. Moreover, using NVIDIA’s <\/span>Jetson Orin Nano Super Developer Kit<\/span><\/a>, aiDAPTIV+ extended token lengths by 16x, enabling better context comprehension and more accurate outputs. Specifically, it accelerated the time to the first token by 24x, enhancing user experiences by improving response time.<\/span>\u00a0<\/span><\/p>\n

\"\"<\/span><\/p>\n

\u00a0<\/span><\/p>\n

Tackling key AI challenges<\/h3>\n

Phison’s aiDAPTIV+ is also designed to resolve critical hurdles in AI inference applications:<\/span>\u00a0<\/span><\/p>\n