“The Hybrid AI hardware solution allows small and medium-sized businesses to train significantly larger AI models beyond previous limitations, scaling up to Llama-3 70B and Falcon 180B. It features seamless integration with GPU memory, utilizing aiDAPTIVCache for low-latency processing. It also includes high-endurance AI100E SSDs with a 100 DWPD rating for durability. Besides, with a focus on security, ease of deployment, and cost savings, aiDAPTIV+ is ideal for AI applications in industries requiring on-premises data control and scalable model training.
This design enables organizations to train complex models like Llama-2 7B on standard off-the-shelf hardware while ensuring low-latency processing and high-endurance storage (100 DWPD) with SLC NAND.
. . .
According to the company, they have a technique similar to OS-level swapping, where less frequently used data is offloaded from RAM to storage to free up memory for active processes. Likewise, aiDAPTIV+ utilizes high-speed, high-capacity AI100E M.2 SSDs as aiDAPTIVCache, effectively extending GPU memory. Engineers specifically optimize these SSDs to handle the intensive demands of AI workloads, ensuring efficient data management and seamless model training.”- electronics-lab.com
Source: electronics-lab.com
English 
繁體中文 
简体中文 
日本語 
Deutsch 
한국어