To date, however, as with many seemingly revolutionary ideas, there just hasn\u2019t been a way to make a business out of the concept\u2014primarily because each use case is highly unique and it\u2019s simply not scalable.\u00a0<\/span>\u00a0<\/span><\/p>\n When engineers and developers talk about computational storage, too often it\u2019s a pie-in-the-sky approach: \u201cWhat if we could run Linux on a drive, and we just gave it bigger processors?\u201d While the idea may seem innovative, it lacks focus and practical application. It\u2019s misguided thinking that is overly complicated and driven by technological idealism. Ultimately, it won\u2019t lead to the hoped-for benefits.\u00a0\u00a0<\/span>\u00a0<\/span><\/p>\n <\/p>\n \u00a0<\/span><\/p>\n At Phison, we utilized our knowledge in NAND storage technology innovations to find a better way to offload the processing burden to an SSD, and that\u2019s with a tailored approach to acceleration, one that focuses on the tasks that storage devices are best suited for: applying fixed operations to ranges of logical block addressing (LBA). We integrate specialized accelerators into our SSDs to handle specific tasks that don\u2019t require excessive power or complexity.<\/span>\u00a0<\/span><\/p>\n For example, we create hardware accelerators that can perform specific operations at very high speeds, such as qualifying large datasets, object-based erasure coding, checksum verification, and filtering out irrelevant information before it even reaches the CPU. This allows for faster and more efficient data processing, particularly in high-demand environments like data centers or supercomputing clusters. By processing data at the SSD level, you can reduce the amount of data that needs to be moved across the PCIe bus or through the network, which alleviates congestion, eases bandwidth limitations, and speeds up overall performance.<\/span>\u00a0<\/span><\/p>\n By focusing on highly specific tasks that are considered \u201cmonkey work\u201d, these accelerators can provide significant benefits without adding substantial cost or power consumption. The accelerated SSDs can handle large volumes of data much faster, all while consuming less power than traditional processors. Importantly, this approach can be scaled across multiple drives, creating a more efficient, parallelized system that outperforms traditional CPU-bound processing.<\/span>\u00a0<\/span><\/p>\n The host CPU is cable of doing all the tasks listed above faster than an individual SSD, but there are practical limitations to the total CPU DRAM<\/a> bandwidth that can be assigned to non-OS tasks.\u00a0 Additionally, moving that data from SSD to DRAM consumes roughly half the DDR bandwidth available to the CPU.\u00a0 When factoring in that an all-flash storage chassis can have 30, 60 or even 90 SSDs, this presents a lot of offload capability to the appliance.\u00a0 A chassis with 90 Gen6 SSDs can process data at 2.5 TB\/s without impacting any CPU resources. In this scenario, the SSDs perform pre-filtering and pre-compute tasks while the CPU manages more important operations.<\/span>\u00a0<\/span><\/p>\n <\/p>\n \u00a0<\/span><\/p>\n Recently, Phison has pivoted and begun to look at new ways to offload some of the CPU workload to SSDs that goes a step beyond targeted accelerators. In some cases, the company is even adding CPU clusters to the storage array\u2014but the big difference here is that the CPU clusters aren\u2019t being used to do calculations, but to actually run web services or microservices. They show up as additional addressable CXL services<\/a> on the PCIe bus.<\/span>\u00a0<\/span><\/p>\n Consider an AI project, for instance, which involves a lot of pipelining. That\u2019s where one large language model (LLM) produces data and outputs it, then another LLM takes it and transforms it and sends it to another LLM, and so on. An example of this would be video translation of a TED talk, in which an LLM extracts the English audio and turns it into text, another LLM translates the text into Chinese, another LLM trained on a celebrity\u2019s voice produces that audio track and so on, until the final output is a brand-new video of that celebrity delivering the talk in Chinese with synchronized lip movment.\u00a0<\/span>\u00a0<\/span><\/p>\n That complex operation involves a lot of little steps that are typically handled by the CPU or GPU and require a lot of model swaps. Why couldn\u2019t you use the SSDs to do those little steps in the background while using the main CPU to delegate tasks to these accelerators and perform other higher-level tasks? In high-performance computing (HPC) organizations, the results can be impressive.\u00a0<\/span>\u00a0<\/span><\/p>\n It’s not uncommon for an HPC cluster to have 100 petabytes of data storage (which includes double and triple redundancy), which means they could have 100,000 SSDs to spread a workload across. Suddenly, operations that were taking a day or two are now being completed in mere seconds.\u00a0<\/span>\u00a0<\/span><\/p>\n In large HPC arrays, there are so many SSDs that the SSDs\u2019 bandwidth eclipses the entire network or CPU bandwidth. This is where we realized at Phison that there is a massive untapped space where SSDs can do intelligent things.\u00a0<\/span>\u00a0<\/span><\/p>\n Where the HPC use case is all about speed and compute, we\u2019ve also looked at security use cases, which are more about rock-solid FIPS 140-3 compliant products that provide security services well beyond what TPM 2.0 achieve.\u00a0<\/span>\u00a0<\/span><\/p>\n An SSD can execute hundreds of cryptographic operations like signing and verification per second\u2014and if a server has 30 to 90 SSDs, the processing power grows accordingly. Each SSD can act as an independent hardware-based agent with a root of trust that can point back to your HSM (hardware security module) server. Collectively, all of those drives surpass what one powerful CPU can do because the CPUs are not designed to be digital signing algorithm (DSA) engines. That multi-SSD power, combined with the fact that it\u2019s hardware that\u2019s already installed in the server, provides great benefits in bolstering security.\u00a0<\/span>\u00a0<\/span><\/p>\n <\/p>\n![\"\"](\"https:\/\/phisonblog.com\/wp-content\/uploads\/2022\/08\/Why-Is-Computational-Storage-Inevitable-Banner.jpg\")
<\/a>A smarter approach: Tailored acceleration<\/h3>\n
![\"\"](\"https:\/\/phisonblog.com\/wp-content\/uploads\/2021\/11\/SSDs-for-Sustained-Write-Intensive-Workloads.jpg\")
<\/a>Emerging applications in HPC and security are changing the computational storage landscape\u00a0<\/span><\/h3>\n
![\"\"](\"https:\/\/phisonblog.com\/wp-content\/uploads\/2022\/08\/964_4192971202.jpg\")