{"id":72366,"date":"2024-03-27T16:00:29","date_gmt":"2024-03-27T23:00:29","guid":{"rendered":"https:\/\/phisonblog.com\/?p=72366"},"modified":"2024-04-03T16:15:46","modified_gmt":"2024-04-03T23:15:46","slug":"phisons-new-software-uses-ssds-and-dram-to-boost-effective-memory-for-ai-training","status":"publish","type":"post","link":"https:\/\/phisonblog.com\/zh\/phisons-new-software-uses-ssds-and-dram-to-boost-effective-memory-for-ai-training\/","title":{"rendered":"Phison \u7684\u65b0\u8f6f\u4ef6\u4f7f\u7528 SSD \u548c DRAM \u6765\u63d0\u5347 AI \u8bad\u7ec3\u7684\u6709\u6548\u5185\u5b58"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.16&#8243; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.16&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.16&#8243; custom_padding=&#8221;|||&#8221; global_colors_info=&#8221;{}&#8221; custom_padding__hover=&#8221;|||&#8221;][et_pb_text _builder_version=&#8221;4.24.3&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<p>&#8220;Phison&#8217;s booth at GTC 2024 held an unexpected surprise: The company demoed a single workstation with four GPUs using SSDs and DRAM to expand the effective memory space for AI workloads, allowing it to run a workload that typically requires 1.4TB of VRAM spread across 24 H100 GPUs. The company&#8217;s new aiDaptiv+ platform is designed to lower the barriers of AI LLM training by employing system DRAM and SSDs to augment the amount of GPU VRAM available for training, which Phison says will allow users to accomplish intense generative AI training workloads at a fraction of the cost of just using standard GPUs, albeit trading the lower cost of entry for reduced performance and thus longer training times..&#8221;<\/p>\n<p>Source:\u00a0 <a href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/phisons-new-software-uses-ssds-and-dram-to-boost-effective-memory-for-ai-training-demos-a-single-workstation-running-a-massive-70-billion-parameter-model-at-gtc-2024\" target=\"_blank\" rel=\"noopener\">Tom&#8217;s Hardware<\/a><\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Phison&#8217;s booth at GTC 2024 held an unexpected surprise: The company demoed a single workstation with four GPUs using SSDs and DRAM to expand the effective memory space for AI workloads, allowing it to run a workload that typically requires 1.4TB of VRAM spread across 24 H100 GPUs. The company&#8217;s new aiDaptiv+ platform is designed [&hellip;]<\/p>\n","protected":false},"author":10,"featured_media":72368,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_et_pb_use_builder":"on","_et_pb_old_content":"<p><a href=\"https:\/\/news.google.com\/rss\/articles\/CBMiYmh0dHBzOi8vd3d3LmtpdGd1cnUubmV0L2NvbXBvbmVudHMvc3NkLWRyaXZlcy9qb2FvLXNpbHZhL21zaS11bnZlaWxzLWl0cy1mYXN0ZXN0LXBjaWUtNS0wLXNzZC15ZXQv0gEA?oc=5\" target=\"_blank\" rel=\"nofollow noopener\">MSI unveils its fastest PCIe 5.0 SSD yet<\/a>\u00a0\u00a0<span style=\"color: #6f6f6f;\">KitGuru<\/span><\/p>","_et_gb_content_width":"","inline_featured_image":false,"footnotes":""},"categories":[114],"tags":[22],"class_list":["post-72366","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-phison-in-the-news","tag-long-content"],"acf":[],"_links":{"self":[{"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/posts\/72366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/comments?post=72366"}],"version-history":[{"count":3,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/posts\/72366\/revisions"}],"predecessor-version":[{"id":72371,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/posts\/72366\/revisions\/72371"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/media\/72368"}],"wp:attachment":[{"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/media?parent=72366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/categories?post=72366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/phisonblog.com\/zh\/wp-json\/wp\/v2\/tags?post=72366"}],"curies":[{"name":"\u53ef\u6e7f\u6027\u7c89\u5242","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}