That’s the question Ace Stryker, Director of Market Development, and Alan Bumgarner, Director of Strategic Planning, set out to answer for industry experts and influencers at Gestalt IT’s AI Field Day on February 21, 2024.
Not surprisingly, the short answer is that it’s all about the massive amounts of data that AI models need to process in order to learn and improve.
Ace and Alan discussed why solid-state storage drives (SSDs) are particularly well suited to AI use cases like large language models (LLMs) such as Chat GPT4, recommendation engines, photo tagging, surveillance, and inventory management, as well as multimodal use cases that integrate a number of these elements.
They emphasized how Solidigm has an industry-leading storage portfolio that optimizes and accelerates AI infrastructure, scales efficiently and improves operational efficiency, whether stored and accessed in data centers or at the near edge (e.g., regional data center) or the far edge (e.g., ruggedized, in a vehicle, in the field).
"When it comes to AI, SSDs outperform HDDs in every way,” said Ace. “Within the AI structure, one storage device is not doing one thing at a time. They may be hit by multiple pipelines at the same time – involving training, checkpointing, and preparation. These things happen in parallel, generating more of an I/O workload.”
He also emphasized Total Cost of Ownership (TCO) as a critical element in where SSDs shine over all-HDDs arrays. Stryker compared the number of drives, servers, racks, power density and energy costs for an all-HDD Array (3.5” 24TB) vs. an all-SDD array (Solidigm D5-P5336 61.44 TB) at 70% utilization, to demonstrate this point. This chart illustrates the comparison:
“Not only are these drives storing quite a bit more data,” said Ace. “They are also physically smaller… that has a direct impact on the number of servers you need to populate the storage you require, and how many racks are needed to house those servers. So, you can think of it almost as a cascading effect where fewer smaller drives with higher densities lead to fewer servers, fewer racks, smaller data center footprint, and power optimizations as well.” He went on to share that all of these have sustainability implications.
Alan further emphasized the focus on power with an example from Meta and Stanford University. “The number one thing that most of these folks are thinking about is power,” he said.
Alan took attendees through the five stages of AI work training: data ingest, data prep, training, checkpointing, and inference. He talked about storage challenges with each of these, the workloads they require, and how SSDs are optimal for these workloads.
In summary, Ace and Alan emphasized the critical role storage plays for AI servers: accelerating workflows and seeing them through end to end with efficiency. Said Ace, “With data sets getting bigger and bigger and the models getting more sophisticated, storage needs to be able to scale efficiently in order to keep GPUs fed, keep utilization high, and make AI servers as efficient as possible during every stage of the workflow.” He also underscored cost as an important piece of the SSD story as related to power efficiency, rack space, and data center footprint.
About Solidigm
Solidigm is a leading global provider of innovative NAND flash memory solutions. Solidigm technology unlocks data’s unlimited potential for customers, enabling them to fuel human advancement. Originating from the sale of Intel’s NAND and SSD business, Solidigm became a standalone U.S. subsidiary of semiconductor leader SK hynix in December 2021. Headquartered in Rancho Cordova, California, Solidigm is powered by the inventiveness of team members in 13 locations around the world. For more information, please visit solidigm.com and follow us on Twitter and on LinkedIn. “Solidigm” is a trademark of SK hynix NAND Product Solutions Corp. (d/b/a Solidigm).
Contact details
Related topics
Related news
Solidigm Extends AI SSD Portfolio Leadership with Lightning-Fast Additions to their D7 Product Line
Solidigm™ D7-PS1010 and D7-PS1030 SSDs are built to turbocharge demanding modern workloads and power the most performance-critical stages of the AI data pipeline
Solidigm SSDs Help Break Another Pi Calculation Record
StorageReview Lab breaks pi calculation world record with over 202 trillion digits, consuming nearly 1.5 Petabytes of space across 28 Solidigm SSDs.
Scientific Research and High-Capacity Storage at the Edge: Astrophotography Use Case
Armed with a powerful deep-sky-object capture rig, a set of Solidigm QLC SSDs, and a rugged Dell XR7620 server, Jordan Ranous of Storage Review recently explored the need for robust, cost-effective...
Another Serving of Pi: Solidigm SSDs Help Calculate New World Record
After successfully breaking the speed record for calculating Pi to 100 trillion digits last year, the team at StorageReview has taken it up a notch, revealing the known digits of Pi to 105 trillion...