Big, fast, bold QLC SSDs for large unstructured datasets

Solidigm Team
Technical Brief
3-MIN Read
06 Dec 2022

Big, fast, bold QLC SSDs for large unstructured datasets

Summary

Learn about options for servicing unstructured datasets with fast PCIe SSDs. See how Solidigm QLC or TLC solid-state drives can lower TCO for you.

 
Big, Fast, Bold QLC SSDs for Large Unstructured Datasets


When customers want to extend their data pool by several petabytes, they have limited options for servicing unstructured datasets with fast PCIe SSDs. At Solidigm, we have a unique product portfolio structured to give data center customers better solutions to meet their needs. We are the only vendor to offer both QLC and TLC technologies based on floating gate and charge trap making technologies.

Together with our industry-leading expertise, our product line is uniquely positioned to address storage pain points such as aging gear, lack of capacity, and high costs. As data-rich services increase, Solidigm QLC SSDs can rapidly access more data, more efficiently. Not only that: at a system level, they can also perform just as well as more expensive TLC-based SSDs. Check out the tests performed by StorageReview with the Solidigm D5-P5316.

Additionally, the capacity of Solidigm QLC drives leads to footprint consolidation, and thus, TCO savings, making them the perfect fit for partners like Dell PowerScale. Dell’s PowerScale family of all-flash nodes are designed to be reliable at any scale. No matter the type of data, where it lives, or how large it is, PowerScale makes it easy to manage.

The PowerScale F900 and F600 are now equipped with Solidigm D5-P5316 QLC SSDs to deliver top-of-the-line performance and huge capacity. In fact, with Solidigm QLC SSDs, PowerScale can pack up to 186 PB in a 252-node cluster. Dell believes that PowerScale is the most flexible and secure scale-out NAS solution on the market, and Solidigm plays an integral role in powering the nodes that put it on top.

David Noy, VP of Product Management at Dell, recently recorded a podcast with StorageReview

Dell positioned PowerScale as part of a broader delivery strategy spanning traditional appliances, Apex managed services, and software-defined cloud deployment. PowerScale is available as an Apex file service, and Dell also introduced a software-defined form of OneFS intended to provide cloud-native scale-out NAS while preserving a common code base across on-premises and cloud environments. This commonality is intended to keep functionality, replication behavior, cyber capabilities, and administration largely consistent whether OneFS runs on dedicated appliances, PowerEdge-based platforms, or virtualized cloud compute instances. PowerScale’s hardware evolution focused heavily on density and flash economics. Dell added support for QLC flash drives in 15.36 TB and 30.72 TB capacities for all-flash nodes such as the F200 and F900, describing QLC as denser and lower cost than TLC, with endurance and performance as the principal tradeoffs. Dell stated that OneFS mitigates those tradeoffs through large I/O patterns, write coalescing, preprocessing, and wide distribution of writes across nodes and drives. Based on field metrics, Dell estimated roughly 14 years of endurance under harsh real-world conditions and said drive wear is monitored through telemetry, alerts, command-line tools, and APIs. Dell also reported that QLC-based systems have shown the same performance as TLC-based systems in its use cases and noted an upcoming OneFS release expected to improve streaming read performance by 25 to 30 percent through software changes alone. Density was presented as a dominant requirement in unstructured data environments because customers face continuous growth along with rack space, power, and cooling constraints. Dell said customers generally prefer denser nodes when available, especially when they may need to absorb multi-petabyte increases quickly and cost-effectively. PowerScale scales compute and storage together rather than through a disaggregated shelf model, allowing customers to choose denser or smaller-drive nodes depending on whether the workload emphasizes broad capacity or a higher proportion of peak-performance data. Dell indicated that future density gains could come from new chassis designs or different drive form factors, although no specific direction was committed. It also acknowledged limited supplier choice for high-capacity QLC, but judged the density value sufficient to proceed. At larger capacities, Dell framed reliability in terms of mean time to data loss and said it targets modeled durability levels measured in thousands of years. If growing drive sizes were ever to reduce those thresholds, Dell said it could increase protection levels and trade some storage efficiency for stronger erasure-coding-style durability. Cyber resilience was described as spanning both primary storage and backup systems. Backup infrastructure was characterized as the last line of defense and therefore in need of strong security, immutability, threat detection, and rapid recovery to a known-good state. Dell emphasized that simple replication alone can spread encrypted or corrupted data to a secondary system if the primary is compromised, making early detection and containment critical. PowerScale’s protection approach therefore stresses identifying suspicious user behavior, such as abnormal access patterns, and revoking privileges quickly to stop propagation before infected data reaches replicas or backups. For very large unstructured datasets, comprehensive backup was described as difficult and expensive. Environments in the 10- to 20-petabyte range, and even around 200 petabytes, were presented as not uncommon, with backup infrastructure requirements and change rates becoming prohibitive at that scale. Customers may therefore back up only part of the environment or rely more heavily on replicated snapshots and secondary copies. Dell presented vaulted architectures with a full air gap, separate administrative control, and periodic rather than continuous access as necessary alternatives when full backup is impractical. An air-gapped secondary copy that opens only periodically to receive updates and preserves multiple immutable point-in-time copies was described as especially important for preventing attacker access. Security responsibilities for unstructured data were depicted as shared between security leadership and infrastructure owners. Chief security officers often drive initiatives from the top down, while infrastructure teams and backup administrators are highly focused on the operational and regulatory consequences of breaches and data unavailability. Dell also described cyber protection as expanding across its broader storage portfolio. PowerMax was cited as reporting metrics that may indicate malicious activity through CloudIQ as part of a security index. Across products, Dell outlined a layered model combining immutability through retention lock, isolation through vaulting or other protected locations, and intelligence through user-behavior analysis and content analytics. This model supports a progression from basic reporting metrics to more advanced analytics and ultimately air-gapped vaulting. The intelligence layer was presented as increasingly important because ransomware can remain dormant for long periods and may alter only a small amount of data while still causing serious damage. AI and machine learning were described as useful for recognizing subtle attack patterns and identifying suspicious behavior early based on learned characteristics of prior attacks. Cloud-based OneFS topologies, including Alpine, were presented as useful for replication targets, burst capacity, and operational flexibility. Dell highlighted use cases such as temporarily standing up large cloud clusters instead of purchasing short-term compute, spinning environments down and back up to control costs, and tiering data into very low-cost object storage such as ultra-cold archive. Cloud was also described as valuable for supply-chain agility when customers need immediate capacity during unpredictable growth. At the same time, Dell said very large deployments often favor on-premises infrastructure economically, reflecting a shift from cloud-first thinking toward using cloud only when appropriate. For sustained high-capacity environments, dense on-premises hardware was presented as continuing to provide strong value, with demand for density, performance, and large cluster sizes expected to remain significant.
where he discussed the future of PowerScale and the impact of Solidigm QLC SSDs. David explained that in PowerScale, Dell uses staged writes, causing less of a write amplification impact on the drives. Combining this implementation with insights gained from field data, PowerScale can extract 14 years' worth of endurance from the D5-P5316.

Furthermore, pre-fetch and performance optimizations lead to the same performance from TLC and QLC drives. Dell has put Solidigm drives to the test, duplicating punishing field environments, and they are comfortable touting the benefits of QLC to their customers.

Aside from exceptional endurance and performance, switching to Solidigm’s QLC technology also provides a clear capacity advantage. QLC-powered PowerScale systems provide 4 – 8 times the capacity of traditional TLC SSDs, with almost 1 PB of storage in a 2U chassis. When you consider the lower price point, increased capacity, and now-proven performance parity over TLC technology, QLC is the clear path forward for data-rich environments.

Dell customers are demanding greater density, and Solidigm is delivering. In 2023, we are launching our 4th generation of QLC SSDs and will go from a maximum 30.72 TB SSD offering to a 61.44 TB SSD offering. Read more about our current QLC offerings, and how they are being deployed in the Dell PowerScale all-flash NAS systems.