3D NAND and Optane SSD Transform the Data Center Storage

1 .3DNAND and Optane ssd transform the data center storage 陈宸仲 

2 .Legal Disclaimer Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more atintel.com. Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider yourpurchase. Cost reduction scenarios described are intended as examples of how a given Intel-based product, in the specified circumstances and configurations, may affect future costs and provide cost savings. Circumstances will vary. Intel does not guarantee any costs or cost reduction. Intel does not control or audit the design or implementation of third party benchmark data or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar performance benchmark data are reported and confirm whether the referenced benchmark data are accurate and reflect performance of systems available for purchase. Intel, the Intel logo, Intel Optane, Xeon, and others are trademarks of Intel Corporation in the U.S. and/or other countries. © 2018 Intel Corporation. All rights reserved. *Other names and brands may be claimed as the property of others. NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 2 2 

3 . Intel Technology Innovations Fill the Memory and Storage Gaps Performance and Capacity for Every Need Intel® 3D NAND Intel® Optane™ Technology Technology Lower cost & higher Higher density performance LOWER Cost HIGHER LESS Delay MORE NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 3 

4 . changing data needs have exposed Storage & memory gaps Working set scaling is limited dram memory Capacity Gap Performance Gap storage Lower performance/$ limits value of stored data NAND SSD Cost Gap HDD NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 4 4 

5 . Intel Data Center Solutions for All Needs IOPS Latency Quality of Endurance Capacity Service Intel® Optane™ SSDs Highest Performance PCIe*/NVMe* Products Intel® 3D NAND SSDs High Performance PCIe/NVMe Products Intel® 3D NAND SSDs Mainstream SATA Products NOTE: Bigger dots are better Graphical representation of product comparison is based on internal Intel analysis, and is provided here for informational purposes only. Any differences in system hardware, software or configuration may affect actual performance. *Other names and brands may be claimed as the property of others. NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 5 

6 . e.G.HCI is the fastest growing architecture in DC storage Data Close to Compute = Reduced Latency = Greater Business Value NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 6 6 

7 . OPTNAE Usage Model NVM SOLUTIONS GROUP 7 

8 . Intel® Optane™ technology for data center configurations Fast Storage and caching Bigger and Affordable Memory Memory Pool + Intel® Xeon® Intel® Xeon® Scalable DDR DRAM Scalable Processor Processor DDR Family Family Intel® Memory Drive Technology PCIe* Intel® Optane™ SSD software with Intel® Optane™ SSDs PCIe* PCIe* PCIe* Intel® 3D NAND SSDs for DC Intel® 3D NAND SSDs for DC *Other names and brands may be claimed as the property of others. 

9 .DEMO - Optane SSD with IMDT NVMNVM SOLUTIONS SOLUTIONS G GROUP ROUP Intel Confidential – Customers Under NDA 9 9 

10 . Solution example – SPARK NVM SOLUTIONS GROUP 10 

11 . Hardware Configuration Software Configuration Master Node Data Node (x3) Stack Version CPU Intel® Xeon® Intel® Xeon® Gold Distribution HDP 2.6.4.0 Gold 6140 CPU 6140 CPU @ @ 2.30GHz 2.30GHz Cores per Socket 18 18 HDFS* 2.7.3 Sockets 2 2 YARN* 2.7.3 Threads per Core 2 2 Spark* 2.2.0 Total vcores 72 72 OS CentOS 7.4* Memory 192GB 192GB SSD None 3.7TB Intel® SSD Kernel 4.14.16 DC P4500 (x2) 375GB Intel® Optane™ SSD DC P4800X (x2) Network 10Gbps * Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 11 

12 . Workload that fits entirely into DRAM Spark* Workload Configuration # of Executors across all Nodes 42 # of Cores per Executor 5 Memory per Executor 12 GiB Memory Overhead per Executor 3 GiB Driver Memory 1 GiB Driver Memory Overhead 1 GiB K-Means workload Scale Factor 1.2 Billion samples Time taken to run the workload is 5.3 min 1 Spark* configuration is based on generally understood guidelines. Data set fits entirely into memory, without any spill. The objective is to utilize maximum available resources on the system to get best possible run-time. 1 For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 12 

13 . Workload that fits entirely into DRAM (+IMDT) Spark* Workload Configuration # of Executors across all Nodes 42 # of Cores per Executor 5 Memory per Executor 12 GiB Memory Overhead per Executor 3 GiB Driver Memory 1 GiB CPU usage, same as Driver Memory Overhead 1 GiB before K-Means workload Scale Factor 1.2 Billion samples Time taken to run the workload is 5.3 min 1 Objective is to ensure performance did Memory added not get impacted when running the (but unused) via same workload using same resource IMDT configuration, except for memory expansion using IMDT. 1 For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 13 

14 . Bigger Workload using DRAM Spark* Workload Configuration # of Executors across all Nodes 30 # of Cores per Executor 7 Memory per Executor 17 GiB Memory Overhead per Executor 3 GiB Driver Memory 1 GiB Driver Memory Overhead 1 GiB K-Means workload Scale Factor 2 Billion samples Time taken to run the workload is 43 min 1 Spark* shuffles the data between memory and storage when dataset does not fit entirely in memory. If the workload is large enough that it cannot fit with fully populated memory channel, the next logical move is to scale out and add more nodes. Storage: 2x Intel® Optane® SSD DC P4800X 1 For (750GB) system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 14 

15 . Bigger Workload using IMDT Spark* Workload Configuration # of Executors across all Nodes 42 # of Cores per Executor 10 Memory per Executor 40 GiB Memory Overhead per Executor 3 GiB Driver Memory 1 GiB Driver Memory Overhead 1 GiB K-Means workload Scale Factor 2 Billion samples Time taken to run the workload is 12 min 1 IMDT helps to bring more memory resources without having to scale out. IMDT can expand memory capacity to grow x8 beyond system spec. That directly translates to more Spark* executors that can run in parallel. 1 For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 15 

16 . Solution Economics Master Node Data Node (x3) Per-node Configuration Cost Comparison CPU Intel® Xeon® Gold 6140 CPU @ 2.30GHz 100,000.00 45 Cores/Socket 18 43 90,000.00 40 Sockets 2 80,000.00 35 Cost $ USD Threads per 2 70,000.00 Minutes 30 Core 60,000.00 25 Total vcores 72 50,000.00 20 Memory 192GB 40,000.00 12 15 30,000.00 SSD None 3.7TB Intel® SSD DC 20,000.00 10 P4500 (x2) 10,000.00 5 375GB Intel® Optane™ 0.00 0 SSD DC P4800X (x2) Intel® Xeon® Server Intel® Xeon™ Server + IMDT Server Optane/IMDT Runtime [min] Network 10Gbps 20% added cost1  reduce runtime by factor of x3.52 1Cost estimates based on quote from Colfax International as of May 27, 2018 2For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 16 

17 . Bigger Workload using IMDT and fewer nodes Spark* Workload Configuration (2 Data Nodes only) # of Executors across all Nodes 28 # of Cores per Executor 10 Memory per Executor 40 GiB Memory Overhead per Executor 3 GiB Driver Memory 1 GiB Driver Memory Overhead 1 GiB K-Means workload Scale Factor 2 Billion samples Time taken to run the workload is 30 min 1 For workloads that are not fully utilizing CPU resources in a given infrastructure, IMDT can help increase CPU utilization. Increasing CPU utilization allows for savings on data center footprint by reducing node-count, with larger memory per node. Savings can be put back into improved networks, higher-core-count CPUs, etc. 1 For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 17 

18 . Solution Economics Master Node Data Node (x2) CPU Intel® Xeon® Gold 6140 CPU @ 2.30GHz Cluster (workers) Configuration Cost Comparison Cores/Socket 18 Sockets 2 Cost $ USD 100,000.00 45 Minutes 90,000.00 43 40 80,000.00 35 Threads per 2 30 70,000.00 30 Core 60,000.00 25 50,000.00 Total vcores 72 20 40,000.00 30,000.00 15 Memory 192GB 12 20,000.00 10 5 SSD None 3.7TB Intel® SSD DC 10,000.00 0.00 0 P4500 (x2) 3x Intel® Xeon® 2x Intel® Xeon® 3x Intel® Xeon® 375GB Intel® Optane™ Server Server + IMDT Server + IMDT SSD DC P4800X (x2) Server Optane/IMDT Runtime [min] Network 10Gbps 20% cost reduction1  reduce runtime by 30%2 1Cost estimates based on quote from Colfax International as of May 27, 2018 2For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 18 

19 . Solution Alternatives Cluster (workers) Configuration Cost Comparison – adding the expanded all-DRAM option2 100000 90000 Cost $ USD1 80000 70000 60000 50000 40000 30000 20000 10000 0 3x Intel® Xeon® Server (768GB) 3x Intel® Xeon® Server (192GB) 2x Intel® Xeon® Server + IMDT 3x Intel® Xeon® Server + IMDT Server (incl' DRAM) Optane/IMDT addition 1Cost estimates based on quote from Colfax International as of May 27, 2018 2For system configuration details, please refer to Slide #5. Benchmark results were obtained prior to implementation of recent software patches and firmware updates intended to address exploits referred to as "Spectre" and "Meltdown". Implementation of these updates may make these results inapplicable to your device or system. *Other names and brands may be claimed as the property of others NVM SOLUTIONS GROUP 19 

20 . Recommendations on server configuration NVM SOLUTIONS GROUP 20 

21 . Intel® Optane™ Technology Intel® Optane™ 100GB† SSD DC P4800X 200GB † PCIe* 3.0 x4, 375GB NVMe* 750GB 1.5TB *Other names and brands may be claimed as the property of others. † Available in Q4’18. Copyright © 2018 Intel Corporation. All rights reserved. Intel and the Intel logo are trademarks of Intel Corporation in the U.S and/or other countries. NVM SOLUTIONS GROUP 21 

22 . Intel® 3D NAND Technology 1.6TB 240GB 1.6TB Intel® SSD 2TB Intel® SSD Intel® SSD 480GB 3.2TB 3.2TB DC P4610 DC P4600 D3-S4610 960GB 6.4TB 4TB PCIe* 3.1 x4, NVMe* PCIe* 3.1 x4, NVMe* SATA 6GB/s 2TB 7.68TB 6.4TB 4TB 8TB 1TB 1TB Intel® SSD Intel® SSD Intel® SSD 240GB Intel® SSD 7.68TB 2TB 2TB 480GB DC P4510 4TB DC P4500 4TB D3-S4510 D5-P4320 PCIe* 3.1 x4, NVMe* PCIe* 3.1 x4, NVMe* SATA 6GB/s 960GB PCIe* 3.0 x4, NVMe* 8TB 8TB 2TB 4TB *Other names and brands may be claimed as the property of others. 8TB Copyright © 2018 Intel Corporation. All rights reserved. Intel and the Intel logo are trademarks of Intel Corporation in the U.S and/or other countries. NVM SOLUTIONS GROUP 22 

23 . Enterprise Cloud Scale-out Storage Data Tier Recommendation. Storage Caching Memory Better + • Breakthrough NAND caching bottlenecks to optimize storage scaling and Best server utilization (Optane caching) Intel® SSD Intel® DRAM • Scale services while maintaining SLAs (Optane caching) DC P4500 Optane™ SSD • Differentiate and monetize services with ultra-low, predictable latency (Optane caching) Good + • Maximize storage per server to optimize TCO and increase agility (P4500 storage) • Deploy all-PCIe* solutions to accelerate applications and increase server Better utilization (P4500 storage, P4600 caching) Intel® SSD Intel® SSD DC DRAM • Higher capacity storage and caching increases server agility DC P4500 P4600 • Advanced manageability, serviceability and security increases IT efficiency (P4500, P4600) Install base + • Increase storage per server to reduce TCO and improve agility (S4500 storage) Good Intel® SSD Intel® SSD DC DRAM • Faster caching to accelerate applications and scale per node storage (P4600 caching) DC S4500 P4600 NVM Solutions Group 23 

24 .Business Operations / Mission Critical Data Tier Recommendation Storage Caching Memory Better + • Breakthrough NAND caching bottlenecks to optimize storage scaling and server utilization (Optane caching) Best Intel® SSD Intel® DRAM + • Scale services while maintaining SLAs (Optane caching) DC P4500 Optane™ SSD Intel® Optane™ SSD with • Differentiate and monetize services with ultra-low, predictable latency Intel® Memory Drive Technology (Optane caching) Good + • Maximize storage per server to optimize TCO and agility (P4500 storage) • Deploy all-PCIe* solutions to accelerate applications and increase server Better Intel® SSD Intel® SSD DRAM + utilization (P4500 storage, P4600 caching) DC P4500 DC P4600 Intel® Optane™ SSD with • Advanced manageability and serviceable increases IT efficiency (P4500, P4600) Intel® Memory Drive Technology • Accelerate applications and improve data-driven insights via larger working sets (Optane SSD extend memory) Install base + Good • Increase storage per server to reduce TCO and improve agility (S4500 storage) Intel® SSD Intel® SSD DRAM • Faster caching to accelerate applications and scale per node storage (P4600 DC S4500 DC P4600 caching) NVM Solutions Group 24 

25 .Breakthrough the system bottleneck with Intel Optane ssd Yesterday TODAY CPU CPU CPU CPU 2D NAND OPTANE™ OPTANE™ HDD HDD 3D NAND 3D NAND HDD HDD 3D NAND 3D NAND *Other names and brands may be claimed as the property of others. Copyright © 2018 Intel Corporation. All rights reserved. Intel and the Intel logo are trademarks of Intel Corporation in the U.S and/or other countries. 25 

26 .26