申请试用
HOT
登录
注册
 
Elastify Cloud-Native Spark Application with Persistent Memory

Elastify Cloud-Native Spark Application with Persistent Memory

Spark开源社区
/
发布于
/
8447
人观看
Cloud native deployment has become one of the major trends for large scale Big Data analytics. Compared to on-premise data center, cloud offers much stronger scalability and higher elasticity to Big Data applications. However, cloud is also considered to be less performance than on-premise alternatives due to virtualization and cluster resource disaggregation. We present a new cloud native Spark application architecture backed by persistent memory technology. The key ingredient of this architecture is a novel acceleration engine that uses Intel’s 3DXPoint technology as external memory. We discuss how the performance of multiple aspects of data processing can be improved using this new architecture. As a key takeaway, audience will gain understanding on the benefits of latest persistent memory technology, and how such new technology could be leveraged in cloud data processing architecture.
0 点赞
2 收藏
14下载
确认
3秒后跳转登录页面
去登陆