17/03 - Harnessing the power of Spark and Cassandra in your Spri
展开查看详情
1.Harnessing the Power of Spark + Cassandra within your Spring App Steve Pember CTO, ThirdChannel @svpember
2.RELATIONAL DATABASES ARE FANTASTIC @spring_io #springio17
3.SQL MAKES YOU STRONG
4.
5.
6.
7.
8.@spring_io #springio17
9. Agenda • Spark • Cassandra • Spark + Cassandra • Working with Spark + Cassandra • Demo @spring_io #springio17
10. Apache Spark • Distributed Execution Engine @spring_io #springio17
11.
12. Apache Spark • Distributed Execution Engine • What about Hadoop? @spring_io #springio17
13. Hadoop Spark • Map / Reduce • More than Map/ • Storage via HDFS Reduce • Each calculation • No dependent step written to storage disk mechanism • Clustered Calculations, each step in memory @spring_io #springio17
14. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident @spring_io #springio17
15.@spring_io #springio17
16.@spring_io #springio17
17. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture @spring_io #springio17
18.@spring_io #springio17
19.Your Spring App @spring_io #springio17
20. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure @spring_io #springio17
21.THE SPARKCONTEXT SUBMITS JOBS TO THE CLUSTER @spring_io #springio17
22.OPERATIONS ARE PERFORMED AGAINST RDDS @spring_io #springio17
23. Resilient Distributed Dataset • Immutable • Partitioned • Parallel operations • Created by performing operations on other RDDs • Reusable & Composable @spring_io #springio17
24.@spring_io #springio17
25. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs @spring_io #springio17
26.MORE THAN MAP/REDUCE @spring_io #springio17
27. RDD operations • map • reduce • aggregate • filter • flatmap • join • … plus many more @spring_io #springio17
28.@spring_io #springio17
29. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs • Additional Modules @spring_io #springio17