17/03 - Harnessing the power of Spark and Cassandra in your Spri

Harnessing the Power of Spark + Cassandra within your Spring App

展开查看详情

1.Harnessing the Power of Spark + Cassandra within your Spring App Steve Pember CTO, ThirdChannel @svpember

2.RELATIONAL DATABASES ARE FANTASTIC @spring_io #springio17

3.SQL MAKES YOU STRONG

8.@spring_io #springio17

9. Agenda • Spark • Cassandra • Spark + Cassandra • Working with Spark + Cassandra • Demo @spring_io #springio17

10. Apache Spark • Distributed Execution Engine @spring_io #springio17

11.

12. Apache Spark • Distributed Execution Engine • What about Hadoop? @spring_io #springio17

13. Hadoop  Spark • Map / Reduce • More than Map/ • Storage via HDFS Reduce • Each calculation • No dependent step written to storage disk mechanism • Clustered Calculations, each step in memory @spring_io #springio17

14. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident @spring_io #springio17

15.@spring_io #springio17

16.@spring_io #springio17

17. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture @spring_io #springio17

18.@spring_io #springio17

19.Your Spring App @spring_io #springio17

20. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure @spring_io #springio17

21.THE SPARKCONTEXT SUBMITS JOBS TO THE CLUSTER @spring_io #springio17

22.OPERATIONS ARE PERFORMED AGAINST RDDS @spring_io #springio17

23. Resilient Distributed Dataset • Immutable • Partitioned • Parallel operations • Created by performing operations on other RDDs • Reusable & Composable @spring_io #springio17

24.@spring_io #springio17

25. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs @spring_io #springio17

26.MORE THAN MAP/REDUCE @spring_io #springio17

27. RDD operations • map • reduce • aggregate • filter • flatmap • join • … plus many more @spring_io #springio17

28.@spring_io #springio17

29. Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs • Additional Modules @spring_io #springio17