申请试用
HOT
登录
注册
 

A Deep Dive into Query Execution Engine of Spark SQL

Spark开源社区
/
发布于
/
10492
人观看
Spark SQL enables Spark to perform efficient and fault-tolerant relational query processing with analytics database technologies. The relational queries are compiled to the executable physical plans consisting of transformations and actions on RDDs with the generated Java code. The code is compiled to Java bytecode, executed at runtime by JVM and optimized by JIT to native machine code at runtime. This talk will take a deep dive into Spark SQL execution engine. The talk includes pipelined execution, whole-stage code generation, UDF execution, memory management, vectorized readers, lineage based RDD transformation and action.
14点赞
9收藏
46下载
确认
3秒后跳转登录页面
去登陆