申请试用
HOT
登录
注册
 
Spark Structured Streaming

Spark Structured Streaming

Spark开源社区
/
发布于
/
4886
人观看
With the ubiquity of real-time data, organizations need streaming systems that are scalable, easy to use, and easy to integrate into business applications. Structured Streaming is a new high-level streaming API in Apache Spark based on our experience with Spark Streaming. Structured Streaming differs from other recent stream- ing APIs, such as Google Dataflow, in two main ways. First, it is a purely declarative API based on automatically incrementalizing a static relational query (expressed using SQL or DataFrames), in con- trast to APIs that ask the user to build a DAG of physical operators. Second, Structured Streaming aims to support end-to-end real-time applications that integrate streaming with batch and interactive analysis. We found that this integration was often a key challenge in
8点赞
5收藏
16下载
确认
3秒后跳转登录页面
去登陆