2. Pulsar 2.4.0 新功能解析-翟佳

展开查看详情

1.Apache Pulsar — 2.4.0 翟佳

2.自我介绍 • 开源项目爱好者: • Pulsar, BookKeeper 的 Committer 和 PMC 成员 • EMC -> StreamNative • StreamNative Core Engineer • 华中科大 -> 中科院计算所

3.Pulsar Releases • 2.2.0 — 2018/10/27 • 2.2.1 — 2018/12/14 • 2.3.0 — 2019/02/22 • 2.3.1 — 2019/04/12 • 2.3.2 — 2019/05/02 • 2.4.0 — 2019/06/29

4.Pulsar Components Pulsar IO Cassandra Kafka MySQL Debezium MongoDB Flume Hdfs Messaging Event Processing Pulsar Functions Complex Stream Pulsar Brokers Processing Stream Storage Analytics BookKeeper Pulsar SQL Hive Tiered Storage Google Cloud Azure Blob AWS S3 HDFS Storage Storage

5.Pulsar 2.4.0 Features • Key-Shared 订阅模式 • Delayed Message • Replicated subscriptions • Kerberos Authentication • Go Functions • Connectors • Others

6.Key-Shared 订 阅

7.Pulsar 统一的消费模型

8.2.4.0 : Key-shared 订阅

9.Delayed Message

10.2.4.0 — Delayed Message TypedMessageBuilder.java TypedMessageBuilder.java

11. Geo-Replication Replicated subscriptions

12.2.4.0 : Geo-replication: Replicated subscriptions Beijing Shanghai Producer Producer (P1) Topic (T1) Topic (T1) (P2) Consumer Subscription (S1) Subscription (S1) Consumer (C1) (C2) 1 2 3 4 5 6 7 .. Producer Topic (T1) (P3) Guangzhou

13.Authentication — Kerberos

14.Authentication in Pulsar • TLS • Json Web Token(JWT) • AthenZ • Kerberos

15.Go Function

16.Pulsar Functions— 轻量化计算

17.Pulsar Functions— 轻量化计算

18.2.4.0 — Pulsar Functions Go-lang

19.Pulsar IO Connectors

20.Pulsar IO Connectors in 2.4.0 • Flume Source and Sink #3597 • Redis sink #3700 • Solr sink #3885 • RabbitMQ sink #3967 • InfluxDB sink #4017 Thanks! -@tuteng -@murong00

21.Others

22.2.4.0 : Other Features • Large message size support — PR #4247 • Add Negative Acknowledge — PR #3816 • Add support for snappy compression — PR #4319 • Muti Version Schema support — PR #3876 • KeyValue schema enhancement — PR #4117 #4548 • Combine package for Pulsar client and admin — PR #3662

23.• 社区 Twitter: @apache_pulsar Wechat Subscription: ApachePulsar Mailing Lists dev@pulsar.apache.org, users@pulsar.apache.org Slack https://apache-pulsar.slack.com (#china) register: https://apache-pulsar.herokuapp.com/ Localization https://crowdin.com/project/apache-pulsar Github https://github.com/apache/pulsar https://github.com/apache/bookkeeper

24.Thanks !