Pulsar 2.4.0 新功能解析

1 .Apache Pulsar — 2.4.0 翟佳 

2 .自我介绍 • 开源项目爱好者： • Pulsar, BookKeeper 的 Committer 和 PMC 成员 • EMC -> StreamNative • StreamNative Core Engineer • 华中科大 -> 中科院计算所 

3 .Pulsar Releases • 2.2.0 — 2018/10/27 • 2.2.1 — 2018/12/14 • 2.3.0 — 2019/02/22 • 2.3.1 — 2019/04/12 • 2.3.2 — 2019/05/02 • 2.4.0 — 2019/06/29 

4 .Pulsar Components Pulsar IO Cassandra Kafka MySQL Debezium MongoDB Flume Hdfs Messaging Event Processing Pulsar Functions Complex Stream Pulsar Brokers Processing Stream Storage Analytics BookKeeper Pulsar SQL Hive Tiered Storage Google Cloud Azure Blob AWS S3 HDFS Storage Storage 

5 .Pulsar 2.4.0 Features • Key-Shared 订阅模式 • Delayed Message • Replicated subscriptions • Kerberos Authentication • Go Functions • Connectors • Others 

6 .Key-Shared 订 阅 

7 .Pulsar 统一的消费模型 

8 .2.4.0 ： Key-shared 订阅 

9 .Delayed Message 

10 .2.4.0 — Delayed Message TypedMessageBuilder.java TypedMessageBuilder.java 

11 . Geo-Replication Replicated subscriptions 

12 .2.4.0 ： Geo-replication: Replicated subscriptions Beijing Shanghai Producer Producer (P1) Topic (T1) Topic (T1) (P2) Consumer Subscription (S1) Subscription (S1) Consumer (C1) (C2) 1 2 3 4 5 6 7 .. Producer Topic (T1) (P3) Guangzhou 

13 .Authentication — Kerberos 

14 .Authentication in Pulsar • TLS • Json Web Token(JWT) • AthenZ • Kerberos 

15 .Go Function 

16 .Pulsar Functions— 轻量化计算 

17 .Pulsar Functions— 轻量化计算 

18 .2.4.0 — Pulsar Functions Go-lang 

19 .Pulsar IO Connectors 

20 .Pulsar IO Connectors in 2.4.0 • Flume Source and Sink #3597 • Redis sink #3700 • Solr sink #3885 • RabbitMQ sink #3967 • InfluxDB sink #4017 Thanks! -@tuteng -@murong00 

21 .Others 

22 .2.4.0 ： Other Features • Large message size support — PR #4247 • Add Negative Acknowledge — PR #3816 • Add support for snappy compression — PR #4319 • Muti Version Schema support — PR #3876 • KeyValue schema enhancement — PR #4117 #4548 • Combine package for Pulsar client and admin — PR #3662 

23 .• 社区 Twitter: @apache_pulsar Wechat Subscription: ApachePulsar Mailing Lists dev@pulsar.apache.org, users@pulsar.apache.org Slack https://apache-pulsar.slack.com (#china) register: https://apache-pulsar.herokuapp.com/ Localization https://crowdin.com/project/apache-pulsar Github https://github.com/apache/pulsar https://github.com/apache/bookkeeper 

24 .Thanks !