1. Pulsar 简介和用户案例-郭斯杰

展开查看详情

1.Apache Pulsar Introduction and community

2. 我是谁 我来自哪里 我要到哪里去

3.What is Apache Pulsar?

4.What is Apache Pulsar? 2003 2010 2012 2006 2011

5.Built for Cloud

6. A brief history of Pulsar • 2012 Pulsar idea started • 5+ years on production, 100+ applications, 10+ data centers • 2016/09 Yahoo open sourced Pulsar • 2017/06 Yahoo donated Pulsar to ASF • 2018/09 Pulsar graduated as a Top-Level project • 25 committers, 139 contributors, 843 forks, 3700+ stars

7.Pulsar

8.1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

9. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

10. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

11. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

12. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

13. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

14. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

15. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

16. 1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

17.1.x - PubSub Messaging Multi language clients Messaging Stream Storage Low Latency Storage

18. 2.x - Tiered Storage Multi language clients Messaging Stream Storage Low Latency Cloud Native Storage Storage

19. 2.x - Processing Multi language clients Pr g in oc g es sa s in s Me g Stream Storage Low Latency Cloud Native Storage Storage

20.2.x - Interactive Queries Interactive Queries Multi language clients Pr g in oc g es sa s in s Me g Stream Storage Low Latency Cloud Native Storage Storage

21.2.x - Unified Data Processing Interactive Queries Multi language clients Pr g in oc Stream & Batch g es sa Processing s in s Me g Stream Storage Low Latency Cloud Native Storage Storage

22.2.x - Pulsar Functions Interactive Queries Multi language clients Pr g in oc Stream & Batch g es sa Processing s in s Me g Function Processing Stream Storage { } Low Latency Cloud Native Storage Storage

23. 2.x - Pulsar IO Interactive Queries Multi language clients Pr g Pulsar IO in oc Stream & Batch g es sa Processing s in s Me g Function Processing Stream Storage { } Low Latency Cloud Native Storage Storage

24. 2.x - Pulsar CDC Interactive Queries Multi language clients Pr g Pulsar IO in oc Stream & Batch g es sa Processing s in s Me g Change Data Capture Function Processing Stream Storage { } Low Latency Cloud Native Storage Storage

25.Event Streaming Platform Interactive Queries Multi language clients Pr g Pulsar IO in oc Stream & Batch g es sa Processing s in s Me g Change Data Capture Function Processing Stream Storage { } Low Latency Cloud Native Storage Storage

26.Use cases & Community

27. 案例 - Yahoo • 使用 Pulsar 作为核心的 Event Data Bus • 整合不同的技术和集群成统一的解决 方案 • 全球多机房( 8+) 复制 • 每日处理千亿量级的消息,多达 230 万个 topics

28. 案例 - Twitter • 整个消息系统 (EventBus)EventBus) 的存储方案 • Search 、 Ads 、 Stream computing 、 Manhattan Database • 1000+ Bookies per datacenter • 17PB/day, 1.5 trillion records/second

29. 案例 - 智联招聘 Pulsar based Event Center POC 3 billion msgs/day 1 billion msgs/day 2018/07 2018/09 2018/10 2018/11 2018/12 2019/02 Win the best innovative 6 billion msgs/day Pulsar on Production platform award at Zhaopin • 统一: 替换 RabbitMQ + Kafka • 0 数据丢失 • 50+ NameSpaces • 60 亿 消息 / 天 • 3TB Storage/ 天 • 20+ 核心应用