EP-004: Geo Replication

TGIP 第四期

展开查看详情

1.

2.Geo Replication TGIP-CN Episode 004

3.Cluster ❏ Identified by a cluster-name ❏ Cluster name is used for configuring geo-replication ❏ Cluster configuration ❏ Web service url (http://) ❏ Web service url tls (https://) ❏ Broker service url (pulsar://) ❏ Broker service url tls (pulsar+ssl://)

4.Cluster Setup $ bin/pulsar initialize-cluster-metadata \ --cluster pulsar-cluster-1 \ --zookeeper zk1.us-west.example.com:2181 \ --configuration-store zk1.us-west.example.com:2181 \ --web-service-url http://pulsar.us-west.example.com:8080 \ --web-service-url-tls https://pulsar.us-west.example.com:8443 \ --broker-service-url pulsar://pulsar.us-west.example.com:6650 \ --broker-service-url-tls pulsar+ssl://pulsar.us-west.example.com:6651

5.Cluster Operations ❏ Create ❏ Get ❏ Update ❏ List

6.Geo Replication Cluster 2 Cluster 1 Cluster 3

7.Global Config Store Cluster 2 “Cluster 1”: … “Cluster 2”: … “Cluster 3”: … ZooKeeper Cluster 1 ZooKeeper Global ZooKeeper Cluster 3

8.Allowed Clusters & Replicated Clusters ❏ `bin/pulsar-admin tenants create --allowed-clusters <clusters-list>` ❏ `bin/pulsar-admin namespaces create --clusters <clusters-list>`

9.Geo-Replication

10.Demo ➢ Configuration Store ○ pulsar-sfo-zookeeper ➢ Two clusters ○ pulsar-sfo-1 ○ pulsar-sfo-2

11.Geo-replication w/o Global ZK Cluster 2 ZooKeeper ZooKeeper ZooKeeper “Cluster 1”: … “Cluster 2”: … Cluster 1 “Cluster 3”: … ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper “Cluster 1”: … “Cluster 2”: … “Cluster 3”: … Cluster 3 “Cluster 1”: … “Cluster 2”: … “Cluster 3”: …

12.Aggregation Pattern Cluster 4 ZooKeeper ZooKeeper ZooKeeper Cluster 1 ZooKeeper ZooKeeper ZooKeeper “Cluster 1”: … “Cluster 4”: … Cluster 2 ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper Cluster 3 “Cluster 3”: … “Cluster 4”: … “Cluster 2”: … “Cluster 4”: …

13.Failover Pattern Active Standby ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper ZooKeeper “Active”: … “Standby”: … “Standby”: …

StreamNative 是一家围绕 Apache Pulsar 和 Apache BookKeeper 打造下一代流数据平台的开源基础软件公司。秉承 Event Streaming 是大数据的未来基石、开源是基础软件的未来这两个理念,专注于开源生态和社区的构建,致力于前沿技术。