The first step to Multi AZ architecture for Apache BookKeeper

1 .The first step to Multi AZ architecture for Apache BookKeeper (Durability and availability across zones!) Anup Ghatage Salesforce | Senior Member of Technical Staff Ankit Jain Salesforce | Senior Member of Technical Staff 

2 . Anup Ghatage Ankit Jain Salesforce Salesforce Carnegie Mellon University Carnegie Mellon University 

3 .● ● ● ● 

4 .BookKeeper Basics 

5 .• • • • • 

6 . What is a cookie? Zookeeper ● It’s the identity of the Bookie-0 Bookie-1 Bookie-2 Cookie Cookie Cookie InstanceID: InstanceID: InstanceID: bookie in the cluster abc123 abc123 abc123 ledgerDir=/tmp ledgerDir=/tmp ledgerDir=/tmp journalDir=/tmp journalDir=/tmp journalDir=/tmp ● Created when bookies are started ● Used to verify cluster Bookie-0 Bookie-1 Bookie-2 membership and state of data in the bookie 

7 .• • • • 

8 .Why do we need a Multi AZ Architecture anyway? 

9 . “The cloud is just a computer in Reston with a “The Azure cloud has experienced three unique and significant incidents that impacted bad power supply” customers.” “The problem for those sites that were brought down by the AWS outage is sites’ own failure “Savor “Fireplace For Your Home” on Christmas, to implement the one key design principle of rated four out of five stars and featuring “famous the cloud — design with failure in mind. ” old-fashioned, wood-burning fireplace, ” 

10 .• • • • • 

11 .Our design 

12 .• • • 

13 .• • • 

14 . Bookie-0 Bookie-0 InstanceID: abc123 Cookie InstanceID: abc123 Cookie ledgerDir=/tmp ledgerDir=/tmp journalDir=/tmp journalDir=/tmp networkLocation= /region+zone/upgradeDomain Region West US us-west us-west1 AZ az1 2a a Kubernetes Azure AWS GCP 

15 .• • • • • 

16 .• • networkLocation 

17 .What a Multi AZ Architecture enables 

18 . • • • • • Reference: Charan Guttapalem - bookkeeper-server/src/main/java/org/apache/bookkeeper/client/ZoneawareEnsemblePlacementPolicy.java 

19 .● ● ● 

20 .

21 .Questions?