SlideShare a Scribd company logo
The first step to
Multi AZ architecture for
Apache BookKeeper
(Durability and availability across zones!)
Anup Ghatage
Salesforce | Senior Member of Technical Staff
Ankit Jain
Salesforce | Senior Member of Technical Staff
Salesforce
Carnegie Mellon University
Anup Ghatage
Salesforce
Carnegie Mellon University
Ankit Jain
●
●
●
●
BookKeeper Basics
•
•
•
•
•
Bookie-0 Bookie-1 Bookie-2
Zookeeper
Bookie-0
InstanceID:
abc123
ledgerDir=/tmp
journalDir=/tmp
Cookie
Bookie-1
InstanceID:
abc123
ledgerDir=/tmp
journalDir=/tmp
Cookie
Bookie-2
InstanceID:
abc123
ledgerDir=/tmp
journalDir=/tmp
Cookie
What is a cookie?
● It’s the identity of the
bookie in the cluster
● Created when bookies
are started
● Used to verify cluster
membership and state of
data in the bookie
•
•
•
•
Why do we need a
Multi AZ Architecture anyway?
“The problem for those sites that were brought
down by the AWS outage is sites’ own failure
to implement the one key design principle of
the cloud — design with failure in mind. ”
“The cloud is just a computer in Reston with a
bad power supply”
“The Azure cloud has experienced three unique
and significant incidents that impacted
customers.”
“Savor “Fireplace For Your Home” on Christmas,
rated four out of five stars and featuring “famous
old-fashioned, wood-burning fireplace,”
•
•
•
•
•
Our design
•
•
•
•
•
•
AWSAzure GCP
Kubernetes
us-west
2a
us-west1
a
West US
az1
Bookie-0
InstanceID: abc123
ledgerDir=/tmp
journalDir=/tmp
Cookie
Bookie-0
InstanceID: abc123
ledgerDir=/tmp
journalDir=/tmp
networkLocation=
/region+zone/upgradeDomain
Cookie
Region
AZ
•
•
•
•
•
•
•
networkLocation
What a Multi AZ Architecture
enables
•
•
•
•
•
Reference: Charan Guttapalem - bookkeeper-server/src/main/java/org/apache/bookkeeper/client/ZoneawareEnsemblePlacementPolicy.java
●
●
●
The first step to Multi AZ architecture for Apache BookKeeper_Anup Ghatage
Questions?

More Related Content

The first step to Multi AZ architecture for Apache BookKeeper_Anup Ghatage