Zhaopin.com is a Chinese online recruitment services provider. As a bilingual job board, Zhaopin.com has one of the largest selections of real-time job vacancies in China. All recruitment advertisements are provided by prominent Chinese and foreign companies and enterprises throughout China. Zhaopin.com provides professional HR services to over 2.2 million clients and its average daily page views are over 68 million.nApache Pulsar was developed to address several shortcomings of existing messaging systems including a lot of enterprise features, message durability, and lower message latency. Zhaopin.com had built its enterprise event bus By using RabbitMQ for years. As the company grows, the amount of its data is getting larger and larger, and the usage scenarios of message systems are also become varied. The original RabbitMQ based architecture was hard to afford. Ultimately, it chose Apache Pulsar to replace RabbitMQ based architecture in 2018. Since Apache Pulsar was deployed at August 2018, The data amount in Pulsar is increased from 30 million messages per day to 6 billion+ messages. By learning from a lot of practical experiences, they summarised the best practices to using Pulsar as an enterprise event bus. Penghui and Jia detail how Apache Pulsar meet the requirements from Zhaopin.com. How Apache Pulsar is used in Zhaoping.com, and What is the best practices to using Pulsar as an enterprise event bus. Along the way, they will highlight the advantages of Apache Pulsar over the old system, and how high durability, high throughput and low latency of Apache Pulsar make it ideally suited for enterprise event bus.
1 of 34
More Related Content
Building Zhaopin's enterprise event center on apache pulsar
2. Zhaopin.com
Zhaopin.com is the biggest online recruitment service
provider in China
Zhaopin.com provides job seekers a comprehensive resume service, latest
deployment, and career development related information, as well as in-depth
online job search for positions throughout China.
Zhaopin.com provides professional HR services to over 2.2 million clients and its
average daily pageviews are over 68 millions.
3. Who we are
❏ Penghui Li
❏ Tech lead of Infrastructure
team at Zhaopin
❏ 5+ years of experiences in
messaging and microservices
❏ Apache Pulsar Committer
4. Who we are
❏ Jia Zhai
❏ Pulsar PMC Member / Committer
❏ BookKeeper PMC Member /
Committer
❏ Funding engineer at
StreamNative
5. Agenda
❏ Why building an Event Center
❏ Why Apache Pulsar
❏ Apache Pulsar at Zhaopin
❏ Streaming Platform
❏ Zhaopin’s contributions to Apache Pulsar
7. Data Silos
❏ High Maintenance Cost
❏ Extremely hard to scale data cross
teams
❏ Inconsistency between data silos
❏ Doesn’t scale
❏ No consistent SLA
Pain Points
To Enterprises
MSMQ
Data Processing
Kafka
To End Users
RabbitMQ
8. Data Silos
❏ High Maintenance Cost
❏ Extremely hard to scale data cross
teams
❏ Inconsistency between data silos
❏ Doesn’t scale
❏ No consistent SLA
Pain Points
To Enterprises
MSMQ
Data Processing
Kafka
To End Users
RabbitMQ
9. Unification - MQService
❏ Simplified Operations
❏ Scale-out Service
❏ High Availability
Problem Solved
Problem Unsolved
❏ Keep messages for longer period
❏ Data rewind
❏ Order guarantee
26. Pulsar at Zhaopin
❏ One copy of data, single source-of-truth
❏ Don’t worry about data consistency between RabbitMQ and
Kafka
❏ Multi-tenancy makes topic management easier
❏ Strong data durability allows us to stop worrying about
message loss