Basavaiah Thambara, LinkedIn
This talk will introduce our home grown NoSQL document store and its initial design based on MySQL replication and the challenges faced, will touch base on some of the major changes incorporated in the product for replacing MySQL replication with Kafka-based replication and cover Kafka based replication implementation in some depth. Followed by an overview of Kafka configuration options to support reliable delivery along with details of the application logic to ensure "exactly once delivery" and "rejection of out-of-band messages."
Audience takeaways are
- How our home grown NoSQL datastore works
- Challenges we faced with MySQL based replication
- How Kafka helped scale the database infrastructure
- Over all how to use kafka for database replication at scale
Basavaiah Thambara, LinkedIn
Basavaiah Thambara (Basu) has more than a decade of experience designing, building, and scaling MySQL databases. He is currently working as a staff database engineer at LinkedIn managing Espresso, an in-house distributed NoSQL datastore built on top of MySQL. Prior to LinkedIn, he worked at Yahoo! after his Masters in Computer Science. He currently lives in Bangalore, India.
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
author = {Basavaiah Thambara},
title = {How We Used Kafka to Scale Database Infrastructure},
year = {2019},
address = {Singapore},
publisher = {USENIX Association},
month = jun
}