From 15,000 Database Connections to under 100—A Tech Debt Tale

Note: Presentation times are in Coordinated Universal Time (UTC).

Website Maintenance Alert

Due to scheduled maintenance, the USENIX website may not be available on Monday, March 17, from 10:00 am–6:00 pm Pacific Daylight Time (UTC -7). We apologize for the inconvenience and thank you for your patience.

If you would like to register for NSDI '25, SREcon25 Americas, or PEPR '25, please complete your registration before or after this time period.

Wednesday, 13 October, 2021 - 05:0005:30

Sunny Beatteay, DigitalOcean

Abstract: 

Whenever a company scales quickly, they invariably take on technical debt. It's unavoidable. However, the existence of tech debt isn't the problem, it's how you handle it when you can't put it off any longer.

In this talk, I will be telling the story of one company's largest technical re-architecture to date. It was a company-wide effort that extended over multiple years and taught us many lessons. And it all revolved around a single, overloaded database.

This talk is geared towards mid-level engineers and up who have a solid understanding of tech debt and distributed systems. I discuss some advanced topics and show various architectural diagrams. Though beginners will likely it interesting as well.

Sunny Beatteay, DigitalOcean

Sunny is a software engineer at DigitalOcean where he works on building managed storage products. He has a passion for whiskey and working on distributed systems—preferably in that order. When he's not breaking production, he can be found trying to figure out how to pipe all his troubles into /dev/null.

SREcon21 Open Access Sponsored by Indeed

BibTeX

Presentation Video