Leila Vayghan, Shopify
This talk is about enhancing the search infrastructure of Shopify, a large-scale ecommerce platform that supports over 3 million merchants and handles more than two petabytes of data.
This talk explains how we leverage Kubernetes on Google Cloud Platform to ensure high availability and performance, crucial for maintaining our platform's robust search functionality. It will also elaborate on our innovative approach using dedicated reindexing nodes within existing clusters, which significantly improves indexing and reindex performance while cutting infrastructure costs. We will explore the application of Kubernetes Event-Driven Autoscaling (KEDA) to dynamically manage resource allocation, enhancing operational efficiency and reducing on-call fatigue. This strategy not only supports seamless user experiences but also boosts Gross Merchandise Value (GMV) and revenue through improved system responsiveness.
This presentation is ideal for those involved in managing large-scale data systems or interested in advanced Elasticsearch optimizations.
Leila Vayghan, Shopify
Leila is an engineer at Shopify, where she spends her days enabling millions of merchants to grow by making sure buyers are able to search and find their products. She does this by running a large-scale search infrastructure on Kubernetes in many regions of the world. Leila has completed her master’s degree on the availability of stateful applications running on Kubernetes and has presented her work at many conferences.
author = {Leila Vayghan},
title = {Enhancing Elasticsearch Performance: Innovative Reindexing Strategies Using Dedicated Nodes and {KEDA} Autoscalers},
year = {2024},
address = {Dublin},
publisher = {USENIX Association},
month = oct
}