Operating Elasticsearch with Ease at Scale

Search is ubiquitous! From booking a cab in a ride sharing platform to searching for a job on LinkedIn, Elasticsearch has emerged as a prominent solution for search and has been increasingly adopted for Log analytics and Application Performance monitoring.

In this talk, we would focus on how SRE Partners can leverage Elasticsearch to turn data into actionable insights by helping them to find a needle in a haystack. While Elasticsearch's out of the box defaults works for smaller implementations, the nuances of handling a massive elastic deployment which can scale to serve billions of ingests and millions of searches per day requires a deeper knowledge on Elasticsearch internals.

At PayPal, we have been proficient in managing elastic at this scale and we will share our learnings from our past crunching experiences with specific interesting details around how things can go wrong and effective ways to mitigate them along with demos.

In a gist we will have the following sections:

• Elasticsearch overview
• You are not alone! (We will discuss about the common issues that we could face with elastic)
• Making elastic truly elastic...(We will cover the following sections w.r.t to ingests, searches and monitoring)
• Handling the dark queries
• Policing the police
• Do more with less
• Elasticsearch in Action! (Demo)