sponsors
Twitter
Facebook
LinkedIn
Google+
YouTubeusenix conference policies
Trash Day: Coordinating Garbage Collection in Distributed Systems
Martin Maas, University of California, Berkeley, and Oracle Labs, Cambridge;Tim Harris, Oracle Labs, Cambridge; Krste Asanović and John Kubiatowicz, University of California, Berkeley
Cloud systems such as Hadoop, Spark and Zookeeper are frequently written in Java or other garbage-collected languages. However, GC-induced pauses can have a significant impact on these workloads. Specifically, GC pauses can reduce throughput for batch workloads, and cause high tail-latencies for interactive applications.
In this paper, we show that distributed applications suffer from each node’s language runtime system making GC-related decisions independently. We first demonstrate this problem on two widely-used systems (Apache Spark and Apache Cassandra). We then propose solving this problem using a Holistic Runtime System, a distributed language runtime that collectively manages runtime services across multiple nodes.
We present initial results to demonstrate that this Holistic GC approach is effective both in reducing the impact of GC pauses on a batch workload, and in improving GC-related tail-latencies in an interactive setting.
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
author = {Martin Maas and Tim Harris and Krste Asanovi{\'c} and John Kubiatowicz},
title = {Trash Day: Coordinating Garbage Collection in Distributed Systems},
booktitle = {15th Workshop on Hot Topics in Operating Systems (HotOS XV)},
year = {2015},
address = {Kartause Ittingen, Switzerland},
url = {https://www.usenix.org/conference/hotos15/workshop-program/presentation/maas},
publisher = {USENIX Association},
month = may
}
connect with us