Detailed Black-Box Monitoring of Distributed Systems

dc.contributor.author Ricardo Pereira Vilaça en
dc.contributor.other 5602 en
dc.date.accessioned 2021-12-17T17:56:00Z
dc.date.available 2021-12-17T17:56:00Z
dc.date.issued 2021 en
dc.description.abstract Modern containerized distributed systems, such as big data storage and processing stacks or micro-service based applications, are inherently hard to monitor and optimize, as resource usage does not directly match hardware resources due to multiple virtualization layers. For instance, inter-application traffic is an important factor in as it directly indicates how components interact, it has not been possible to accurately monitor it in an application independent way and without severe overhead, thus putting it out of reach of cloud platforms. In this paper we present an efficient black-box monitoring approach for gathering detailed structural information of collaborating processes in a distributed system that can be queried for various purposes, as it includes both information about processes, containers, and hosts, as well as resource usage and amount of data exchanged. The key to achieving high detail and low overhead without custom application instrumentation is to use a kernel-aided event driven strategy. We validate a prototype implementation by applying it to multi-platform microservice deployments, evaluate its performance with micro-benchmarks, and demonstrate its usefulness for container placement in a distributed data storage and processing stack (i.e., Cassandra and Spark). en
dc.identifier.uri http://repositorio.inesctec.pt/handle/123456789/12713
dc.identifier.uri http://dx.doi.org/10.1145/3341105.3374007 en
dc.language eng en
dc.title Detailed Black-Box Monitoring of Distributed Systems en
dc.type Publication en
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
P-00V-7Q0.pdf
Size:
1.75 MB
Format:
Adobe Portable Document Format
Description: