Horus: Non-Intrusive Causal Analysis of Distributed Systems Logs

dc.contributor.author Machado,N en
dc.contributor.other 6125 en
dc.date.accessioned 2021-12-17T17:55:58Z
dc.date.available 2021-12-17T17:55:58Z
dc.date.issued 2021 en
dc.description.abstract Logs are still the primary resource for debugging distributed systems executions. Complexity and heterogeneity of modern distributed systems, however, make log analysis extremely challenging. First, due to the sheer amount of messages, in which the execution paths of distinct system components appear interleaved. Second, due to unsynchronized physical clocks, simply ordering the log messages by timestamp does not suffice to obtain a causal trace of the execution. To address these issues, we present Horus, a system that enables the refinement of distributed system logs in a causally-consistent and scalable fashion. Horus leverages kernel-level probing to capture events for tracking causality between application-level logs from multiple sources. The events are then encoded as a directed acyclic graph and stored in a graph database, thus allowing the use of rich query languages to reason about runtime behavior. Our case study with TrainTicket, a ticket booking application with 40 microservices, shows that Horus surpasses current widely-adopted log analysis systems in pinpointing the root cause of anomalies in distributed executions. Also, we show that Horus builds a causally-consistent log of a distributed execution with much higher performance (up to 3 orders of magnitude) and scalability than prior state-of-the-art solutions. Finally, we show that Horus' approach to query causality is up to 30 times faster than graph database built-in traversal algorithms. en
dc.identifier.uri http://repositorio.inesctec.pt/handle/123456789/12712
dc.identifier.uri http://dx.doi.org/10.1109/dsn48987.2021.00035 en
dc.language eng en
dc.title Horus: Non-Intrusive Causal Analysis of Distributed Systems Logs en
dc.type Publication en
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
398.44 KB
Adobe Portable Document Format