Verified Progress Tracking for Timely Dataflow.
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Standard
Verified Progress Tracking for Timely Dataflow. / Brun, Matthias; Decova, Sára; Lattuada, Andrea; Traytel, Dmitriy.
12th International Conference on Interactive Theorem Proving (ITP 2021). ed. / Liron Cohen; Cezary Kaliszyk. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2021. p. 1-20 10 (Leibniz International Proceedings in Informatics, LIPIcs, Vol. 193).Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Harvard
Interactive Theorem Proving - ITP 2021, Rome / (Virtual Conference), Italy, 29/06/2021. https://doi.org/10.4230/LIPICS.ITP.2021.10
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - Verified Progress Tracking for Timely Dataflow.
AU - Brun, Matthias
AU - Decova, Sára
AU - Lattuada, Andrea
AU - Traytel, Dmitriy
PY - 2021
Y1 - 2021
N2 - Large-scale stream processing systems often follow the dataflow paradigm, which enforces a program structure that exposes a high degree of parallelism. The Timely Dataflow distributed system supports expressive cyclic dataflows for which it offers low-latency data- and pipeline-parallel stream processing. To achieve high expressiveness and performance, Timely Dataflow uses an intricate distributed protocol for tracking the computation’s progress. We modeled the progress tracking protocol as a combination of two independent transition systems in the Isabelle/HOL proof assistant. We specified and verified the safety of the two components and of the combined protocol. To this end, we identified abstract assumptions on dataflow programs that are sufficient for safety and were not previously formalized.
AB - Large-scale stream processing systems often follow the dataflow paradigm, which enforces a program structure that exposes a high degree of parallelism. The Timely Dataflow distributed system supports expressive cyclic dataflows for which it offers low-latency data- and pipeline-parallel stream processing. To achieve high expressiveness and performance, Timely Dataflow uses an intricate distributed protocol for tracking the computation’s progress. We modeled the progress tracking protocol as a combination of two independent transition systems in the Isabelle/HOL proof assistant. We specified and verified the safety of the two components and of the combined protocol. To this end, we identified abstract assumptions on dataflow programs that are sufficient for safety and were not previously formalized.
U2 - 10.4230/LIPICS.ITP.2021.10
DO - 10.4230/LIPICS.ITP.2021.10
M3 - Article in proceedings
SN - {978-3-95977-188-7
T3 - Leibniz International Proceedings in Informatics, LIPIcs
SP - 1
EP - 20
BT - 12th International Conference on Interactive Theorem Proving (ITP 2021)
A2 - Cohen, Liron
A2 - Kaliszyk, Cezary
PB - Schloss Dagstuhl - Leibniz-Zentrum für Informatik
T2 - 12th International Conference on<br/>Interactive Theorem Proving - ITP 2021
Y2 - 29 June 2021 through 1 July 2021
ER -
ID: 282091882