RT Journal Article
T1 Property-Based Testing for Spark Streaming
A1 Riesco Rodríguez, Adrián
A1 Rodríguez Hortalá, Juan
AB Stream processing has reached the mainstream in the last years, as a new generation of open source distributed stream processing systems, designed for scaling horizontally on commodity hardware, has brought the capability for processing high volume and high velocity data streams to companies of all sizes. In this work we propose a combination of temporal logic and property-based testing (PBT) for dealing with the challenges of testing programs that employ this programming model. We formalize our approach in a discrete time temporal logic for finite words, with some additions to improve the expressiveness of properties, which includes timeouts for temporal operators and a binding operator for letters. In particular we focus on testing Spark Streaming programs written with the Spark API for the functional language Scala, using the PBT library ScalaCheck. For that we add temporal logic operators to a set of new ScalaCheck generators and properties, as part of our testing library sscheck.
PB Cambridge University Press
SN 1471-0684
YR 2019
FD 2019
LK https://hdl.handle.net/20.500.14352/91461
UL https://hdl.handle.net/20.500.14352/91461
LA eng
NO RIESCO A, RODRÍGUEZ-HORTALÁ J. Property-Based Testing for Spark Streaming. Theory and Practice of Logic Programming. 2019;19(4):574-602. doi:10.1017/S1471068419000012
DS Docta Complutense
RD 6 abr 2025