Automated engineering of domain-specific metamorphic testing environments

dc.contributor.authorGómez-Abajo, Pablo
dc.contributor.authorCerro Cañizares, Pablo
dc.contributor.authorNúñez Covarrubias, Alberto
dc.contributor.authorGuerra, Esther
dc.contributor.authorde Lara, Juan
dc.date.accessioned2024-07-04T16:47:10Z
dc.date.available2024-07-04T16:47:10Z
dc.date.issued2023-02-02
dc.description.abstractContext: Testing is essential to improve the correctness of software systems. Metamorphic testing (MT) is an approach especially suited when the system under test lacks oracles, or they are expensive to compute. However, building an MT environment for a particular domain (e.g., cloud simulation, model transformation, machine learning) requires substantial effort. Objective: Our goal is to facilitate the construction of MT environments for specific domains. Method: We propose a model-driven engineering approach to automate the construction of MT environments. Starting from a meta-model capturing the domain concepts, and a description of the domain execution environment, our approach produces an MT environment featuring comprehensive support for the MT process. This includes the definition of domain-specific metamorphic relations, their evaluation, detailed reporting of the testing results, and the automated search-based generation of follow-up test cases. Results: Our method is supported by an extensible platform for Eclipse, called Gotten. We demonstrate its effectiveness by creating an MT environment for simulation-based testing of data centres and comparing with existing tools; its suitability to conduct MT processes by replicating previous experiments; and its generality by building another MT environment for video streaming APIs. Conclusion: Gotten is the first platform targeted at reducing the development effort of domain-specific MT environments. The environments created with Gotten facilitate the specification of metamorphic relations, their evaluation, and the generation of new test cases.
dc.description.departmentDepto. de Sistemas Informáticos y Computación
dc.description.facultyFac. de Informática
dc.description.refereedTRUE
dc.description.sponsorshipMadrid Government (Comunidad de Madrid-Spain) under the Multiannual Agreement with the Complutense University as part of the Program to Stimulate Research for Young Doctors in the context of the V PRICIT (Regional Programme of Research and Technological Innovation) under grant PR65/19-22452
dc.description.sponsorshipProyecto del Ministerio de Ciencia con referencia PID2021-122270OB-I00
dc.description.sponsorshipProyectos de la Comunidad de Madrid con referencias P2018/TCS-4314 y S2018/TCS-4339
dc.description.statuspub
dc.identifier.doi10.1016/j.infsof.2023.107164
dc.identifier.officialurlhttps://www.sciencedirect.com/science/article/pii/S0950584923000186?via%3Dihub
dc.identifier.urihttps://hdl.handle.net/20.500.14352/105658
dc.journal.titleInformation and Software Technology
dc.language.isoeng
dc.page.initial107164
dc.publisherElsevier
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 Internationalen
dc.rights.accessRightsopen access
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject.keywordMetamorphic testing
dc.subject.keywordModel-driven engineering
dc.subject.keywordDomain-specific languages
dc.subject.keywordCloud computing
dc.subject.keywordSimulation
dc.subject.ucmSoftware
dc.subject.unesco3304.99 Otras
dc.titleAutomated engineering of domain-specific metamorphic testing environments
dc.typejournal article
dc.type.hasVersionVoR
dc.volume.number157
dspace.entity.typePublication
relation.isAuthorOfPublicationfbd86834-ee36-422f-b303-b72800b228f1
relation.isAuthorOfPublication739c7331-24ad-41a6-8f5b-873485fa4501
relation.isAuthorOfPublication.latestForDiscoveryfbd86834-ee36-422f-b303-b72800b228f1
Download
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
ist_anunez.pdf
Size:
2.08 MB
Format:
Adobe Portable Document Format
Collections