On the Understandability of Semantic Constraints for Behavioral Software Architecture Compliance: A Controlled Experiment

On the Understandability of Semantic Constraints for Behavioral Software Architecture Compliance: A Controlled Experiment

Abstract

Software architecture compliance is concerned with the alignment of implementation with its desired architecture and detecting potential inconsistencies. The work presented in this paper is specifically concerned with behavioral architecture compliance. That is, the focus is on semantic alignment of implementation and architecture. In particular, this paper evaluates three representative approaches for describing semantic constraints in terms of their understandability, namely natural language descriptions as used in many architecture documentations today, a structured language based on specification patterns that abstract underlying temporal logic formulas, and a structured cause-effect language that is based on Complex Event Processing. We conducted a controlled experiment with 190 participants using a simple randomized design with one alternative per experimental unit. Overall all approaches support a high level of correct understanding, and the statistical inference suggests that all tested approaches are equally well suited for describing semantic constraints for behavioral architecture compliance in terms of understandability. In consequence this indicates that it is possible to benefit from the tested structured languages with underlying formal representations for automated verification without having to suffer from decreased understandability. Vice versa, the results suggest that the use of natural language can be a suitable way to document architecture semantics when reliable automated support for formal verification is of minor importance.

Grafik Top
Authors
  • Czepa, Christoph
  • Tran, Huy
  • Zdun, Uwe
  • Tran, Thanh
  • Weiss, Erhard
  • Ruhsam, Christoph
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Full Paper in Proceedings)
Event Title
IEEE International Conference on Software Architecture (ICSA 2017)
Divisions
Software Architecture
Subjects
Software Engineering
Event Location
Gothenburg, Sweden
Event Type
Conference
Event Dates
3-7 April 2017
Date
April 2017
Export
Grafik Top