Ph.D. Thesis

My cumulative, publication-based doctoral thesis revolved around the leitmotif of Good-enough Requirements Engineering. The official version is openly accessible on DiVA and can be downloaded here.

Abstract

Background: High-quality requirements are considered crucial for successful software development endeavors as the requirements' purpose is to inform subsequent activities like implementation or testing. Requirements quality defects have been shown to incur significant costs for remediation, scaling up even to project failure. At the same time, the effort to improve the quality of requirements must be justified. Organizations developing software, therefore, need to understand when their requirements artifacts are of ``good enough'' quality, i.e., they need to be able to identify the optimum between over- and under-engineering.

Problem: The body of knowledge in requirements quality does not yet offer solutions that would allow organizations to identify that optimum due to three shortcomings: (1) there is no generally accepted, theoretical foundation to describe requirements quality that can serve as a basis to coordinate distributed research efforts and the synthesis of evidence in the field, (2) the scientific practice currently applied in the field is of limited rigor to draw reliable conclusions from existing empirical contributions, and (3) the field lacks empirical evidence that can be aggregated to form a holistic view of requirements quality. These are potential causes for the lack of adoption of requirements quality research in practice.

Goal: In this cumulative, publication-based thesis, we address these three shortcomings and aim to contribute to a more evidence-based approach to requirements quality research grounded in scientific theory.

Method: First, we develop a theoretical foundation by adopting and integrating existing software engineering theories. Second, we evaluate the state of the art of data analysis and open science in the field and provide guidelines to improve these practices. Third, we demonstrate the application of these guidelines and conduct a controlled experiment to contribute additional empirical evidence to the field.

Results: The resulting set of analytical theories specifies requirements quality and provides a structure for future empirical contributions. Our evaluation of the state of the art shows both the need for a common theoretical foundation as well as support for applying rigorous research practices. Our empirical studies contribute to these needs and illustrate the complexity of the impact that requirements quality defects have on subsequent activities. Finally, we develop a method for the effective aggregation of empirical results.

Conclusion: Our theoretical, methodological, and empirical contributions help to coordinate a productive and constructive research agenda on requirements quality that is based on evidence and grounded in theory. This allows for rigorous and practically relevant research that ultimately informs organizations on how to engineer good-enough requirements.

Keywords: Requirements Engineering, Requirements Artifacts, Requirements Quality

Chapters

This section lists all contributions that compose my thesis. With the exception of the first chapter (the introduction), each chapter consists of a scientific manuscript submitted for publication at a peer-reviewed venue. The following graph shows how the contributions (i.e., chapters, on the right) are motivated by goals (in the middle) which we derived from identified gaps (on the left).

The full thesis document will be made available here soon.

Chapter 1: Introduction

Julian Frattini

Download PDF

Part I: Theory

Chapter 2: Requirements quality research: a harmonized theory, evaluation, and roadmap

Julian Frattini, Lloyd Montgomery, Jannik Fischbach, Daniel Mendez, Davide Fucci, Michael Unterkalmsteiner

Requirements Engineering Journal (2023), DOI: 10.1007/s00766-023-00405-y

Chapter 3: A live extensible ontology of quality factors for textual requirements

Julian Frattini, Lloyd Montgomery, Jannik Fischbach, Michael Unterkalmsteiner, Daniel Mendez, Davide Fucci

Requirements Engineering Conference (2022), DOI: 10.1109/RE54965.2022.00041

Chapter 4: Measuring the Fitness-for-Purpose of Requirements: An initial Model of Activities and Attribute

Julian Frattini, Jannik Fischbach, Davide Fucci, Michael Unterkalmsteiner, Daniel Mendez

Requirements Engineering Conference (2024), DOI: 10.1109/RE59067.2024.00047

Part II: Methodology

Chapter 5: Requirements quality research artifacts: Recovery, analysis, and management guideline

Julian Frattini, Lloyd Montgomery, Davide Fucci, Michael Unterkalmsteiner, Daniel Mendez, Jannik Fischbach

Journal of Systems and Software (2024), DOI: 10.1016/j.jss.2024.112120

Chapter 6: A Second Look at the Impact of Passive Voice Requirements on Domain Modeling: Bayesian Reanalysis of an Experiment

Julian Frattini, Davide Fucci, Richard Torkar, Daniel Mendez

International Workshop on Methodological Issues with Empirical Studies in Software Engineering (2024), DOI: 10.1145/3643664.3648211

Chapter 7: Crossover Designs in Software Engineering Experiments: Review of the State of Analysis

Julian Frattini, Davide Fucci, Sira Vegas

International Symposium on Empirical Software Engineering and Measurement (2024), DOI: 10.1145/3674805.3690754

Part III: Application and Transfer

Chapter 8: Applying Bayesian Data Analysis for Causal Inference about Requirements Quality: A Controlled Experiment

Julian Frattini, Davide Fucci, Richard Torkar, Lloyd Montgomery, Michael Unterkalmsteiner, Jannik Fischbach, Daniel Mendez

Empirical Software Engineering (2024), DOI: 10.1007/s10664-024-10582-1

Chapter 9: Replications, Revisions, and Reanalyses: Managing Variance Theories in Software Engineering

Julian Frattini, Jannik Fischbach, Davide Fucci, Michael Unterkalmsteiner, Daniel Mendez

Submitted to Transactions on Software Engineering. Pre-print available at arXiv:2412.12634.

The full list of my publications can be found here. In case of difficulties accessing the publications, please contact me directly.