A pragmatic approach for identifying and managing design science research goals and evaluation criteria

Abstract : The effectiveness of a Design Science Research (DSR) project is judged both by the fitness of the designed artifact as a solution in the application environment and by the level of new research contributions. An important and understudied challenge is how to translate DSR project research goals into discrete and measurable evaluation criteria for use in the DSR processes. This position paper proposes an inclusive approach for articulating DSR goals and then identifying project evaluation criteria for these goals. The goals are organized hierarchically as utilitarian goals, safety goals, interaction and communication goals, cognitive and aesthetic goals, innovation goals, and evolution goals. Goals in a DSR project are identified pragmatically by considering the components of the context coupled with the hierarchy of goals. Based on the identified goals, the associated evaluation criteria are determined and organized along the same hierarchy. These criteria measure the ability of the artifact to meet its goals in itscontext (immediate fitness). Moreover, our approach also supports the innovation and research contributions of the project. The apex of the goal hierarchy addresses the identification of criteria measuring the fitness for evolution of the designed artifact, to accommodate for changes in goals or context.
Complete list of metadatas

Cited literature [37 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02283783
Contributor : Médiathèque Télécom Sudparis & Institut Mines-Télécom Business School <>
Submitted on : Friday, September 13, 2019 - 3:31:05 PM
Last modification on : Wednesday, February 12, 2020 - 3:02:19 PM
Long-term archiving on: Saturday, February 8, 2020 - 1:22:21 PM

File

645a0358c6eb808dc3fe1ac4bb998f...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02283783, version 1

Citation

Alan Hevner, Nicolas Prat, Isabelle Comyn-Wattiau, Jacky Akoka. A pragmatic approach for identifying and managing design science research goals and evaluation criteria. AIS SIGPrag Pre-ICIS workshop on "Practice-based Design and Innovation of Digital Artifacts", Dec 2018, San Francisco, United States. ⟨hal-02283783⟩

Share

Metrics

Record views

46

Files downloads

68