Design science (methodology)

From HandWiki
Short description: Research methodology

Design science research (DSR) is a research paradigm focusing on the development and validation of prescriptive knowledge in information science. Herbert Simon distinguished the natural sciences, concerned with explaining how things are, from design sciences which are concerned with how things ought to be,[1] that is, with devising artifacts to attain goals.[2][further explanation needed] Design science research methodology (DSRM) refers to the research methodologies associated with this paradigm. It spans the methodologies of several research disciplines, for example information technology, which offers specific guidelines for evaluation and iteration within research projects.

DSR focuses on the development and performance of (designed) artifacts with the explicit intention of improving the functional performance of the artifact. DSRM is typically applied to categories of artifacts including algorithms, human/computer interfaces, design methodologies (including process models) and languages. Its application is most notable in the Engineering and Computer Science disciplines, though is not restricted to these and can be found in many disciplines and fields.[3][4] DSR, or constructive research,[5] in contrast to explanatory science research, has academic research objectives generally of a more pragmatic nature. Research in these disciplines can be seen as a quest for understanding and improving human performance.[6] Such renowned research institutions as the MIT Media Lab, Stanford University's Center for Design Research, Carnegie Mellon University's Software Engineering Institute, Xerox’s PARC, and Brunel University London’s Organisation and System Design Centre, use the DSR approach.[3]

Design science is a valid research methodology to develop solutions for practical engineering problems.[7] Design science is particularly suitable for wicked problems.[8]

Objectives

The main goal of DSR is to develop knowledge that professionals of the discipline in question can use to design solutions for their field problems. Design sciences focus on the process of making choices on what is possible and useful for the creation of possible futures, rather than on what is currently existing.[9] This mission can be compared to the one of the ‘explanatory sciences’, like the natural sciences and sociology, which is to develop knowledge to describe, explain and predict.[6] Hevner states that the main purpose of DSR is achieving knowledge and understanding of a problem domain by building and application of a designed artifact.[10]

Evolution and applications

Since the first days of computer science, computer scientists have been doing DSR without naming it. They have developed new architectures for computers, new programming languages, new compilers, new algorithms, new data and file structures, new data models, new database management systems, and so on. Much of the early research was focused on systems development approaches and methods. The dominant research philosophy in many disciplines has focused on developing cumulative, theory-based research results in order to make prescriptions. It seems that this ‘theory-with-practical-implications’ research strategy has not delivered on this aim, which led to search for practical research methods such as DSR.[11]

Characteristics

The design process is a sequence of expert activities that produces an innovative product.[12] The artifact enables the researcher to get a better grasp of the problem; the re-evaluation of the problem improves the quality of the design process and so on. This build-and-evaluate loop is typically iterated a number of times before the final design artifact is generated.[13] In DSR, the focus is on the so-called field-tested and grounded technological rule as a possible product of Mode 2 research with the potential to improve the relevance of academic research in management. Mode 1 knowledge production is purely academic and mono-disciplinary, while Mode 2 is multidisciplinary and aims at solving complex and relevant field problems.[6]

Guidelines in information systems research

Hevner et al. have presented a set of guidelines for DSR within the discipline of Information Systems (IS).[10] DSR requires the creation of an innovative, purposeful artifact for a special problem domain. The artifact must be evaluated in order to ensure its utility for the specified problem. In order to form a novel research contribution, the artifact must either solve a problem that has not yet been solved, or provide a more effective solution. Both the construction and evaluation of the artifact must be done rigorously, and the results of the research presented effectively both to technology-oriented and management-oriented audiences.

Hevner counts 7 guidelines for a DSR:[10]

  1. Design as an artifact: Design-science research must produce a viable artifact in the form of a construct, a model, a method, or an instantiation.
  2. Problem relevance: The objective of design-science research is to develop technology-based solutions to important and relevant business problems.
  3. Design evaluation: The utility, quality, and efficacy of a design artifact must be rigorously demonstrated via well-executed evaluation methods.
  4. Research contributions: Effective design-science research must provide clear and verifiable contributions in the areas of the design artifact, design foundations, and/or design methodologies.
  5. Research rigor: Design-science research relies upon the application of rigorous methods in both the construction and evaluation of the design artifact.
  6. Design as a search process: The search for an effective artifact requires utilizing available means to reach desired ends while satisfying laws in the problem environment.
  7. Communication of research: Design-science research must be presented effectively both to technology-oriented as well as management-oriented audiences.

Transparency in DSR is becoming an emerging concern. DSR strives to be practical and relevant. Yet few researchers have examined the extent to which practitioners can meaningfully utilize theoretical knowledge produced by DSR in solving concrete real-world problems. There is a potential gulf between theoretical propositions and concrete issues faced in practice—a challenge known as design theory indeterminacy. Guidelines for addressing this challenges are provided in Lukyanenko et al. 2020.[14]

The engineering cycle and the design cycle

The engineering cycle is a framework used in Design Science for Information Systems and Software Engineering, proposed by Roel Wieringa.[15]

Artifacts

Artifacts within DSR are perceived to be knowledge containing. This knowledge ranges from the design logic, construction methods and tool to assumptions about the context in which the artifact is intended to function (Gregor, 2002).

The creation and evaluation of artifacts thus forms an important part in the DSR process which was described by Hevner et al., (2004) and supported by March and Storey (2008) as revolving around “build and evaluate”.

DSR artifacts can broadly include: models, methods, constructs, instantiations and design theories (March & Smith, 1995; Gregor 2002; March & Storey, 2008, Gregor and Hevner 2013), social innovations, new or previously unknown properties of technical/social/informational resources (March, Storey, 2008), new explanatory theories, new design and developments models and implementation processes or methods (Ellis & Levy 2010).

A three-cycle view

DSR can be seen as an embodiment of three closely related cycles of activities.[16] The relevance cycle initiates DSR with an application context that not only provides the requirements for the research as inputs but also defines acceptance criteria for the ultimate evaluation of the research results. The rigor cycle provides past knowledge to the research project to ensure its innovation. It is incumbent upon the researchers to thoroughly research and reference the knowledge base in order to guarantee that the designs produced are research contributions and not routine designs based upon the application of well-known processes. The central design cycle iterates between the core activities of building and evaluating the design artifacts and processes of the research.

Ethical issues

DSR in itself implies an ethical change from describing and explaining of the existing world to shaping it. One can question the values of information system research, i.e., whose values and what values dominate it, emphasizing that research may openly or latently serve the interests of particular dominant groups. The interests served may be those of the host organization as perceived by its top management, those of information system users, those of information system professionals or potentially those of other stakeholder groups in society.[11]

Academic Examples of Design Science Research

There are limited references to examples of DSR, but Adams has completed two PhD research topics using Peffers et al.'s DSRP (both associated with digital forensics but from different perspectives):

2013: The Advanced Data Acquisition Model (ADAM): A process model for digital forensic practice [17]

2024: The Advanced Framework for Evaluating Remote Agents (AFERA): A Framework for Digital Forensic Practitioners [18]

See also

References

  1. Kessler, EH (2013) (in en). Encyclopedia of management theory. Thousand Oaks, Calif.: SAGE. p. 2. ISBN 9781412997829. 
  2. Simon, Herbert A. (1988). "The Science of Design: Creating the Artificial". Design Issues 4 (1/2): 67–82 [69]. doi:10.2307/1511391. ISSN 0747-9360. https://www.jstor.org/stable/1511391. 
  3. 3.0 3.1 Vaishnavi, V., Kuechler, W. (2004/21). “Design Science Research in Information Systems” January 20, 2004 (updated in 2017 and 2019 by Vaishnavi, V. and Stacey, P.; last updated November 24, 2021. URL: http://desrist.org/design-research-in-information-systems
  4. "On theory development in design science research: Anatomy of a research project". European Journal of Information Systems 17 (5): 489–504. 2008. doi:10.1057/ejis.2008.40. 
  5. Dresch, Aline; Lacerda, Daniel Pacheco; Valle, José Antônio Jr. Antunes (2015) (in en-gb). Design Science Research: A Method for Science and Technology Advancement. Cham: Springer. pp. i. doi:10.1007/978-3-319-07374-3. ISBN 978-3-319-07373-6. 
  6. 6.0 6.1 6.2 Van Aken JE (2005). "Management research as a design science: Articulating the research products of mode 2 knowledge production in management". British Journal of Management 16 (1): 19–36. doi:10.1111/j.1467-8551.2005.00437.x. 
  7. Peffers, Ken; Tuunanen, Tuure; Rothenberger, Marcus A.; Chatterjee, Samir (2007-12-01). "A Design Science Research Methodology for Information Systems Research". Journal of Management Information Systems 24 (3): 45–77. doi:10.2753/MIS0742-1222240302. ISSN 0742-1222. https://doi.org/10.2753/MIS0742-1222240302. 
  8. Hevner; March; Park; Ram (2004). "Design Science in Information Systems Research". MIS Quarterly 28 (1): 75. doi:10.2307/25148625. https://www.jstor.org/stable/25148625. 
  9. Simon, H.A. (1969). The sciences of the artificial. MIT Press. 
  10. 10.0 10.1 10.2 Hevner, A. R.; March, S. T.; Park, J. & Ram, S. Design Science in Information Systems Research. MIS Quarterly, 2004, 28, 75-106. URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.103.1725&rep=rep1&type=pdf
  11. 11.0 11.1 Iivari J (2007). "A paradigmatic analysis of information systems as a design science". Scandinavian Journal of Information Systems 19 (2): 39. 
  12. Watts S; Shankaranarayanan G; Even A (2009). "Data quality assessment in context: A cognitive perspective". Decis Support Syst 48 (1): 202–211. doi:10.1016/j.dss.2009.07.012. 
  13. Markus ML; Majchrzak A; Gasser L. "A design theory for systems that support emergent knowledge processes". MIS Quarterly 2002: 179–212. 
  14. HEC Montréal, Canada; Lukyanenko, Roman; Parsons, Jeffrey; Memorial University of Newfoundland, Canada (2020-09-01). "Research Perspectives: Design Theory Indeterminacy: What Is it, How Can it Be Reduced, and Why Did the Polar Bear Drown?". Journal of the Association for Information Systems 21 (5): 1343–1369. doi:10.17705/1jais.00639. https://aisel.aisnet.org/jais/vol21/iss5/1/. 
  15. Wieringa, Roel (2014). Design science methodology for information systems and software engineering. Heidelberg. ISBN 978-3-662-43839-8. OCLC 899248827. https://www.worldcat.org/oclc/899248827. 
  16. Hevner AR (2007). "The three cycle view of design science research". Scandinavian Journal of Information Systems 19 (2): 87. 
  17. https://www.researchgate.net/publication/258224615_The_Advanced_Data_Acquisition_Model_ADAM_A_process_model_for_digital_forensic_practice
  18. https://espace.curtin.edu.au/bitstream/handle/20.500.11937/93974/Adams%20RB%202023%20Public.pdf?sequence=1&isAllowed=y

Research examples

Further reading

  • March, S. T., Smith, G. F., (1995). Design and natural science research on information technology. Decision Support Systems, 15(4), pp. 251–266.
  • March, S. T., Storey, V. C., (2008). Design Science in the Information Systems Discipline: An introduction to the special issue on design science research, MIS Quarterly, Vol. 32(4), pp. 725–730.
  • "On the Use of Experiments in Design Science Research: A Proposition of an Evaluation Framework". Communications of the AIS 34 (1): 223–240. 2014. http://aisel.aisnet.org/cais/vol34/iss1/10. 
  • Opdenakker, Raymond en Carin Cuijpers (2019),’Effective Virtual Project Teams: A Design Science Approach to Building a Strategic Momentum’, Springer Verlag.
  • Van Aken, J. E. (2004). Management Research Based on the Paradigm of the Design Sciences: The Quest for Field-Tested and Grounded Technological Rules. Journal of Management Studies, 41(2), 219–246.
  • Watts S, Shankaranarayanan G., Even A. Data quality assessment in context: A cognitive perspective. Decis Support Syst. 2009;48(1):202-211.

External links