SEQUAL framework

The SEQUAL framework is systems modelling reference model for evaluating the quality of models. The SEQUAL framework, which stands for "semiotic quality framework" is developed by John Krogstie and others since the 1990s.

The SEQUAL framework is a so-called "top-down quality framework", which is based on semiotic theory, such as the works of Charles W. Morris. Building on these theory it "defines several quality aspects based on relationships between a model, a body of knowledge, a domain, a modeling language, and the activities of learning, taking action, and modeling". Its usefulness, according to Mendling et al. (2006), was confirmed in a 2002 experiment by Moody et al.

History

The basic idea behind the SEQUAL framework is, that "conceptual models can be considered as sets of statements in a language, and therefore can be evaluated in semiotic/linguistic terms". A first semiotic framework for evaluating conceptual models was originally proposed by Lindland et al. in the 1994 article "Understanding quality in conceptual modeling". In its initial version, it considered three quality levels:

• syntactic,
• semantic, and
• pragmatic quality

The framework was later extended, and called the SEQUAL framework by Krogstie et al. in the 1995 article "Defining quality aspects for conceptual models". in the 2002 article "Quality of interactive models" Krogstie & Jørgensen extended the initial framework adding more levels of Stamper's semiotic ladder.

SEQUAL framework topics

Modeling is an integral part of many technical fields, including engineering, economics, and software engineering. In this context, a model is a formal representation of an organizational system, such as a business model or a formal description of software in UML.

Model activation

Model activation, according to John Krogstie (2006), is the process by which a model affects reality. Model activation involves actors interpreting the model and to some extent adjusting their behaviour accordingly. This process can be:

• automated, where a software component interprets the model,
• manual, where the model guides the actions of human actors, or
• interactive, where prescribed aspects of the model are automatically interpreted and ambiguous parts are left to the users to resolve.

Sets in the Quality Framework

The Quality Framework works with a set of eight items:

• A: Actors that develop or have to relate to (parts of) the model. Can be persons or tools.
• L: What can be expressed in the modeling language
• M: What is expressed in the model
• D: What can be expressed about the domain (area of interest)
• K: The explicit knowledge of the participating persons
• I: What the persons in the audience interpret the model to say
• T: What relevant tools interpret the model to say
• G: The goals of the modeling

Physical quality

The three main aspects of physical quality are:

• Externalization or the question "Is it possible to externalize knowledge by using the model language?",
• Internalizability about model persistence and availability, and
• Basically or the question "Is the model language able to express the model domain?"

Externalization is presenting the modeller's concept in some model form for others to make sense of it. Other people can have look on it and can discuss. How other people perceives the model is a matter of internalization. After perceiving the model in their own way they can discuss and change their mind accordingly. To make sense others, it is better to have some model language in common. Physical quality refers to the possibility of externalizing models by using model language that should be available and of course in persistence manner to be internalized by audiences.

How available is the model to audience? Availability depends on distributability, especially when members of the audience are geographically dispersed. Then, a model which is an electronically distributable format will be more easily distributed than one which must be printed on paper and sent by ordinary mail or fax. It may also matter exactly what is distributed, e.g. the model in an editable form or merely in an output format.

How persistent is the model, how protected is it against loss or damage? This also includes previous versions of the model, if these are relevant. E.g. for a model on disk, the physical quality will be higher if there is a backup copy, or even higher if this backup is on another disk whose failure is independent of the originals. Similarly, for models on paper, the amount and security of backup copies will be essential.

Empirical quality

To evaluate empirical quality, the model should be well externalized. Main aspects are:

• Ergonomics,
• readability,
• layout, and
• information theory.

Basically empirical quality is about the question "Is the model easily readable?". Empirical quality deals with the variety of elements distinguished, error frequencies when being written or read, coding (shapes of boxes) and ergonomics for Computer-Human Interaction for documentation and modeling-tools. Ergonomics is the study of workplace design and the physical and psychological impact it has on workers. This quality is related to readability and layout. There are different factors that have an important impact on visual emphasis like size, solidity, foreground/background differences, colour (red attracts the eye more than other colours),change(blinking or moving symbols attract attention), position and so on.

For graph aesthetics there may be different consideration(Battista, 1994, Tamassia, 1988) like angles between edges not be too small, minimize the number of bends along edges, minimize the number of crossings between edges, place nodes with high degree in the centre of the drawing, have symmetry of sons in hierarchies, have uniform density of nodes in the drawing, have verticality of hierarchical structures and so on.

Syntactical quality

Syntactic quality is the correspondence between the model M and the language extension L of the language in which the model is written. Three aspects here are:

• Error detection: During a modeling session, some syntactical errors--- syntactic incompleteness --- should be allowed on a temporary basis. For instance, although the DFD language requires that all processes are linked to a flow, it is difficult to draw a process and a flow simultaneously. Syntactical completeness has to be checked upon user's request. So, in contrast to implicit checks where the tool is forcing the user to follow the language syntax, explicit check can only detect and report on existing errors. The user has to make the corrections.
• Error correction: to replace a detected error with a correct statement

Semantic quality

What is expressed in the model? The semantic goals of this framework are:

• Validity; if all the statements in the model are correct and related to the problem. M\D = Ø
• Completeness; if the model contains all relevant and correct statements to solve this problem. D\M = Ø

Perceived semantic quality

Perceived semantic quality is the relation between an actor's interpretation of a model and his/her knowledge of the domain.

• Perceived validity I\K = Ø
• Perceived completeness K\I = Ø

Pragmatic quality

Pragmatic quality is the correspondence between the model and people's interpretation of it. Comprehension is the only pragmatic goal in the framework. It is very important that people that read the model, understand it. No solution is good if no-one understands it. Pragmatic quality relates to the effect the model have on the participants and the world. Four aspects is treated specifically, that:

• the human interpretation of the model is correct relative to what is meant.
• the tool interpretation is correct relative to what is meant to be expressed in the model.
• the participants learn based on the model.
• the domain is changed (preferably in a positive direction relative to the goal of modeling).

Social quality

The goal for the social quality is agreement. Agreement about knowledge, interpretation and model. Agreement is achieved if perceived semantic quality and comprehension are achieved. There is relative agreement and absolute agreement. For the three agreement parts (knowledge, interpretation and model) we can define:

• Relative agreement in the three above agreement types; all Knowledge, Interpretation and Model are consistent.
• Absolute agreement in the three above agreement types; all Knowledge, Interpretation and Model are equal.

Knowledge quality

Degree of internalization of existing organizational reality.

• Knowledge in domain is "complete": D\K = Ø.
• Knowledge in domain is "valid": K\D = Ø.

Activities for improvement:

• Stakeholder identification
• Knowledge source identification
• Research and investigation
• Participant selection
• Participant training
• Problem definition

Language quality

To receive good language quality it is important that:

• The language is appropriate to the domain.
• The language is appropriate to the participants' knowledge of modeling languages
• The language appropriate to express the knowledge of the participants

If the language quality is good, it will improve the participants' interpretation and other technical actors' interpretation. For additional detail, see the quality of modelling languages

Organizational quality

The organizational quality of the model relates to:

• That all statements in the model contribute to fulfilling the goals of modeling, or Organizational goal validity.
• That all the goals of modeling are addressed through the model, or Organizational goal completeness.

Alternative quality framework

An alternative quality framework is the Guidelines of Modeling (GoM) based on general accounting principles. The framework "include the six principles of correctness, clarity, relevance, comparability, economic efficiency, and systematic design". It was operationalized for Event-driven Process Chains and also tested in experiments

Another alternative modelling process quality framework actually based on SEQUAL is the "Quality of Modelling" framework (QoMo). QoMo is still a "preliminary modelling process oriented, based on knowledge state transitions, cost of the activities bringing such transitions about, and a goal structure for activities-for-modelling. Such goals are directly linked to concepts of SEQUAL".

Further reading

• John Krogstie (2012). "Model-Based Development and Evolution of Information Systems: A Quality Approach"
• John Krogstie (2001). "A semiotic approach to quality in requirements specifications"