How novice analysts understand supply chain process models: an experimental study of using diagrams and texts

Process models specific to the supply chain domain are an important tool for the analysis of interorganizational interfaces and requirements of information technology (IT) systems supporting supply chain decision-making. The purpose of this study is to examine the effectiveness of supply chain process models for novice analysts in conveying domain semantics compared to alternative textual representations.

A laboratory experiment with graduate students as proxies for novice analysts was conducted. Participants were randomly assigned to either the diagram group, which worked with “thread diagrams” created from the modeling grammar “Supply Chain Operation Reference (SCOR) model”, or the text group, which worked with semantically equivalent textual representations. Domain understanding was measured using cognitively demanding information acquisition for two different domains.

Diagram users were more accurate in identifying product-related information and organizing this information in a graph compared to those using the textual representation. The authors found considerable improvements in domain understanding, and using the diagrams was perceived as easy as using the texts.

The study's findings are unique in providing empirical evidence for supply chain process models being an effective representation for novice analysts. Such evidence is lacking in prior research because of the evaluation methods used, which are limited to scenario, case study and informed argument. This study adds the diagram user's perspective to that literature and provides a rigorous empirical evaluation by contrasting diagrammatic and textual representations.