User interfaces utilizing multiple modalities or even multisensory feedback are more common, creating the need for evaluation techniques that can take multiple quality dimensions under consideration. This paper demonstrates how the trained panel method can support the design and evaluation of physical or complex technological artefacts by mapping out design spaces based on their descriptive attributes. It is an expert-based method, and the goal is to derive with a comprehensive description of a sample of existing artefacts or prototypes. The method entails a training as well as multiple feedback sessions to ensure consensus among panel participants. We are providing a description of the advantages and limitations of the method by presenting how it was applied to identify salient attributes that are important in the design or evaluation of smartwatches. Apart from the specific case described in detail, we are also discussing how and in what context the trained panel method can provide value in HCI research and practice.
List of Papers
Connecting the Community