The present paper examines the potential of the implementation of theatre directing theories onto the design of human-computer interaction, especially in the case of digital humans, and whether the emergent practices produce differentiated, aesthetically coherent experiences. It also suggests the exploration of dramatic/performative horizons for IVAs.

Additional Keywords and Phrases: human-computer interaction; embodied virtual agents; personified interfaces; posthuman performance; theatre directing theories; multi-linear drama

  • INTRODUCTION

The recent advancements in the fields of artificial intelligence, machine learning, natural language processing and computer graphics have resulted to the design and development of intelligent virtual assistants, known as IVAs, that exhibit numerous humanlike traits. Such traits pertain to personality, physical appearance, gender and other characteristics, typically exhibited by humans  [1], [2].

The systematic approach of the same traits, their aesthetic organization and repeatable exhibitability in a theatre performance, has been the objective of theatre directing theories and acting methods [3]. These aspire at rendering the performer/actor an able, intelligent “machine, producing aesthetically coherent performative results. Hence, theatre directing theories may hold some interesting keys in the designing of interactive experiences with digital humans, situated within the general discourse between Computers and Theatre [4].

  • OVERVIEW & STATE OF THE ART

This paper supplements our Dual Claire experimental project, also exhibited within the framework of CHIGreece 2021, which focuses on the potential of “directing” digital human agents according to theatre directing theories, while shedding light on the differentiated, aesthetically coherent dramatic and performative outcomes, aiming at opening up new horizons for IVAs performance.

Intelligent embodied and disembodied machines may exhibit theatrical and performative elements in their optimal performance as social agents [5]. The role of intelligent technological nonhuman may be expanded in the cocreation of artmaking and coperformance, leading to the emergence of hybrid artistic practices [6]. IVAs have been included in theatre performance, as the are capable of interactive storytelling [7].

The Dual Claire experimental project develops a dialogue with human-robot interaction as theatre [8], [9], [10]; theatre as a research tool for HCI [11], [12]; virtual agents performance [13]; acting methods in IVAs [14].

Stanislavski [15] and Artaud [16] have also received some attention. Stanislavski attracts the focus of Klinger 2005 [17]; Shyba & Tam 2005q [18]; and Postma et al. 2010 [19]; while Artaud has been acknowledged as a source of inspiration for HCI [20].

  • METHODOLOGY

Dual Claire evolves around the adoption of two different theatre directing theories in the development of two interactive experiences with a UneeQ’s digital human, namely Stanislavski’s realistic approach and Artaud’s surrealistic one . An opportunity to comparatively observe the differentiated aethetically coherent outcomes manifesting both on a dramatic (scenario and script) level as well as on a performative, behavioural level of the digital human thus emerges.

Our digital human is an “avant-garde” IVA-performer that showcases how an artistic approach based on theatre directing methodology in designing IVAs may pervade their usual scope and create a differentiated, aesthetically coherent result. The key research questions addressed are “how the implementation of two different theatre directing theories affects the designing of an interactive experience with a digital human within a commercial services context?”; “what are the challenges emerging in terms of directing, acting and script?”; and “does the adoption of certain theatre directing approaches lead to a differentiated, aesthetically coherent digital human performance, manifesting in drama and performance?”.

Τhe UneeQ Digital Humans trial version platform was chosen as the main tool for the experiment after some research as it meets the basic requirements, i.e. real-time human-computer interaction with natural language (spoken & written), machine learning, variety of emotional responses and realistic graphics. Additionally, Google Dialogueflow was used for the design of the dialogues.

Two linear scripts, inspired by the methods of the two widely renowned theatre directors were first conceived and then transformed into multi-linear, following a logic of “multiple improvisational rehearsing”. The central scenario wants Claire, the character of our digital human, to be an assistant at the fictional Kouros lounge bar on the island of Paros. The meaning load delivered in both versions remains almost the same, following different dramaturgical aesthetics in each case. In order for the two versions to be compared more efficiently, the strategy of changing solely the character of the text and the emotes of the digital human has been opted for, with the spectacular aspect being kept identical (space, digital human face, hairstyle e.t.c). The emotional aspect of human-computer interaction was addressed by attributing to the digital human emotes from the range of those offered by UneeQ.

  • CONCLUSION

The initial hypothesis that the adoption of a specific theatre directing theory results to a differentiated, aesthetically coherent digital human performance was verified. Virtual assistants are in position to perform according to a theatre directing theory even within their usual commercial context; such a performance whets our appetite for future more, even artistic, endeavours.  

REFERENCES

  • Jared Newman. 2018. Everything You Need To Know About AI Assistants, From Siri To Ozlo. Retrieved October 17, 2021 from https://www.fastcompany.com/3059719/handicapping-the-aiassistants-from-siri-to-ozlo
  • New Line Technologies Blog. 2018. Voice Assistants as a Trend of 2018. Retrieved October 17, 2021 from http://newline.tech/blog/voice-assistants-as-a-trend-of-2018/
  • Avra Sidiropoulou. 2011. Authoring Performance: The Director in Contemporary Theatre. Palgrave Macmillan US. New York, USA.
  • Brenda Laurel. 1993. Computers as Theatre. Addison-Wesley. Massachusetts, USA.
  • Louise LePage. 2021. The Importance of Realism, Character, and Genre: How Theatre Can Support the Creation of Likeable Sociable Robots. International Journal of Social Robotics 13, 6 (December 2020),1427-1441.
  • Yu Bo, Chen Baoyang & Wang Zhi-ou. 2020. Methodology on Human-robotics Stage Performance and Creation.IFAC-PapersOnLine 53, 5 (2020), 110-115.
  • Ravi Bhushan, Karthik Kulkarni, Vishal Kumar Pandey, Connor Rawls, Brandon Mechtley, Suren Jayasuriya & Christian Ziegler. 2020. ODO: Design of Multimodal Chatbot for an Experiential Media System. Multimodal Technologies and Interaction 4,4 (December 2020), 1-16.
  • Alain Bonardi & Christine Zeppenfeld. 2007. Human Actors and Virtual Agents Playing Together to Transform Stage Direction Practices. In: Pelachaud C., Martin JC., André E., Chollet G., Karpouzis K., Pelé D. (eds) Intelligent Virtual Agents. IVA 2007. Lecture Notes in Computer Science 4722, (2007), 358-359. Springer, Berlin, Heidelberg. Retrieved October 17, 2021 from https://doi.org/10.1007/978-3-540-74997-4_37
  • David Lu, & William Smart. 2011. Human-robot interactions as theatre. Proceedings - IEEE International Workshop on Robot and Human Interactive Communication (September 2011), 473 - 478. Retrieved October 17, 2021 from 10.1109/ROMAN.2011.6005241.
  • Amiy Chatley,  Kerstin Dautenhahn, Michael Walters, Dag Sverre Syrdal & Bruce Christianson. 2010. Theatre as a Discussion Tool in Human-Robot Interaction Experiments - A Pilot Study. Third International Conference on Advances in Computer-Human Interactions (January 2010), 73-78, doi: 10.1109/ACHI.2010.17
  • Giulio Iacucci, Carlo Iacucci & Kari 2002. Imagining and experiencing in design, the role of performances. In Proceedings of the second Nordic conference on Human-computer interaction (NordiCHI '02). Association for Computing Machinery, New York, NY, USA, 167–176. DOI:https://doi.org/10.1145/572020.572040
  • Maggie Morgan & Alan Newell. 2007. Interface between two disciplines - the development of theatre as a research tool. In Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability (HCI'07). Springer-Verlag, Berlin, Heidelberg, 184–193.
  • Gabriella Giannachi, Marco Gillies, Nick Kaye & David Swapp. 2009. Mediating Performance Through Virtual Agents. Retrieved October 17, 2021 from 5773. 10.1007/978-3-642-04380-2_48.
  • Stacy Marsella, Sharon Marie Carnicke, Jonathan Gratch, Anna Okhmatovskaia & Albert Rizzo. 2006. An exploration of delsarte’s structural acting system. In Proceedings of the 6th international conference on Intelligent Virtual Agents (IVA'06). Springer-Verlag, Berlin, Heidelberg, 80–92. Retrieved October 17, 2021 from DOI:https://doi.org/10.1007/11821830_7
  • Constantin Stanislavski. 1961. Creating a role,  H. I. Popper (Ed.). Theatre Arts Books. London, UK; New York, USA.
  • Antonin Artaud. 1970. The theatre and its double, V. Corti (Trans.). Calder and Boyars. London, UK.
  • William J. Klinger. 2005. Stanislavski and computer science. SIGCSE Bull. 37, 4 (December 2005), 111–114. Retrieved October 17, 2021 from DOI:https://doi.org/10.1145/1113847.1113889
  • Lorene Shyba, & James Tam. (2005). Developing character personas and scenarios: vital steps in theatrical performance and HCI goal-directed design. 187-194. Retrieved October 17, 2021 from 10.1145/1056224.1056251.
  • E.Postma, K. Lauche, P.J. Stappers. 2010. Stanislavski’s ‘System’: Applying Activity Theory in
    user-centered design practice. Retrieved October 17, 2021 from https://studiolab.io.tudelft.nl/manila/gems/postma/PostmaPaperFISCAR2010.pdf
  • Miao Song, Serguei A. Mokhov, Peter Grogono & Sudhir P. Mudur. 2015. HCI in performance arts and the case of Illimitable Space System's multimodal interaction and visualization. In SIGGRAPH ASIA 2015 Art Papers (SA '15). Association for Computing Machinery, New York, NY, USA, Article 8, 1–11. Retrieved October 17, 2021 from DOI:https://doi.org/10.1145/2835641.2835649

TOOLS

UneeQ Digital Humans: https://digitalhumans.com/ 

Google Dialogflow: https://cloud.google.com/dialogflow