SpringerLink
Log in

‘Let Us Work Together’– Insights from an Experiment with Conversational Agents on the Relation of Anthropomorphic Design, Dialog Support, and Performance

  • Conference paper
  • First Online:
Innovation Through Information Systems (WI 2021)

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 47))

Included in the following conference series:

  • 2898 Accesses

Abstract

In the human interaction with CAs, research has shown that elements of persuasive system design, such as praise, are perceived differently when compared to traditional graphical interfaces.

In this experimental study, we will extend our knowledge regarding the relation of persuasiveness (namely dialog support), anthropomorphically designed CAs, and task performance. Within a three-conditions-between-subjects design, two instances of the CA are applied within an online experiment with 120 participants. Our results show that anthropomorphically designed CAs increase perceived dialog support and performance but adding persuasive design elements can be counterproductive. Thus, the results are embedded in the discourse of CA design for task support.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 149.79
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 192.59
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Benbasat, I.: HCI research: future challenges and directions. AIS Trans. Hum.-Comput. Interact. 2(2), 16–21 (2010)

    Article  Google Scholar 

  2. Fogg, B.J.: Computers as persuasive social actors. In: Persuasive Technology. Morgan Kaufmann Publishers, San Francisco, USA, pp. 89–120 (2003)

    Google Scholar 

  3. Loock, C.-M., Staake, T., Thiesse, F.: Motivating energy-efficient behavior with green is: an investigation of goal setting and the role of defaults. Manag. Inf. Syst. Q. 37(4), 1313–1332 (2013)

    Article  Google Scholar 

  4. Haque, M.S., Isomursu, M., Kangas, M., Jämsä, T.: Measuring the influence of a persuasive application to promote physical activity. CEUR Workshop Proc. 2089, 43–57 (2018)

    Google Scholar 

  5. Slattery, P., Vidgen, R., Finnegan, P.: Persuasion: an analysis and common frame of reference for is research. Commun. Assoc. Inf. Syst. 46, 30–69 (2020)

    Google Scholar 

  6. Oinas-Kukkonen, H., Harjumaa, M.: A systematic framework for designing and evaluating persuasive systems. In: Oinas-Kukkonen, H., Hasle, P., Harjumaa, M., Segerståhl, K., Øhrstrøm, P. (eds.) PERSUASIVE 2008. LNCS, vol. 5033, pp. 164–176. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-68504-3_15

    Chapter  Google Scholar 

  7. McTear, M., Callejas, Z., Griol, D.: The Conversational Interface: Talking to Smart Devices. Springer Publishing Company, Basel, Switzerland (2016)

    Book  Google Scholar 

  8. Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., Collins, H.: The politeness effect: Pedagogical agents and learning outcomes. Int. J. Hum. Comput. Stud. 66(2), 98–112 (2008)

    Article  Google Scholar 

  9. Reeves, B., Nass, C.: The Media Equation: How People Treat Computers. The Center for the Study of Language and Information Publications, Television and New Media Like Real People and Places (1996)

    Google Scholar 

  10. Oinas-Kukkonen, H., Harjumaa, M.: Persuasive systems design: key issues, process model, and system features. Commun. Assoc. Inf. Syst. 24(1), 96 (2009)

    Google Scholar 

  11. Diederich, S., Lichtenberg, S., Brendel, A.B., Trang, S.: Promoting sustainable mobility beliefs with persuasive and anthropomorphic design: Insights from an experiment with a conversational agent November 2019

    Google Scholar 

  12. Gnewuch, U., Morana, S., Heckmann, C., Maedche, A.: Designing conversational agents for energy feedback. In: Chatterjee, S., Dutta, K., Sundarraj, R.P. (eds.) DESRIST 2018. LNCS, vol. 10844, pp. 18–33. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91800-6_2

    Chapter  Google Scholar 

  13. Koeder, M.J., Tanaka, E., Mitomo, H.: Lootboxes in digital games - a gamble with consumers in need of regulation? An evaluation based on learnings from Japan. In: 22nd Bienn. Conference International Telecommunation Social Beyond boundaries Challenges business, policy Social (2018)

    Google Scholar 

  14. Toscos, T., Faber, A., An, S., Gandhi, M.P.: Chick clique: persuasive technology to motivate teenage girls to exercise. In: CHI 2006 Extended Abstracts on Human factors in Computing Systems, pp. 1873–1878 (2006)

    Google Scholar 

  15. Seeger, A.M., Pfeiffer, J., Heinzl, A.: Designing anthropomorphic conversational agents: development and empirical evaluation of a design framework. In: ICIS, pp. 1–17 (2018)

    Google Scholar 

  16. Nass, C., Steuer, J., Tauber, E.R.: Computers are social actors. In: ACM CHI, p. 204 (1994)

    Google Scholar 

  17. Nass, C., Moon, Y.: Machines and mindlessness: social responses to computers. J. Soc. Issues 56(1), 81–103 (2000)

    Article  Google Scholar 

  18. Langrial, S., Lehto, T., Oinas-Kukkonen, H., Harjumaa, M., Karppinen, P.: Native mobile applications for personal wellbeing: a persuasive systems design evaluation. In: PACIS, pp. 1–16 (2012)

    Google Scholar 

  19. Consolvo, S., Everitt, K., Smith, I., Landay, J.A.: Design requirements for technologies that encourage physical activity. In: Conference on Human Factors in Computing Systems - Proceedings, vol. 1, pp. 457–466 (2006)

    Google Scholar 

  20. Filippou, J., Cheong, C., Cheong, F.: Modelling the impact of study behaviours on academic performance to inform the design of a persuasive system. Inf. Manag. 53(7), 892–903 (2016)

    Article  Google Scholar 

  21. Lichtenberg, S., Brendel, A.B.: Arrr you a pirate ? towards the gamification element ‘ Lootbox , AMCIS (Forthcoming) (2020)

    Google Scholar 

  22. Lichtenberg, S., Lembcke, T., Brenig, M., Brendel, A.B., Trang, S.: Can Gamification lead to Increase Paid Crowdworkers Output ?. In: 15. Internationale Tagung Wirtschaftsinformatik December 2019 (2020)

    Google Scholar 

  23. Lehto, T., Oinas-Kukkonen, H., Drozd, F.: Factors affecting perceived persuasiveness of a behavior change support system. ICIS 3, 1926–1939 (2012)

    Google Scholar 

  24. Diederich, S., Brendel, A.B., Kolbe, L.M.: On conversational agents in information systems research: analyzing the past to guide future work. In: Proceedings Internationa Conference Wirtschaftsinformatik, pp. 1550–1564 (2019)

    Google Scholar 

  25. Oracle, “Can Virtual Experiences Replace Reality? The future role for humans in delivering customer experience, p. 19 (2016)

    Google Scholar 

  26. Wünderlich, N.V., Paluch, S.: A nice and friendly chat with a bot: user perceptions of AI-based service agents. In: ICIS, no. 1, pp. 1–11 (2017)

    Google Scholar 

  27. Stock, R.M., Merkle, M.: Can humanoid service robots perform better than service employees? a comparison of innovative behavior cues (2018)

    Google Scholar 

  28. Feine, J., Gnewuch, U., Morana, S., Maedche, A.: A taxonomy of social cues for conversational agents. Int. J. Hum. Comput. Stud. 132, 161 (2019)

    Google Scholar 

  29. Verhagen, T., van Nes, J., Feldberg, F., van Dolen, W.: Virtual customer service agents: using social presence and personalization to shape online service encounters. J. Comput. Commun. 19(3), 529–545 (2014)

    Google Scholar 

  30. Fogg, B.J., Nass, C.: How users reciprocate to computers. In: ACM CHI, p. 331 (1997)

    Google Scholar 

  31. Gong, L.: How social is social responses to computers? The function of the degree of anthropomorphism in computer representations. Comput. Hum. Behav. 24(4), 1494–1509 (2008)

    Article  Google Scholar 

  32. Gnewuch, U., Morana, S., Adam, M.T.P., Maedche, A.: Faster is not always better: understanding the effect of dynamic response delays in human-chatbot interaction. In: ECIS, pp. 1–17 (2018)

    Google Scholar 

  33. Araujo, T.: Living up to the chatbot hype: The influence of anthropomorphic design cues and communicative agency framing on conversational agent and company perceptions. Comput. Hum. Behav. 85, 183–189 (2018)

    Article  Google Scholar 

  34. Hanus, M.D., Fox, J.: Persuasive avatars: The effects of customizing a virtual salespersons appearance on brand liking and purchase intentions. Int. J. Hum. Comput. Stud. 84, 33–40 (2015)

    Article  Google Scholar 

  35. Sebastian, J., Richards, D.: Changing stigmatizing attitudes to mental health via education and contact with embodied conversational agents. Comput. Hum. Behav. 73, 479–488 (2017)

    Article  Google Scholar 

  36. Sah, Y.J., Peng, W.: Effects of visual and linguistic anthropomorphic cues on social perception, self-awareness, and information disclosure in a health website. Comput. Hum. Behav. 45, 392–401 (2015)

    Article  Google Scholar 

  37. Schuetzler, R.M., Giboney, J.S., Grimes, G.M., Nunamaker, J.F.: The influence of conversational agents on socially desirable responding. HICSS 9, 283–292 (2018)

    Google Scholar 

  38. Ekman, P., Friesen, W.V.: The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica 1(1), 49–98 (1969)

    Article  Google Scholar 

  39. Mayer, R.E., Johnson, W.L., Shaw, E., Sandhu, S.: Constructing computer-based tutors that are socially sensitive: politeness in educational software. Int. J. Hum. Comput. Stud. 64(1), 36–42 (2006)

    Article  Google Scholar 

  40. Shevchuk, N., Oinas-Kukkonen, H.: Exploring green information systems and technologies as persuasive systems: a systematic review of applications in published research. In: ICIS, pp. 1–11 (2016)

    Google Scholar 

  41. El Kamali, M., Angelini, L., Caon, M., Andreoni, G., Khaled, O.A., Mugellini, E.: Towards the Nestore e-Coach: A tangible and embodied conversational agent for older adults, in UbiComp/ISWC 2018, pp. 1656–1663 (2018)

    Google Scholar 

  42. Hamari, J.: Transforming homo economicus into homo ludens: a field experiment on gamification in a utilitarian peer-to-peer trading service. Electron. Commer. Res. Appl. 12(4), 236–245 (2013)

    Article  Google Scholar 

  43. Xu, K., Lombard, M.: Persuasive computing: feeling peer pressure from multiple computer agents. Comput. Hum. Behav. 74, 152–162 (2017)

    Google Scholar 

  44. Harjunen, V.J., Spapé, M., Ahmed, I., Jacucci, G., Ravaja, N.: Persuaded by the machine: the effect of virtual nonverbal cues and individual differences on compliance in economic bargaining. Comput. Hum. Behav. 87, 384–394 (Oct. 2018)

    Article  Google Scholar 

  45. Adler, R.F., Iacobelli, F., Gutstein, Y.: Are you convinced? a wizard of oz study to test emotional vs. rational persuasion strategies in dialogues. Comput. Hum. Behav. 57, 75–81 (2016)

    Article  Google Scholar 

  46. Boudreau, M.C., Gefen, D., Straub, D.W.: Validation in information systems research: a state-of-the-art assessment. MIS Q. Manage. Inf. Syst. 25(1), 1–16 (2001)

    Article  Google Scholar 

  47. Erdfelder, E., FAul, F., Buchner, A., Lang, A.G.: Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav. Res. Meth. 41(4), 1149–1160 (2009). https://doi.org/10.3758/BRM.41.4.1149

  48. Lezzi, E., Fleming, P., Zizzo, D.J.: Does it matter which effort task you use? a comparison of four effort tasks when agents compete for a prize. SSRN Electron. J. (2015)

    Google Scholar 

  49. Dennis, A.R., Valacich, J.S.: Conducting experimental research in information systems. Commun. Assoc. Inf. Syst. 7(5), 1–41 (2001)

    Google Scholar 

  50. Bagozzi, R.P., Yi, Y.: On the use of structural equation models in experimental designs. J. Mark. Res. 26(3), 271 (1989)

    Article  Google Scholar 

  51. Fombelle, P.W., Bone, S.A., Lemon, K.N.: Responding to the 98%: face-enhancing strategies for dealing with rejected customer ideas. J. Acad. Mark. Sci. 44(6), 685–706 (2015). https://doi.org/10.1007/s11747-015-0469-y

    Article  Google Scholar 

  52. Trenz, M., Veit, D., Tan, C.-W.: Disentangling the impact of omnichannel integration on consumer behavior in integrated sales channels. Manag. Inf. Syst. Q. 44(3) (2020)

    Google Scholar 

  53. Clark, L., et al.: What makes a good conversation? Challenges in designing truly conversational agents. In: Conference on Human Factors in Computing Systems - Proceedings, vol. 12 (2019)

    Google Scholar 

  54. Puca, R.M., Schmalt, H.D.: Task enjoyment: a mediator between achievement motives and performance. Motiv. Emot. 23(1), 15–29 (1999)

    Article  Google Scholar 

  55. Wrzesniewski, A., Dutton, J.E., Debebe, G.: Interpersonal sensemaking.pdf. Res. Organ. Behav. 25, 93–135 (2003)

    Google Scholar 

  56. Bussell, H., Forbes, D.: Understanding the volunteer market: the what, where, who and why of volunteering. Int. J. Nonprofit Volunt. Sect. Mark. 7(3), 244–257 (2002)

    Article  Google Scholar 

  57. Agarwal, R., Sinha, A.P., Tanniru, M.: Cognitive fit in requirements modeling: a study of object and process methodologies. J. Manag. Inf. Syst. 13(2), 137–162 (1996)

    Article  Google Scholar 

  58. Durward, D., Blohm, I., Leimeister, J.M.: The nature of crowd work and its effects on individuals’ work perception. J. Manag. Inf. Syst. 37(1), 66–95 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Jonas Gehrke and Jessica Lühnen for their support during this research project.

Author information

Authors and Affiliations

  1. Chair of Information Management, Georg-August-Universität Göttingen, Goettingen, Germany

    Sascha Lichtenberg, Johannes Bührke, Simon Trang & Stephan Diederich

  2. Chair of Business Informatics, Esp. Intelligent Systems and Services, Technische Universität Dresden, Dresden, Germany

    Alfred Benedikt Brendel

  3. Chair of Digital Transformation and Information System, Universität Des Saarlandes, Saarbrücken, Germany

    Stefan Morana

Authors
  1. Sascha Lichtenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Johannes Bührke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alfred Benedikt Brendel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Simon Trang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stephan Diederich
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stefan Morana
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sascha Lichtenberg .

Editor information

Editors and Affiliations

  1. Faculty of Business Administration and Economics, University of Duisburg-Essen, Essen, Germany

    Frederik Ahlemann

  2. Faculty of Business Administration and Economics, University of Duisburg-Essen, Essen, Germany

    Reinhard Schütte

  3. Department of Computer Science and Applied Cognitive Science, University of Duisburg-Essen, Duisburg, Germany

    Stefan Stieglitz

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lichtenberg, S., Bührke, J., Brendel, A.B., Trang, S., Diederich, S., Morana, S. (2021). ‘Let Us Work Together’– Insights from an Experiment with Conversational Agents on the Relation of Anthropomorphic Design, Dialog Support, and Performance. In: Ahlemann, F., Schütte, R., Stieglitz, S. (eds) Innovation Through Information Systems. WI 2021. Lecture Notes in Information Systems and Organisation, vol 47. Springer, Cham. https://doi.org/10.1007/978-3-030-86797-3_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86797-3_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86796-6

  • Online ISBN: 978-3-030-86797-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation