Generative AI chatbot in PyramidApp: students’ behaviors and design principles

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Gutiérrez-Ferré, Aldric
  • dc.contributor.author Hernández Leo, Davinia
  • dc.contributor.author Sánchez Reina, Jesús Roberto
  • dc.date.accessioned 2024-10-29T07:37:13Z
  • dc.date.available 2024-10-29T07:37:13Z
  • dc.date.embargoEnd info:eu-repo/date/embargoEnd/2025-09-14
  • dc.date.issued 2024
  • dc.description Comunicació presentada a 30th International Conference CollabTech 2024, celebrada a Barcelona del 11 al 14 de setembre de 2024.
  • dc.description.abstract Generative Artificial Intelligence (GenAI) offers new opportunities to implement useful features within Computer Supported Collaborative Learning (CSCL) environments. Despite these growing prospects, there is still limited research concerning the application of GenAI in learning environments. This work in progress aims to evaluate the mediation of a masked GenAI chatbot in the setting of the CSCL web application PyramidApp. A quasi-experimental within-subjects study was designed to assess the effect of GenAI chatbot intervention within the environment of PyramidApp. In the setting of 9 online activities, we evaluated the effect of the GenAI chatbot activity in 105 conversational chat rooms. The findings revealed that the GenAI chatbot provides useful feedback as students rate the chatbot’s answers higher than their peers’ answers (MChatbot = 4.11, MStudents = 3.91). The presence of the chatbot has an effect on group communication with the length of messages increased in chat rooms where the chatbot was present. Moreover, chatbot behavior to rate the students’ answers was correlated with the students’ behavior. The present study offers valuable insights into the optimal strategies for integrating a GenAI Large Language Model into educational tools and computer supported learning.
  • dc.description.sponsorship This work was partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33, CEX2021–001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). The work of D. Hernández-Leo (Serra Hunter) was supported by ICREA under the ICREA Academia program.
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Gutiérrez-Ferré A, Hernández-Leo D, Sánchez-Reina JR. Generative AI chatbot in PyramidApp: students’ behaviors and design principles. In: Santos P, Álvarez C, Hernández-Leo D, Kobayashi M, Zurita G, editors. Collaboration technologies and social computing. 30th International Conference CollabTech 2024; 2024 Sept 11–14; Barcelona, Spain. Cham: Springer; 2024. p. 248-56. DOI: 10.1007/978-3-031-67998-8_19
  • dc.identifier.doi http://dx.doi.org/10.1007/978-3-031-67998-8_19
  • dc.identifier.isbn 9783031679971
  • dc.identifier.uri http://hdl.handle.net/10230/68391
  • dc.language.iso eng
  • dc.publisher Springer
  • dc.relation.ispartof Santos P, Álvarez C, Hernández-Leo D, Kobayashi M, Zurita G, editors. Collaboration technologies and social computing. 30th International Conference CollabTech 2024; 2024 Sept 11–14; Barcelona, Spain. Cham: Springer; 2024. p. 248-56.
  • dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PID2020-112584RB-C33
  • dc.rights © 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.subject.keyword Computer-supported collaborative learning
  • dc.subject.keyword Collaborative learning flow pattern
  • dc.subject.keyword ChatGPT
  • dc.subject.keyword Human-AI collaboration
  • dc.subject.keyword PyramidApp
  • dc.title Generative AI chatbot in PyramidApp: students’ behaviors and design principles
  • dc.type info:eu-repo/semantics/conferenceObject
  • dc.type.version info:eu-repo/semantics/acceptedVersion