Development and Empirical Study of a Multimodal Educational Agent System in Metaverse for Engineering Education Digital Transformation
Abstract
Against the backdrop of digital transformation in higher education, engineering education faces critical challenges including the theory-practice divide and high barriers to technical tool adoption. This study develops a tripartite framework ("functional deconstruction-process modeling-data governance") for educational agent systems, which is built upon the Coze platform and rigorously aligned with the standards of China's Emerging Engineering Education (3E) initiative—for deployment in metaverse learning environments. By implementing multimodal interaction and adaptive decision-making mechanisms via three agent roles (teaching assistant/learning companion/management agent), we construct an immersive learning ecosystem and establish a context-aware paradigm for intelligent interactive education tailored to Chinese engineering education contexts. This research pioneers an innovative approach to cultivating engineering talent for the AI era through transformative learning methodologies.
Keywords:
Educational agent; Metaverse; Engineering education; Educational digitalizationCopyright Notice & License:
All articles published in the Journal of Engineering Systems and Applications (JESA) are licensed under the Creative Commons Attribution–NonCommercial 4.0 International License (CC BY-NC 4.0).
Under this license:
-
Attribution — Users must give appropriate credit to the author(s), provide a link to the license, and indicate if any changes were made.
-
Non-Commercial Use — The work may not be used for commercial purposes without explicit written permission from the copyright holder.
-
Adaptations Allowed — Users may remix, transform, or build upon the material for non-commercial purposes, as long as proper attribution is maintained.
-
No Additional Restrictions — Users may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
-
Third-Party Material — Any third-party material included in the article is subject to the copyright terms of its respective owner, unless otherwise indicated.
Full license text: https://creativecommons.org/licenses/by-nc/4.0/

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
Chao Zhang, Arnaud Polette, Romain Pinquié, Mirai Iida, Henri De Charnace & Jean Philippe Pernot. (2025). Reinforcement learning-based parametric CAD models reconstruction from 2D orthographic drawings. Computer-Aided Design, 188, 103925-103925.
Luran Xing, Zhengping Li & Lijun Wang. (2025). Applications and Future Trends of Agents in the Metaverse. SID Symposium Digest of Technical Papers, 56 (S1), 951-954.
Xiaoqin Tang, Li Jiang, Guoli Liu & Hongxia Li. (2025). The interaction effect of pedagogical agent and emotional feedback on effective learning: a 2 × 2 factorial experiment in online formative assessment. Frontiers in Psychology, 16, 1610550-1610550.
Yanlin Wang, Wanjun Zhong, Yanxian Huang, Ensheng Shi, Min Yang, Jiachi Chen... & Zibin Zheng. (2025). Agents in software engineering: survey, landscape, and vision. Automated Software Engineering, 32 (2), 70-70.
Malak Sadek, Rafael A. Calvo & Céline Mougenot. (2025). The Value-Sensitive Conversational Agent Co-Design Framework. International Journal of Human–Computer Interaction, 41 (15), 9533-9564.
Liao Hu, Qiteng Wu & Ruoyu Qi. (2025). Empowering smart app development with SolidGPT: an edge–cloud hybrid AI agent framework. Advances in Engineering Innovation, 16 (7), 119-125.
Yingying Pan, Jingyang Zhang, Jiahui Yu & Zhehao Pan. (2025). Modeling primary school students’ behavioral intention to use GenAI-augmented pedagogical agents: a hybrid SEM-ANN method. Education and Information Technologies, (prepublish), 1-20.
Wanqing Hu, Rushi Gong, Sisi Wu & Yanyan Li. (2025). A conversational agent based on contingent teaching model to support collaborative learning activities: impacts on students’ learning performance, self-efficacy and perceptions. Educational technology research and development, (prepublish), 1-32.
Lucía Güitta López, Lionel Güitta López, Jaime Boal & Álvaro J. López López. (2025). Sim-to-real transfer via a Style-Identified Cycle Consistent Generative Adversarial Network: Zero-shot deployment on robotic manipulators through visual domain adaptation. Engineering Applications of Artificial Intelligence, 159 (PA), 111510-111510.
Julie Schell, Kasey Ford & Arthur B. Markman. (2025). Building responsible AI chatbot platforms in higher education: an evidence-based framework from design to implementation. Frontiers in Education, 10, 1604934-1604934.
