Evaluating user experience in cultural heritage through virtual reality simulations
Submitted: 2024-10-06
|Accepted: 2024-12-24
|Published: 2025-01-31
Copyright (c) 2025 Virtual Archaeology Review
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Downloads
Keywords:
virtual archaeology, virtual reality, virtual museum, emotion evaluation, virtual simulator, immersion
Supporting agencies:
Abstract:
Highlights:
- The proposed analysis develops a virtual reality (VR)simulator for the Museum of India to enhance heritage preservation efforts.
- The Emotion questionnaire validates the impact of virtual museum tours on emotional states, including positive, negative, and boredom, compared to traditional methods.
- Immersive VR significantly enhanced user experience, and the VR-simulator system showed a more effective positive impact and reduced adverse effects compared to the non-VR group.
Abstract:
Cultural heritage currently has a significant social and economic impact on a global scale. This study evaluates user experience in cultural heritage through virtual reality (VR). While previous research has explored the use of digital technologies in museums, there needs to be a greater understanding of VR's effects on user engagement, emotional connection, and knowledge retention within heritage contexts. This study developed a VR-Simulator for the Le-Corbusier Museum, Chandigarh, India, also called VRSLM, and accessed the impact and emotions of participants using the Achievement Emotion Questionnaire (AEQ). VR-Simulator provides participants with an immersive and interactive museum experience using a Mobile-VR headset. The study includes historical analysis, 3D visualization creation, multimedia integration, Unity, VR environment development, and deployment as an IRUSU Play VR app. VRSLM framework was evaluated with 40 participants, divided into two equal groups: VR-Simulator and Non-VR. They were asked to visit the museum using VR and traditional methods. The impact of the VRSLM system was measured by applying a statistical test and comparing it with the non-VR group. The results indicated that the VR-Simulator group had more positive emotions than the non-VR group. The overall mean score of the positive emotion factors was (M=4.2 vs. M=2.6), the negative score was (M=2.0 vs. M=2.5), and the boredom emotion factor scored (M=3.1 vs. M= 2.6), of VR-simulator and non-VR-group-respectively. T-tests and factor analyses were also applied to find out the impact of VR, indicating a significant difference between the groups regarding users' emotions and engagement effects on the participants. The findings suggest that VR simulations significantly improve user engagement and create a more positive impact in immersive environment than traditional methods. These results offer valuable insights for museums, curators, and heritage sites, suggesting that VR can revolutionize heritage experiences by deepening visitor understanding.
VRSLM framework was evaluated with 40 participants, divided into two equal groups: VR-Simulator and Non-VR. They were asked to visit the museum using VR and traditional methods. The impact of the VRSLM system was measured by applying a statistical test and comparing it with the non-VR group. The results indicated that the VR-Simulator group had more positive emotions than the non-VR group. The overall mean score of the positive emotion factors was (M=4.25 vs. M=2.60), the negative score was (M=2.02 vs. M=2.57), and the boredom emotion factor scored (M=3.12 vs. M= 2.68), of VR-Simulator and non-VR-group-respectively. T-tests and factor analyses were also applied to find out the impact of VR, indicating a significant difference between the groups regarding users' emotions and engagement effects on the participants. The findings suggest that VR-Simulator significantly improve user engagement and create a more immersive learning environment than traditional methods. These results offer valuable insights for museums, curators, and heritage sites, suggesting that VR can revolutionize heritage experiences by deepening visitor understanding.
References:
Ali, M. (2024). Fostering cultural heritage awareness through VR serious gaming: A study on promoting Saudi heritage among the younger generation. Journal of Infrastructure, Policy and Development, 8(3), 1–21. https://doi.org/10.24294/jipd.v8i3.3084
Jangra, S., Singh, G., Mantri, A., Angra, S., & Sharma, B. (2023). Interactivity Development Using Unity 3d Software And C #. 2023 14th International Conference on Computing Communication and Networking Technologies (pp. 1–6). Delhi, India: IEEE. https://doi.org/10.1109/ICCCNT56998.2023.10308030
Angra, S., Sharma, B., & Sharma, A. (2022). Analysis of Virtual Reality and Augmented Reality SDK’s and Game Engines: A Comparison. In International Conference on Edge Computing and Applications, ICECAA 2022 Proceedings (pp. 1681–1684). Tamilnadu, India: IEEE. https://doi.org/10.1109/ICECAA55415.2022.9936111
Angra, S., Sharma, B., & Sharma, K. D. (2022). Amalgamation of Virtual Reality, Augmented Reality and Machine Learning: A Review. 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (pp. 2601–2604). Greater Noida, India: IEEE. https://doi.org/10.1109/ICACITE53722.2022.9823716
Argyriou, L., Economou, D., & Bouki, V. (2020). Design methodology for 360° immersive video applications: the case study of a cultural heritage virtual tour. Personal and Ubiquitous Computing, 24(6), 843–859. https://doi.org/10.1007/s00779-020-01373-8
Banfi, F. (2020). HBIM, 3D drawing and virtual reality for archaeological sites and ancient ruins. Virtual Archaeology Review, 11(23), 16–33. https://doi.org/10.4995/var.2020.12416
Banfi, F., Brumana, R., & Stanga, C. (2019). Extended reality and informative models for the architectural heritage: From scan-to-bim process to virtual and augmented reality. Virtual Archaeology Review, 10(21), 14–30. https://doi.org/10.4995/var.2019.11923
Bekele, M. K., Town, C., Pierdicca, R., Frontoni, E., & Malinverni, E. V. A. S. (2018). A Survey of Augmented, Virtual, and Mixed Reality. Journal on Computing and Cultural Heritage, 11(2), 1–36. https://doi.org/10.1145/3145534
Boeykens, S., Santana Quintero, M., Neuckermans, H., Ioannides, M., Addison, A., Georgopoulos, A., & Kalisperis, L. (2008). Improving Architectural Design Analysis using 3D Modeling and Visualization techniques. Proceedings of the 14th International Conference on Virtual Systems and Multimedia (pp. 67–73). Limassol, Cyprus: Archeolingua; Hungary.
Chirico, A., Ferrise, F., Cordella, L., & Gaggioli, A. (2018). Designing awe in virtual reality: An experimental study. Frontiers in Psychology, 8, 2351. https://doi.org/10.3389/fpsyg.2017.02351
Corrales-Serrano, M., Merchán, P., Merchán, M. J., & Pérez, E. (2024). Virtual Reality Applied to Heritage in Higher Education—Validation of a Questionnaire to Evaluate Usability, Learning, and Emotions. Heritage, 7(6), 2792–2810. https://doi.org/10.3390/heritage7060132
Datta, P., Kaur, A., Sassi, N., Gulzar, Y., & Jaziri, W. (2024). An evaluation of intelligent and immersive digital applications in eliciting cognitive states in humans through the utilization of Emotiv Insight. MethodsX, 12(102748), 2215-0161. https://doi.org/10.1016/j.mex.2024.102748
De Luca, V., Barba, M. C., D’Errico, G., Nuzzo, B. L., & De Paolis, L. T. (2023). A user experience analysis for a mobile mixed reality application for cultural heritage. Virtual Reality, 27(4), 2821–2837. https://doi.org/10.1007/s10055-023-00840-w
Egea-Vivancos, A., & Arias-Ferrer, L. (2020). Principles for the design of a history and heritage game based on the evaluation of immersive virtual reality video games. E-Learning and Digital Media, 18(4), 383–402. https://doi.org/10.1177/2042753020980103
Falconer, L., Burden, D., Cleal, R., Hoyte, R., Phelps, P., Slawson, N., Welham, K. (2020). Virtual avebury: Exploring sense of place in a virtual archaeology simulation. Virtual Archaeology Review, 11(23), 50–62. https://doi.org/10.4995/var.2020.12924
Fischer, H., Arnold, M., Philippe, S., Dyrna, J., & Jung, S. (2021). VR-Based Learning and Teaching. a Framework for Implementation of Virtual Reality in Formal Education. 15th International Technology, Education and Development Conference, INTED2021 Proceedings (pp. 3304-3314). Spain: IATED. https://doi.org/10.21125/inted.2021.0694
Gagliardi, E., Bernardini, G., Quagliarini, E., Schumacher, M., & Calvaresi, D. (2023). Characterization and future perspectives of Virtual Reality Evacuation Drills for safe built environments: A Systematic Literature Review. Safety Science, 163(2023),106141. https://doi.org/10.1016/j.ssci.2023.106141
Geronikolakis, E., Pateraki, M., Sylaiou, S., Liarokapis, F., Dimitropoulos, K., Grammalidis, N., & Vassiliadi, M. (2018). Mixed Reality, Gamified Presence, and Storytelling for Virtual Museums. In Encyclopedia of Computer Graphics and Games (pp. 1–13). Los Angeles, USA: Springer Cham. https://doi.org/10.1007/978-3-319-08234-9_249-1
Hammady, R., Ma, M., & Strathearn, C. (2019). User experience design for mixed reality: A case study of HoloLens in museum. International Journal of Technology Marketing, 13(3–4), 354–375. https://doi.org/10.1504/IJTMKT.2019.104600
Iacono, S., Scaramuzzino, M., Martini, L., Panelli, C., Zolezzi, D., Perotti, M., Vercelli, G. V. (2024). Virtual Reality in Cultural Heritage: A Setup for Balzi Rossi Museum. Applied Sciences, 14(9), 3562. https://doi.org/10.3390/app14093562
Innocente, C., Ulrich, L., Moos, S., & Vezzetti, E. (2023). A framework study on the use of immersive XR technologies in the cultural heritage domain. Journal of Cultural Heritage, 62, 268-283. https://doi.org/10.1016/j.culher.2023.06.001
Kennedy, A. A. U., Thacker, I., Nye, B. D., Sinatra, G. M., Swartout, W., & Lindsey, E. (2021). Promoting interest, positive emotions, and knowledge using augmented reality in a museum setting. International Journal of Science Education,11(3), 242–258. https://doi.org/10.1080/21548455.2021.1946619
Lee, H., Jung, T. H., tom Dieck, M. C., & Chung, N. (2020). Experiencing immersive virtual reality in museums. Information and Management, 57(5), 103229. https://doi.org/10.1016/j.im.2019.103229
Li, J., & Lv, C. (2024). Exploring user acceptance of online virtual reality exhibition technologies: A case study of Liangzhu Museum. PLoS ONE, 19(8), 1–25. https://doi.org/10.1371/journal.pone.0308267
Li, P. P., & Chang, P. L. (2017). A study of virtual reality experience value and learning efficiency of museum-using shihsanhang museum as an example. Proceedings of the 2017 IEEE International Conference on Applied System Innovation (pp. 1158–1161). Sapporo, Japan: IEEE. https://doi.org/10.1109/ICASI.2017.7988391
Makransky, G., & Lilleholt, L. (2018). A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Educational Technology Research and Development, 66(5), 1141–1164. https://doi.org/10.1007/s11423-018-9581-2
Morrow, G. S., & Wernke, S. A. (2024). Thinking Through the Tool: Collaborative Archaeological Bodywork in Immersive Virtual Reality. Virtual Archaeology Review, 15(30), 21–34. https://doi.org/10.4995/var.2024.19806
Othman, M. K., Aman, S., Anuar, N. N., & Ahmad, I. (2021). Improving Children’s Cultural Heritage Experience Using Game-based Learning at a Living Museum. Journal on Computing and Cultural Heritage, 14(3), (1-24). https://doi.org/10.1145/3453073
Othman, M. K., Nogoibaeva, A., Leong, L. S., & Barawi, M. H. (2022). Usability evaluation of a virtual reality smartphone app for a living museum. Universal Access in the Information Society, 21(4), 995–1012. https://doi.org/10.1007/s10209-021-00820-4
Paolanti, M., Puggioni, M., Frontoni, E., Giannandrea, L., & Pierdicca, R. (2023). Evaluating Learning Outcomes of Virtual Reality Applications in Education: A Proposal for Digital Cultural Heritage. Journal on Computing and Cultural Heritage, 16(2), 1-25. https://doi.org/10.1145/3593432
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48. https://doi.org/10.1016/j.cedpsych.2010.10.002
Perry, S., Economou, M., Young, H., Roussou, M., & Pujol, L. (2018). Moving beyond the virtual museum: Engaging visitors emotionally. Proceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia (pp. 1–8). Dublin, Ireland: IEEE. https://doi.org/10.1109/VSMM.2017.8346276
Quattrini, R., Pierdicca, R., Paolanti, M., Clini, P., Nespeca, R., & Frontoni, E. (2020). Digital interaction with 3D archaeological artefacts: evaluating user’s behaviours at different representation scales. Digital Applications in Archaeology and Cultural Heritage, 18, e00148. https://doi.org/10.1016/j.daach.2020.e00148
Resta, G., Dicuonzo, F., Karacan, E., & Pastore, D. (2021). The Impact Of Virtual Tours On Museum Exhibitions After The Onset Of Covid-19 Restrictions: Visitor Engagement And Long Term Perspectives. Scires-It, 11(1), 151–166. https://doi.org/10.2423/i22394303v11n1p151
Rodríguez-Lora, J.-A., Rosado, A., & Navas-Carrillo, D. (2021). Le Corbusier’s Urban Planning as a Cultural Legacy. An Approach to the Case of Chandigarh. Designs, 5(3), 44. https://doi.org/10.3390/designs5030044.
Shehade, M., & Stylianou-Lambert, T. (2020). Virtual reality in museums: Exploring the experiences of museum professionals. Applied Sciences, 10(11), 4031. https://doi.org/10.3390/app10114031
Singh, G., & Ahmad, F. (2024). An interactive augmented reality framework to enhance the user experience and operational skills in electronics laboratories. Smart Learning Environments, 11(1), 5. https://doi.org/10.1186/s40561-023-00287-1
Škola, F., Rizvić, S., Cozza, M., Barbieri, L., Bruno, F., Skarlatos, D., & Liarokapis, F. (2020). Virtual reality with 360-video storytelling in cultural heritage: Study of presence, engagement, and immersion. Sensors, 20(20), 5851. https://doi.org/10.3390/s20205851
Spallone, R., Lamberti, F., Vigo, L., Ronco, F., Calandra, D., & Ferraro, M. (2024). 3D modelling and virtual reality for museum heritage presentation: Contextualisation of sculpture from the tang era. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 48(2), 413–420. https://doi.org/10.5194/isprs-Archives-XLVIII-2-W4-2024-413-2024
Stals, A., & Caldas, L. (2022). State of XR research in architecture with focus on professional practice–a systematic literature review. Architectural Science Review, 65(2), 138–146. https://doi.org/10.1080/00038628.2020.1838258
Steuri, N., Sahli, O., Reich, J., Milella, M., Nyffeler, J., Doppler, T., & Hafner, A. (2023). Virtual Reality applications for visualization of 6000-year-old Neolithic graves from Lenzburg (Switzerland). Digital Applications in Archaeology and Cultural Heritage, 30(2), e00283. https://doi.org/10.1016/j.daach.2023.e00283
Thorp, S. O., Rimol, L. M., & Grassini, S. (2023). Association of the Big Five Personality Traits with Training Effectiveness, Sense of Presence, and Cybersickness in Virtual Reality. Multimodal Technologies and Interaction, 7(2), 11. https://doi.org/10.3390/mti7020011
Trunfio, M., Lucia, M. Della, Campana, S., & Magnelli, A. (2022). Innovating the cultural heritage museum service model through virtual reality and augmented reality: the effects on the overall visitor experience and satisfaction. Journal of Heritage Tourism, 17(1), 1–19. https://doi.org/10.1080/1743873X.2020.1850742
Wang, Z., & Meng, J. (2023). Dialogues with cultural heritage via museum digitalisation: developing a model of visitors’ cognitive identity, technological agent, cultural symbolism, and public engagement. Museum Management and Curatorship, 39(6), 810-833. https://doi.org/10.1080/09647775.2023.2269164
Yee, K. C., & Mubin, S. A. (2024). AR Mobile Application for Enhancing National Museum Heritage Visualization. International Journal of Software Engineering and Computer Systems, 10(1), 1–19. https://doi.org/10.15282/ijsecs.10.1.2024.1.0119
Zain, M., Baniyamin, N., Ibrahim, I., Rashid, M. M., Zakaria, K., & Mohd Mustafah, Y. (2024). Designing immersive narratives of Jugra heritage site for cultural edutainment using mixed reality. Journal of ICT in Education, 11(1), 81–95. https://doi.org/10.37134/jictie.vol11.1.6.2024
Zempelin, S., Sejunaite, K., Lanza, C., & Riepe, M. W. (2021). Emotion induction in young and old persons on watching movie segments: Facial expressions reflect subjective ratings. PLoS ONE, 16(6), 1–16. https://doi.org/10.1371/journal.pone.0253378
