Preserving Balinese dance through hyperreal digital humans: A motion capture and projection mapping approach

Tombak Matahari; Arya Harditya; Aras Darmawan

doi:10.38010/deskomvis.v6i1.93

Authors

Tombak Matahari Sampoerna University
Arya Harditya Sampoerna University
Aras Darmawan ArassXlab

DOI:

https://doi.org/10.38010/deskomvis.v6i1.93

Keywords:

Balinese Dance, Motion Capture, Projection, Mapping Cultural, Preservation

Abstract

This research explores how motion capture and projection mapping technologies can be structured to preserve traditional Balinese dance while supporting creative education in higher learning. The project aimed to create a hyperreal digital human that authentically embodies traditional choreography, guided by the Balinese philosophy of Tri Hita Karana, which emphasizes harmony among the divine, humans, and nature. The production pipeline integrated students and professionals across all stages—from ideation and narrative development to technical execution—using an OptiTrack motion capture system, Blender for 3D modeling, and Unreal Engine for real-time rendering. The cleaned motion data was mapped onto a detailed 3D character representing a celestial Balinese dancer. This digital performance was then projection-mapped onto large structures during the Indonesia Bertutur 2024 festival, engaging audiences with a fusion of tradition and digital art. Results show that motion capture can retain the integrity of traditional movements, while projection mapping serves as a powerful medium for public storytelling. The collaborative model also provided students with direct exposure to industry workflows and cultural material. This study concludes that emerging media can meaningfully support cultural preservation and pedagogical innovation when implemented with respect, structure, and collaboration.

Downloads

Download data is not yet available.

References

Boboc, R. G., Băutu, E., Gîrbacia, F., Popovici, N., & Popovici, D.-M. (2022). Augmented reality in cultural heritage: An overview of the last decade. Applied Sciences, 12(19), 9859. https://doi.org/10.3390/app12199859

Chunlan, Y., Tengku Wook, T.S.M. & Rosdi, F. Advancing cultural heritage: a decadal review of digital transformation in Chinese museums. npj Herit. Sci. 13, 189 (2025). https://doi.org/10.1038/s40494-025-01714-x

Grand Challenges in Immersive Technologies for Cultural Heritage. (2024). arXiv.

arXiv

Hong, M., Kim, J., Chang, J., & Kim, M. (2024). Dissemination of digital heritage using media technology-Intangible cultural heritage of Korea, Dongnae Crane Dance. In DS 136: Proceedings of the Asia Design and Innovation Conference (ADIC) 2024 (pp. 335-342). https://www.designsociety.org/publication/47857/dissemination_of_digital_heritage_using_media_technology_-_intangible_cultural_heritage_of_korea_dongnae_crane_dance

MMU Press. (2025). Development of audio-visual exhibition “Portable Western" using video mapping for folk stories. International Journal of Creative Multimedia, 6(1), 49–64. https://doi.org/10.33093/ijcm.2025.6.1.4

Mu, Y., Ling, H. Y., Shi, Y., Ojeda, I. B., Xi, P., Shu, C., Zinno, F., & Peng, X. B. (2025). StableMotion: Training Motion Cleanup Models with Unpaired Corrupted Data. arXiv preprint arXiv:2505.03154. https://arxiv.org/abs/2505.03154

Nikolakopoulou, V., Printezis, P., Maniatis, V., Kontizas, D., Vosinakis, S., Chatzigrigoriou, P., & Koutsabasis, P. (2022). Conveying intangible cultural heritage in museums with interactive storytelling and projection mapping: the case of the mastic villages. Heritage, 5(2), 1024-1049. https://doi.org/10.3390/heritage5020056

Rizhan, W., Mazian, A. I., Rahim, N., Jamal, A. A., Ismail, I., & Fadzli, S. A. (2025). Folk Dance Motion Templates based on Motion Capture Technique For Guaranteeing Authenticity of Folk Dance: Case Studies of Malay Folk Dances. Digital Applications in Archaeology and Cultural Heritage, e00449. https://doi.org/10.1016/j.daach.2025.e00449

Sawhney, N., de Souza e Silva, A., & Pimenta, M. S. (2018). Practice-based learning in design and media education. International Journal of Art & Design Education, 37(2), 263–274. https://doi.org/10.1111/jade.12127

Utkarsh, A., Li, Y., Jain, H., & Yu, R. (2017). Motion capture cleanup using deep learning. CVPR Workshop.

Wang, M., & Yu, R. (2022). Digital production and realization for traditional dance movements based on Motion Capture Technology. Front. Soc. Sci. Technol, 4(11), 13-18.

Wang, Z., He, C., Yan, Z., Wang, J., Wang, Y., Liu, J., Shen, A., Zeng, M., Rushmeier, H., Xu, H., Yu, B., Lu, C., & Wang, E. Y. (2025). Chang‑E: A high‑quality motion capture dataset of Chinese classical Dunhuang dance. ACM Journal on Computing and Cultural Heritage.

ACM Digital Library+1