In the realm of digital cultural heritage, students from the Computational Media and Arts (CMA) Thrust at The Hong Kong University of Science and Technology (Guangzhou) have been actively applying volumetric video technology in innovative projects. Here are two notable examples:

Case Study 1: Recreating Dunhuang Dance in a Digital Realm

Students collaborated with a Dunhuang dance artist to capture her performance using volumetric video technology. By integrating the 3D recording with a meticulously constructed virtual Dunhuang environment, they produced a lifelike digital representation of this ancient art form. This project not only revitalizes the traditional Dunhuang dance but also offers audiences an immersive experience, allowing them to appreciate the cultural heritage in a modern digital context.

Case Study 2: Bringing Cantonese Opera to the Metaverse

To engage younger audiences who may be reluctant to attend traditional theater performances, students invited a Cantonese opera performer for volumetric video capture. They then created a 3D virtual stage accessible via VR devices, effectively bringing Cantonese opera into the metaverse. This innovative approach breaks the confines of physical theaters, enabling viewers to enjoy and interact with the performance in a virtual space, thereby enhancing the appeal of traditional culture among the youth. Similar initiatives have been undertaken by institutions like the Guangdong Cantonese Opera House, which has utilized VR technology to film excerpts of Cantonese opera, promoting the digital dissemination of this traditional art form.

These case studies demonstrate the CMA students' commitment to preserving and promoting cultural heritage through cutting-edge technology, showcasing the potential of volumetric video in the digital transformation of traditional arts.

Case Study 3: 《Legend of the White Snake》Immersive VR Narrative Experience

Leveraging volumetric video technology, we created China's first VR interactive narrative work based on the Peking Opera adaptation of “Legend of the White Snake”. This exhibition integrates cutting-edge technologies such as volumetric video, digital humans, and virtual reality. Visitors board a virtual painted boat in the VR digital space, where the movements and vocal performances of Peking Opera actors are authentically recreated. Audience can embody characters and personally experience classic scenes such as "Boating on the Lake and Borrowing the Umbrella," immersing themselves in the charm of traditional culture and joining "White Snake" in opening a new chapter of the millennia-old legend.

With the advent of the digital era, immersive video technology will advance even further, shifting the audience's role from passive "viewers" to active "participants," and even enabling them to "influence" the story's development through AI. Coupled with other immersive sensory devices, humanity is poised to step into a more authentic and fantastical digital world.