首页|沉浸式数字叙事中的视听联觉研究与构建——以宋庆龄与中国福利会相关档案开发实践为例

沉浸式数字叙事中的视听联觉研究与构建——以宋庆龄与中国福利会相关档案开发实践为例

扫码查看
在档案资源开发过程中应用沉浸式数字叙事,可使档案记忆立体化、具象化,实现从物理空间向记忆空间的演变.研究对数字人文视域下的档案资源开发利用实践现状进行回顾,分析目前针对档案资源所进行的沉浸式数字叙事构建的局限,论证基于精细声音设计的沉浸式叙事路径在档案资源开发利用中的可行性.并以宋庆龄与中国福利会的相关档案为对象,探索了基于VR、模拟人声、数字人等多种数字技术、强调声音设计的沉浸式叙事方法.当中虚拟展厅与全景色、无损音效的结合,使档案资源从平面延伸到丰满的立体空间,从而验证了音乐和图像多模态交叉交融的可能性,针对文本所进行的视听联觉研究与构建的尝试,拓展了数字人文研究新领域.
Sound Design in the Construction of Immersive Digital Narratives—Taking Song Qingling and China Welfare Institute's Related Archive as an Example
Immersive digital narrative of archival resources accelerates the three-dimensionalization and con-creteness of archival memory,realizing the evolution from physical space to memory space.This study reviews the current status of the development and utilization of archival resources from the perspective of digital humanities,ana-lyzes the limitations of the current construction of immersive digital narratives of archival resources,and demonstrates the feasibility of immersive narrative paths based on sophisticated sound design in the development and utilization of archival resources.Taking the relevant archives of Soong Ching Ling and the China Welfare Institute as an example,we synesthetically construct an audio-visual archival immersive narrative method based on multiple state-of-the-art technologies,such as VR,MetaHuman and Mockingbird.It verifies the possibility of multi-modal cross-fertilization of music and image resources.By combining the virtual exhibition hall with panoramic views and lossless sound effects,archival resources and image resources can be extended from a flat space to an infinite three-dimensional space.

immersive storytellingdigital storytellingarchive developmentdigital humanities

王美贤、程宸、陈涛、王心雨、林纪元

展开 >

中山大学信息管理学院

上海音乐学院音乐工程系

中山大学计算机学院

沉浸式叙事 数字叙事 档案开发 数字人文 视听联觉

国家社会科学基金一般项目

23BTQ088

2024

数字人文研究

数字人文研究

ISSN:
年,卷(期):2024.4(1)
  • 14