Current Issue Cover
沉浸式环境中多场景视觉提示信息可视化方法综述

任洋甫1,2, 李志强3, 张松海1,2(1.青海大学计算机技术与应用系, 西宁 810016;2.清华大学计算机科学与技术系, 北京 100084;3.国防大学联合作战学院, 北京 100091)

摘 要
沉浸式环境是通过虚拟现实(virtual reality,VR)等技术为用户呈现趋近于真实的环境体验。虚拟现实是通过计算机生成现实世界的模拟环境,可以为用户提供丰富的沉浸感、交互性和想象力体验。用户在虚拟现实场景中,通过视觉可以快速熟悉环境,获取场景内外的信息,还可以通过视觉完成与场景的交互,增强用户的感知。增强现实(augmented reality,AR)会将虚拟信息放置在真实场景中,用户可以与真实场景中的虚拟信息进行交互。为了充分了解视觉提示信息在虚拟现实等不同沉浸式场景中的研究,探究视觉信息提示方法的本源,本文按照信息提示位置的不同、功能和应用的不同进行区分,首先综述近年来在普通二维场景中的方法,通过技术对比和改进深入讨论了在三维虚拟现实或增强现实环境下对视觉提示信息可视化方法的研究。分析在虚拟现实或增强现实环境下与普通二维场景中显示的异同,同时展开视觉提示信息在多场景下对用户注意力等使用功能方面的研究介绍,以及全景视频观看等实际场景中的应用研究说明。本文通过对二维和三维场景视野外、场景中标签布局和注意力引导,以及全景视频观看等实际应用中的讨论,可以更详细地展示视觉提示信息在沉浸式环境和多场景中的研究前景与发展方向。
关键词
Survey of visualization methods for multiscene visual cue information in immersive environments

Ren Yangfu1,2, Li Zhiqiang3, Zhang Songhai1,2(1.Department of Computer Technology and Applications, Qinghai University, Xining 810016, China;2.Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;3.Joint Operations College, National Defense University, Beijing 100091, China)

Abstract
The immersive environment presents a near-real environment experience to users through technologies such as virtual reality(VR). Virtual reality is a simulated environment that generates the natural world through computers,providing users with a rich immersion experience,interactivity,and imagination. In virtual reality,the eyes are the window for viewing the scene and a meaningful way to interact with the virtual world. Virtual reality is a very convenient way for users to obtain information about the location through visual means. The interaction of the scene enhances the users’perception. Augmented reality(AR)places virtual information in a natural setting,and users can interact with the virtual information in the actual location. To understand the application research of visual cue information in different immersive scenarios such as virtual reality,combined with the relationship between visual information cue methods,this paper mainly distinguishes information according to the information display position,function use,and actual application field summarizes and discusses recent years — a study of information visualization methods for visual cues in immersive multiscene environments. First,the prompt information outside the field of view is analyzed. Due to the limitation of hardware devices,the view range of the content in the scene viewed by users through different devices is affected. The methods for visual prompt information outside the field of view can be divided into overview + details and focus + context and discussed separately for 2D and 3D scenarios. The situation within the field of view focuses on the label placement around the model,which is slightly different from the problem of label layout in the scene and the problem of information outside the field of view. When the information in the field of view is displayed,more attention is given to the displayed information. Whether the content is occluded or overlapped,the authors hope to ensure users are more comfortable when viewing information content. At the same time,different requirements are for the layout and distribution of label information. The primary purpose of research on label layout in the scene is to reduce label placement. Good overlapping and confusing problems reduce users’cognitive load when observing. From the perspective of information management,for the information in the scene, how to place the information reasonably and avoid occlusion can not only improve the user’s scene awareness but also improve the user’s experience in the scene. Considering the use function of visual prompt information,the fast visual information added in VR helps users know their position or scene information as soon as possible during the scene roaming. Just like the user in reality,when the users enter an unfamiliar scene,their location in the scene can be obtained through map navigation or eye-catching signs. Therefore,enhancing user perception through visual prompts is conducive to improving users’interactive experience in the scene,helping them grasp scene information quickly and find points of interest as soon as possible. In practical applications,the problems encountered in panoramic videos and their solutions,as well as problems encountered in industrial and life scenarios,such as applying the currently popular video barrage in panoramic videos,are discussed. Panoramic videos are viewed in immersive scenes or applications in entertainment and industrial production. However,judging from the current state of technology,some challenges remain in the visualization method of multiscene visual cue information in the virtual reality environment in the following aspects:first,the method needs to improve user experience on display devices of different sizes in 2D scenes,improve the efficiency of users’acquisition and understanding of information,reduce the cognitive load of users when using machines,and improve the exploration of adapting to multisize screen information prompt methods. Second,the user’s information prompting method outside the field of view in different 3D scenes can ensure a better immersion and a more convenient interaction method,providing users comprehensive information prompts. Third,the research on the technique of tag placement and layout in the scene, considering the user experience,mainly covers three aspects,namely,the way users view and interact with tags,the location and display time of titles,and the movement of tags and scenes. At the same time,users pay more attention to whether the interaction mode in the background is convenient,whether the viewing method is comfortable,and whether the effect on the scene’s content is small enough. Fourth,the map navigation and attention guidance methods in the scene are critical for users to obtain information. Therefore,the users’interactive experience when using map navigation and how to obtain important news and to improve the users’attention guidance need to be improved. Accuracy and reducing the effect of prompt information on immersion are of excellent research importance. Fifth,watching videos in virtual reality can provide users a good viewing experience,so how to enhance their sense of immersion further in the viewing,present a better way to guide the storyline,and reduce the feeling of dizziness in the viewing are all issues worth discussing. Sixth,in scenarios such as industrial production,education,and entertainment,how visual prompt information can form a good interaction with users and help users complete a series of tasks is important. The discussion in this paper on practical applications such as out-of-field,in-scene label layout and attention guidance in 2D and 3D scenes,and panoramic video viewing enables showing in more detail the effects of visual cue information in immersive environments and multiplescenes: research prospects and development directions.
Keywords

订阅号|日报