面向时变体数据的特征可视化方法
A feature visualization method for time-varying volume data
- 2022年27卷第4期 页码:1302-1313
收稿日期:2020-12-28,
修回日期:2021-02-24,
录用日期:2021-3-3,
纸质出版日期:2022-04-16
DOI: 10.11834/jig.200781
移动端阅览
浏览全部资源
扫码关注微信
收稿日期:2020-12-28,
修回日期:2021-02-24,
录用日期:2021-3-3,
纸质出版日期:2022-04-16
移动端阅览
目的
2
自然界中的大部分现象本质上都是在空间上随时间的流逝不断发展变化的物理或化学过程,可以表述为含有时间变量的数据场,这些数据场称为时变体数据。随着科学计算技术、计算机仿真技术以及现代观测技术的发展,能够以前所未有的精度对自然现象进行仿真或者观测,但同时也面临时变体数据体积大、时间长以及变量数目多的难题。为了更有效地显示时变体数据并挖掘数据中的关键信息,针对时变体数据的可视化,本文提出一种基于数据特征的方法,用于探索时变体数据中感兴趣区域(即特征)的特点与变化。
方法
2
通过将特征提取、特征跟踪、运动检测和提出的3种特征可视化方法(数据帧特征可视化、单个运动过程特征可视化和空间多运动过程特征可视化)置于同一个框架之中,提供一种从时间域和空间域探索多变量时变体数据的一站式解决方案,并突出时变体数据的动力学特性。
结果
2
本文方法在4组不同的时变体数据上应用,对数据中特征各变量的变化以及感兴趣的运动进行了特征可视化。
结论
2
实验结果显示本文方法能以较小的时间成本有效显示数据中的特征以及用户定义的运动,方法的有效性与实用性得到了验证。
Objective
2
Scientific phenomena
such as combustion
ocean currents
and hurricanes are inherently time-varying processes that can be represented as data fields with time variables. Data fields with time variables are often referred to as time-varying volume data. Studying the dynamic aspects of scientific phenomena that change over time is critical to the solution of many scientific problems. With the rapid advancement in computing technologies
time-varying volume data have been created to simulate many physical and chemical processes in their spatial and temporal domains with unprecedented accuracy and complexity. Time-varying volumes usually have large sizes (millions or even billions of voxels)
long duration (hundreds or even thousands of timesteps)
and contain multiple variables. Presenting time-varying volume data providing a powerful impetus for the research on the visualization of time-varying volume data. It is important to first present the data information efficiently then allow scientists to have direct interaction with the data and glean insights into the simulated scientific phenomena. The ability of scientists to visualize time-varying phenomena is essential to ensuring the correct interpretation and analysis
fostering insights
and communicating those insights to others. Rendering time-varying volume data to achieve interactive visualization has long been of interest to the visualization community. Methods for visualizing time-varying volume data can be classified broadly into two types: time-independent and time-dependent. Time-independent algorithms process each timestep or multiple timesteps of time-varying data independently and display a sequence of timesteps as an animation. Methods generally include encoding data to make it more manageable (e.g.
down-sampling in the time domain
data compression
contour extraction)
preselecting transfer functions for direct volume rendering
and interactive hardware-accelerated volume rendering. Time-independent algorithms
which do not rely on domain and expert knowledge
have the advantages of easy operation and good flexibility but fail to consider the dynamic and time-varying characteristics of data. Moreover
the methods cannot highlight the information in data important to scientific discovery. Different from time-independent methods
time-dependent methods
which are usually referred to as "feature-based visualization" or "feature visualization"
focus on the features of data and track the variation tendency of data by using the consistency of feature movements and interactions between adjacent timesteps. In this context
a feature can be defined from two aspects: 1) regions of interest that can be extracted from original data
such as shape
structure
variation
and phenomena and 2) some subsets of interest in the original data. Using techniques from image processing and mathematical morphology
feature visualization algorithms extract amorphous regions from scalar or vector fields of data and create correspondences between consecutive timesteps with certain matching criteria. A major advantage of feature visualization over other methods is that it exploits the data coherence between consecutive timesteps and focus on just those regions of interest so that users can ignore redundant
unimportant
or noninterest regions. The resulting significant reduction in the storage requirement of data and rendering cost of visualization tasks makes feature visualization most suitable for investigating a temporal-spatial variation and motion process. Feature visualization of time-varying volume data generally includes four major steps: 1) defining features of data according to domain knowledge or research need; 2) extracting and quantifying features from data; 3) tracking the extracted features step by step; and 4) presenting features by isosurface rendering or direct volume rendering.
Method
2
In this paper
a method based on feature visualization is proposed to help scientists explore the characteristics and variations of regions of interest in time-varying volume data. The proposed method includes a feature-based data processing part which combines feature extraction
feature tracking over time
and event query and isolation in one workflow and three interactive visualizations: feature visualization of a data frame
feature visualization of an individual event
and feature visualization of multiple events in the spatial context. In the feature-based data processing part
a region-growing algorithm with a threshold provided by users is applied to the scalar field of the primary variable set by users (or the only variable) in every data frame. Connected components of points with data values above the threshold are extracted from each data frame as features. Geometric properties
such as volume
mass
and centroid are calculated for each extracted feature during the process of extraction. Using the point metadata generated from feature extraction
the extracted features in each timestep are correlated over time with a feature tracking algorithm based on volume overlap to determine occurrences of the same feature in consecutive time steps. A feature may go through five states in its evolution: birth
continuation
merge
split
and death. With numerous features spanning dozens or even hundreds of timesteps
it is necessary to isolate all occurrences of the same features from the tracking history to help understand the dynamics in the data. In this context
the temporal and spatial evolution of a feature is referred to as an event. A state graph-based event query algorithm is utilized to capture events defined by scientists. After the event query
a list is created to record all isolated events as a sequence of the triplet: timestep
index of the feature in this timestep
and the state in the evolution process. In the visualization part of the method
a web-based viewer is developed to provide a user interface to explore the feature metadata generated from the feature-based data processing program with three interactive visualizations.
Result
2
The proposed method is applied to four time-varying volume datasets: turbulent vortex
hurricane Isabel
ocean simulation
and hydrothermal plume. The visualization results demonstrate the events of interest from each dataset and further allow users to explore the data from different perspectives from an instance to the entire dataset
which confirmed the usability and effectiveness of the proposed method.
Conclusion
2
Generally
the proposed method of this paper has five major benefits: 1) providing a one-stop solution to explore the spatial
temporal
and parameter spaces of time-varying volume data; 2) highlighting the dynamic aspects of time-varying volume data
which helps scientists understand when and where interesting events occur in a dataset; 3) the feature metadata generated by the feature-based data processing algorithm ensures efficient loading and processing a large amount of data; 4) the viewer does not require a client-side installation and offers centralized maintenance
making it more accessible to more users; and 5) the visualization results and the viewer itself can be distributed easily among multiple users
thereby promoting collaborative research.
Athawale T, Sakhaee E and Entezari A. 2016. Isosurface visualization of data with nonparametric models for uncertainty. IEEE Transactions on Visualization and Computer Graphics, 22(1): 777-786 [DOI: 10.1109/TVCG.2015.2467958]
Bemis K G, Silver D, Xu G Y, Light R, Jackson D, Jones C, Ozer S and Liu L. 2015. The path to COVIS: a review of acoustic imaging of hydrothermal flow regimes. Deep Sea Research Part II: Topical Studies in Oceanography, 121: 159-176 [DOI: 10.1016/j.dsr2.2015.06.00]
Bernard J, Hutter M, Zeppelzauer M, Fellner D and Sedlmair M. 2018. Comparing visual-interactive labeling with active learning: an experimental study. IEEE Transactions on Visualization and Computer Graphics, 24(1): 298-308 [DOI: 10.1109/TVCG.2017.2744818]
Dutta S and Shen H W. 2016. Distribution driven extraction and tracking of features for time-varying data analysis. IEEE Transactions on Visualization and Computer Graphics, 22(1): 837-846 [DOI: 10.1109/TVCG.2015.2467436]
El-Shehaly M, Gračanin D, Gad M, Elmongui H G and Matkovič K. 2015. Interactive fusion and tracking for multi-modal spatial data visualization. Computer Graphics Forum, 34(3): 251-260 [DOI: 10.1111/cgf.12637]
Guo H Q, He W B, Peterka T, Shen H W, Collis S M and Helmus J. 2016. Finite-time lyapunov exponents and lagrangian coherent structures in uncertain unsteady flows. IEEE Transactions on Visualization and Computer Graphics, 22(6): 1672-1682 [DOI: 10.1109/TVCG.2016.2534560]
Haimes R and Darmofal D. 1991. Visualization in computational fluid dynamics: a case study//Proceedings of IEEE Visualization'91. San Diego, USA: IEEE: 392-397 [ DOI: 10.1109/VISUAL.1991.175837 http://dx.doi.org/10.1109/VISUAL.1991.175837 ]
Hazarika S, Biswas A and Shen H W. 2018. Uncertainty visualization using copula-based analysis in mixed distribution models. IEEE Transactions on Visualization and Computer Graphics, 24(1): 934-943 [DOI: 10.1109/TVCG.2017.2744099]
Hsu W H, Mei J Q, Correa C D and Ma K L. 2009. Depicting time evolving flow with illustrative visualization techniques//Proceedings of 2009 International Conference on Arts and Technology. Yi-Lan, China: Springer: 136-147 [ DOI: 10.1007/978-3-642-11577-6_18 http://dx.doi.org/10.1007/978-3-642-11577-6_18 ]
Ji G F and Shen H W. 2006. Feature tracking using earth mover's distance and global optimization. Pacific Graphics: 1-10
Ji G F, Shen H W and Wenger R. 2003. Volume tracking using higher dimensional isosurfacing//Proceedings of IEEE Visualization, 2003. Seattle, USA: IEEE: 209-216 [ DOI: 10.1109/VISUAL.2003.1250374 http://dx.doi.org/10.1109/VISUAL.2003.1250374 ]
Joshi A, Caban J, Rheingans P and Sparling L. 2009. Case study on visualizing hurricanes using illustration-inspired techniques. IEEE Transactions on Visualization and Computer Graphics, 15(5): 709-718 [DOI: 10.1109/TVCG.2008.105]
Kang D J and Curchitser E N. 2013. Gulf Stream eddy characteristics in a high-resolution ocean model. Journal of Geophysical Research: Oceans, 118(9): 4474-4487 [DOI: 10.1002/jgrc.20318]
Kraus M, Weiler N, Oelke D, Kehrer J, Keim D and Fuchs J. 2020. The impact of immersion on cluster identification tasks. IEEE Transactions on Visualization and Computer Graphics, 26(1): 525-535 [DOI: 10.1109/TVCG.2019.2934395]
Kumpf A, Tost B, Baumgart M, Riemer M, Westermann R and Rautenhaus M. 2018. Visualizing confidence in cluster-based ensemble weather forecast analyses. IEEE Transactions on Visualization and Computer Graphics, 24(1): 109-119 [DOI: 10.1109/TVCG.2017.2745178]
Lee T Y and Shen H W. 2009. Visualizing time-varying features with TAC-based distance fields//2009 IEEE Pacific Visualization Symposium. Beijing, China: IEEE: 1-8 [DOI: 10.1109/PACIFICVIS.2009.4906831]
Liu L, Silver D and Bemis K. 2020. Visualizing events in time-varying scientific data. Journal of Visualization, 23(2): 353-368 [DOI: 10.1007/s12650-020-00625-2]
Liu L, Silver D and Bemis K. 2021. Visualizing acoustic imaging of hydrothermal plumes on the seafloor. IEEE Computer Graphics and Applications, 41(2): 63-75 [DOI: 10.1109/MCG.2020.2995077]
Liu L, Silver D, Bemis K, Kang D and Curchitser E. 2017. Illustrative visualization of mesoscale ocean eddies. Computer Graphics Forum, 36(3): 447-458 [DOI: 10.1111/cgf.13201]
Lorensen W E and Cline H E. 1987. Marching cubes: a high resolution 3D surface construction algorithm. ACM SIGGRAPH Computer Graphics, 21(4): 163-169 [DOI: 10.1145/37401.37422]
Ma K L. 2003. Visualizing time-varying volume data. Computing in Science and Engineering, 5(2): 34-42 [DOI: 10.1109/MCISE.2003.1182960]
Ma K L, Rosendale J V and Vermeer W. 1996. 3D shock wave visualization on unstructured grids//Proceedings of 1996 Symposium on Volume Visualization. San Francisco, USA: IEEE: 96: 87-94 [ DOI: 10.1109/SVV.1996.558049 http://dx.doi.org/10.1109/SVV.1996.558049 ]
Ozer S, Silver D, Bemis K and Martin P. 2014. Activity detection in scientific visualization. IEEE Transactions on Visualization and Computer Graphics, 20(3): 377-390 [DOI: 10.1109/TVCG.2013.117]
Reinders F, Post F H and Spoelder H J W. 1999. Attribute-based feature tracking//Gröller E, Löffelmann H, Ribarsky W, eds. Data Visualization'99. Vienna: Springer: 63-72
Reinders F, Post F H and Spoelder H J W. 2001. Visualization of time-dependent data with feature tracking and event detection. The Visual Computer, 17(1): 55-71 [DOI: 10.1007/PL00013399]
Robertson P K. 1990. A methodology for scientific data visualisation: choosing representations based on a natural scene paradigm//Proceedings of the 1st IEEE Conference on Visualization: Visualization'90. San Francisco, USA: IEEE: 114-123 [ DOI: 10.1109/VISUAL.1990.146372 http://dx.doi.org/10.1109/VISUAL.1990.146372 ]
Saikia H and Weinkauf T. 2017. Global feature tracking and similarity estimation in time-dependent scalar fields. Computer Graphics Forum, 36(3): 1-11 [DOI: 10.1111/cgf.13163]
Samtaney R, Silver D, Zabusky N and Cao J. 1994. Visualizing features and tracking their evolution. Computer, 27(7): 20-27 [DOI: 10.1109/2.299407]
Schnorr A, Helmrich D, Childs H, Kuhlen T W and Hentschel B. 2019. Feature tracking utilizing a maximum-weight independent set problem//2019 IEEE 9th Symposium on Large Data Analysis and Visualization (LDAV). Vancouver, Canada: IEEE: 6-15 [ DOI: 10.1109/LDAV48142.2019.8944363 http://dx.doi.org/10.1109/LDAV48142.2019.8944363 ]
Silver D and Wang X. 1997. Tracking and visualizing turbulent 3d features. IEEE Transactions on Visualization and Computer Graphics, 3(2): 129-141 [DOI: 10.1109/2945.597796]
Ullah A, Muhammad K, Del Ser J, Baik S W and Albuquerque V H C. 2019. Activity recognition using temporal optical flow convolutional features and multilayer LSTM. IEEE Transactions on Industrial Electronics, 66(12):9692-9702 [DOI: 10.1109/TIE.2018.2881943]
Van Walsum T, Post F H, Silver D and Post F. 1996. Feature extraction and iconic visualization. IEEE Transactions on Visualization and Computer Graphics, 2(2): 111-119 [DOI: 10.1109/2945.506223]
Wehrend S and Lewis C. 1990. A problem-oriented classification of visualization techniques//Proceedings of the 1st IEEE Conference on Visualization: Visualization'90. San Francisco, USA: IEEE: 139-143 [ DOI: 10.1109/VISUAL.1990.146375 http://dx.doi.org/10.1109/VISUAL.1990.146375 ]
Zabusky N and Silver D. 1992. Case study: visualizing classical problems in CFD//Proceedings of IEEE Visualization'92. Boston, MA, USA: IEEE: 436-440 [ DOI: 10.1109/VISUAL.1992.235174 http://dx.doi.org/10.1109/VISUAL.1992.235174 ]
相关作者
相关机构