适用于昼夜环境的呼吸率视频检测
Respiratory rate estimation under day and night conditions
- 2018年23卷第1期 页码:144-154
收稿:2017-07-05,
修回:2017-9-19,
纸质出版:2018-01-16
DOI: 10.11834/jig.170310
移动端阅览

浏览全部资源
扫码关注微信
收稿:2017-07-05,
修回:2017-9-19,
纸质出版:2018-01-16
移动端阅览
目的
2
呼吸率是呼吸疾病检测的敏感指标,基于视频的呼吸率检测方法因成本低、使用限制少等特点成为近年医疗健康领域的研究热点。针对现有方法在噪声抑制及夜间信号获取方面存在的问题,提出一种适用于昼夜环境且抗噪性能高的呼吸率视频检测方法。
方法
2
该方法只需使用夜视功能的摄像头即可实现昼夜呼吸率检测。首先,采用人脸检测确定人脸区域,并结合人体几何关系规范呼吸区域;然后,结合空间尺度及相位差异,采用基于相位的视频处理方法对呼吸区域进行时空相位处理,在突出呼吸区域的同时有效抑制了噪声干扰。采用最大似然法进行呼吸初估计,并结合初估计频率对原信号平滑滤波以优化波形;最后应用峰值检测完成呼吸率的二次估计。
结果
2
通过室内有无光源两种环境的实验可知,稳定光源下呼吸率平均误差为0.54次/min,无光源下平均误差为0.62次/min。本文方法与真实呼吸率有良好一致性,与传统呼吸率检测方法相比,鲁棒性更好。
结论
2
提出一种适用于昼夜环境的呼吸率视频检测方法。采用红外摄像机实现夜间视频采集,并通过胸部定位、基于相位的视频放大技术进行时空相位处理,在拓展空间分辨率的同时有效抑制噪声放大,提高呼吸检测的精度与鲁棒性。
Objective
2
Respiratory rate is a sensitive indicator that can directly reflect the health of the human body for related respiratory diseases
such as Biot's respiration
Cheyne-Stokes respiration
and sleep-related breathing disorders. Video-based respiratory detection
which has the features of low cost and few restrictions
has been an advanced research interest in recent years. Given that normal cameras cannot capture videos and present high noise at night
existing methods cannot handle night environment
which could lead to deviations in respiratory estimation and even to errors. To solve these problems
a respiratory detection method was proposed in this study. The proposed method is appropriate for day and night conditions and has a good anti-noise performance.
Method
2
The method was mainly composed of three parts. First
the main face region in videos was confirmed using a Viola-Jones face detector
and the chest region was located by body geometry. We improved the face detection box algorithm to repair the problem that the Viola-Jones algorithm might have a high detection error at night. Second
the chest video was obtained by using a phase-based video motion-processing method
which was combined with spatial scale and phase difference to amplify respiratory movement. We decomposed the original video frames to multiple spatial-scale orientations of phase video sequences. Respiratory signal was extracted by applying average luminance signal operation. Finally
we applied the maximum likelihood (ML) criterion to estimate the respiratory rate by using the signal generated in the second step. The result from the ML criterion could present minimal deviation because breathing waves extracted from the average luminance signal were coarse
which presented the respiratory characteristic unsatisfactorily. Therefore
we used the first estimated respiratory rate as a reference and broadened the frequency band to process the original breathing wave by smoothing filter. Accurate respiratory rate was estimated by peak detection from the smoothed respiratory wave. We solved the problem that normal cameras cannot work efficiently at night by using an active infrared camera. Our method benefited from the extraction of phase information and could thus yield a better performance than those of traditional methods that extract based on luminance information.
Result
2
We collected videos under day and night conditions and conducted a quantitative analysis of the result of respiratory detection. Significant robustness improvements were obtained. The average errors were 0.54 times/min in the day and 0.62 times/min in the night compared with those of the traditional respiratory rate estimation method proposed by Alinovi and Zhang. A stability test was performed to verify the best working environment of our method in different video durations and thickness of clothes.
Conclusion
2
We propose a respiratory rate estimation method that is appropriate for day and night conditions and exhibits good anti-noise performance. We used an active infrared camera to collect videos at night. The breathing region was highlighted by applying a Viola-Jones face detector. The robustness of respiratory rate estimation was improved by effectively selecting breathing region and restraining noise amplification through the phase-based video motion method
which decomposed video frames into different spatial scales and phase orientations.
Yang K. The non-contact respiration detection and Bluetooth communication based on ARM[D]. Qinghuangdao:Yanshan University, 2014. http://cdmd.cnki.com.cn/Article/CDMD-10216-1014041510.htm .
杨凯. 基于ARM的非接触式呼吸检测及蓝牙通信[D]. 秦皇岛: 燕山大学, 2014.
Wu H Y, Rubinstein M, Shih E, et al. Eulerian video magnification for revealing subtle changes in the world[J]. ACM Transactions on Graphics, 2012, 31(4):#65.[DOI:10.1145/2185520.2185561]
Alinovi D, Cattani L, Ferrari G, et al. Spatio-temporal video processing for respiratory rate estimation[C]//2015 IEEE International Symposium on Medical Measurements and Applications. Turin, Italy:IEEE, 2015:12-17.[ DOI:10.1109/MeMeA.2015.7145164 http://dx.doi.org/10.1109/MeMeA.2015.7145164 ]
Burt P, Adelson E. The Laplacian pyramid as a compact image code[J]. IEEE Transactions on Communications, 198331(4):532-540.[DOI:10.1109/TCOM.1983.1095851]
Zhang Y F, Ouyang J F, Yao L F. Design of real-time respiration measuring system based on fast face detection[J]. Computer Engineering and Applications, 2016, 52(2):256-261.
张言飞, 欧阳健飞, 姚丽峰.基于快速人脸检测的实时呼吸测量系统的设计[J].计算机工程与应用, 2016, 52(2):256-261. [DOI:10.3778/j.issn.1002-8331.1403-0028]
Wadhwa N, Rubinstein M, Durand F, et al. Phase-based video motion processing[J]. ACM Transactions on Graphics, 2013, 32(4):#80.[DOI:10.1145/2461912.2461966]
Liu C, Torralba A, Freeman W T, et al. Motion magnification[J]. ACM Transactions on Graphics, 2005, 24(3):519-526.[DOI:10.1145/1073204.1073223]
Fleet D J, Jepson A D. Computation of component image velocity from local phase information[J]. International Journal of Computer Vision, 1990, 5(1):77-104.[DOI:10.1007/BF00056772]
Gautama T, Van Hulle M A. A phase-based approach to the estimation of the optical flow field using spatial filtering[J]. IEEE Transactions on Neural Networks, 2002, 13(5):1127-1136.[DOI:10.1109/TNN.2002.1031944]
Gu Y H, Lin Q, Hu B. A fast medical image registration algorithms based on steerable pyramid[J]Journal of Fudan University:Natural Science, 2010, 49(2):177-184.
顾宇灏, 林青, 胡波.一种基于方向可控金字塔结构的快速医学图像配准算法[J].复旦学报:自然科学版, 2010, 49(2):177-184. [DOI:10.15943/j.cnki.fdxb-jns.2010.02.007]
Viola P, Jones M. Rapid object detection using a boosted cascade of simple features[C]//Proceedings of 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Kauai, Hawaii, USA:IEEE, 2001:511-518.[ DOI:10.1109/CVPR.2001.990517 http://dx.doi.org/10.1109/CVPR.2001.990517 ]
Ntonfo G M Q, Ferrari G, Raheli R, et al. Low-complexity image processing for real-time detection of neonatal clonic seizures[J]. IEEE Transactions on Information Technology in Biomedicine, 2012, 16(3):375-382.[DOI:10.1109/TITB.2012.2186586]
Cattani L, Alinovi D, Ferrari G, et al. A wire-free, non-invasive, low-cost video processing-based approach to neonatal apnoea detection[C]//Proceedings of 2014 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications. Rome, Italy:IEEE, 2014:67-73.[ DOI:10.1109/BIOMS.2014.6951538 http://dx.doi.org/10.1109/BIOMS.2014.6951538 ]
Cattani L, Ntonfo G M K, Lofino F, et al. Maximum-likelihood detection of neonatal clonic seizures by video image processing[C]//The 8th International Symposium on Medical Information and Communication Technology. Firenze, Italy:IEEE, 2014:1-5.[ DOI:10.1109/ISMICT.2014.6825219 http://dx.doi.org/10.1109/ISMICT.2014.6825219 ]
Kay S M. Fundamentals of Statistical Signal Processing:Estimation Theory[M]. Upper Saddle River, NJ, USA:Prentice-Hall, Inc., 1993.
Kong L Q. Research on key techniques of the noncontact detection of physiological signals[D]. Beijing:Beijing Institute of Technology, 2014. http://cdmd.cnki.com.cn/article/cdmd-10007-1014086665.htm .
孔令琴. 非接触式生理信号检测关键技术研究[D]. 北京: 北京理工大学, 2014.
Ma J L, Wang C, Li Z J, et al. Study of measuring heart rate and respiration rate based on PPG[J]. Optical Technique, 2011, 37(3):309-312.
马俊领, 王成, 李章俊, 等.基于PPG的心率和呼吸频率的测量研究[J].光学技术, 2011, 37(3):309-312..[DOI:10.13741/j.cnki.11-1879/o4.2011.03.008]
相关文章
相关作者
相关机构
京公网安备11010802024621