1.武汉大学 计算机学院,湖北 武汉 430072
2.武汉大学 深圳研究院,广东 深圳 518000
黄 鹏,男,硕士生,现从事计算机视觉、模式识别与多媒体内容分析方面的研究。E-mail: 2017282110180@whu.edu.cn
E-mail:cliang@whu.edu.cn
收稿:2019-01-04,
纸质出版:2020-12-24
移动端阅览
黄鹏,郑淇,梁超.图像分割方法综述[J].武汉大学学报(理学版),2020,66(6):519-531.
HUANG Peng,ZHENG Qi,LIANG Chao.Overview of Image Segmentation Methods [J].J Wuhan Univ (Nat Sci Ed),2020,66(6):519-531.
黄鹏,郑淇,梁超.图像分割方法综述[J].武汉大学学报(理学版),2020,66(6):519-531. DOI:10.14188/j.1671-8836.2019.0002
HUANG Peng,ZHENG Qi,LIANG Chao.Overview of Image Segmentation Methods [J].J Wuhan Univ (Nat Sci Ed),2020,66(6):519-531. DOI:10.14188/j.1671-8836.2019.0002(Ch).
为了解图像分割领域的研究现状,对图像分割方法进行了系统性梳理,首先按照基于阈值、边缘、区域、聚类、图论及特定理论等6类方法介绍传统图像分割方法;然后介绍基于深度学习的分割方法,并探讨了几种常用的分割网络模型,包括全卷积网络(full convolutional network,FCN)、金字塔场景解析网络(pyramid scene parsing network,PSPNet)、DeepLab、Mask R-CNN;最后在图像分割的常用数据集上对同类方法进行了性能比较和分析。
In order to understand the current research status in the field of image segmentation
the image segmentation methods are systematically sorted out. Firstly
traditional image segmentation methods are introduced according to 6 types of methods based on thresholds
edges
regions
clusters
graph theory
and specific theories. Then the segmentation methods based on deep learning are introduced
and several commonly used segmentation network models are discussed
including full convolutional network (FCN)
pyramid scene parsing network (PSPNet)
DeepLab
and Mask R-CNN. Finally
the performance comparison and analysis of similar methods are performed on the commonly used datasets for image segmentation.
OTSU N . A threshold selection method from gray-level histograms [J]. IEEE Transactions on Systems , Man , and Cybernetics , 1979 , 9 ( 1 ): 62 - 66 . DOI: 10.1109/TSMC.1979.4310076 http://dx.doi.org/10.1109/TSMC.1979.4310076 .
PUN T . A new method for grey-level picture thresholding using the entropy of the histogram [J]. Signal Processing , 1980 , 2 ( 3 ): 223 - 237 . DOI: 10.1016/0165-1684(80)90020-1 http://dx.doi.org/10.1016/0165-1684(80)90020-1 .
YEN J C , CHANG F J , CHANG S . A new criterion for automatic multilevel thresholding [J]. IEEE Transactions on Image Processing , 1995 , 4 ( 3 ): 370 - 378 .
KHAN J F , BHUIYAN S M A , ADHAMI R R . Image segmentation and shape analysis for road-sign detection [J]. IEEE Transactions on Intelligent Transportation Systems , 2011 , 12 ( 1 ): 83 - 96 . DOI: 10.1109/ TITS.2010.2073466 http://dx.doi.org/10.1109/TITS.2010.2073466 .
ROSENFELD A . The max Roberts operator is a Hueckel-type edge detector [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence , 1981 , 3 ( 1 ): 101 - 103 . DOI: 10.1109/TPAMI.1981.4767056 http://dx.doi.org/10.1109/TPAMI.1981.4767056 .
LANG Y , ZHENG D . An improved Sobel edge detection operator [C]// IEEE International Conference on Computer Science & Information Technology . New York : IEEE Press , 2010 : 67 - 71 . DOI: 10.1109/ ICCSIT.2010.5563693 http://dx.doi.org/10.1109/ICCSIT.2010.5563693 .
YANG L , WU X Y , ZHAO D W , et al . An improved Prewitt algorithm for edge detection based on noised image [C]// 2011 4th International Congress on Image and Signal Processing . New York : IEEE Press , 2011 : 1197 - 1200 .
ULUPINAR F , MEDIONI G . Refining edges detected by a LoG operator [J]. Computer Vision Graphics & Image Processing , 1990 , 51 ( 3 ): 275 - 298 . DOI: 10.1016/0734-189X(90)90004-F http://dx.doi.org/10.1016/0734-189X(90)90004-F .
LI E S , ZHU S L , ZHU B S , et al . An adaptive edge-detection method based on the Canny operator [C]// 2009 International Conference on Environmental Science and Information Application Technology . New York : IEEE Press , 2009 : 465 - 469 . DOI: 10.1109/ESIAT.2009.49 http://dx.doi.org/10.1109/ESIAT.2009.49 .
ZHANG Y J . An Overview of Image and Video Segmentation in the Last 40 Years [EB/OL]. [ 2018-02-10 ]. https://www.irma-international.org/viewtitle/4834/ https://www.irma-international.org/viewtitle/4834/ ?isxn=97815914 07539 .
PHAM D L , XU C Y , PRINCE J L . A survey of current methods in medical image segmentation [J]. Annual Review of Biomedical Engineering , 2000 , 2 ( 1 ): 315 - 337 .
TREMEAU A , BOREL N . A region growing and merging algorithm to color segmentation [J]. Pattern Recognition , 1997 , 30 ( 7 ): 1191 - 1203 . DOI: 10.1016/S0031-3203(96)00147-1 http://dx.doi.org/10.1016/S0031-3203(96)00147-1 .
CHENG Y . Mean shift,mode seeking,and clustering [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 1995 , 17 ( 8 ): 790 - 799 . DOI: 10.1109/34.400568 http://dx.doi.org/10.1109/34.400568 .
FUKUNAGA K , HOSTETLER L D . The estimation of the gradient of a density function,with applications in pattern recognition [J]. IEEE Transactions on Information Theory , 1975 , 21 ( 1 ): 32 - 40 . DOI: 10.1109/TIT.1975.1055330. http://dx.doi.org/10.1109/TIT.1975.1055330.
SHEIKH Y A , KHAN E A , KANADE T . Mode-seeking by Medoidshifts [C]// 2007 IEEE 11th International Conference on Computer Vision . New York : IEEE Press , 2007 : 1 - 8 . DOI: 10.1109/ ICCV.2007.4408978 http://dx.doi.org/10.1109/ICCV.2007.4408978 .
LEVINSHTEIN A , STERE A , KUTULAKOS K N , et al . TurboPixels: Fast superpixels using geometric flows [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2009 , 31 ( 12 ): 2290 - 2297 . DOI: 10.1109/TPAMI.2009.96 http://dx.doi.org/10.1109/TPAMI.2009.96 .
ACHANTA R , SHAJI A , SMITH K , et al . SLIC superpixels compared to state-of-the-art superpixel methods [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2012 , 34 ( 11 ): 2274 - 2282 . DOI: 10.1109/TPAMI.2012.120. http://dx.doi.org/10.1109/TPAMI.2012.120.
BOYKOV Y Y , JOLLY M P . Interactive graph cuts for optimal boundary region segmentation of objects in N-D images [C]// Proceedings Eighth IEEE International Conference on Computer Vision . New York : IEEE , 2001 : 105 - 112 . DOI: 10.1109/ICCV.2001.937505 http://dx.doi.org/10.1109/ICCV.2001.937505 .
ROTHER C , KOLMOGOROV V , BLAKE A , et al . “ GrabCut”: Interactive foreground extraction using iterated graph cuts [J]. International Conference on Computer Graphics and Interactive Techniques , 2004 , 23 ( 3 ): 309 - 314 . DOI: 10.1145/1015706.1015720 http://dx.doi.org/10.1145/1015706.1015720 .
TANG M , GORELICK L , VEKSLER O , et al . GrabCut in One Cut [C]// Proceedings of the 2013 IEEE International Conference on Computer Vision . New York : IEEE Press , 2013 : 1769 - 1776 .
MATHERON G . Random Sets and Integral Geometry [M]. New York : Wiley Press , 1975 .
CRESPO J , W.SCHAFER R , SERRA J , et al . The flat zone approach: A general low-level region merging segmentation method [J]. Signal Processing , 1997 , 62 ( 1 ): 37 - 60 .
HOLLAND J H . Genetic algorithms and the optimal allocation of trials [J]. SIAM Journal on Computing , 1973 , 2 ( 2 ): 88 - 105 . DOI: 10.1137/0202009 http://dx.doi.org/10.1137/0202009 .
LIU H H , CHEN Z H , CHEN X H , et al . Multiresolution medical image segmentation based on wavelet transform [C]// 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference . New York : IEEE Press , 2006 : 3418 - 3421 . DOI: 10.1109/IEMBS.2005.1617212 http://dx.doi.org/10.1109/IEMBS.2005.1617212 .
YANG X , CHUNG A C S , JIAN Y . An active contour model for image segmentation based on elastic interaction [J]. Journal of Computational Physics , 2006 , 219 ( 1 ): 455 - 476 . DOI: 10.1016/j.jcp.2006.03.026 http://dx.doi.org/10.1016/j.jcp.2006.03.026 .
SAHA P K , UDUPA J K . Relative fuzzy connectedness among multiple objects: Theory, algorithms, and applications in image segmentation [J]. Computer Vision and Image Understanding , 2001 , 82 ( 1 ): 42 - 56 . DOI: 10.1006/cviu.2000.0902 http://dx.doi.org/10.1006/cviu.2000.0902 .
ROY P , GOSWAMI S , CHAKRABORTY S , et al . Image segmentation using rough set theory: A review [J]. International Journal of Rough Sets & Data Analysis , 2014 , 1 ( 2 ): 62 - 74 . DOI: 10.1006/cviu.2000.0902 http://dx.doi.org/10.1006/cviu.2000.0902 .
LONG J , SHELHAMER E , DARRELL T . Fully convolutional networks for semantic segmentation [C]// Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition . New York : IEEE Press , 2015 : 3431 - 3440 . DOI: 10.1109/CVPR.2015.7298965 http://dx.doi.org/10.1109/CVPR.2015.7298965 .
ZHAO H S , SHI J P , QI X J , et al . Pyramid scene parsing network [C]// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition . New York : IEEE Press , 2017 : 2881 - 2890 . DOI: 10.1109/CVPR.2017.660 http://dx.doi.org/10.1109/CVPR.2017.660 .
CHEN L C , PAPANDREOU G , KOKKINOS I , et al . Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs [EB/OL]. [ 2018-08-09 ]. https://ui.adsabs.harvard.edu/abs/2014arXiv1412.7062C/abstract https://ui.adsabs.harvard.edu/abs/2014arXiv1412.7062C/abstract .
CHEN L C , PAPANDREOU G , KOKKINOS I , et al . Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2018 , 40 ( 4 ): 834 - 848 . DOI: 10.1109/TPAMI.2017.2699184 http://dx.doi.org/10.1109/TPAMI.2017.2699184 .
CHEN L C , PAPANDREOU G , SCHROFF F , et al . Rethinking Atrous Convolution for Semantic Image Segmentation [EB/OL]. [ 2018-05-09 ]. https://arxiv.org/pdf/1706.05587.pdf https://arxiv.org/pdf/1706.05587.pdf .
CHEN L C , ZHU Y , PAPANDREOU G , et al . Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [EB/OL]. [ 2018-08-09 ]. https://arxiv.org/pdf/1802.02611v1.pdf https://arxiv.org/pdf/1802.02611v1.pdf .
HE K M , GKIOXARI G , DOLLÁR P , et al . Mask R-CNN [C]// 2017 IEEE International Conference on Computer Vision (ICCV) . New York : IEEE Press , 2017 : 2980 - 2988 . DOI: 10.1109/ICCV.2017.322 http://dx.doi.org/10.1109/ICCV.2017.322 .
EVERINGHAM M , ESLAMI S M A , VAN GOOL L , et al . The PASCAL visual object classes challenge: A retrospective [J]. International Journal of Computer Vision , 2015 , 111 ( 1 ): 98 - 136 . DOI: 10.1007/s11263-014-0733-5 http://dx.doi.org/10.1007/s11263-014-0733-5 .
LIN T Y , MAIRE M , BELONGIE S , et al . Microsoft COCO: Common objects in context [C]// European Conference on Computer Vision (LNCS 8639) . Berlin : Springer , 2014 : 740 - 755 . DOI: 10.1007/978-3-319-10602-1_48 http://dx.doi.org/10.1007/978-3-319-10602-1_48 .
CHEN Y P , LI J N , XIAO H X , et al . Dual path networks [C]// Proceedings of the 31st International Conference on Neural Information Processing Systems . New York : ACM , 2017 : 4467 - 4475 .
CHENG J , SUN Y , MENG Q H . A dense semantic mapping system based on CRF-RNN network [C]// 2017 18th International Conference on Advanced Robotics (ICAR) . New York : IEEE Press , 2017 : 589 - 594 . DOI: 10.1109/ICAR.2017.8023671 http://dx.doi.org/10.1109/ICAR.2017.8023671 .
HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C]// 2016 IEEE Conference on Computer Vision & Pattern Recognition . Washington D C : IEEE Computer Society , 2016 : 770 - 778 .
REN S Q , HE K M , GIRSHICK R , et al . Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [EB/OL]. [ 2018-08-08 ]. https://arxiv.org/pdf/1506.01497.pdf https://arxiv.org/pdf/1506.01497.pdf .
LI Y , QI H Z , DAI J , et al . Fully convolutional instance-aware semantic segmentation [C]// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition . New York : IEEE Press , 2017 : 2359 - 2367 .
DAI J , HE K , SUN J . Instance-aware semantic segmentation via multi-task network cascades [C]// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition . New York : IEEE Press , 2016 : 3150 - 3158 .
CORDTS M , OMRAN M , RAMOS S , et al . The Cityscapes dataset for semantic urban scene understanding [C]// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition . New York : IEEE Press , 2016 : 3213 - 3223 .
0
浏览量
3254
下载量
56
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621