Research on Microscopic 3D Measurement System Based on Focus Variation

Minghao Shang; Feihong Yu

doi:10.3788/LOP202158.1600002

[1] Malik A S, Choi T S. Comparison of polymers: a new application of shape from focus[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 39, 246-250(2009).

[2] He B F, Ding S Y, Wei C E et al. Review of measurement methods for areal surface roughness[J]. Optics and Precision Engineering, 27, 78-93(2019).

[3] Hamzah R A, Ibrahim H. Literature survey on stereo vision disparity map algorithms[J]. Journal of Sensors, 2016, 1-23(2016).

[4] Durou J D, Falcone M, Sagona M. Numerical methods for shape-from-shading: a new survey with benchmarks[J]. Computer Vision and Image Understanding, 109, 22-43(2008).

[5] Tomasi C, Kanade T. Shape and motion from image streams under orthography: a factorization method[J]. International Journal of Computer Vision, 9, 137-154(1992).

[6] Nayar S K, Nakagawa Y. Shape from focus[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16, 824-831(1994).

[7] Surya G, Subbarao M. Depth from defocus by changing camera aperture: a spatial domain approach[C]. //Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 15-17, 1993, New York, NY, USA, 61-67(1993).

[8] Ribal C, Lermé N. Le Hégarat-Mascle S. Efficient graph cut optimization for shape from focus[J]. Journal of Visual Communication and Image Representation, 55, 529-539(2018).

[9] Cui H Y. Research on 3D reconstruction and mosaic algorithm based on multi-focus image sequence[D], 1(2019).

[10] Zhang X, Zhu Y J, Zhang B Z et al. 3D reconstruction of cutting edge of micro-milling cutter based on depth of field[J]. Industrial Control Computer, 32, 135-137(2019).

[11] Wang J C. Theoretical study of auto-focus algorithm based on image processing[D], 30(2012).

[12] Firestone L, Cook K, Culp K et al. Comparison of autofocus methods for automated microscopy[J]. Cytometry: The Journal of the International Society for Analytical Cytology, 12, 195-206(1991).

[13] Santos A, de Solórzano C O, Vaquero J J et al. Evaluation of autofocus functions in molecular cytogenetic analysis[J]. Journal of Microscopy, 188, 264-272(1997).

[14] Sun Y, Duthaler S, Nelson B J. Autofocusing in computer microscopy:selecting the optimal focus algorithm[J]. Microscopy Research and Technique, 65, 139-149(2004).

[15] Chu X, Zhu L Q, Lou X P et al. Dynamic auto focus algorithm based on improved Sobel operator[J]. Journal of Applied Optics, 38, 237-242(2017).

[16] Yao M, Wu Z N. An anti-nosie algorithm to auto-focusing[J]. Optics & Optoelectronic Technology, 9, 41-45(2011).

[17] Zhang F S, Li S W, Hu Z G et al. An improved auto-focus evaluating algorithm based on Sobel gradient function[J]. Optical Technique, 43, 234-238(2017).

[18] Wu X J. Z-distance measuring system of probe station based on automatic focusing technology[D], 31(2017).

[19] Thelen A, Frey S, Hirsch S et al. Improvements in shape-from-focus for holographic reconstructions with regard to focus operators, neighborhood-size, and height value interpolation[J]. IEEE Transactions on Image Processing, 18, 151-157(2009).

[20] Tian Y Z, Hu H J, Cui H Y et al. Three-dimensional surface microtopography recovery from a multifocus image sequence using an omnidirectional modified Laplacian operator with adaptive window size[J]. Applied Optics, 56, 6300-6310(2017).

[21] Gaganov V, Ignatenko A. Robust shape from focus via Markov random fields[EB/OL]. [2020-08-15]. https://graphics.cs.msu.ru/files/download/papers/sff-via-mrf.pdf

[22] Moeller M, Benning M, Schönlieb C et al. Variational depth from focus reconstruction[J]. IEEE Transactions on Image Processing, 24, 5369-5378(2015).

[23] Kumar G P, Sahay R R. Accurate structure recovery via weighted nuclear norm: a low rank approach to shape-from-focus[C]. //2017 IEEE International Conference on Computer Vision Workshops (ICCVW), October 22-29, 2017, Venice, Italy, 563-574(2017).

[24] Pech-Pacheco J L, Cristobal G, Chamorro-Martinez J et al. Diatom autofocusing in brightfield microscopy: a comparative study[C]. //Proceedings 15th International Conference on Pattern Recognition ICPR-2000, September 3-7, 2000, Barcelona, Spain, 314-317(2000).

[25] Lee S Y, Yoo J T, Kumar Y et al. Reduced energy-ratio measure for robust autofocusing indigital camera[J]. IEEE Signal Processing Letters, 16, 133-136(2009).

[26] Wee C Y, Paramesran R. Measure of image sharpness using eigenvalues[J]. Information Sciences, 177, 2533-2552(2007).

[27] Yang G, Nelson B J. Wavelet-based autofocusing and unsupervised segmentation of microscopic images[C]. //roceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003), October 27-31, 2003, Las Vegas, NV, USA., 2143-2148(2003).

[28] Pertuz S, Puig D, Garcia M A. Analysis of focus measure operators for shape-from-focus[J]. Pattern Recognition, 46, 1415-1432(2013).

[29] Yuan T F. Research on the focus variation algorithm and software system for the measurement of surface topography[D], 18(2017).

[30] Xie H, Rong W B, Sun L N. Wavelet-based focus measure and 3-D surface reconstruction method for microscopy images[C]. //2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 9-15, 2006, Beijing, China., 229-234(2006).

[31] Tian Y Z, Cui H Y, Pan Z Y et al. Improved three-dimensional reconstruction algorithm from a multifocus microscopic image sequence based on a nonsubsampled wavelet transform[J]. Applied Optics, 57, 3864-3872(2018).

[32] Baina J, Dublet J. Automatic focus and iris control for video cameras[C]. //Fifth International Conference on Image Processing and its Applications, July 4-6, 1995, Edinburgh, UK, 232-235(1995).

[33] Freeman W T, Adelson E H. The design and use of steerable filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13, 891-906(1991).

[34] Aydin T, Akgul Y S. A new adaptive focus measure for shape from focus[C]. //Procedings of the British Machine Vision Conference 2008, September 1-4, 2008, Leeds, 1-10(2008).

[35] You Y H, Liu T, Liu J W. Survey of the auto-focus methods based on image processing[J]. Laser & Infrared, 43, 132-136(2013).

[36] Yin Q X. Research on 3D reconstruction technology based on focus variation microscopic measurement[D], 50(2018).

[37] Yang Y, Wu J H, Huang S Y et al. Multimodal medical image fusion based on fuzzy discrimination with structural patch decomposition[J]. IEEE Journal of Biomedical and Health Informatics, 23, 1647-1660(2019).

[38] Piella G. A general framework for multiresolution image fusion: from pixels to regions[J]. Information Fusion, 4, 259-280(2003).

[39] Li S T, Yang B. Multifocus image fusion using region segmentation and spatial frequency[J]. Image and Vision Computing, 26, 971-979(2008).

[40] De I, Chanda B. Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure[J]. Information Fusion, 14, 136-146(2013).

[41] Burt P, Adelson E. The Laplacian pyramid as a compact image code[J]. IEEE Transactions on Communications, 31, 532-540(1983).

[42] Burt P J, Adelson E H. Merging images through pattern decomposition[J]. Proceedings of SPIE, 575, 173-181(1985).

[43] Toet A. Image fusion by a ratio of low-pass pyramid[J]. Pattern Recognition Letters, 9, 245-253(1989).

[44] Toet A, van Ruyven L J, Valeton J M. Merging thermal and visual images by a contrast pyramid[J]. Optical engineering, 28, 287789(1989).

[45] Toet A. A morphological pyramidal image decomposition[J]. Pattern Recognition Letters, 9, 255-261(1989).

[46] Wang W B, Li H L, Zhang X D. Fusion algorithm of remote sensing images based on nonsubsampled pyramid and empirical mode demoposition[J]. Journal of Harbin Engineering University, 33, 1394-1398(2012).

[47] Li Z H, Jing Z L, Sun S Y et al. Remote sensing image fusion based on steerable pyramid frame transform[J]. Acta Optica Sinica, 25, 598-602(2005).

[48] Wang Y Y, Zhang N, Han M L. Wavelet transform multi-focus image fusion method based on Canny operator edge detection[J]. Electronic Measurement Technology, 42, 148-151(2019).

[49] Xu M M. The research of image fusion algorithm based on wavelet transform[D], 10(2014).

[50] Zhu S S, Qu P Y. Multi-focus image fusion based on wavelet transform and guided filtering[J]. Measurement & Control Technology, 39, 103-107(2020).

[51] Li H, Manjunath B S, Mitra S K. Multisensor image fusion using the wavelet transform[J]. Graphical Models and Image Processing, 57, 235-245(1995).

[52] Do M N, Vetterli M. The contourlet transform: an efficient directional multiresolution image representation[J]. IEEE Transactions on Image Processing, 14, 2091-2106(2005).

[53] Candès E J, Donoho D L. Ridgelets: a key to higher-dimensional intermittency?[J]. Philosophical Transactions of the Royal Society of London Series A: Mathematical, Physical and Engineering Sciences, 357, 2495-2509(1999).

[54] Qu X B, Yan J W, Xiao H Z et al. Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain[J]. Acta Automatica Sinica, 34, 1508-1514(2008).

[55] Eckhorn R, Reitboeck H J, Arndt M et al. Feature linking via synchronization among distributed assemblies: simulations of results from cat visual cortex[J]. Neural Computation, 2, 293-307(1990).

[56] Yan T, Chen B, Liu F X et al. Multi-focus image fusion model for micro 3D reconstruction[J]. Journal of Computer-Aided Design & Computer Graphics, 29, 1613-1623(2017).

[57] Wang Z B, de Ma Y. Medical image fusion using m-PCNN[J]. Information Fusion, 9, 176-185(2008).

[58] Easley G, Labate D, Lim W Q. Sparse directional image representations using the discrete shearlet transform[J]. Applied and Computational Harmonic Analysis, 25, 25-46(2008).

[59] Yin M, Liu W, Zhao X et al. A novel image fusion algorithm based on nonsubsampled shearlet transform[J]. Optik, 125, 2274-2282(2014).

[60] Zhang Y F, Geng Z X, Wang J M. Multi-focus image fusion algorithm based on extended phase stretch transform[J]. Laser & Optoelectronics Progress, 57, 221007(2020).

[61] Tian S W, Lin S Z, Lei H W et al. Multi-band image synchronous super-resolution and fusion method based on improved WGAN-GP[J]. Acta Optica Sinica, 40, 2010001(2020).

[62] Zhang H T, Chang Y, Tan L et al. Three-dimensional reconstruction of wheat grain images based on z-axis weight[J]. Acta Optica Sinica, 39, 0310001(2019).