• Journal of Semiconductors
  • Vol. 43, Issue 8, 081001 (2022)
Zhiheng Cheng*, Chaolun Wang*, Xing Wu**, and Junhao Chu*
Author Affiliations
  • In Situ Devices Center, Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200241, China
  • show less
    DOI: 10.1088/1674-4926/43/8/081001 Cite this Article
    Zhiheng Cheng, Chaolun Wang, Xing Wu, Junhao Chu. Review in situ transmission electron microscope with machine learning[J]. Journal of Semiconductors, 2022, 43(8): 081001 Copy Citation Text show less
    References

    [1] A Avsar, A Ciarrocchi, M Pizzochero et al. Defect induced, layer-modulated magnetism in ultrathin metallic PtSe2. Nat Nanotechnol, 14, 674(2019).

    [2] M Zhou, W Wang, J Lu et al. How defects influence the photoluminescence of TMDCs. Nano Res, 14, 29(2021).

    [3] J Jiang, Z Ni. Defect engineering in two-dimensional materials. J Semicond, 40, 070403(2019).

    [4] X Chen, F Du, C Wang et al. Direct visualization of breakdown-induced metal migration in enhanced modified lateral silicon-controlled rectifiers. IEEE Trans Electron Devices, 68, 1378(2021).

    [5] X Wu, C Luo, P Hao et al. Probing and manipulating the interfacial defects of InGaAs dual-layer metal oxides at the atomic scale. Adv Mater, 30, 1703025(2018).

    [6] C Luo, C Wang, X Wu et al. In situ transmission electron microscopy characterization and manipulation of two-dimensional layered materials beyond graphene. Small, 13, 1604259(2017).

    [7] R G Mendes, J Pang, A Bachmatiuk et al. Electron-driven in situ transmission electron microscopy of 2D transition metal dichalcogenides and their 2D heterostructures. ACS Nano, 13, 978(2019).

    [8] Z Dong, Y Ma. Atomic-level handedness determination of chiral crystals using aberration-corrected scanning transmission electron microscopy. Nat Commun, 11, 1588(2020).

    [9] N J Zaluzec. The influence of Cs/Cc correction in analytical imaging and spectroscopy in scanning and transmission electron microscopy. Ultramicroscopy, 151, 240(2015).

    [10] Y Lin, M Zhou, X Tai et al. Analytical transmission electron microscopy for emerging advanced materials. Matter, 4, 2309(2021).

    [11] J Zhang, Y Yu, P Wang et al. Characterization of atomic defects on the photoluminescence in two-dimensional materials using transmission electron microscope. InfoMat, 1, 85(2019).

    [12] B H Kim, J Yang, D Lee et al. Liquid-phase transmission electron microscopy for studying colloidal inorganic nanoparticles. Adv Mater, 30, 1703316(2018).

    [13] Z Fan, L Zhang, D Baumann et al. In situ transmission electron microscopy for energy materials and devices. Adv Mater, 31, 1900608(2019).

    [14] X Yang, C Luo, X Y Tian et al. A review of in situ transmission electron microscopy study on the switching mechanism and packaging reliability in non-volatile memory. J Semicond, 42, 013102(2021).

    [15] C Zhang, K V Larionov, K L Firestein et al. Optomechanical properties of MoSe2 nanosheets as revealed by in situ transmission electron microscopy. Nano Lett, 22, 673(2022).

    [16] N de Jonge, L Houben, R E Dunin-Borkowski et al. Resolution and aberration correction in liquid cell transmission electron microscopy. Nat Rev Mater, 4, 61(2019).

    [17] H Xu, X Wu, X Tian et al. Dynamic structure-properties characterization and manipulation in advanced nanodevices. Mater Today Nano, 7, 100042(2019).

    [18] J S Cai, R Cai, Z T Sun et al. Confining TiO2 nanotubes in PECVD-enabled graphene capsules toward ultrafast K-ion storage: in situ TEM/XRD study and DFT analysis. Nano-Micro Lett, 12, 123(2020).

    [19] R B Wang, Z T Song, W X Song et al. Phase-change memory based on matched Ge-Te, Sb-Te, and In-Te octahedrons: Improved electrical performances and robust thermal stability. Infomat, 3, 1008(2021).

    [20] Y H Wang, J B Pang, Q L Cheng et al. Applications of 2D-layered palladium diselenide and its van der Waals heterostructures in electronics and optoelectronics. Nano-Micro Lett, 13, 143(2021).

    [21] Y L Wu, R R Gaddam, C Zhang et al. Stabilising cobalt sulphide nanocapsules with nitrogen-doped carbon for high-performance sodium-ion storage. Nano-Micro Lett, 12, 48(2020).

    [22] H Zhang, Y Yang, H Xu et al. Li4Ti5O12 spinel anode: Fundamentals and advances in rechargeable batteries. Infomat, 4, e12228(2021).

    [23] I Ibrahim, J Kalbacova, V Engemaier et al. Confirming the dual role of etchants during the enrichment of semiconducting single wall carbon nanotubes by chemical vapor deposition. Chem Mater, 27, 5964(2015).

    [24] J Pang, Y Wang, X Yang et al. A wafer-scale two-dimensional platinum monosulfide ultrathin film via metal sulfurization for high performance photoelectronics. Mater Adv, 3, 1497(2022).

    [25] Y Sun, B Sun, J B He et al. Compositional and structural engineering of inorganic nanowires toward advanced properties and applications. Infomat, 1, 496(2019).

    [26] J W Wang, Z R Jia, X H Liu et al. Construction of 1D heterostructure NiCo@C/ZnO nanorod with enhanced microwave absorption. Nano-Micro Lett, 13, 175(2021).

    [27] B J Yu, S D Liu, W H Xie et al. Versatile core-shell magnetic fluorescent mesoporous microspheres for multilevel latent fingerprints magneto-optic information recognition. Infomat, 4, e12289(2022).

    [28] M Schorb, I Haberbosch, W J H Hagen et al. Software tools for automated transmission electron microscopy. Nat Methods, 16, 471(2019).

    [29] B Plotkin-Swing, G J Corbin, S De Carlo et al. Hybrid pixel direct detector for electron energy loss spectroscopy. Ultramicroscopy, 217, 113067(2020).

    [30] A Maigné, M Wolf. Low-dose electron energy-loss spectroscopy using electron counting direct detectors. Microscopy, 67, i86(2018).

    [31] X Chen, L H Zhou, P Wang et al. Effects associated with nanostructure fabrication using in situ liquid cell TEM technology. Nano-Micro Lett, 7, 385(2015).

    [32] S Zhang, J B Pang, Q L Cheng et al. High-performance electronics and optoelectronics of monolayer tungsten diselenide full film from pre-seeding strategy. Infomat, 3, 1455(2021).

    [33] T Ishida, A Shinozaki, M Kuwahara et al. Performance of a silicon-on-insulator direct electron detector in a low-voltage transmission electron microscope. Microscopy, 70, 321(2021).

    [34] C Ophus, J Ciston, J Pierce et al. Efficient linear phase contrast in scanning transmission electron microscopy with matched illumination and detector interferometry. Nat Commun, 7, 10719(2016).

    [35] F Hui, C Li, Y H Chen et al. Understanding the structural evolution of Au/WO2.7 compounds in hydrogen atmosphere by atomic scale in situ environmental TEM. Nano Res, 13, 3019(2020).

    [36] Y Jiang, Z F Zhang, W T Yuan et al. Recent advances in gas-involved in situ studies via transmission electron microscopy. Nano Res, 11, 42(2018).

    [37] Y Wang, X X Peng, A Abelson et al. In situ TEM observation of neck formation during oriented attachment of PbSe nanocrystals. Nano Res, 12, 2549(2019).

    [38] B Weng, Y H Jiang, H G Liao et al. Visualizing light-induced dynamic structural transformations of Au clusters-based photocatalyst via in situ TEM. Nano Res, 14, 2805(2021).

    [39] Y T Zhu, D D Yuan, H Zhang et al. Atomic-scale insights into the formation of 2D crystals from in situ transmission electron microscopy. Nano Res, 14, 1650(2021).

    [40] A Alberti, C Bongiorno, E Smecca et al. Pb clustering and PbI2 nanofragmentation during methylammonium lead iodide perovskite degradation. Nat Commun, 10, 2196(2019).

    [41] S R Spurgeon, C Ophus, L Jones et al. Towards data-driven next-generation transmission electron microscopy. Nat Mater, 20, 274(2020).

    [42] S V Kalinin, A R Lupini, O Dyck et al. Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy. MRS Bull, 44, 565(2019).

    [43] F Uesugi, S Koshiya, J Kikkawa et al. Non-negative matrix factorization for mining big data obtained using four-dimensional scanning transmission electron microscopy. Ultramicroscopy, 221, 113168(2021).

    [44] O Dyck, M Ziatdinov, D B Lingerfelt et al. Atom-by-atom fabrication with electron beams. Nat Rev Mater, 4, 497(2019).

    [45] M Chen, W Dai, S Y Sun et al. Convolutional neural networks for automated annotation of cellular cryo-electron tomograms. Nat Methods, 14, 983(2017).

    [46] C H Lee, A Khan, D Luo et al. Deep learning enabled strain mapping of single-atom defects in two-dimensional transition metal dichalcogenides with sub-picometer precision. Nano Lett, 20, 3369(2020).

    [47] R K Vasudevan, M Ziatdinov, S Jesse et al. Phases and interfaces from real space atomically resolved data: physics-based deep data image analysis. Nano Lett, 16, 5574(2016).

    [48] A Belianinov, Q He, M Kravchenko et al. Identification of phases, symmetries and defects through local crystallography. Nat Commun, 6, 7801(2015).

    [49] C T Nelson, R K Vasudevan, X Zhang et al. Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data. Nat Commun, 11, 6361(2020).

    [50] Y LeCun, B Boser, J S Denker et al. Backpropagation applied to handwritten zip code recognition. Neural Comput, 1, 541(1989).

    [51] A Krizhevsky, I Sutskever, G E Hinton. ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, 1097(2012).

    [52] O Ronneberger, P Fischer, T Brox. U-Net: convolutional networks for biomedical image segmentation, 234(2015).

    [53] Y LeCun, Y Bengio, G Hinton. Deep learning. Nature, 521, 436(2015).

    [54] L C Chen, Y Zhu, G Papandreou et al. Encoder-decoder with atrous separable convolution for semantic image segmentation(2018).

    [55] M Ge, F Su, Z Zhao et al. Deep learning analysis on microscopic imaging in materials science. Mater Today Nano, 11, 100087(2020).

    [56] J Dan, X Zhao, S J Pennycook. A machine perspective of atomic defects in scanning transmission electron microscopy. InfoMat, 1, 359(2019).

    [57] W Li, K G Field, D Morgan. Automated defect analysis in electron microscopic images. npj Comput Mater, 4, 36(2018).

    [58] A Maksov, O Dyck, K Wang et al. Deep learning analysis of defect and phase evolution during electron beam-induced transformations in WS2. npj Comput Mater, 5, 12(2019).

    [59] J M Ede, R Beanland. Partial scanning transmission electron microscopy with deep learning. Sci Rep, 10, 8332(2020).

    [60] C Zhang, J Feng, L R DaCosta et al. Atomic resolution convergent beam electron diffraction analysis using convolutional neural networks. Ultramicroscopy, 210, 112921(2019).

    [61] C Wang, Q Zou, Z Cheng et al. Tailoring atomic 1T phase CrTe2 for in situ fabrication. Nanotechnology, 33, 085302(2021).

    [62] A Ziletti, D Kumar, M Scheffler et al. Insightful classification of crystal structures using deep learning. Nat Commun, 9, 2775(2018).

    [63] L Yao, Z Ou, B Luo et al. Machine learning to reveal nanoparticle dynamics from liquid-phase TEM videos. ACS Cent Sci, 6, 1421(2020).

    [64] S H Yang, W Choi, B W Cho et al. Deep learning-assisted quantification of atomic dopants and defects in 2D materials. Adv Sci, 8, 2101099(2021).

    [65] K M Roccapriore, M Ziatdinov, S H Cho et al. Predictability of localized plasmonic responses in nanoparticle assemblies. Small, 17, 2100181(2021).

    [66] S V Kalinin, O Dyck, S Jesse et al. Exploring order parameters and dynamic processes in disordered systems via variational autoencoders. Sci Adv, 7, eabd5084(2021).

    [67] Y Han, J Jang, E Cha et al. Deep learning STEM-EDX tomography of nanocrystals. Nat Mach Intell, 3, 267(2021).

    [68] X Wang, J Li, H D Ha et al. Autodetect-mNP: an unsupervised machine learning algorithm for automated analysis of transmission electron microscope images of metal nanoparticles. J Am Chem Soc, 1, 316(2021).

    [69] M Ragone, V Yurkiv, B Song et al. Atomic column heights detection in metallic nanoparticles using deep convolutional learning. Comput Mater Sci, 180, 109722(2020).

    [70] B Lee, S Yoon, J W Lee et al. Statistical characterization of the morphologies of nanoparticles through machine learning based electron microscopy image analysis. ACS Nano, 14, 17125(2020).

    [71] G D Förster, A Castan, A Loiseau et al. A deep learning approach for determining the chiral indices of carbon nanotubes from high-resolution transmission electron microscopy images. Carbon, 169, 465(2020).

    [72] M Ziatdinov, O Dyck, A Maksov et al. Deep learning of atomically resolved scanning transmission electron microscopy images: Chemical identification and tracking local transformations. ACS Nano, 11, 12742(2017).

    [73] W S Li, H K Ning, Z H Yu et al. Reducing the power consumption of two-dimensional logic transistors. J Semicond, 40, 091002(2019).

    [74] J L Wang. A novel spin-FET based on 2D antiferromagnet. J Semicond, 40, 020401(2019).

    [75] F Liang, C Wang, C Luo et al. Ferromagnetic CoSe broadband photodetector at room temperature. Nanotechnology, 31, 374002(2020).

    [76] H Zhang, X T Jiang, Y L Wang et al. Preface to the special issue on monoelemental 2D semiconducting materials and their applications. J Semicond, 41, 080101(2020).

    [77] J S Zhou, J H Yang, Z M Wei. Photodetectors based on 2D material/Si heterostructure. J Semicond, 41, 080401(2020).

    [78] N Q Deng, H Tian, J Zhang et al. Black phosphorus junctions and their electrical and optoelectronic applications. J Semicond, 42, 081001(2021).

    [79] C L Wang, X Wu, Y H Ma et al. Metallic few-layered VSe2 nanosheets: high two-dimensional conductivity for flexible in-plane solid-state supercapacitors. J Mater Chem A, 6, 8299(2018).

    [80] C Wang, X Wu, X Zhang et al. Iron-doped VSe2 nanosheets for enhanced hydrogen evolution reaction. Appl Phys Lett, 116, 223901(2020).

    [81] H Qiu, T Xu, Z Wang et al. Hopping transport through defect-induced localized states in molybdenum disulphide. Nat Commun, 4, 2642(2013).

    [82] C Wang, M Jin, D Liu et al. VSe2 quantum dots with high-density active edges for flexible efficient hydrogen evolution reaction. J Phys D, 54, 214006(2021).

    [83] S Zhang, C G Wang, M Y Li et al. Defect structure of localized excitons in a WSe2 monolayer. Phys Rev Lett, 119, 046101(2017).

    [84] X Wang, Y Zhang, H Si et al. Single-atom vacancy defect to trigger high-efficiency hydrogen evolution of MoS2. J Am Chem Soc, 142, 4298(2020).

    [85] K Barthelmi, J Klein, A Hötger et al. Atomistic defects as single-photon emitters in atomically thin MoS2. Appl Phys Lett, 117, 070501(2020).

    [86] T Susi, J C Meyer, J Kotakoski. Manipulating low-dimensional materials down to the level of single atoms with electron irradiation. Ultramicroscopy, 180, 163(2017).

    [87] S J Pennycook, D E Jesson. High-resolution Z-contrast imaging of crystals. Ultramicroscopy, 37, 14(1991).

    [88] E D Boyes, A P LaGrow, M R Ward et al. Single atom dynamics in chemical reactions. Acc Chem Res, 53, 390(2020).

    [89] R Mi, D Li, Z Hu et al. Morphology effects of CeO2 nanomaterials on the catalytic combustion of toluene: a combined kinetics and diffuse reflectance infrared fourier transform spectroscopy study. ACS Catal, 11, 7876(2021).

    [90] B Ni, X Wang. Face the edges: catalytic active sites of nanomaterials. Adv Sci, 2, 1500085(2015).

    [91] H M Zheng. Imaging, understanding, and control of nanoscale materials transformations. MRS Bull, 46, 443(2021).

    [92] W H Wang, S W Chee, H W Yan et al. Growth dynamics of vertical and lateral layered double hydroxide nanosheets during electrodeposition. Nano Lett, 21, 5977(2021).

    [93] F Shi, J Peng, F Li et al. Design of highly durable core−shell catalysts by controlling shell distribution guided by in situ corrosion study. Adv Mater, 33, 2101511(2021).

    [94] Z Ou, Z Wang, B Luo et al. Kinetic pathways of crystallization at the nanoscale. Nat Mater, 19, 450(2020).

    [95] M R Hauwiller, X Ye, M R Jones et al. Tracking the effects of ligands on oxidative etching of gold nanorods in graphene liquid cell electron microscopy. ACS Nano, 14, 10239(2020).

    [96] H Shan, W Gao, Y Xiong et al. Nanoscale kinetics of asymmetrical corrosion in core-shell nanoparticles. Nat Commun, 9, 1011(2018).

    [97] H G Liao, D Zherebetskyy, H Xin et al. Facet development during platinum nanocube growth. Science, 345, 916(2014).

    [98] F K Wang, S J Yang, T Y Zhai. 2D Bi2Se3 materials for optoelectronics. iScience, 24, 103291(2021).

    [99] Q Li, J Lu, P Gupta et al. Engineering optical absorption in graphene and other 2D materials: Advances and applications. Adv Opt Mater, 7, 1900595(2019).

    [100] J Qiao, X Kong, Z X Hu et al. High-mobility transport anisotropy and linear dichroism in few-layer black phosphorus. Nat Commun, 5, 4475(2014).

    [101] C M O'Leary, C S Allen, C Huang et al. Phase reconstruction using fast binary 4D STEM data. Appl Phys Lett, 116, 124101(2020).

    [102] D J Flannigan, A H Zewail. 4D electron microscopy: principles and applications. Acc Chem Res, 45, 1828(2012).

    [103] S E Zeltmann, A Muller, K C Bustillo et al. Patterned probes for high precision 4D-STEM bragg measurements. Ultramicroscopy, 209, 112890(2020).

    [104] C Koch. Determination of core structure periodicity and point defect density along dislocations(2002).

    [105] J Su, M Wang, Y Li et al. Sub-millimeter-scale monolayer p-type H-phase VS2. Adv Funct Mater, 16, 2000240(2020).

    [106] Q Ji, C Li, J Wang et al. Metallic vanadium disulfide nanosheets as a platform material for multifunctional electrode applications. Nano Lett, 17, 4908(2017).

    [107] L Tao, K Chen, Z Chen et al. Centimeter-scale CVD growth of highly crystalline single-layer MoS2 film with spatial homogeneity and the visualization of grain boundaries. ACS Appl Mater Interfaces, 9, 12073(2017).

    [108] M Acerce, D Voiry, M Chhowalla. Metallic 1T phase MoS2 nanosheets as supercapacitor electrode materials. Nat Nanotechnol, 10, 313(2015).

    [109] D Teich, G Seifert, S Iijima et al. Helicity in ropes of chiral nanotubes: calculations and observation. Phys Rev Lett, 108, 235501(2012).

    [110] M S Y Tang, E P Ng, J C Juan et al. Metallic and semiconducting carbon nanotubes separation using an aqueous two-phase separation technique: a review. Nanotechnology, 27, 332002(2016).

    [111] J H Warner, Y C Lin, K He et al. Atomic level spatial variations of energy states along graphene edges. Nano Lett, 14, 6155(2014).

    [112] Z W Yin, W Zhao, J Li et al. Advanced electron energy loss spectroscopy for battery studies. Adv Funct Mater, 32, 2107190(2022).

    [113] A Pokle, J Coelho, E Macguire et al. EELS probing of lithium based 2D battery compounds processed by liquid phase exfoliation. Nano Energy, 30, 18(2016).

    [114] H Ali, C Maynau, L Lajaunie et al. Transmission electron microscopy and electron energy-loss spectroscopy studies of hole-selective molybdenum oxide contacts in silicon solar cells. ACS Appl Mater Interfaces, 11, 43075(2019).

    [115] A W Robertson, Y C Lin, S Wang et al. Atomic structure and spectroscopy of single metal (Cr, V) substitutional dopants in monolayer MoS2. ACS Nano, 10, 10227(2016).

    [116] Q M Ramasse, C R Seabourne, D M Kepaptsoglou et al. Probing the bonding and electronic structure of single atom dopants in graphene with electron energy loss spectroscopy. Nano Lett, 13, 4989(2013).

    [117] W Zhang, D H Seo, T Chen et al. Kinetic pathways of ionic transport in fast-charging lithium titanate. Science, 367, 1030(2020).

    [118] F S Hage, G Radtke, D M Kepaptsoglou et al. Single-atom vibrational spectroscopy in the scanning transmission electron microscope. Science, 367, 1124(2020).

    [119] Y A U Rehman, L M Po, M Liu. LiveNet: Improving features generalization for face liveness detection using convolution neural networks. Expert Syst Appl, 108, 159(2018).

    [120] Z Tong, G Tanaka. Hybrid pooling for enhancement of generalization ability in deep convolutional neural networks. Neurocomputing, 333, 76(2019).

    [121] S Zheng, C Wang, X Yuan et al. Super-compression of large electron microscopy time series by deep compressive sensing learning. Patterns, 2, 100292(2021).

    Zhiheng Cheng, Chaolun Wang, Xing Wu, Junhao Chu. Review in situ transmission electron microscope with machine learning[J]. Journal of Semiconductors, 2022, 43(8): 081001
    Download Citation