Wide field-of-view (FOV) optics are essential components in many optical systems, with applications spanning imaging, display, sensing, and beam steering. Conventional refractive wide FOV optics often involve multiple stacked lenses, resulting in large size and weight as well as high cost. Metasurface lenses or metalenses promise a viable solution to realizing wide FOV optics without complex lens assembly. We review the various architectures of wide FOV metalenses, elucidate their fundamental operating principles and design trade-offs, and quantitatively evaluate and contrast their imaging performances. Emerging applications enabled by wide FOV metasurface optics are also discussed.

- Advanced Photonics
- Vol. 5, Issue 3, 033001 (2023)
Abstract
Author Presentation Playback
1 Introduction
Field of view (FOV) is an essential metric for gauging the performance of optical systems. In an imaging instrument, having a wide-FOV (WFOV) allows capturing the surrounding scene in a single frame without image stitching or mechanical scanning. Therefore, WFOV imaging optics are extensively applied in photography, microscopy, biomedical diagnosis, navigation and control, three-dimensional (3D) sensing, security surveillance, and beyond.1 Optical reciprocity stipulates that WFOV systems can also be used for light or image projection, a much sought-after feature enabling wide-angle beam steering and immersive displays for augmented/virtual reality (AR/VR) devices, automotive sensors, gaming simulators, and movie theaters.
Traditional WFOV optics used in these applications are based on refractive lenses. As the angle of incidence (AOI) of light with respect to optical axis increases, the angle-dependent monochromatic Seidel aberrations—coma, astigmatism, and field curvature—are exacerbated on top of on-axis spherical aberration. To suppress these aberrations, the conventional solution involves distributing the light-bending power over multiple refractive surfaces in stacked compound lenses, which, however, comes at the expense of system size, weight, cost, and complexity.
Optical metasurfaces, which comprise arrays of subwavelength structures (often termed “meta-atoms”),2
Sign up for Advanced Photonics TOC. Get the latest issue of Advanced Photonics delivered right to you!Sign up now
Here, we take a deep dive into the field of WFOV metalenses, deliberating on their design approaches, underlying physics, performance characteristics, and potential applications. This article is organized as follows. We start by defining a set of standardized performance metrics for WFOV lenses to facilitate comparison between different architectures on an equal footing. Etendue conservation as a fundamental design constraint governing WFOV lenses will also be highlighted and quantified. Next, we review various metasurface architectures that have been pursued to expand the FOV of optical systems and quantitatively evaluate their performance. Analytical solutions for several designs will be formulated, providing a computationally efficient design approach in place of traditional numerical optimization based on polynomial expansion. We then proceed to discuss applications in consumer electronics, biomedicine, beam steering, immersive display,32 and defense, where WFOV meta-optics are likely going to make a significant impact. Finally, promising future research directions that can further enhance and expand the functionalities of WFOV meta-optical systems are presented.
2 Performance Metrics Characterizing WFOV Optics
2.1 Optical Performance Parameters
At the optical component level, the optical performance of a WFOV lens is measured by a set of classical parameters characterizing: (1) resolution, such as point spread function (PSF), modulation transfer function (MTF), or the Strehl ratio; (2) diffraction efficiency, defined as the fraction of optical power impinging on the lens aperture that contributes to the PSF;33 (3) stray background formally characterized by the veiling glare index (VGI)34 (since most literature on metalenses does not report VGI, the ratio of diffraction efficiency over bulk transmission efficiency of the optics provides a rough measure of glare); and (4) distortion.
While the performance measures may appear straightforward, care must be taken in their interpretation. First, we note that (angular) FOV, which is generally defined as the angular extent that an optical system can image, is a parameter pertinent to the entire optical system (e.g., the imaging sensor size) and therefore is not included in the list above. At the component level, the angle-dependent PSF, diffraction efficiency, and distortion provide full information to assess the angular performance of the optics alone. When the FOV figure is quoted to characterize a lens in literature, it is usually associated with the angular range where the optics resolution remains above a certain threshold, e.g., the diffraction limit (
Second, we want to stress that full width at half-maximum (FWHM) of focal spot, which does not account for stray background or sidelobes, is not a proper measure of lens resolution, as correctly pointed out by other authors.33
Third, care must be taken in quantifying and interpreting optical efficiency figures of WFOV optics. The ambiguity is twofold. On the one hand, the canonical definition of diffraction efficiency can be challenging to implement in practical measurements or even in simulations for lenses with significant stray background. This is because the spatial extent of nonzero PSF can be difficult to determine due to background noise or overlap with specular (zeroth-order) transmission in experiments. Moreover, the concept of PSF associated with first-order diffraction ceases to be meaningful, even in modeling, if the stray background spans multiple diffraction orders. In this case, another parameter “focusing efficiency,” defined as the fraction of optical power encircled within a certain area around the focal spot over the total incident power, is often quoted as a less rigorous proxy.33 One should bear in mind that there is considerable ambiguity regarding the metric due to the different encircled areas quoted (sometimes with severe PSF truncation). On the other hand, WFOV optics is unique in that all WFOV lenses must restrict the entrance pupil (either via a physical or a virtual aperture stop) to conserve etendue (Sec. 2.3). When one quotes efficiency numbers, they are customarily normalized to optical power incident on the entire physical area of the first optic in a compound lens. As a result, the efficiency figures may be artificially suppressed; nonetheless, one should bear in mind that this is an artifact due to the presence of the aperture stop and should not be interpreted as poor optical quality of WFOV optics. In this regard, a better measure of the light-collection capability of WFOV lenses is the area of the physical aperture times the diffraction or focusing efficiency.
Last, but not least, distortion is an important metric only becoming significant in WFOV imaging systems. In WFOV systems, distortion is often inevitable, since distortion must be introduced during nonlinear mapping of the scene from a spherical angular space to a flat image plane. Unlike other third-order Seidel aberrations, distortion does not necessarily reduce the information in an image and can be computationally removed without losing image resolution, provided that it is not too large.35 However, when strong distortion is present, for example, near the edge of the field for most WFOV systems, the angular resolution along the meridional orientation can be compromised (Note S1 in the Supplemental Material). Therefore, specification of distortion, which in the case of an azimuthally symmetric optical system can be characterized by the dependence of image height (i.e., focal spot position) on the field angle, is important in gauging the imaging performance of WFOV optics.
2.2 Volumetric Channel Density
The basic parameters outlined above do not include nonoptical metrics such as size, even though size reduction of optical systems represents a major advantage of emerging optical technologies exemplified by metasurfaces. To account for both optical performance and compactness, a compound metric, VCD, was recently proposed by Ma et al.36 and is defined as
The VCD parameter also provides a simple (as compared to full AOI-dependent PSF/MTF prescriptions) and quantitative metric to gauge the angle-dependent performance of imaging optics. For an imaging system equipped with a given optic, its VCD becomes a function of FOV, where the latter is defined by the image sensor size. An FOV larger than what the optic can properly handle inevitably results in blurring at the edges of the field and a drop of VCD. The VCD versus FOV curve, therefore, offers a direct visual representation of the angle-dependent imaging performance of the underlying optic.
Figure 1 shows the
Figure 1.A VCD versus FOV plot comparing the VCD of several metalens designs (the blue and red solid lines correspond to optimized metalens doublets with 1-mm and 10-mm focal lengths, respectively), the empirical limit of conventional optics (purple dotted line), and those of ideal imaging systems following rectilinear projection (yellow and green solid lines assume a flat image sensor and a curved image sensor, respectively). Adapted from Ref.
One limitation with the VCD metric is that it specifies monochromatic optical performance and disregards chromatic aberration. It also only applies to single-aperture systems, whereas multiaperture design provides a path to expanding FOV. We shall elaborate further on both aspects in the paper.
2.3 Etendue Conservation and Its Implications
Before we unveil different WFOV architectures, we would like to spotlight etendue conservation as one universal constraint that applies to all WFOV designs. The conservation law stipulates that for a WFOV imaging optic, the etendue at the image plane (or at an intermediate optical aperture) must be equal to (or greater than, when imperfect refraction or reflection takes place, e.g., with diffuse scattering) that at the entrance aperture. Given the large acceptance angle of a WFOV optic, etendue conservation essentially implies that the image is considerably larger than the entrance pupil. This is illustrated in the classical fisheye lens design example in Fig. 2. It shows that for all incident angles, only a small fraction of light rays arriving at the first optic are collected by the imaging array. In other words, the presence of an aperture stop far smaller than the physical size of the lenses is a common trait of WFOV optics.
Figure 2.An exemplary classical fisheye lens design (Nikkor 6 mm
To quantify the impact of etendue conservation, Fig. 3 plots the size (diameter) ratio between the image and the entrance pupil as a function of FOV for different effective numerical aperture (NA) values. The curves assume etendue conservation, and therefore practical designs can only situate in regions on or above the curve with the corresponding effective NA. These curves allow a designer to immediately determine the required image sensor dimensions to capture a full FOV image based on entrance pupil size and target
Figure 3.The curves plot size ratio between the image and the entrance pupil versus FOV for lenses with varying NAs calculated based on etendue conservation. The points correspond to experimentally validated designs from Ref.
In summary, well-designed WFOV optics, whether classical or meta-optical, preserve etendue. Consequently, WFOV optics are characterized by an entrance pupil size smaller than the cross-sectional area of the optical system. This characteristic can have a major impact on the nominal optical efficiencies of WFOV systems, as we alluded to in Sec. 2.1.
3 Optical Metasurfaces: All Roads that Lead to WFOV Optics
The canonical metalens design assumes a hyperbolic phase profile to convert an incident plane wave to a spherical wavefront. The phase profile is given as20
Design type | FOV (deg) | Focusing | Effective | Physical | Wavelength | |
Singlet with an aperture stop | >170 | 32 to 45 | 0.24 | 1 | 5200 | |
Quadratic phase singlet | >170 | 3.5 | 0.27 | 2 | 532 | — |
Metalens doublet | 50 | 50 | 0.44 | 0.31 | 532 | |
Metalens doublet | 60 | 70 | 0.49 | 0.8 | 850 | |
Metalens with angular phase control |
Table 1. A representative selection of WFOV metalens demonstrations: numbers only theoretically predicted without experimental validation are marked in boldfaced.
Design architecture | Advantages | Limitations |
Singlet with an aperture stop | Simple architecture, large FOV | Significant distortion at large AOIs, moderate NA |
Quadratic phase singlet | Simple architecture, large FOV | Large glare (stray background), significant distortion at large AOIs, limited resolution |
Metalens doublet | Enhanced aberration correction capability | Increased complexity, significant distortion at large AOIs |
Metalens with angular phase control | Ultrathin profile, high focusing quality | Complex design and fabrication |
Multiaperture array | Distortion suppression | Curtailed optical throughput, requiring computational processing |
Table 2. Summary of comparison between different WFOV metalens architectures.
3.1 Singlet Flat Optics with an Aperture Stop
A simple architecture to increase the FOV of a flat lens involves placing an aperture stop in front of a flat metasurface (or DOE), as shown in Fig. 4(a). Light entering the aperture is spatially dispersed depending on the AOI, and as a result beams incident at different angles interact with different (yet continuous) portions of the metasurface. The rays are then focused onto a flat image plane in a (near-)telecentric configuration, whose significance will be revealed in our subsequent analysis. This scheme therefore allows angle-dependent engineering of the metasurface phase profile to suppress aberrations.
Figure 4.(a) A WFOV lens comprising an aperture stop in front of a single-layer metasurface: the different colors label light rays incident from varying AOIs. Image courtesy of Shalaginov et al.
Dating back to the early 19th century,45 the baseline design of an aperture coupled with a refractive lens was known to the photographic instrumentation community as a “landscape lens.” Its DOE-based flat optics embodiment was explored in the 1980s by Bobrov and Greishkh46,47 and Buralli and Morris.48 Based on the architecture, Grulois et al.49 fabricated a low-profile infrared (IR) camera, where a multiple-order DOE lens was used to imprint the optical phase profile to extend the spectral bandwidth. The metasurface counterparts of the landscape lens were theoretically investigated by Kalvach and Szabó50 and later experimentally implemented by Engelberg et al.,51 who further successfully deployed the lens to capture an outdoor image under filtered natural illumination. In these embodiments, the aperture and the DOE/metasurface are separated by an air gap, which restricts the attainable FOV due to rapid divergence of the DOE/metasurface size at large AOIs.
This limitation can be overcome by replacing the air gap with a solid substrate. Shalaginov et al.40,52 applied this approach to significantly expand the FOV of metalenses, demonstrating a flat fisheye lens with record
Figure 5.A flat fisheye metalens with
Design of the single-layer WFOV flat lens incorporating an aperture stop can be performed following an analytical formalism,59 which also provides critical insights into working principles and design trade-offs of this architecture. The theory presents a closed-form expression of the phase function
We have validated that the equations can precisely reproduce the aforementioned designs (for all literature examples whose detailed design prescriptions are available). Equation (5) can be approximated with a simple quadratic phase function, albeit only for coincidental parameter combinations,59 which explains why quadratic phase profiles have been successfully adopted in selected designs.51 In more general cases, Eq. (5) represents the optimal solution for suppression of spherical and comatic aberrations.
The ideal stigmatic focusing condition used to obtain Eq. (5) is only rigorously satisfied in the limit of infinitesimal aperture size. The theory further derives the root-mean-square wavefront error
This important expression explicitly relates lens performance to design parameters, including focal length
3.2 Singlet Metalenses with a Quadratic Phase Profile
It is well known that the classical hyperbolic phase profile eliminates on-axis spherical aberration but suffers from severe off-axis coma aberration.61,62 This sensitivity to off-axis aberration can be alleviated by resorting to a phase distribution that is invariant with respect to incident angle change. A quadratic phase function assuming the following form fulfills this requirement,
Equation (8) indicates that the phase profile can be regarded as the same parabolic function as Eq. (7) (neglecting the constant phase term) but laterally shifted along the
The quadratic phase concept was first proposed by Pu et al.63 and later on also numerically investigated by other authors.64
Figure 6.Images taken with (a) a singlet lens with quadratic phase and (b) a singlet lens with hyperbolic phase. (c) Picture of the USAF resolution chart used in the experiment with the corresponding FOVs highlighted by the circles. (d) Measured transmission (dotted lines) and focusing efficiencies (dashed and solid lines) versus AOI for both polarizations. The focusing efficiency is normalized with respect to both total incident power on the entire metasurface (solid lines) and the transmission power (dashed lines). The focusing efficiencies were evaluated by integration of energy in the focal spot using a circular aperture with a radius of
One important characteristic of the quadratic phase lens is the existence of a virtual aperture. This can be understood by noticing that the phase gradient of a quadratic function [Eq. (7)] increases linearly with
Despite its conceptual simplicity and elegance, one drawback of the quadratic singlet design is that it incurs large spherical aberration, resulting in significant stray background as well as low focusing efficiency. To quantitatively assess the impact of spherical aberration, we numerically investigated the performance of a metalens with a quadratic phase profile defined by Eq. (7), where
Figure 7(a) shows the simulated optical intensity distribution on the optical axis. Unlike a hyperbolic phase lens, which produces a single intensity peak localized on the focal plane, Fig. 7(a) shows an oscillatory intensity profile because of the spherical aberration. We also note that the peak intensity point does not locate on the nominal focal plane
Figure 7.Simulated intensity distributions of a quadratic phase singlet metalens (black colored) and a singlet metalens with a physical aperture stop (rosewood colored): (a) along the optical axis and (b) on the transverse planes corresponding to peak on-axis intensity. The
3.3 Stacked Doublet Metalenses
Additional design degrees of freedom can be introduced by adding a second metasurface or DOE to the single-layer designs discussed above to form doublet flat lenses. The doublet configuration is schematically shown in Fig. 8(a), which consists of two layers of cascaded metasurfaces. To understand its working principle, an intuitive explanation has been formulated, which we are paraphrasing here.61,72 In this design, the bottom metasurface carries the main focusing power, and the top metasurface functions as a phase corrector analogous to a Schmidt plate in classical refractive optics [Fig. 8(b)], designed to have a phase distribution that neutralizes the spherical aberration of the bottom lens at normal incidence. Following an intuitive and insightful theoretical treatment introduced by Martins et al.,72 the bottom metasurface assumes a quadratic phase profile given by Eq. (7) [blue solid line in Fig. 9(a)]. To correct the on-axis spherical aberration, the top metasurface (marked as green rectangles in Fig. 9) must carry a phase profile [green dotted line in Fig. 9(a)] that compensates for the difference between the quadratic phase and the aberration-free hyperbolic phase [Eq. (2), orange solid line in Fig. 9(a)]. Provided that the spatial gradient of the top metasurface phase function is small, the phase profile remains almost unchanged after propagating through the substrate. Therefore, it is simply vertically displaced and superimposed onto the bottom metasurface phase, as shown in Fig. 9(a).
Figure 8.Schematic doublet lens designs for expanding the FOV. (a) Metalens doublet containing two metasurface layers on two sides of a substrate. (b) A classical doublet analog comprising a Schmidt plate for phase correction and a focusing lens. Images courtesy of Groever et al.
Figure 9.Schematic diagram explaining the aberration suppression mechanism of a doublet metalens. Images courtesy of Martins et al.
At oblique incidence, two changes to the optical phase distribution are introduced compared with the normal incidence case. First, the obliquely incident beam carries an additional in-plane linear phase gradient, which, combined with the quadratic phase [Eq. (7)], yields a laterally displaced quadratic phase profile [Eq. (8), blue solid line in Fig. 9(b)]. The top metasurface phase is also projected to a laterally shifted, off-center position as shown in Fig. 9(b). A laterally offset hyperbolic phase distribution [orange solid line in Fig. 9(b)] can be recovered when the lateral displacements of the bottom metasurface quadratic phase and the top metasurface correcting phase are aligned, thus producing a sharp focal spot in a telecentric configuration.
The superior wide-field performance of the doublet lens compared with a singlet following the classical hyperbolic phase profile is evident from Fig. 10, which compares their monochromatic imaging characteristics. While the two designs both generate aberration-free, sharp images at normal incidence, only the doublet effectively mitigates blurring due to coma aberration in off-axis imaging. In addition to single-wavelength operation, achromatic doublet metalenses have been proposed by coupling the design with meta-atom dispersion engineering.71,73,74 The doublet architecture has also been theorized to offer subdiffraction focusing with expanded FOV.75 Beyond doublets, triplet metalenses have also been demonstrated to suppress both monochromatic and chromatic aberrations.76
Figure 10.Imaging performance comparison between a doublet metalens and a singlet metalens with the classical hyperbolic phase profile. (a), (b) Images taken with (a) the doublet and (b) the singlet lenses. (c), (d) Measured MTFs of (c) the doublet and (d) the singlet lenses. Images courtesy of Arbabi et al.
3.4 Angular Phase Control in Nonlocal Metasurfaces
The WFOV design approaches discussed so far are based on ray optics and have not actively exploited the potential to tailor an angle-dependent optical phase profile—a capability unique to nonlocal metasurfaces.77 The basic principle of angular phase control is to engineer the metasurface’s phase distribution
Figure 11(a) shows the cross-sectional layout of a cylindrical, monochromatic metalens comprising five layers of Si patterns designed using TO.95 The optical phase profile of the lens is dependent on the AOI, as shown in Fig. 11(d), and the phase profiles agree well with the ideal phase functions required for aberration-free focusing at the AOIs. Modeled focal spot profiles in Figs. 11(b) and 11(c) indicate that the lens can indeed achieve sharp focusing at the four AOIs as designed. In addition to optimizing for monochromatic focusing at discrete AOI values, the TO-based design can also support achromatic operation over a continuous angular range. As an example, an
Figure 11.A metalens designed with angular phase control. (a) The lens consists of five layers of silicon (black) embedded in an
Compared with other WFOV metalens designs, this scheme uniquely allows an ultrathin profile approaching the fundamental thickness limit of WFOV optics without compromising focusing quality. The presence of the thickness limit can be rationalized by considering the angular memory effect:96 when a light beam incident on a disordered medium is tilted, the transmitted wavefront remains identical in shape, albeit tilted by the same angle, provided that the input wave vector change is smaller than approximately one over the medium thickness. The angular memory effect stipulates that the metasurface optics must be sufficiently thick to accommodate a phase profile that sensitively depends on the AOI. Li et al.97 formulated a lower bound of metalens thickness
For typical metalenses with
3.5 Multiaperture Optics
Geometric aberrations pertinent to WFOV imaging can also be alleviated by dividing up the FOV into a multitude of subsegments and using a separate set of optics to address each sub-FOV. The subimages are then stitched together computationally to capture the full WFOV scene. This multiaperture scheme has been implemented with refractive microlens arrays100
Figure 12.Multiaperture design examples. (a) Schematic depiction of a 1-D metalens array, where each metalens is designed to cover a segment of the horizontal FOV. (b) A WFOV system based on a lenslet array coupled with meta-gratings for FOV rotation. Images courtesy of Chen et al.
The key advantage of the multiaperture scheme is that each imaging element can be individually optimized to attain minimal aberration and distortion within a small sub-FOV. The main limitation is the reduction of optical throughput: for an imager that divides the FOV to
3.6 Nonplanar Metasurfaces
The approaches discussed thus far have all relied upon metasurfaces or DOEs on a flat plane commensurate with standard microfabrication technologies. Recent advances have enabled fabrication of optical and optoelectronic devices on curved surfaces, either via direct writing techniques109
4 WFOV Metalens Applications: A Panoramic View
As an emerging optics technology, practical industrial applications of metasurfaces are starting to surface. Over the past few years, the community has converged upon several potential beachhead markets of optical metasurfaces where their critical benefits—system-level SWaP advantages, minimal monochromatic aberration, polarization discrimination capacity, and low-cost at scale—are fully mobilized. As a subset of metasurface optics, WFOV metalenses consolidate the leading SWaP advantage, which is unparalleled by conventional optics offering the same wide-angle view. In the following, we will focus on several selected applications motivated by the unique combination of WFOV and superior SWaP metrics, where the metalens technology is most likely to make significant practical impacts.
4.1 3-D Sensing
3-D depth sensing is a rapidly expanding market with broad applications in mobile and consumer electronic devices, automotive electronics, robotics, unmanned aerial vehicles, industrial automation, and AR/VR. FOV is a critical performance metric for 3-D sensors, and WFOV is an essential feature for many applications. For example, AR devices require depth information from 3-D sensors to enable the computer-generated elements to merge seamlessly with the surrounding scenes.125 A WFOV matching that of human vision is thus necessary to render an immersive user experience. Near-surface gesture recognition and sensing for advanced driver-assistance systems in vehicles are among other use cases where the WFOV capability is mandated.
There are three main categories of 3-D sensing technologies: (passive and active) stereo, structured light, and time-of-flight. Except for passive stereo, all other types of sensors use a combination of projection optics for active illumination of the scene, and imaging optics to capture the reflected light and reconstruct the depth information. Since the active illumination light sources are monochrome (near-IR LEDs or VCSELs), 3-D sensing represents a volume market where chromatic aberration—a major challenge facing metasurface optics—can be largely discounted. It is therefore not surprising that several metasurface start-ups have chosen 3-D sensing as their beachhead market. For instance, Metalenz unveiled Orion™ in 2021, a metasurface-based projection optic claiming simpler architecture, a compact form factor, and high resolution.126 Metasurface projection optics targeting 3-D sensing applications have also been reported by several other groups.127
Metalenses are promising candidates for WFOV imaging optics in 3-D sensors. With diffraction-limited performance, they can enable panoramic 3-D sensing with unprecedented spatial resolution. For example, a diffraction-limited
4.2 Biomedical Imaging
Similar to 3-D sensing, WFOV, high resolution, and compact form factor are also highly coveted features in minimally invasive or point-of-care biomedical imaging. A case in point is endoscopic imaging. Endoscopes with a restricted FOV require their operators to constantly move and refocus them, which complicates the endoscopy procedure considerably. Conventional endoscopes use convex refractive lenses or gradient refractive index (GRIN) lenses as the light-collecting elements, whose large size hampers miniaturization of endoscopic probes [Fig. 13(a)]. The challenge is exacerbated for WFOV endoscopes, which involve complex compound lenses or lens arrays with an even larger footprint.132
Figure 13.WFOV metalenses for endoscopy. (a) Schematics comparing endoscopes based on (top) convex lenses, (middle) GRIN lenses, and (bottom) metalenses. (b) A metalens doublet design demonstrating enhanced wide-field performance compared to a singlet design: (left) ray tracing simulations and (right) spot diagrams comparing the two designs. Note that image magnification of the doublet is twice of that of the singlet. Images courtesy of Liu et al.
To address the issue, Liu et al. adapted the doublet metalens design to create a meta-objective that can be used in conjunction with a fiber bundle microscope for endoscopy imaging.131 Ray-tracing simulation results shown in Fig. 13(b) attest to the doublet’s off-axis aberrations suppression capability compared with a single metalens design. At 525-nm wavelength and
In addition to replacing traditional optics on classical endoscopes, metalenses have also been applied to advanced endoscopic imaging modalities. Pahlevaninezhad et al.135 pioneered a class of fiber-optic catheters using metalenses for endoscopic optical coherence tomography. More recently, the same group developed a bijective metalens configuration to circumvent the classical trade-off between resolution and depth of field in tomography imaging.136 Coherent Raman scattering and stimulated emission depletion endoscopic imaging based on metalenses have also been explored.137,138 Emerging techniques facilitating integration of metasurfaces on fiber facets also envisage novel miniaturized endoscopic probes with enhanced and versatile imaging capabilities.139
Endoscopy is only one example highlighting the potential applications of WFOV metalenses in the biomedical imaging arena. Other promising use scenarios include portable or miniature microscopy,145 wide-field retinal imaging, and 3-D microscopy.146
4.3 Beam Steering and Projection Display
Following the reciprocity principle, the WFOV lenses can also be used as an “inverse imaging” instrument, projecting point sources or patterns on the focal plane to form directional collimated beams or far-field images. The former capacity and beam steering constitute the key optical function indispensable to light detection and ranging (lidar), free-space optical communications, and remote sensing. The latter underlies various projection display technologies, such as heads-up and near-eye displays.151
Chip-scale beam steering has recently emerged as a disruptive technology boasting high speed, low power consumption, and superior ruggedness compared with the traditional mechanical scanners.155 The leading nanophotonic beam-steering platform is an optical phased array (OPA), which dynamically modulates the optical phase gradient across an aperture to change the beam propagation direction. An OPA can be implemented using photonic integrated circuits156,157 or active metasurfaces,158
Lens-assisted beam steering (LABS) is an alternative mechanism ideally suited for WFOV beam scanning.164
Figure 14.Schematic LABS device layout. Image courtesy of Li et al.
Figure 15.(a) Schematic top-view of the Luneburg-lens based beam steering device. (b) Schematic showing output from a waveguide feeds into the 2-D Luneburg lens which collimates the beam in-plane. Images courtesy of Kim et al.
By placing a microdisplay at its focal plane, a WFOV metalens can be turned into a light engine in heads-up or near-eye display. In display, the WFOV advantage is profound for applications such as AR/VR, where a large FOV matching that of human vision is essential to rendering an immersive user experience.32 A light engine based on WFOV metalenses can either directly cast images onto a screen or funnel light into a waveguide-based display.173
4.4 Video Surveillance Systems
WFOV video surveillance systems constructed around classical refractive compound lenses are already widely deployed in both defense and civilian applications, such as military reconnaissance, security surveillance, and motion and activity monitoring. These applications can be classified into two categories according to the scene illumination source, i.e., natural light (including infrared emissions from objects) versus active illumination sources (most commonly, LEDs, and in some cases, VCSELs). For the former, the main technical challenge comes from the broadband nature of the source and chromatic aberration of metalenses, which demands dispersion engineering of the metasurface and/or image postprocessing, as we shall discuss further in Sec. 5. In thermal imaging, perceptive tolerance to chromatic aberration is enhanced in the absence of wavelength (e.g., RGB) discrimination.174 When active illumination is used, chromatic aberration is alleviated, (Additional spectral filtering may still be necessary when LED illumination sources are used, especially when emission wavelength fluctuations of LEDs due to manufacturing variations and temperature changes are taken into account.) and the primary bottleneck facing metalenses becomes their limited aperture size, since geometric aberrations scale with the optics dimensions. To maintain adequate resolution and SNR, metalens-based surveillance systems are best suited for short-distance applications, such as driver monitoring system, eye tracking, or biometric identification.60 Compared with traditional refractive or wafer-level micro-optics adopted in these use cases, metalenses offer the advantages of enlarged FOV, reduced number of elements, ultracompact form factor, and ease of direct integration onto CMOS image sensors.
5 Future Paths through the Lens of Meta-Optics
The applications outlined in Sec. 4 continue to motivate new advances in the field of WFOV meta-optics. Here, we spotlight a few promising directions where the technological advances are well poised to enhance performance, introduce new functionalities, and expand the application scope of WFOV meta-optics.
5.1 Broadband Operation
Metalenses, similar to DOEs, are known to suffer from severe chromatic aberrations due to “wrapping” of a modulo
Achromatic WFOV metalenses can similarly be assembled from dispersion-engineered meta-atoms. The bandwidth limitation applies equally to these achromatic WFOV metalenses, which have been analyzed by Shastri and Monticone.177Figure 16 shows the bandwidth bound for flat WFOV metalenses with zero distortion (i.e., image height
Figure 16.Bandwidth bounds for WFOV dispersion-engineered achromatic metalenses. Here,
Unlike dispersion engineering, which seeks to fulfill a set of predefined phase profiles at different wavelengths, alternative approaches to realize achromaticity resort to optimizing the phase discontinuity between zones178 or arraying of meta-atoms.58 Unconstrained by the ideal phase profiles, these approaches can transcend the aforementioned bandwidth bound, albeit at the expense of focusing quality, since aberrations are inevitably introduced. As an example, Yang et al.58 designed an achromatic
Despite the fact that several broadband or multiwavelength designs have been proposed for WFOV metalenses,57,58,71,73,74,44 few attempts have been made on their experimental demonstration.76,183 In addition, developing new achromatic designs and architectures, for instance, leveraging inverse design and novel nonlocal metasurface architectures, as well as innovating processing methods of meta-atom structures with ultrahigh aspect ratios184 to extend the accessible group delay, represent two other promising directions toward broadband WFOV metalenses.
5.2 Hybrid Metasurface-Augmented Optics
While useful as standalone optical elements, the application scope of metasurfaces can be significantly broadened once they can be seamlessly integrated with traditional refractive, reflective, or diffractive optics. Such metasurface-augmented optics can circumvent intrinsic performance limits confronting metasurfaces. For instance, coupling refractive and metasurface optics can surpass the spectral bandwidth bound, where refractive optics provide large group delay and the metasurface compensates the refractive chromatic aberration;185
In the context of WFOV lenses, such hybrid optics boast performances well exceeding those attainable with either a planar metasurface or classical optics alone. To illustrate the advantage of hybrid optics, here we present and compare two exemplary WFOV meta-optics designs: the first is a meta-optics design using only planar metasurfaces and the second is a hybrid design integrating conformal metasurfaces. As shown in Fig. 17, both designs have four metasurfaces: the all-planar design consists of two flat substrates with metasurfaces on each side of the substrates, and the hybrid meta-optic consists of two hybrid lenses with metasurfaces on the curved surfaces of each lens. The two structures assume the same specifications as follows: a 3-mm aperture stop positioned at the first optical surface, an
Figure 17.Comparison between all-planar and hybrid meta-optics. (a) Design and ray trace simulation of an all-planar meta-optic. (b)–(d) Simulated MTFs of the planar meta-optic across 100-deg FOV for 750, 1150, and 1550 nm wavelengths. (e) Design and ray trace simulation of a hybrid meta-optic. (f)–(h) Simulated MTFs of the hybrid meta-optic across 180-deg FOV for 750, 1150, and 1550 nm wavelengths.
With similar dimensions, the state-of-the-art near-IR refractive optical systems for 3-D sensors in mobile or consumer electronics typically employ at least four aspheric lenses (i.e., eight optical surfaces or more) and are usually constrained by FOVs of
As the example proves, conformal integration of metasurfaces on curved surfaces will significantly boost system performance. Moreover, the capability also permits decoupling of optical functions with geometric shapes, as the latter is often dictated by nonoptical considerations, such as aerodynamic or ergonomic factors. One integration route involves fabrication of metasurfaces on stretchable elastomer substrates followed by attachment onto curved surfaces.112,190,191 Laser/electron-beam writing109
5.3 Active Tuning
The optical properties of active metasurfaces can be dynamically modulated in response to external mechanical, electrical, optical, thermal, chemical, or magnetic stimuli.193
The optical zoom metalens with variable FOV is an example empowered by such multifunctional metasurface optics. Conventional designs rely on moving refractive lens groups with respect to each other to produce zoom, which adds to system size, cost, and complexity. Figure 18 presents a zoom metalens design consisting of two cascaded reconfigurable metasurfaces, which can be switched between a wide-angle mode with 40 deg FOV and a telephoto mode with 4 deg FOV.209 The design is parfocal, i.e., the focal plane position is fixed in space during optical zoom, which differs from varifocal lenses, whose focal plane shifts as their effective focal length changes.210 The reconfigurable metasurface was implemented with two mechanisms, polarization multiplexing using meta-atoms with in-plane anisotropy and structural transition in a low-loss optical phase change material
Figure 18.(a), (b) Schematic illustration of the doublet zoom metalens configuration in the (a) wide-angle mode and (b) telephoto mode. MS-1 and MS-2 label the front and back metasurfaces, respectively. (c), (d) Ray trace simulation of the polarization-multiplexed zoom metalens in the (c) wide-angle mode and (d) telephoto mode. All the units are in mm. Images captured by the zoom metalens in the (e) wide-angle mode (scale bars: 10-deg FOV) and (f), (g) telephoto mode (scale bars: 1-deg FOV). Images courtesy of Yang et al.
A tunable WFOV meta-optics front end can also be coupled with computational reconstruction to acquire information beyond what is accessible to a conventional imager. As shown in Fig. 19, the reconstruction can be performed in a general tunable linear optical system receiving an optical input whose light intensity is given in the form of a flattened 1-D vector
Figure 19.End-to-end optimization of both the meta-optical front end and the reconstruction algorithm to minimize reconstruction error in computational imaging. Image courtesy of Arya et al.
Equation (10) comprises a set of linear equations. Generally speaking, the matrix
To obtain optimal reconstruction quality, both the tunable optics front end and the reconstruction algorithm used to solve Eq. (10) must be jointly optimized.217,218 This optimization problem has been approached by Arya et al.,215 numerically demonstrating depth-resolved 3-D imaging utilizing a reconfigurable metasurface optics front end. Leveraging the “end-to-end” optimization framework, angular aberrations can be corrected by modeling the spatially varying PSF in the computational backend in both diffractive optics219 and metalenses.220 The same framework can also be applied to extracting spatial, spectral, angular, depth, and/or polarization information to enable multifunctional meta-optical imagers with dramatically enhanced intelligence capabilities.
6 Concluding Remarks
For decades, WFOV optics have been synonymous with bulky and complicated multilens assembly. The advent of metasurfaces is set to transform the field, enabling flat WFOV lenses that are compact and lightweight while offering exceptional optical quality with drastically reduced element count. WFOV imaging and sensing therefore also epitomize an emerging area where optical metasurface technologies are most likely to make significant practical impacts. In light of the growing importance of this dynamic field, this tutorial presents a comprehensive overview of different WFOV metalens designs, analyzes the intrinsic performance trade-offs of various WFOV metalens architectures, spotlights promising applications of WFOV metalens technologies, and envisages future directions where important technological advances will likely emerge. To conclude, we foresee that exciting applications will come to fruition in this wide-open space as we embrace imminent new developments and innovations of WFOV metalens technologies over the next few years.
Tian Gu is a Research Scientist and Principal Investigator at Materials Research Laboratory and Department of Materials Science and Engineering at MIT. His research interests involve metasurface optics, integrated photonics, and photonic materials. Dr. Gu is a recipient of the SPIE Rising Researcher Award, R&D; 100 Award, TechConnect National Innovation Award, among others. He has served on the conference program committees for CLEO, IEEE Summer Topicals Meeting, IEEE Photonics Conference, Optical Interconnects Conference, SENSORS, International Congress on Glass, CPV-X, etc. He also serves on the Editorial Board of Scientific Reports.
Juejun Hu is currently the John F. Elliott Professor of Materials Science and Engineering at MIT. His research primarily focuses on integrated optics and photonics. Prof. Hu has authored and coauthored more than 150 refereed journal publications, and he has been recognized with the SPIE Early Career Achievement Award, the Robert L. Coble Award from the American Ceramic Society, the Vittorio Gottardi Prize from the International Commission on Glass, the NSF CAREER award, and the DARPA Young Faculty Award, among others. Hu is a fellow of SPIE, Optica, and the American Ceramic Society.
Biographies of the other authors are not available.
References
[1] S. Gao et al. Review on panoramic imaging and its applications in scene understanding(2022).
[3] X. Ni et al. Broadband light bending with plasmonic nanoantennas. Science, 335, 427(2012).
[24] S. Wang et al. Broadband achromatic optical metasurface devices. Nat. Commun., 8, 187(2017).
[25] S. Shrestha et al. Broadband achromatic dielectric metalenses. Light Sci. Appl., 7, 85(2018).
[31] F. Balli et al. A hybrid achromatic metalens. Nat. Commun., 11, 3892(2020).
[32] J. Kim et al. Scalably manufactured high-index atomic layer-polymer hybrid metasurfaces for high-efficiency virtual reality metaoptics in the visible(2022).
[38] A. W. Lohmann. Scaling laws for lens systems. Appl. Opt., 28, 4996-4998(1989).
[39] Y. Shimizu. Wide angle fisheye lens(1973).
[45] Wollaston Landscape Lens, .
[47] S. T. Bobrov, G. T. Greishkh. High resolution projection lenses using diffractive elements. Avtometriya, 6, 3-7(1985).
[52] M. Y. Shalaginov et al. A single-layer panoramic metalens with > 170° diffraction-limited field of view(2019).
[76] S. Shrestha, A. Overvig, N. Yu. Multi-element meta-lens systems for imaging, FF2B.8(2019).
[82] S. Molesky et al. Inverse design in nanophotonics. Nat. Photonics, 12, 659-670(2018).
[95] Z. Lin et al. Topology-optimized multilayered metaoptics. Phys. Rev. Appl., 9, 044030(2018).
[97] S. Li, C. W. Hsu. Thickness bound for nonlocal wide-field-of-view metalenses(2022).
[106] Z. Zang et al. Planar multi-aperture fish-eye lens using metagrating(2021).
[115] J. Burch et al. Conformable holographic metasurfaces. Sci. Rep., 7, 4520(2017).
[117] M. Born, E. Wolf. Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light(2000).
[121] T. Zentgraf et al. Plasmonic Luneburg and Eaton lenses. Nat. Nanotechnol., 6, 151-155(2011).
[126] Metalenz launches Orion, the world’s simplest, most compact dot pattern projector.
[133] C.-W. Chiang et al. Dual view capsule endoscopic lens design. Opt. Express, 23, A15-A26(2015).
[140] J. Yang et al. Photonic crystal fiber metalens. Nanophotonics, 8, 443-449(2019).
[143] J. E. Froech et al. Real time full-color imaging in a meta-optical fiber endoscope(2022).
[151] G. Y. Lee et al. Metasurface eyepiece for augmented reality. Nat. Commun., 9, 4562(2018).
[154] S. Lan et al. Metasurfaces for near-eye augmented reality. ACS Photonics, 6, 864-870(2019).
[157] X. Sun et al. Si photonics for practical LiDAR solutions. Appl. Sci., 9, 4225(2019).
[163] T. Gu et al. Active metasurfaces: lighting the path to commercial success(2022).
[166] J. J. Lopez et al. Planar-lens enabled beam steering for chip-scale LIDAR, SM3I.1(2018).
[171] S. Kim et al. Luneburg lens for wide-angle chip-scale optical beam steering, SF3N.7(2019).
[173] S. M. Kamali, E. Arbabi, A. Faraon. Metasurface-based compact light engine for AR headsets. Proc. SPIE, 11040, 1104002(2019).
[176] J. Engelberg, U. Levy. Achromatic flat lens performance limits. Optica, 8, 834-845(2021).
[183] Y. Liu et al. Broadband behavior of quadratic metalenses with a wide field of view(2022).
[184] M. Shalaginov, D. H. Werner, S. D. Campbell, L. Kang et al. Dancing angels on the point of a needle: nanofabrication for subwavelength optics. Nanoantennas and Plasmonics: Modelling, Design and Fabrication, 381-443(2020).
[189] A comprehensive list of 3D sensors commonly leveraged in ROS development.
[193] O. Quevedo-Teruel et al. Roadmap on metasurfaces. J. Opt., 21, 073002(2019).
[206] S. C. Malek et al. Active nonlocal metasurfaces. Nanophotonics, 10, 655-665(2021).
[209] F. Yang et al. Reconfigurable parfocal zoom metalens. Adv. Opt. Mater., 10, 2200721(2022).
[211] Y. Zhang et al. Broadband transparent optical phase change materials, JTh5C.4(2017).
[215] G. Arya et al. End-to-end optimization of metasurfaces for imaging with compressed sensing(2022).

Set citation alerts for the article
Please enter your email address