Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1 -- 2594 2023-05-11 11:15:53 |
2 format correct -1 word(s) 2593 2023-05-12 04:07:59 | |
3 format correct Meta information modification 2593 2023-05-12 04:08:32 |

Video Upload Options

Do you have a full video?

Confirm

Are you sure to Delete?
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Jiao, J.; Zhao, L.; Pan, W.; Li, X. Applications of Intelligent SWaP3 Cameras. Encyclopedia. Available online: https://encyclopedia.pub/entry/44143 (accessed on 25 June 2024).
Jiao J, Zhao L, Pan W, Li X. Applications of Intelligent SWaP3 Cameras. Encyclopedia. Available at: https://encyclopedia.pub/entry/44143. Accessed June 25, 2024.
Jiao, Jingjie, Lixing Zhao, Wenhao Pan, Xiaoyan Li. "Applications of Intelligent SWaP3 Cameras" Encyclopedia, https://encyclopedia.pub/entry/44143 (accessed June 25, 2024).
Jiao, J., Zhao, L., Pan, W., & Li, X. (2023, May 11). Applications of Intelligent SWaP3 Cameras. In Encyclopedia. https://encyclopedia.pub/entry/44143
Jiao, Jingjie, et al. "Applications of Intelligent SWaP3 Cameras." Encyclopedia. Web. 11 May, 2023.
Applications of Intelligent SWaP3 Cameras
Edit

Driven by the constantly evolving and iterative SWaP3, manufacturers have focused on some advanced directions such as miniaturization, lightweight, high performance (high-resolution, hyperspectral), and intelligence of IRCs. In applications such as surveillance globalization satellites and much strategic military equipment, the requirement for performance is unlimited. Additionally, the focus of scenarios dominated by high performance is to improve time resolution, spatial resolution, spectral resolution, and other core performance parameters such as sensitivity, frame rate, signal-to-noise ratio, as well as the degree of intelligence of the imaging devices. 

infrared camera intelligent SWaP3

1. Introduction

At present, due to the improvement of infrared detection and imaging technology, intelligent infrared detection and imaging products gradually tend to “SWAP”, namely size, weight, and power consumption. “SWAP” along with the high-performance (such as band, spectral information, signal-to-noise ratio, dynamic range, field of view (FOV), resolution, etc.) and the low-price constitute the new concept of “SWaP3[1], as shown in Figure 1. SWaP3 reflects the current market variation tendency from the pursuit of ultimate performance to product availability, usability, manufacturability, and cost performance.
Figure 1. The concept diagram of SWaP3.
Intelligent SWaP3 cameras are now widely used in military fields, including military equipment, space remote sensing (RS) of key targets, space-sensitive target surveillance, planetary exploration, and in civil fields such as medical thermal imaging and temperature measurement, agricultural production, industrial security monitoring, forestry disaster prevention, and living entertainment [2]. The ultimate goal of current product development is to reduce the size, weight, power, and cost while meeting the performance requirements of the camera as much as possible. In terms of spaceborne applications, the microsatellite and CubeSat, with relatively lower weight, volume, and cost, shorter development cycles, and more widely applicable scenarios, have been rapidly developed in recent years. At the same time, with the rise of new materials and the continuous improvement of the detector, electronics, optical and other technologies, the corresponding payloads aboard the satellites above have also made breakthroughs, and micro miniaturization is gradually gaining attention [3]. Additionally, the miniaturization of imaging payloads undertaking critical tasks is one of the major difficulties during the micro miniaturization of payloads [4]. In ground scenarios, more and more applications tend to the edge scene, so small size, portability, low research and development (R&D) cost, mass production, and low power consumption have become the main demands nowadays. Additionally, the requirements for lightweight, power consumption, and cost of camera systems are getting higher and higher [5]. Therefore, the technical methods for each element of “SWaP3” are especially critical.
There are many universities, research institutes, and companies around the world focusing on the R&D of cameras led by SWaP3. In 2011, aiming at significantly reducing the size, weight, power, and production costs of uncooled cameras [6], DARPA initiated a Low-Cost Thermal Imager-Manufacturing (LCTI-M) program, in which DRS provided solutions for the LCTI-M program [7]. In particular, in terms of material, a silicon integration scheme was adopted. For the optical system, DRS eliminated most discrete components and used chip-level optics. In electronics, DRS is partitioned according to the electronic functions and uses state-of-the-art low-power FPGAs and memory devices. Additionally, in terms of packaging technology, a new 3D wafer-level package was adopted to achieve miniaturization. Finally, the solutions mentioned above facilitated the development of the SWaP3 module. BAE Systems developed the Stacked Modular Architecture High-Resolution Thermal (SMART) chip camera to reach the LCTI-M index requirements [8]. The SMART chip camera is manufactured using a wafer-on-wafer process. BAE Systems used a ROIC and an ASIC chip to reduce the size, which does not affect the FPA performance. Additionally, BAE Systems used wafer-level vacuum packaging to realize miniaturization. In addition, in recent years, DARPA also proposed a number of programs related to the R&D of intelligent SWaP3 infrared imaging equipment. The programs including the limits of thermal sensors (LOTS), focal arrays for curved infrared imagers (FOCII), and Blackjack all contain the objectives developing high-performance, small size, low weight, power and price detector chip, camera or satellite imaging payload. As shown in Table 1, in addition to DARPA, the organizations, agencies, and companies with strong capabilities in development of detector and camera including Leonardo DRS, BAE, ESA, NASA, Arizona Space Institute, FLIR, Sofradir, and Semi-Conductor Devices (SCD) have done a lot of works in the R&D of SWaP3 cameras.
Table 1. Technical indicators and characteristics of typical intelligent SWaP3 infrared cameras (IRCs) around the world in recent years.
At present, intelligent SWaP3 IRCs are gradually applied to edge scenarios with the extensive application of AI, embedded, and other technologies. Additionally, the cameras are increasingly focused on lightweight and low power consumption while improving their performance. However, it should be noted that the lightweight and miniaturization of the camera are contradictory to the improvement of the resolution, FOV, and other performance parameters. Therefore, how to find the right balance among these elements is a critical task for the development of intelligent SWaP3 IRCs. Currently, in almost all the scenarios, the overall development idea of new intelligent SWaP3 cameras is to realize miniaturization, low power consumption, and high reliability on the premise of achieving the target function and performance, but according to different application requirements, the emphasis is different. What is more, in terms of spaceborne applications, radiation resistance should also be considered.

2. Applications

2.1. Military and Scientific Field

The applications of intelligent SWaP3 cameras in the military and scientific fields can be divided into ground-level applications and space-borne applications. The former includes surveillance and reconnaissance, detection, identification, and tracking of key targets and military weapons development, and the latter consists of RS of sensitive objects, planetary and space exploration, and spaceborne surveillance. Many devices, including reconnaissance and surveillance cameras, are gradually developing in the direction of SWaP3. Additionally, various intelligent image processing and optimization algorithms are effectively deployed at the edge.
In ground-level military systems, intelligent SWaP3 cameras are used in many scenarios, including military infrared vision enhancement equipment, maritime target surveillance, and target tracking. However, researchers focus on the space military and scientific domain. The intelligent SWaP3 cameras are widely used in the monitoring and inspection of satellites themselves (including the monitoring of solar panels, antennas, and other key payloads) and in-orbit service with visual support (including the monitoring of critical events such as docking and separation of spacecraft) [3]. In the ESA’s BepiColombo program, the spacecraft carried a set of BepiColombo Selfie Cameras consisting of three MCAMs (micro-cameras) developed by MCSE, which are attached to a CAM Box (an interface box). The full name of the camera is MCAMv3 Digital Space Micro-Camera, and it is a multi-functional, modular, radiation-resistant SWaP3 module suitable for harsh environments. Furthermore, the system is responsible for capturing images of solar panel deployment during the LEOP (Launch and Early Orbit Phase) and the core module MTM (Mercury Transfer Module) MEPS (Micro-Satellite Electric Propulsion System) during the cruise phase. Additionally, the system can also be used for planetary surface photography [11][12][13]. As shown in Figure 2, in the European radar imaging satellite Sentinel-1A of the Copernicus program, MCSE also developed a Monitoring Camera System [14] with three miniature cameras and control processing units to monitor the deployment of solar panels and antennas during LEOP. Furthermore, one camera of the system is dedicated to the observation of the Earth with a weight of 110 g, power consumption of 1.8 W, and a large FOV of 70°.
Figure 2. Deployment of Sentinel-1A’s cameras and images taken by the Monitoring Camera System [15][16].
What is more, in planetary research, intelligent SWaP3 cameras can be used to photograph the surface of planets or deep-space targets for research and analysis; in space debris detection and identification, SWaP3 cameras can detect foreign objects such as space debris and collect information from them to take avoidance measures or record them for research. In terms of space situation awareness, SWaP3 cameras can realize the identification and monitoring of various space targets such as high and low-orbit satellites (including active and abandoned satellites) and approaching satellites. Then the cameras obtain information and data from the above satellites, thus avoiding space collisions and conducting autonomous sensing and detection of in-orbit threats for avoidance or countermeasures. In regard to extraterrestrial planet detection, there are many intelligent SWaP3 IRCs developed for rover systems applying for exploration of Mars, the Moon, etc., which usually undertake tasks such as surface environment detection and analysis of planets [17][18][19].

2.2. Civil Field

Intelligent SWaP3 cameras have wide applications in the civil field, including security monitoring, assisted driving, vehicle vision enhancement, and disaster prevention. For example, microthermal imaging cameras for monitoring abnormal areas of equipment are used in daily preventive testing. Additionally, in product R&D and electronics manufacturing, developers often use high-precision detectors to test and assess. Additionally, temperature guns are used for medical temperature measurement. Moreover, infrared imaging has the characteristics of long working distance and high imaging contrast, and it can work without external light sources, and IR imaging is less affected by abnormal weather. So, the IRC can be used as an auxiliary supplement to enhance the visual effect for high-performance and miniaturized monitoring edge equipment. Huawei “XMC” (extra, magic, credible) series [20] intelligent SWaP3 surveillance cameras use supplementary infrared light for auxiliary visual enhancement in addition to its own super starlight imaging capabilities. This series product can realize perimeter intrusion detection and behavior analysis.
Intelligent SWaP3 cameras are also widely used in agriculture. Unispectral’s Monarch is the first portable edge-end tunable spectral NIR SWaP camera in the world [21]. In the camera, Unispectral’s proprietary tunable Fabry–Perot filter (μFPF) and miniature IR camera module (including optics, image sensor, and controller) are integrated together on a 60 × 40 × 14.5 mm PCB. Furthermore, the module weighs 30 g in total and consumes less than 0.85 W, simplifying spectral imaging and eliminating the need for a bulky, complex, and expensive spectrometer. Additionally, it facilitates instant detection, monitorization, and classification. It has a wide range of prospects in agricultural scenarios, such as pest control, grading, and classification, as well as industrial and commercial scenarios.
In terms of medical scenarios, intelligent SWaP3 cameras can be used to detect body temperature in a non-contact, rapid, and non-hazardous way, which is suitable for the screening of large numbers of people. In recent years, infrared thermography and TIR products have been widely used during epidemics. In addition, intelligent SWaP3 IRCs can be used to assist in surgeries or medical examinations for achieving intelligent medical treatment along with many devices equipped with high technology. For example, the infrared radiation of the human body can be captured and converted into a dedicated thermogram by a small and light camera, thus facilitating the localization and detection of lesions, which can provide a basis for clinical diagnosis. Furthermore, the smaller size and lower weight of SWaP3 cameras can be used in more complex and difficult medical scenarios such as gastrointestinal examinations. The SWaP3 cameras can achieve more clear monitoring of lesions and accomplish more reliable and on-time localization of difficult diseases such as cancer. Then, doctors can save lives by taking medical measures or doing operative planning in advance.
Moreover, hyperspectral imaging (HSI) devices are wildly used in medical fields. HSI can acquire both two-dimensional spatial information and one-dimensional spectral information of an object with a high spectral resolution, thus enabling the identification of various pathological conditions. It can provide a wealth of spectral information about patients’ tissue samples or disease sites. As a non-contact optical diagnostic technology, HSI can detect the distribution of lesions in body skin tissues, ex vivo cancer tissues, and organs such as eyes and teeth. It can play an important role in medical diagnostic scenarios such as cancer, heart diseases, retinal lesions, and dental diseases. In addition to medical diagnostic scenarios, HSI holds great promise for disease mechanism research and even surgery assistance. Compared with general imaging methods, HSI can acquire both image and spectral information, with the advantages of a wider range of bands, higher spectral resolution, and more comprehensive information acquisition. So, HSI can provide more accurate and dimensional information of the disease site in spatial and spectral dimensions. Not only can HSI obtain external information such as size and shape that can also be identified by other detection imaging methods, but HIS can also get the differentials of the internal structure. It also has a very high sensitivity. However, due to the effect of too much information and overlong processing time, it is difficult to achieve rapid diagnosis in real-time. Therefore, how to capture effective information quickly by fusing algorithms is one of the main research directions currently. In addition, there are few HSI devices and mass-produced products that are actually used for medical detection, and even the existing products are often very large in size and difficult to adapt to the needs of medical conditions. The main reason is that it is difficult to develop hyperspectral products for SWaP3-constrained platforms, which makes them inconvenient to be used in the actual diagnosis and surgery assistance. Therefore, developing SWaP3 HSI instruments with higher performance is an important direction for R&D in the field of medical devices.

References

  1. Ye, Z.; Chen, Y.; Zhang, P. Overview of latest technologies of HgCdTe infrared photoelectric detectors. Infrared Technol. 2014, 35, 8.
  2. Mai, L. Outline on development and application of FPA thermal imaging sets. Infrared Technol. 2006, 28, 497–502.
  3. Pan, C.; Cang, L.; Luo, M.; Tao, L.; Chen, S.; Chen, B.; Bai, Z.; Cui, H.; Xu, C.; Zhao, J. Development status and application of space infrared camera optical technology. Infrared Technol. 2022, 44, 9.
  4. Jiao, B. Status and trends of development of satellite-based compact CCD cameras. Space Electron. 1995, 7, 34–40.
  5. Ye, Z.; Li, H.; Wang, J.; Chen, X.; Sun, C.; Liao, Q.; Huang, A.; Li, H.; Zhou, S.; Lin, J. Recent hotspots and innovative trends of infrared photon detectors. J. Infrared Millim. Waves 2022, 41, 15–39.
  6. Dhar, N.K.; Elizondo, L.A.; Dat, R.; Elizondo, S.L. Advanced imaging systems programs at DARPA MTO. In Proceedings of the Infrared Sensors, Devices, and Applications III, San Diego, CA, USA, 19 September 2013; p. 886802.
  7. Li, C.; Han, C.; Skidmore, G.D.; Cook, G.; Kubala, K.; Bates, R.; Temple, D.; Lannon, J.; Hilton, A.; Glukh, K. Low-cost uncooled VOx infrared camera development. In Proceedings of the Infrared Technology and Applications XXXIX, Baltimore, MD, USA, 29 April–3 May 2013; pp. 465–474.
  8. Sengupta, L.; Auroux, P.-A.; McManus, D.; Harris, D.A.; Blackwell, R.J.; Bryant, J.; Boal, M.; Binkerd, E. BAE systems’ SMART chip camera FPA development. In Proceedings of the Infrared Technology and Applications XLI, Baltimore, MD, USA, 8 June 2015; pp. 338–344.
  9. Yue, T.; Zhang, H.; Huang, C.; Chen, X. The application of Chang’ E-2 CMOS camera technologies. Space Recovery Remote Sens. 2011, 32, 12–17.
  10. Pack, D.; Ardila, D.; Herman, E.; Rowen, D.; Welle, R.; Wiktorowicz, S.; Hattersley, B. Two aerospace corporation CubeSat remote sensing imagers: CUMULOS and R3. In Proceedings of the 31st Annual AIAA/USU Conference on Small Satellites, Logan, UT, USA, 4–10 August 2017.
  11. Schulz, R.; Benkhoff, J. BepiColombo: Payload and mission updates. Adv. Space Res. 2006, 38, 572–577.
  12. Benkhoff, J.; Van Casteren, J.; Hayakawa, H.; Fujimoto, M.; Laakso, H.; Novara, M.; Ferri, P.; Middleton, H.R.; Ziethe, R. BepiColombo—Comprehensive exploration of Mercury: Mission overview and science goals. Planet. Space Sci. 2010, 58, 2–20.
  13. Benkhoff, J.; Murakami, G.; Baumjohann, W.; Besse, S.; Bunce, E.; Casale, M.; Cremosese, G.; Glassmeier, K.-H.; Hayakawa, H.; Heyner, D. BepiColombo-mission overview and science goals. Space Sci. Rev. 2021, 217, 90.
  14. Krag, H.; Serrano, M.; Braun, V.; Kuchynka, P.; Catania, M.; Siminski, J.; Schimmerohn, M.; Marc, X.; Kuijper, D.; Shurmer, I. A 1 cm space debris impact onto the sentinel-1a solar array. Acta Astronaut. 2017, 137, 434–443.
  15. ESA. BepiColombo Monitoring Cameras. Available online: https://www.esa.int/ESA_Multimedia/Images/2018/10/BepiColombo_monitoring_cameras (accessed on 21 March 2023).
  16. ESA. BepiColombo’s first images from space. Available online: https://www.esa.int/ESA_Multimedia/Images/2018/10/BepiColombo_s_first_images_from_space (accessed on 21 March 2023).
  17. Li, F. Development of small infrared camera on board. Space Recovery Remote Sens. 2004, 25, 5.
  18. Thangavelautham, J.; Asphaug, E.; Dektor, G.; Kenia, N.; Uglietta, J.; Ichikawa, S.; Choudhari, A.; Herreras-Martinez, M.; Schwartz, S. An Interplanetary CubeSat Mission to Phobos. In Proceedings of the 48th Annual Lunar and Planetary Science Conference, The Woodlands, TX, USA, 20–24 March 2017; p. 1707.
  19. Schwartz, S.; Nallapu, R.T.; Gankidi, P.; Dektor, G.; Thangavelautham, J. Navigating to Small-Bodies Using Small Satellites. In Proceedings of the 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS), Monterey, CA, USA, 23–26 April 2018.
  20. Huawei. Available online: https://www.huawei.com (accessed on 21 March 2023).
  21. Unispectral. Available online: https://www.unispectral.com/product/monarch-nir-pcb/ (accessed on 21 March 2023).
More
Information
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register : , , ,
View Times: 340
Revisions: 3 times (View History)
Update Date: 12 May 2023
1000/1000
Video Production Service