First row: The subjects. Second row: Patterns captured by the sensor. Remaining rows: The reconstructed images.
Every photographer knows this truth: When it comes to cameras and gear, things can get huge—and fast. Especially in the lens department. Though mirrorless was first touted as the smaller, lighter alternative to chunky DSLRs (and in some ways, they do still hold to that promise), it’s hard to ignore the fact that these once-promising lightweight systems can quickly become bogged down with glass. And while lenses have been a part of the photographic process since, well, the very beginning, groundbreaking research by a group of scientists at the Tokyo Institute of Technology could lead to new lensless imaging systems and eventually, a lensless future.The team at Tokyo Tech has proposed a new image reconstruction method using a mathematical algorithm. The hardware consists of a mask and image sensor, with the mask encoding the incident light (light that falls on the subject), which then casts patterns on the sensor.
The team at Tokyo Tech has proposed a new image reconstruction method using a mathematical algorithm. The hardware consists of a mask and image sensor, with the mask encoding the incident light (light that falls on the subject), which then casts patterns on the sensor
Looking at these patterns, the human eye would be unable to decipher any usable information—everything is rendered as incomprehensible blobs, similar to the mark left when you throw spaghetti on the wall or go Jackson Pollock on a canvas. However, the optical algorithm is able to decode the information, yielding fairly accurate results. “Without the limitations of a lens, the lensless camera could be ultra-miniature, which could allow new applications that are beyond our imagination,” says Prof. Masahiro Yamaguchi of Tokyo TechHow it worksThe team has pioneered a technology they call Vision Transformer (ViT), which can learn image features in what they describe as a “hierarchical” fashion, thereby avoiding the traditional CNN processing. This means direct reconstruction, with no iterative calculations needed, and a reduction in approximation errors.
Where CNN relied on local pixel information, ViT can use global features in an image. According to experiments, the process is viable and the proposed camera creates high-quality images with a processing time that would enable real-time capture.
“The ultimate goal of a lensless camera is being miniature-yet-mighty. We are excited to be leading in this new direction for next-generation imaging and sensing solutions,” says the lead author of the study, Mr. Xiuxi Pan of Tokyo Tech.
Tokyo Tech researchers propose novel technology
The team at Tokyo Tech has proposed a new image reconstruction method using a mathematical algorithm. The hardware consists of a mask and image sensor, with the mask encoding the incident light (light that falls on the subject), which then casts patterns on the sensor.
Without the limitations of a lens, the lensless camera could be ultra-miniature, which could allow new applications that are beyond our imagination,” says Prof. Masahiro Yamaguchi of Tokyo Tech.
The ultimate goal of a lensless camera is being miniature-yet-mighty. We are excited to be leading in this new direction for next-generation imaging and sensing solutions,” says the lead author of the study, Mr. Xiuxi Pan of hjotography
You must be logged in to post a comment.