Advancements in high-resolution imaging technologies for immersive media

Immersive media is gaining increasing attention for its ability to deliver highly realistic and engaging experiences through enveloping visual environments. To advance its realization, we have developed a novel 360-degree camera system capable of capturing ultra-high-resolution 30K videos. The system features a pentagonal prism structure equipped with six elemental cameras, enabling uniform high-resolution imaging in all directions. Furthermore, we are developing scene-adaptive imaging technologies that dynamically adjust capture modes in different areas of the frame according to the subject characteristics. A newly developed image sensor allows control of capture modes in 4×4-pixel units at 4K resolution. This enables high-quality capture of diverse subjects with varying motion and brightness across a wide field of view, such as 360-degree videos. This paper introduces recent advancements in imaging architectures for realizing next-generation immersive media applications.