3D VR camera, visualize "Yesterday Once More"

09/11 2024 383

Written by VR Gyroscope Ran Qixing

Over the past few decades, the way people record their lives has undergone tremendous changes, evolving from text, voice, images to videos. With the emergence of new XR hardware represented by Apple Vision Pro and the further maturity of the supply chain, 3D immersive imaging is becoming a more "vivid" way of recording.

3D immersive imaging, with its unique three-dimensional experience, allows people to record and experience every wonderful moment in life in a more intuitive and vivid way. Similar to "spatial computing," it represents an upgrade in visual technology and a revolution in experience.

In June this year, Canon officially released the RF-S 3.9mm F3.5 STM DUAL FISHEYE lens, which is currently compatible with the APS-C sensor EOS R7 camera. The launch of this lens not only expands the EOS VR system's product line but also further lowers the barrier to entry for 3D VR imaging.

RF-S 3.9mm F3.5 STM DUAL FISHEYE product demonstration (screen recording content in AVP is slightly compressed)

Carve 3D memories with VR lenses, allowing the naked eye to experience "Yesterday Once More"

Advancements in XR head-mounted device technology and the development of image capture terminals are changing the way people record their lives. The birth of a professional 3D VR lens means that we are no longer merely recording life but redefining "recording" itself in an unprecedented way, exploring a brand-new visual narrative approach.

Image captured by Canon EOS R7 + RF-S 3.9mm F3.5 STM DUAL FISHEYE (screenshot from a 2D device)

Compared to traditional 2D images, 3D VR images provide a more three-dimensional visual experience by simulating binocular disparity. Of course, from a 2D dual-fisheye image display perspective, this sensation might not be as pronounced.

However, when I put on the Apple Vision Pro to view a scene of a "beach trip" with friends captured through Canon's 3D VR lens, I truly felt the significance of that moment.

Through a first-person 180-degree field of view, I felt like I was back at that evening, looking at the golden sand on the beach, hearing familiar laughter and the gentle sound of waves lapping against the shore. The glow from that kerosene lamp was so warm, reminiscent of "Yesterday Once More."

Final 3D imaging screenshot viewed within Apple Vision Pro (screenshot is slightly blurry, please refer to actual experience)

It made me want to run and experience the softness of the sand and the impact of the waves again, as if everything were within reach and so dreamlike.

This intense sense of immersion and interactivity is something I've never experienced in any other medium. It made me realize that 3D VR imaging is not just a new way of recording but also an emotional connector, bringing people closer together. Memories are no longer cold photos or videos but warm, emotional stories.

Scene captured by Canon EOS R7 + RF-S 3.9mm F3.5 STM DUAL FISHEYE

As a more three-dimensional form of recording, 3D VR cameras have become the choice of many users and families. They can not only record every moment of life but also preserve precious family gatherings, capturing every highlight in life.

144° Field of View, Easy to Use from Scratch, the Perfect Witness

With the development of VR technology, there are many 3D VR cameras and lenses available on the market, and Canon EOS R7 + RF-S 3.9mm F3.5 STM DUAL FISHEYE can be considered the most professional yet accessible combination.

Canon's RF-S 3.9mm F3.5 STM DUAL FISHEYE adopts a lens layout design close to the interpupillary distance of the human eye, with a baseline length of 60mm. Combined with a 144-degree ultra-wide-angle field of view, it can maximize the restoration of real scenes visible to the human eye.

Compared to traditional 180-degree 3D VR lenses, the 144-degree field of view of the RF-S 3.9mm F3.5 STM DUAL FISHEYE actually does a "subtraction" by reducing the problem of "giveaways" caused by too wide a field of view. In the past, 180-degree VR lenses often captured unnecessary ground, camera tripods, and other extraneous backgrounds, making post-production editing more difficult.

The 144-degree field of view, however, allows creators to capture desired content more easily while maintaining a relatively large field of view, eliminating cumbersome post-production processes. Meanwhile, by narrowing the field of view to 144°, the pixel density increases, providing higher image resolution even in 4K Fine mode.

During actual operation, with the support of Canon EOS R7 and the 144-degree field of view, users can easily capture desired 3D images with just one click. The RF-S 3.9mm F3.5 STM DUAL FISHEYE lens now supports autofocus, significantly reducing the hassle of manual focusing, making the shooting process more efficient and convenient. Autofocus ensures that the image remains clear, allowing users to focus on composition and creativity without worrying about technical details.

Additionally, the lens's maximum f/3.5 aperture effectively captures sufficient light in low-light environments. This is crucial for 3D VR shooting as good lighting conditions help reduce noise and improve image quality, resulting in more detailed and realistic final works. As shown in the evening beach image below, even as the sun sets and the environment darkens, the shot still captures the scene beautifully, highlighting the main subjects.

During use, I found that the camera and lens design are compact, with optimized ergonomic design. Together, they weigh approximately 900g (camera body 612g, lens 290g), making them suitable for lightweight travel.

In fact, this was my first time using Canon's EOS VR system to create 3D image content. I could complete the shooting almost without referring to the manual, relying solely on simple camera buttons. It's quite user-friendly, even for beginners.

The Canon EOS VR system is a comprehensive process that includes not only the camera body and lens but also post-production software support. The EOS VR Utility application simplifies the post-processing of VR content. Users can easily convert captured footage and photos into virtual reality (VR) images without complex post-production stitching and blending processes.

EOS VR Utility can also be considered a savior for unusable footage. Here's a 3D VR video I shot indoors. Due to the shooting angle, the original image had noticeable distortion, affecting both the subjects and the windows in the background, almost rendering it unusable.

However, after one-click horizontal correction in EOS VR Utility, the image was instantly restored, with subjects and surroundings displaying normally. It was simply amazing. Those with strong hands-on abilities can also click the manual horizontal correction below to adjust from three dimensions: translation, pitch, and roll.

Comparison before and after horizontal correction in EOS VR Utility

This is also a relatively lightweight software that runs smoothly on my low-end MacBook Air (M1), with low computer performance requirements. Compared to professional post-production software like Adobe Premiere Pro, the learning curve for EOS VR Utility is extremely low. Of course, EOS VR also has an Adobe Premiere Pro plugin, but due to limitations in my equipment and capabilities, I won't delve into that here.

After simple processing, EOS VR Utility can export 3D 180-degree and 3D 360-degree image content for viewing on XR devices, supporting multiple encoding formats.

EOS VR Utility workbench

Once the 3D VR image is successfully exported, we can transfer it to an XR device for viewing via AirDrop or USB file transfer. Upon putting on the device, you'll experience an unprecedented sense of immersion, as if truly placed within the captured scene, reliving the past from the camera's perspective.

The 4K 3D images processed by Canon's complete EOS VR system can be best showcased on XR devices. The oncoming waves and friends waving at you are all so natural and realistic.

Final 3D imaging screenshot viewed within Apple Vision Pro (screenshot is slightly blurry, please refer to actual experience)

Final 3D imaging screenshot viewed within PICO 4 Ultra (single eye, screenshot is slightly blurry, please refer to actual experience)

From Apple to Douyin, 3D imaging is becoming mainstream

With the official launch of Apple Vision Pro, 3D imaging technology is entering the public eye at an unprecedented pace.

Since July this year, Apple has been focusing on 3D 180-degree immersive content, releasing series such as "Boundless" and "Wild Life," with films, concerts, and sports events to be released throughout the year. As an XR device integrating advanced display technology and powerful computing capabilities, Apple Vision Pro not only marks a significant breakthrough in hardware but also leads a new trend in immersive content.

On the other hand, short video platforms like Douyin and Kuaishou are also seeking innovative increments and are fully compatible with 3D VR image playback. Users can view 180-degree 3D VR images on their mobile phones through gyroscopes and screen swipes. In the past, 3D VR images might have been considered a niche hobby limited to specific professionals or geek players. However, the development of the times has surpassed our expectations, and 3D imaging is gradually becoming a mainstream recording method.

Screenshot of 3D VR work on Douyin platform

In this process, 3D VR shooting tools become particularly important. Camera manufacturers represented by Canon are actively embracing the era of spatial computing, launching products like the RF-S 3.9mm F3.5 STM DUAL FISHEYE lens specifically designed for 3D VR image shooting. For the construction of the 3D content ecosystem, these professional devices are not only the hardware foundation but also the key driving force for the entire industry's forward development.

3D VR imaging is not just a form of imagery but also a bridge connecting the past and the future, allowing us to relive those precious moments in a more vivid and authentic way.

Therefore, if you are about to have a 'highlight moment' that needs to be recorded, you might as well try 3D VR video. By using the Canon EOS R7, which has a low threshold and is easy to operate, with the RF-S 3.9mm F3.5 STM DUAL FISHEYE lens, you can easily capture every wonderful moment in life and create 3D memories that can be 'revisited'.

Solemnly declare: the copyright of this article belongs to the original author. The reprinted article is only for the purpose of spreading more information. If the author's information is marked incorrectly, please contact us immediately to modify or delete it. Thank you.