Systems and methods are provided performing for low compute depth map generation by implementing acts of obtaining a stereo pair of images of a scene, downsampling the stereo pair of images, generating a depth map by stereo matching the downsampled stereo pair of images, and generating an upsampled depth map based on the depth map using an edge-preserving filter for obtaining at least some data of at least one image of the stereo pair of images.

Systems and methods are provided performing for low compute depth map generation by implementing acts of obtaining a stereo pair of images of a scene, downsampling the stereo pair of images, generating a depth map by stereo matching the downsampled stereo pair of images, and generating an upsampled depth map based on the depth map using an edge-preserving filter for obtaining at least some data of at least one image of the stereo pair of images.

A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.

An inventive device includes a multi-aperture imaging device comprising an image sensor; an array of adjacently arranged optical channels, each optical channel including an optic for projecting at least one partial field of view of a total field of view onto an image sensor area of the image sensor arrangement, a beam deflection means for deflecting an optical path of the optical channels, and a focusing means for setting a focal position of the multi-aperture imaging device. The device further comprises a control means configured to control the focusing means and to receive image information from the image sensor; the control means being configured to control the multi-aperture imaging device into a sequence of focal positions so as to capture a corresponding sequence of image information of the total field of view and to produce, from the sequence of image information, a depth map for the captured total field of view.

An inventive device includes a multi-aperture imaging device comprising an image sensor; an array of adjacently arranged optical channels, each optical channel including an optic for projecting at least one partial field of view of a total field of view onto an image sensor area of the image sensor arrangement, a beam deflection means for deflecting an optical path of the optical channels, and a focusing means for setting a focal position of the multi-aperture imaging device. The device further comprises a control means configured to control the focusing means and to receive image information from the image sensor; the control means being configured to control the multi-aperture imaging device into a sequence of focal positions so as to capture a corresponding sequence of image information of the total field of view and to produce, from the sequence of image information, a depth map for the captured total field of view.

A depth camera assembly (DCA) determines depth information for a local area. The DCA includes a camera assembly and at least one illuminator. The DCA may select a subset of the VCSELs to provide illumination at any given time. The illuminator may comprise near-field VCSELs configured to generate a structured light (SL) pattern for depth sensing in the near-field and far-field VCSELs configured to generate a SL pattern for depth sensing in the far-field. The near-field VCSELs may comprise a linear emission region which is shorter than a linear emission region of the far-field VCSELs. The DCA may generate and phase shift a quasi-sinusoidal SL pattern. The DCA may phase shift the quasi-sinusoidal SL pattern by alternating which traces on the illuminator are active.

An electronic device includes a display; a camera; a first light emitting module, wherein each of the camera and the first light emitting module comprises a first type polarizing filter; a second light emitting module including a second type polarizing filter that is different from the first type polarizing filter; and at least one processor configured to: obtain a first image by using the camera, based on a first light output from the first light emitting module and a second light output from the second light emitting module; identify at least one feature point in the first image; and control the display to display the first image and information related to the at least one feature point.

A mechanism is described for facilitating adaptive resolution and viewpoint-prediction for immersive media in computing environments. An apparatus of embodiments, as described herein, includes one or more processors to receive viewing positions associated with a user with respect to a display, and analyze relevance of media contents based on the viewing positions, where the media content includes immersive videos of scenes captured by one or more cameras. The one or more processors are further to predict portions of the media contents as relevant portions based on the viewing positions and transmit the relevant portions to be rendered and displayed.

There is provided an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data. A color shift correction data generation unit generates color shift correction data for correcting a color shift between two-dimensional image data of a base viewpoint and two-dimensional image data of a reference viewpoint. A metadata addition unit transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, encoded data of the two-dimensional image data of the base viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object and encoded data of the two-dimensional image data of the reference viewpoint and depth image data. The present disclosure can be applied, for example, to a synthesis apparatus.

There is provided an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data. A color shift correction data generation unit generates color shift correction data for correcting a color shift between two-dimensional image data of a base viewpoint and two-dimensional image data of a reference viewpoint. A metadata addition unit transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, encoded data of the two-dimensional image data of the base viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object and encoded data of the two-dimensional image data of the reference viewpoint and depth image data. The present disclosure can be applied, for example, to a synthesis apparatus.