H04N13/271

Systems and methods for model-based modification of a three-dimensional (3D) mesh

An illustrative method includes obtaining a three-dimensional (3D) mesh of a subject, obtaining a mesh model, and generating a hybrid mesh of the subject. The generating includes replacing a portion of the 3D mesh with the mesh model such that the hybrid mesh includes a non-replaced portion of the 3D mesh represented at a first resolution and the mesh model representing the replaced portion of the 3D mesh at a second resolution.

Systems and methods for model-based modification of a three-dimensional (3D) mesh

An illustrative method includes obtaining a three-dimensional (3D) mesh of a subject, obtaining a mesh model, and generating a hybrid mesh of the subject. The generating includes replacing a portion of the 3D mesh with the mesh model such that the hybrid mesh includes a non-replaced portion of the 3D mesh represented at a first resolution and the mesh model representing the replaced portion of the 3D mesh at a second resolution.

CAMERA MODULE

An embodiment of the present invention discloses a camera module including a light output unit configured to output an optical signal to an object; an optical unit configured to pass the optical signal reflected from the object; a sensor configured to receive the optical signal passed by the optical unit; and a control unit configured to acquire depth information of the object using the optical signal received by the sensor, wherein the sensor includes an effective area in which a light receiving element is disposed and an ineffective area other than the effective area and includes a first row region, in which the effective area and the ineffective area are alternately disposed in a row direction, and a second row region, in which the effective area and the ineffective area are alternately disposed in the row direction and the effective area is disposed at a position not overlapping the effective area of the first row region in a column direction, light that reaches the effective area of the first row region is controlled by first shifting control to reach the ineffective area of the first row region or the ineffective area of the second row region, and light that reaches the effective area of the second row region is controlled by the first shifting control to reach the ineffective area of the second row region or the ineffective area of the first row region.

Using time-of-flight techniques for stereoscopic image processing

The current disclosure describes a stereo imaging system that is configured to use Time-of-Flight (“Tof”) techniques to aid in stereoscopic image processing. One process disclosed uses ToF to aid in identifying the same elements (e.g., pixel clusters) in stereo image pairs by narrowing down search areas for matching. Another process uses ToF to aid in identifying the same elements in stereo image pairs where there a small amount texture making it difficult to find a match.

Using time-of-flight techniques for stereoscopic image processing

The current disclosure describes a stereo imaging system that is configured to use Time-of-Flight (“Tof”) techniques to aid in stereoscopic image processing. One process disclosed uses ToF to aid in identifying the same elements (e.g., pixel clusters) in stereo image pairs by narrowing down search areas for matching. Another process uses ToF to aid in identifying the same elements in stereo image pairs where there a small amount texture making it difficult to find a match.

SYSTEMS AND METHODS FOR INTERPOLATIVE THREE-DIMENSIONAL IMAGING WITHIN THE VIEWING ZONE OF A DISPLAY

Methods and systems for three-dimensional video capture are provided. A plurality of cameras (112) attached to a frame (108), each camera (112) configured to generate a three-dimensional array of pixels of a viewing zone of a display (110), may provide the arrays to an interpolator (122) executed by a processor (116) of a device (100). The interpolator (122) may combine the plurality of three-dimensional arrays of pixels from the plurality of cameras (112) into an output three-dimensional array of pixels for rendering locally at a display (110) or transmission to a remote device (102) for rendering at a display (110) of the remote device (102).

Systems and methods for vehicle guidance using depth map generation
11393350 · 2022-07-19 · ·

This disclosure relates to systems and methods for vehicle guidance. Stereo images may be obtained at different times using a stereo image sensor. A depth image may be determined based on an earlier obtained pair of stereo images. The depth image may be refined based on predictions of an earlier stereo image and a later obtained stereo image. Depth information for an environment around a vehicle may be obtained. The depth information may characterize distances between the vehicle and the environment around the vehicle. A spherical depth map may be generated from the depth information. Maneuver controls for the vehicle may be provided based on the spherical depth map.

CAMERA MODULE

A camera module according to an exemplary embodiment of the present invention comprises: a light emitting unit which outputs an optical signal to an object; a light receiving unit which collects the optical signal output from the light emitting unit and reflected from the object; a sensor unit which, through a plurality of pixels, receives the optical signal received by the light receiving unit; and an image processing unit which, by means of the optical signal, processes information received through a first pixel having a valid value and a second pixel having an invalid value indicating pixel saturation, wherein at least one of a plurality of pixels adjacent to the second pixel includes the first pixel, and the image processing unit generates a valid value of the second pixel on the basis of the valid value of the first pixel among the plurality of pixels adjacent to the second pixel.

CAMERA MODULE

A camera module according to an exemplary embodiment of the present invention comprises: a light emitting unit which outputs an optical signal to an object; a light receiving unit which collects the optical signal output from the light emitting unit and reflected from the object; a sensor unit which, through a plurality of pixels, receives the optical signal received by the light receiving unit; and an image processing unit which, by means of the optical signal, processes information received through a first pixel having a valid value and a second pixel having an invalid value indicating pixel saturation, wherein at least one of a plurality of pixels adjacent to the second pixel includes the first pixel, and the image processing unit generates a valid value of the second pixel on the basis of the valid value of the first pixel among the plurality of pixels adjacent to the second pixel.

IMAGING SYSTEM CONFIGURED TO USE TIME-OF-FLIGHT IMAGING AND STEREO IMAGING
20220247995 · 2022-08-04 ·

An imaging system is configured to use an array of time-of-flight (ToF) pixels to determine depth information using the ToF imaging method and/or the stereo imaging method. A light emitting component emits light to illuminate a scene and a light detecting component detects reflected light via the array of ToF pixels. A ToF pixel is configured to determine phase shift data based on a phase shift between the emitted light and the reflected light, as well as intensity data based on an amplitude of the reflected light. Multiple ToF pixels are shared by a single micro-lens. This enables multiple offset images to be generated using the intensity data measured by each ToF pixel. Accordingly, via a configuration in which multiple ToF pixels share a single micro-lens, depth information can be determined using both the ToF imaging method and the stereo imaging method.