A depth acquisition device includes memory and processor performing: acquiring, from the memory, intensities of infrared light emitted from a light source and measured by imaging with the infrared light reflected on a subject by pixels in an imaging element; generating a depth image by calculating a distance to the subject as a depth for each pixel based on an intensity received by the pixel; acquiring, from the memory, a visible light image generated by imaging, with visible light, a substantially same scene with a substantially same viewpoint and at a substantially same timing as those of imaging the infrared light image; detecting, from the visible light image, an edge region including an edge along a direction perpendicular to a direction of movement of the visible light image; and correcting, in the depth image, a depth of a target region corresponding to the edge region in the depth image.

An accuracy improvement device 1 of the present embodiment includes: a painting processing unit 13 that generates a segmentation image obtained by painting each of a plurality of regions in an RGB image to be processed, with a designated color, on the basis of a segmentation result obtained by dividing the RGB image to be processed into the plurality of regions, and a smoothing processing unit 15 that uses the segmentation image as a guide image to execute edge retention smoothing processing on a depth map estimated from the RGB image to be processed.

The methods and systems described herein provide for depth-aware image editing and interactive features. In particular, a computer application may provide image-related features that utilize a combination of a (a) the depth map, and (b) segmentation data to process one or more images, and generate an edited version of the one or more images.

A dot array illuminator includes an illumination source that includes one or more source arrays and a microlens array (MLA). A source array is an array of light emitting components. The source arrays are positioned on a substrate according to a geometric configuration. The MLA includes lens arrays that are arranged in a similar geometric configuration. The microlens array are separated from the source arrays by a distance and are substantially parallel to the source arrays. The microlens array overlaps with the source arrays and is of a dimension such that it can receive substantially all light emitted by the illumination source. The illumination source emits light towards the MLA. The MLA receives the light and outputs structured pattern light by interpolating received light.

A dot array illuminator includes an illumination source that includes one or more source arrays and a microlens array (MLA). A source array is an array of light emitting components. The source arrays are positioned on a substrate according to a geometric configuration. The MLA includes lens arrays that are arranged in a similar geometric configuration. The microlens array are separated from the source arrays by a distance and are substantially parallel to the source arrays. The microlens array overlaps with the source arrays and is of a dimension such that it can receive substantially all light emitted by the illumination source. The illumination source emits light towards the MLA. The MLA receives the light and outputs structured pattern light by interpolating received light.

A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.

A three dimensional system including rendering with variable displacement.

A three dimensional system including rendering with variable displacement.