A system and a method are disclosed for a structured-light system to estimate depth in an image. An image is received in which the image is of a scene onto which a reference light pattern has been projected. The projection of the reference light pattern includes a predetermined number of particular sub-patterns. A patch of the received image and a sub-pattern of the reference light pattern are matched based on either a hardcode template matching technique or a probability that the patch corresponds to the sub-pattern. If a lookup table is used, the table may be a probability matrix, may contain precomputed correlations scores or may contain precomputed class IDs. An estimate of depth of the patch is determined based on a disparity between the patch and the sub-pattern.

A system and a method are disclosed for a structured-light system to estimate depth in an image. An image is received in which the image is of a scene onto which a reference light pattern has been projected. The projection of the reference light pattern includes a predetermined number of particular sub-patterns. A patch of the received image and a sub-pattern of the reference light pattern are matched based on either a hardcode template matching technique or a probability that the patch corresponds to the sub-pattern. If a lookup table is used, the table may be a probability matrix, may contain precomputed correlations scores or may contain precomputed class IDs. An estimate of depth of the patch is determined based on a disparity between the patch and the sub-pattern.

An apparatus for handling an emergency situation in a vehicle comprises: a control device; and a camera system that provides a 3D video of the interior of the vehicle. The control device transmits, to a mobile edge computing (MEC) server, information about a camera parameter set related to the camera system while the vehicle is driving. When an emergency event related to the vehicle is detected, the control device transmits, to the MEC server, a 3D video encoded on the basis of the camera parameter set.

An apparatus for handling an emergency situation in a vehicle comprises: a control device; and a camera system that provides a 3D video of the interior of the vehicle. The control device transmits, to a mobile edge computing (MEC) server, information about a camera parameter set related to the camera system while the vehicle is driving. When an emergency event related to the vehicle is detected, the control device transmits, to the MEC server, a 3D video encoded on the basis of the camera parameter set.

A system for projecting dots onto a three-dimensional image is configured to activate multiple pseudo-random dot projectors sequentially. Each pseudo-random dot projector includes an illumination source and a wavefront modulating element (WME) located along an optical axis in a path traversed by radiation produced by the illumination source. The system is configured to form images of dots in the projection plane along the optical axis. The system may also include controlling circuitry configured to perform a sequential projection operation on the plurality of pseudo-random dot projection systems to produce a temporal sequence of images and aggregate and process the temporal sequence of images to produce a high-resolution depth image of the three-dimensional surface.

An image sensor according to an embodiment of the present invention includes: a pixel array in which a plurality of pixels are arrayed in a grid shape, and which converts reflection light signals reflected from an object into electrical signals; an image processor which converts the electrical signals to generate subframes, and extracts pieces of second depth information having a higher resolution than pieces of first depth information extracted from a plurality of the subframes; and a memory for storing the pieces of first depth information, wherein the reflection light signals are input to the pixel array through mutually different optical paths shifted in sub-pixel units of the pixel array, and the memory stores a plurality of the pieces of first depth information that correspond to the mutually different optical paths.

An image sensor according to an embodiment of the present invention includes: a pixel array in which a plurality of pixels are arrayed in a grid shape, and which converts reflection light signals reflected from an object into electrical signals; an image processor which converts the electrical signals to generate subframes, and extracts pieces of second depth information having a higher resolution than pieces of first depth information extracted from a plurality of the subframes; and a memory for storing the pieces of first depth information, wherein the reflection light signals are input to the pixel array through mutually different optical paths shifted in sub-pixel units of the pixel array, and the memory stores a plurality of the pieces of first depth information that correspond to the mutually different optical paths.

One aspect of the invention relates to a fully automatic method for calculating the current, geo-referenced position and alignment of a terrestrial scan-surveying device in situ on the basis of a current panoramic image recorded by the surveying device and at least one stored, geo-referenced 3D scan panoramic image.

One aspect of the invention relates to a fully automatic method for calculating the current, geo-referenced position and alignment of a terrestrial scan-surveying device in situ on the basis of a current panoramic image recorded by the surveying device and at least one stored, geo-referenced 3D scan panoramic image.

A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, stereoscopic image data of the live action scene is received, and display wall metadata of the precursor image is determined. Further, a first portion of the stereoscopic image data comprising the stage element in the live action scene is determined based on the stereoscopic image data and the display wall metadata. A second portion of the stereoscopic image data comprising the display wall in the live action scene with the display wall displaying the precursor image is also determined. Thereafter, an image matte for the stereoscopic image data is generated based on the first portion and the second portion.