Disclosed are a wide viewing angle stereo camera apparatus and a depth image processing method using the same. A stereo camera apparatus includes a receiver configured to receive a first image and a second image of a subj ect captured through a first lens and a second lens that are provided in a vertical direction; a converter configured to convert the received first image and second image using a map projection scheme; and a processing configured to extract a depth of the subject by performing stereo matching on the first image and the second image converted using the map projection scheme, in a height direction.

Disclosed are a wide viewing angle stereo camera apparatus and a depth image processing method using the same. A stereo camera apparatus includes a receiver configured to receive a first image and a second image of a subj ect captured through a first lens and a second lens that are provided in a vertical direction; a converter configured to convert the received first image and second image using a map projection scheme; and a processing configured to extract a depth of the subject by performing stereo matching on the first image and the second image converted using the map projection scheme, in a height direction.

An electronic device tracks its motion in an environment while building a three-dimensional visual representation of the environment that is used to correct drift in the tracked motion. A motion tracking module estimates poses of the electronic device based on feature descriptors corresponding to the visual appearance of spatial features of objects in the environment. A mapping module builds a three-dimensional visual representation of the environment based on a stored plurality of maps, and feature descriptors and estimated device poses received from the motion tracking module. The mapping module provides the three-dimensional visual representation of the environment to a localization module, which identifies correspondences between stored and observed feature descriptors. The localization module performs a loop closure by minimizing the discrepancies between matching feature descriptors to compute a localized pose. The localized pose corrects drift in the estimated pose generated by the motion tracking module.

A sensor device has a sensor base with a sensor mount, for which different sensor assemblies are attachable to the sensor mount. The sensor base transmits different settings to the sensor assembly via the sensor mount interface. The transmission preferably is wireless, rather than using mechanical connectors. The sensor assembly stores the settings in control registers that determine the settings for the capture of sensor data. In one approach, the sensor base includes an application processor and software executing on the application processor determines the settings. The control registers for the sensor assembly are thus software programmable, allowing different settings to be applied to different samples of sensor data.

An object of the present invention is to provide an I/O device, an I/O program, and an I/O method that can use a stereoscopic image for a long time. Another object of the present invention is to provide an I/O device, an I/O program, and an I/O method that can perform an operation even when there is a restriction on the operation due to an object. A display device can generate a stereoscopic image, a depth level sensor measures a distance to an object, and a control section displays a view on the display device according to the depth level sensor. A depth level adjustment mechanism adjusts at least one of a region width and a region position of a measurement region of the depth level sensor.

The image processing apparatus 104 includes a processor performing a noise reduction on at least part of an input image produced by image capturing using an image capturing system 101, 102, and an acquirer acquiring first information on an optical characteristic of the image capturing system. The optical characteristic indicates a factor that degrades information of an object space in the image capturing of the input image. A processor changes a process of the noise reduction depending on the first information.

Embodiments generally relate to a machine-implemented method of automatically adjusting the range of a depth data recording executed by at least one processing device. The method comprises determining, by the at least one processing device, at least one position of a subject to be recorded; determining, by the at least one processing device, at least one spatial range based on the position of the subject; receiving depth information; and constructing, by the at least one processing device, a depth data recording based on the received depth information limited by the at least one spatial range.

Embodiments generally relate to a machine-implemented method of automatically adjusting the range of a depth data recording executed by at least one processing device. The method comprises determining, by the at least one processing device, at least one position of a subject to be recorded; determining, by the at least one processing device, at least one spatial range based on the position of the subject; receiving depth information; and constructing, by the at least one processing device, a depth data recording based on the received depth information limited by the at least one spatial range.

A method and apparatus merge depth maps in a depth camera system. According to a possible embodiment, a first image of a scene can be received. The first image can include first image coordinates. A second image of the scene can be received. A third image of the scene can be received. An x-axis depth map of the first image coordinates can be generated based on the first and second images. A y-axis depth map of the first image coordinates can be generated based on the first and third images. The y-axis can be perpendicular to the x-axis. Edge detection can be performed on the first image to detect edges in the first image. A confidence score map can be generated for each depth map. A higher confidence score on the confidence score map of the x-axis depth map can be set for a pixel on an edge at an angle closer to the y-axis than the x-axis for the pixel on the x-axis depth map. A lower confidence score on the confidence score map of the y-axis depth map can be set for a corresponding pixel on the y-axis depth map. A depth value of a pixel on a fusion depth map can be selected based on the confidence score maps and the depth maps.

An imaging device, including a monolithic semiconductor integrated circuit substrate, comprises a focal plane array of pixel cells. Each one of the pixel cells includes a gate overlying a region of the substrate operable to convert incident radiation into charge carriers. The pixel also includes a CMOS readout circuit including at least one output transistor in the substrate. The pixel further includes a charge coupled device section on the substrate adjacent the gate, the charge coupled device section including a sense node to receive charge carriers transferred from the region of the substrate beneath the gate. The sense node is coupled to the output transistor. The pixel also includes a reset switch coupled to the sense node. The pixel's charge coupled device section has a buried channel region. The pixel also includes one or more bias enabling switches operable to enable a bias voltage to be applied to the gate. At least one of the reset switch or the one or more bias enabling switches is formed in the buried channel region.