A time-of-flight (ToF) image sensor system includes a pixel array, where each pixel of the pixel array is configured to receive a reflected modulated light signal and to demodulate the reflected modulated light signal to generate an electrical signal; a plurality of analog-to-digital converters (ADCs), where each ADC is coupled to at least one assigned pixel of the pixel array and is configured to convert a corresponding electrical signal generated by the at least one assigned pixel into an actual pixel value; and a binning circuit coupled to the plurality of ADCs and configured to generate at least one interpolated pixel, where the binning circuit is configured to generate each of the at least one interpolated pixel based on actual pixel values corresponding to a different pair of adjacent pixels of the pixel array, each of the at least one interpolated pixel having a virtual pixel value.

A time-of-flight (ToF) image sensor system includes a pixel array, where each pixel of the pixel array is configured to receive a reflected modulated light signal and to demodulate the reflected modulated light signal to generate an electrical signal; a plurality of analog-to-digital converters (ADCs), where each ADC is coupled to at least one assigned pixel of the pixel array and is configured to convert a corresponding electrical signal generated by the at least one assigned pixel into an actual pixel value; and a binning circuit coupled to the plurality of ADCs and configured to generate at least one interpolated pixel, where the binning circuit is configured to generate each of the at least one interpolated pixel based on actual pixel values corresponding to a different pair of adjacent pixels of the pixel array, each of the at least one interpolated pixel having a virtual pixel value.

According to an embodiment of the present invention, disclosed is a camera module comprising: a light output unit for outputting an optical signal to an object; a sensor for receiving an optical signal reflected from the object; and a control unit for acquiring distance information about the object by using the phase difference of the received optical signal, wherein the sensor includes a non-extraction area from which the phase different is not extracted and an extraction area from which the phase difference is extracted and the control unit stops timing control for the received optical signal in the non-extraction area.

Systems and methods for three-dimensional imaging, modeling, mapping, and/or control capabilities in compact size suitable for integration with and/or augmentation of robotic, laparoscopic, and endoscopic surgical systems. The systems including at least one optical source configured to project onto a surgical or endoscopic environment, and at least one camera positioned to capture at least one image of the surgical or endoscopic environment.

A system includes a sensor including a set of cameras configured to capture a set of images of an enclosed space. The system further includes a processor and a non-transitory computer-readable medium containing instructions which, when executed on the processor, cause the processor to perform operations including: (a) receiving the set of images captured by the set of cameras; (b) pre-processing the set of images to increase quality and reduce effect of ambient lighting; (c) building a disparity map for the set of images based at least in part on a relationship between the set of cameras; and (d) determining an occupancy of the enclosed space based at least in part on the disparity map. The system can be used to determine occupancy in a trailer with irregularly shaped cargo using low cost sensors.

A depth map generation device includes a plurality of image capture pairs, a depth map generation module, and a processor. The depth map generation module is coupled to the plurality of image capture pairs for generating a plurality of depth maps corresponding to the plurality of image capture pairs according to the image pairs captured by the plurality of image capture pairs. The processor is coupled to the depth map generation module for optionally outputting a depth map of the plurality of depth maps, or outputting a blending depth map composed of a part or all of the plurality of depth maps.

A depth map generation device includes a plurality of image capture pairs, a depth map generation module, and a processor. The depth map generation module is coupled to the plurality of image capture pairs for generating a plurality of depth maps corresponding to the plurality of image capture pairs according to the image pairs captured by the plurality of image capture pairs. The processor is coupled to the depth map generation module for optionally outputting a depth map of the plurality of depth maps, or outputting a blending depth map composed of a part or all of the plurality of depth maps.

Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Calibration in the field is described for stereo and other depth camera configurations using a projector One example includes imaging the first and the second feature in a first camera of the camera system wherein the distance from the first camera to the projector is known, imaging the first and the second feature in a second camera of the camera system, wherein the distance from the second camera to the projector is known, determining a first disparity between the first camera and the second camera to the first feature, determining a second disparity between the first camera and the second camera to the second feature, and determining an epipolar alignment error of the first camera using the first and the second disparities.