Provided are an apparatus and a method for executing generation of a disparity map and an object detection process with high accuracy and efficiency. The apparatus includes a disparity calculation unit that receives two images captured from different viewpoints, calculates a disparity, and generates a disparity map and a classification unit that performs the object detection process using the disparity map. The disparity calculation unit performs a stereo matching process using an original-resolution image, generates cost volumes corresponding to a plurality of resolutions from the processing result, generates disparity maps and object candidate region maps corresponding to a plurality of different resolutions, using the cost volumes corresponding to each resolution, and outputs the disparity maps and the object candidate region maps to the classification unit.

Provided are an apparatus and a method for executing generation of a disparity map and an object detection process with high accuracy and efficiency. The apparatus includes a disparity calculation unit that receives two images captured from different viewpoints, calculates a disparity, and generates a disparity map and a classification unit that performs the object detection process using the disparity map. The disparity calculation unit performs a stereo matching process using an original-resolution image, generates cost volumes corresponding to a plurality of resolutions from the processing result, generates disparity maps and object candidate region maps corresponding to a plurality of different resolutions, using the cost volumes corresponding to each resolution, and outputs the disparity maps and the object candidate region maps to the classification unit.

A wallpaper system presents a first wallpaper image of a wallpaper video to a user and receives, via a user input device, one or both of: (i) a spatial user input selection, and (ii) a time user input selection from the user to apply to the wallpaper video. In response to detecting one or both of: (i) the spatial user input selection, and (ii) the time user input selection, the wallpaper system determines one or both of: (i) a respective spatial movement parameter within a wallpaper video associated with the spatial user input selection, and (ii) a respective time coordinate within the wallpaper video associated with the time user input selection. Wallpaper system presents, via the image display, a second wallpaper image associated with one or both of: (i) the respective spatial movement parameter, and (ii) the respective time coordinate.

An information display system includes a frame, a pair of cameras arranged at both side ends of the frame, a transparent display fitted into the frame, a display position setting device that detects a target based on a feature extracted from image data captured by the pair of cameras, and sets, as a display position, a position at which a straight line connecting an eye of a user wearing the frame and the target passes through the transparent display, and a controller that controls the transparent display in such a way as to display a point light at the display position set by the display position setting device.

A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.

A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.

Time of Flight (ToF) image processing methods include collecting correlation samples to calculate a phase estimate. Systems and methods are provided for collecting correlation samples from multiple pixels. An image processing system for continuous waves includes a light source configured to emit light, an image sensor having a plurality of pixels, and a processor configured to collect correlation samples from a subset of the plurality of pixels in the image sensor.

An image processing system for time-of-flight depth imaging includes a processor for determining depth measurements using different modes of operation. The processor determines depth measurements in a first set of frames using a second set of frames. The first mode is a continuous wave modulation mode without depth linearization and the second mode is a continuous wave modulation mode with depth linearization. The depth estimates collected in the second mode using depth linearization are used to correct the depth estimates collected in the first mode.

A leg (205) detection system comprising: a robotic arm (200) comprising a gripping portion (208) for holding a teat cup (203, 210) for attaching to a teat (1102, 1104, 1106, 1108, 203S, 203) of a dairy livestock (200, 202, 203); an imaging system coupled to the robotic arm (200) and configured to capture a first three-dimensional (3D) image (138, 2400, 2500) of a rearview of the dairy livestock (200, 202, 203) in a stall (402), the imaging system comprising a 3D camera (136, 138) or a laser (132), wherein each pixel of the first 3D image (138, 2400, 2500) is associated with a depth value; one or more memory (104) devices configured to store a reference (3D) 3D image (138, 2400, 2500) of the stall (402) without any dairy livestock (200, 202, 203); and a processor (102) communicatively coupled to the imaging system and the one or more memory (104) devices, the processor (102) configured to: access the first 3D image (138, 2400, 2500) and the reference (3D) 3D image (138, 2400, 2500); subtract the first 3D image (138, 2400, 2500) from the reference (3D) 3D image (138, 2400, 2500) to produce a second 3D image (138, 2400, 2500); perform morphological image (138, 2400, 2500) processing on the second 3D image (138, 2400, 2500) to produce a third 3D image (138, 2400, 2500); perform image (138, 2400, 2500) thresholding on the third 3D image (138, 2400, 2500) to produce a fourth 3D image (138, 2400, 2500); cluster (2616, 2618, 2626, 2628) data from the fourth 3D image (138, 2400, 2500); identify, using the clustered data from the fourth 3D image (138, 2400, 2500), one or more legs (205) of the dairy livestock (200, 202, 203); and provide instructions for movements of the robotic arm (200) to avoid the identified one or more legs (205) while attaching the teat cup (203, 210) to the teat (1102, 1104, 1106, 1108, 203S, 203) of the dairy livestock (200, 202, 203).