An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Alignment systems and devices are provided for controlling the alignment of an optical payload. In some embodiments, an optical positioning system is provided that includes a yoke supporting an optical payload. The yoke, which includes a plurality of articulated segments and associated pivot joints, is mechanically coupled to the optical payload, such that when the optical payload is oriented in a given direction, such as towards a distal target, the optical payload is rotatable about a distal pivot axis associated with a distal pivot joint of the yoke. The pivot joints of the yoke may be configured such that the rotation axis associated with a given pivot joint passes sufficiently close to a respective center of mass of a distalward portion of the optical alignment system beyond the given pivot joint, such that the position and orientation of the optical payload is maintained in the absence of external forces.

Example embodiments relate to detectors for detecting electromagnetic radiation. One embodiment includes a detector for detecting electromagnetic radiation spanning a range from a first wavelength to a second wavelength. The detector includes an array of funnel elements for propagating electromagnetic radiation from a second plane towards a first plane. Each of the funnel elements includes an entrance end and an exit end. The entrance ends of the array of funnel elements define the second plane. The entrance end is larger than half of the second wavelength in a medium from which the electromagnetic radiation enters the detector. The exit end is smaller than half of the first wavelength of in the medium. The detector also includes an array of photosensitive elements for detecting electromagnetic radiation incident on the array of photosensitive elements. Each funnel element is associated with a photosensitive element. The array of photosensitive elements defines the first plane.

In one embodiment, a three-dimensional LIDAR system includes a light source (e.g., laser) to emit a light beam (e.g., a laser beam) to sense a physical range associated with a target. The system includes a camera and a light detector (e.g., a flash LIDAR unit) to receive at least a portion of the light beam reflected from the target. They system includes a dichroic mirror situated between the target and the light detector, the dichroic mirror configured to direct the light beam reflected from the target to the light detector to generate a first image, wherein the dichroic mirror further directs optical lights reflected from the target to the camera to generate a second image. The system includes an image processing logic coupled to the light detector and the camera to combine the first image and the second image to generate a 3D image.

In one embodiment, a three-dimensional LIDAR system includes a light source (e.g., laser) to emit a light beam (e.g., a laser beam) to sense a physical range associated with a target. The system includes a camera and a light detector (e.g., a flash LIDAR unit) to receive at least a portion of the light beam reflected from the target. They system includes a dichroic mirror situated between the target and the light detector, the dichroic mirror configured to direct the light beam reflected from the target to the light detector to generate a first image, wherein the dichroic mirror further directs optical lights reflected from the target to the camera to generate a second image. The system includes an image processing logic coupled to the light detector and the camera to combine the first image and the second image to generate a 3D image.

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

A mechanism is described for facilitating adaptive resolution and viewpoint-prediction for immersive media in computing environments. An apparatus of embodiments, as described herein, includes one or more processors to receive viewing positions associated with a user with respect to a display, and analyze relevance of media contents based on the viewing positions, where the media content includes immersive videos of scenes captured by one or more cameras. The one or more processors are further to predict portions of the media contents as relevant portions based on the viewing positions and transmit the relevant portions to be rendered and displayed.

A depth acquisition device includes memory and processor performing: acquiring, from the memory, intensities of infrared light emitted from a light source and measured by imaging with the infrared light reflected on a subject by pixels in an imaging element; generating a depth image by calculating a distance to the subject as a depth for each pixel based on an intensity received by the pixel; acquiring, from the memory, a visible light image generated by imaging, with visible light, a substantially same scene with a substantially same viewpoint and at a substantially same timing as those of imaging the infrared light image; detecting, from the visible light image, an edge region including an edge along a direction perpendicular to a direction of movement of the visible light image; and correcting, in the depth image, a depth of a target region corresponding to the edge region in the depth image.