An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.

A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.

A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA projects a series of sinusoidal patterns into the local area DCA and captures images of the sinusoidal patterns via a sensor. Each pixel of the augmented sensor includes a plurality of charge bins, and charge accumulated by a photodiode of a pixel during different time intervals (e.g., times when different sinusoidal patterns are emitted) is stored in a different charge storage bin. Charge may be retrieved from different charge storage bins to determine depth from the DCA.

A photo filter (e.g., artistic/stylized painting) light field effect system includes an eyewear device having a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the stylized image painting effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The stylized image painting effect system generates a photo filter stylized painting effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.

Matching timings of transmitting pieces of information for reproducing video and audio with presence and handling loss are provided. An information synchronization device is configured to synchronize, to a reference timestamp, data in which one or more labels for identifying respective one or more subjects on a video and one or more pieces of location information for identifying respective locations of the one or more subjects are respectively associated. The information synchronization device includes a reception unit for receiving the data at each time, a buffer for storing the received data, and a location information interpolation unit for generating, when pieces of the location information at times before and after the reference timestamp is stored into the buffer for any of the labels, location information of the label at the reference timestamp by interpolation using the pieces of the location information.

A head-mounted device includes a plurality of front camera modules, a display device, an in-display camera module and an image-processing unit. The front camera modules include a first camera module and a second camera module that are respectively disposed at the left and right sides of the head-mounted device. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the front camera modules and the display device. The display device and the in-display camera module face a user side of the head-mounted device.

A head-mounted device includes a plurality of front camera modules, a display device, an in-display camera module and an image-processing unit. The front camera modules include a first camera module and a second camera module that are respectively disposed at the left and right sides of the head-mounted device. The in-display camera module is disposed within the boundary of the display device. The image-processing unit is in communication connection with the front camera modules and the display device. The display device and the in-display camera module face a user side of the head-mounted device.

A three-dimensional media streaming and broadcasting system and method, which enables different media, such as concerts and sports events, to be transferred in a live and three-dimensional manner, and the transferred image to be broadcast and viewed with devices such as virtual reality goggles.

A three-dimensional media streaming and broadcasting system and method, which enables different media, such as concerts and sports events, to be transferred in a live and three-dimensional manner, and the transferred image to be broadcast and viewed with devices such as virtual reality goggles.