The present disclosure provides an image capturing device that captures images of a first sensor that includes a first imaging modality, a second sensor that includes a first imaging modality and a third sensor that includes a second imaging modality. A controller connected with the first sensor, the second sensor and the third sensor, wherein the controller registers an image captured by the first sensor or the second sensor to an image captured by the third sensor.

A “Concurrent Projector-Camera” uses an image projection device in combination with one or more cameras to enable various techniques that provide visually flicker-free projection of images or video, while real-time image or video capture is occurring in that same space. The Concurrent Projector-Camera provides this projection in a manner that eliminates video feedback into the real-time image or video capture. More specifically, the Concurrent Projector-Camera dynamically synchronizes a combination of projector lighting (or light-control points) on-state temporal compression in combination with on-state temporal shifting during each image frame projection to open a “capture time slot” for image capture during which no image is being projected. This capture time slot represents a tradeoff between image capture time and decreased brightness of the projected image. Examples of image projection devices include LED-LCD based projection devices, DLP-based projection devices using LED or laser illumination in combination with micromirror arrays, etc.

A “Concurrent Projector-Camera” uses an image projection device in combination with one or more cameras to enable various techniques that provide visually flicker-free projection of images or video, while real-time image or video capture is occurring in that same space. The Concurrent Projector-Camera provides this projection in a manner that eliminates video feedback into the real-time image or video capture. More specifically, the Concurrent Projector-Camera dynamically synchronizes a combination of projector lighting (or light-control points) on-state temporal compression in combination with on-state temporal shifting during each image frame projection to open a “capture time slot” for image capture during which no image is being projected. This capture time slot represents a tradeoff between image capture time and decreased brightness of the projected image. Examples of image projection devices include LED-LCD based projection devices, DLP-based projection devices using LED or laser illumination in combination with micromirror arrays, etc.

An omnidirectional image-capturing assembly for conveniently generating virtual tours conducted via omnidirectional images, and a method executed thereby includes an omnidirectional image-capturing assembly having an omnidirectional image-capturing apparatus, a mobile computing apparatus, and a mobile stand for fixing the omnidirectional image-capturing apparatus and mobile computing apparatus.

An omnidirectional image-capturing assembly for conveniently generating virtual tours conducted via omnidirectional images, and a method executed thereby includes an omnidirectional image-capturing assembly having an omnidirectional image-capturing apparatus, a mobile computing apparatus, and a mobile stand for fixing the omnidirectional image-capturing apparatus and mobile computing apparatus.

The invention presents a system and a method for 3D human reconstruction using a compact kit of depth cameras. Instead of using complex and expensive devices as in traditional methods, the proposed system and method employs a simple, easy-to-install system to accurately collect the human body shape. The generated model is capable of moving thanks to a skeleton system simulating the human skeleton. The proposed system includes four blocks: Data Collection Block, Point Cloud Standardization Block, Human Digitization Block and Output Block. The proposed method includes five steps: Point Cloud Collecting, Point Cloud Filtering, Point Cloud Calibrating, Point Cloud Optimizing and 3D Human Model Generating.

A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.

A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.

Methods, systems, devices and computer software/program code products enable efficient handling and remedying of unreliable sensor data, such as data captured by cameras in a virtual 3-dimensional (V3D) imaging or communications system; and enable, in a visual communications system involving a plurality of display devices usable by respective users, synchronization to a common space, and display of images by a receiving device in an orientation independent of the angle at which the receiving device is held.

Methods, systems, devices and computer software/program code products enable efficient handling and remedying of unreliable sensor data, such as data captured by cameras in a virtual 3-dimensional (V3D) imaging or communications system; and enable, in a visual communications system involving a plurality of display devices usable by respective users, synchronization to a common space, and display of images by a receiving device in an orientation independent of the angle at which the receiving device is held.