A multi-modal sensor system includes: an underlying sensor system; a polarization camera system configured to capture polarization raw frames corresponding to a plurality of different polarization states; and a processing system including a processor and memory, the processing system being configured to control the underlying sensor system and the polarization camera system, the memory storing instructions that, when executed by the processor, cause the processor to: control the underlying sensor system to perform sensing on a scene and the polarization camera system to capture a plurality of polarization raw frames of the scene; extract first tensors in polarization representation spaces based on the plurality of polarization raw frames; and compute a characterization output based on an output of the underlying sensor system and the first tensors in polarization representation spaces.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

Optic pieces having multiple lens arrays are disclosed. A disclosed example optic piece for use within a projection system includes a body extending between a first side of the body and a second side of the body that is opposite the first side, the body at least partially transparent, a first array of lenses on the first side of the body, ones of the first array of lenses having a respective first surface area, and a second array of lenses on the second side of the body, ones of the second lenses having a respective second surface area that is larger than the first surface area.

A structured-light pattern for a structured-light system includes a base light pattern that includes a row of a plurality of sub-patterns extending in a first direction. Each sub-pattern is adjacent to at least one other sub-pattern, and each sub-pattern is different from each other sub-pattern. Each sub-pattern includes a first number of portions in a sub-row and a second number of portions in a sub-column. Each sub-row extends in the first direction and each sub-column extends in a second direction that is substantially orthogonal to the first direction. Each portion may be a first-type portion or a second-type portion. A size of a first-type portion is larger in the first direction and in the second direction than a size of a second-type portion in the first direction and in the second direction. In one embodiment, a first-type portion is a black portion and the second-type portion is a white portion.

A 3D measuring instrument includes a registration camera and a surface measuring system having a projector and autofocus camera. In a first pose, the registration camera captures a first registration image of first registration points. The autofocus camera captures a first surface image of first light projected onto the object by the projector and determines first 3D coordinates of points on the object. In a second pose, the registration camera captures a second registration image of second registration points. The autofocus camera adjusts the autofocus mechanism based at least in part on adjusting a focal length to reduce a difference between positions of the first and second registration points. A second surface image of second light is captured. A compensation parameter is determined based at least in part on the first registration image, the second registration image, the first 3D coordinates, the second surface image, and the projected second light.

Aspects of the subject disclosure are directed towards safely projecting a diffracted light pattern, such as in an infrared laser-based projection/illumination system. Non-diffracted (zero-order) light is refracted once to diffuse (defocus) the non-diffracted light to an eye safe level. Diffracted (non-zero-order) light is aberrated twice, e.g., once as part of diffraction by a diffracting optical element encoded with a Fresnel lens (which does not aberrate the non-diffracted light), and another time to cancel out the other aberration; the two aberrations may occur in either order. Various alternatives include upstream and downstream positioning of the diffracting optical element relative to a refractive optical element, and/or refraction via positive and negative lenses.

A method for producing a fencing material including the steps of: providing a border material having an interior surface; providing a mesh material having a front and a back; treating the interior surface of the border material to produce a tacky border material surface; placing a portion of the front and/or the back of the mesh material against the tacky border material surface; pressing the tacky border material surface and the mesh material together; and thermally bonding at least some portion of the front and the back of the mesh material with the interior surface of the border material. The border material being a polyvinyl chloride, the mesh being a polyvinyl chloride material and/or a vinyl coated material.

The present disclosure provides an apparatus. The apparatus according to the present disclosure comprises: at least one first light source configured to irradiate illumination light to an object on a reference surface; at least one second light source configured to irradiate pattern light to the object, a plurality of cameras configured to capture one or more illumination images and one or more pattern images; and one or more processors configured to determine a plurality of outlines indicating edges of the object based on two or more images captured in different directions among the one or more illumination images and the one or more pattern images; determine a virtual plane corresponding to an upper surface of the object based on the plurality of outlines; and determine an angle between the virtual plane and the reference plane.

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

A method includes identifying a target surface in an environment of a robotic device. The method further includes controlling a moveable component of the robotic device to move along a motion path relative to the target surface, wherein the moveable component comprises a light source and a camera. The method additionally includes receiving a plurality of images from the camera when the moveable component is at a plurality of poses along the motion path and when the light source is illuminating the target surface. The method also includes determining bidirectional reflectance distribution function (BRDF) image data, wherein the BRDF image data comprises the plurality of images converted to angular space with respect to the target surface. The method further includes determining, based on the BRDF image data and by applying at least one pre-trained machine learning model, a material property of the target surface.