Systems and methods for providing a virtual keyboard are shown and described. User gestures are captured by a camera and are mapped to spatial coordinates that correspond to the keys of a virtual keyboard. The user defines the coordinate system based on his or her range of motion and also defines the spatial dimensions of the virtual keyboard. The spatial dimensions are then scaled to provide a display image of the virtual keyboard on a TV display. Facial recognition techniques and corresponding data regarding the viewer's anatomy and previously captured reference gestures are used to interpret the viewer's gestures and determine which keystrokes are intended. A character prediction technique using the trajectory of the cursor (i.e., trajectory of entered keystrokes) is combined with language/semantic-based character prediction models to identify a next predicted character that is indicated as the user's selected character, thereby disambiguating the key selection indicated the positioning of his or her fingers relative to the virtual keyboard keys.

A vehicle gesture control system for a host vehicle, the host vehicle including an adaptive cruise control or autonomous drive arrangement, the system including a sensor to detect gestures performed by a driver on the surface of a steering wheel grip in the host vehicle, the steering wheel grip including a circular tube surrounding a steering wheel that rotates about a steering column, and a processor receiving outputs from the sensor and connected to a memory unit storing instructions for the processor to activate a plurality of features of the adaptive cruise control or autonomous drive arrangement in response to a respective plurality of different gestures detected by the sensor, wherein two of the gestures represent “up” and “down” commands and include movement of the driver's thumb in opposite directions, respectively, around a lateral section of the steering wheel grip that faces the driver.

A photo sensor circuit includes: a photo transistor; a first switching transistor; a second switching transistor; and a capacitance element. The photo transistor includes: a gate connected to a first wiring; a source connected to a second wiring; and a drain. The first switching transistor includes: a gate connected to a third wiring; a source connected to a fourth wiring; and a drain connected to the drain of the photo transistor. The capacitance element includes: a first terminal connected to the drain of the photo transistor; and a second terminal connected to the source of the first switching transistor. The second switching transistor includes: a gate connected to a gate line; a source connected to a signal line; and a drain connected to the first terminal of the capacitance element. The photo transistor, first switching transistor, and second transistor each include an oxide semiconductor layer as a channel layer.

A display device including a beam emitter and a display panel is provided. The beam emitter emits a first beam; the display panel includes a display screen body and a light control layer. The light control layer includes photosensitive devices that outputs a sensing signal according to a sensing result, a control module for controlling turning on and turning off of the photosensitive devices, and a reading module for reading the sensing signal output by the photosensitive devices and determining a projection position of the first beam on the display panel according to the sensing signal.

A display device including a beam emitter and a display panel is provided. The beam emitter emits a first beam; the display panel includes a display screen body and a light control layer. The light control layer includes photosensitive devices that outputs a sensing signal according to a sensing result, a control module for controlling turning on and turning off of the photosensitive devices, and a reading module for reading the sensing signal output by the photosensitive devices and determining a projection position of the first beam on the display panel according to the sensing signal.

An image processing method and apparatus for a smart pen, and an electronic device are provided in embodiments of the present disclosure, and belong to the technical field of data processing. The method comprises: monitoring a working state of a second pressure switch provided at a pen tip of a smart pen after a first pressure switch of the smart pen is in a closed state; controlling an infrared transceiver circuit on the smart pen to send an infrared signal to an area where the smart pen writes; acquiring a lightweight network model preset in the smart pen, so as to perform feature extraction processing on an original image; performing classification processing on a feature matrix by using a fully connected layer in the lightweight network model, to obtain a trajectory classification result; and displaying a writing trajectory of the smart pen on a target object in real time.

An example approach to detect inputs using a sensor is disclosed. In an example, an electronic device may include a housing, an optical sensor to detect an input from a detection zone, and a rotatable housing mounted to a side of the housing. The optical sensor is disposed in the rotatable housing. The electronic device may also include a direction sensor to detect an orientation of the rotatable housing relative to the housing.

An interactive assembly including at least one interactive surface element, at least a first region of the at least one interactive surface element having first user sensible functionality and at least a second region of the at least one interactive surface element having second functionality, different from the first user sensible functionality, input sensor functionality, including at least one input sensor located in propinquity to at least one of the at least one interactive surface element, operative to sense impingement of an electromagnetic radiation spot on at least one of the at least one first region and the at least one second region of the at least one interactive surface element and utilization functionality for employing outputs of the input sensor functionality in respect of impingement on either or both of the at least one first region and the at least one second region.

An optical touch substrate, an in-cell touch panel and a display device are disclosed. The optical touch substrate includes a base substrate, a light shielding matrix and a plurality of pixel regions defined by the light shielding matrix. The light shielding matrix includes a plurality of first optical touch electrodes and a plurality of second optical touch electrodes arranged to cross each other. The first optical touch electrodes are insulated from the second optical touch electrodes, and at least one optical touch electrode of the plurality of first optical touch electrodes and the plurality of second optical touch electrodes includes a photosensitive layer and a conductive layer provided in a stacked manner. A sensing signal on each optical touch electrode changes as an intensity of light irradiated to a corresponding photosensitive layer changes.

An optical touch substrate, an in-cell touch panel and a display device are disclosed. The optical touch substrate includes a base substrate, a light shielding matrix and a plurality of pixel regions defined by the light shielding matrix. The light shielding matrix includes a plurality of first optical touch electrodes and a plurality of second optical touch electrodes arranged to cross each other. The first optical touch electrodes are insulated from the second optical touch electrodes, and at least one optical touch electrode of the plurality of first optical touch electrodes and the plurality of second optical touch electrodes includes a photosensitive layer and a conductive layer provided in a stacked manner. A sensing signal on each optical touch electrode changes as an intensity of light irradiated to a corresponding photosensitive layer changes.