An augmented reality or virtual reality (AR/VR) device pairs with a companion device to augment input interfaces associated with an AR/VR application at the AR/VR device. In implementations, an AR/VR device determines a portion of a markup file that corresponds to an AR/VR scene of a plurality of AR/VR scenes in an AR/VR environment, and communicates the portion of the markup file to the companion device to cause the companion device to configure a companion user interface associated with initiating an action as part of the AR/VR scene. In response to receiving user input via the companion user interface, the companion device communicates the action to the AR/VR device to initiate the action. The AR/VR device receives input data from the companion device, and initiates the action for the AR/VR scene.

An information processing method is provided for a terminal device. The method includes obtaining an image including an AR target; recognizing the AR target, and generating a virtual scene including N virtual objects (N being an integer greater than or equal to 2); disassembling the virtual scene to obtain the N virtual objects; and generating object information that separately corresponds to the N virtual objects, which include a target virtual object to be interacted with by a user. The method also includes keeping the object information of virtual objects other than the target virtual object in the N virtual objects unchanged and updating the object information of the target virtual object in response to receiving an operation instruction inputted by the user for the target virtual object, such that the target virtual object is interacted independently rather than the virtual scene as whole by the user.

A unit pixel arranged along with a display pixel in each pixel of a display panel is provided. The unit pixel may include a thin-film transistor (TFT) photodetector including an active layer formed of amorphous silicon or polycrystalline silicon on an amorphous transparent substrate, and at least one transistor electrically coupled to the TFT photodetector and configured to generate a voltage output from photocurrent generated from the active layer.

A display device is capable of sensing a user's touching or inputting by a laser pointer on a display panel, by means of arranging a photo transistor in some pixels of the display panel to sense off-current of the photo transistor according to a change in the quantity of external light. In addition, a common electrode overlapping a data line is arranged separately from a common electrode overlapping a read-out line from which a sensing signal is detected, thereby improving the sensing performance carried out simultaneously with the display driving, owing to reduced influence of noise caused by the display driving to the sensing signal.

A display device is capable of sensing a user's touching or inputting by a laser pointer on a display panel, by means of arranging a photo transistor in some pixels of the display panel to sense off-current of the photo transistor according to a change in the quantity of external light. In addition, a common electrode overlapping a data line is arranged separately from a common electrode overlapping a read-out line from which a sensing signal is detected, thereby improving the sensing performance carried out simultaneously with the display driving, owing to reduced influence of noise caused by the display driving to the sensing signal.

A display apparatus and a control method thereof are provided. The display apparatus includes a display configured to be rotatable; a plurality of cameras; and a processor configured to: based on the display being oriented in a vertical direction, control one camera of the plurality of cameras to perform photographing; and based on a user command being received while the one camera is performing photographing, rotate the display to be oriented in a horizontal direction and control the one camera to stop photographing.

A tactile touch sensor (TTS) system and method allowing physical augmentation of a high-resolution touch sensor array (TSA) is disclosed. Physical augmentation is accomplished using a TSA physical overlay (TPO) placed on top of the TSA. The TPO is constructed to transmit forces to the underlying TSA. Force transmission is accomplished by either using a flexible overlay or with a rigid mechanical overlay that transmits user forces exerted on the overlay to the underlying TSA. Incorporation of TPO identifiers (TPI) within the TPO permits identification of the TPO by a TPO detector (TPD) allowing operational characteristics of the TSA to be automatically reconfigured to conform to the currently applied TPO structure by a user computing device (UCD). The UCD may be configured to automatically load an appropriate application software driver (ASD) in response to a TPI read by the TPD from the currently applied TPO.

A tactile touch sensor (TTS) system and method allowing physical augmentation of a high-resolution touch sensor array (TSA) is disclosed. Physical augmentation is accomplished using a TSA physical overlay (TPO) placed on top of the TSA. The TPO is constructed to transmit forces to the underlying TSA. Force transmission is accomplished by either using a flexible overlay or with a rigid mechanical overlay that transmits user forces exerted on the overlay to the underlying TSA. Incorporation of TPO identifiers (TPI) within the TPO permits identification of the TPO by a TPO detector (TPD) allowing operational characteristics of the TSA to be automatically reconfigured to conform to the currently applied TPO structure by a user computing device (UCD). The UCD may be configured to automatically load an appropriate application software driver (ASD) in response to a TPI read by the TPD from the currently applied TPO.

A touch display apparatus including a body, a display module, a light control element, and a touch module is provided. The body has an opening. The display module is disposed in the body and is suitable for emitting a plurality of image beams toward the opening. The light control element is disposed to overlap the opening of the body and is suitable for reflecting the image beams coming from the display module to an imaging space to display an image frame of the display module. The imaging space and the display module are located on two opposite sides of the light control element. The touch module is disposed on one side of the light control element and is configured to recognize a touch operation of a user in the imaging space.

A touch display apparatus including a body, a display module, a light control element, and a touch module is provided. The body has an opening. The display module is disposed in the body and is suitable for emitting a plurality of image beams toward the opening. The light control element is disposed to overlap the opening of the body and is suitable for reflecting the image beams coming from the display module to an imaging space to display an image frame of the display module. The imaging space and the display module are located on two opposite sides of the light control element. The touch module is disposed on one side of the light control element and is configured to recognize a touch operation of a user in the imaging space.