A system is provided that allows users to interact with digital content using personalized interactions. The personalized interactions may be images (e.g., selfies) that are used in connection with providing feedback for digital content.

An AR -based information displaying method and an AR apparatus, an electronic device and a storage medium, applicable to the technical field of computers. The method comprises: acquiring voice information and a user image of a user; identifying the voice information and extracting user characteristics; and when the user image matches the user characteristics, displaying, by an AR displaying device, target information associated with the user at a display position corresponding to the user image, wherein the target information comprises at least one of user information and voice associated information. According to this solution, the user information and voice associated information of the user are displayed by the AR displaying device at the display position corresponding to the user image, so a user wearing the AR displaying device may give a pertinent reply after conveniently knowing user information and statement intentions of a speaker, improving the communication efficiency of users.

A messaging system performs engagement analysis based on labels associated with content items produced by users of the messaging system. The messaging system is configured to process content items comprising images to identify elements in the images and determine labels for the images based on conditions indicating when to associate a label of the labels with an image of the images based on the elements in the image. The messaging system is further configured to associate the label with the content item, in response to determining to associate the label with the image, associating the label with the content item. The messaging system is further configured to determine engagement scores for the label based on interactions of users with the content items associated with label and adjust the engagement scores to determine trends in the labels to generate adjusted engagement scores.

An image recognition approach employs both computer generated and manual image reviews to generate image tags characterizing an image. The computer generated and manual image reviews can be performed sequentially or in parallel. The generated image tags may be provided to a requester in real-time, be used to select an advertisement, and/or be used as the basis of an internet search. In some embodiments generated image tags are used as a basis for an upgraded image review. A confidence of a computer generated image review may be used to determine whether or not to perform a manual image review. Images and their associated image tags are optionally added to an image sequence.

An image recognition approach employs both computer generated and manual image reviews to generate image tags characterizing an image. The computer generated and manual image reviews can be performed sequentially or in parallel. The generated image tags may be provided to a requester in real-time, be used to select an advertisement, and/or be used as the basis of an internet search. In some embodiments generated image tags are used as a basis for an upgraded image review. A confidence of a computer generated image review may be used to determine whether or not to perform a manual image review. Images and their associated image tags are optionally added to an image sequence.

A desktop application and supporting web site for capturing audio and video recordings or other digital content of differing modalities is introduced, wherein multiple participants in a collaborative session may be in separate remote locations. The application includes providing a high quality data format for transferring recordings, audiovisual data and the like to a remote network location or computer and a real-time data format for intercommunicating comments and instructions that are not recorded. Peer-to-peer and server-client implementations may be optimized regarding delivery time (latency) versus content quality. The desktop application also provides mechanisms for playing back sound, video or other data for participants' reference, along with synchronized presentations of textual, audio and visual material corresponding to the session.

A desktop application and supporting web site for capturing audio and video recordings or other digital content of differing modalities is introduced, wherein multiple participants in a collaborative session may be in separate remote locations. The application includes providing a high quality data format for transferring recordings, audiovisual data and the like to a remote network location or computer and a real-time data format for intercommunicating comments and instructions that are not recorded. Peer-to-peer and server-client implementations may be optimized regarding delivery time (latency) versus content quality. The desktop application also provides mechanisms for playing back sound, video or other data for participants' reference, along with synchronized presentations of textual, audio and visual material corresponding to the session.

Digital image capture session and metadata association techniques are described. In one example, a user input is received to initiate an image capture session. At least one digital image is captured using a digital camera during the image capture session. Audio input data is also collected using an audio input device during the image capture session and is converted into text data, e.g., speech-to-text. Metadata is generated based on the text data and associated with the at least one digital image. The at least one digital image is output as having the associated metadata as completion of the image capture session.

Digital image capture session and metadata association techniques are described. In one example, a user input is received to initiate an image capture session. At least one digital image is captured using a digital camera during the image capture session. Audio input data is also collected using an audio input device during the image capture session and is converted into text data, e.g., speech-to-text. Metadata is generated based on the text data and associated with the at least one digital image. The at least one digital image is output as having the associated metadata as completion of the image capture session.

The description relates to diversified hybrid image annotation for annotating images. One implementation includes generating first image annotations for a query image using a retrieval-based image annotation technique. Second image annotations can be generated for the query image using a model-based image annotation technique. The first and second image annotations can be integrated to generate a diversified hybrid image annotation result for the query image.