NOISE REDUCTION DURING EYE TRACKING IN ADAPTIVE EYEGLASSES
20250251789 ยท 2025-08-07
Assignee
Inventors
Cpc classification
G01K3/005
PHYSICS
International classification
G01K3/00
PHYSICS
Abstract
A tracking system for an adaptive eyeglass includes a left eye-tracker, a right eye-tracker, left auxiliary sensor(s), right auxiliary sensor(s), a processor, a left communication bus communicably coupling the processor to the left auxiliary sensor(s), and a right communication bus communicably coupling the processor to the right auxiliary sensor(s). Communication between the left auxiliary sensor(s) and the left communication bus is temporarily disabled, whilst sampling left eye-tracking data using the left eye-tracker. Communication between the right auxiliary sensor(s) and the right communication bus is temporarily disabled, whilst sampling right eye-tracking data using the right eye-tracker.
Claims
1. A tracking system for an adaptive eyeglass, the tracking system comprising: a left eye-tracker and a right eye-tracker for a left part and a right part of the adaptive eyeglass, respectively, wherein each of the left eye-tracker and the right eye-tracker comprises a plurality of light emitters, a plurality of light sensors and an analog front end chip, wherein the plurality of light emitters are implemented as infrared (IR) emitters, while the plurality of light sensors are implemented as IR sensors; at least one left auxiliary sensor and at least one right auxiliary sensor arranged on the left part and the right part, respectively, wherein the at least one left auxiliary sensor and the at least one right auxiliary sensor are peripheral sensors; a processor; a left communication bus that is employed to communicably couple the processor to the at least one left auxiliary sensor; and right communication bus that is employed to communicably couple the processor to the at least one right auxiliary sensor, wherein the processor is configured to: temporarily disable communication between the at least one left auxiliary sensor and the left communication bus, whilst sampling left eye-tracking data using the left eye-tracker; and temporarily disable communication between the at least one right auxiliary sensor and the right communication bus, whilst sampling right eye-tracking data using the right eye-tracker.
2. The tracking system of claim 1, wherein the left eye-tracking data and the right eye-tracking data are sampled in a time-multiplexed manner.
3. The tracking system of claim 1, wherein the processor is configured to: read out the left eye-tracking data from the left eye-tracker, during a time period when the right eye-tracking data is being sampled; and read out the right eye-tracking data from the right eye-tracker, during another time period when the left eye-tracking data is being sampled.
4. The tracking system of claim 1, further comprising at least one rechargeable power source that is employed to supply electrical power to the left eye-tracker, the right eye-tracker, the at least one left auxiliary sensor, the at least one right auxiliary sensor 2 and the processor, wherein the processor is configured to: detect when a charge level of the at least one rechargeable power source is above a first predefined threshold level; and when it is detected that the charge level is above the first predefined threshold level, read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during a time period when the right eye-tracking data is being sampled; and read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during another time period when the left eye-tracking data is being sampled.
5. The tracking system of claim 1, further comprising at least one rechargeable power source that is employed to supply electrical power to the left eye-tracker, the right eye-tracker, the at least one left auxiliary sensor, the at least one right auxiliary sensor and the processor, wherein the processor is configured to: detect when a charge level of the at least one rechargeable power source is any one of: (i) not above a first predefined threshold level, below a second predefined threshold level; and when it is detected that the charge level is any one of: (i) not above the first predefined threshold level, (ii) below the second predefined threshold level, read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every M.sup.th cycle of sampling of the right eye-tracking data, wherein M is an integer whose value is greater than or equal to 2; and read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every N.sup.th cycle of sampling of the left eye-tracking data, wherein N is an integer whose value is greater than or equal to 2.
6. The tracking system of claim 1, wherein at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises a temperature sensor that is employed to sense an ambient temperature, and wherein the processor is configured to: detect when the ambient temperature is any one of: (i) more than a first predefined threshold temperature, (ii) below a second predefined threshold temperature; and when it is detected that the ambient temperature is any one of: more than the first predefined threshold temperature, (ii) below the second predefined threshold temperature, read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every K.sup.th cycle of sampling of the right eye-tracking data, wherein K is an integer whose value is greater than or equal to 2; and read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every L.sup.th cycle of sampling of the left eye-tracking data, wherein L is an integer whose value is greater than or equal to 2.
7. The tracking system of claim 1, wherein at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises a temperature sensor, and at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises at least one of: an ultraviolet sensor, an ambient light sensor, wherein a given eye-tracker comprises a plurality of light emitters and a plurality of light sensors, wherein the processor is configured to: detect at least one of: (i) when ultraviolet light intensities read out from the ultraviolet sensor are above a predefined threshold ultraviolet level, (ii) when an average illuminance read out from the ambient light sensor is above a predefined threshold illuminance; and when at least one of following is detected: (i) the ultraviolet light intensities are above the predefined threshold ultraviolet level, (ii) the average illuminance is above the predefined threshold illuminance, increase an illumination intensity of each light emitter; decrease a sampling frequency of the temperature sensor; and increase a sampling frequency of the ultraviolet sensor.
8. A method implemented by a tracking system comprising a left eye-tracker and a right eye-tracker, at least one left auxiliary sensor and at least one right auxiliary sensor, a processor, a left communication bus communicably coupling the processor to the at least one left auxiliary sensor, and a right communication bus communicably coupling the processor to the at least one right auxiliary sensor, wherein each of the left eye-tracker and the right eye-tracker comprises a plurality of light emitters, a plurality of light sensors and an analog front end (AFE) chip, wherein the plurality of light emitters are implemented as infrared (IR) emitters, while the plurality of light sensors are implemented as IR sensors, and wherein the at least one left auxiliary sensor and the at least one right auxiliary sensor are peripheral sensors, the method comprising: temporarily disabling communication between the at least one left auxiliary sensor and the left communication bus, whilst sampling left eye-tracking data using the left eye-tracker; and temporarily disabling communication between the at least one right auxiliary sensor and the right communication bus, whilst sampling right eye-tracking data using the right eye-tracker.
9. The method of claim 8, wherein the left eye-tracking data and the right eye-tracking data are sampled in a time-multiplexed manner.
10. The method of claim 8, further comprising: reading out the left eye-tracking data from the left eye-tracker, during a time period when the right eye-tracking data is being sampled; and reading out the right eye-tracking data from the right eye-tracker, during another time period when the left eye-tracking data is being sampled.
11. The method of claim 8, further comprising: detecting when a charge level of at least one rechargeable power source of the tracking system is above a first predefined threshold level; and when it is detected that the charge level is above the first predefined threshold level, reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during a time period when the right eye-tracking data is being sampled; and reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during another time period when the left eye-tracking data is being sampled.
12. The method of claim 8, further comprising: detecting when a charge level of at least one rechargeable power source of the tracking system is any one of: (i) not above a first predefined threshold level, (ii) below a second predefined threshold level; and when it is detected that the charge level is any one of: not above the first predefined threshold level, below the second predefined threshold level, reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every M.sup.th cycle of sampling of the right eye1 tracking data, wherein M is an integer whose value is greater than or equal to 2; and reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every N.sup.th cycle of sampling of the left eye-tracking data, wherein N is an integer whose value is greater than or equal to 2.
13. The method of claim 8, further comprising: detecting when an ambient temperature of the tracking system is any one of: (i) more than a first predefined threshold temperature, (ii) below a second predefined threshold temperature; and when it is detected that the ambient temperature is any one of: more than the first predefined threshold temperature, below the second predefined threshold temperature, reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every K.sup.th cycle of sampling of the right eye-tracking data, wherein K is an integer whose value is greater than or equal to 2; and reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every L.sup.th cycle of sampling of the left eye-tracking data, wherein L is an integer whose value is greater than or equal to 2.
14. The method of claim 8, wherein a given eye-tracker comprises a plurality of light emitters and a plurality of light sensors, the method further comprising: detecting at least one of: (i) when ultraviolet light intensities read out from an ultraviolet sensor of the tracking system are above a predefined threshold ultraviolet level, when an average illuminance read out from an ambient light sensor of the tracking system is above a predefined threshold illuminance; and when at least one of following is detected: (i) the ultraviolet light intensities are above the predefined threshold ultraviolet level, (ii) the average illuminance is above the predefined threshold illuminance, increasing an illumination intensity of each light emitter; decreasing a sampling frequency of a temperature sensor of the tracking system; and increasing a sampling frequency of the ultraviolet sensor.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
DETAILED DESCRIPTION OF EMBODIMENTS
[0016] The following detailed description illustrates embodiments of the present disclosure and ways in which they can be implemented. Although some modes of carrying out the present disclosure have been disclosed, those skilled in the art would recognize that other embodiments for carrying out or practising the present disclosure are also possible.
[0017] In a First Aspect, the Present Disclosure Provides a Tracking System for an Adaptive Eyeglass, the Tracking System Comprising: [0018] a left eye-tracker and a right eye-tracker for a left part and a right part of the adaptive eyeglass, respectively, wherein each of the left eye-tracker (204a, 304a) and the right eye-tracker (204b, 304b) comprises a plurality of light emitters, a plurality of light sensors and an analog front end (AFE) chip, wherein the plurality of light emitters are implemented as infrared (IR) emitters, while the plurality of light sensors are implemented as IR sensors; [0019] at least one left auxiliary sensor and at least one right auxiliary sensor arranged on the left part and the right part, respectively, wherein the at least one left auxiliary sensor and the at least one right auxiliary sensor are peripheral sensors; [0020] a processor; [0021] a left communication bus that is employed to communicably couple the processor to the at least one left auxiliary sensor; and [0022] a right communication bus that is employed to communicably couple the processor to the at least one right auxiliary sensor,
wherein the processor is configured to: [0023] temporarily disable communication between the at least one left auxiliary sensor and the left communication bus, whilst sampling left eye-tracking data using the left eye-tracker; and [0024] temporarily disable communication between the at least one right auxiliary sensor and the right communication bus, whilst sampling right eye-tracking data using the right eye-tracker.
[0025] In a second aspect, the present disclosure provides a method implemented by a tracking system comprising a left eye-tracker and a right eye-tracker, at least one left auxiliary sensor and at least one right auxiliary sensor, a processor, a left communication bus communicably coupling the processor to the at least one left auxiliary sensor, and a right communication bus communicably coupling the processor to the at least one right auxiliary sensor, wherein each of the left eye-tracker and the right eye-tracker comprises a plurality of light emitters, a plurality of light sensors and an analog front end (AFE) chip, wherein the plurality of light emitters are implemented as infrared (IR) emitters, while the plurality of light sensors are implemented as IR sensors, and wherein the at least one left auxiliary sensor and the at least one right auxiliary sensor are peripheral sensors, the method comprising: [0026] temporarily disabling communication between the at least one left auxiliary sensor and the left communication bus, whilst sampling left eye-tracking data using the left eye-tracker; and [0027] temporarily disabling communication between the at least one right auxiliary sensor and the right communication bus, whilst sampling right eye-tracking data using the right eye-tracker.
[0028] Pursuant to the present disclosure, the tracking system and the method are capable of preventing any noise sensitivity issues during sampling of the eye-tracking data. This technical benefit is achieved by temporarily disabling the communication between the auxiliary sensor(s) and the communication bus for a given eye, when the eye-tracking data is being sampled from the eye tracker for the given eye. This allows to time-multiplex various activities of the eye-tracker and the auxiliary sensor(s) of the given eye (namely, the same eye) in a very selective, yet effective manner. In other words, the activities of the auxiliary sensor(s) of the given eye need not be stalled completely, while the eye-tracker of the given eye is working (namely, either sampling or reading out). For example, reading-out of sensor data from the auxiliary sensor(s) of the given eye can be performed while the eye-tracker of the given eye is also reading out. This allows the tracking system and the method to work most efficiently (namely, without any delays), whilst facilitating highly accurate eye-tracking. Moreover, such a very selective manner of time-multiplexing between the eye-tracker and the auxiliary sensor(s) for the same eye works seamlessly and synchronously when performed for both the eyes. This will be evident from examples provided later in the present disclosure.
[0029] For purposes of the present disclosure, there will now be provided some implementation examples of various components of the tracking system. Herein, each eye-tracker (namely, the left eye-tracker and the right eye-tracker) comprises the plurality of light emitters and the plurality of light sensors. Notably, each eye-tracker comprising the plurality of light emitters and the plurality of light sensors enables the eye-tracking to be performed without requiring the eye-tracker to come in contact with a user's face. In some implementations, the plurality of light emitters are implemented as infrared (IR) emitters, while the plurality of light sensors are implemented as IR sensors. It will be appreciated that the IR light emitted from the IR emitters is invisible to the human eye and remains unaffected from visible light sources (for example, sunlight, room lighting, and the like) which enables to minimize noise levels in the signals received by the IR sensors. In other implementations, the plurality of light emitters can be implemented as ultraviolet (UV) emitters, while the plurality of light sensors can be implemented as UV sensors. In this regard, the UV emitters and the UV sensors may operate with UV light lying in a range of wavelengths that are not harmful to the human eye. For example, a wavelength of the UV light may lie in a range from 315 nanometres to 400 nanometres.
[0030] In some implementations, each eye-tracker could comprise an analog front end (AFE) chip that converts analog signals received from the plurality of light sensors to digital signals. In other implementations, each of the plurality of light sensors could have a built-in AFE functionality within itself. Notably, the use of the AFE chip in each eye-tracker enables to amplify and enhance the quality of the analog signals received from the plurality of light sensors.
[0031] Examples of the adaptive eyeglasses include, but are not limited to, a pair of glasses, a pair of sunglasses, and smart glasses. The term auxiliary sensor refers to any peripheral sensor that is communicably coupled to the processor with a communication bus. Notably, the at least one left auxiliary sensor and the at least one right auxiliary sensor being peripheral sensors implies that the at least one left auxiliary sensor and the at least one right auxiliary sensor are arranged in the adaptive eyeglass without affecting an aesthetic appearance of the adaptive eyeglass. The at least one auxiliary sensor can be implemented as various different types of sensors. As an example, the at least one auxiliary sensor could comprise a temperature sensor that is employed to sense an ambient temperature. As another example, the at least one auxiliary sensor could comprise a UV sensor. As yet another example, the at least one auxiliary sensor could be a charge level sensor that is employed to sense a charge level of at least one rechargeable power source of the tracking system. As still another example, the at least one auxiliary sensor could be an ambient light sensor. Optionally, in this regard, the tracking system further comprises the at least one rechargeable power source that is employed to supply electrical power to the left eye-tracker, the right eye-tracker, the at least one left auxiliary sensor, the at least one right auxiliary sensor and the processor.
[0032] The processor can be implemented as a microcontroller, a controller, or a microprocessor. As an example, the processor could be implemented as an application-specific integrated circuit (ASIC) chip, or a reduced instruction set computer (RISC) chip.
[0033] The left communication bus communicably coupling the processor to the at least one left auxiliary sensor can be implemented as an Inter-Integrated Circuit (I2C) bus. Similarly, the right communication bus communicably coupling the processor to the at least one right auxiliary sensor can also be implemented as an I2C bus. It will be appreciated that there may be several communication buses in the tracking system. In some implementations, the left eye-tracker and the right eye-tracker may be communicably coupled to the processor via different buses, namely Serial Peripheral Interface (SPI) buses.
[0034] Throughout the present disclosure, the term sampling refers to measuring or collecting sensor data from a given sensor. In case of an eye-tracker, the term sampling refers to measuring or collecting eye-tracking data from the eye-tracker. It is known that reading out the sensor data from the at least one auxiliary sensor during sampling of the eye-tracking data for the same eye leads to noise in the eye-tracking data. The present disclosure provides various ways in which such a situation can be prevented.
[0035] In an embodiment, the left eye-tracking data and the right eye-tracking data are sampled in a time-multiplexed manner. It will be appreciated that such a time-multiplexing for sampling the left eye-tracking data and the right eye-tracking data is performed in addition to the aforementioned very selective time-multiplexing of activities between the auxiliary sensor(s) and the eye-tracker of the same eye. This allows the tracking system and the method to work most efficiently (namely, without any delays), whilst facilitating highly accurate eye-tracking for both the eyes.
[0036] For this purpose, the tracking system is electrically designed to support operations of the left side and the right side independently. In other words, separate communication buses are employed to isolate sensitive power lines and sensitive signals from each other, thereby allowing a peripheral circuit operation of an opposite eye to work seamlessly during alternating left and right eye tracking.
[0037] The overall time-multiplexing between the left eye-tracker and the right eye-tracker, and between the eye-tracker and the auxiliary sensor(s) of the same eye can be performed in various different ways, depending on a scenario in which the tracking system is operating. For illustration purposes only, there will now be considered a few different scenarios, for example, based on a charge level of the at least one rechargeable power source of the tracking system, ambient conditions of the tracking system (including ambient light conditions and ambient temperature), and additional circuitry power consumption.
[0038] Optionally, the Processor is Configured to: [0039] read out the left eye-tracking data from the left eye-tracker, during a time period when the right eye-tracking data is being sampled; and [0040] read out the right eye-tracking data from the right eye-tracker, during another time period when the left eye-tracking data is being sampled.
[0041] This may be a simplest way to time multiplex the sampling of the left eye-tracking data and the sampling of the right eye-tracking data, pursuant to the present disclosure. This can be used in combination with additional ways to time multiplex between the eye-tracker and the auxiliary sensor(s) of the same eye, to achieve the overall time-multiplexing between the left eye-tracker and the right eye-tracker, and between the eye-tracker and the auxiliary sensor(s) of the same eye can be performed.
Case 1: High/Medium Charge Level Condition
[0042] In a first embodiment, the processor is configured to: [0043] detect when a charge level of the at least one rechargeable power source is above a first predefined threshold level; and [0044] when it is detected that the charge level is above the first predefined threshold level, [0045] read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during a time period when the right eye-tracking data is being sampled; and [0046] read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during another time period when the left eye-tracking data is being sampled.
[0047] In other words, the sensor data is read out from the auxiliary sensor(s) of the given eye when the eye-tracking data of another eye is being sampled. This does not cause any noise to the eye-tracking data of the other eye, because noise on the left communication bus does not affect the sampling of the right eye-tracking data (and vice versa).
[0048] Moreover, as the sampling of the eye-tracking data for the left eye and the right eye is performed in the time-multiplexed manner (as mentioned earlier), this also means that the sensor data of the auxiliary sensor(s) of the given eye is read out when the eye-tracking data of the same eye is not being sampled. In fact, the sensor data of the auxiliary sensor(s) of the given eye can be read out when the eye-tracking data of the same eye is being read out. Notably, any noise during the read-out phase of the eye-tracker for the given eye does not affect the eye-tracking data that has been already sampled for the given eye. As a result, there is no noise in the eye-tracking data of the given eye (namely, the same eye) also. One example implementation of the first embodiment has been illustrated in conjunction with
[0049] It will be appreciated that the at least one rechargeable power source could comprise separate rechargeable power sources for a left side and a right side of the adaptive eyeglass. In such a case, the charge level of the at least one rechargeable power source could refer to an overall charge level of the separate rechargeable power sources.
[0050] The first predefined threshold level could be either system defined by default or user-defined. The first predefined threshold level may, for example, lie in a range of 40 percent to 80 percent; more optionally, in a range of 50 percent to 70 percent.
Case 2: Low Charge Level Condition
[0051] In a second embodiment, the processor is configured to: [0052] detect when the charge level of the at least one rechargeable power source is any one of: (i) not above the first predefined threshold level, (ii) below a second predefined threshold level; and [0053] when it is detected that the charge level is any one of: (i) not above the first predefined threshold level, (ii) below the second predefined threshold level, [0054] read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every M.sup.th cycle of sampling of the right eye-tracking data, wherein M is an integer whose value is greater than or equal to 2; and [0055] read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every N.sup.th cycle of sampling of the left eye-tracking data, wherein N is an integer whose value is greater than or equal to 2.
[0056] This allows to reduce power consumption of the auxiliary sensor(s), thereby allowing the tracking system to utilise the remaining charge of the at least one rechargeable power source to focus on high priority tasks, such as eye-tracking. Moreover, by reducing the frequency of activities performed by the auxiliary sensor(s) and performing lesser number of activities in parallel, voltage fluctuations can be prevented during the low charge level condition.
[0057] In some implementations, there may be only one predefined threshold levels for the charge level, namely, the first predefined threshold level. In such implementations, the tracking system may be considered to have: [0058] a high charge level, when the charge level is above the first predefined threshold level; and [0059] a low charge level, when the charge level is not above the first predefined threshold level.
[0060] Accordingly, in such implementations, the charge level being (i) not above the first predefined threshold level corresponds to the low charge level.
[0061] In other implementations, there may be two separate predefined threshold levels for the charge level, namely, the first predefined threshold level and the second predefined threshold level, wherein the first predefined threshold level is higher than the second predefined threshold level. As an example, the first predefined threshold level could be 50 percent, while the second predefined threshold level could be 25 percent. In such implementations, the tracking system may be considered to have: [0062] a high charge level, when the charge level is above the first predefined threshold level; [0063] a medium charge level, when the charge level is not above the first predefined threshold level, but above the second predefined threshold level; and [0064] a low charge level, when the charge level is below the second predefined threshold level.
[0065] Accordingly, in such implementations, the charge level being (ii) below the second predefined threshold level corresponds to the low charge level.
[0066] Referring to the operation of read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every M.sup.th cycle of sampling of the right eye-tracking data, if M were equal to 2, this would mean that the left sensor data would be read out during every 2.sup.nd cycle of sampling of the right eye-tracking data. Moreover, it will be appreciated that for reading out the left sensor data in every M.sup.th cycle of sampling of the right eye-tracking data, the left sensor data could be sampled during every M-1.sup.th cycle of sampling of the right eye-tracking data. One example implementation of the second embodiment has been illustrated in conjunction with
[0067] It will be appreciated that M and N can be much higher than 2, depending on how often the sensor data needs to be sampled. For example, in a case where the at least one auxiliary sensor comprises a charge level sensor and a temperature sensor, it may be preferred to read out the ambient temperature from the temperature sensor more often than reading out the charge level from the charge level sensor, when eye tracking is active. As an example, the charge level may be read out once every 5 seconds, which could mean that M for the charge level sensor is in an order of hundreds, for example 300 or more. Moreover, it will be appreciated that M and N can be different.
Case 3: Hot/Cold Ambient Condition
[0068] In a third embodiment, at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises a temperature sensor that is employed to sense an ambient temperature, and wherein the processor is configured to: [0069] detect when the ambient temperature is any one of: (i) more than a first predefined threshold temperature, (ii) below a second predefined threshold temperature; and [0070] when it is detected that the ambient temperature is any one of: (i) more than the first predefined threshold temperature, (ii) below the second predefined threshold temperature, [0071] read out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every K.sup.th cycle of sampling of the right eye-tracking data, wherein K is an integer whose value is greater than or equal to 2; and [0072] read out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every L.sup.th cycle of sampling of the left eye-tracking data, wherein L is an integer whose value is greater than or equal to 2.
[0073] This allows to reduce power consumption of the auxiliary sensor(s), thereby allowing the tracking system to utilise the remaining charge of the at least one rechargeable power source to focus on high priority tasks, such as eye-tracking, during the hot/cold ambient condition.
[0074] It will be appreciated that the ambient temperature being (i) more than the first predefined threshold temperature pertains to a hot ambient condition, while the ambient temperature being (ii) below the second predefined threshold temperature pertains to a cold ambient condition. As an example, the first predefined threshold temperature may lie in a range of 30 to 60 degree Celsius; more optionally, in a range of 40 to 50 degree Celsius. As another example, the second predefined threshold temperature may lie in a range of 10 to 5 degree Celsius; more optionally, in a range of 10 to 0 degree Celsius. It will be appreciated that the first predefined threshold temperature and the second predefined threshold temperature may be selected depending on a type of battery cell employed in the at least one rechargeable power source.
[0075] Moreover, it will be appreciated that K and L can be different.
[0076] It will also be appreciated that the hot/cold ambient condition (of Case 3) works quite similarly to the low charge level condition (of Case 2). This is because in the cold ambient condition, the tracking system behaves similar to the low charge level condition due to an increase in an internal impedance of the at least one rechargeable power source. In order to take this increase in the internal impedance into account, a voltage limit of the at least one rechargeable power source for the low charge level condition can be adjusted to be slightly higher in the cold ambient condition. In other words, parallel processing can be avoided at a higher battery voltage, in the cold ambient condition.
[0077] On the other hand, in the hot ambient condition, the internal impedance of the at least one rechargeable power source decreases, thereby reducing the noise during power-consuming tasks. However, this reduction in the noise is not very significant as compared to the overall noise that is experienced in the prior art due to parallel sampling of the eye-tracking data with reading out of the sensor data from the auxiliary sensor(s) for the same eye. Besides, current consumption of integrated circuits (namely, of the eye-tracker and the auxiliary sensor(s)) and the various communication buses increases in the hot ambient condition, thereby causing more noise coupling. As a result, the eye-tracker becomes less efficient in the hot ambient condition.
[0078] Therefore, in a scenario where both Case 2 and Case 3 are satisfied simultaneously, namely, the battery level is low and the ambient condition is hot or cold, the first predefined threshold level and/or the second predefined threshold level for the charge level can be modified. As an example, in very hot environments (for example, such as 45 degree Celsius or more), the first predefined threshold level and/or the second predefined threshold level can be decreased. As a result, the low battery condition would be satisfied sooner in the hot ambient condition, thereby enabling the tracking system to schedule and multiplex the various activities of the eye-tracker and the auxiliary sensor(s) for both the eyes optimally.
Case 4: Bright Outdoor Environment Condition
[0079] In a fourth embodiment, at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises a temperature sensor, and at least one of: the at least one left auxiliary sensor, the at least one right auxiliary sensor comprises at least one of: a UV sensor, an ambient light sensor, wherein a given eye-tracker comprises a plurality of light emitters and a plurality of light sensors, [0080] wherein the processor is configured to: [0081] detect at least one of: (i) when UV light intensities read out from the ultraviolet sensor are above a predefined threshold UV level, (ii) when an average illuminance read out from the ambient light sensor is above a predefined threshold illuminance; and [0082] when at least one of following is detected: (i) the UV light intensities are above the predefined threshold UV level, (ii) the average illuminance is above the predefined threshold illuminance, [0083] increase an illumination intensity of each light emitter; [0084] decrease a sampling frequency of the temperature sensor; and [0085] increase a sampling frequency of the UV sensor.
[0086] When the UV light intensities are above the predefined threshold UV level, they could indicate a bright outdoor environment. The UV light intensities may be expressed in terms of the UV index (UVI). Accordingly, the predefined threshold UV level can also be defined in terms of UVI. Optionally, the predefined threshold UV level may lie in a range of 0.8 UVI to 1.2 UVI. As an example, the predefined threshold UV level may be 1 UVI; accordingly, a user of the adaptive eyeglass may be considered to be in a bright outdoor environment, when the UV light intensities read out from the ultraviolet sensor are above 1 UVI. It will be appreciated that typically, an indoor environment corresponds to a UV-index that is near zero.
[0087] Likewise, when the average illuminance is above the predefined threshold illuminance, it could indicate a bright outdoor environment. In a typical bright outdoor environment (namely, during daylight hours), the average illuminance may, for example, range from 10,000 lux to 100,000 lux or more. Accordingly, the predefined threshold illuminance may lie in a range of 5,000 lux to 10,000 lux.
[0088] It will be appreciated that using the ambient light sensor in combination with the UV sensor allows to improve the accuracy of detecting when the user is in a bright outdoor environment. This may be particularly beneficial when the UV sensor does not have a high accuracy.
[0089] In the bright outdoor environment condition, the illumination intensity of each light emitter is increased, thereby allowing the eye-tracker to sample the eye-tracking data more accurately. Notably, an increase in the ambient light level (which can be indicated by the UV light intensities read out from the ultraviolet sensor and/or by the average illuminance read out from the ambient light sensor) negatively impacts the accuracy of the light sensors; therefore, increasing the illumination intensity of the light emitters may allow to improve accuracy under such a condition. Optionally, the illumination intensity of a given light emitter is increased by a predefined percent that is selected based on the ultraviolet light intensities. As an example, the illumination intensity can be increased by percent.
[0090] Moreover, in the bright outdoor environment condition, the sampling frequency of the temperature sensor can be decreased, thereby allowing the tracking system to utilise the remaining charge of the at least one rechargeable power source for high priority tasks, namely, eye tracking and increasing the illumination intensity of the light emitters. As an example, the sampling frequency of the temperature sensor can be decreased by 50 percent. As another example, the sampling frequency of the temperature sensor can be decreased by 90 percent.
[0091] Furthermore, in the bright outdoor environment condition, the sampling frequency of the UV sensor can be increased, thereby allowing the tracking system to identify any changes in the bright outdoor environment condition promptly. This further allows the tracking system to schedule various activities of the auxiliary sensor(s) accordingly. As an example, the sampling frequency of the UV sensor can be increased by 50 percent. As another example, the sampling frequency of the UV sensor can be increased by 100 percent.
[0092] In this way, the tracking system is configured to prevent noise coupling from internal signalling, whilst balancing power rails. As is evident from the aforementioned Cases 1 to 4, the tracking system can be configured to take into account different sources impacting internally generated noise in the tracking system, including ambient conditions (namely, the UV light intensities and the ambient temperature), power source condition (namely, the charge level and aging) and peripheral circuitry power consumption (for example, Bluetooth communication, UV sensor(s), temperature sensor(s), memory, inertial measurement unit (IMU), and the like) to time slot and adjust the sampling frequency, speed and parallelism of the various activities of the tracking system, to minimize communication bus and power rail noise, during sensitive AFE operation.
[0093] The present disclosure also relates to the method of the second aspect as described above. Various embodiments and variants disclosed above, with respect to the tracking system of the aforementioned first aspect, apply mutatis mutandis to the method of the second aspect.
[0094] Optionally, the left eye-tracking data and the right eye-tracking data are sampled in a time-multiplexed manner.
[0095] Optionally, the method further comprises: [0096] reading out the left eye-tracking data from the left eye-tracker, during a time period when the right eye-tracking data is being sampled; and [0097] reading out the right eye-tracking data from the right eye-tracker, during another time period when the left eye-tracking data is being sampled.
[0098] In a first embodiment, the method further comprises: [0099] detecting when a charge level of the at least one rechargeable power source of the tracking system is above a first predefined threshold level; and [0100] when it is detected that the charge level is above the first predefined threshold level, [0101] reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during a time period when the right eye-tracking data is being sampled; and [0102] reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during another time period when the left eye-tracking data is being sampled.
[0103] In a second embodiment, the method further comprises: [0104] detecting when a charge level of the at least one rechargeable power source of the tracking system is any one of: (i) not above a first predefined threshold level, (ii) below a second predefined threshold level; and [0105] when it is detected that the charge level is any one of: (i) not above the first predefined threshold level, (ii) below the second predefined threshold level, [0106] reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every M.sup.th cycle of sampling of the right eye-tracking data, wherein M is an integer whose value is greater than or equal to 2; and [0107] reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every N.sup.th cycle of sampling of the left eye-tracking data, wherein N is an integer whose value is greater than or equal to 2.
[0108] In a third embodiment, the method further comprises: [0109] detecting when an ambient temperature of the tracking system is any one of: (i) more than a first predefined threshold temperature, (ii) below a second predefined threshold temperature; and [0110] when it is detected that the ambient temperature is any one of: (i) more than the first predefined threshold temperature, (ii) below the second predefined threshold temperature, [0111] reading out left sensor data from the at least one left auxiliary sensor by allowing communication between the at least one left auxiliary sensor and the left communication bus, during every K.sup.th cycle of sampling of the right eye-tracking data, wherein K is an integer whose value is greater than or equal to 2; and [0112] reading out right sensor data from the at least one right auxiliary sensor by allowing communication between the at least one right auxiliary sensor and the right communication bus, during every L.sup.th cycle of sampling of the left eye-tracking data, wherein L is an integer whose value is greater than or equal to 2.
[0113] In a fourth embodiment, a given eye-tracker comprises a plurality of light emitters and a plurality of light sensors, the method further comprising: [0114] detecting at least one of: (i) when ultraviolet light intensities read out from an ultraviolet sensor of the tracking system are above a predefined threshold ultraviolet level, (ii) when an average illuminance read out from an ambient light sensor of the tracking system is above a predefined threshold illuminance; and [0115] when at least one of following is detected: (i) the ultraviolet light intensities are above the predefined threshold ultraviolet level, (ii) the average illuminance is above the predefined threshold illuminance, [0116] increasing an illumination intensity of each light emitter; [0117] decreasing a sampling frequency of a temperature sensor of the tracking system; and [0118] increasing a sampling frequency of the ultraviolet sensor.
DETAILED DESCRIPTION OF THE DRAWINGS
[0119] Referring to
[0120] The processor 208 is configured to: [0121] temporarily disable communication between the at least one left auxiliary sensor 206a and the left communication bus 210a, whilst sampling left eye-tracking data using the left eye-tracker 204a; and [0122] temporarily disable communication between the at least one right auxiliary sensor 206b and the right communication bus 210b, whilst sampling right eye-tracking data using the right eye-tracker 204b.
[0123] This prevents any noise sensitivity issues during sampling of the eye-tracking data.
[0124] Referring to
[0125] The processor 308 is configured to: [0126] temporarily disable communication between the at least one left auxiliary sensor 306a-c and the left communication bus 310a, whilst sampling left eye-tracking data using the left eye-tracker 304a; and [0127] temporarily disable communication between the at least one right auxiliary sensor 306d-f and the right communication bus 310b, whilst sampling right eye-tracking data using the right eye-tracker 304b.
[0128] This prevents any noise sensitivity issues during sampling of the eye-tracking data.
[0129]
[0130]
[0131]
[0133] In other words, the sensor data is read out from the auxiliary sensor(s) of the given eye when the eye-tracking data of another eye is being sampled. This does not cause any noise to the eye-tracking data of the other eye. Moreover, as the sampling of the eye-tracking data for the left eye and the right eye is performed in a time-multiplexed manner, the sensor data of the auxiliary sensor(s) of the given eye is read out when the eye-tracking data of the same eye is not being sampled. As shown in
[0134]
[0135] According to the second embodiment,
[0138] This allows to reduce power consumption of the auxiliary sensor(s), thereby allowing the tracking system to utilise the remaining charge of the at least one rechargeable power source to focus on high priority tasks, such as eye-tracking. Moreover, by reducing the frequency of activities performed by the auxiliary sensor(s) and performing lesser number of activities in parallel, voltage fluctuations can be prevented during the low charge level condition. With reference to
[0139] According to the third embodiment,
[0142] This allows to reduce power consumption of the auxiliary sensor(s), thereby allowing the tracking system to utilise the remaining charge of the at least one rechargeable power source to focus on high priority tasks, such as eye-tracking, during the hot/cold ambient condition. Moreover, by reducing the frequency of activities performed by the auxiliary sensor(s) and performing lesser number of activities in parallel, voltage fluctuations can be prevented during the hot/cold ambient condition. With reference to
[0143]
[0144] Referring to
[0145] The aforementioned steps are only illustrative and other alternatives can also be provided where one or more steps are added, one or more steps are removed, or one or more steps are provided in a different sequence without departing from the scope of the claims herein.