Distance measurement device having external light illuminance measurement function and external light illuminance measurement method

Abstract

A distance measurement device includes a light emission unit which is capable of emitting measurement light to be irradiated toward an object, a light reception unit configured to receive light from the object via an optical filter through which light having the same wavelength band as the measurement light passes, a distance calculation unit configured to calculate a distance to the object based on each charge amount obtained by accumulating a charge corresponding to the received light at a plurality of timings which are delayed by a predetermined phase with respect to emission timing of the measurement light, and an external light intensity calculation unit configured to calculate external light illuminance of external light illuminating the object at the spectral sensitivity of the optical filter based on the charge amounts acquired at the light reception unit and a reflectivity of the object.

Claims

1. A distance measurement device, comprising: a light emission unit which is capable of emitting measurement light to be irradiated toward an object, a light reception unit configured to receive light from the object via an optical filter through which light having the same wavelength band as the measurement light passes, a distance calculation unit configured to calculate a distance to the object based on each charge amount obtained by accumulating a charge corresponding to the received light at a plurality of timings which are delayed by a predetermined phase with respect to emission timing of the measurement light, and an external light illuminance calculation unit configured to calculate external light illuminance of external light illuminating the object at the spectral sensitivity of the optical filter based on the charge amounts acquired at the light reception unit and a reflectivity of the object.

2. The distance measurement device according to claim 1, wherein the light passing through the optical filter is near-infrared light.

3. The distance measurement device according to claim 1, wherein the reflectivity of the object is calculated based on the calculated distance to the object and reflected brightness of the measurement light reflected at the object which is determined from each charge amount.

4. The distance measurement device according to claim 1, wherein the reflectivity of the object is known.

5. The distance measurement device according to claim 1, wherein the external light illuminance is calculated based on reflected brightness of external light reflected at the object which is determined from each charge amount and the reflectivity of the object.

6. The distance measurement device according to claim 1, further comprising an output unit configured to output the external light illuminance.

7. The distance measurement device according to claim 6, wherein the light reception unit comprises a plurality of two-dimensionally arrayed pixels, the external light illuminance calculation unit calculates an external light illuminance for each pixel, and the output unit outputs an external light illuminance image.

8. The distance measurement device according to claim 1, further comprising a warning unit configured to output a warning signal when the external light illuminance is equal to or greater than a threshold value.

9. The distance measurement device according to claim 1, further comprising an image output unit configured to output an external light illuminance emphasis image in which pixels with the external light illuminance equal to or greater than a threshold value are highlighted.

10. The distance measurement device according to claim 1, wherein a charge amount corresponding to reflected brightness of the external light reflected at the object is determined by the following formula:
Qa={(Q1+Q2+Q3+Q4)−2Qs}/2, where Qa is the charge amount corresponding to the reflected brightness of the external light reflected at the object, Q1, Q2, Q3, Q4 respectively represent the charge amounts obtained at the plurality of timings, and Qs is a charge amount corresponding to reflected brightness of the measurement light reflected at the object.

11. An external light illuminance measurement method, comprising the steps of: selecting whether or not to emit measurement light to be irradiated toward an object, receiving light from the object via an optical filter through which light having the same wavelength band as the measurement light passes, and calculating external light illuminance of external light illuminating the object at the spectral sensitivity of the optical filter based on charge amounts corresponding to the received light and a reflectivity of the object.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) FIG. 1 is a view illustrating the definitions of the terms used in the present description.

(2) FIG. 2 is a view showing the status of the external light illuminance of the external light illuminating an object and the reflected brightness of the external light reflected at the object.

(3) FIG. 3 is a block diagram showing the structure of a distance measurement device according to an embodiment.

(4) FIG. 4 is a view showing a charge amount including reflected measurement light and reflected external light.

(5) FIG. 5A is a view illustrating the relationship between the reflectivity of an object, the distance to the object, and an acquired charge amount.

(6) FIG. 5B is a view illustrating the relationship between the reflectivity of an object, the distance to the object, and an acquired charge amount.

(7) FIG. 6 is a view showing the relationship between illuminance and the distance from a light source.

(8) FIG. 7 is a view showing an object having a known reflectivity.

(9) FIG. 8 is a view showing an example of an output unit configured to output external light illuminance.

(10) FIG. 9A is a view showing the case in which there is an auxiliary or unintended external light source.

(11) FIG. 9B is a view showing an example of an external light illuminance image.

(12) FIG. 10A is a view showing the influence of external light on distance measurement accuracy in the prior art.

(13) FIG. 10B is a view showing the influence of external light on distance measurement accuracy in the prior art.

(14) FIG. 11A is a view showing the influence of external light on the inability to measure distance in the prior art.

(15) FIG. 11B is a view showing the influence of external light on the inability to measure distance in the prior art.

(16) FIG. 12A is a view showing an example of the spectral sensitivity of a conventional lux meter.

(17) FIG. 12B is a view showing an example of the transmission wavelength of an optical filter in a conventional TOF camera.

DETAILED DESCRIPTION

(18) The embodiments of the present disclosure will be described in detail below with reference to the attached drawings. In the drawings, identical or similar constituent elements have been assigned the same or similar signs. Furthermore, the embodiments described below do not limit the technical scope of the inventions or the definitions of the terms described in the claims.

(19) FIG. 1 is a view showing the definitions of the terms used in the present description. A distance measurement device 1, an object O, and an external light source L are illustrated in FIG. 1. In the present description, the phrase “measurement light” (represented by sign S) means light which is emitted from a light emission unit of the distance measurement device 1 toward the object O, the phrase “reflected brightness of the measurement light” (represented by sign I.sub.s) means the reflected intensity of the measurement light S reflected at the object O. Furthermore, in the present description, the phrase “external light” (represented by sign A) means the light emitted from the external light source L other than the distance measurement device 1, and the phrase “external light illuminance” (represented by sign E.sub.A) means the intensity of the external light A with which the external light source L irradiates the object O at the spectral sensitivity of the distance measurement device 1. Further, in the present description, the phrase “reflected brightness of the external light” (represented by sign I.sub.A) means the intensity of the external light A reflected at the object O at the spectral sensitivity of the distance measurement device 1. Furthermore, the phrase “reflectivity of the object” (represented by sign p) means the calculated reflectivity of the object O at the spectral sensitivity of the distance measurement device 1 or the known reflectivity of the object at the spectral sensitivity of the distance measurement device 1.

(20) FIG. 2 is a view showing the status of the external light illuminance E.sub.A on the object and the reflected brightness I.sub.A of the external light. When the object has a uniformly-diffusing reflective surface having a reflectivity ρ, the relationship represented by the following formula holds. Note that in this formula, π is the ratio of the circumference of a circle to its diameter. In other words, the external light illuminance E.sub.A on the object O can be determined from the reflected brightness I.sub.A of the external light from the object O and the reflectivity ρ of the object O.

(21) $\begin{array}{cc}\left[\mathrm{Formula}1\right]& \end{array}$$\begin{array}{cc}{E}_A=\frac{\pi }{\rho }{I}_A& 1\end{array}$

(22) FIG. 3 shows the structure of the distance measurement device 1 according to the present embodiment. The distance measurement device 1 comprises a light emission unit 10, an optical filter 11, a light reception unit 12, a light emission/reception control unit 13, an A/D conversion unit 14, a memory 15, a distance calculation unit 16, and an external light illuminance calculation unit 17. The distance measurement device 1 may further comprise at least one of an output unit 18, a warning unit 19, and an image output unit 20. At least one of the memory 15, the distance calculation unit 16, the external light illuminance calculation unit 17, the output unit 18, the warning unit 19, and the image output unit 20 may be constituted by a semiconductor integrated circuit such as a known processor, for example, a CPU (central processing unit), or an FPGA (field-programmable gate array).

(23) The light emission unit 10 comprises a light source which emits intensity-modulated measurement light S, for example a light-emitting diode, a semiconductor laser, etc., and is capable of selectively emitting the measurement light S toward the object O. The measurement light S is, for example, near-infrared light, and may be light of another wavelength as long as the light is suitable for distance measurement.

(24) The optical filter 11 is designed to have a spectral sensitivity such that light of the same wavelength band as the measurement light S passes therethrough. The light passing through the optical filter 11 is, for example, near-infrared light, like the measurement light S, and not only the reflected measurement light S reflected at the object O, but also the reflected light of the same wavelength band as the measurement light S in the reflected external light A reflected at the object O passes therethrough.

(25) The light reception unit 12 comprises, for example, a light-receiving element, a capacitor, etc., receives light from the object O via the optical filter 11, and accumulates charge in accordance with the received light. The light reception unit 12 may comprise a single light-receiving element, or may comprise a plurality of two-dimensionally arrayed light-receiving elements, for example, a CCD (charge-coupled device) image sensor, a CMOS (complementary metal-oxide semiconductor) image sensor, etc.

(26) The light emission/reception control unit 13 comprises a known control circuit which controls the emission timing of the light emission unit 10 and the reception timing of the light reception unit 12, and is controlled by the processor described above. The A/D conversion unit 14 comprises, for example, an A/D converter, etc., and A/D converts the charge amount in accordance with the received light. The memory 15 comprises, for example, a semiconductor memory, a magnetic storage device, etc., and stores the A/D converted charge amount.

(27) The distance calculation unit 16 calculates the distance to the object O based on each charge amount accumulated at a plurality of timings which are delayed by a predetermined phase with respect to the emission timing of the measurement light S. For example, the light reception unit 12 accumulates charge amounts Q1 to Q4 at a plurality of timings delayed by 0°, 90°, 180°, and 270° with respect to the emission timing of the measurement light S, respectively, and the distance calculation unit 16 calculates the distance d to the object O based on each charge amount Q1 to Q4. For example, the formula for calculating the distance d is as described in the following formula. Note that in the formula, c is the speed of light, and T is the intensity modulation period of the measurement light S.

(28) $\begin{array}{cc}\left[\mathrm{Formula}2\right]& \end{array}$$\begin{array}{cc}d=\frac{c.Math.T}{4}.Math.\left(1+\frac{Q3-Q1}{Q2-Q4}\right)& 2\end{array}$

(29) The external light illuminance calculation unit 17 calculates external light illuminance E.sub.A of external light irradiated toward the object O at the spectral sensitivity of the optical filter 11 based on the charge amount acquired at the light reception unit 12 and the reflectivity ρ of the object O. When the light-receiving element receives only external light via a lens, the reflected brightness I.sub.A of the external light corresponds to the charge amount acquired at the light-receiving element.

(30) The reflected brightness I.sub.A of the external light can be determined even during the distance measurement operation. At this time, the charge amount acquired at the light-receiving element includes not only the reflected brightness I.sub.A of the external light, as shown in FIG. 1, but also the reflected brightness I.sub.s of the measurement light. A method in which only the reflected brightness I.sub.A of the external light is determined from the acquired charge amount will be described below.

(31) FIG. 4 shows a charge amount including the reflected external light and the reflected measurement light. The charge amount Qs corresponding to the reflected brightness I.sub.s of the measurement light can be determined by removing the charge amount Qa corresponding to the reflected brightness I.sub.A of the external light as shown in, for example, the following formula, by individually calculating the differences between the two charge amounts (Q1 and Q3, Q2 and Q4) having different phases, and adding the absolute values of these two difference results.
[Formula 3]
Qs=|Q1−Q3|+|Q2−Q4|  3

(32) Thus, the charge amount Qa corresponding to the reflected brightness I.sub.A of the external light may be determined by subtracting twice the charge amount Qs of the measurement light from the result obtained by adding each charge amount Q1 to Q4, and further dividing the calculation result by 2 as shown in, for example, the following formula. Specifically, the external light illuminance E.sub.A can be calculated even during the distance measurement operation in which measurement light is emitted, and as a result, changes of the external light illuminance E.sub.A due to environmental changes can be continuously monitored even during the distance measurement operation.

(33) $\begin{array}{cc}\left[\mathrm{Formula}4\right]& \end{array}$$\begin{array}{cc}\mathrm{Qa}=\frac{\left(Q1+Q2+Q3+Q4\right)-2\mathrm{Qs}}{2}& 4\end{array}$

(34) Furthermore, in particular at the time of installation of the distance measurement device 1, it is not always necessary to perform a distance measurement operation. Thus, by opening only the shutter without emitting measurement light, only the charge amount Qa corresponding to the reflected brightness I.sub.A of the external light is acquired, whereby the external light illuminance E.sub.A can be calculated based on the charge amount Qa corresponding to the reflected brightness I.sub.A of the external light and the reflectivity ρ of the object. In this modified example, the distance measurement device 1 may further comprise means for selecting whether or not to emit the measurement light.

(35) In the calculation of the external light illuminance E.sub.A, it is necessary that the reflectivity ρ of the object be known, and thus, by preparing an object having a known reflectivity ρ and placing it in the measurement target space, the external light illuminance E.sub.A can be calculated. Furthermore, the reflectivity ρ of an arbitrary object (i.e., an object having an unknown reflectivity ρ) in the target measurement space can be determined by calculation, and the external light illuminance E.sub.A can be calculated from the determined reflectivity ρ. A method for calculating the reflectivity ρ of an object will be described below.

(36) FIGS. 5A and 5B illustrate the relationship between the reflectivity of an object, the distance to the object, and the acquired charge amount. FIG. 5A shows an object O1 which has a high reflectivity and which has a far distance, an object O2 which has a high reflectivity and which has a near distance, and an object O3 which has a low reflectivity and which has a near distance, and FIG. 5B shows the three charge amounts (including the reflected brightness I.sub.s of the measurement light and the reflected brightness I.sub.A of the external light) when the reflected light is received from the objects O1, O2, and O3. When the distance from the distance measurement device 1 to the object is far, even when the reflectivity is the same, as for objects O1 and O2, though the reflected brightness I.sub.s of the measurement light is reduced depending on the distance to the object, the reflected brightness I.sub.A of the external light is unchanged under the same external light illuminance. Conversely, when only the reflectivity differs but the distance is the same, as for objects O2 and O3, the reflected brightness I.sub.s of the measurement light and the reflected brightness I.sub.A of the external light change at the same rate. Specifically, the reflectivity ρ of the object is correlated with the distance to the object and the reflected brightness I.sub.s of the measurement light. Similar to formula 1, the reflected brightness I.sub.s of the measurement light has the following relationship between the illuminance Es of the measurement light and the reflectivity ρ of the object.

(37) $\begin{array}{cc}\left[\mathrm{Formula}5\right]& \end{array}$$\begin{array}{cc}{I}_S=\frac{\rho }{\pi }.Math.E_S& 5\end{array}$

(38) Furthermore, it is also known that illuminance E generally follows the inverse square law of the distance d to the object O. As shown in FIG. 6, when the distances from the light source L to the two objects O1 and O2 are defined as d.sub.1 and d.sub.2, respectively, and the intensities of the objects O1 and O2 are E.sub.1 and E.sub.2, respectively, the following relationship holds between the two intensities E.sub.1 and E.sub.2. Specifically, if the distance doubles, the illuminance becomes ½.sup.2, and if the distance triples, the illuminance becomes ⅓.sup.2.

(39) $\begin{array}{cc}\left[\mathrm{Formula}6\right]& \end{array}$$\begin{array}{cc}{E}_2=\frac{1}{{\left(d_2/d_1\right)}^2}.Math.E_1& 6\end{array}$

(40) Thus, the following formula is obtained from formula 6 and formula 5. Note that in the formula, k is a proportionality constant. According to the following formula, it can be understood that the reflectivity ρ of the object can be calculated based on the calculated distance to the object and the reflected brightness I.sub.s of the measurement light determined from each charge amount Q1 to Q4. In other words, when the reflectivity ρ of the object is determined by calculation, measurement light emission is necessary.

(41) $\begin{array}{cc}\left[\mathrm{Formula}7\right]& \end{array}$$\begin{array}{cc}{I}_S=\frac{\rho }{\pi }.Math.E_S=\frac{k.Math.\rho }{d^2}& 7\end{array}$

(42) As described above, an object O having a known reflectivity ρ may be prepared, as shown in FIG. 7. Further, as a method for acquiring the reflected brightness I.sub.A of the external light, there is a method of obtaining the reflected brightness I.sub.A from the acquired charge amount without emitting measurement light. By using an object having a known reflectivity ρ and using the reflected brightness I.sub.A determined by such a calculation method, it is also possible to more accurately calculate the external light illuminance E.sub.A.

(43) Referring again to FIG. 3, the output unit 18 outputs the external light illuminance E.sub.A calculated by the external light illuminance calculation unit 17 to the outside. The output unit 18 may comprise a display unit 23 such as an LED display or a liquid crystal display, as shown in, for example, FIG. 8, or alternatively, may comprise a communication unit 24 such as an external output port or network communication device as shown in, for example FIG. 8. As an alternative example, the output unit 18 may comprise an external memory such as a semiconductor memory or a magnetic storage device.

(44) When the light reception unit 12 comprises a plurality of two-dimensionally arrayed pixels, such as a CCD image sensor or a CMOS image sensor, the external light illuminance calculation unit 17 may calculate the external light illuminance E.sub.A for each pixel, and the output unit 18 may output an external light illuminance image. An external light illuminance image is particularly effective when there is an auxiliary or unintended external light source L2 other than the external light source L1 in the target measurement space as shown in, for example, FIG. 9A. FIG. 9B shows an external light illuminance image G in which a portion H where the external light is strong due to the external light source L2 can be easily recognized.

(45) Referring again to FIG. 3, when the external light illuminance E.sub.A is equal to or greater than a threshold value, the warning unit 19 outputs a warning signal such as a warning sound or a warning message to the outside. As a result of this warning signal, danger can be notified when a strong external light that is out of the accuracy guarantee of the distance measurement device 1 is detected. When the distance measurement device 1 is used in an application system such as an object monitoring system, the warning signal may be used as a power stop signal of an industrial machine such as a robot or a machine tool.

(46) Referring yet again to FIG. 3, the image output unit 20 outputs to the outside an external light illuminance emphasis image in which pixels with the external light illuminance E.sub.A equal to or greater than a threshold value are highlighted. The external light illuminance emphasis image is an image in which pixels having an external light illuminance E.sub.A equal to or greater than a threshold value are highlighted on an image such as a distance image or a luminance image (for example, an image of the reflected brightness I.sub.s of measurement light, which is generally referred to as an IR (near infrared) image, or an image of the reflected brightness I.sub.A of external light). As a result of this external light illuminance emphasis image, it is possible to easily visually recognize portions where external light which is stronger than a specified value are observed on the image.

(47) According to the embodiments described above, there can be provided a distance measurement device which can measure external light illuminance E.sub.A in accordance with the spectral sensitivity of the distance measurement device 1 without the need for an illuminance meter, spectrometer, etc. In an environment in which the distance measurement device 1 is used, for example, in an FA (factory automation) environment, devices (for example, laser scanners, proximity sensors using near-infrared light, wireless communication devices for IrDA (infrared data association) communication, near-infrared heaters, other TOF cameras, etc.) which use near-infrared light as external light are often used, and the external light of these instruments is conventionally invisible to humans and may not be observable with commercially available illuminance meters in some cases. Thus, it is very significant that the distance measurement device 1 is capable of measuring external light illuminance with the strong influence on distance measurement accuracy or inability to perform distance measurement.

(48) Furthermore, since the external light illuminance E.sub.A that can affect distance measurement accuracy or the inability to perform distance measurement can be more accurately understood, and it is possible to accurately determine whether or not the external light is within the expected range, it is possible to provide a distance measurement device 1 which can operate stably in terms of distance measurement accuracy or the inability to perform distance measurement. Furthermore, since the external light illuminance E.sub.A can be measured using the object to be measured, external light due to environmental changes can be continuously monitored not only at the time of installation of the distance measurement device 1 but also during the distance measurement operation.

(49) The program executed by the processor described above may be stored on a computer-readable nontransitory storage medium such as a CD-ROM, etc.

(50) Though the various of the embodiments have been described in the present specification, the present invention is not limited to the embodiments described above, and it should be appreciated that various changes can be made within the scope of the following claims.