Method and device for recording parking location

10856109 · 2020-12-01

Assignee

Inventors

Cpc classification

International classification

Abstract

The present disclosure relates to a method and device for recording a parking location of a vehicle more accurately at a more accurate time point by performing machine learning through situation recognition by the device. A method for recording parking according to an embodiment of the present disclosure includes, when a communication is established between the terminal and the vehicle, recognizing that a user gets in the vehicle, when a strength of a communication connection signal between the terminal and the vehicle is lowered to be equal to or lower than a predetermined level, recognizing that the user exits the vehicle, when it is determined by the motion sensor of the terminal that the user has moved a predetermined number of walking steps or more, recognizing that parking of the vehicle is completed.

Claims

1. A method for recording a parking location of a vehicle, the method performed by a user terminal and comprising: when a communication connection is established between the user terminal and the vehicle, recognizing that a user enters the vehicle; recognizing, by a motion sensor of the user terminal, that the vehicle, into which the user has entered, starts to travel; when a strength of a communication connection signal between the user terminal and the vehicle drops to a predetermined level or less, recognizing that the user exits the vehicle; after recognizing that the user exits the vehicle, measuring a current location of the user terminal to determine location information of the user terminal; when it is determined by the motion sensor of the user terminal that the user has moved a predetermined number of walking steps or more, recognizing that parking of the vehicle is completed; when it is recognized that the parking of the vehicle is completed, requesting an input of parking information from the user through a user interface of the user terminal; and generating a parking information card based at least in part on the parking information from the user and on the determined location information, wherein the location information comprises location accuracy, the location accuracy indicating an error range of the location information with a distance unit, and wherein, when the location accuracy of the location information is equal to or greater than a predetermined distance value, the corresponding location information is determined as an inaccurate location and is excluded from the determined location information.

2. The method of claim 1, wherein measuring the current location of the user terminal is repeatedly performed at a predetermined interval within a predetermined time range after recognizing that the user exits the vehicle.

3. The method of claim 1, wherein the location information of the user terminal is determined using at least one of base station information relating to a base station connected to the user terminal, WiFi network information relating to a WiFi network connected to the user terminal, or GNSS (Global Navigation Satellite System) signal information relating to a GNSS signal obtained by the user terminal.

4. The method of claim 1, wherein the location information further comprises latitude and longitude.

5. The method of claim 1, further comprising: after recognizing that the vehicle starts to travel and before recognizing that the user exits the vehicle, obtaining first location information, which is a last GNSS (Global Navigation Satellite System) location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the user terminal, wherein measuring the current location of the user terminal comprises: obtaining current location information of the user terminal after recognizing that the user exits the vehicle; and determining the current location information as an abnormal location when a distance from a current location to a first location of the first location information is equal to or greater than a predetermined value, by comparing the current location information and the first location information.

6. The method of claim 1, further comprising: after recognizing that the vehicle starts to travel and before recognizing that the user exits the vehicle, obtaining first location information, which is a last GNSS (Global Navigation Satellite System) location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the user terminal, wherein measuring the current location of the user terminal comprises: a) generating a first group comprising the first location information; b) obtaining current location information of the user terminal after recognizing that the user exits the vehicle; c) calculating distances from a current location to a plurality of existing locations by comparing the current location information with existing location information, the existing location information including the first location information and information about locations of the terminal that were measured after recognizing that the user exits the vehicle; d) when a smallest value among values of the calculated distances from the current location to the existing locations is greater than a pre-configured value, generating a new group comprising the current location information, or when a smallest value among the values of the calculated distances from the current location to the existing locations falls within a pre-configured range, including the current location information in a closest group to which a closest existing location, which is closest to the current location, belongs; and e) terminating the measurement of the current location and providing, as the determined location information, location information having a highest accuracy among locations included in the closest group when a number of locations included in the closest group is equal to or greater than a predetermined number and an accuracy of at least one location among the locations included in the closest group is equal to or greater than a predetermined level, and, otherwise, repeating b), c) and d).

7. A computer-readable recording medium storing one or more instructions that, when executed by a user terminal, cause the user terminal to: when a communication connection is established between the user terminal and a vehicle, recognize that a user enters the vehicle; recognize, by a motion sensor of the user terminal, that the vehicle, into which the user has entered, starts to travel; when a strength of a communication connection signal between the user terminal and the vehicle drops to a predetermined level or less, recognize that the user exits the vehicle; after recognizing that the user exits the vehicle, measure a current location of the user terminal to determine location information of the user terminal; when it is determined by the motion sensor of the user terminal that the user has moved a predetermined number of walking steps or more, recognize that parking of the vehicle is completed; when it is recognized that the parking of the vehicle is completed, request an input of parking information from the user through a user interface of the user terminal; and generate a parking information card based at least in part on the parking information from the user and on the determined location information, wherein the location information comprises location accuracy, the location accuracy indicating an error range of the location information with a distance unit, and wherein, when the location accuracy of the location information is equal to or greater than a predetermined distance value, the corresponding location information is determined as an inaccurate location and is excluded from the determined location information.

8. A device configured to record a parking location of a vehicle, the device comprising: a motion sensor configured to sense movement of the device; a communication module configured to perform communication with an external device; a user interface configured to allow a user and the device to interact with each other; and one or more processors configured to interact with the motion sensor, the communication module, and the user interface, wherein the one or more processors are configured to: when a communication is established between the communication module and the vehicle, recognize that the user enters the vehicle; when the device moves at a predetermined speed or higher, recognize, by the motion sensor, that the vehicle starts to travel; when a strength of a communication connection signal between the communication module and the vehicle drops to a predetermined level or less, recognize that the user exits the vehicle; after recognizing that the user exits the vehicle, measure a current location of the device to determine location information of the device; when it is determined by the motion sensor that the user carrying the device has moved a predetermined number of walking steps or more, recognize that parking of the vehicle is completed; request an input of parking information from the user through the user interface; and generate a parking information card based at least partially on the parking information from the user and on the determined location information, wherein the location information comprises location accuracy, the location accuracy indicating an error range of the location information with a distance unit, and wherein, when the location accuracy of the location information is equal to or greater than a predetermined distance value, the corresponding location information is determined as an inaccurate location and is excluded from the determined location information.

9. The device of claim 8, wherein the one or more processors are configured to request the input of the parking information and generate the parking information card after recognizing that the user enters the vehicle, recognizing that the vehicle starts to travel, recognizing that the user exits the vehicle, and recognizing that the parking of the vehicle is completed are performed in sequence.

10. The device of claim 9, wherein the one or more processors are further configured to repeatedly measure the current location of the device at a predetermined interval within a predetermined range of time after recognizing that the user exits the vehicle.

11. The device of claim 9, wherein the communication module comprises a GNSS (Global Navigation Satellite System) module, and the location information of the device is determined using at least one of base station information relating to a base station connected to the device, WiFi network information relating to a WiFi network connected to the device, or GNSS signal information relating to a GNSS signal obtained by the device.

12. The device of claim 9, wherein the location information further comprises latitude and longitude.

13. The device of claim 9, wherein the communication module comprises a GNSS (Global Navigation Satellite System) module, and the one or more processors are further configured to, after recognizing that the vehicle starts to travel and before recognizing that the user exits the vehicle, obtain first location information, which is a last GNSS location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the device, and the one or more processors measure the current location of the device by: obtaining current location information of the device after recognizing that the user exits the vehicle; and determining the current location information as an abnormal location when a distance from a current location to a first location of the first location information is equal to or greater than a predetermined value, by comparing the current location information and the first location information.

14. The device of claim 8, wherein the communication module comprises a GNSS (Global Navigation Satellite System) module, and the one or more processors are further configured to, after recognizing that the vehicle starts to travel and before recognizing that the user exits the vehicle, obtain first location information, which is a last GNSS location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the device, and the one or more processors measure the current location of the device by: a) generating a first group comprising the first location information; b) obtaining current location information of the device after recognizing that the user exits the vehicle; c) calculating distances from a current location to a plurality of existing locations by comparing the current location information and existing location information, the existing location information including the first location information and information about locations of the device measured after recognizing that the user exits the vehicle; d) when a smallest value among values of the calculated distances from the current location to the existing locations is greater than a pre-configured value, generating a new group comprising the current location information, or when a smallest value among the values of the calculated distances from the current location to the existing locations falls within a pre-configured range, including the current location information in a closest group to which a closest existing location, which is closest to the current location, belongs; and e) terminating the measurement of the current location and providing, as the determined location information, location information having a highest accuracy among locations included in the closest group when a number of locations included in the closest group is equal to or greater than a predetermined number, and an accuracy of at least one location among the locations included in the closest group is equal to or greater than a predetermined level, and, otherwise, repeating b), c) and d).

15. A method for recording a parking location of a vehicle, the method performed by a user terminal and comprising: when a communication connection is established between the user terminal and the vehicle, recognizing that a user enters the vehicle; recognizing, by a motion sensor of the user terminal, that the vehicle, into which the user has entered, starts to travel; obtaining first location information, which is a last GNSS (Global Navigation Satellite System) location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the user terminal; when a strength of a communication connection signal between the user terminal and the vehicle drops to a predetermined level or less, recognizing that the user exits the vehicle; after recognizing that the user exits the vehicle, measuring a current location of the user terminal to determine location information of the user terminal; when it is determined by the motion sensor of the user terminal that the user has moved a predetermined number of walking steps or more, recognizing that parking of the vehicle is completed; when it is recognized that the parking of the vehicle is completed, requesting an input of parking information from the user through a user interface of the user terminal; and generating a parking information card based at least in part on the parking information from the user and on the determined location information, wherein measuring the current location of the user terminal comprises: a) generating a first group comprising the first location information; b) obtaining current location information of the user terminal after recognizing that the user exits the vehicle; c) calculating distances from a current location to a plurality of existing locations by comparing the current location information with existing location information, the existing location information including the first location information and information about locations of the terminal that were measured after recognizing that the user exits the vehicle; d) when a smallest value among values of the calculated distances from the current location to the existing locations is greater than a pre-configured value, generating a new group comprising the current location information, or when a smallest value among the values of the calculated distances from the current location to the existing locations falls within a pre-configured range, including the current location information in a closest group to which a closest existing location, which is closest to the current location, belongs; and e) terminating the measurement of the current location and providing, as the determined location information, location information having a highest accuracy among locations included in the closest group when a number of locations included in the closest group is equal to or greater than a predetermined number and an accuracy of at least one location among the locations included in the closest group is equal to or greater than a predetermined level, and, otherwise, repeating b), c) and d).

16. A device configured to record a parking location of a vehicle, the device comprising: a motion sensor configured to sense movement of the device; a communication module configured to perform communication with an external device; a user interface configured to allow a user and the device to interact with each other; and one or more processors configured to interact with the motion sensor, the communication module, and the user interface, wherein the one or more processors are configured to: when a communication is established between the communication module and the vehicle, recognize that the user enters the vehicle; when the device moves at a predetermined speed or higher, recognize, by the motion sensor, that the vehicle starts to travel; when a strength of a communication connection signal between the communication module and the vehicle drops to a predetermined level or less, recognize that the user exits the vehicle; after recognizing that the user exits the vehicle, measure a current location of the device to determine location information of the device; when it is determined by the motion sensor that the user carrying the device has moved a predetermined number of walking steps or more, recognize that parking of the vehicle is completed; request an input of parking information from the user through the user interface; and generate a parking information card based at least partially on the parking information from the user and on the determined location information, wherein the communication module comprises a GNSS (Global Navigation Satellite System) module, and the one or more processors are further configured to, after recognizing that the vehicle starts to travel and before recognizing that the user exits the vehicle, obtain first location information, which is a last GNSS location information before the user exits the vehicle, based on a GNSS signal lastly obtained by the device, and the one or more processors measure the current location of the device by: a) generating a first group comprising the first location information; b) obtaining current location information of the device after recognizing that the user exits the vehicle; c) calculating distances from a current location to a plurality of existing locations by comparing the current location information and existing location information, the existing location information including the first location information and information about locations of the device measured after recognizing that the user exits the vehicle; d) when a smallest value among values of the calculated distances from the current location to the existing locations is greater than a pre-configured value, generating a new group comprising the current location information, or when a smallest value among the values of the calculated distances from the current location to the existing locations falls within a pre-configured range, including the current location information in a closest group to which a closest existing location, which is closest to the current location, belongs; and e) terminating the measurement of the current location and providing, as the determined location information, location information having a highest accuracy among locations included in the closest group when a number of locations included in the closest group is equal to or greater than a predetermined number, and an accuracy of at least one location among the locations included in the closest group is equal to or greater than a predetermined level, and, otherwise, repeating b), c) and d).

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The above and other aspects, features, and advantages of the present disclosure will become apparent from the detailed description of the following aspects in conjunction with the accompanying drawings, in which:

(2) FIG. 1 illustrates an environment for implementing a method for recording a parking location according to an embodiment in the present disclosure;

(3) FIG. 2 illustrates a block diagram of a vehicle and a user terminal according to an embodiment in the present disclosure;

(4) FIG. 3 is a diagram illustrating situations from on-boarding to parking, and technologies and information used for recognizing the situations according to an embodiment in the present disclosure;

(5) FIG. 4 is a diagram illustrating a condition for off-board recognition according to an embodiment in the present disclosure;

(6) FIG. 5 is a diagram illustrating operations performed by recognition of situations according to an embodiment in the present disclosure;

(7) FIGS. 6 to 10 illustrate exemplary screens which may be displayed on a user terminal when the operations illustrated in FIG. 5 are performed;

(8) FIG. 11 is a flow chart of a method for recording a parking location according to an embodiment in the present disclosure;

(9) FIG. 12 is a flow chart of a method for providing decided parking location information of a vehicle according to an embodiment in the present disclosure;

(10) FIG. 13 is a flow chart of a method for grouping location information to provide decided parking location information of a vehicle according to an embodiment in the present disclosure; and

(11) FIG. 14 is a diagram illustrating location information grouping performed according to the flow chart of FIG. 13.

DETAILED DESCRIPTION

(12) Hereinafter, the disclosure will be described in detail with reference to the accompanying drawings. The disclosure may be implemented in various different forms and is not limited to embodiments described herein. In order to explain the present disclosure clearly, the embodiments described below may omit portions, which do not have a direct relationship with the explanation, but it does not mean that the omitted configurations are unnecessary to implement a device or a system to which the idea of the present disclosure is applied. The same or similar components are indicated by the same reference number throughout the description.

(13) Although the terms first, second, and the like may be used to describe various components, the components should not be defined by the terms, and the terms are used only for the purpose of distinguishing between one component and the other components. As used herein, the singular forms are intended to include the plural forms as well, unless the context clearly indicates otherwise.

(14) In the description, it should be understood that the terms include or have indicate existence of a feature, a number, a step, an operation, a component, parts, or a combination thereof, and do not previously exclude the existences or probability of addition of one or more other features, numerals, steps, operations, components, parts, or combinations thereof.

(15) FIG. 1 illustrates an environment for implementing a method for recording a parking location according to an embodiment in the present disclosure.

(16) Elements for recording the parking location of a vehicle may include: a user terminal 200; a vehicle 100 configured to communicate with the user terminal 200; a Global Navigation Satellite System (GNSS) signal transmitter 500; a base station 300; and a wireless access point 400.

(17) The user terminal 200 may be a mobile device which a user can move while holding, and may be one of various devices, such as a smartphone, a tablet PC, a smart watch, a notebook, and a PDA.

(18) The user terminal 200 may be connected to the vehicle 100 through wired/wireless communication. For example, a communication may be established between the user terminal 200 and the vehicle 100 through Bluetooth as a wireless communication, and a communication may be established between the user terminal 200 and the vehicle 100 through USB connection, as a wired communication.

(19) The user terminal 200 and the vehicle 100 may be connected through an interface, such as an Android Auto, Apple CarPlay, and Mirrorlink.

(20) The user terminal 200 may communicate with the base station 300, which is a wireless communication facility that can connect a network and the terminal. The base station 300 may connect the user terminal 200 and an access network of a mobile communication, such as CDMA, GSM, WCDMA, LTE, and 5th generation mobile communication (5G).

(21) The location of the user terminal 200 may be approximatively determined on the basis of which base station 300 the user terminal 200 communicates with.

(22) The user terminal 200 may communicate with the access point 400, which allows connection to a network through WiFi. The location of the user terminal 200 may be determined on the basis of information of the access point 400 connected to the user terminal 200, or information of a WiFi network.

(23) The user terminal 200 may communicate with the GNSS signal transmitter 500, such as GPS satellite. GNSS is a system that provides information relating to the location, altitude, speed of an object on the ground by using an artificial satellite flying in space orbit, and may communicate with the user terminal 200 to provide information relating to the location, altitude, speed of the user terminal 200.

(24) The GNSS may include a Global Positioning System (GPS), a GLObal NAvigation Satellite System (GLONASS) developed by Russia, Galileo developed by the European Union, Beidou developed by China, etc.

(25) The user terminal 200 may determine a user boarding/exiting the vehicle 100 by using the establishment and disconnection of a communication with the vehicle 100 and may measure the location of the user terminal 200 by communicating with the base station 300, the access point 400, and the GNSS signal transmitter 500.

(26) FIG. 2 illustrates a block diagram of a vehicle and a user terminal according to an embodiment in the present disclosure.

(27) In an embodiment of the present disclosure, a vehicle 100 may include a Bluetooth module 120 mounted therein and include a control unit 110, which can control various electronic devices of the vehicle, including the Bluetooth module 120.

(28) A user terminal (200) according to an embodiment of the present disclosure may include a Bluetooth module 210, a WiFi module 220, and an RF module 230 in order to communicate with an external device. The user terminal 200 may include a GPS module 240, which can receive location information from a GPS satellite, a motion sensor 250, which can sense various movements of the user terminal 200, a camera module 260, which can take an image of an external environment, and a control unit 270, which can control the operation thereof.

(29) A communication between the Bluetooth module 210 of the user terminal 200 and the Bluetooth module 120 of the vehicle 100 can be established through device setup therebetween. Each of the user terminal 200 and the vehicle 100 may include an identification record of the other in a Bluetooth connection profile at the time of an initial device setup.

(30) At every time when the user terminal 200 is connected to the vehicle 100 through a connection profile including an identification record of the vehicle 100, the user terminal 200 can recognize that a communication has been established between the user terminal and the vehicle.

(31) Using the recognition process, the user terminal 200 may recognize a case when the user terminal 200 is placed in the vehicle, that is, a situation where a user carrying the user terminal 200 gets in the vehicle 100. The user terminal 200 may recognize, as the situation where a user carrying the user terminal 200 gets out of the vehicle 100, that the vehicle 100 is turned off or the user terminal 200 is moved outside the vehicle, whereby the communication is disconnected or the strength of a connection signal is weakened at a predetermined level or less.

(32) The WiFi module 220 of the user terminal 200 may communicate with the access point 400 located at close range, and the user terminal 200 may measure a place at which the user terminal 200 is located, through the IP address of the access point 400, or the like.

(33) The RF module 230 of the user terminal 200 may communicate with the base station 300 and may allow estimation of a region in which the user terminal 200 is placed, through location information of the base station 300, with which the user terminal 200 communicates with.

(34) The motion sensor 250 of the user terminal 200 may include a sensor, such as an acceleration sensor and a gyroscope. The user terminal 200 may determine whether a user carrying the user terminal 200 has stopped, is walking, is running, is riding a bicycle, or is on-board a vehicle, which is traveling, by using a Qualcomm CMC (Coarse Motion Classifier) or Android AR(Activity Recognition) together with the motion sensor 250.

(35) The Qualcomm CMC is a context awareness API provided by Qualcomm and is configured to provide Walk, Run, Bike, Stationary, and Vehicle information by using sensor information of a mobile device. The Google AR is a context awareness API provided by Google and is configured to provide IN_VEHICLE, ON_BICYCLE, ON_FOOR, and RUNNING information by using sensor information of the mobile device.

(36) The camera module 260 of the user terminal 200 is configured to take an image of an external situation so as to enable a user to take an image of the location of the parked vehicle and store the image.

(37) FIG. 3 is a diagram illustrating situations ranging to parking and technologies and information used for recognizing the situations according to an embodiment in the present disclosure.

(38) In situation (1) in FIG. 3, a user gets in a vehicle 100 with a user terminal 200. When the user terminal 200, in which Bluetooth is on and a configuration for connection to the vehicle 100 has been set up, is moved in the vehicle 100, the user terminal 200 is connected to the vehicle 100 automatically, and may recognize the connection to the vehicle 100, through a profile of a connected Bluetooth device.

(39) The connection of the user terminal 200 to the vehicle 100 means that the user carrying the user terminal 200 is on-board the vehicle 100. Therefore, when a communication between the user terminal 200 and the vehicle 100 is established, the user terminal 200 may recognize that the user is on-board the vehicle 100.

(40) Information used for on-board recognition is a connection between the user terminal 200 and the vehicle 100, and the connection may be formed through a communication establishment technology, such as Bluetooth, Android-Auto, and Mirrorlink.

(41) In situation (2) in FIG. 3, the vehicle 100, which has the user on-board, starts to travel. In the traveling vehicle 100, there is the user terminal 200, and the user terminal 200 may sense a traveling movement of the vehicle through a motion sensor and an API, such as a Qualcomm CMC and Android AR.

(42) In order to decide parking recognition later, traveling recognition is an essential step. Even in the case where the on-board recognition described above and off-board recognition described below are accomplished, when traveling recognition between the on-board recognition and the off-board recognition is not identified, the non-identification of traveling recognition means that the vehicle has not been moved, and thus there is no need to newly record a parking location.

(43) In situation (3) in FIG. 3, when the vehicle 100 arrives at a destination, the vehicle is turned off and the communication between the vehicle 100 and the user terminal 200 is disconnected. Therefore, when the communication between the vehicle 100 and the user terminal 200 is disconnected, the disconnection can be recognized as a situation where the user gets out of the vehicle 100.

(44) Even when the vehicle is turned off, a Bluetooth module of the vehicle 100 is being supplied with power by a battery, etc. Therefore, Bluetooth connection between the user terminal 200 and the vehicle 100 may be maintained during a certain time after the vehicle is turned off.

(45) Therefore, in addition to the case where the connection between the user terminal 200 and the vehicle 100 is completely released, when the user terminal 200 becomes far away from the vehicle 100 and the strength of a connection signal between the user terminal 200 and the vehicle 100 is weakened at a predetermined level or less, off-board recognition may be accomplished. The situation where the strength of the connection signal is weakened at the predetermined level or less includes a case where the connection is released.

(46) FIG. 4 illustrates that when the user starts to get out of the vehicle 100, the strength of a Bluetooth signal of the user terminal 200 connected to the vehicle 100 is weakened. When the user gets out and moves far away from the vehicle 100, the Bluetooth RSSI of the user terminal 200 gradually decreases.

(47) For example, in an embodiment in the present disclosure, in the case where the predetermined level is configured as 85 dBm, when the user moves far away from the vehicle 100 and thus the Bluetooth RSSI of the user terminal 200 is lowered to 85 dBm, the user terminal 200 recognizes an off-board situation. The predetermined level may be pre-configured to be different according to embodiments.

(48) When the user terminal 200 recognizes that the user gets out of the vehicle, the user terminal measures the location thereof to identify the location of the stopped vehicle.

(49) Referring again to FIG. 3, after the off-board recognition is completed, the user terminal 200 determines whether the user moves on foot by a predetermined number of steps or more, through the motion sensor 250 of the user terminal 200.

(50) When the user has moved on foot by a predetermined number of steps or more, for example, five steps or more, it indicates that the user has got off the vehicle 100 and is moving on foot to another place. Therefore, the user terminal may recognize that parking has been performed.

(51) The walking movement of the user may be sensed by a motion sensor, APIs such as Qualcomm CMC and Android AR, and also a general pedometer.

(52) The fact that the user has moved on foot by a predetermined number of steps or more indicates that the user is moving away from the vehicle 100. Therefore, in addition to the off-board recognition, the user terminal 200 additionally determines whether walking is sensed, whereby a parking situation can be more accurately recognized.

(53) In a case where there is no parking recognition operation using sensing of walking and whether parking has been performed is determined only on the basis of off-board recognition described above, even when the user temporarily stops the vehicle for filling with fuel, turns off the vehicle, and then sits in the vehicle, parking may be recognized incorrectly.

(54) However, an embodiment in the present disclosure employs a fact that the user has moved on foot by a predetermined number of steps or more, as an additional condition for recognizing that parking has been performed, which is to be identified after off-board recognition, whereby a parking situation can be more accurately recognized.

(55) That is, in an embodiment of the present disclosure, when on-board recognition, traveling recognition, off-board recognition, and parking recognition are all accomplished in consideration of the entire contextual situation ranging to a parking operation rather than as a fragmentary event, it is determined that parking of the vehicle 100 is completed. Therefore, a parking situation can be more accurately recognized. The situation recognitions may be configured such that as usage data of the user are stacked, the accuracy is further developed through use patterns analysis using machine learning.

(56) FIG. 5 is a diagram illustrating operations performed by recognition of situations according to an embodiment in the present disclosure.

(57) In an embodiment of the present disclosure, when off-board recognition is accomplished in the user terminal, it may be required that a current location of the user terminal 200 is measured. When it is recognized that parking of the vehicle 100 is completed, a camera or memo record request may be made using a user interface of the user terminal 200, and the user may be requested to input parking information.

(58) In an embodiment of the present disclosure, when the user performs an input of parking information, for example, photographing a place where the vehicle 100 is parked, recording the location of the place in texts, and recording the location of the place by voice, the input information may be combined with measured location information so as to be used to generate a parking information card.

(59) FIGS. 6 to 10 illustrate exemplary screens which may be displayed on a user terminal when the operations illustrated in FIG. 5 are performed.

(60) FIG. 6 is an example of a screen requesting an input of parking information from the user after parking recognition. The box at the top of the user terminal 200 shows location information of a place where the vehicle is parked, obtained by a location measurement, and allows the user to select whether to photograph the parking location or record the parking location by making a memo thereof.

(61) FIG. 7 is an example of an interface screen allowing a user to make a memo in voice or text when the user selects a MEMO button. At the top of the user terminal 200, the location information of the place where the vehicle is parked, obtained by the location measurement, is showed, and a microphone button and a keyboard button are provided.

(62) When the user pushes a microphone icon, it is possible to record the parking location by voice, and when the user pushes the keyboard button, a screen allowing input of characters may appear as illustrated in FIG. 8. Using the interface as illustrated in FIG. 8, the user may record the location of a place where the user has parked the vehicle, through a keyboard appearing on the screen.

(63) FIG. 9 illustrates a case where the user takes an image of the parking location, and when the user pushes a PHOTO button illustrated in FIG. 6 and then photographs the location of the vehicle 100, the user terminal 200 may generate a parking card together with information relating to a measured location.

(64) In the screen of FIG. 9, a VIEW LOCATION button enabling the user to identify the current location of the user terminal 200 through a map may be shown, and when the VIEW LOCATION button is pushed, the current location of the user terminal 200 is showed on a map as illustrated in FIG. 10, and information relating to the latitude, longitude, and location accuracy may be displayed.

(65) When the user inputs parking information through interfaces as illustrated in FIGS. 6 to 10, the user terminal 200 may combine the input parking information with measured location information to generate a parking card showing the parking information input by the user and the measured location information.

(66) As a case where the user ignores a request for inputting parking information, if there is no input after a request for input of parking location information, the user terminal 200 may generate a parking card by using only measured location information, after passage of a predetermined time from the request for input of the parking location information.

(67) When the user parks the vehicle and then finishes his/her work, the user may identify the parking location of the user's vehicle by loading such a parking card in order to find the vehicle.

(68) FIG. 11 is a flow chart of a method for recording a parking location according to an embodiment in the present disclosure.

(69) First, a user terminal 200 recognizes that a user is on-board a vehicle 100, through the establishment of a communication between the user terminal 200 and the vehicle 100 (S110). Then, when it is determined that the user is in the vehicle, which is traveling, through a motion sensor of the user terminal 200, it is determined that the user is in the traveling vehicle (S120).

(70) In the most simple manner, when it is sensed through the motion sensor 250 of the user terminal 200 that the user terminal 200 is moved at a predetermined speed or higher or is moved at a predetermined acceleration or higher, it may be recognized that the user terminal 200 is in the traveling vehicle.

(71) The motion sensor (250) may determine whether the user is in the traveling vehicle, by using an API, such as a Qualcomm CMC or Android AR.

(72) After it is recognized that the vehicle 100 is in a traveling state, when the communication between the user terminal 200 and the vehicle 100 is disconnected or the strength of a communication connection signal is weakened to be equal to or lower than a predetermined level, the user terminal 200 recognizes a state where the user gets out of the vehicle 100 and measures the location of the user terminal 200 (S130).

(73) When the user terminal 200 is in an indoor parking lot, more accurate location measurement using a GNSS signal is impossible. Therefore, a method for measuring the location through a different manner is required to be proposed, and the manner will be described in detail.

(74) After the recognition of an off-board state, the user terminal 200 determines whether the user moves on foot, and when it is determined that the user has moved on foot by a predetermined number of steps of more, the user terminal recognizes that the vehicle 100 has entered a parked state (S140).

(75) When the parked state is recognized, the user terminal 200 may request the user to input a camera or memo record through a user interface (S150).

(76) When the user inputs parking information in response to the request, the user terminal 200 generates and issues a parking location card on the basis of camera or memo information input in operation S150, and location information decided through a measurement in operation S130 (S160).

(77) FIG. 12 is a flow chart of a method for providing decided parking location information of a vehicle according to an embodiment in the present disclosure.

(78) The user terminal 200 obtains last location information measured through a GNSS before the vehicle enters a place, which is a GNSS signal shadow area, such as a parking building, as illustrated in FIG. 14 (S210).

(79) Then, when an off-board state is recognized, a location measurement is performed by the user terminal 200 and location information is grouped (S230). The location measurement may be repeatedly performed periodically (for example, one time per minute) during a predetermined time from an off-board recognition time point (for example, during 15 minutes from an off-board recognition time point).

(80) In the location measurement operation, location information of the user terminal 200 may be obtained using at least one of base station information relating to a base station connected to the terminal, WiFi network information relating to a WiFi network connected to the terminal, or GNSS signal information relating to a GNSS signal obtained by the terminal.

(81) When multiple pieces of location information obtained through grouping satisfy a particular location terminating condition, decided location information is provided (S240 and S260). When the location terminating condition fails to be satisfied from a time point at which the off-board state is recognized, to a predetermined measurement time point, location information having the highest accuracy among pieces of location information obtained up to a corresponding time point is provided (S250).

(82) Grouping of location information is a procedure for obtaining multiple pieces of location information and then grouping them to find more accurate location information, and will be described in detail later with reference to FIGS. 13 and 14.

(83) As described in FIG. 14, location information lastly obtained immediately before the vehicle enters a parking building, which is a GNSS shadow area, is P1(x1, y1, 99). The expressed location information is (latitude, longitude, location accuracy), and the location accuracy corresponds to an error range of the location information, which is shown in a distance unit (m). That, P1 is a location, the latitude of which is x1, and the longitude of which is y1, and the error range is 99 m. Lastly obtained GNSS-measured location information may be referred to as first location information, and the first location information may be classified as a first group.

(84) After the vehicle enters the parking building and an off-board state is recognized, the user terminal 200 measures the current location and provides location information of P2(x2, y2, 20) (S231 of FIG. 13). P2 has a high location accuracy but is a location which is spaced 3000 m apart from P1 and has been abnormally measured.

(85) In another embodiment of the present disclosure, location information indicating a location spaced a predetermined distance or greater (for example, 500 m) apart from the location of lastly obtained GNSS-measured location information is abnormal location information and may be excluded from location information for providing decided location information.

(86) In an embodiment of the present disclosure described below, a grouping procedure is performed without excluding even abnormal location information as described above.

(87) In a case where the distance between P1 and P2 is compared (S233), when the distance falls within a predetermined distance, P2 is included in the same group as P1, and when the distance is beyond the predetermined distance, a new group for P2 is generated (S235, S237, and S239).

(88) In an embodiment of the present disclosure, when a standard for including in the same group is 300 m, the distance between P1 and P2 is 3000 m as illustrated in FIG. 14, and thus P2 is classified as a new second group, not the first group to which P1 belongs.

(89) In an embodiment of the present disclosure, a location terminating condition is that there are three or more pieces of location information in the same group and there is location information having a location accuracy of 50 m or smaller in the corresponding group, and when the condition is satisfied, location information having the highest location accuracy (indicating the lowest value shown in unit m) in the corresponding group is provided as decided location.

(90) Each of the first group and the new second group includes only one piece of location information. Therefore, the location terminating condition fails to be satisfied (S240), and current location information is obtained again (S231).

(91) The re-obtained location information is P3(x3, y3, 2300). P3 has a location accuracy of 2300 m and thus the error range of the information is too large, and may be classified as inaccurate location information. For example, P3 may be measured on the basis of the location of the base station which the user terminal 200 communicates with.

(92) In another embodiment of the present disclosure, when the location accuracy of location information is equal to or lower than a predetermined level (a value shown in unit m is equal to or more than a predetermined value, for example, 500 m or greater), the location information is inaccurate location information and may be excluded from location information for providing decided location information.

(93) In an embodiment of the present disclosure described below, a grouping procedure is performed without excluding even inaccurate location information as described above.

(94) P3 has a distance of 3500 m from P1 and has a distance of 44 m from P2, and thus belongs to the second group (S233, S235, and S237). The first group has one piece of location information and the second group has two pieces of location information, and thus the above location terminating condition fails to be satisfied (S240).

(95) When current location information is obtained again, P4(x4, y4, 60) is obtained (S231). For example, P4 may be location information measured by a WiFi connection to an access point existing in the parking building, which is established while the user moves. P4 is 100 m far away from P1, is 2800 m far away from P2, and is 2600 m far away from P3 (S233). Therefore, P4 belongs to P1, which has a distance of 300 m or less from P4 (S235 and S237). The first group has two pieces of location information and the second group has two pieces of location information, and thus the above location terminating condition fails to be satisfied (S240).

(96) When current location information is obtained again, P5(x5, y5, 37) is obtained (S231). For example, P5 may be location information measured when the user moves and becomes more closer to the access point existing in the parking building. P5 has a distance of 110 m from P1, and as shown in FIG. 14, it may be noted that P5 is 2600 m or greater far away from P2 and P3 and has a distance of 100 m or less from P4 (S233). Therefore, P5 belongs to the first group, which is the same group as P1 and P4 (S235 and S237). Accordingly, the first group has three pieces of location information and the second group has two pieces of location information. Therefore, a requirement relating to the number of pieces of location information belonging to one group, among the above location terminating condition, is satisfied.

(97) In addition, the location accuracy of P5 is 37 m, which is smaller than 50 m. Therefore, a requirement relating to the location accuracy of at least one piece of location information in the group is also satisfied. Therefore, the location terminating condition is satisfied, and P5 having the highest location accuracy in the first group may be provided as decided location information.

(98) As described above, until the location terminating condition is satisfied, the steps from S231 to S240 are repeatedly performed. When the location terminating condition is not satisfied after the location measurement is performed during a predetermined time (for example, 15 minutes) from the off-board recognition time point, information having the highest location accuracy among the pieces of location information obtained until the predetermined time has passed may be provided as decided location information.

(99) The decided location information may be used to generate a parking information card by being combined with parking information input by the user as illustrated in FIG. 5.

(100) Proposed may be a device, which can perform a method for recording a parking location as described above and is configured to record a parking location of a vehicle. Such a device may include: a motion sensor configured to sense movement of the device; a communication module configured to perform communication with an external device; a user interface configured to allow a user and the device to interact with each other; and a processor configured to interact with the motion sensor, the communication module, and the user interface.

(101) The processor may be configured to perform the method according to the embodiments in the present disclosure as described above. For example, the processor may be configured to: A) when a communication is established between the communication module and the vehicle, recognize that the user gets in the vehicle; B) when the device moves at a predetermined speed or higher, recognize, by the motion sensor, that the vehicle starts to travel; C) when a strength of a communication connection signal between the communication module and the vehicle is lowered to be equal to or lower than a predetermined level, recognize that the user gets out of the vehicle; D) when it is determined by the motion sensor that the user carrying the device has moved on foot by a predetermined number of steps or more, recognize that parking of the vehicle is completed; E) request an input of parking information from the user through the user interface of the device; and F) after the parking information input request, generate a parking information card at least partially on the basis of the parking information input through the user interface.

(102) The processor may be configured to perform E) and F) after all of A) to D) are completed in sequence, whereby a parked state requiring recording can be recognized more accurately.

(103) In another embodiment of the present disclosure, provided may be a computer-readable recording medium in which at least a program configured to, when executed by a user terminal, cause the terminal to perform the method for recording a parking location according to the embodiments described in the present disclosure is recorded.

(104) Although all the components constituting an embodiment of the disclosure have been described above as being combined into a single unit or combined to be operated as a single unit, the disclosure is not necessarily limited to such an embodiment, and one or more of all the components may be selectively combined and operated. Further, all components may be implemented in independent hardware, but some or all of the components may be selectively combined and implemented in computer programs which have a program module performing functions of some components or all components which are combined in one or more pieces of hardware. Codes and code segments forming the computer program can be easily conceived by an ordinarily skilled person in the technical field of the present disclosure. Such a computer program may implement the embodiments of the present disclosure by being stored in a computer readable storage medium, and being read and executed by a computer. Storage mediums such as a magnetic recording medium, an optical recording medium, and a semiconductor recording device may be employed as the storage medium of a computer program. Further, the computer program for implementing the embodiments of the disclosure includes a program module which is transmitted through an external device.

(105) The embodiments of the present disclosure have been illustrated, but various changes and modifications would be applied thereto by a person skilled in the art. Therefore, it may be understood that the changes and modifications are included in the range of the present disclosure unless departing from the scope of the present disclosure.