System for in-vehicle-infotainment based on dual asynchronous displays
地域：
MI
MI Dearborn
摘要
Multiple display infotainment systems in vehicles provide various options for drivers and passengers to interact with elements on the multiple displays. Techniques include accessing historical driver information that includes previous or typical driver preferences and actions while operating the vehicle. Driving context information and driver state information are received describing the conditions in and around the vehicle. When a signal indicates that an interactive element should be presented to the driver or a passenger, an adaptive rule-based system uses the contextual information and previous history to determine a score for each interaction element. The score and they type of interaction required by the element are then used to determine a location on the multiple displays for presenting the interactive element.
說明書
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
Modern vehicles include infotainment systems including displays that provide information and also serve as human-machine interfaces for inputs by drivers and passengers. In some vehicles, infotainment systems include multiple displays at different locations in the cabin. These displays typically include predefined features for each separate display, and in some cases a large screen may be divided into regions with predefined features displayed at each region. During usage, interacting with certain active screens may be challenging or require the driver to pull their focus away from operation of the vehicle to interact with an active display away from the windshield of the vehicle. Display systems with an enhanced level of usability, convenience, and reduced time required to complete a task will improve comfort for users.
In some embodiments, techniques for rearranging the placement of an interactive element on a display system as part of an infotainment system in a vehicle. The techniques involve identifying an optimal location for an interactive element on a display system for the particular driver and current situation, and rearranging the placement of elements on the display system to optimally suit the situation and driver. In some embodiments, a system of one or more computers can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes the system to perform the actions. One or more computer programs can be configured to perform particular operations or actions by virtue of including instructions that, when executed by data processing apparatus, cause the apparatus to perform the actions.
權(quán)利要求
What is claimed is:1. A system, comprising:one or more processors; and a memory having stored thereon instructions that, when executed by the one or more processors, cause the one or more processors to:access a database of historical driver behavior information, the historical driver behavior information associated with a driver and describing previous interactions with a display system of a vehicle, the display system comprising a first display and a second display, wherein at least one of the first display or the second display is positioned away from a windshield of the vehicle; access an initial rule base describing a plurality of rules for locating interactive elements on at least one of the first display or the second display; receive driving context information describing a driving environment; receive driver state information relating to the driver; receive a signal to present an interactive element on the display system; provide, as inputs to an adaptive learning system, the initial rule base, the driving context information and the driver state information; determine, by the adaptive learning system, a threshold value for the interactive element based on a likelihood of access of the interactive element by the driver; determine, by the adaptive learning system, a plurality of scores for the interactive element at a plurality of locations on different screens of the display system based on the initial rule base, the historical driver behavior information, the driving context information, and the driver state information; determine, by the adaptive learning system, a first location on the first display to present the interactive element based on a determination that a first score of the plurality of scores associated with the first location exceeds the threshold value; determine a minimum display time for the interactive element during which the interactive element is prevented from being moved to a different location of the display system; display the interactive element at the first location; maintain, by the adaptive learning system, the interactive element at the first location for at least the minimum display time before allowing the interactive element to be moved by the adaptive learning system to a different location of the display system; receive, by the adaptive learning system, user interaction data describing a user interaction with the interactive element after displaying the interactive element at the first location for the minimum display time; and adjust one or more rules of the initial rule base in response to the user interaction data to generate an adjusted rule base. 2. The system of claim 1 , wherein the instructions comprise further instructions that, when executed by the one or more processors, cause the one or more processors to:receive interaction type data associated with the interactive element describing a required user input for interacting with the interactive element; and wherein:the threshold value is based on the interaction type data; and the first location on the first display or the second display is further based on the interaction type data. 3. The system of claim 1 , wherein the first score for the interactive element describes a likelihood of placing the interactive element on the display system. 4. The system of claim 1 , wherein the driver state information is gathered by sensors in a cab of the vehicle. 5. The system of claim 1 , wherein determining the location comprises setting the location of the interactive element to the first display based on accessibility of driver interaction with the display system based on a determination that the first score for the interactive element exceeds the threshold value. 6. The system of claim 1 , wherein the driving context information is received from a remote computing device. 7. The system of claim 1 , wherein the driver state information comprises data corresponding to at least one of:a driving style of the driver; a driver identity; or driver fatigue. 8. The system of claim 1 , wherein the driver state information comprises data received from a mobile device associated with the driver. 9. The system of claim 8 , wherein the data received from the mobile device comprises at least one of:appointment information; or phone call information. 10. The system of claim 1 , wherein the instructions comprise further instructions that, when executed by the one or more processors, cause the one or more processors to determine a second location on the second display to present the interactive element based on a determination that a passenger will assist the driver with the interactive element. 11. The system of claim 1 , wherein the instructions comprise further instructions that, when executed by the one or more processors, cause the one or more processors to:receive a signal to present a subsequent interactive element on the display system; provide, as inputs to the adaptive learning system, the adjusted rule base, subsequent driving context information, and subsequent driver state information; determine, by the adaptive learning system, a subsequent threshold value for the subsequent interactive element based on a likelihood of access of the subsequent interactive element by the driver; determine, by the adaptive learning system, a second plurality of scores for the subsequent interactive element at the plurality of locations within the display system based on the adjusted rule base, the historical driver behavior information, the subsequent driving context information, and the subsequent driver state information, wherein the second plurality of scores is different than a third plurality of scores that would be produced for the subsequent interactive element using the initial rule base; determine, by the adaptive learning system, a second location on the first display to present the subsequent interactive element based on a determination that a second score of the plurality of scores associated with the second location exceeds the subsequent threshold value; and display the subsequent interactive element at the second location. 12. The system of claim 1 , wherein the instructions comprise further instructions that, when executed by the one or more processors, cause the one or more processors to:receive interaction data from each vehicle in a fleet of vehicle systems; and adjust one or more rules of the initial rule base in response to the interaction data. 13. A computer-implemented method, comprising:accessing a database of historical driver behavior information, the historical driver behavior information associated with a driver and describing previous interactions with a display system of a vehicle, the display system comprising a first display and a second display, wherein at least one of the first display or the second display is positioned away from a windshield of the vehicle; accessing an initial rule base describing a plurality of rules for locating interactive elements on at least one of the first display or the second display; receiving driving context information describing a driving environment; receiving driver state information relating to the driver; receiving a signal to present an interactive element on the display system; providing, as inputs to an adaptive learning system, the initial rule base, the driving context information and the driver state information; determining, by the adaptive learning system, a threshold value for the interactive element based on a likelihood of access of the interactive element by the driver; determining, by the adaptive learning system, a plurality of scores for the interactive element at a plurality of locations on different screens of the display system based on the initial rule base, the historical driver behavior information, the driving context information, and the driver state information; determining, by the adaptive learning system, a first location on the first display to present the interactive element based on a determination that a first score of the plurality of scores associated with the first location exceeds the threshold value; determining a minimum display time for the interactive element during which the interactive element is prevented from being moved to a different location of the display system; displaying the interactive element at the first location; maintaining the interactive element at the first location for at least the minimum display time before allowing the interactive element by the adaptive learning system to be moved to a different location of the display system; receiving, by the adaptive learning system, user interaction data describing a user interaction with the interactive element after displaying the interactive element at the first location for the minimum display time; and adjusting one or more rules of the initial rule base in response to the user interaction data to generate an adjusted rule base. 14. The computer-implemented method of claim 13 , further comprising:receiving interaction type data associated with the interactive element describing a required user input for interacting with the interactive element; and wherein:determining the threshold value is based on the interaction type data; and the location on the first display or the second display is further based on the interaction type data. 15. The computer-implemented method of claim 13 , further comprising determining a second location on the second display to present the interactive element based on a determination that the first score for the interactive element is less than the threshold value. 16. The computer-implemented method of claim 13 , wherein determining the first location comprises setting the first location of the interactive element to the first display based on accessibility of driver interaction with the display system based on a determination that the first score for the interactive element exceeds the threshold value. 17. A non-transitory, computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to:access a database of historical driver behavior information, the historical driver behavior information associated with a driver and describing previous interactions with a display system of a vehicle, the display system comprising a first display and a second display, wherein at least one of the first display or the second display is positioned away from a windshield of the vehicle; access an initial rule base describing a plurality of rules for locating interactive elements on at least one of the first display or the second display; receive driving context information describing a driving environment; receive driver state information relating to the driver; receive a signal to present an interactive element on the display system; provide, as inputs to an adaptive learning system, the initial rule base, the driving context information and the driver state information; determine, by the adaptive learning system, a threshold value for the interactive element based on a likelihood of access of the interactive element by the driver on each of the first display and the second display; determine, by the adaptive learning system, a plurality of scores for the interactive element at a plurality of locations on different screens of the display system based on the initial rule base, the historical driver behavior information, the driving context information, and the driver state information; determine, by the adaptive learning system, a first location on the first display to present the interactive element based on a determination that a first score of the plurality of scores associated with the first location exceeds the threshold value; determine a minimum display time for the interactive element during which the interactive element is prevented from being moved by the adaptive learning system to a different location of the display system; display the interactive element at the first location; maintain the interactive element at the first location for at least the minimum display time before allowing the interactive element to be moved to a different location of the display system; receive, by the adaptive learning system, user interaction data describing a user interaction with the interactive element after displaying the interactive element at the first location for the minimum display time; and adjust one or more rules of the initial rule base in response to the user interaction data to generate an adjusted rule base. 18. The non-transitory, computer-readable medium of claim 17 , wherein the instructions comprise further instructions that, when executed by the one or more processors, cause the one or more processors to:receive interaction type data associated with the interactive element describing a required user input for interacting with the interactive element; and wherein: the threshold value is based on the interaction type data; andthe location on the first display or the second display is further based on the interaction type data.
意見反饋
使用該功能遇到問題