What is a vehicle HMI?
What is a vehicle HMI?
What is a vehicle HMI?
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Di Driver IInformation f ti System S t<br />
<strong>HMI</strong> for automotive<br />
ICES seminar at Stoneridge 20 th of October 2009<br />
Stoneridge Electronics, Joacim Wenna, Celine Scharin<br />
CONFIDENTIAL
Agenda<br />
Automotive and commercial <strong>vehicle</strong> <strong>HMI</strong><br />
• <strong>What</strong> <strong>is</strong> <strong>vehicle</strong> <strong>HMI</strong>?<br />
• Trends<br />
• <strong>HMI</strong> in commercial <strong>vehicle</strong>s<br />
• Safety <strong>HMI</strong><br />
Stoneridge <strong>HMI</strong> Solutions<br />
• <strong>HMI</strong> at Stoneridge<br />
• Examples<br />
Questions
General automotive and<br />
commercial <strong>vehicle</strong> <strong>HMI</strong><br />
Celine Scharin<br />
CONFIDENTIAL
<strong>What</strong> <strong>is</strong> a <strong>vehicle</strong> <strong>HMI</strong>?<br />
<strong>HMI</strong> <strong>is</strong> about how the driver <strong>is</strong> able to interact with the<br />
<strong>vehicle</strong>. Main task <strong>is</strong> to drive the <strong>vehicle</strong>.<br />
Examples:<br />
D<strong>is</strong>plays and buttons and sound<br />
Pedals, levers and steering wheel<br />
Mirrors<br />
Safety superv<strong>is</strong>ion systems
Automotive <strong>HMI</strong> trends<br />
Influenced and controlled by<br />
User needs and demands<br />
Infrastructure<br />
Consumer products, e.g. iPhone, TiVo<br />
Laws and rules<br />
Traffic safety<br />
Technology
Instrument Cluster Trends<br />
More information in Instrument Clusters<br />
• New safety features; Lane Keeping Ass<strong>is</strong>tance, Traffic Sign Recognition, Driver<br />
Monitoring Systems and more…<br />
• Video from camera systems, rear/side/front view, bird view, night v<strong>is</strong>ion.<br />
• Environmental regulations, Ad-Blue, Particle Filters and similar…<br />
• ”Energy monitors” and “Green-gauges” for Hybrids.<br />
• Driver Training V<strong>is</strong>ualization<br />
Information priority, p y adaption p and sharing g<br />
• Give the driver the right information at the right time!<br />
• Tailor GUI layout for different markets: Asia, Australia, Europe, Brazil, USA…<br />
• Share and move information between Cluster and Secondary D<strong>is</strong>play.<br />
Customization<br />
• Let the driver customize not only functionality but now also styling of graphics<br />
and colours to get an individual feeling.<br />
• Pre-defined driving g modes and p profiles; ; High-way, g y, City, y, Night… g
Range Rover full configurable cluster
Opel Eye<br />
A th t d d i d<br />
A camera that reads road signs and<br />
shows in cluster, over speeding<br />
warning possible!
Lexus LS600h full cluster and eye-tracker
BMW 7-series<br />
Google inside…
<strong>HMI</strong> in commercial <strong>vehicle</strong>s<br />
CONFIDENTIAL
The commercial <strong>vehicle</strong>
Why <strong>is</strong> <strong>HMI</strong> important?<br />
Human error <strong>is</strong> involved in 90-95% of all road accidents<br />
Ca 100 people people per<strong>is</strong>h yearly in heavy truck<br />
accidents<br />
PProfessional f i l ddrivers i spend d ca 9 hours/24h h /24h in i the h truckk<br />
Tight time schedules<br />
Make driving a more fun experience<br />
Save money
<strong>HMI</strong> Function<br />
Balance task/user capacity<br />
Graphical user interfaces and systems<br />
can ass<strong>is</strong>t driver for a safer, , more<br />
convenient and fun driving experience<br />
• Good interfaces make it easy for drivers to<br />
interpret situations and act accordingly<br />
• Passive systems alert driver in hazardous<br />
situations<br />
• Active systems automatically avoid<br />
accidents and support driving performance
GGood d design d i support t h human capabilities biliti<br />
and compensate p for human limitations<br />
CONFIDENTIAL
Fatigue<br />
> 25% traffic accidents due to fatigue<br />
Great concern when dealing with heavy trucks<br />
E6 H l i b<br />
E6 Helsingborg,<br />
September 2, 2009.
Fatigue – counter measures<br />
Active and passive system<br />
Cognitive task to maintain alertness<br />
Rumble strips<br />
Nap<br />
Light<br />
Energy drink<br />
Does not work:<br />
Radio<br />
Cold air
Driver d<strong>is</strong>traction<br />
Wh <strong>What</strong> t <strong>is</strong> i driver d i d<strong>is</strong>traction?<br />
di t ti ?<br />
Too many and/or too long eye movements<br />
away from the “field relevant for driving”<br />
KKatja tj Kircher, Ki h VTI<br />
1/4 accidents <strong>is</strong> caused by driver d<strong>is</strong>traction
Driver d<strong>is</strong>traction examples<br />
Eating/drinking or preparing eating/drinking<br />
Chatting on computer<br />
Manipulating p g music/audio controls<br />
Multitasking<br />
(time consuming and complex tasks)<br />
Talking/dialing mobile phone<br />
Send/read SMS*<br />
Reaching, leaning, etc.<br />
Smoking<br />
Passenger d<strong>is</strong>tracting
Driver d<strong>is</strong>traction warning<br />
system<br />
11. W Warn for f d<strong>is</strong>traction di t ti itself it lf (teach (t h ddriver i not t t to<br />
get d<strong>is</strong>tracted)<br />
22. Adapt other warnings arnings (help dri driver er when hen<br />
necessary)<br />
3. Combination: adapt warnings and warn for<br />
“really really bad bad” d<strong>is</strong>traction
Adaptivity<br />
A Atechnical t h i l system t can make k ddrivers i observant b t off r<strong>is</strong>ks i k<br />
Consider in design:<br />
Drivers are sometimes already aware of r<strong>is</strong>ks<br />
City y traffic implicate p a high g level of driver awareness<br />
An automatic warning can increase workload<br />
An adaptive system might make driver solely aware of<br />
r<strong>is</strong>ks he/she not have not payed attention to<br />
Warnings imply more information to interpret
Stoneridge <strong>HMI</strong> Solutions<br />
Joacim Wenna<br />
CONFIDENTIAL
<strong>HMI</strong> at Stoneridge
Stoneridge <strong>HMI</strong> goals<br />
With creativity, creativity innovative minds and technology build<br />
the next generation design with:<br />
Enhanced performance<br />
p<br />
Increased safety<br />
Increased user sat<strong>is</strong>faction<br />
…for systems that have<br />
O One system feeling f li<br />
Good usability<br />
New technology
Examples<br />
Digital Tachograph <strong>HMI</strong><br />
Scania Instrument Cluster<br />
Drome – Stoneridge graphics platform
<strong>What</strong> <strong>is</strong> a Digital Tachograph?<br />
Device that records the driving hours of the driver driver.
Digital Tachograph background<br />
Tachograph design driven by EU laws<br />
Specification written by EU, Annex 1B<br />
Focus on first products p has been to design g according g to<br />
specification and not according to user need.<br />
Extremely long and complicated change processes -><br />
mustt beright b i ht att th thefi firstt time. ti<br />
First rev<strong>is</strong>ion released 2005
Digital tachograph rev<strong>is</strong>ion 6<br />
User interface not very user friendly<br />
DDownload l d ti times very llong<br />
Power consumption high<br />
Card withdraw time long
Digital Tachograph rev<strong>is</strong>ion 7<br />
Focus areas for improvement:<br />
Usability - <strong>HMI</strong><br />
• D<strong>is</strong>play<br />
• Buttons<br />
Performance<br />
• Download time<br />
• Card withdraw time<br />
• Power consumption
Tachograph D<strong>is</strong>play & Button <strong>HMI</strong><br />
<strong>HMI</strong> was not optimal – Improvements needed<br />
Two alternative ways<br />
• Do it like the competitor, market leader.<br />
• Do it right, what the users want.<br />
Solution:<br />
• Stoneridge Tachograph simulator was developed<br />
-> User input before actual implementation<br />
-> Button design could also be tested
Tachograph – Simulator<br />
Simulator!
Tachograph - Buttons<br />
Before…<br />
Aft After!<br />
!
Tachograph - Menus<br />
Before…<br />
After!
Tachograph – Manual entries<br />
Before…<br />
After!
Tachograph – Card withdraw<br />
Before…<br />
After!
Tachograph – The movie<br />
http://www.se5000.com/product-overview.html<br />
p p
Scania Instrument Cluster
Instrument cluster for commercial<br />
<strong>vehicle</strong>s<br />
Functions <strong>is</strong> constantly changed/added in commercial<br />
<strong>vehicle</strong>s.<br />
Shorter development time required<br />
<strong>HMI</strong> needs to be flexible<br />
Customer needs to be able to develop and simulate <strong>HMI</strong><br />
more easily il andto d t l lower cost.<br />
t
Drome – Stoneridge Graphics platform
<strong>What</strong> <strong>is</strong> the target application of Drome?<br />
Instrument clusters for commercial <strong>vehicle</strong>s<br />
Secondary d<strong>is</strong>plays for commercial <strong>vehicle</strong>s<br />
Any type of embedded d<strong>is</strong>play application requiring fast<br />
and flexible <strong>HMI</strong> design at low piece price.
<strong>What</strong> <strong>is</strong> the Drome Platform?<br />
Customer independent tool chain for developing <strong>HMI</strong><br />
and graphics for d<strong>is</strong>play applications.<br />
Translates data from a PC based WYSIWYG <strong>HMI</strong><br />
design g tool to a down-loadable binary y format and finally y<br />
executes the <strong>HMI</strong> on a target system.
Components of the platform<br />
U Uses 3:rd 3 d part t <strong>HMI</strong> ddevelopment l t ttool l<br />
Drome Widget Plugin<br />
Drome Compiler<br />
Drome Target library
<strong>HMI</strong> Design Flow
<strong>HMI</strong> Design Tool - EB GUIDE Studio<br />
Create the <strong>HMI</strong> graphics and logics using the UML-based state<br />
machine hi<br />
Simulate the <strong>HMI</strong> in PC<br />
Language support<br />
Easy to customize functionality, widgets, checkers etc.<br />
Majority of design work can be done by the customer if desired<br />
“Pack and go” feature<br />
Automatically generated documentation<br />
Automotive and commercial <strong>vehicle</strong> users includes Scania, VW,<br />
Bentley, Porsche, Audi
Drome Widget plugin<br />
Plug-in Plug in for the <strong>HMI</strong> design tool<br />
Defines the widgets<br />
Stoneridge specialized widgets guarantees<br />
same behaviour on target and on PC<br />
Includes checkers to verify that the designed<br />
<strong>HMI</strong> <strong>is</strong> compatible with the target library.
Drome Compiler<br />
Translate exported XML from Guide to Drome<br />
binary database<br />
Can be configured g to extract only y used <strong>HMI</strong><br />
components like languages, characters and<br />
fonts<br />
Keeps database footprint small
Drome Target Library<br />
Interprets the generated database into a <strong>HMI</strong><br />
and draws it on the d<strong>is</strong>play<br />
Library y runs on conventional 32-bit micro<br />
controller, for example NEC V850.<br />
Small footprint p
V<strong>is</strong>ual design in GUIDE
Behavioral Design in GUIDE
Rapid prototyping<br />
Bench test of <strong>HMI</strong> using the powerful built in simulator in Guide<br />
Studio on your PC. PC<br />
In <strong>vehicle</strong> test using a d<strong>is</strong>play connected to a laptop running Guide<br />
Studio with a CAN-plugin to connect to real truck environment,<br />
retrieving ti i andd sending di ddata t t to all ll other th ECU ECUs i in th the system. t<br />
On target test by using the Stoneridge development board Neo or<br />
custom product. Th<strong>is</strong> allows the customer to compile and run their<br />
<strong>HMI</strong> on a real l target t t HW and d the th actual t l d<strong>is</strong>play di l that th t shall h ll be b used. d<br />
Field test on the actual customer product. With Drome the customer<br />
can make changes g on the <strong>HMI</strong> and download it on the product p out in<br />
the field.
Drome Prototyping Tools<br />
NEC Dx3 32-bit MCU<br />
Neo<br />
Xilinx Spartan 3 1200E FPGA used as Graphics<br />
Controller<br />
DR 1.0<br />
3 Analogue Video Interface (CVBS)<br />
Development p Kit 18-bit 18 bit RGB D<strong>is</strong>play Interface<br />
1 CAN, 1 LIN, GPIO<br />
D<strong>is</strong>play support up to WVGA (800x480 pixels)<br />
NEC Dx3 32-bit MCU<br />
Xilinx Spartan 3 1200E FPGA used as Graphics<br />
Controller<br />
<br />
<br />
3 Analogue Video Interface (CVBS, optional RGB)<br />
18-bit RGB D<strong>is</strong>play Interface<br />
2 CAN New! Trinity Picture<br />
DR 20 comming 2 CAN 1 LIN GPIO<br />
New! , 1LIN, GPIO<br />
LVDS Digital Video Interface New!<br />
Analogue video to LVDS digital video converter New!<br />
18-bit RGB d<strong>is</strong>play interface<br />
LVDS D<strong>is</strong>play Interface (D<strong>is</strong>play link) New!<br />
DR 2.0 comming<br />
Development Kit soon!<br />
p y ( p y )<br />
D<strong>is</strong>play Support up to DVGA (1280x480 pixels)
Drome – Next generation<br />
The next generation of <strong>is</strong> in development.<br />
Target: Higher resolution d<strong>is</strong>plays, more<br />
advanced virtual gauges, g g , ppowerful<br />
animations<br />
and 3D graphics.<br />
Using g next generation g Guide (Guide ( 4.0) )
Stoneridge Platform Roadmap<br />
Functionallity<br />
CUSTOMER<br />
SPECIFIC REQUIREMENT<br />
Power PC, ARM9<br />
SRE ADVANCED OS PLATFORM VALKYRIA<br />
VALKYRIA 1<br />
Power PC, Linux<br />
VALKYRIA 2<br />
Under definition<br />
SRE ADVANCED GRAPHICS PLATFORM DROME<br />
DROME 1<br />
DROME 2<br />
Dx3 + FPGA<br />
Under definition<br />
SRE BASE PLATFORM MIMER<br />
MIMER 1<br />
NEC V850 Jupiter<br />
MIMER 2<br />
NEC V850 Dx3<br />
MIMER 3<br />
Under definition<br />
2004 2006 2008 2010 2012<br />
2014<br />
SOP
Questions?<br />
CONFIDENTIAL
Thank You!<br />
CONFIDENTIAL