A data driven approach Chris Ranganathan November 2018 2 Using Data to quantify the problem LOSA Data Training Data Line Data Training Response Next steps Contents Context A320A330A380B787B777 ID: 814460
Download The PPT/PDF document "Training Effective Flight Path Monitorin..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Training Effective Flight Path Monitoring
A data driven approach
Chris Ranganathan
November 2018
Slide22
Using Data to quantify the problem
LOSA Data
Training Data
Line Data
Training Response
Next steps
Contents
Slide3Context
A320/A330/A380/B787/B777~ 2100 pilots~ 200 pilot instructorsAll types in EBT since October 2015
Slide4270 observations (narratives)
1673 Threats (
avg
: 6.19 per flight)
2176 Errors (
avg
: 8.05 per flight)
LOSA Raw Data
LOSA Report:
Identified and ranked Threats & Errors observed
Compared Crew Management of Threats, Errors against LOSA database average and against 4 peer airlines.
Rated crew performance in 11 Threat and Error Management countermeasures, on a 4 point scale
Operations Data–
LOSA 2015
Slide55
The 11 LOSA Countermeasures were related to one or more of the 9 Pilot Competencies by a comparison of the LOSA Behavioral Markers to Etihad Performance Indicators
Correlating LOSA and EBT data (1/2)
Slide66
Next step was to research industry papers/studies in the areas of Monitor/Cross Check and Workload Management
Resulting Competencies of Focus:
Application of Procedures (APK)
Aircraft Flight Path Management, Automation (FPA)
Aircraft Flight Path Management, Manual (FPM)
Workload Management (WLM)
Situation Awareness (SAW)
Monitor / Cross Check related to 4 different competencies
Workload Management was related to 3 of the top 5 negative net LOSA countermeasure rankings
Correlating LOSA and EBT data (2/2)
Slide77
Discovering and correcting flight path management errors:
“ Effective Flight Path Monitoring”
, or
EFPM.
Industry papers review
Performance Indicators relevant to EFPM were identified based on industry research and refined during instructor workshops
How frequently were these indicators cited as a cause of poor pilot performance in training/checking……….
Slide8EBT simulator data of pilot performance (all ranks)
8
Slide9PI data for grades <3 (all fleets: EVAL-SBT)
9
Slide1010
Line Check data of pilot performance
Check to see
if these issues identified in training/checking were contributing to incidents in unsupervised line operations……….
Slide11Correlation with Etihad Operational Data
Most significant Tier 3 Safety Performance Indicators contributing to OVERALL AIRLINE Operational Risk
Aircraft speed exceedance
Level Bust induced by EY
Aircraft speed exceedances
Long landing
Circa
March 2018
Slide12Review and modify current competency framework to explicitly define Performance Indicators (PIs) relevant to EFPM
Review and modify initial and recurrent training programs to emphasize Areas of Vulnerability (AoVs) - target the PIs relevant to EFPM
Train pilots to deliver Threat Based interactive briefings that emphasize the importance of the PM roleImplement a deliberate and comprehensive approach to training manual flying skills for Instructors & line pilots that raises self confidenceEnsure that instructors and evaluators:Train the relevant performance indicators that reinforce the responsibility of the PM to challenge deviations;Are proficient at training and evaluating competencies & performance indicators relevant to EFPM; and
Place emphasis on EFPM during line checks
12
Resulting Agreed Actions
Slide13Review and modify current competency framework to explicitly define Performance Indicators (PIs) relevant to EFPM
13
Competency
EY Performance Indicators for EFPM
Application of Procedures (APK)
Monitors aircraft system status according to published operating instructions
Communication (COM)
Uses appropriate escalation of communication to resolve deviations identified by monitoring
Flight Path Management - Automation (FPA)
Monitors and
Detects deviations from the desired aircraft trajectory and takes appropriate action
Maintains the desired flight path during flight
whilst monitoring
and managing other tasks and distractions
Flight Path Management - Manual (FPM)
Knowledge (KNO)
Leadership and Teamwork (LTW)
Confidently says and does what is important for safety,
resolving deviations identified whilst monitoring using an escalation of communication
Problem Solving & Decision Making (PSD)
Monitors execution of decisions, reviews and adapts them as required
Situation Awareness (SAW)
Monitors, identifies and assesses
Is aware of
the state of the aircraft and its systems
Monitors, identifies and assesses
Is aware of
where the aircraft is and its environment
Workload Management (WLM)
Monitors
, Reviews, monitors and cross-checks actions conscientiously
Slide14Review and modify initial and recurrent training programs to emphasize
AoVs
and target the PIs relevant to EFPMInitial Training (thus far)MPLBoeing Type Rating curricula
Recurrent Training
Medium/Method
Instructor led Ground Training
e-learning module
Initial Simulator Training:
Scenario Based Training
Recurrent Simulator Training:
EVAL, SBT and ISI phases of EBT
Slide15Slide1616
Training Appropriate Assertiveness in ISI
Competency
EY Performance Indicators for EFPM
Communication (COM)
Uses appropriate escalation of communication to resolve deviations identified by monitoring
Leadership and Teamwork (LTW)
Confidently says and does what is important for safety,
resolving deviations identified whilst monitoring, using an escalation of communication
Slide1717
Training Monitoring in SBT & EVAL
Changes in atmospheric conditions affecting aircraft energy
Systems failures which are not declared by the internal warning systems
Failure to Capture Altitude, LOC, GS, NAV
Erroneous G/SErroneous LOC captureFalse G/S Thrust Management Computer improper thrust settings. Does not respond to thrust targets, no failure indication.
Competency
EY Performance Indicators for EFPM
(APK)
Follows SOP’s unless a higher degree of safety dictates otherwise
Monitors aircraft system status according to published operating instructions
(COM)
Confirms that the recipient correctly understands important information
Conveys messages and information clearly, accurately, timely and adequately
(FPA)/ (FPM)
Detects deviations from the desired aircraft trajectory and takes appropriate action
Effectively monitors automation, including engagement and automatic mode transitions
Maintains the desired flight path during flight whilst managing other tasks and distractions
Selects appropriate level/mode of automation in a timely manner considering phase of flight & workload
(LTW)
Anticipates other crew members’ needs and carries out instructions when directed
(SAW)
Is aware of where the aircraft is and its environment
Is aware of the state of the aircraft and it systems
(
WLM
)
Ensures tasks are completed
Manages interruptions, distractions, variations and failures effectively
Offers and accepts assistance, delegates when necessary and asks for help early
Plans, Prepares, prioritizes and schedules tasks effectively
Reviews, monitors and cross-checks actions conscientiously
Simulation challenges….
Slide18On a line flight – what does good EFPM look like?
In Flight
Phase
Pilot
Flying (PF)Pilot Monitoring (PM)
During Cruise
Use this time to anticipate and complete all tasks (e.g. administrative tasks,
stowing and pulling items, setting up and briefing approaches).
When interrupted by unanticipated tasks
Verbalize constraints/next
action
as needed to reinforce team awareness.
Delegate task to PM (or transfer aircraft control).
Continue monitoring flight path with high scan rate.
Perform task after checking
PF is monitoring the flight path.
If PF inappropriately engages in non-monitoring task, then monitor flight path with high scan rate.
When interrupted by non-normal situations
Monitor flight path with high scan rate
Avoid initiating procedures until aircraft trajectory is safe
(Golden Rules).
Maintain awareness of flight path until other crewmember is concentrating on monitoring it.
During non-routine high-workload situations (e.g. Go-Around…)Focus on monitor flight path with high scan rate.
Maintain high SAW of aircraft energy to avoid altitude bust.Use correct callouts in the correct sequence.Prioritize tasks to ensure correct aircraft configuration change (L/G, flaps retraction on schedule,…) during dynamic maneuver.Delay ATC readback as appropriate:Fly-Navigate THEN Communicate
(WLM) Plans, Prepares, prioritizes and schedules tasks effectively
(COM) Confirms that the recipient correctly understands important information
(WLM) Offers and accepts assistance, delegates when necessary and asks for help early
(FPA/FPM) Effectively monitors automation/flight guidance, including engagement and automatic mode transitions
(FPA/FPM) Maintains the desired flight path during flight using automation / during manual flight whilst managing other tasks and distractions
(SAW) Is aware of where the aircraft is and its environment
Slide19Placing emphasis on EFPM during line checks
EFPM behaviours in “Line Pilot speak”===
=====
Related EFPM Performance Indicators
Slide20Placing emphasis on EFPM during line checks
EFPM behaviours in “Line Pilot speak”
=====
Related EFPM Performance Indicators
Slide21Enabling Effective Flight Path Monitoring – next steps
Ensure Operations Policy and Training programs encourage an “Active” PM role
Ensure Operations Policy and Training programs, enable the confidence and skills required to hand fly during line operations, when appropriateContinue to correlate Operations and Training Data to measure effectiveness of training programsNext LOSA to use EBT competency frameworkTrain Safety Investigators to use competency framework when describing/classifying pilot performance
Continue to promote a pilot mindset of “healthy suspicion”.