2009 SMS Pilot Project (SMSPP) Analysis - FAA

enefit from, regular review of these data at a system level. Consideration should be given to
looking at AD follow-up actions to ensure that appropriate updates are made to various controls
(processes, practices, standards) to capture system-level learning that could preclude future
events.
5-5 Comparison of the Proposed Part 5 and SMS Framework
MITRE analyzed the differences and similarities between the proposed part 5, for part 121
certificate holders, and the proposed SMS framework. The MSMS team wanted to identify how
closely aligned the proposed SMS framework was to the part 5 NPRM that was specifically
written for part 121 certificate holders.
MITRE and the MSMS team concluded that although proposed part 5 is written for part 121
certificate holders, the two guidelines covered very comparable areas of proposed
implementation.
For more information, Appendix B contains a link to the study.
6-0 Collection and Analysis of Data Gathered From D&M
Organizations During the Pilot Project
The MSMS team collected specific non-proprietary data to meet the objectives of the MSMS
pilot project. A database was created to input and organize data received during the pilot project.
The data and analysis in this report were compiled from January 2011 until December 2012.
Data collected after December 2012 will be collected by AIR-150, the Safety Management
Design and Analysis Branch.
The FAA and the pilot project participants used a number of data collection methods. These
methods include conducting a PGA and DGA over the two-year period and gathering data from
surveys, interviews, and company feedback. Additionally, a SharePoint site was used to share
information between the participants and FAA PMTs. Some D&M organizations used their own
internal company web sites to share information with the PMTs.
The team determined the type of data to collect during the MSMS pilot project. The data
collection processes evolved as the pilot progressed. The qualitative and quantitative data in this
report are non-proprietary.
6-1 Collection and Analysis Methods
The data was collected sporadically throughout the 24 months of the project. The activity and
progress of the organizations in the pilot project varied throughout the study. This was due to a
number of factors including other company priorities, SMS learning curve, and slower progress
than anticipated. Delays were not due to any lack of commitment to aviation safety.
The collected performance metrics and supporting data were reviewed periodically (monthly) to
ensure objectives were being achieved. For example, the team looked for progress in areas of
23