INSIDE QMS

A publication of XCELAR Quality Management Systems | June 1, 2010 | Edition 1

XCELAR Launches Quality Management Systems Division

Welcome to the first issue of our Quality Management Newsletter. XCELAR launched its Quality Manage-ment Division in 2009 to address the growing need for expertise in the airline training arena. Current trends in training and training management programs such as Advanced Quality Programs have brought sweep-ing changes to our industry. At XCELAR we believe that carefully placed experts in these fields can bring the needed focus, efficiencies, and greater success to new and existing programs for every airline.

In order to better serve our customers, XCELAR has assembled a great team of AQP and SMS experts from inside the airline and aviation industries. Look for more information about our product manager, Jill Toney, inside this newsletter. Future issues will high-light other XCELAR team members, as well as our
partners from the airlines, aviation associations, and the FAA.

We hope to bring you valuable information regarding re-cent trends in Quality training programs, tips on building your AQP or SMS, and insider scoops on areas of great-est challenge within the program. We look forward to your questions regarding our articles, questions we can answer for you in future issues, or areas that need a more in depth solution. We are always available to talk to you directly, and can be reached at the contact numbers and locations listed on the back of this newsletter.
Thank you for joining us in our new adventure. We look forward to a continuing relationship with all of you.

Cheri L Haynes,
Director of Quality Management Systems, XCELAR

Jill Toney named XCELAR’s Product Manager for QMS

Jill Toney comes to XCELAR with over 15 years of training experi-ence, including 10 years with Ad-vanced Qualification Programs. She has managed and designed successful programs for B737-200, B737-300/500, B747 aircraft types, as well as an Instructor/Evaluator AQP program, and a CRM AQP. Most recently, Jill held the position of Manager of Flight Operations Training Standards for United Airlines, where she over-saw all of United's training pro-grams, record-keeping, quality control, and regulatory compli-ance. Jill is currently developing AQP programs tailored to the emerging needs of US regional carriers, as well as the application of AQP processes to cabin crews and ground functions including ATC, Maintenance, Dispatch, Air-port Operations, and Security.

Recent accomplishments of note include:

• Developed a Quality Control pro-gram designed to calibrate evalua-tors through rater-reliability training and standardize training programs.
• Implemented a Data Management Plan to critically analyze pilot per-formance based on qualification standards for increased safety and improved training.
• Developed plan to integrate AQP, FSAP, and FOQA data into a suc-cessful overall Safety Management System (SMS).
• Implemented standardized policies related to the qualification, cur-rency, and records of safety per-sonnel.
• Designed automated grade sheets, performance data collection and analysis tools, as well as standard data reporting to the FAA.

Upcoming Regulatory Changes: What They Mean

New legislation was recently passed by the House of Representatives (H.R. 3371: Airline Safety and Pilot Training Improvement Act). To best prepare for these changes, it is important to under-stand exactly what will be required. Some highlights of the Bill include:

• Requires airline pilots to hold an Airline Transport Pilot license (1,500 minimum flight hours required).
• Establishes pre-employment screening including an assessment of a pilot’s skills, aptitudes, airman-ship and suitability for functioning in the airline’s operational environ-ment.
• Requires airlines to: establish pilot mentoring programs whereby highly experienced pilots will men-tor junior pilots; create Pilot Profes-sional Development Committees; modify training programs to accom-modate new-hire pilots with differ-ent levels and types of flight experi-ence; and provide leadership and command training to pilots in com-mand.
• Studies the best methods and opti-mal time needed in training pro-grams for pilots to master neces-sary aircraft systems, maneuvers, and procedures; the length of time between training events including recurrent training; and the best methods to reliably evaluate mas-tery of systems, maneuvers and procedures.
• Creates a Pilot Records Database, to provide airlines with fast, elec-tronic access to a pilot’s compre-hensive record.
• Information included in the data-base will include pilot’s licenses, aircraft ratings, check rides, No-tices of Disapproval and other flight proficiency tests.
• Flight and Duty Time Rule: Directs the FAA to update and implement a new pilot flight and duty time rule and fatigue risk management plans within one year to more adequately track scientific research in the field of fatigue.
• Fatigue Risk Management Systems: Requires air carriers to create fa-tigue risk management systems approved by FAA to proactively miti-gate pilot fatigue.
• Commuting Study: Studies the im-pact of pilot commuting on fatigue and provides preliminary results to the FAA to be considered as part of the flight and duty time rulemaking.
• Directs the FAA to develop and im-plement a plan to facilitate the es-tablishment of an Aviation Safety Action Program (ASAP) Flight Op-erational Quality Assurance (FOQA) program, and Advanced Qualifica-tion Programs (AQP) by all com-mercial airlines and their unions.

In Our Next Issue: How HR 3371 impacts your airline’s training programs.

To read the entire text of H.R. 3371: Airline Safety and Pilot Training Improvement Act, go to: www.opencongress.org/bill/111-h3371/text

Your Questions… Answered

Since launching the QMS division of XCELAR, we have received many questions regard-ing specific aspects of AQP development. In each newsletter, we will share some of these questions, along with answers from our experts. You can send your questions to us by emailing quality management@xcelar.com.

We are currently working on developing our grad-ing strategy. What grade scale should we choose? Is there an industry standard?

While there is no docu-mented industry standard, most AQP carriers use ei-ther a 4-point or a 5-point grade scale. The decision to choose an effective grade scale should focus on ‘odd’ versus ‘even’, rather than 4-point versus 5-point. A 5-point Likert scale gives evaluators neu-tral ground to answer nei-ther positive nor negative. Some neutral answers are truly middle; some are non-committal. A 4-point Likert scale forces evaluators to agree or disagree. There's no neutral or middle ground. It's a forced choice that demands much more from evaluators. A forced choice scale also tends to lessen central tendency bias. However, 4-point scales tend to be a too nar-row to capture adequate variability and detail. If choosing a 4-point scale, detailed reason codes should be employed to off-set the possible lack of variability. Reason codes represent categories of common behavior (e.g. procedural knowledge, use of automation) that enable analysts to determine why the behavior occurred. Whichever grade scale you choose, a strong rater-reliability program is cru-cial. Without well calibrated evaluators, data derived using any grade scale is invalid.

A Quality Control Pro-gram is a required part of an AQP program, but there is very little guid-ance on this. What types of things should be included in this program?

A strong Quality Control program should address both instructor perform-ance and the overall quality of the training program and environment. Instructor performance can be ad-dressed through routine observations of your in-structor force by qualified observers. Designing a comprehensive perform-ance grading methodology will allow you to address individual instructor issues, as well as issues that are common among the whole group. Analyzing the data that you collect from in-structor observation grade sheets allows you to con-tinually improve the quality of the materials and train-ing supplied to your in-structors. While employing quality instructors is a big part of a quality training program, there are other factors to consider: the or-ganization of the course, accuracy of the course ma- terial, the way the material is delivered, to name a few. One way to determine the overall quality of your training program is to design a stan-dard critique mechanism. Online survey tools are effec-tive ways to receive feedback, while giving the author ano-nymity and time flexibility to point out flaws and suggest improvements to your pro-gram. Using a standard for-mat and grade scale when designing the paper form or online survey allows you to analyze the data for trends and prioritize tasks for con-tinuous improvement of your program.

For more information about rater-reliability, grading methodology, overall data management, or quality control programs, contact us at qualitymanage-ment@xcelar.com.

XCELAR QM Services

Need help with your Phase II development? Does data management scare you? What is your rater reliability? XCELAR’s team of experts includes AQP program man-agers and trainers from major carriers, database specialists, airline and aviation indus-try executive management, and technology experts in flight training, aircraft systems, and airline operations. We can review your AQP and recommend next step proce-dures, fixes, and areas of particular concern. We provide complete packages for any phase of your program or hourly consulting. From Phase I through completion and implementation, for flight operations, inflight, dispatch and maintenance, we can bring clarity and success to your program. We specialize in a customized approach to train-ing that incorporates proven technologies and methods with your individual needs and demographics. And we guarantee that the results will be successful and meet FAA standards and approval. Send us an email, call, or visit our website for more informa-tion.

Cheri L. Haynes Direct line: 612-991-3648 or cheri.haynes@xcelar.com