ASRS Program Briefing
August 2013
1
ASRS Program Briefing Index
ASRS Program Overview Report Processing Alert Messages Quick Responses ASRS Database CALLBACK ASRS Directline Focused Studies & Research ASRS Model Applied ASRS Summary 3 11 22 29 32 37 41 43 47 54
Aviation Safety Reporting System
2
ASRS Program Overview
Aviation Safety Reporting System
3
ASRS Program Overview
Concept & Mission
The Aviation Safety Reporting System (ASRS) receives, processes and analyzes voluntarily submitted incident reports from pilots, air traffic controllers, dispatchers, cabin crew, maintenance technicians, and others. Reports submitted to ASRS may describe both unsafe occurrences and hazardous situations. Information is gathered from these reports and disseminated to stakeholders. ASRS's particular concern is the quality of human performance in the National Airspace System. Reporting Incentives
• Voluntary • Confidential • Non-punitive
Aviation Safety Reporting System
4
ASRS Program Overview
Purpose
Identify deficiencies and discrepancies in the National Airspace System
• Objective: Improve the current aviation system
Provide data for planning and improvements to the future National Airspace System
• Objective: Enhance the basis for human factors research & recommendations for future aviation procedures, operations, facilities, and equipment
Aviation Safety Reporting System
5
ASRS Program Overview
ASRS Background
WW II 1958 Oct. 1974 Dec. 1974 Apr. 1975 May 1975 May 9, 1975 Apr. 1976 Industry and Military recognized value of voluntary incident reporting Need for U.S. Incident Data System raised during FAA Enactment Hearings United Airlines incident foreshadowed TWA 514 Accident TWA 514 Accident Study of the National Air Transportation System as a Result of the Secretary’s Task Force on the FAA Safety Mission Aviation Safety Reporting Program (ASRP) Implemented (FAA) Advisory Circular 00-46 Issued Aviation Safety Reporting System (ASRS) Established (NASA/FAA)
6
Aviation Safety Reporting System
ASRS Program Overview
ASRS Staff
The ASRS Staff is composed of highly experienced pilots, air traffic controllers and mechanics, as well as a management team that possess aviation and human factors experience. ASRS Analysts' experience is comprised of over 470 cumulative years of aviation expertise covering the full spectrum of aviation activity: air carrier, corporate, military, and general aviation; Air Traffic Control in Towers, TRACONs, Centers, and Military Facilities. Analyst cumulative flight time exceeds 140,000 hours in over 50 different aircraft. In addition, the ASRS Staff has human factors and psychology research experience in areas such as crew resource management, training, fatigue, user interface design, usability evaluations, and research methodology.
Aviation Safety Reporting System
7
Documents Governing ASRS Immunity & Confidentiality
Federal Register Notice, 1975 & 1976 Federal Aviation Regulations Part 91.25 (14 CFR 91.25) FAA Advisory Circular 00-46E
ASRS Program Overview
FAA policy concerning Air Traffic Controllers regarding ASRS reporting, FAA Order JO 7200.20
Aviation Safety Reporting System
8
ASRS Program Overview
The Immunity Concept
Paragraph 9. c. FAA Advisory Circular No. 00-46E c. Enforcement Restrictions. The FAA considers the filing of a report with NASA
concerning an incident or occurrence involving a violation of 49 U.S.C. subtitle VII or the 14 CFR to be indicative of a constructive attitude. Such an attitude will tend to prevent future violations. Accordingly, although a finding of violation may be made, neither a civil penalty nor certificate suspension will be imposed if:
1. 2. The violation was inadvertent and not deliberate; The violation did not involve a criminal offense, accident, or action under 49 U.S.C. § 44709, which discloses a lack of qualification or competency, which is wholly excluded from this policy; The person has not been found in any prior FAA enforcement action to have committed a violation of 49 U.S.C. subtitle VII, or any regulation promulgated there for a period of 5 years prior to the date of occurrence; and The person proves that, within 10 days after the violation, or date when the person became aware or should have been aware of the violation, he or she completed and delivered or mailed a written report of the incident or occurrence to NASA.
3.
4.
Aviation Safety Reporting System
9
ASRS Program Overview
ASRS Stakeholders
Aviation Safety Reporting System
10
Report Processing
Aviation Safety Reporting System
11
Report Processing
Report Intake Overview
ASRS receives reports from pilots, air traffic controllers, cabin crew, dispatchers, maintenance technicians, and others involved in aviation operations. ASRS's report intake has been robust from the first days of the program, in which it averaged approximately 400 reports per month. In recent years, report intake has grown at an enormous rate. Intake now averages over 1,300 reports per week and nearly 6,000 reports per month.
Aviation Safety Reporting System
12
Report Processing
Report Intake Metrics
• Total Program Report Intake = 1,059,600 • Total Report Intake for 2012 = 71,540 • An increase of 118% since 1997 • Averaging 5,962 reports per month, 285 per working day
Monthly Report Intake
(January 1981 – December 2012)
7,000
Smoothed Intake
6,000
5,000
4,000
3,000
2,000
1,000
0
'81 '82 '83 '84 '85 '86 '87 '88 '89 '90 '91'92 '93 '94 '95 '96 '97 '98 '99 '00 '01 '02 '03 '04 '05 '06 '07 '08 '09 '10 '11'12
Aviation Safety Reporting System
13
Report Processing
Incident Reporter Distribution
January 2003 – December 2012
100%
80%
60%
40%
20%
0% 2003 34,043 2004 38,116 2005 40,657 2006 39,694 2007 45,603 2008 50,405 2009 48,986 2010 58,683 2011 61,018 2012 71,540
Controller Air Carrier General Aviation Crew Air Carrier MaintenanceController Other Other Maintenance Cabin Crew Cabin Gen Av
Aviation Safety Reporting System
14
Report Processing
Report Processing Overview
ASRS has securely processed over one million reports in its 37 year history. The process contains critical elements that ensure each report is handled in a manner that maintains reporter confidentiality while maximizing the ability to accurately assess the safety value of each report. ASRS report processing begins with the receipt of reports through electronic submission or from the post office, and ends with the final coded report entering the ASRS Databases. Reports sent to the ASRS are widely regarded as one of the world’s largest sources of information on aviation safety and human factors.
Aviation Safety Reporting System
15
Report Processing
Report Processing Flow
Aviation Safety Reporting System
16
Report Processing
Report Processing Flow
Paper
Electro nic
ASRS paper reports are picked-up daily from the Moffett Field Post Office or are received electronically via website Electronic Report Submission (ERS) or ASAP data transmissions
Every report is date and time stamped based on the date of receipt
Two ASRS Analysts “screen” each report within three working days to provide initial categorization and to determining the triage of processing
ASRS Analysts may identify hazardous situations from reports and issue an Alert Message. De-identified information is provided to organizations in positions of authority for further evaluation and potential corrective actions
17
Aviation Safety Reporting System
Report Processing
Report Processing Flow
ASRS retains high-level categorization of 100% of reports received. Based on initial categorization, multiple reports on the same event are brought together to form one database “record” ASRS Analysts identify reports that require further analysis and entry into the public ASRS database. During the detailed Report Analysis process, reports are codified using the ASRS taxonomy. An ASRS Analyst may choose to call a reporter on the telephone to clarify any information the reporter provided. This information is added to the analysis and final record. To ensure confidentiality all identifying data is removed. After analysis, the Identification Strip, the top portion of the report, is returned to the reporter. This ID strip acts as the reporter’s proof of submittal. All physical and electronic ID strip data with the reporter’s name, address, date and time stamp is removed.
Aviation Safety Reporting System
18
Report Processing
Report Processing Flow
All reports that receive further analysis go through a Final Check to assure coding accuracy. Quality Assurance checks are also performed for coding quality. Final coded reports enter the ASRS Database. These de-identified records are then available in the ASRS Database Online, which is available through the ASRS website. Original reports, both physical and electronic data, are destroyed to completely ensure confidentiality ASRS uses the information it receives to promote aviation safety through a number of products and services, such as Alert Messages, Search Requests, a monthly newsletter, focused studies and more
Aviation Safety Reporting System
19
Report Processing
ASRS Products & Services
Aviation Safety Reporting System
20
Report Processing
ASRS Products & Services Metrics
April 1976 – December 2012
Significant Items
Safety Alert Messages Quick Responses Search Requests CALLBACK Issues ASRS Directline Issues Research Studies
Quantity
5,707 141 7,335 395 10 64
Aviation Safety Reporting System
21
Alert Messages
Aviation Safety Reporting System
22
Alert Messages
Alert Message Overview
When ASRS receives a report describing a hazardous situation, for example, a defective navigation aid, an aircraft system anomaly, a confusing procedure, or any other circumstance which might compromise safe flight – an alerting message is issued using de-identified information provided in the reports. Alerting messages have a single purpose: to relay safety information to organizations in positions of authority so that they can evaluate the information and take possible corrective actions. Alert messages are classified as Alert Bulletins or For Your Information Notices, and may be included in monthly ASRS Safety Teleconferences.
Aviation Safety Reporting System
23
Alert Messages
ASRS Alerting Pyramid
ASRS has no direct authority to directly correct safety issues. It acts through and with the cooperation of others.
Aviation Safety Reporting System
24
Alert Messages
Alerting Metrics
January 2003 – December 2012
2003 2004
157 147
2005
79 129
2006
75 117
2007
63 279
2008
40 235
2009
30 206
2010
43 222
2011
50 151
2012
40 177
Alert Messages Issued FYI Notices Issue Response Rate to AB/FYI
115 99
28%
36%
32%
35%
49%
46%
38%
34%
29%
27%
Response Rate 38% Non-Manufacturer
82%
45%
55%
64%
55%
26%
36%
38%
25%
Aviation Safety Reporting System
25
Alert Messages
Alerting Subjects
January 2003 – December 2012
Subject
Aircraft Systems Airports Facility Status and Maintenance Other ATC Procedures ATC Operations Airport Lighting and Approach Aids ATC Equipment Hazards to Flight Aircraft Power Plants Navigation Aircraft Avionics
Total
810 450 285 209 164 161 125 86 83 44 37
26
Aviation Safety Reporting System
Alert Messages
Alerting Responses
January 2003 – December 2012
Response
Action taken as a result of the AB/FYI Action initiated before AB/FYI received Action initiated in response to AB/FYI but not completed Addressee agrees with AB/FYI but sees no problem Issue raised by AB/FYI under investigation Addressee disputes factual accuracy of AB/FYI Information in AB/FYI insufficient for action For information only, no response expected Action not within addressee's jurisdiction Addressee in factual agreement but is unable to resolve
Aviation Safety Reporting System
Percentage
25% 13% 10% 6% 5% 21% 12% 3% 3% 2%
27
Total
59%
Alert Messages
Examples of Safety Alerting Success
SFO Taxiway Signage (FYI 2012-102)
SFO Airfield Operations office reviewed the pilot's comments and stated they are “...working with Jeppesen to enlarge the inset diagram on page 10-9 depicting Hot Spot #1, which currently shows Taxiways E, J, and F, but excludes Taxiway F1. The more encompassing diagram should assist pilots in quickly identifying the position of each taxiway and thus more effectively follow Tower instructions.”
DTW Taxiway "F" Marking Confusion (FYI 2012-97)
The DTW Director of Airfield Operations investigated the safety concern stating “As a result of our investigation, a request was made to the commercial chart provider on July 31, 2012 to revise the chart and add a notation for 'Taxiway Fox located south of E-2' to the map.”
HS-125 Violent Wing Oscillations (AB 2012:17)
The Kansas City Aircraft Evaluation Group responded stating “The result of investigating the source of these ASRS reports found 40 some similar incidences have been reported in various forms. The information has facilitated attention to the matter resulting in effort toward continued operational safety.”
Aviation Safety Reporting System
28
Quick Responses
Aviation Safety Reporting System
29
Quick Responses
Quick Response Overview
Quick Responses are rapid turnaround data analysis that are typically accomplished within two to ten business days of the request. They are a high value service directed towards safety issues with immediate operational importance. Quick Responses are generally limited to government agencies such as FAA, NTSB, NASA, and U.S. Congress.
Aviation Safety Reporting System
30
Quick Responses
Recent Quick Response Applications
An Analysis of Part 121 Similar Call Sign Related Incidents (QR339) An Analysis of Part 121 Flight Crew Fatigue Related Incidents (QR338) An Analysis of Dual Turboprop Engine Aircraft Icing Encounter Incidents (QR337) An Analysis of Part 121, 135 and 91 Turbojet Rejected Takeoff Related Incidents (QR336)
31
Aviation Safety Reporting System
ASRS Database
Aviation Safety Reporting System
32
ASRS Database
ASRS Database
Information in the ASRS Database is available publicly. The ASRS will provide Search Requests to government agencies, members of Congress, aviation safety organizations, and others. ASRS will search its database, download relevant reports, and send to requestor. Direct access to search de-identified reports in the ASRS database is now available through ASRS Database Online http://asrs.arc.nasa.gov/search/database.html For your convenience, selected relevant reports on several safety topics are available on the website called ASRS Database Report Sets http://asrs.arc.nasa.gov/search/reportsets.html The ASRS Database is also available and updated monthly through the FAA Aviation Safety Information Analysis and Sharing (ASIAS) website http://www.asias.faa.gov/
Aviation Safety Reporting System
33
ASRS Database
ASRS Database Metrics
Since the inception of ASRS, over 7,335 Search Requests (SRs) have been directly provided by ASRS Research Staff to various aviation organizations and agencies, as well as individuals through December 2012 The activity on the ASRS website for ASRS Database Online is over 1,638 completed queries a month From the ASRS website, ASRS Database Report Sets are downloaded on average over 3,140 times a month, Report Sets were first posted in January 2000
Aviation Safety Reporting System
34
ASRS Database
Search Requestors by Organization
January 2003 – December 2012
Organization
FAA Media Air Carriers NTSB NASA Alphabet Groups Other Research Organizations Miscellaneous Safety Organizations
Total
300 75 73 72 69 54 39 30 29
Organization
Student Aircraft Manufacturers Individuals Miscellaneous Government Foreign Military Law Firms Educational Institutes DHS
Total
22 21 21 13 11 8 7 5 3
Aviation Safety Reporting System
35
ASRS Database
Recent Search Requests Samples
RNAV Departure Related Incidents (SR 7081) • Completed for FAA Air Traffic Organization, Terminal Office (AJT-28)
Landing Roll Incidents Involving Spoiler, Speedbrakes or Thrust Reverser Issues (SR 7078)
• Completed for the NTSB
CAK Airport Reports (SR 7067) • For an Air Carrier introducing a new route into Akron-Canton Airport (CAK) • Reports used for pilot training purposes Unmanned Aerial Vehicle (UAV) Related Incidents (SR7063) • Completed for NASA
Aviation Safety Reporting System
36
CALLBACK
Aviation Safety Reporting System
37
CALLBACK
CALLBACK Overview
CALLBACK, the award winning ASRS monthly safety newsletter, has been published since 1979 in a popular “lessons learned” format. CALLBACK presents ASRS report excerpts that are significant, educational, and timely. Occasionally features on ASRS program developments and research are also presented. Over 398 issues have been published and distributed throughout the U.S. and to the international aviation community. All issues since December 1994 are available for download at the ASRS website at:
http://asrs.arc.nasa.gov/publications/callback.html
Aviation Safety Reporting System
38
CALLBACK
CALLBACK Distribution and Subscription
In addition to being published online, CALLBACK is distributed by email. Subscription is free and available via the ASRS website. The total number of email subscribers for 2012 was over 24,500 CALLBACK views for 2012 (HTML and PDF) were over 300,000
Aviation Safety Reporting System
39
CALLBACK
Aviation Community Feedback
Sample reader comments from 2012
• “Thank you so much for sending me these......very real and all pilots need to see them.” • “These NASA CALLBACK things are great. I'm not sure who all reads or likes them but I learn a few things from them.” • “I am a retired professional pilot who valued these reports. Thank you for a good job.” • “Thank you for another useful CALLBACK. Ernest Gann may have said it best: It's when things are going just right that you'd better be suspicious.”
Aviation Safety Reporting System
40
ASRS Directline
Aviation Safety Reporting System
41
ASRS Directline
ASRS Directline Overview
ASRS Directline is another award-winning ASRS publication. Although not currently published, this safety journal had an estimated readership of 20,000. Ten issues have been published since 1991 with an average of three to five articles per issue. All issues are available for download at the ASRS website at: http://asrs.arc.nasa.gov/publications/directline.html The feasibility of producing this publication again in the near future is being assessed.
42
Aviation Safety Reporting System
Focused Studies/Research
Aviation Safety Reporting System
43
Focused Studies / Research
Focused on Operations and Human Factors
64 Research Studies and Special Papers Published
• Operations: Deviations, De-Icing/Anti-Icing, Rejected Takeoffs, Clearances, Weather Encounters, Landing Incidents, Runway Transgressions, TCAS II, Crossing Restrictions, etc. • Human Factors: Communication, Memory, Confusion, Time Pressure, Judgment, Training, Crew Performance, Flight Crew Monitoring, etc. • Confidential Reporting: ASRS Reporting Model, Case for Confidential Reporting, Development of ASRS, Cross Industry Applications, etc.
Research agendas are developed in collaboration with government and industry safety organizations There are over 30 ASRS Research Papers available to download on the ASRS website
Aviation Safety Reporting System
44
Focused Studies / Research
Structured Callback: Supplemental Question Set
Meteorological and Aeronautical Information Services Data Link Services and Applications Study
In cooperation with the FAA, ASRS is currently conducting a study focused on meteorological and aeronautical information services (AIS) via data link. ASRS is gathering reports of incidents that occurred while pilots were utilizing weather or AIS information in the cockpit (textual and/or graphical) obtained via data link (including ACARS) or other sources on the ground or in the air. Some factors to be analyzed include type of weather data received, cockpit display utilized, software or applications used to receive meteorological information, and end user graphical interface issues. In March of 2012 an interim report was published and is now available on the ASRS website.
Aviation Safety Reporting System
45
Focused Studies / Research
Structured Callback: Supplemental Question Set
Wake Vortex Encounter Study
In cooperation with the FAA ASRS is currently examining Wake Vortex Encounter incidents reported to ASRS. ASRS began this study in 2007 and will continue through 2013. At present the Wake Vortex Encounter Study includes all airspace within the United States, en route and terminal. In quarterly reports, the ASRS documents event dynamics and contributing factors underlying unique wake vortex encounter incidents. A sampling of the factors to be analyzed includes reporters’ assessed magnitude of wake encounter, aircraft spacing, aircraft type, runway configuration, and consequences from the encounter.
Aviation Safety Reporting System
46
ASRS Model Applied
Aviation Safety Reporting System
47
ASRS Model Applied
ASRS Model Applied
The ASRS model is utilized internationally in the aviation community. The International Confidential Aviation Safety Systems (ICASS) Group promotes confidential reporting systems as an effective method of enhancing flight safety in commercial air transport and general aviation operations. International Civil Aviation Organization (ICAO) has revised Annex 13 – Accident Prevention. The previous Recommendation for member states to establish a voluntary incident reporting system has been elevated to a Standard. Because of the success of ASRS, there is also a growing interest in utilizing the ASRS reporting model for application to other disciplines such as medicine, railroad, maritime, security, and others.
Aviation Safety Reporting System
48
ASRS Model Applied to International Aviation Community
UNITED STATES: Aviation Safety Reporting System (ASRS) [1976]
ASRS Model Applied
UNITED KINGDOM: Confidential Human factors Incident Reporting Programme (CHIRP) [1982] CANADA: Confidential Aviation Safety Reporting Program (CASRP) [1985], (SECURITAS) [1995] AUSTRALIA: CAIR [1988], Report Confidentially (REPCON) [2007] BRAZIL: Confidential Flight Safety Report (RCSV) [1997] JAPAN: Aviation Safety Information Network (ASI-NET) [1999] FRANCE: Confidential Events Reporting System (REC) [2000], (REX) [2011] TAIWAN: Taiwan Confidential Aviation Safety Reporting System (TACARE) [2000] KOREA: Korean Aviation voluntary Incident Reporting System (KAIRS) [2000] CHINA: Sino Confidential Aviation Safety reporting System (SCASS) [2004] SINGAPORE: Singapore Confidential Aviation Incident Reporting (SINCAIR) [2004] SPAIN: Safety Occurrence Reporting System (SNS) [2007]
49
Aviation Safety Reporting System
ASRS Model Applied to International Aviation Community
United Kingdom CHIRP (1982) Canada CASRP (1985) SECURITAS (1995) Spain SNS (2007) Germany EUCARE France REC (2000) REX (2011) Russia VASRP (1992)
ASRS Model Applied
United States ASRS (1976)
Korea KAIRS (2000) China SCASS (2004)
Japan ASI-NET (1999)
Taiwan TACARE (2000)
Brazil RCSV (1997)
Singapore SINCAIR (2004)
South Africa SASCO
Australia CAIR (1988) REPCON (2007)
New Zealand ICARUS
Aviation Safety Reporting System
50 International Confidential Aviation Safety Systems (ICASS)
ASRS Model Applied
ASRS Model Applications
Confidential Close Call Reporting System (C3RS)
A Confidential Close Call Reporting System to improve railroad safety. C3RS is a partnership between railroad carriers, railroad labor organizations, NASA, and the Federal Railroad Administration (FRA). (2010 to present)
The National Fire Fighters Near-Miss Reporting System
The project is administered by the International Association of Fire Chiefs (IAFC) in consultation with the National Fire Fighter Near-Miss Reporting System Task Force, with the goal to improve fire fighter safety. (2005 to present)
Security Incident Reporting System (SIRS)
NASA Ames developed SIRS so individuals could voluntarily submit reports about security system effectiveness and potential problems that might lead to corrective action. (2001 – 2005)
Patient Safety Reporting System (PSRS)
The PSRS began as a collaboration between the Department of Veterans Affairs (VA) and NASA Ames Research Center as a contribution to a commitment to quality and safety. (2000 – 2009)
Aviation Safety Reporting System
51
ASRS Summary
Aviation Safety Reporting System
52
ASRS Summary
ASRS Summary
ASRS is a highly successful and trusted program that has served the needs of the aviation community for over 37 years. It is available to all participants in the National Airspace System who wish to report safety incidents and situations. The ASRS identifies system deficiencies, and issues alerting messages to persons in a position to correct them. It educates through its newsletter CALLBACK, its journal ASRS Directline and through its research studies. Its database is a public repository which serves the needs of the FAA and NASA, and those of other organizations world-wide which are engaged in research and the promotion of safe flight.
53
Aviation Safety Reporting System
ASRS Summary
Advantages of the ASRS Model
System-Wide Perspective System-Wide Alerting Data Processing through Expert Analysts Comprehensive and Time Tested Coding Taxonomy Strong Immunity and Legal Provisions Information Sharing on Safety/Security National and International Reputation
Aviation Safety Reporting System
54
ASRS Summary
Why Confidential Reporting Works
When organizations want to learn more about the occurrence of events, the best approach is simply to ask those involved People are generally willing to share their knowledge if they are assured • Their identities will remain protected • There is no disciplinary or legal consequences A properly constructed confidential, voluntary, non-punitive reporting system can be used by any person to safely share information Confidential reporting systems have the means to answer the question why - why a system failed, why a human erred Incident/event data are complementary to the data gathered by other monitoring systems
Aviation Safety Reporting System
55
Thank You
Contact the NASA Program Director
• Linda Connell –
[email protected]
Additional Information & Resources
• Confidentiality & Incentives to Report
http://asrs.arc.nasa.gov/overview/confidentiality.html
• Immunity Policies
http://asrs.arc.nasa.gov/overview/immunity.html
• Requesting ASRS Data
http://asrs.arc.nasa.gov/search/requesting.html
56
Aviation Safety Reporting System