The Internal Revenue Service Needs to Strengthen Guidelines for Measuring the Quality and Timeliness of the Walk-In Assistance Program
April 2000
Reference Number: 2000-40-065
This report has cleared the Treasury Inspector General for Tax Administration disclosure review process and information determined to be restricted from public release has been redacted from this document.
April 25, 2000
MEMORANDUM FOR COMMISSIONER ROSSOTTI
FROM: Pamela J. Gardiner /s/ Pamela J. Gardiner
Deputy Inspector General for Audit
SUBJECT: Final Audit Report – The Internal Revenue Service Needs to Strengthen Guidelines for Measuring the Quality and Timeliness of the Walk-In Assistance Program
This report presents the results of our review of the Internal Revenue Service’s (IRS) readiness efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of this review was to determine whether the readiness process for the 2000 filing season will ensure that taxpayers who walk into an IRS office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.
In summary, we found that the IRS has an effective process for planning the Walk-In Assistance Program. If properly implemented, taxpayers who visit IRS offices for assistance during the 2000 filing season should receive quality customer service that is timely and accurate. Our concern is that current guidelines do not provide comprehensive instructions for measuring the quality and timeliness of service and evaluating program results. Accordingly, we recommended that the IRS:
IRS management agreed with our recommendations and has initiated corrective actions. Management’s comments have been incorporated into the report where appropriate, and the full text of their comments is included as an appendix.
Copies of this report are also being sent to the IRS managers who are affected by the report recommendations. Please contact me at (202) 622-6510 if you have questions, or your staff may call Walter E. Arrison, Associate Inspector General for Audit (Wage and Investment Income Programs), at (770) 455-2475.
Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently
The National Office Does Not Adequately Monitor the Walk-In Assistance Program
Appendix I – Detailed Objective, Scope, and Methodology
Appendix II – Major Contributors to This Report
Appendix III – Report Distribution List
Appendix IV – Management’s Response to the Draft Report
The overall mission of the Internal Revenue Service (IRS) is to provide America’s taxpayers top quality service by helping them understand and meet their tax responsibilities and by applying the tax law with integrity and fairness to all. As part of this overall mission, the IRS wants to provide world-class customer service to taxpayers who visit IRS offices during the upcoming filing season. During the 1999 filing season, IRS employees assisted over six million taxpayers who came in to ask a question, get a tax form, or have their tax return prepared. In addition, numerous other taxpayers came in to get tax forms off the self-service racks.
This audit report presents our evaluation of the IRS’ readiness efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of this review was to determine whether the readiness process for the 2000 filing season will ensure that taxpayers who walk into an IRS office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.
Results
The IRS has a fundamentally sound approach to planning walk-in assistance for the 2000 filing season. The process covers: anticipating the number of taxpayers who will visit IRS offices and the services that they will need, staffing walk-in assistance with trained personnel, and setting up enough offices with the proper facilities to service taxpayers. However, the IRS needs to strengthen current guidelines for measuring the quality and timeliness of services provided by the Walk-In Assistance Program.
The Internal Revenue Service Has Not Established Acceptability Standards to Evaluate the Time Taxpayers Wait for Walk-In Assistance
Operating Guidelines for Fiscal Year 2000 have established wait-time goals for assisting individual taxpayers: 15 minutes for taxpayers who come into the office to ask a tax question or get a tax form and 30 minutes for taxpayers who need a return prepared. However, acceptability standards (the percentage of taxpayers to be serviced within the 15-minute and 30-minute goals) have not been set to identify offices that are not providing timely service or to measure the overall success of the Walk-In Assistance Program.
Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently
All taxpayers who visit IRS offices and need assistance getting forms should be included in the computation of wait-time. Some offices correctly include these taxpayers in their wait-time computations. However, numerous offices do not record the actual length of time these taxpayers wait in line. Instead, all taxpayers are counted as being served timely in the wait-time computation regardless of how long the taxpayers were in line.
The National Office Does Not Adequately Monitor the Walk-In Assistance Program
Because of limited resources, the IRS National Office does not adequately monitor the implementation of the Walk-In Assistance Program. However, regional offices conduct independent reviews of Walk-In Assistance Programs in district offices, both during the readiness process and the filing season. We believe it would be beneficial for the regional offices to furnish the National Office the results of their reviews to help identify and correct trends or potential problems.
The Internal Revenue Service Has Not Developed Quality Measurements for the Tax Return Preparation Program to Comply With the New Balanced Measurements
The IRS has adopted a system of balanced measures that includes three general types of measurements: customer satisfaction, employee satisfaction, and business results (quality and quantity). However, the current quality reviews of tax returns prepared by walk-in assistors are done on an ad hoc basis and do not meet the requirements of the recently issued balanced measurement regulation.
Summary of Recommendations
To improve the Walk-In Assistance Program readiness process for the 2000 filing season, we recommended that the IRS:
Management’s Response: IRS management agreed with our recommendations and has initiated corrective actions. Management’s complete response to the draft report is included as Appendix IV.
This report presents our evaluation of the Internal Revenue Service’s (IRS) efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of the audit was to determine whether the readiness process for the 2000 filing season will help ensure that taxpayers who come into an IRS office for assistance receive quality customer service and accurate, timely responses to their tax-related questions.
To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.
The audit was conducted in the IRS National Office during August and September 1999, in accordance with Government Auditing Standards. We also contacted regional offices to secure information.
Details of our audit objective, scope, and methodology are presented in Appendix I. Major contributors to this report are listed in Appendix II.
The overall mission of the IRS is to provide America’s taxpayers top quality service by helping them understand and meet their tax responsibilities and by applying the tax law with integrity and fairness to all. As part of this overall mission, the IRS wants to provide world-class customer service to taxpayers who use walk-in assistance during the upcoming filing season.
The IRS has recognized that some taxpayers prefer to visit IRS offices rather than take advantage of assistance provided over the internet or telephone. Over 400 offices are available nationwide for taxpayers to visit during the filing season. During the 1999 filing season, IRS employees assisted over six million taxpayers who came in to ask a question, get a tax form, or have their tax return prepared. In addition, numerous other taxpayers came in to get tax forms off the self-service racks.
The following key elements provide the foundation of the readiness planning process:
Internal Revenue Service Executive Steering Committee
The IRS Executive Steering Committee (ESC) is responsible for overseeing the implementation of service improvement projects, setting priorities, and ensuring consistency with the IRS business strategy. Senior IRS executives meet bimonthly to raise and resolve multifunctional issues impacting the filing season. For example, the ESC ensured that the IRS is preparing for the 2000 filing season by developing readiness check plans, addressing troublesome areas, and reporting on the IRS’ state of readiness. The last filing season was evaluated to identify pertinent issues for the upcoming year. These issues were incorporated into a Servicewide Action Plan used to monitor the readiness process.
Fiscal Year 2000 Walk-In Assistance Program Expectations
Yearly, the Assistant Commissioner (Customer Service) issues a program letter that contains guidance for the implementation of the Walk-In Assistance Program. The expectations for 2000 and beyond focus on delivering consistent, expeditious, accurate, and professional service. World-class customer service is the goal. The program letter contains several key initiatives which, if properly put in place, should result in an effective, customer-driven 2000 Walk-In Assistance Program.
Compliance and Customer Service Managers’ Handbook
The Internal Revenue Manual contains a formal readiness checklist for field offices to use to prepare the walk-in area for the filing season. The readiness checklist is comprehensive and covers: staffing, training, review of office procedures, cross-functional coordination, space and equipment needs, and the availability of reference materials.
Certification of Readiness Process
All functions and field offices were required to perform readiness reviews and certify, by December 15, 1999, that sites are prepared for the filing season.
The IRS has a fundamentally sound approach to planning walk-in assistance for the 2000 filing season that covers: anticipating the number of taxpayers who will visit IRS offices and the services that they will need, staffing walk-in assistance with trained personnel, and setting up enough offices with the proper facilities to service taxpayers. However, the IRS needs to strengthen current guidelines for measuring the quality and timeliness of services provided by the Walk-In Assistance Program.
The Internal Revenue Service Has Not Established Acceptability Standards to Evaluate the Time Taxpayers Wait for Walk-In Assistance
Providing timely service to taxpayers who visit IRS offices for assistance is critical to a successful Walk-In Assistance Program. The IRS has established wait-time goals for assisting individual taxpayers: 15 minutes for taxpayers who come into the office to ask a tax question or get a tax form and 30 minutes for taxpayers who need a return prepared. However, acceptability standards (the percentage of taxpayers to be serviced within the 15-minute and 30-minute goals) have not been set to identify offices that are not providing timely service or to measure the overall success of the Walk-In Assistance Program.
The need for additional standards is shown in the statistics maintained for last year’s filing season. The IRS National Office requested that field offices gather information and compute the percentage of taxpayers who were not waited on within the 15-minute and 30-minute goals. Regions were to report monthly when goals were not being met. Our limited review of wait-time statistics showed that a high percentage of all taxpayers received timely service. However, the statistics also showed that taxpayers in some locations did not. Because there was no standard specifically stated for an acceptable level of service, the National Office did not receive any exception reports from the regions.
We believe that the lack of acceptable performance standards prevented the field from reporting actual wait-time results. Field offices need predetermined wait-time performance standards to ensure that problems are reported to the National Office. Without acceptability standards, the National Office may not identify or correct problems with field offices providing timely service to taxpayers.
Recommendation
Management’s Response: IRS management is requiring field offices to send monthly wait-time reports to the National Office, and an analyst has been assigned to monitor wait-times.
Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently
The timeliness of assistance is an important factor in the success of the Walk-In Assistance Program. Some offices are equipped with an automated Q-matic system to measure the length of time taxpayers have to wait for service. In other offices, employees have to manually record the wait-time on forms when taxpayers come into the office. Unfortunately, there are differences in the way offices compute wait-time for taxpayers who need assistance in getting a tax form.
When taxpayers cannot find the form they are looking for in the self-service forms racks, they have to wait in a line to ask an IRS employee for assistance. In some offices, taxpayers who only need a form are sent to a separate line. In other offices, taxpayers who need forms get in the same line as taxpayers who have a question to be answered. In either case, the contact should be used to calculate the time a taxpayer has to wait for service.
Our review of regional evaluations of walk-in assistance, and discussions with analysts who made the evaluations, showed inconsistencies in computing wait-time. Some offices correctly included taxpayers getting forms in their wait-time computations. However, numerous offices incorrectly applied the guidelines and did not record the actual length of time these taxpayers waited in line. Instead, all taxpayers were counted as being served timely in the wait-time computation, regardless of how long they were in line.
It is important that all offices consistently report data because it is used for funding, resourcing, and program analysis purposes. That same information is also used to compute wait-time and evaluate whether offices are providing service to taxpayers within the 15-minute goal.
Recommendation
Management’s Response: The requirement to accurately record wait-times has been reiterated by IRS management with field offices.
The National Office Does Not Adequately Monitor the Walk-In Assistance Program
The IRS National Office is primarily responsible for planning the Walk-In Assistance Program based on input from the field and new initiatives suggested by various sources such as the Congress and the IRS Commissioner. However, because of limited resources, the National Office does not adequately monitor the implementation of the Walk-In Assistance Program. We believe that there is a process currently in place that could provide the National Office with valuable information on the implementation of the Program with little or no additional expense.
Every fall, district offices undertake a Certification of Readiness Process. District Directors are responsible for preparing their walk-in office sites to ensure that taxpayers receive quality, timely customer service during the filing season. The readiness process involves evaluating all aspects of what is needed to provide an effective Walk-In Assistance Program to the public. Considerations such as staffing levels, training, office space, equipment needs, and availability of reference materials should be addressed. At the conclusion of this readiness process, District Directors certify that district offices are prepared to offer quality customer service to taxpayers during the filing season.
In addition to the districts’ efforts to prepare for the filing season, regional analysts from the four regional offices conduct independent reviews of districts around the country. These analysts, using the national operating guidelines, evaluate the effectiveness of the districts’ preparation efforts and submit a report presenting their findings to each District Director. We believe it would be beneficial for the four regional offices to also provide the review results to the National Office to identify possible trends that need corrective action.
Regional offices also conduct independent reviews of the effectiveness of the Walk-In Assistance Program in district offices during the filing season. We believe that the National Office needs the results of these reviews, too. For example, the regional reviews identified the previously mentioned inconsistencies in compiling wait-time measurements.
Recommendation
Management’s Response: Regions have been asked by IRS management to forward the results of district office reviews to the National Office. An analyst will be assigned the responsibility of reviewing the findings to identify national trends that need corrective action.
The Internal Revenue Service Has Not Developed Quality Measurements for the Tax Return Preparation Program to Comply With the New Balanced Measurements
During August 1999, the IRS issued the final regulation covering its adoption of a balanced system to measure organization and employee performance servicewide. The balanced measurement system the IRS has adopted includes the following three general types of measurement:
Customer Satisfaction - The IRS plans to survey a statistically valid sample of taxpayers and develop indices to measure progress in meeting satisfaction goals.
Employee Satisfaction - The IRS plans to anonymously survey employees to assess a wide variety of factors such as quality of supervision, adequacy of training, and support services that affect the work environment.
Business Results - The IRS plans to measure business results in two distinct categories of quality and quantity.
The IRS plans to implement most of the requirements of the new balanced measurements for the Walk-In Assistance Program. However, a formal quality review program to measure the accuracy of tax return preparation has not been developed. Although some districts review return preparation, the reviews are not done by a dedicated unit and the results are not statistically valid. As a result, the IRS does not get statistically valid feedback on the quality of return preparation and does not comply with the requirements of the balanced measurement regulation.
Recommendation
Management’s Response: Statistically valid quality reviews of tax returns prepared in Walk-In offices will be added to the set of balanced measures that have been developed for the Walk-In Assistance Program.
Overall, the IRS has an effective process for planning the services to be provided through the Walk-In Assistance Program. If properly implemented, taxpayers who visit IRS offices for assistance should receive quality customer service that is timely and accurate. Our concern is that current guidelines do not provide comprehensive instructions for measuring program results. Unless the recommendations in this report are implemented prior to the start of the 2000 filing season, the time that taxpayers have to wait for service may not be computed consistently, and delays in providing service may not be reported to the national level so that corrective actions can be taken. Also, the IRS will not meet the requirements of the Balanced Measurement Program unless a formal, statistically valid quality review of the return preparation program is developed and implemented.
Appendix I
Detailed Objective, Scope, and MethodologyOur overall objective was to determine whether the readiness process for the 2000 filing season will help ensure that taxpayers who walk into an Internal Revenue Service (IRS) office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish our objective, we performed the following audit tests:
Appendix II
Major Contributors to This ReportWalter E. Arrison, Associate Inspector General for Audit (Wage and Investment Income Programs)
Gary E. Lewis, Director
Stephen S. Root, Audit Manager
Linda L. Bryant, Senior Auditor
Tom J. Cypert, Senior Auditor
Susan A. Price, Senior Auditor
Charles O. Ekunwe, Auditor
Appendix III
Report Distribution ListDeputy Commissioner Operations C:DO
Chief Operations Officer OP
Assistant Commissioner (Customer Service) OP:C
Director, Office of Program Evaluation and Risk Analysis M:O
National Director, Education, Walk-In, and Correspondence Improvement OP:C:E
National Director for Legislative Affairs CL:LA
Office of Management Controls M:CFO:A:M
Audit Liaison for Assistant Commissioner (Customer Service) OP:C
Office of the Chief Counsel CC
Appendix IV
Management’s Response to the Draft ReportResponse has been removed due to its size. To see the complete Response, please go to the Adobe PDF version of this report on the TIGTA Public Web Page.