The Internal Revenue Service Needs to Strengthen Guidelines for Measuring the Quality and Timeliness of the Walk-In Assistance Program

April 2000

Reference Number: 2000-40-065

 

This report has cleared the Treasury Inspector General for Tax Administration disclosure review process and information determined to be restricted from public release has been redacted from this document.

April 25, 2000

 

MEMORANDUM FOR COMMISSIONER ROSSOTTI

 

FROM: Pamela J. Gardiner /s/ Pamela J. Gardiner

Deputy Inspector General for Audit

SUBJECT: Final Audit Report – The Internal Revenue Service Needs to Strengthen Guidelines for Measuring the Quality and Timeliness of the Walk-In Assistance Program

This report presents the results of our review of the Internal Revenue Service’s (IRS) readiness efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of this review was to determine whether the readiness process for the 2000 filing season will ensure that taxpayers who walk into an IRS office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.

In summary, we found that the IRS has an effective process for planning the Walk-In Assistance Program. If properly implemented, taxpayers who visit IRS offices for assistance during the 2000 filing season should receive quality customer service that is timely and accurate. Our concern is that current guidelines do not provide comprehensive instructions for measuring the quality and timeliness of service and evaluating program results. Accordingly, we recommended that the IRS:

IRS management agreed with our recommendations and has initiated corrective actions. Management’s comments have been incorporated into the report where appropriate, and the full text of their comments is included as an appendix.

Copies of this report are also being sent to the IRS managers who are affected by the report recommendations. Please contact me at (202) 622-6510 if you have questions, or your staff may call Walter E. Arrison, Associate Inspector General for Audit (Wage and Investment Income Programs), at (770) 455-2475.

Table of Contents

Executive Summary

Objective and Scope

Background

Results

The Internal Revenue Service Has Not Established Acceptability Standards to Evaluate the Time Taxpayers Wait for Walk-In Assistance

Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently

The National Office Does Not Adequately Monitor the Walk-In Assistance Program

The Internal Revenue Service Has Not Developed Quality Measurements for the Tax Return Preparation Program to Comply With the New Balanced Measurements

Conclusion

Appendix I – Detailed Objective, Scope, and Methodology

Appendix II – Major Contributors to This Report

Appendix III – Report Distribution List

Appendix IV – Management’s Response to the Draft Report

Executive Summary

The overall mission of the Internal Revenue Service (IRS) is to provide America’s taxpayers top quality service by helping them understand and meet their tax responsibilities and by applying the tax law with integrity and fairness to all. As part of this overall mission, the IRS wants to provide world-class customer service to taxpayers who visit IRS offices during the upcoming filing season. During the 1999 filing season, IRS employees assisted over six million taxpayers who came in to ask a question, get a tax form, or have their tax return prepared. In addition, numerous other taxpayers came in to get tax forms off the self-service racks.

This audit report presents our evaluation of the IRS’ readiness efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of this review was to determine whether the readiness process for the 2000 filing season will ensure that taxpayers who walk into an IRS office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.

Results

The IRS has a fundamentally sound approach to planning walk-in assistance for the 2000 filing season. The process covers: anticipating the number of taxpayers who will visit IRS offices and the services that they will need, staffing walk-in assistance with trained personnel, and setting up enough offices with the proper facilities to service taxpayers. However, the IRS needs to strengthen current guidelines for measuring the quality and timeliness of services provided by the Walk-In Assistance Program.

The Internal Revenue Service Has Not Established Acceptability Standards to Evaluate the Time Taxpayers Wait for Walk-In Assistance

Operating Guidelines for Fiscal Year 2000 have established wait-time goals for assisting individual taxpayers: 15 minutes for taxpayers who come into the office to ask a tax question or get a tax form and 30 minutes for taxpayers who need a return prepared. However, acceptability standards (the percentage of taxpayers to be serviced within the 15-minute and 30-minute goals) have not been set to identify offices that are not providing timely service or to measure the overall success of the Walk-In Assistance Program.

Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently

All taxpayers who visit IRS offices and need assistance getting forms should be included in the computation of wait-time. Some offices correctly include these taxpayers in their wait-time computations. However, numerous offices do not record the actual length of time these taxpayers wait in line. Instead, all taxpayers are counted as being served timely in the wait-time computation regardless of how long the taxpayers were in line.

The National Office Does Not Adequately Monitor the Walk-In Assistance Program

Because of limited resources, the IRS National Office does not adequately monitor the implementation of the Walk-In Assistance Program. However, regional offices conduct independent reviews of Walk-In Assistance Programs in district offices, both during the readiness process and the filing season. We believe it would be beneficial for the regional offices to furnish the National Office the results of their reviews to help identify and correct trends or potential problems.

The Internal Revenue Service Has Not Developed Quality Measurements for the Tax Return Preparation Program to Comply With the New Balanced Measurements

The IRS has adopted a system of balanced measures that includes three general types of measurements: customer satisfaction, employee satisfaction, and business results (quality and quantity). However, the current quality reviews of tax returns prepared by walk-in assistors are done on an ad hoc basis and do not meet the requirements of the recently issued balanced measurement regulation.

Summary of Recommendations

To improve the Walk-In Assistance Program readiness process for the 2000 filing season, we recommended that the IRS:

Management’s Response: IRS management agreed with our recommendations and has initiated corrective actions. Management’s complete response to the draft report is included as Appendix IV.

Objective and Scope

This report presents our evaluation of the Internal Revenue Service’s (IRS) efforts to prepare the Walk-In Assistance Program for the 2000 filing season. The overall objective of the audit was to determine whether the readiness process for the 2000 filing season will help ensure that taxpayers who come into an IRS office for assistance receive quality customer service and accurate, timely responses to their tax-related questions.

To accomplish this overall objective, we evaluated the processes for: anticipating the number of taxpayers who will visit IRS offices and the services they will need, staffing walk-in assistance with trained personnel, setting up enough offices with the proper facilities to service taxpayers, and measuring the quality and timeliness of services provided by the Walk-In Assistance Program.

The audit was conducted in the IRS National Office during August and September 1999, in accordance with Government Auditing Standards. We also contacted regional offices to secure information.

Details of our audit objective, scope, and methodology are presented in Appendix I. Major contributors to this report are listed in Appendix II.

Background

The overall mission of the IRS is to provide America’s taxpayers top quality service by helping them understand and meet their tax responsibilities and by applying the tax law with integrity and fairness to all. As part of this overall mission, the IRS wants to provide world-class customer service to taxpayers who use walk-in assistance during the upcoming filing season.

The IRS has recognized that some taxpayers prefer to visit IRS offices rather than take advantage of assistance provided over the internet or telephone. Over 400 offices are available nationwide for taxpayers to visit during the filing season. During the 1999 filing season, IRS employees assisted over six million taxpayers who came in to ask a question, get a tax form, or have their tax return prepared. In addition, numerous other taxpayers came in to get tax forms off the self-service racks.

The following key elements provide the foundation of the readiness planning process:

Internal Revenue Service Executive Steering Committee

The IRS Executive Steering Committee (ESC) is responsible for overseeing the implementation of service improvement projects, setting priorities, and ensuring consistency with the IRS business strategy. Senior IRS executives meet bimonthly to raise and resolve multifunctional issues impacting the filing season. For example, the ESC ensured that the IRS is preparing for the 2000 filing season by developing readiness check plans, addressing troublesome areas, and reporting on the IRS’ state of readiness. The last filing season was evaluated to identify pertinent issues for the upcoming year. These issues were incorporated into a Servicewide Action Plan used to monitor the readiness process.

Fiscal Year 2000 Walk-In Assistance Program Expectations

Yearly, the Assistant Commissioner (Customer Service) issues a program letter that contains guidance for the implementation of the Walk-In Assistance Program. The expectations for 2000 and beyond focus on delivering consistent, expeditious, accurate, and professional service. World-class customer service is the goal. The program letter contains several key initiatives which, if properly put in place, should result in an effective, customer-driven 2000 Walk-In Assistance Program.

Compliance and Customer Service Managers’ Handbook

The Internal Revenue Manual contains a formal readiness checklist for field offices to use to prepare the walk-in area for the filing season. The readiness checklist is comprehensive and covers: staffing, training, review of office procedures, cross-functional coordination, space and equipment needs, and the availability of reference materials.

Certification of Readiness Process

All functions and field offices were required to perform readiness reviews and certify, by December 15, 1999, that sites are prepared for the filing season.

Results

The IRS has a fundamentally sound approach to planning walk-in assistance for the 2000 filing season that covers: anticipating the number of taxpayers who will visit IRS offices and the services that they will need, staffing walk-in assistance with trained personnel, and setting up enough offices with the proper facilities to service taxpayers. However, the IRS needs to strengthen current guidelines for measuring the quality and timeliness of services provided by the Walk-In Assistance Program.

The Internal Revenue Service Has Not Established Acceptability Standards to Evaluate the Time Taxpayers Wait for Walk-In Assistance

Providing timely service to taxpayers who visit IRS offices for assistance is critical to a successful Walk-In Assistance Program. The IRS has established wait-time goals for assisting individual taxpayers: 15 minutes for taxpayers who come into the office to ask a tax question or get a tax form and 30 minutes for taxpayers who need a return prepared. However, acceptability standards (the percentage of taxpayers to be serviced within the 15-minute and 30-minute goals) have not been set to identify offices that are not providing timely service or to measure the overall success of the Walk-In Assistance Program.

The need for additional standards is shown in the statistics maintained for last year’s filing season. The IRS National Office requested that field offices gather information and compute the percentage of taxpayers who were not waited on within the 15-minute and 30-minute goals. Regions were to report monthly when goals were not being met. Our limited review of wait-time statistics showed that a high percentage of all taxpayers received timely service. However, the statistics also showed that taxpayers in some locations did not. Because there was no standard specifically stated for an acceptable level of service, the National Office did not receive any exception reports from the regions.

We believe that the lack of acceptable performance standards prevented the field from reporting actual wait-time results. Field offices need predetermined wait-time performance standards to ensure that problems are reported to the National Office. Without acceptability standards, the National Office may not identify or correct problems with field offices providing timely service to taxpayers.

Recommendation

  1. We recommend that the IRS expand current timeliness standards to include specific wait-time performance expectations and request field offices to report wait-time monthly.
  2. Management’s Response: IRS management is requiring field offices to send monthly wait-time reports to the National Office, and an analyst has been assigned to monitor wait-times.

    Internal Revenue Service Walk-In Assistance Offices Do Not Compute Wait-Time Consistently

    The timeliness of assistance is an important factor in the success of the Walk-In Assistance Program. Some offices are equipped with an automated Q-matic system to measure the length of time taxpayers have to wait for service. In other offices, employees have to manually record the wait-time on forms when taxpayers come into the office. Unfortunately, there are differences in the way offices compute wait-time for taxpayers who need assistance in getting a tax form.

    When taxpayers cannot find the form they are looking for in the self-service forms racks, they have to wait in a line to ask an IRS employee for assistance. In some offices, taxpayers who only need a form are sent to a separate line. In other offices, taxpayers who need forms get in the same line as taxpayers who have a question to be answered. In either case, the contact should be used to calculate the time a taxpayer has to wait for service.

    Our review of regional evaluations of walk-in assistance, and discussions with analysts who made the evaluations, showed inconsistencies in computing wait-time. Some offices correctly included taxpayers getting forms in their wait-time computations. However, numerous offices incorrectly applied the guidelines and did not record the actual length of time these taxpayers waited in line. Instead, all taxpayers were counted as being served timely in the wait-time computation, regardless of how long they were in line.

    It is important that all offices consistently report data because it is used for funding, resourcing, and program analysis purposes. That same information is also used to compute wait-time and evaluate whether offices are providing service to taxpayers within the 15-minute goal.

    Recommendation

  3. We recommend that the IRS clarify instructions for counting taxpayers who visit IRS offices for assistance with forms and for calculating the length of time they had to wait for service.
  4. Management’s Response: The requirement to accurately record wait-times has been reiterated by IRS management with field offices.

    The National Office Does Not Adequately Monitor the Walk-In Assistance Program

    The IRS National Office is primarily responsible for planning the Walk-In Assistance Program based on input from the field and new initiatives suggested by various sources such as the Congress and the IRS Commissioner. However, because of limited resources, the National Office does not adequately monitor the implementation of the Walk-In Assistance Program. We believe that there is a process currently in place that could provide the National Office with valuable information on the implementation of the Program with little or no additional expense.

    Every fall, district offices undertake a Certification of Readiness Process. District Directors are responsible for preparing their walk-in office sites to ensure that taxpayers receive quality, timely customer service during the filing season. The readiness process involves evaluating all aspects of what is needed to provide an effective Walk-In Assistance Program to the public. Considerations such as staffing levels, training, office space, equipment needs, and availability of reference materials should be addressed. At the conclusion of this readiness process, District Directors certify that district offices are prepared to offer quality customer service to taxpayers during the filing season.

    In addition to the districts’ efforts to prepare for the filing season, regional analysts from the four regional offices conduct independent reviews of districts around the country. These analysts, using the national operating guidelines, evaluate the effectiveness of the districts’ preparation efforts and submit a report presenting their findings to each District Director. We believe it would be beneficial for the four regional offices to also provide the review results to the National Office to identify possible trends that need corrective action.

    Regional offices also conduct independent reviews of the effectiveness of the Walk-In Assistance Program in district offices during the filing season. We believe that the National Office needs the results of these reviews, too. For example, the regional reviews identified the previously mentioned inconsistencies in compiling wait-time measurements.

    Recommendation

  5. We recommend that regional offices provide the National Office the results of their independent district office reviews, during both the readiness process to prepare for the filing season and the filing season.

Management’s Response: Regions have been asked by IRS management to forward the results of district office reviews to the National Office. An analyst will be assigned the responsibility of reviewing the findings to identify national trends that need corrective action.

The Internal Revenue Service Has Not Developed Quality Measurements for the Tax Return Preparation Program to Comply With the New Balanced Measurements

During August 1999, the IRS issued the final regulation covering its adoption of a balanced system to measure organization and employee performance servicewide. The balanced measurement system the IRS has adopted includes the following three general types of measurement:

Customer Satisfaction - The IRS plans to survey a statistically valid sample of taxpayers and develop indices to measure progress in meeting satisfaction goals.

Employee Satisfaction - The IRS plans to anonymously survey employees to assess a wide variety of factors such as quality of supervision, adequacy of training, and support services that affect the work environment.

Business Results - The IRS plans to measure business results in two distinct categories of quality and quantity.

The IRS plans to implement most of the requirements of the new balanced measurements for the Walk-In Assistance Program. However, a formal quality review program to measure the accuracy of tax return preparation has not been developed. Although some districts review return preparation, the reviews are not done by a dedicated unit and the results are not statistically valid. As a result, the IRS does not get statistically valid feedback on the quality of return preparation and does not comply with the requirements of the balanced measurement regulation.

Recommendation

  1. We recommend that the IRS develop a statistically valid quality review program that will measure the accuracy of tax returns prepared by the Walk-In Assistance Program and will meet the requirements of the new balanced measurement regulation.

Management’s Response: Statistically valid quality reviews of tax returns prepared in Walk-In offices will be added to the set of balanced measures that have been developed for the Walk-In Assistance Program.

Conclusion

Overall, the IRS has an effective process for planning the services to be provided through the Walk-In Assistance Program. If properly implemented, taxpayers who visit IRS offices for assistance should receive quality customer service that is timely and accurate. Our concern is that current guidelines do not provide comprehensive instructions for measuring program results. Unless the recommendations in this report are implemented prior to the start of the 2000 filing season, the time that taxpayers have to wait for service may not be computed consistently, and delays in providing service may not be reported to the national level so that corrective actions can be taken. Also, the IRS will not meet the requirements of the Balanced Measurement Program unless a formal, statistically valid quality review of the return preparation program is developed and implemented.

Appendix I

Detailed Objective, Scope, and Methodology

Our overall objective was to determine whether the readiness process for the 2000 filing season will help ensure that taxpayers who walk into an Internal Revenue Service (IRS) office receive quality customer service and accurate, timely responses to their tax-related questions. To accomplish our objective, we performed the following audit tests:

  1. Determined what procedures were in place to identify the needs of walk-in taxpayers and to anticipate the workload for the walk-in sites.
    1. Identified the concerns of taxpayers who visit walk-in sites and determined what steps were being taken to address those concerns by reviewing the results of the Fiscal Year (FY) 1999 Customer Service satisfaction exit surveys and interviewing Customer Service management.
    2. Determined how prior year experiences had been incorporated into planning for the FY 2000 filing season (Q-Matic results, the Walk-In Contact Card (Form 6148) and the Taxpayer Service Activity Report analyses (Form 5311), etc.). Evaluated how the 1999 filing season deficiencies were being addressed in the planning process.
    3. Determined whether studies that address providing assistance to non-English speaking walk-in taxpayers were considered in the FY 2000 planning process.
    4. Identified studies that addressed providing unique services to walk-in taxpayers (for example, assistors proficient in sign language for hearing impaired taxpayers, special services for elderly, etc.) and any other demographic studies that help profile the walk-in customer in order to provide the most appropriate service.
    5. Reviewed the FY 2000 Walk-In Assistance Program Letter to identify any additional initiatives relating to walk-in workload. Evaluated the IRS’ procedures for ensuring these goals were met. Determined whether the readiness process addressed workload needs.
  1. Determined what processes were in place to ensure walk-in areas will be adequately staffed, and that assistors will have been adequately trained for the FY 2000 filing season.
    1. Evaluated procedures for deciding how walk-in sites will be staffed for FY 2000.
    1. Determined how the IRS identified the number of employees needed for each site and how the allocation between permanent, seasonal, and detailed-in walk-in assistors was handled.
    2. Identified the procedures for determining how back-up assistors will be detailed into the walk-in area and whether staffing commitments had been obtained from the compliance areas.
    1. Evaluated the IRS’ procedures for ensuring all employees who will work as assistors during the filing season receive timely, relevant training.
    1. Determined procedures for ensuring all employees, including those who might be detailed into the walk-in area, have had training prior to the start of the filing season.
    2. Reviewed the Learning and Education Organization’s plans to ensure timely and complete training.
    3. Reviewed the procedures for making certain all employees working the walk-in area were aware of any changes to the tax laws for the filing season. Determined the process to ensure all resource/reference material was available to assistors.
    1. Reviewed the FY 2000 Walk-In Operating Guidelines to identify any other initiatives relating to walk-in staffing and training. Evaluated the IRS’ procedures for ensuring these goals were met. Determined whether the readiness process addressed staffing and training needs.
  1. Determined whether Customer Service had taken steps to ensure that adequate facilities will be available for walk-in taxpayers during the year 2000 filing season.
    1. Interviewed appropriate officials in Customer Service to determine the current status of the IRS’ readiness process (facilities) for the year 2000 filing season. Verified that basic facility requirements of a customer-driven Walk-In Assistance Program were being addressed in the readiness process—adequate space, signs, number of office locations and hours, availability of forms (including CD ROM), sufficient publicity, taxpayer privacy concerns, etc.
    2. Determined what procedures were used to identify the optimal office hours for weekday and weekend walk-in assistance during the filing season by interviewing management and obtaining copies of any studies done around this area.
    3. Reviewed the Year 2000 Filing Season Readiness Executive Steering Committee Action Plan and determined the current status of initiatives related to the availability of walk-in facilities.
    4. Assessed whether the readiness process will ensure that walk-in initiatives in the action plan will be implemented during the 2000 filing season.
    5. Analyzed the FY 2000 Walk-In Operating Guidelines and determined the current status of walk-in initiatives.
    6. Assessed whether the readiness process will ensure that walk-in initiatives in the Program Letter will be implemented during the 2000 filing season.
    7. Determined whether the readiness process will ensure that adequate electronic filing (E-File) software and equipment will be delivered to walk-in sites timely to enable assistors to be trained prior to the beginning of the filing season.
  1. Determined whether Customer Service has taken sufficient actions to implement an effective measurement system for the Walk-In Assistance Program during the 2000 filing season.
    1. Interviewed appropriate officials in Customer Service to learn the current status of the development of a measurement system for the Walk-In Assistance Program.
    2. Verified that Customer Service had designed performance indicators in the Walk-In Assistance Program that will measure the three major areas of the new balanced measurement system—business results (including quantity and quality), customer satisfaction, and employee satisfaction.

Appendix II

Major Contributors to This Report

Walter E. Arrison, Associate Inspector General for Audit (Wage and Investment Income Programs)

Gary E. Lewis, Director

Stephen S. Root, Audit Manager

Linda L. Bryant, Senior Auditor

Tom J. Cypert, Senior Auditor

Susan A. Price, Senior Auditor

Charles O. Ekunwe, Auditor

Appendix III

Report Distribution List

Deputy Commissioner Operations C:DO

Chief Operations Officer OP

Assistant Commissioner (Customer Service) OP:C

Director, Office of Program Evaluation and Risk Analysis M:O

National Director, Education, Walk-In, and Correspondence Improvement OP:C:E

National Director for Legislative Affairs CL:LA

Office of Management Controls M:CFO:A:M

Audit Liaison for Assistant Commissioner (Customer Service) OP:C

Office of the Chief Counsel CC

Appendix IV

Management’s Response to the Draft Report

Response has been removed due to its size. To see the complete Response, please go to the Adobe PDF version of this report on the TIGTA Public Web Page.