Difference between revisions of "236.12 Quality Assurance Reviews"

From Engineering_Policy_Guide
Jump to navigation Jump to search
m (Per RW, updated RW link)
(updated per RR3687)
 
(4 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{|style="padding: 0.3em; margin-left:15px; border: 1px solid #cccccc; text-align:center; font-size: 95%; background:#f5f5f5" width="160px" align="right"
+
<div style="float: right; margin-right:0px; width:275px; background-color: #f5f5f5; padding: 0.3em; border: 1px solid #cccccc; text-align:left;">
|- 
+
'''<u><center>Forms</center></u>'''
|'''Forms'''
+
*[https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx Quality Assurance Review Report]
|-
+
</div>
|[http://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx Quality Assurance Review Report - Front Page]
 
|}
 
 
 
  
 
===236.12.1 Introduction===
 
===236.12.1 Introduction===
Line 15: Line 12:
 
====236.12.2.1 Authority====
 
====236.12.2.1 Authority====
  
Each June, the Asst. to the State Design Engineer - Right of Way will approve the annual Quality Assurance Plan for the following fiscal year. Consideration should be given to scheduling these routine reviews so that over a four-year period all districts are reviewed in at least one functional area. Districts scheduled for review are to be advised well in advance of the review date to ensure appropriate personnel are available.
+
The Asst. to the State Design Engineer - Right of Way will approve the Quality Assurance Review (QAR) plan. Consideration should be given to scheduling these routine reviews so all districts are reviewed in at least one functional area. Districts scheduled for review are to be advised in advance of the review.
  
The Asst. to the State Design Engineer - Right of Way may substitute a Quality Assurance Review (QAR) with comparable reviews similar to the following:
+
The Asst. to the State Design Engineer - Right of Way may substitute a QAR with comparable reviews similar to the following:
 
:*Joint Process Review,
 
:*Joint Process Review,
 
:*Peer Review,
 
:*Peer Review,
Line 27: Line 24:
 
====236.12.2.2 QAR Administration====
 
====236.12.2.2 QAR Administration====
  
The QAR Team is lead by a designated field liaison officer (FLO) within the [https://spexternal.modot.mo.gov/sites/de/SitePages/CO%20RW%20Staff.aspx Right of Way Section] Office. The FLO will coordinate the QAR and be responsible for identifying Division/District participants and ensure completion in a timely manner.
+
The QAR team is led by a designated right of way liaison within the right of way section of Design Division. The QAR team will coordinate the QAR and be responsible for identifying division/district participants and ensure completion in a timely manner.
  
The FLO has the overall responsibility for selection, training and supervising QAR Teams and shall coordinate the following:
+
The QAR team lead has the overall responsibility for selection, training and supervising the QAR team and shall coordinate the following:
:*Yearly QAR Plan;
+
:*[https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Scope.docx Scope];
 
:*Schedule;
 
:*Schedule;
 
:*Sampling;
 
:*Sampling;
:*Exit Interview; and
+
:*Recommendation Reviews; and
:*Report
+
:*[https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx Report]
  
The FLO will also be responsible for ensuring the QAR recommendations are monitored for implementation.
+
The QAR team will also be responsible for ensuring the QAR recommendations are monitored for implementation.
  
===236.12.3 Quality Assurance Review Process===
+
===236.12.3 QAR Process===
  
 
====236.12.3.1 Purpose====
 
====236.12.3.1 Purpose====
  
To develop policies and methods of continuously evaluating the quality of all right of way functions statewide through a quality assurance process.
+
To develop policies and methods of continuously evaluating the quality of all right of way functions statewide through a quality assurance process. Also, to develop best practices as processes are reviewed and constantly improved.
  
 
====236.12.3.2 Background====
 
====236.12.3.2 Background====
  
This article contains the regulations, requirements, and procedural directives governing the operation of the Right of Way Section.
+
This article contains the regulations, requirements, and procedural directives governing the operation of the right of way section.
  
Federal regulations governing right of way acquisition are found in [https://www.fhwa.dot.gov/legsregs/directives/cfr23toc.htm 23 CFR] (Code of Federal Regulations) and [https://www.ecfr.gov/cgi-bin/text-idx?c=ecfr&sid=3bdda26e1102fe42dd21611091c4a569&rgn=div5&view=text&node=49:1.0.1.1.18&idno=49 49 CFR Part 24]. Compliance with these regulations are required if federal funds are to be used in any part of a project. The policies and procedures outlined in the above-mentioned manual are written to include all the federal requirements.
+
Federal regulations governing right of way acquisition are found in [https://www.fhwa.dot.gov/legsregs/directives/cfr23toc.htm 23 CFR] (Code of Federal Regulations) and [https://www.ecfr.gov/current/title-49/subtitle-A/part-24 49 CFR Part 24] and [https://www.sos.mo.gov/adrules/csr/current/7csr/7csr 7 CSR] (Code of State Regulations) Chapter 4 10-4.010-.020. Compliance with these regulations are required for every MoDOT project. The policies and procedures outlined in the above-mentioned manual are written to include all state and federal requirements.
  
 
====236.12.3.3 Definitions====
 
====236.12.3.3 Definitions====
  
'''Critical Requirement''':  A measurable activity in a departmental process that indicates whether or not the process is being properly carried out and if the quality of the product is being controlled. A critical requirement could reveal significant problems or indicate beneficial results for the department.
+
'''Critical Requirement''':  A measurable activity in a departmental process that indicates whether or not the process is being properly carried out and if the quality of the product is being controlled. A critical requirement could reveal significant problems or indicate beneficial results for the department.
  
 
'''Critical Problem Area''':  An area where critical requirements indicate a process is not in compliance with predetermined criteria.
 
'''Critical Problem Area''':  An area where critical requirements indicate a process is not in compliance with predetermined criteria.
Line 58: Line 55:
 
'''Outstanding Quality Area''':  An area of unique superior performance due to magnitude of effort or innovation in concept or application.
 
'''Outstanding Quality Area''':  An area of unique superior performance due to magnitude of effort or innovation in concept or application.
  
'''Quality Assurance''':  Conformance to predetermined criteria. Quality Assurance refers primarily to process requirements in this procedure.
+
'''Quality Assurance''':  Conformance to predetermined criteria. Quality assurance refers primarily to process requirements in this procedure.
  
'''Quality Assurance Database''':  A central data source for the various data elements of the division's records management programs.  Pertinent data is recorded for the purpose of planning, performing and tracking of quality assurance reviews.  
+
'''Quality Assurance Monitoring Plan''':  A monitoring plan based on critical requirements prepared by the right of way quality assurance administrative team leader to outline the criteria, frequency and methods for conducting QARs.
  
'''Quality Assurance Monitoring Plan''':  A monitoring plan based on critical requirements prepared by the Right of Way Quality Assurance Administrative Team Leader to outline the criteria, frequency and methods for conducting Quality Assurance Reviews.
+
'''Quality Assurance Guidelines''':  Step by step guideline for conducting QARs.
  
'''Quality Assurance Guidelines''': Step by step guideline for conducting Quality Assurance Reviews.
+
[https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx '''QAR Report''']:  The written report of the results of a Quality Assurance Review.
 
 
[[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|'''Quality Assurance Review Report''']]:  The written report of the results of a Quality Assurance Review.
 
  
 
'''Recommendations''':  Significant issues/items that require action.
 
'''Recommendations''':  Significant issues/items that require action.
Line 74: Line 69:
 
====236.12.3.4 Procedure====
 
====236.12.3.4 Procedure====
  
The Asst. to the State Design Engineer - Right of Way will designate a Quality Assurance Administrative Team lead by a field liaison officer who will establish and direct Quality Assurance Reviews of all districts and certain division office units, which implement the Missouri Department of Transportation’s Right of Way Program.
+
The Asst. to the State Design Engineer - Right of Way will designate a quality assurance administrative team lead by a right of way liaison who will establish and direct QARs of all districts and certain division office units, which implement the MoDOT’s right of way program.
 
 
The Right of Way Section through the Quality Assurance Administrative Team Leader will establish and maintain complete, current and usable directives, and respective guidelines.
 
  
The Quality Assurance Administrative Team Leader will establish and maintain current Review Plans based on critical requirements identified in each functional area or process.
+
The right of way section through the quality assurance administrative team leader will establish and maintain complete, current and usable directives, and respective guidelines.
  
The Quality Assurance Administrative Team Leader will develop and provide the Asst. to the State Design Engineer - Right of Way a fiscal year schedule of planned Quality Assurance Reviews by June 1, of each preceding year, and revise as changes occur.
+
The quality assurance administrative team leader will establish and maintain current review plans based on critical requirements identified in each functional area or process.
  
The Quality Assurance Administrative Team Leader will select Quality Assurance Review Teams of not more than four (4) people, each with expertise in the respective QAR. Members shall not monitor their own district.   One person per district per team will be permitted to assist.  Team members are to be selected in June from the appropriate right of way personnel including the FHWA Realty Officer.
+
The quality assurance administrative team leader will select QAR team members, each with expertise in the respective QAR. Members shall not monitor their own district. Team members are to be selected from the appropriate right of way personnel including the FHWA realty officer.
  
District and Division Office participants in Quality Assurance Reviews will identify for the Quality Assurance Administrative Team, possible need for training; improvements to procedures, guidelines; and problems or innovations of statewide significance.
+
District and division participants in QARs will identify for the quality assurance administrative team, possible need for training; improvements to procedures, guidelines; and problems or innovations of statewide significance.
  
The Quality Assurance Administrative Team will report the final results of Quality Assurance Review to the Asst. to the State Design Engineer - Right of Way.
+
The quality assurance administrative team will report the final results of QAR to the Asst. to the State Design Engineer - Right of Way.
  
The Right of Way Section will evaluate the Quality Assurance results, make improvements to procedures and processes, conduct appropriate training, circulate to all districts applicable outstanding results, record the summary of the results and responses to each review and track problem areas until they are corrected or resolved.
+
The right of way section will evaluate the quality assurance results, make improvements to procedures and processes, conduct appropriate training, circulate to all districts applicable outstanding results, record the summary of the results and responses to each review and track problem areas until they are corrected or resolved.
  
===236.12.4 Quality Assurance Review Plan===
+
===236.12.4 QAR Plan===
  
====236.12.4.1 Quality Assurance Review Plan====
+
====236.12.4.1 QAR Plan====
  
This document establishes the minimum standard for Right of Way Section’s Quality Assurance Review Plan on a fiscal year basis.
+
This document establishes the minimum standard for right of way section’s QAR plan.
  
 
====236.12.4.2 Schedule====
 
====236.12.4.2 Schedule====
  
A schedule will show the dates of review by the Quality Assurance Review Teams for the upcoming fiscal year.
+
A schedule will show the dates of review by the QAR team.
  
 
====236.12.4.3 Notice====
 
====236.12.4.3 Notice====
  
Two weeks prior to the review, a notice shall be sent to the right of way manager to ensure that all parties are aware of the review. This notice will contain the following:
+
Prior to the review, a notice shall be sent to the district right of way managers to ensure that all parties are aware of the review. This notice will contain the following:
 
+
:*Identify team members.
:*Identify team members
+
:*The anticipated dates the reviews will begin and be completed.
:*The anticipated arrival and departure times and dates
+
:*The functional areas that will be reviewed.
:*The functional areas that will be reviewed
+
:*The desired date for scheduling of the recommendation reviews.
:*The desired time for scheduling of the exit interview
 
  
 
====236.12.4.4 Reviews====
 
====236.12.4.4 Reviews====
  
The purpose of each review is to determine compliance with right of way processes and procedures in each of the functional areas being reviewed.  At the discretion of the reviewer, the review may include onsite inspection of the subject projects, review of files and/or interviews.  If interviews are desired, they will be coordinated with the supervisor.
+
The purpose of each review is to determine compliance with right of way processes and procedures in each of the functional areas being reviewed.  
  
Each review will be conducted in accordance with the approved source documents. Compliance with the functional area will be determined by examination of each. It will be the responsibility of the FLO Team Leader to ensure that the scope of the review is sufficient to support a determination regarding compliance or noncompliance with the functional areas being reviewed.
+
Each review will be conducted in accordance with the approved source documents. Compliance with the functional area will be determined by examination of each. It will be the responsibility of the right of way liaison to ensure that the scope of the review is sufficient to support a determination regarding compliance or noncompliance with the functional areas being reviewed.
  
====236.12.4.5 Exit Interviews====
+
====236.12.4.5 Recommendation Reviews====
  
An exit interview will be held at the conclusion of each review. The right of way manager will be requested to attend along with any other supervisory personnel responsible for the functional area being reviewed. The review team will advise the district/division office of factual findings of the review. '''No conclusions regarding compliance or recommendations for corrective action will be provided at this interview'''.
+
Recommendation reviews will be held at the conclusion of each review. The right of way manager will be requested to attend along with any other supervisory personnel responsible for the functional area being reviewed. The review team will advise the district/division office of factual findings of the review. <b>No conclusions regarding compliance or recommendations for corrective action will be provided at this interview</b>.
  
Each exit interview will include a discussion of current procedures. The right of way manager will be provided an opportunity to discuss the procedures and make recommendations for changes. A discussion of these recommendations and the actions taken will be included in the [[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|Quality Assurance Review Report]].
+
Each recommendation review will include a discussion of current procedures. The right of way manager will be provided an opportunity to discuss the procedures and make recommendations for changes. A discussion of these recommendations and the actions taken will be included in the       [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Report].
  
 
====236.12.4.6 Reports====
 
====236.12.4.6 Reports====
  
Within fifteen (15) working days of completion of the review, a written draft report will be provided to the right of way manager. The format of this report will be in accordance with the format adopted for all [[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|Quality Assurance Review Reports]]. The district will be permitted fifteen (15) working days within which to comment regarding the accuracy of the factual data in the draft report. It is not expected that the district will fully respond to the conclusions or the recommendations as reflected in the draft report.
+
Within fifteen (15) working days of completion of the review, a written draft report will be provided to the district right of way manager. The format of this report will be in accordance with the format adopted for all [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Reports]. The district will be permitted fifteen (15) working days within which to comment regarding the accuracy of the factual data in the draft report. It is not expected that the district will fully respond to the conclusions or the recommendations as reflected in the draft report.
  
A final report will be completed within fifteen (15) working days of receipt of the comments or expiration of the review period. Extensions to the review period may be granted at the discretion of the Asst. to the State Design Engineer - Right of Way, upon request from the district.
+
A final report will be completed within fifteen (15) working days of receipt of the comments or expiration of the review period. Extensions to the review period may be granted at the discretion of the Asst. to the State Design Engineer - Right of Way, upon request from the district.
  
The final report will be provided to the Asst. to the State Design Engineer - Right of Way, District and FHWA and the findings and recommendations will be retained in the division office. A review period of thirty (30) days will be allowed for response to the findings and recommendations within the report. It is the responsibility of the QAR Administrative Team leader to ensure that appropriate responses are obtained to each recommendation contained in the report. The agreed upon responses are to be filed with the report.
+
The final report will be provided to the Asst. to the State Design Engineer - Right of Way, district and FHWA and the findings and recommendations will be retained in the division office. A review period of thirty (30) days will be allowed for response to the findings and recommendations within the report. It is the responsibility of the QAR administrative team leader to ensure that appropriate responses are obtained to each recommendation contained in the report. The agreed upon responses are to be filed with the report.
  
===236.12.5 Quality Assurance Review Guideline===
+
===236.12.5 QAR Guideline===
  
 
====236.12.5.1 Plan====
 
====236.12.5.1 Plan====
  
'''Schedule Annual QARs'''
+
'''Schedule QARs'''
 
 
Prior to June of each year, coordinate with appropriate units and develop a fiscal year schedule for reviews.  Revise as necessary.
 
 
 
'''Schedule QARs Visit'''
 
 
 
Check current QA schedule, avoiding overlapping reviews or overloading, and adjust if necessary.
 
  
Combine QARs into one visit if possible.
+
Each year, coordinate with appropriate units and develop a schedule for reviews.  Avoiding overlapping reviews or overloading, and adjust if necessary.
  
 
'''QAR Team'''
 
'''QAR Team'''
  
Assign the most knowledgeable staff from the QAR Team Selection Pool.
+
Assign the most knowledgeable staff.
  
 
Team members conducting the review should adequately prepare prior to the execution of the review.
 
Team members conducting the review should adequately prepare prior to the execution of the review.
Line 151: Line 137:
 
'''Review Past QARs'''
 
'''Review Past QARs'''
  
Review reports from management, Audits and Investigations, Federal Highway Administration (FHWA) and others.
+
Review reports from management, Audits and Investigations, FHWA and others.
  
Identify unresolved areas of noncompliance and areas marked for improvement
+
Identify unresolved areas of noncompliance and areas marked for improvement.
  
 
'''Plan QAR Content'''
 
'''Plan QAR Content'''
Line 163: Line 149:
 
====236.12.5.2 Conduct====
 
====236.12.5.2 Conduct====
  
Notify district/division office Of QAR Content
+
Notify district/division office of QAR Content.
  
Two weeks prior to QAR, notify districts/division office of all areas to be covered.
+
Prior to the QAR, notify districts/division office of all areas to be covered.
  
 
'''Conduct Review'''
 
'''Conduct Review'''
Line 177: Line 163:
 
:*Procedures for obtaining files and copies.
 
:*Procedures for obtaining files and copies.
 
:*District contact person for assistance.
 
:*District contact person for assistance.
 
Seek information that may not be contained in the file.
 
  
 
Look for positive areas as well as noncompliance.
 
Look for positive areas as well as noncompliance.
  
Base the QAR on critical requirements and unresolved issues from earlier visits.
+
Base the QAR on critical requirements and unresolved issues from prior QARs.
  
 
Verify that previous corrective action is effective.
 
Verify that previous corrective action is effective.
Line 188: Line 172:
 
When the critical requirements indicate a problem exists, follow up and verify the problem and its magnitude.
 
When the critical requirements indicate a problem exists, follow up and verify the problem and its magnitude.
  
Review parallel issues identified in audits performed by Audits and Investigations (AI), by the Federal Highway Administration (FHWA) and other performance reports.
+
Review parallel issues identified in audits performed by Audits and Investigations, by the FHWA and other performance reports.
  
 
Talk with district/division office staff.
 
Talk with district/division office staff.
Line 194: Line 178:
 
Take complete notes of specifics and impressions.
 
Take complete notes of specifics and impressions.
  
Prepare for Exit Interview(s). QAR team leader and team members should review and analyze information; organize presentation.
+
Prepare for recommendation reviews. QAR team leader and team members should review and analyze information; organize presentation.
  
====236.12.5.3 Conduct Exit Interview with District/Division Office Staff====
+
====236.12.5.3 Conduct Recommendation Review with District/Division Office Staff====
  
 
Arrange a meeting for all participants.
 
Arrange a meeting for all participants.
  
Prepare a list of general impressions; cite specifics only when necessary to illustrate the magnitude of the praise or issue.  Avoid detail.
+
Prepare a list of general impressions; cite specifics only when necessary to illustrate the magnitude of the praise or issue.  
  
 
Clearly state urgent or high impact issues.
 
Clearly state urgent or high impact issues.
Line 208: Line 192:
 
Agree on appropriate items for district and division office action.
 
Agree on appropriate items for district and division office action.
  
Take notes to help with development of the written [[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|QAR Report]].
+
Take notes to help with development of the written [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Report].
  
 
Include general items (impressions, findings that indicate lack of quality control or attention to detail).
 
Include general items (impressions, findings that indicate lack of quality control or attention to detail).
Line 214: Line 198:
 
If an issue can be immediately corrected, report the corrective action rather than a negative finding.
 
If an issue can be immediately corrected, report the corrective action rather than a negative finding.
  
Discuss all issues you expect to include in the [[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|QAR Report]].
+
Discuss all issues you expect to include in the [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Report].
  
Ask district/division office staff for specific recommendations to improve procedures, meeting requirements, training, and statewide problems. Identify areas that are inefficient or that adversely impact other areas.
+
Ask district/division office staff for specific recommendations to improve procedures, meeting requirements, training, and statewide problems. Identify areas that are inefficient or that adversely impact other areas.
  
Emphasize steps that will follow the visit. For example, clarification or additional information may be requested during report preparation.
+
Emphasize steps that will follow the review. For example, clarification or additional information may be requested during report preparation.
  
====236.12.5.4 Prepare [[236.12_Quality_Assurance_Reviews#236.12.6 Quality Assurance Review Report|QAR Report]]====
+
====236.12.5.4 Prepare [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Report]====
  
Prepare draft report and send to the district/division office within 15 working days. '''Content of the report should reflect what was discussed at exit interview'''.
+
Prepare draft report and send to the district/division office. '''Content of the report should reflect what was discussed at the recommendation review'''.
  
 
Address action items in report.
 
Address action items in report.
Line 228: Line 212:
 
Work to resolve disagreements regarding report contents.
 
Work to resolve disagreements regarding report contents.
  
Contact the district/division office if a response is not received within 15 working days after receipt of draft report.
+
Contact the district/division office if a response is not received within fifteen (15) working days after receipt of draft report.
 
 
Prepare final report and send to district/division office within 15 working days after receipt of comments to the draft report.
 
  
Recommend issues to be included in the Quality Assurance database.
+
Prepare final report and send to district/division office within fifteen (15) working days after receipt of comments to the draft report.
  
 
Share outstanding methods or issues without identifying the source of the issue.
 
Share outstanding methods or issues without identifying the source of the issue.
Line 238: Line 220:
 
====236.12.5.5 Track Critical Issues until Remedied or Resolved====
 
====236.12.5.5 Track Critical Issues until Remedied or Resolved====
  
Track the corrective action and/or make a follow up visit. Disagreements with report recommendations are resolved through upper management. The Asst. to the State Design Engineer - Right of Way is the final arbiter.
+
Track the corrective action and/or make a follow-up visit. Disagreements with report recommendations are resolved through upper management. The Asst. to the State Design Engineer - Right of Way is the final arbiter.
 
 
Upon satisfactory resolution, update the QA database to reflect the disposition.
 
 
 
====236.12.5.6 Act====
 
 
 
'''To Continually Improve'''
 
 
 
Solve problems.  Form task teams to solve difficult problems.
 
 
 
Provide specific technical information needed or requested.
 
 
 
Begin writing, revising or combining procedures or guidelines if necessary.  Division Office should quickly remedy procedure/guideline problems identified in the QAR Report.
 
 
 
Identify problems, which can be resolved by source documents (forms, checklist, etc.), office or management systems, training, workshops or other means.
 
 
 
As appropriate, compile a general summary of outstanding methods and issue areas.  Share this summary with right of way personnel and others as determined by the Asst. to the State Design Engineer - Right of Way.
 
 
 
Periodically review the QAR Plan.  Change the frequency and content of QARs as necessary to focus on continuing problems or new areas.
 
  
===236.12.6 [http://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx Quality Assurance Review Report]===
+
===236.12.6 [https://epg.modot.org/forms/RW/Chapter%2012_Quality%20Assurance/Quality%20Assurance%20Review%20Report.docx QAR Report]===
  
 
====236.12.6.1 Purpose And Scope Of Review====
 
====236.12.6.1 Purpose And Scope Of Review====
  
This report summarizes the results of the quality assurance review conducted in the district. The review was done to assess process performance relating to critical functions such as:
+
This report summarizes the results of the QAR conducted. The review was done to assess process performance relating to critical functions such as:
 
 
 
:*Administration  
 
:*Administration  
 
 
:*Appraisal   
 
:*Appraisal   
 
 
:*Negotiations  
 
:*Negotiations  
 
 
:*Realty Asset
 
:*Realty Asset
 
 
:*Relocation
 
:*Relocation
 +
:*Right of Way Parcel Acquisition (RWPA) and Realty Asset Inventory (RAI) with in the Transportation Management System (TMS).
  
 
Identify those areas in which there may be a need for closer adherence to existing process standards or indications that the existing process standards warrant modification.
 
Identify those areas in which there may be a need for closer adherence to existing process standards or indications that the existing process standards warrant modification.
  
Identify good ideas that may be shared with other districts to the benefit of the overall right of way program.
+
Identify best practices that may be shared with other districts to the benefit of the overall right of way program.
  
 
====236.12.6.2 QAR Team Members====
 
====236.12.6.2 QAR Team Members====
Line 284: Line 244:
 
====236.12.6.3 Background====
 
====236.12.6.3 Background====
  
[https://www.fhwa.dot.gov/legsregs/directives/cfr23toc.htm Titles 23] and [https://www.fhwa.dot.gov/legsregs/directives/cfr49toc.htm 49 of the Code of Federal Regulations] broadly mandate the state's responsibilities for compliance with the provisions of the Uniform Relocation Assistance and Real Property Acquisition Regulations for Federal and Federally Assisted Programs. To assure proper recognition of, and adherence to, those regulations, the Missouri Highways and Transportation Department has developed, with the approval of the Federal Highway Administration, procedures covering all aspects of right of way acquisition, management, and disposition. These procedures provide the basis for the periodic quality assurance review of all current processes.
+
[https://www.fhwa.dot.gov/legsregs/directives/cfr23toc.htm Titles 23] and [https://www.ecfr.gov/current/title-49/subtitle-A/part-24 49 of the Code of Federal Regulations] and [https://www.sos.mo.gov/adrules/csr/current/7csr/7csr 7 CSR (Code of State Regulations) Chapter 4 10-4.010-.020] broadly mandate the state's responsibilities for compliance with the provisions of the Uniform Relocation Assistance and Real Property Acquisition Regulations, Federally Assisted Programs. To assure proper recognition of, and adherence to, those regulations, MoDOT has developed, with the approval of the FHWA, procedures covering all aspects of right of way acquisition, management, and disposition. These procedures provide the basis for the periodic QAR of all current processes.
  
Provide the date of the Last Review.
+
Provide the date of the last review.
  
Follow-up of recommendations from previous reviews:
+
Follow-up of recommendations from previous reviews.
  
 
====236.12.6.4 Methodology and Findings====
 
====236.12.6.4 Methodology and Findings====
Line 294: Line 254:
 
'''Sampling Technique'''
 
'''Sampling Technique'''
  
A letter notifies all right of way managers of the scheduled reviews. This letter identifies the critical functions that are to be reviewed, the calendar period that would be covered, and the dates and specific time schedules for the district office review team visits.
+
A letter notifies all right of way managers of the scheduled reviews. This letter identifies the critical functions that are to be reviewed, the calendar period that would be covered, and the dates the review will be conducted.  
  
In the schedule, the Administration, Appraisal, and Negotiation files have been reviewed in the Division Office prior to the district team visits.  The Realty Asset and Relocation files are being reviewed in the district and all functions are then discussed during the district office exit interview.
+
In the schedule, the administration, appraisal, negotiation, realty asset, relocation, RWPA and RAI files have been reviewed and all functions are then discussed during the recommendation review.
  
 
'''Sample Reviewed and Findings'''
 
'''Sample Reviewed and Findings'''
  
Samples may be reviewed from any or all of the following categories: Administration, Appraisals, Negotiations, Realty Assets, and Relocation. The files reviewed for each category shall be documented.
+
Samples may be reviewed from any or all of the following categories: administration, appraisals, negotiations, realty assets, relocation, RWPA and RAI. The files reviewed for each category shall be documented.
  
 
Note the following information for the files that were reviewed:
 
Note the following information for the files that were reviewed:
 
 
:*Project No.
 
:*Project No.
 
:*Route
 
:*Route
Line 310: Line 269:
 
:*Findings
 
:*Findings
  
'''Exit Interview'''
+
'''Recommendation Review'''
  
At the conclusion of the Review a brief exit interview is conducted.
+
At the conclusion of the review a brief recommendation review is conducted.
  
 
Note the following items in the report:
 
Note the following items in the report:
:*Names of district personnel who were present
+
:*Names of district personnel who were present;
:*Who conducted the interview?
+
:*Who conducted the interview;
:*A discussion of positive/negative findings in the report.
+
:*A discussion of positive/negative findings in the report;
:*Exit interview responses.
+
:*Recommendation review responses; and
 
:*Follow-up on previous recommendations.
 
:*Follow-up on previous recommendations.
  

Latest revision as of 08:37, 18 October 2023

Forms

236.12.1 Introduction

The Central Office right of way staff members coordinate periodic reviews of district office operating procedures to promote and ensure quality assurance of the acquisition process, realty asset activities and compliance with The Uniform Act.

236.12.2 Organization and Job Functions

236.12.2.1 Authority

The Asst. to the State Design Engineer - Right of Way will approve the Quality Assurance Review (QAR) plan. Consideration should be given to scheduling these routine reviews so all districts are reviewed in at least one functional area. Districts scheduled for review are to be advised in advance of the review.

The Asst. to the State Design Engineer - Right of Way may substitute a QAR with comparable reviews similar to the following:

  • Joint Process Review,
  • Peer Review,
  • Internal Audit or
  • External Audit.

If comparable reviews are conducted, the Asst. to the State Design Engineer - Right of Way may waive a QAR at their discretion.

236.12.2.2 QAR Administration

The QAR team is led by a designated right of way liaison within the right of way section of Design Division. The QAR team will coordinate the QAR and be responsible for identifying division/district participants and ensure completion in a timely manner.

The QAR team lead has the overall responsibility for selection, training and supervising the QAR team and shall coordinate the following:

  • Scope;
  • Schedule;
  • Sampling;
  • Recommendation Reviews; and
  • Report

The QAR team will also be responsible for ensuring the QAR recommendations are monitored for implementation.

236.12.3 QAR Process

236.12.3.1 Purpose

To develop policies and methods of continuously evaluating the quality of all right of way functions statewide through a quality assurance process. Also, to develop best practices as processes are reviewed and constantly improved.

236.12.3.2 Background

This article contains the regulations, requirements, and procedural directives governing the operation of the right of way section.

Federal regulations governing right of way acquisition are found in 23 CFR (Code of Federal Regulations) and 49 CFR Part 24 and 7 CSR (Code of State Regulations) Chapter 4 10-4.010-.020. Compliance with these regulations are required for every MoDOT project. The policies and procedures outlined in the above-mentioned manual are written to include all state and federal requirements.

236.12.3.3 Definitions

Critical Requirement: A measurable activity in a departmental process that indicates whether or not the process is being properly carried out and if the quality of the product is being controlled. A critical requirement could reveal significant problems or indicate beneficial results for the department.

Critical Problem Area: An area where critical requirements indicate a process is not in compliance with predetermined criteria.

Outstanding Quality Area: An area of unique superior performance due to magnitude of effort or innovation in concept or application.

Quality Assurance: Conformance to predetermined criteria. Quality assurance refers primarily to process requirements in this procedure.

Quality Assurance Monitoring Plan: A monitoring plan based on critical requirements prepared by the right of way quality assurance administrative team leader to outline the criteria, frequency and methods for conducting QARs.

Quality Assurance Guidelines: Step by step guideline for conducting QARs.

QAR Report: The written report of the results of a Quality Assurance Review.

Recommendations: Significant issues/items that require action.

Source Documents: Document in which data collected for a QAR is first recorded.

236.12.3.4 Procedure

The Asst. to the State Design Engineer - Right of Way will designate a quality assurance administrative team lead by a right of way liaison who will establish and direct QARs of all districts and certain division office units, which implement the MoDOT’s right of way program.

The right of way section through the quality assurance administrative team leader will establish and maintain complete, current and usable directives, and respective guidelines.

The quality assurance administrative team leader will establish and maintain current review plans based on critical requirements identified in each functional area or process.

The quality assurance administrative team leader will select QAR team members, each with expertise in the respective QAR. Members shall not monitor their own district. Team members are to be selected from the appropriate right of way personnel including the FHWA realty officer.

District and division participants in QARs will identify for the quality assurance administrative team, possible need for training; improvements to procedures, guidelines; and problems or innovations of statewide significance.

The quality assurance administrative team will report the final results of QAR to the Asst. to the State Design Engineer - Right of Way.

The right of way section will evaluate the quality assurance results, make improvements to procedures and processes, conduct appropriate training, circulate to all districts applicable outstanding results, record the summary of the results and responses to each review and track problem areas until they are corrected or resolved.

236.12.4 QAR Plan

236.12.4.1 QAR Plan

This document establishes the minimum standard for right of way section’s QAR plan.

236.12.4.2 Schedule

A schedule will show the dates of review by the QAR team.

236.12.4.3 Notice

Prior to the review, a notice shall be sent to the district right of way managers to ensure that all parties are aware of the review. This notice will contain the following:

  • Identify team members.
  • The anticipated dates the reviews will begin and be completed.
  • The functional areas that will be reviewed.
  • The desired date for scheduling of the recommendation reviews.

236.12.4.4 Reviews

The purpose of each review is to determine compliance with right of way processes and procedures in each of the functional areas being reviewed.

Each review will be conducted in accordance with the approved source documents. Compliance with the functional area will be determined by examination of each. It will be the responsibility of the right of way liaison to ensure that the scope of the review is sufficient to support a determination regarding compliance or noncompliance with the functional areas being reviewed.

236.12.4.5 Recommendation Reviews

Recommendation reviews will be held at the conclusion of each review. The right of way manager will be requested to attend along with any other supervisory personnel responsible for the functional area being reviewed. The review team will advise the district/division office of factual findings of the review. No conclusions regarding compliance or recommendations for corrective action will be provided at this interview.

Each recommendation review will include a discussion of current procedures. The right of way manager will be provided an opportunity to discuss the procedures and make recommendations for changes. A discussion of these recommendations and the actions taken will be included in the QAR Report.

236.12.4.6 Reports

Within fifteen (15) working days of completion of the review, a written draft report will be provided to the district right of way manager. The format of this report will be in accordance with the format adopted for all QAR Reports. The district will be permitted fifteen (15) working days within which to comment regarding the accuracy of the factual data in the draft report. It is not expected that the district will fully respond to the conclusions or the recommendations as reflected in the draft report.

A final report will be completed within fifteen (15) working days of receipt of the comments or expiration of the review period. Extensions to the review period may be granted at the discretion of the Asst. to the State Design Engineer - Right of Way, upon request from the district.

The final report will be provided to the Asst. to the State Design Engineer - Right of Way, district and FHWA and the findings and recommendations will be retained in the division office. A review period of thirty (30) days will be allowed for response to the findings and recommendations within the report. It is the responsibility of the QAR administrative team leader to ensure that appropriate responses are obtained to each recommendation contained in the report. The agreed upon responses are to be filed with the report.

236.12.5 QAR Guideline

236.12.5.1 Plan

Schedule QARs

Each year, coordinate with appropriate units and develop a schedule for reviews. Avoiding overlapping reviews or overloading, and adjust if necessary.

QAR Team

Assign the most knowledgeable staff.

Team members conducting the review should adequately prepare prior to the execution of the review.

Review Past QARs

Review reports from management, Audits and Investigations, FHWA and others.

Identify unresolved areas of noncompliance and areas marked for improvement.

Plan QAR Content

Base the QAR on right of way procedures and processes. Be sure supporting procedures, rules, statutes and critical requirements are current, correct and available to participants.

Prepare a list of activities and/or documentation that supports critical requirements.

236.12.5.2 Conduct

Notify district/division office of QAR Content.

Prior to the QAR, notify districts/division office of all areas to be covered.

Conduct Review

Focus on right of way processes and procedures.

Cover critical requirements and source documents.

At the initial meeting reconfirm:

  • Where the work will be performed.
  • Procedures for obtaining files and copies.
  • District contact person for assistance.

Look for positive areas as well as noncompliance.

Base the QAR on critical requirements and unresolved issues from prior QARs.

Verify that previous corrective action is effective.

When the critical requirements indicate a problem exists, follow up and verify the problem and its magnitude.

Review parallel issues identified in audits performed by Audits and Investigations, by the FHWA and other performance reports.

Talk with district/division office staff.

Take complete notes of specifics and impressions.

Prepare for recommendation reviews. QAR team leader and team members should review and analyze information; organize presentation.

236.12.5.3 Conduct Recommendation Review with District/Division Office Staff

Arrange a meeting for all participants.

Prepare a list of general impressions; cite specifics only when necessary to illustrate the magnitude of the praise or issue.

Clearly state urgent or high impact issues.

Be prepared for discussion (anticipate questions, develop appropriate responses, etc.).

Agree on appropriate items for district and division office action.

Take notes to help with development of the written QAR Report.

Include general items (impressions, findings that indicate lack of quality control or attention to detail).

If an issue can be immediately corrected, report the corrective action rather than a negative finding.

Discuss all issues you expect to include in the QAR Report.

Ask district/division office staff for specific recommendations to improve procedures, meeting requirements, training, and statewide problems. Identify areas that are inefficient or that adversely impact other areas.

Emphasize steps that will follow the review. For example, clarification or additional information may be requested during report preparation.

236.12.5.4 Prepare QAR Report

Prepare draft report and send to the district/division office. Content of the report should reflect what was discussed at the recommendation review.

Address action items in report.

Work to resolve disagreements regarding report contents.

Contact the district/division office if a response is not received within fifteen (15) working days after receipt of draft report.

Prepare final report and send to district/division office within fifteen (15) working days after receipt of comments to the draft report.

Share outstanding methods or issues without identifying the source of the issue.

236.12.5.5 Track Critical Issues until Remedied or Resolved

Track the corrective action and/or make a follow-up visit. Disagreements with report recommendations are resolved through upper management. The Asst. to the State Design Engineer - Right of Way is the final arbiter.

236.12.6 QAR Report

236.12.6.1 Purpose And Scope Of Review

This report summarizes the results of the QAR conducted. The review was done to assess process performance relating to critical functions such as:

  • Administration
  • Appraisal
  • Negotiations
  • Realty Asset
  • Relocation
  • Right of Way Parcel Acquisition (RWPA) and Realty Asset Inventory (RAI) with in the Transportation Management System (TMS).

Identify those areas in which there may be a need for closer adherence to existing process standards or indications that the existing process standards warrant modification.

Identify best practices that may be shared with other districts to the benefit of the overall right of way program.

236.12.6.2 QAR Team Members

List the names of those that performed the review.

236.12.6.3 Background

Titles 23 and 49 of the Code of Federal Regulations and 7 CSR (Code of State Regulations) Chapter 4 10-4.010-.020 broadly mandate the state's responsibilities for compliance with the provisions of the Uniform Relocation Assistance and Real Property Acquisition Regulations, Federally Assisted Programs. To assure proper recognition of, and adherence to, those regulations, MoDOT has developed, with the approval of the FHWA, procedures covering all aspects of right of way acquisition, management, and disposition. These procedures provide the basis for the periodic QAR of all current processes.

Provide the date of the last review.

Follow-up of recommendations from previous reviews.

236.12.6.4 Methodology and Findings

Sampling Technique

A letter notifies all right of way managers of the scheduled reviews. This letter identifies the critical functions that are to be reviewed, the calendar period that would be covered, and the dates the review will be conducted.

In the schedule, the administration, appraisal, negotiation, realty asset, relocation, RWPA and RAI files have been reviewed and all functions are then discussed during the recommendation review.

Sample Reviewed and Findings

Samples may be reviewed from any or all of the following categories: administration, appraisals, negotiations, realty assets, relocation, RWPA and RAI. The files reviewed for each category shall be documented.

Note the following information for the files that were reviewed:

  • Project No.
  • Route
  • County
  • Parcel No.
  • Findings

Recommendation Review

At the conclusion of the review a brief recommendation review is conducted.

Note the following items in the report:

  • Names of district personnel who were present;
  • Who conducted the interview;
  • A discussion of positive/negative findings in the report;
  • Recommendation review responses; and
  • Follow-up on previous recommendations.

236.12.6.5 Conclusion and Recommendations

Clearly state the conclusions and recommendations contained in the report.