|
Grantees can use many methods to monitor contractor program compliance, among them program reports, site visits, client satisfaction reviews, capacity development/technical assistance, and chart or records reviews. A successful monitoring effort should include several of these methods, while keeping to a reasonable level the time and resources contractors must spend to meet their reporting obligations.
1. Program Reports
Pre-award contract negotiations between grantee and service providers should clearly delineate the program objectives, service units to be provided, number of clients to be served, and outcomes to be measured. In order to assess contract compliance, grantees may require contractors to submit monthly and/or quarterly program reports. Reports may include information on the number of completed service units, progress towards objectives such as percent of each objective completed, staffing and program changes, successes, failures, and status of clinical quality management activities. When reported service delivery drops below a prescribed level, grantees should negotiate some form of corrective action.
2. Site Visits
Provider site visits are another way to monitor contract compliance. Grantees typically use site visit monitoring forms as a way to collect data that are comparable across sites. A site visit might include a review of files, staff interviews, observation of service provision, tour of the facility, review of program objectives, review of fiscal management system, review of staff licensure requirements, and discussion of other key issues.
3. Client Satisfaction Reviews
Some grantees require their contractors to conduct periodic client satisfaction reviews. Such reviews can be conducted a number of ways, including written and telephone surveys, interviews, suggestion boxes, focus groups, public hearings (town meetings), and/or use of a hotline.
Results of client satisfaction surveys should be shared with the planning council as soon as results are available. Care should be taken to ensure that individual agencies and consumers are not identified. A summary of aggregate data can help direct future priority setting and resource-allocation decisions. Client satisfaction data can also be a useful tool to determine capacity development needs that may exist in the service delivery system.
Grantees and councils need to be aware of "survey burn-out" due to over surveying of clients. To prevent or lessen this effect, grantees may want to consider surveying certain categories of providers (i.e. substance abuse centers or transportation providers) each year, with all providers included on a rotating basis.
4. Capacity Development/Technical Assistance
If common problem areas are noted across providers during program monitoring visits, grantees can support local technical assistance (TA) programs or capacity development activities. They can help solve problems once identified, prevent the same problems from occurring in newly funded providers, and prevent problems from escalating to a serious level.
During the process of monitoring contractors, grantees often discover exemplary tools, methods, and practices. As part of a grantee's local TA efforts or capacity development curriculum, these "best practices" should be introduced to all providers. Grantees could consider having quarterly provider meetings where this information is shared in a non-threatening manner. Highlighting model practices is a way to acknowledge innovations and quality performance, judging projects according to objective criteria.
5. Chart/Record Reviews
Grantees can conduct client records reviews to assess providers' performance with respect to area-wide standards of care and adherence to established clinical quality management programs. Record reviews typically involve on-site data collection by a monitoring team, followed by aggregation of data within and comparisons of findings across providers. This kind of monitoring can be costly because of the time required for designing an approach, collecting and analyzing data, and reporting on findings. However, it is particularly useful where detailed and reliable client-level assessments are needed to assess the quality and effectiveness of care services. |