The Role of Monitoring and Evaluation in Maintaining CARF Standards Conformance

A survey date has a way of catching everyone’s attention. Policies get pulled up, participant files get checked, reports are reviewed, and teams start asking the same question: Are we ready?

But for organizations maintaining CARF accreditation, the more useful question is what has been happening in the months between surveys.

That is where monitoring and evaluation becomes important.

A good monitoring and evaluation system helps an organization see whether its policies are being followed, whether services are producing the intended results, and where improvement is needed before a small issue becomes a larger one. Instead of scrambling to assemble evidence when a survey approaches, teams can work with information they already use as part of everyday operations.

This fits the larger purpose of accreditation. CARF describes accreditation as a commitment to continuous improvement and service excellence that requires continued improvement efforts after the survey, not simply preparation for the survey itself. CARF’s steps to accreditation

What Monitoring and Evaluation Means in a CARF Environment

Monitoring and evaluation are closely connected, but they do different jobs.

Monitoring is the routine tracking of activities, measures, and results. It helps answer practical questions: Are required processes happening? Is documentation being completed? Are services reaching the people they are intended to serve? Are performance indicators moving in the expected direction?

Evaluation goes a little deeper. It asks what the information means, whether a program or process is working as intended, why results may be changing, and what should happen next.

The CDC Program Evaluation Framework describes evaluation as a structured process that includes gathering credible evidence, generating conclusions, and acting on findings. That basic idea is useful in many service settings because it turns data into decisions instead of leaving numbers sitting in a report.

For organizations pursuing CARF accreditation, the goal should not be to build a separate evaluation system that only comes alive before a survey. A better approach is to connect program evaluation systems with everyday management, outcomes measurement, and quality improvement.

Why Monitoring and Evaluation Supports CARF Standards Conformance

1. It makes conformance visible throughout the year

A written policy explains what should happen. Monitoring helps show whether it is actually happening.

Regular reviews can uncover incomplete records, inconsistent processes, missed follow-up, or gaps in data while there is still time to address them. That gives leadership a much more realistic picture of operations than a last-minute review of documents.

CARF’s quality standards framework specifically connects measurable goals and indicators with reviewing results, identifying areas for improvement, and making changes. In simple terms, organizations are expected to do more than collect information. They need to use it.

2. It connects outcomes measurement to service quality

Organizations can collect an impressive amount of data without learning very much from it.

The useful question is not, “How many numbers do we have?” It is, “What are these numbers telling us about the people we serve and the way we operate?”

Depending on the program and applicable CARF standards, an organization may look at service outcomes, access, satisfaction, efficiency, safety, stakeholder feedback, or other relevant performance measures. Measures should fit the program and provide information people can actually use, rather than being selected simply because they are easy to count.

When teams review trends, compare results with targets, and discuss why performance changed, outcomes measurement becomes part of management rather than another reporting task.

3. It helps identify gaps before the survey

Survey preparation becomes much more manageable when routine monitoring is already showing where the organization is strong and where attention is needed.

If a recurring review uncovers an issue, the organization has time to understand what caused it. Maybe staff expectations are unclear. Perhaps a form is being used inconsistently. A process may look fine on paper but work differently in practice.

Finding that out early allows the organization to respond thoughtfully instead of trying to repair everything just before survey time.

Organizations that want outside support connecting readiness, documentation, and performance systems can use CARF accreditation consulting as part of their broader preparation and improvement work.

What a Practical Monitoring System Can Look Like

A useful system does not have to be complicated. It does have to be consistent.

Area to review	Practical question	Possible follow-up
Performance measures	Are results moving toward the target?	Examine causes and adjust the improvement plan
Participant or service records	Is documentation complete and consistent with practice?	Correct patterns and clarify staff expectations
Feedback and satisfaction	What are persons served and stakeholders telling us?	Identify themes and determine what needs attention
Incidents, safety, or risk trends	Are recurring patterns appearing?	Review causes, controls, and prevention steps
Improvement actions	Did the change actually improve the result?	Continue, revise, or replace the action

The details will differ by organization, program, and the CARF standards that apply. What matters is creating a repeatable rhythm: collect useful information, review it with the right people, decide what it means, act on it, and then check whether the action worked.

How to Build Monitoring and Evaluation Into Everyday Operations

• Start with questions that matter

  
  

Before creating another spreadsheet or dashboard, decide what leadership and program teams genuinely need to know.

Good measures should help answer meaningful questions about performance, outcomes, service quality, and conformance. If a measure is collected every month but nobody discusses it or makes decisions from it, it may be creating work rather than insight.

• Give each measure an owner

  
  

Someone should know who collects the information, who checks its accuracy, who reviews it, and who follows up when something needs attention.

Clear ownership prevents a familiar problem: everyone assumes someone else is watching the issue.

• Look at trends, not just isolated numbers
  

One unusual month does not always mean there is a serious problem. Looking across several reporting periods makes it easier to see whether a change is temporary or part of a pattern.

Context matters too. Results can shift because of staffing, service volume, referral patterns, program changes, or other operational factors. Numbers are useful, but the conversation around them often provides the real insight.

• Document what was decided

  
  

A meeting is not the end of the process.

Record what was found, what decision was made, who is responsible for the next step, and when the issue will be reviewed again. That creates a visible connection between monitoring and performance improvement.

• Check whether the improvement actually worked

  
  

This is where many improvement efforts lose momentum.

A new policy was written. Training was completed. A form was changed. The action item gets marked “done.”

But did the result improve?

Go back to the measure. Did the problem decrease? Is the new process being followed consistently? Did the change produce the result the organization hoped for?

Completion and improvement are not the same thing. Monitoring and evaluation help organizations tell the difference.

Common Mistakes That Weaken Program Evaluation Systems

Even well-intentioned organizations can make monitoring harder than it needs to be. Common problems include:

• Collecting too many measures without a clear reason

• Reviewing data only when a report or survey is due

• Focusing heavily on activities while overlooking outcomes

• Keeping program, quality, and leadership information in separate silos

• Making changes without checking whether they worked

• Treating conformance as the responsibility of one employee or department

The strongest systems are often the ones staff can realistically maintain.

Rienzzie Kern’s current services include performance measurement and management, performance improvement, program evaluation, data collection and analysis, and development of monitoring and evaluation systems. The About Rienzzie Kern page also identifies him as an active CARF surveyor with extensive experience in monitoring, evaluation, program development, and performance improvement.

For organizations preparing for an original survey or re-survey, Mock surveys | Facilitation | Training can also help connect what is written in policies and plans with what staff are doing in practice.

Make Conformance Part of the Way the Organization Works

Monitoring and evaluation can turn CARF standards conformance from a periodic preparation project into an ongoing management practice. When organizations track meaningful measures, discuss what the results are saying, act on what they find, and check whether those changes worked, survey readiness becomes a natural result of stronger everyday systems.

A useful next step is to look at the information your organization already collects and ask a simple question: Are we actually using this information to improve services and make decisions?

If the answer is “not consistently,” that is a practical place to start. For organizations that want help strengthening those systems while preparing for accreditation or re-accreditation, CARF accreditation consulting from Rienzzie Kern can support the connection between monitoring, performance improvement, documentation, and survey readiness.

FAQs

1. What is the difference between monitoring and evaluation?

Monitoring routinely tracks activities, measures, and results. Evaluation examines what those results mean, whether a program or process is working, and what changes may be needed.

2. Does CARF require every organization to use the same performance measures?

No. Applicable standards and useful measures depend on the programs and services being accredited. Organizations should work from the current CARF standards manual that applies to their services and choose measures that provide meaningful information about performance and outcomes.

3. How often should monitoring data be reviewed?

There is no single review schedule that makes sense for every measure. Some information may require frequent attention, while other indicators may be more useful when reviewed monthly, quarterly, or at another planned interval. The schedule should allow the organization to recognize patterns and respond in a timely way.

4. Can monitoring and evaluation replace a mock survey?

No. They serve different purposes. Routine monitoring supports ongoing oversight and improvement. A mock survey provides a more focused readiness assessment and gap analysis when an organization is preparing for an original survey or re-survey.

5. Is CARF standards conformance the same as legal or regulatory conformance?

No. CARF standards are accreditation standards. An organization may also have separate licensing, legal, contractual, funding, or regulatory obligations. Those requirements should be identified and managed separately rather than assumed to be covered by CARF accreditation.