In program evaluation, which concept refers to the practical importance of an observed effect, beyond statistical metrics?

• A. Statistical significance
• B. Programmatic significance
• C. External validity
• D. Reliability

Answer: (B)

The main idea here is the practical importance of an observed effect for program decisions. In program evaluation, an effect can be statistically notable but not meaningful in real-world terms. Statistical significance tells us whether an effect is unlikely to be due to chance, but it doesn’t say whether the effect matters in actual practice, such as whether it justifies costs, changes in program design, or scaling up.

Programmatic significance focuses on whether the observed effect is large enough and relevant enough to matter to stakeholders and to the program’s goals. It considers practical implications, feasibility, and whether the results would drive worthwhile actions or policy decisions.

External validity is about generalizing findings to other settings or populations, which is a separate concern from how important the effect is in the current context. Reliability is about the consistency of measurements or results, not the practical impact of the effect itself.

So, the term that captures the practical importance of an observed effect for program decisions is programmatic significance.