Zeitschrift für Evaluation: Issue 1/2024, 23. Volume Counterfactual self-assessments as a potential approach for estimating intervention effects

Assessing the effectiveness of interventions often poses significant challenges for evaluators, as practical constraints and limited resources restrict the application of appropriate study designs for a reliable assessment of intervention effects. In response to this, the ‚method of counterfactual self-assessments‘ is occasionally proposed as an accessible, time- and cost-effective alternative. Its approach is based on the comparison between self-assessments of intervention participants after an intervention’s termination and self-assessments under the assumption that the intervention did not take place. This article explains the functioning of the method, along with potential advantages and weaknesses. It also sheds light on the empirical evidence regarding the validity of counterfactual self-assessments. While the method holds practical benefits, it also faces numerous potential limitations that have been insufficiently explored to date. Therefore, this article highlights promising areas for future research endeavors.

Keywords
Impact, Impact Assessment, Research Design, Self-Assessment