Evaluating Public and Community Health Programs: Assessment for Evidence Based Interventions

A participatory framework connecting community assessment to evidence-based intervention evaluation

Now in its third edition, Evaluating Public and Community Health Programs: Assessment for Evidence Based Interventions provides a systematic, theory-driven approach to program evaluation that places stakeholders at the center of the evaluation process. The text connects community assessment with program implementation while addressing the gap between evaluating evidence-based practices and assessing for them in community health settings.

This updated edition delivers expanded coverage of evidence-based practice evaluation, updated perspectives on community and needs assessment, and strengthened focus on community engagement throughout the research process. The participatory model framework guides readers through practical evaluation strategies that involve all program stakeholders rather than relying solely on evaluation experts. Readers will also find:

• Clear explanations of the links between community assessment, program implementation, and comprehensive program evaluation processes
• Practical, ongoing evaluation strategies emphasizing stakeholder participation and community-centered approaches rooted in participatory research principles
• Health equity considerations integrated throughout, ensuring evaluations address disparities and promote equitable outcomes across diverse populations
• Implementation science frameworks that focus evaluation on factors influencing intervention effectiveness as evidence-based practice
• Theory-driven assessment approaches that provide the foundation for determining whether interventions can achieve evidence-based status

Ideal for students, faculty, researchers, and professionals in public health, community health, community health nursing, preventive medicine, health social work, and public policy, this text provides the essential framework for conducting meaningful program evaluations that engage communities and advance evidence-based practice.

Preface xiii
Acknowledgment xv
About the Companion Website xvii

1 COMMUNITY ASSESSMENTS 1
Learning Objectives 1
Introduction 2
Community Assessment 2
Purpose of a Community Assessment 4
Types of Community Assessment 6
Community Action Group 7
Building a Strong Team 10
Participatory Research 11
Role of Contextual Variables in Community Assessment 13
Challenges With Community Assessments 14
Summary 15
Discussion Questions and Activities 16
Key Terms 16
References 16

2 RESEARCH FOR EVIDENCE-BASED SOLUTIONS 19
Learning Objectives 19
Introduction 20
Steps in Conducting a Community Assessment 20
Cultural Context 22
Health Equity 24
Theoretical Underpinnings of Community Assessment 25
Ethical Considerations in Conducting Community Assessments 28
The Literature Review 33
Research Questions for Evidence-Based Solutions 37
Summary 43
Discussion Questions and Activities 43
Key Terms 44
References 44

3 ADVOCATING FOR CHANGE 47
Learning Objectives 47
Introduction 48
Engaging Stakeholders 48
Using Community Assessments in Advocacy 48
The Community Assessment Report 50
Disseminating Results for Advocacy 58
In Class Activity 60
Summary 61
Discussion Questions and Activities 61
Key Terms 62
References 62

4 ISSUES IN EVALUATION 65
Learning Objectives 65
What is Evaluation? 66
Evaluation Feasibility Assessment 67
Evaluation 67
Successful Initiatives 71
Why Theory? 72
The Contract for Evaluation 72
Evaluation Team and Expectations 75
Managing the Evaluation Process 78
Triangulation as a Strategy for Improving Evaluations 81
Ethical Considerations In Evaluation 82
Factors That Affect Methods and Measurement Approaches 83
Organizational Structures and Support 84
Summary 84
Discussion Questions and Activities 85
Key Terms 86
References 86

5 SELECTING THE APPROPRIATE EVIDENCE-BASED SOLUTION 87
Learning Objectives 87
Introduction 88
Evidence-based Public Health 88
Evidence-based Practice 90
Population Needs and Characteristics 91
Organizational Characteristics 93
Summary 102
Discussion Questions and Activities 103
Key Terms 103
References 103

6 EVALUATING THE IMPLEMENTATION OF EVIDENCEBASED SOLUTIONS 107
Learning Objectives 107
Introduction 108
The Timing of Evaluation 108
Formative Evaluation 109
Questions 109
The Evaluability Assessment 110
Justification for the Program 113
Stakeholder Support 116
The Program's Logic Model 116
Program's Goals and Objectives 117
The Program's Resources 117
Program Activities and Outputs 118
Evaluating the Implementation of the EBI 119
Measurement 122
Reach 122
Summary 125
Discussion Questions and Activities 126
Key Terms 126
References 126

7 DESIGNING THE EVALUATION: OUTCOME EVALUATION 129
Learning Objectives 129
Introduction 130
Selecting Evaluation Questions 132
Measuring Concepts and Constructs 135
Evaluation Research Designs 137
Adding a Control or Comparison Group 139
Efficiency Assessments 140
Factors Affecting Measurement in Outcome Evaluation 141
Control and Comparison Groups 143
Threats to Validity 143
Approaches to Measurement 145
Reach 146
Summary 148
Discussion Questions and Activities 149
Key Terms 149
References 149

8 QUANTITATIVE RESEARCH AND DATA COLLECTION 151
Learning Objectives 151
Introduction 152
Primary Data Collection 152
Selecting the Questions to Answer 155
Digital Approaches 168
Secondary Data 170
Managing and Storing Data 171
Summary 171
Discussion Questions and Activities 171
Key Terms 172
References 172

9 QUALITATIVE RESEARCH AND DATA COLLECTION 173
Learning Objectives 173
Introduction 174
Data in Qualitative Research 175
Tools of the Trade 176
Validity and Reliability 177
Interview Approaches 178
Managing and Storing Qualitative Data 190
Summary 190
Discussion Questions and Activities 191
Key Terms 191
References 192

10 ANALYZING AND INTERPRETING DATA IN QUANTITATIVE AND QUALITATIVE RESEARCH 193
Learning Objectives 193
Introduction 194
Quantitative Data (Part 1) 194
Summary 201
Discussion Questions and Activities 202
Qualitative Data (Part 2) 202
Interpreting the Data and Reaching Conclusions 207
Summary 209
Discussion Questions and Activities 210
Key Terms 210
References 211

11 REPORTING EVALUATION FINDINGS 213
Learning Objectives 213
Introduction 214
The Content of the Report 216
Timing of the Report 227
The Format of the Report 227
Summary 230
Discussion Questions and Activities 231
Key Terms 231
References 231

12 CASE STUDY: THE COMMUNITY ASSESSMENT 233
Background 233
Establish the CAG 234
Determine the Availability of Data 236
Decide on the Data-Collection Approaches and Methods 237
Training 238
Resource Procurement 239
Analysis and Interpretation of the Data 239
Summary of Findings 239
The Intervention 240
Design the Evaluation 245
Collect the Data 250
Analyze and Interpret the Data 255
Report on the Results 258
Discussion Questions and Activities 259
Key Terms 260
References 260

13 CASE STUDY: PROCESS EVALUATION 261
Background 261
Theoretical Framework 262
Community Assessment Findings 263
The Evaluation Plan 270
Answering the Evaluation Question 272
Reporting the Results 281
Discussion Questions and Activities 283
References 284

APPENDICES
A MODEL AGREEMENT BETWEEN EVALUATION CONSULTANT AND TEAM MEMBERS 285
B MODEL PREAMBLE FOR ADULT INDIVIDUAL INTERVIEWS 289
C MODEL DEMOGRAPHIC SHEET 291
D MODEL FIELD NOTES REPORT 293
E MODEL INTERVIEW REFUSAL REPORT 295
F DATA COLLECTION TRAINING MANUAL TEMPLATE 297
G GUIDELINES FOR COMPLETING AN EVALUATION REPORT 307

INDEX 311

MURIEL J. HARRIS, PhD, MPH, is an Adjunct Professor and former Director of the PhD Program in the School of Public Health and Information Sciences at the University of ?Louisville, where she led graduate training in public health evaluation methodologies and ?evidence-based practice.