Ensuring Quality and Productivity in Higher Education: An Analysis of Assessment Practices(29, No. 1 ASHE Higher Education Report)

A detailed review of the quality assurance and productivity oversight processes being applied today by agencies given the task of assessing and evaluating education and professional development activities, this book identifies what is working well, and what could be improved. Using the results of a Rand research study conducted, the authors present four successful approaches, key factors to consider and critical lessons learned about the assessment process. Using documentation of organizations engaged in assessment, interviews with experts, conferences, and site visits, the authors also examine the main task of assessment to focus on quality and productivity of specific providers and explore the overall purpose of such studies to provide a higher-level assessment of the system as a whole. They analyze these two main purposes of assessment as they impact stakeholder and system-level needs as well as provide opportunities for program-wide improvements. This book also discusses the emerging trend of corporate learning organizations, and demonstrates how such organizations are now indispensable tools in promoting communications among stakeholders and developing strong links between professional development programs and the system's basic mission. The authors analyze key similitaries and differences among the approaches studied and present four basic models of assessment and evaluation. Each model's strengths and specific applicable characteristics are classified with six crucial factors most important to consider when deciding what model might serve your system best. Three key steps in the process of assessment, regardless of the model selected or the system assessed, are detailed with the several lessons learned in the field concerning their successful application. Finally, for providers in professional development courses meeting the challenge of a lack of preexisting evaluation tools, guidelines for developing measures of learning outcomes are presented with their specific needs in mind.

Table of Contents:
Foreword. Introduction. Objectives and Approach. Framework. Organization of the Report. Phase One: System Level Assessment. Goals of System Level Assessment. How Systems Establish a Structure for Such Assessment. How Systems Identify Misalignments. How Systems Allocate Resources. Need for Standardized Data and Course Offerings. Beyond Assessment: Promoting Workforce Improvement. Multiple Benefits. Phase Two: Assessing How Well Providers Meet Customers' Needs. Model One: Intermediary Assesses or Guides Provider's Process of Assessment. Model Two: Intermediary Conducts the Assessment. Model Three: Provider Conducts the Assessment. Model Four: Student Competencies Are Assessed. Strengths and Weaknesses of the Four Approaches.Choosing the Right Model for Phase Two. Purposes of Assessment. Level of Authority. Level of Resources. Centralization of Operations. System Heterogeneity. Provider Complexity Within a System. Summary. Three Steps for Assessing Providers. Step One: Identify Goals. Step Two: Select Measures. Step Three: Evaluate Performance Using Measures. Measurement Validity and Reliability. Bringing It All Together: Integrating All Three Steps. Relevance of the Three Assessment Steps to Assessors. Conclusions and Recommendations. Phase One Recommendations. Phase Two Recommendations. Appendix A: Corporate Professional Development and Training. Appendix B: Process AuditorsA--Academic Audit. Appendix C: State Higher Education Boards. Appendix D: Balanced Scorecard. Appendix E: Certifiers of Student Competencies. Appendix F: On line Sources. Notes. References. Index.