Handbook of Automated Scoring
Home > Society and Social Sciences > Psychology > Psychological methodology > Psychological testing and measurement > Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)
Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)

Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)


     0     
5
4
3
2
1



Out of Stock


Notify me when this book is in stock
X
About the Book

"Automated scoring engines […] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public." From the Foreword by Alina von Davier, ACTNext Senior Vice President Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.

Table of Contents:
Contents Foreword..................................................................................................................xi 1 The Past, Present, and Future of Automated Scoring..............................1 Peter W. Foltz, Duanli Yan, and André A. Rupp Part I: Theoretical Foundations 2 Cognitive Foundations of Automated Scoring........................................ 13 Malcolm I. Bauer and Diego Zapata-Rivera 3 Assessment Design with Automated Scoring in Mind.........................29 Kristen DiCerbo, Emily Lai, and Matthew Ventura 4 Human Scoring with Automated Scoring in Mind................................49 Edward W. Wolfe 5 Natural Language Processing for Writing and Speaking..................... 69 Aoife Cahill and Keelan Evanini 6 Multimodal Analytics for Automated Assessment................................93 Sidney K. D’Mello 7 International Applications of Automated Essay Scoring.................... 113 Mark D. Shermis 8 Public Perception and Communication around Automated Essay Scoring................................................................................................ 133 Scott W. Wood 9 An Evidentiary-Reasoning Perspective on Automated Scoring: Commentary on Part I................................................................................ 151 Robert J. Mislevy Part II: Operational Methodologies 10 Operational Human Scoring at Scale...................................................... 171 Kathryn L. Ricker-Pedley, Susan Hines, and Carolyn Connelly 11 System Architecture Design for Scoring and Delivery....................... 195 Sue Lottridge and Nick Hoefer 12 Design and Implementation for Automated Scoring Systems........................................................................................... 217 Christina Schneider and Michelle Boyer 13 Quality Control for Automated Scoring in Large-Scale Assessment.................................................................................................... 241 Dan Shaw, Brad Bolender, and Rick Meisner 14 A Seamless Integration of Human and Automated Scoring..............263 Kyle Habermehl, Aditya Nagarajan, and Scott Dooley 15 Deep Learning Networks for Automated Scoring Applications.......283 Saad M. Khan and Yuchi Huang 16 Validation of Automated Scoring Systems............................................ 297 Duanli Yan and Brent Bridgeman 17 Operational Considerations for Automated Scoring Systems: Commentary on Part II............................................................................... 319 David M. Williamson Part III: Practical Illustrations 18 Expanding Automated Writing Evaluation............................................ 329 Jill Burstein, Brian Riordan, and Daniel McCaffrey 19 Automated Writing Process Analysis.....................................................347 Paul Deane and Mo Zhang 20 Automated Scoring of Extended Spontaneous Speech.......................365 Klaus Zechner and Anastassia Loukina 21 Conversation-Based Learning and Assessment Environments.........383 Arthur C. Graesser, Xiangen Hu, Vasile Rus, and Zhiqiang Cai 22 Automated Scoring in Intelligent Tutoring Systems...........................403 Robert J. Mislevy, Duanli Yan, Janice Gobert, and Michael Sao Pedro 23 Scoring of Streaming Data in Game-Based Assessments...................423 Russell G. Almond 24 Automated Scoring in Medical Licensing..............................................445 Melissa J. Margolis and Brian E. Clauser 25 At the Birth of the Future: Commentary on Part III............................. 469 John T. Behrens 26 Theory into Practice: Reflections on the Handbook............................. 475 Andre A. Rupp, Peter W. Foltz, and Duanli Yan Glossary................................................................................................................489 References............................................................................................................ 501 Index......................................................................................................................553

About the Author :
Duanli Yan is Director of Data Analysis and Computational Research in the Psychometrics, Statistics, and Data Sciences area at the Educational Testing Service (ETS), and Adjunct Professor at Fordham University and Rutgers University. She is a co-author of Bayesian Networks in Educational Assessment and Computerized Adaptive and Multistage Testing with R, editor for Practical Issues and Solutions for Computerized Multistage Testing, and co-editor for Computerized Multistage Testing: Theory and Applications. Her awards include the 2016 AERA Division D Significant Contribution to Educational Measurement and Research Methodology Award. André A. Rupp is Research Director in the Psychometrics, Statistics, and Data Sciences area at the Educational Testing Service (ETS). He is co-author and co-editor of two award-winning interdisciplinary books titled Diagnostic Measurement: Theory, Methods, and Applications and The Handbook of Cognition and Assessment: Frameworks, Methodologies, and Applications. His synthesis- and framework-oriented research has appeared in a wide variety of prestigious peer-reviewed journals. He currently serves as the lead developer of the ITEMS professional development portal for NCME. Peter W. Foltz is Vice President in Pearson's AI and Products Solutions Organization and Research Professor at the University of Colorado’s Institute of Cognitive Science. His work covers machine learning and natural language processing for educational and clinical assessments, discourse processing, reading comprehension and writing skills, 21st-century skills learning, and large-scale data analytics. He has authored more than 150 journal articles, book chapters, and conference papers, as well as multiple patents.

Review :
'the Handbook of Automated Scoring is an excellent resource for understanding the theoretical, methodological and practical components of automated scoring. It provides a good foundation for understanding the considerations behind how assessments are designed and detailed methodological information about how to best create these kinds of systems. Part 3 that contains different illustrations of how to best design these systems is especially useful for students who are learning more about how these systems should work when implemented correctly.' - Magdalen Beiting-Parrish and Jay Verkuilen, International Statistical Review, 2021


Best Sellers


Product Details
  • ISBN-13: 9781351264792
  • Publisher: Taylor & Francis Ltd
  • Publisher Imprint: Chapman & Hall/CRC
  • Language: English
  • Sub Title: Theory into Practice
  • ISBN-10: 1351264796
  • Publisher Date: 26 Feb 2020
  • Binding: Digital (delivered electronically)
  • Series Title: Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences


Similar Products

Add Photo
Add Photo

Customer Reviews

REVIEWS      0     
Click Here To Be The First to Review this Product
Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)
Taylor & Francis Ltd -
Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)
Writing guidlines
We want to publish your review, so please:
  • keep your review on the product. Review's that defame author's character will be rejected.
  • Keep your review focused on the product.
  • Avoid writing about customer service. contact us instead if you have issue requiring immediate attention.
  • Refrain from mentioning competitors or the specific price you paid for the product.
  • Do not include any personally identifiable information, such as full names.

Handbook of Automated Scoring: Theory into Practice(Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences)

Required fields are marked with *

Review Title*
Review
    Add Photo Add up to 6 photos
    Would you recommend this product to a friend?
    Tag this Book Read more
    Does your review contain spoilers?
    What type of reader best describes you?
    I agree to the terms & conditions
    You may receive emails regarding this submission. Any emails will include the ability to opt-out of future communications.

    CUSTOMER RATINGS AND REVIEWS AND QUESTIONS AND ANSWERS TERMS OF USE

    These Terms of Use govern your conduct associated with the Customer Ratings and Reviews and/or Questions and Answers service offered by Bookswagon (the "CRR Service").


    By submitting any content to Bookswagon, you guarantee that:
    • You are the sole author and owner of the intellectual property rights in the content;
    • All "moral rights" that you may have in such content have been voluntarily waived by you;
    • All content that you post is accurate;
    • You are at least 13 years old;
    • Use of the content you supply does not violate these Terms of Use and will not cause injury to any person or entity.
    You further agree that you may not submit any content:
    • That is known by you to be false, inaccurate or misleading;
    • That infringes any third party's copyright, patent, trademark, trade secret or other proprietary rights or rights of publicity or privacy;
    • That violates any law, statute, ordinance or regulation (including, but not limited to, those governing, consumer protection, unfair competition, anti-discrimination or false advertising);
    • That is, or may reasonably be considered to be, defamatory, libelous, hateful, racially or religiously biased or offensive, unlawfully threatening or unlawfully harassing to any individual, partnership or corporation;
    • For which you were compensated or granted any consideration by any unapproved third party;
    • That includes any information that references other websites, addresses, email addresses, contact information or phone numbers;
    • That contains any computer viruses, worms or other potentially damaging computer programs or files.
    You agree to indemnify and hold Bookswagon (and its officers, directors, agents, subsidiaries, joint ventures, employees and third-party service providers, including but not limited to Bazaarvoice, Inc.), harmless from all claims, demands, and damages (actual and consequential) of every kind and nature, known and unknown including reasonable attorneys' fees, arising out of a breach of your representations and warranties set forth above, or your violation of any law or the rights of a third party.


    For any content that you submit, you grant Bookswagon a perpetual, irrevocable, royalty-free, transferable right and license to use, copy, modify, delete in its entirety, adapt, publish, translate, create derivative works from and/or sell, transfer, and/or distribute such content and/or incorporate such content into any form, medium or technology throughout the world without compensation to you. Additionally,  Bookswagon may transfer or share any personal information that you submit with its third-party service providers, including but not limited to Bazaarvoice, Inc. in accordance with  Privacy Policy


    All content that you submit may be used at Bookswagon's sole discretion. Bookswagon reserves the right to change, condense, withhold publication, remove or delete any content on Bookswagon's website that Bookswagon deems, in its sole discretion, to violate the content guidelines or any other provision of these Terms of Use.  Bookswagon does not guarantee that you will have any recourse through Bookswagon to edit or delete any content you have submitted. Ratings and written comments are generally posted within two to four business days. However, Bookswagon reserves the right to remove or to refuse to post any submission to the extent authorized by law. You acknowledge that you, not Bookswagon, are responsible for the contents of your submission. None of the content that you submit shall be subject to any obligation of confidence on the part of Bookswagon, its agents, subsidiaries, affiliates, partners or third party service providers (including but not limited to Bazaarvoice, Inc.)and their respective directors, officers and employees.

    Accept

    New Arrivals


    Inspired by your browsing history


    Your review has been submitted!

    You've already reviewed this product!