Blog Post

Innovative Assessment Research and Tools Featured at Duke’s Wednesdays at the Center and New PhD Lab in Digital Knowledge

Innovative Assessment Research and Tools Featured at Duke’s Wednesdays at the Center and New PhD Lab in Digital Knowledge

Wednesdays at the Center:
Who: Professor Kyle Peck, College of Education, Pennsylvania State University, and Khusro Kidwai, Director of Online Teaching and Learning at the University of Southern Maine
What:  Presentation and Demo, “Tools for Transformative Assessment: A Key to Developing Skills."  
http://www.fhi.duke.edu/events/phd-lab-tools-transformative-assessment
When: September 12, 12:00-1:00 pm
Where:  240 Franklin Center, 2204 Erwin Road (on the corner of Erwin and Trent).  Wednesdays at the Center (WATC)

Workshop on Assessment:
Who: Kyle Peck, Khusro Kidwai, and PhD Lab in Digital Knowledge directors David Bell and Cathy Davidson
What: "Is What We Value What We Count" A Workshop on Assessment, Grading, Testing, and other Forms of Evaluation"
When: September 12, 2:30-4:00 pm
Where: FHI Garage, Bay 4, Smith Warehouse, 114 S. Buchanan Blvd


DURHAM, NC  Two collaborators from Penn State and the University of Southern Maine will be at Duke on September 12 to discuss and demonstrate a customizable, open source tool that they have developed to help instructors customize and automate new forms of qualitative assessment.  "Assessment is typically seen as the end of a process, not the beginning. How we measure shapes what we do, how we learn, and encapsulates what we value or do not value in research and learning," says Professor Cathy N. Davidson, co-director of the PhD Lab in Digital Knowledge.  "The reason we are beginning our first year of the PhD Lab in Digital Knowledge with a presentation on assessment is because we want to begin with the fundamentals: what counts?  what matters to us?  what are we trying to achieve?  and do the systems of grading, testing, and evaluating that we have inherited and that have become increasingly standardized over the last 125 years really measure what we say we value? Those are deep, key questions that typically are left unasked. The eRubric tool developed by Professors Peck and Kidwai is so flexible that it helps professors and students think about their categories of judgment and possibilities for finding new ways of assessing quality.”

Developed by Kyle Peck, Professor and Research Fellow at Penn State, and Khusro Kidwai, Director of Online Teaching and Learning at the University of Southern Maine, the eRubric tool is designed to offer alternatives to multiple-choice testing that are flexible enough to support self-assessment, peer-to-peer assessment, and assessment by instructors of higher-order products and performances, such as essays, projects, and presentation and skills and capabilities such as teamwork, and creativity.  eRubric includes features that allow students to be involved in helping to determine and understanding the criteria by which they are being judged. Research shows that student participation in assessment criteria aids and helps motivate learning.  

The  eRubrictool is currently being beta-tested in large, core courses at Penn State, including an art history course. The tool supports the development of the rubric, a set of criteria and ratings to be used during assessment, and automates (to a large extent) the process of rating student responses, providing expert feedback, and scoring or grading. With this Web-based application, instructors can easily set up class rosters, develop rubrics (matrix with criterion, points, and feedback), and use these rubrics to grade students responses (as instructors click on cells in the rubric matrix, a feedback report is automatically generated). Students are then able to log into this application to view the feedback and grades.

Professors Peck and Kidwai will give a talk on “Tools for Transformative Assessment: A Key to Developing Skills”. The talk will be from 12:00pm - 1:00pm, as part of the John Hope Franklin Center luncheon series, Wednesdays at the Center. A light lunch will be offered in 240 Franklin Center, located at 2204 Erwin Road (on the corner of Erwin and Trent).  Wednesdays at the Center (WATC) is a topical weekly noontime series in which scholars, artists, journalists, and others speak informally about their work in conversation with the audience.  All events in the series are free and open to the public. No reservations are necessary, and vouchers to cover parking costs in the Duke Medical Center parking decks (#2 and #3 onthis map) are provided. The event will be videotaped and archived on the Franklin Center website.  

Immediately following their presentation, Peck and Kidwai will hold a workshop and extended conversation with the students and faculty of Duke's new PhD Lab in Digital Knowledge. This will be the kickoff event for the new lab. The public is also welcome to attend this event which will be take place from 2:30pm - 4:00pm.

This visit is sponsored by the Office of the Vice Provost for Academic Affairs, the Franklin Humanities Institute’s PhD Lab in Digital Knowledge, and HASTAC.  

Presenters:
Introduction, Cathy N. Davidson, Co-Director, PhD Lab in Digital Knowledge
Dr. Kyle Peck -Professor and Research Fellow, College of Education, Pennsylvania State University
Dr. Khusro Kidwai - Director of Online Teaching and Learning at the University of Southern Maine

###

Contact:
Anna Rose Beck, Exec Assistant to Cathy N. Davidson
anna.beck@duke.edu
919 684-8471

HASTAC
Duke University, 114 S Buchanan Blvd., Box 90403 Durham, NC 27708-0403 USA
contact@hastac.org www.hastac.org  www.twitter.com/hastac

---

Bibliography:

Andrew, T. (2009)  Online Analytical Rubric Generators.  Retrieved August 21, 2012 from http://suite101.com/article/online-analytical-rubric-generators-a88692

Charles, M., Peck, K. L., Lemke, C., Kolvoord, R., Knezek, G., & Nofar, T.  (2008, July)  SIGTE Forum:  Assessing 21st Century Skills – Next Steps. National Educational Computing Conference (NECC).  San Antonio, TX.Dutton Institute, Penn State University.  Penn State Rubric Cubed: Rubric Builder, Interactive Grading Rubric, Rich Feedback Generator.  Retrieved August 21, 2012 fromhttps://www.e-education.psu.edu/facdev/id/assessment/rubrics/rubric_builder.html

Kidwai, K. (2009, April). Using cognitive modeling and technology to design a scalable approach for grading projects in a large enrollment course. Paper discussion session at the annual meeting of the American Educational Research Association (AERA), San Diego, CA.

Kidwai, K., Hsu, Y., Redman, S., Lee, H., Grigorescu, E., & Miller, S. (2008, November). Revising a large question pool for an astronomy class: A collaboration between instructional design researchers and astrophysicists. Paper presented at E-Learn 2008—World Conference on E-Learning in Corporate, Government, Healthcare, & Higher Education, Las Vegas (NV).

Kidwai, K., & Stroh, W. (2008, November). Maintaining high quality feedback in large-scale grading: A Web-based project assessment tool. Paper presented at E-Learn 2008—World Conference on E-Learning in Corporate, Government, Healthcare, & Higher Education, Las Vegas, NV.

Mao, J, & Peck, K. L. (2008, November)  The Effects of Assessment Strategies and Self-Regulated Learning on College Students' Learning Outcomes. Association for Educational Communications and Technology (AECT) International Convention. Orlando, FL.

Mao, J, & Peck, K. L. (2008, November)  The Use of an Interactive Rubric and Feedback Tool in Enhancing Self- and Peer Assessment. Association for Educational Communications and Technology (AECT) International Convention. Orlando, FL.

Mathews, J., Peck, K. L., and Mao, J.  (2008, March)  Rubric Cubed:  The Penn State Rubric Builder, An Evaluation and Assessment Tool. Teaching and Learning with Technology Symposium at Penn State University.  State College, PA.

Peck, K. L., & Clausen, R. (2008, November)  One-to-One Computing Can Change How and What Teachers Teach. Association for Educational Communications and Technology (AECT) International Convention. Orlando, FL.

 

 

73

1 comment

 

Can anyone provide more detailed information about using this rubric tool?

The only instructions I can find are minimal: https://www.e-education.psu.edu/facdev/id/assessment/rubrics/rubric_builder.html

If anyone attended the Duke event, I would love to hear about it. Why is this tool better or different? 

109