{"id":7312,"date":"2019-06-19T10:43:17","date_gmt":"2019-06-19T16:43:17","guid":{"rendered":"http:\/\/minkhollow.ca\/beckerblog\/?p=7312"},"modified":"2019-06-19T10:43:17","modified_gmt":"2019-06-19T16:43:17","slug":"worth-sharing-we-dont-trust-course-evaluations-but-are-peer-observations-of-teaching-much-better","status":"publish","type":"post","link":"https:\/\/minkhollow.ca\/beckerblog\/2019\/06\/19\/worth-sharing-we-dont-trust-course-evaluations-but-are-peer-observations-of-teaching-much-better\/","title":{"rendered":"Worth Sharing: We Don\u2019t Trust Course Evaluations, but Are Peer Observations of Teaching Much Better?"},"content":{"rendered":"<span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> 3<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span><blockquote><p><a href=\"https:\/\/www.chronicle.com\/article\/We-Don-t-Trust-Course\/246432\/\"><img decoding=\"async\" class=\"alignnone size-full\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2019\/06\/photo_92190_landscape_650x433.jpg\" alt=\"\" \/><\/a>Why colleges and universities that claim to take teaching seriously need a comprehensive and fair system of evaluating it.<\/p><\/blockquote>\n<p>EXACTLY.<\/p>\n<blockquote><p>But, as always seems to happen, the same teaching technique inspired completely contradictory reactions.<\/p>\n<p>For example, while I don\u2019t show too many PowerPoints in English composition, every time I introduce a new writing strategy I\u2019ll throw up a few slides with definitions and examples. One student praised the slides as the most helpful tool for her learning \u2014 another called them useless and recommended I eliminate them from the course.<\/p>\n<p>Contradictory statements about my methods I can handle; I\u2019ve seen them all before. But this round of reviews also included a comment from a student who said I didn\u2019t &#8220;connect well&#8221; with the class. This was a community-engaged learning course in which we took a field trip together to a homeless shelter, spent lots of time in group activities in class, and shared personal perspectives on our understanding of poverty. I also followed my own advice and made a point to arrive in the classroom a few minutes early and engage in informal conversations with students.<\/p>\n<p>So that student\u2019s comment \u2014 although the only one of its kind in this crop of evaluations \u2014 is very likely to spend the entire summer sticking in my craw.<\/p>\n<p>&#8230;<\/p>\n<p>I\u2019m also a white male in his late 40s, which means that I am usually spared pointed comments about my wardrobe, my voice, or my persona that routinely pepper the course evaluations of female and nonwhite faculty members, as plenty of research has documented.<\/p>\n<p>Over the years, a number of factors \u2014 contradictory criticisms, bias against vulnerable instructors, inconsistent response rates \u2014 have all been adduced as evidence for why academe should reduce the outsized role that student ratings and comments play in the evaluation of teaching.<\/p>\n<p>&#8230;<\/p>\n<p>To illustrate that point, she walked us through a thought-provoking exercise that demonstrated in sharp terms why student evaluations and peer observations should be considered within the context of a host of other measures. &#8220;I want you to make a list,&#8221; Miller said, &#8220;of all of the different things that you do each week in support of your teaching. Don\u2019t just think about being in class. Think of all of the other activities you do each week that relate to your teaching.&#8221;<\/p>\n<p>Here is what I jotted down:<\/p>\n<ul>\n<li>Read for class (for the composition course I just taught, I had to read four assigned books and some additional online essays).<\/li>\n<li>Prepare my lesson plan.<\/li>\n<li>Arrange a class visit to the homeless shelter.<\/li>\n<li>Do background research on the subject we were discussing.<\/li>\n<li>Grade writing exercises.<\/li>\n<li>Create assignment sheets.<\/li>\n<li>Meet with students.<\/li>\n<li>Grade papers.<\/li>\n<li>Respond to their emails.<\/li>\n<\/ul>\n<p>As the list slowly grew under my pen, the point of the exercise became abundantly clear: Much of the work of teaching \u2014 perhaps most of it \u2014 takes place outside of the classroom.<\/p>\n<p>&#8230;<\/p>\n<p>Much of the work that we put into our teaching cannot be evaluated, or even accessed, via the two most common strategies that institutions use to evaluate our teaching effectiveness of their faculty: student evaluations and peer observations.<\/p>\n<p>&#8230;<\/p>\n<p>Part of the process ought to include training people in how to assess teaching fairly, or we risk basing promotion decisions on the classroom preferences or gut instincts of the evaluators.<\/p>\n<p>It takes time to evaluate teaching well \u2014 and time usually requires financial investment. Those are significant obstacles, and they won\u2019t be overcome unless academe is willing to set aside its reliance on easy but dubious methods and take the evaluation of good teaching seriously.<\/p><\/blockquote>\n<p>Source: <em><a href=\"https:\/\/www.chronicle.com\/article\/We-Don-t-Trust-Course\/246432\">We Don\u2019t Trust Course Evaluations, but Are Peer Observations of Teaching Much Better?<\/a><\/em><\/p>\n<div class='wp_likes' id='wp_likes_post-7312'><a class='like' href=\"javascript:wp_likes.like(7312);\" title='' ><img decoding=\"async\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/plugins\/wp-likes\/images\/like.png\" alt='' border='0'\/><\/a><span class='text'>Be the first to like.<\/span><\/p>\n<div class='like' ><a href=\"javascript:wp_likes.like(7312);\">Like<\/a><\/div>\n<div class='unlike' ><a href=\"javascript:wp_likes.unlike(7312);\">Unlike<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p><span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> 3<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>Why colleges and universities that claim to take teaching seriously need a comprehensive and fair system of evaluating it. EXACTLY. But, as always seems to happen, the same teaching technique inspired completely contradictory reactions. For example, while I don\u2019t show &hellip; <a class=\"more-link\" href=\"https:\/\/minkhollow.ca\/beckerblog\/2019\/06\/19\/worth-sharing-we-dont-trust-course-evaluations-but-are-peer-observations-of-teaching-much-better\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[3,9,369,24],"tags":[388,41,389,15,393],"class_list":["post-7312","post","type-post","status-publish","format-standard","hentry","category-academia","category-educational-technology","category-higher-education","category-teaching-learning","tag-academia","tag-education","tag-educational-technology","tag-higher-education","tag-teaching-learning"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4Hsb6-1TW","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":4731,"url":"https:\/\/minkhollow.ca\/beckerblog\/2015\/04\/04\/practical-gamification-hct-dubai-mobile-learning\/","url_meta":{"origin":7312,"position":0},"title":"Practical Gamification | HCT Dubai Mobile Learning","author":"Katrin Becker","date":"April 4, 2015","format":false,"excerpt":"My free mini-course starts tomorrow.\u00a0Practical Gamification | HCT Dubai Mobile Learning. April 5-9, 2015","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/04\/gamification-e1426057520863.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":6265,"url":"https:\/\/minkhollow.ca\/beckerblog\/2016\/07\/18\/worth-sharing-teaching-by-numbers-learning-reimagined-medium\/","url_meta":{"origin":7312,"position":1},"title":"Worth Sharing: Teaching by Numbers \u2014 Learning {Re}imagined \u2014 Medium","author":"Katrin Becker","date":"July 18, 2016","format":false,"excerpt":"A curious thing has been happening in UK education and it\u2019s a trend that\u2019s occurring globally as the craft of teaching is being transformed into a \u201cscience\u201d. The Economist recently published an article titled \u201cHow to make a good teacher\u201d that proclaimed: \u201cThe premise that teaching ability is something you\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":6994,"url":"https:\/\/minkhollow.ca\/beckerblog\/2018\/08\/13\/just-in-time-for-the-start-of-term-the-guide-to-simulations-and-games\/","url_meta":{"origin":7312,"position":2},"title":"Just in time for the start of term&#8230;The Guide to Simulations and Games","author":"Katrin Becker","date":"August 13, 2018","format":false,"excerpt":"Available for a limited time for $9.99(US) with this coupon.","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":4798,"url":"https:\/\/minkhollow.ca\/beckerblog\/2015\/06\/18\/walking-the-talk-signature-pedagogies-and-metateaching-in-graduate-level-education-courses\/","url_meta":{"origin":7312,"position":3},"title":"Walking the Talk : Signature Pedagogies and Metateaching in Graduate-Level Education Courses","author":"Katrin Becker","date":"June 18, 2015","format":false,"excerpt":"Here's another fairly recent talk, also from CNIE 2014. [P] Presentation Becker, K. (2014) Walking the Talk : Signature Pedagogies and Metateaching in Graduate-Level Education Courses, CNIE 2014 Confluences: Spaces, Places & Cultures for Innovative Learning, Kamloops, BC, May 13-16, 2014 Canadian Network for Innovation In Education (CNIE) Abstract Many\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5878,"url":"https:\/\/minkhollow.ca\/beckerblog\/2015\/10\/10\/worth-repeating-deterdings-9-5-theses-on-the-power-and-efficacy-of-gamification\/","url_meta":{"origin":7312,"position":4},"title":"Worth Repeating: Deterding&#8217;s 9.5 Theses on the Power and Efficacy of Gamification","author":"Katrin Becker","date":"October 10, 2015","format":false,"excerpt":"There seems to be continued confusion about the distinctions between games, gamification, and game based learning. This talk by Sebastian Deterding is now several years old, but it's as relevant now as it was then. This talk focuses on gamification; what it is, what it isn't and what is needed\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"gamification","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/08\/gamification-300x205.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":6846,"url":"https:\/\/minkhollow.ca\/beckerblog\/2018\/02\/22\/worth-sharing-would-college-students-retain-more-if-professors-dialed-back-the-pace\/","url_meta":{"origin":7312,"position":5},"title":"Worth Sharing: Would College Students Retain More If Professors Dialed Back The Pace?","author":"Katrin Becker","date":"February 22, 2018","format":false,"excerpt":"Why do we forget so much of what we read? Anthropologist Barbara J. King suggests that the answer might point toward benefits of a slower pace of teaching in the college classroom. Source: Would College Students Retain More If Professors Dialed Back The Pace?","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"https:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/7312","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/comments?post=7312"}],"version-history":[{"count":1,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/7312\/revisions"}],"predecessor-version":[{"id":7314,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/7312\/revisions\/7314"}],"wp:attachment":[{"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/media?parent=7312"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/categories?post=7312"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/tags?post=7312"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}