{"id":5016,"date":"2015-07-18T09:00:13","date_gmt":"2015-07-18T15:00:13","guid":{"rendered":"http:\/\/minkhollow.ca\/beckerblog\/?p=5016"},"modified":"2015-07-20T09:26:13","modified_gmt":"2015-07-20T15:26:13","slug":"8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-6","status":"publish","type":"post","link":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/18\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-6\/","title":{"rendered":"8 Part Series on Gamification as Reigeluth&#8217;s Post-industrial Paradigm of Instruction: Part 6"},"content":{"rendered":"<span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> 2<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span><h1>Criterion Referenced vs Norm Referenced<\/h1>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-5017\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2004-07-11_12-58-35_001b_wm-300x283.jpg\" alt=\"2004-07-11_12-58-35_001b_wm\" width=\"300\" height=\"283\" srcset=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2004-07-11_12-58-35_001b_wm-300x283.jpg 300w, http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2004-07-11_12-58-35_001b_wm.jpg 509w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>Poor Norm. He is doomed to be compared against whoever signs up for the same class as him.<\/p>\n<p>Doesn&#8217;t matter what he can do, it seems, it only matters how he\u00a0measures up to what everyone else can do.<\/p>\n<p>Norm-referenced assessment is still the norm (pardon the pun) in many, if not most university classes. We have come to assume that letter grades should be allotted to students based on a statistically normal distribution, but what if everyone in the class manages to meet the stated course objectives?<\/p>\n<p>Criterion referenced assessment (CRA) involves an independently determined set of standards for achievement. So long as the student meets the criterion, they should earn the grade promised.<\/p>\n<p>How does that compare with our usual, norm-referenced assessment (NRA)?<\/p>\n<p>In a typical course when a student earns 65% (which is a pass in most institutions) it is meant to imply that they have mastered approximately 2\/3 of the course content, but is this really true? In a course where 60% or more of the final grade comes from exams their grade is in fact only a measure of the percentage of the content <em>of the exams<\/em> that they have mastered. Of necessity the exams include only a fraction of the course material that was taught.<\/p>\n<p>In a gamified design students are assessed on the work they do over the term, and although final exams are still possible, they should could towards the final \u2018score\u2019 in the same way as all other work. If students manage to earn 1000 points throughout the term, then why should they be made to write a final exam? Haven\u2019t they already demonstrated their mastery of the material?<\/p>\n<p>I&#8217;ve heard people express concerns over\u00a0rigor &amp; accountability in criterion referenced assessment but that can be done quite easily by setting appropriate standards for the work that is submitted.<\/p>\n<p>I suspect that many of the concerns come from experience with the kind of assessment that I&#8217;ve seen myself in some education programs where it is assumed that everyone who tries at all gets an A. I&#8217;ve been in classes like that. It&#8217;s really annoying for those who want to EARN their A&#8217;s, and yes, it can make it seem like CRA lacks rigor. Done right, it actually has MORE\u00a0rigor &amp; accountability than NRA.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-4994\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm-300x225.jpg\" alt=\"2012-01-08-14-00-45_wm\" width=\"300\" height=\"225\" srcset=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm-300x225.jpg 300w, http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg 640w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><a href=\"http:\/\/www.reigeluth.net\/\" target=\"_blank\">Just to keep things organized: these are\u00a0Reigeluth&#8217;s <\/a>8 core ideas for a new post-industrial paradigm of instruction:<\/p>\n<ol>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 1\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/13\/8-part-series-on-gamification-as-a-post-industrial-paradigm-of-instruction-part-1\/\">Learning-focused vs. sorting focused.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 2\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/14\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-2\/\">Learner-centered vs. teacher-centered instruction.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 3\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/15\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-3\/\">Learning by doing vs. teacher presenting.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 4\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/16\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-4\/\">Attainment-based vs. time-based progress.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 5\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/17\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-5\/\">Customized vs. standardized instruction.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 6\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/18\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-6\/\">Criterion-referenced vs. norm-referenced testing.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 7\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/19\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-7\/\">Collaborative vs. individual.<\/a><\/li>\n<li><a title=\"8 Part Series on Gamification as Reigeluth\u2019s Post-industrial Paradigm of Instruction: Part 8\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/20\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-8\/\">Enjoyable vs. unpleasant.<\/a> [1]<\/li>\n<\/ol>\n<p><a href=\"http:\/\/minkhollow.ca\/Gamification\" target=\"_blank\">For more on my gamified approach to course design, see here.<\/a>\u00a0<a href=\"http:\/\/minkhollow.ca\/Gamification\/doku.php?id=book-toc\" target=\"_blank\">I am working on a book that should be out in 2016.<\/a><\/p>\n<ol>\n<li>C. M. Reigeluth, &#8220;Instructional Theory and Technology for the New Paradigm of Education,&#8221; <em>Revista de Educaci\u00f3n a Distancia, <\/em>vol. 11, Sept. 30 2012 2012.<\/li>\n<\/ol>\n<div class='wp_likes' id='wp_likes_post-5016'><a class='like' href=\"javascript:wp_likes.like(5016);\" title='' ><img decoding=\"async\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/plugins\/wp-likes\/images\/like.png\" alt='' border='0'\/><\/a><span class='text'>Be the first to like.<\/span><\/p>\n<div class='like' ><a href=\"javascript:wp_likes.like(5016);\">Like<\/a><\/div>\n<div class='unlike' ><a href=\"javascript:wp_likes.unlike(5016);\">Unlike<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p><span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> 2<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>Criterion Referenced vs Norm Referenced Poor Norm. He is doomed to be compared against whoever signs up for the same class as him. Doesn&#8217;t matter what he can do, it seems, it only matters how he\u00a0measures up to what everyone &hellip; <a class=\"more-link\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/18\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-6\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":4994,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3,360,9,352,24],"tags":[389,126,16,368,393],"class_list":["post-5016","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-academia","category-book","category-educational-technology","category-gamification-2","category-teaching-learning","tag-educational-technology","tag-gamification","tag-instructional-design","tag-reigeluth","tag-teaching-learning"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg","jetpack_shortlink":"https:\/\/wp.me\/p4Hsb6-1iU","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":5019,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/19\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-7\/","url_meta":{"origin":5016,"position":0},"title":"8 Part Series on Gamification as Reigeluth&#8217;s Post-industrial Paradigm of Instruction: Part 7","author":"Katrin Becker","date":"July 19, 2015","format":false,"excerpt":"Collaborative vs Individual For the rest of their professional careers, most graduates will be working in teams rather than individually.\u00a0 We need not only to provide more opportunities to allow them to work in teams, but we must help them learn how to work in teams and find better ways\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":5470,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/09\/03\/gamification-1016-scoring\/","url_meta":{"origin":5016,"position":1},"title":"Gamification 101[6]: Scoring","author":"Katrin Becker","date":"September 3, 2015","format":false,"excerpt":"This is Part 6\u00a0in my continuing saga of my current iteration of a gamified course. In a course where assessment is primarily attainment\u00a0based\u00a0rather than time-based, and that uses\u00a0criterion-referenced rather than\u00a0norm-referenced measures, getting the learning tasks (assignments, quests, etc.) right is key. I give my students lots of choices when it\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/09\/scorecard-10-Notes.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/09\/scorecard-10-Notes.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/09\/scorecard-10-Notes.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/09\/scorecard-10-Notes.png?resize=700%2C400 2x"},"classes":[]},{"id":5022,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/20\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-8\/","url_meta":{"origin":5016,"position":2},"title":"8 Part Series on Gamification as Reigeluth&#8217;s Post-industrial Paradigm of Instruction: Part 8","author":"Katrin Becker","date":"July 20, 2015","format":false,"excerpt":"And so, we come to the last part: Enjoyable vs Unpleasant Students deserve transparency in the way they are to be assessed. In fact, there are two key questions to which every student should be able to expect an answer when asked to perform some learning activity: 1) \u201cWhy am\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":5990,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/11\/10\/gamification-10120-bona-fide-criterion-referenced-assessment\/","url_meta":{"origin":5016,"position":3},"title":"Gamification 101[20]: Bona Fide Criterion-Referenced Assessment","author":"Katrin Becker","date":"November 10, 2015","format":false,"excerpt":"If we really intend to assess people according to described criteria, and if we really want to let go of the simpler time-referenced assessment, then we should be willing to accept evidence created by our students regardless of when, where, or why it was created, right?","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"DBSK11","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/11\/DBSK11-208x300.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":4991,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/13\/8-part-series-on-gamification-as-a-post-industrial-paradigm-of-instruction-part-1\/","url_meta":{"origin":5016,"position":4},"title":"8 Part Series on Gamification as Reigeluth&#8217;s Post-industrial Paradigm of Instruction: Part 1","author":"Katrin Becker","date":"July 13, 2015","format":false,"excerpt":"In his landmark paper describing what the new post-industrial paradigm of instruction should look like, C.M.Reigeluth outlines 8 core ideas: Learning-focused vs. sorting focused. Learner-centered vs. teacher-centered instruction. Learning by doing vs. teacher presenting. Attainment-based vs. time-based progress. Customized vs. standardized instruction. Criterion-referenced vs. norm-referenced testing. Collaborative vs. individual. Enjoyable\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":5012,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/17\/8-part-series-on-gamification-as-reigeluths-post-industrial-paradigm-of-instruction-part-5\/","url_meta":{"origin":5016,"position":5},"title":"8 Part Series on Gamification as Reigeluth&#8217;s Post-industrial Paradigm of Instruction: Part 5","author":"Katrin Becker","date":"July 17, 2015","format":false,"excerpt":"Customized vs Standardized This idea should include customized content as well as customized methods. I recognize that it may not be\u00a0practical to do this individually in a large class - but\u00a0it is possible in smaller classes. What is possible, even in a large class (I know because I've done it)\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2015\/07\/2012-01-08-14-00-45_wm.jpg?resize=525%2C300 1.5x"},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/5016","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/comments?post=5016"}],"version-history":[{"count":9,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/5016\/revisions"}],"predecessor-version":[{"id":5165,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/5016\/revisions\/5165"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/media\/4994"}],"wp:attachment":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/media?parent=5016"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/categories?post=5016"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/tags?post=5016"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}