ProfHacker A Rubric for Evaluating Student Blogs September 27, 2010, 11:00 am By Mark Sample The pedagogical value and the challenges of integrating student blogging into your teaching is a recurring topic on ProfHacker. Some of our earliest posts dealt with student blogging, and we have revisited the issue frequently. Most recently, Jeff and Julie wrote about that age-old question—How are you going to grade this?—when it comes to evaluating classroom blogs. Jeff and Julie offer a number of fantastic pointers, and they also refer to a blogging rubric that I use in my own teaching. I’ve never directly described how I grade student blog posts on ProfHacker, but I think it’s about time to share what has been a valuable tool, and to encourage professors to adopt and modify it to fit their own needs. I typically require weekly blog posts from my students, and though each post by itself may not amount to much, they cumulatively account for a substantial portion of a student’s final grade. For example, in a recent graduate class on postmodernism, I required once-a-week postings that added up to 20 percent of the final grade: Each student will contribute to the weekly class blog, posting an approximately 500-word response to the week’s readings. There are a number of ways to approach these openended posts: consider the reading in relation to its historical or theoretical context; write about an aspect of the day’s reading that you don’t understand, or something that jars you; formulate an insightful question or two about the reading and then attempt to answer your own questions; or respond to another student’s post, building upon it, disagreeing with it, or re-thinking it. In any case, strive for thoughtfulness and nuance. To ensure that everyone has a chance to read the blog before class, post your response by midnight the evening before class. Because these posts are online well before class meets, I am able to skim them for recurring themes or concerns, which I often use as beginning points for class discussion. In this way, the blogs have been invaluable in preparing me to meet my students at the outer edges of their understanding of the material. But when you have 15 or 25 posts per week, per class, how do you grade them all? How do you let students know what kind of work you value?—And what kind of work they should likewise value? Assessing the enormous number of posts on the class blog is challenging, to say the least. In my efforts to quickly and fairly evaluate blog posts, I developed a simple 5-point scale, which rates each post according to the level of critical thinking and engagement displayed in the post. The rubric is quick and easy and in roughly 1–2 minutes I know what to rate any given blog post: Rating Characteristics 4 Exceptional. The blog post is focused and coherently integrates examples with explanations or analysis. The post demonstrates awareness of its own limitations or implications, and it considers multiple perspectives when appropriate. The entry reflects in-depth engagement with the topic. 3 Satisfactory. The blog post is reasonably focused, and explanations or analysis are mostly based on examples or other evidence. Fewer connections are made between ideas, and though new insights are offered, they are not fully developed. The post reflects moderate engagement with the topic. 2 Underdeveloped. The blog post is mostly description or summary, without consideration of alternative perspectives, and few connections are made between ideas. The post reflects passing engagement with the topic. 1 Limited. The blog post is unfocused, or simply rehashes previous comments, and displays no evidence of student engagement with the topic. 0 No Credit. The blog post is missing or consists of one or two disconnected sentences. I strive for as much transparency as possible, so it’s essential that my expectations (i.e. the rubric) are explained to the students early on, and always available for them to review later. I also let the students know what their grades are for each post, using my university’s officially sanctioned method of transmitting student grades (that is, Blackboard). Grades are of course a superficial way of showing students what we value. Direct and immediate descriptive feedback does more than a single letter or number can. So in order to deepen students’ understanding of their own work, I comment on every student’s blogging at least twice throughout the semester. These are public comments, posted below each student’s blog post, again contributing to the collaborative and transparent ecosystem of the blog. How about you? If you ask students to blog, how do you evaluate their efforts? Do you have a rubric to share or other tips for our readers? COMMENTS gideonburton - September 27, 2010 at 12:13 pm It is important to distinguish between the evaluation of a blog post (which your rubric is for) and the evaluation of a blog as a whole (which I think is your larger question when you ask about grading them all). I use a simple quantitative expectation (two posts per week) combined with a qualitative, holistic evaluation given in person during a monthly interview. The students need to feel the freedom to blog informally and frequently, and holding them to high standards for each post is both impractical for the teacher and ineffective for the student. The quantitative expectation gets them blogging; the qualitative gets them blogging better. I publish an explicit list of criteria for good blog posts and each class period take time to point out student posts meeting the criteria. Without micro-evaluating each post, their posts increase in quality. Prior to meeting with students individually (monthly), I require them to do a reflective blog post in which they evaluate how well they have met the learning outcomes and blogging criteria. I have also had success in having students use the published criteria to evaluate one another’s blogs (at end of term). This helps me to read students’ blogs more efficiently, and provides proof of how well a student understands criteria when applying them to another’s work.It is critical that blogs not be evaluated as though they are the static, formal, text-only monologues that traditional papers are. They must be evaluated as the living things they (hopefully) have become. This means teaching the value of informal communication and interactivity as much as more formal analysis of ideas. It means teaching concision of communication and designing posts to be attractive both visually and intellectually. It means addressing the function of blogs in building ethos and the online presence of the student; the effective use of media to complement text; linking and referencing; and especially the social nature of digital knowledge. Measuring engagement must include measuring how well they have literally engaged audiences, not just ideas. This is one reason why I require students to comment on others’ blogs (including blogs of those outside of their school), and to contact experts currently working in the topic area of their blog (using what I call “social discovery”). Blogging isn’t learning how to analyze and publish ideas; it’s about acquiring digital literacy, and that literacy is profoundly media-rich and socially mediated. Any rubric that ignores these factors (or that insists on each post being a miniature polished academic essay) reveals a lack of understanding of what blogs are and do. These are the criteria that I use for the research blogs I assign (spelled out in detail at http://bit.ly/blog-criteria):-development-focus-cohesion-post variety-personalitycurrency / history-sources-interactivity-community-analysis-length-links-media-designquantityI’m also happy to point people to example research blogs from my students.Gideon BurtonBrigham Young Universitywakingtiger@gmail.com mark_sample - September 27, 2010 at 1:29 pm @gideonburton: Thanks for you detailed comments, and your own criteria. I agree that we shouldn’t treat blog posts as traditional papers; the reason I use student blogs in the first place is to carve out an intellectual space in which students feel free from the conventions of academic essays. I often describe the blog as a low-stakes place to try out new ideas and play with different voices and tone. I also do something similar to your reflective blog post, and in fact I’ll be writing about this “blog audit” very soon on ProfHacker… karen_franker - September 27, 2010 at 2:59 pm Mark – Thanks for your excellent posting! I was very interested to see your criteria for evaluating student blogs.Here’s a new blog rubric that I recently created for the University of Wisconsin-Stout: http://www.uwstout.edu/static/profdev/rubrics/blogrubric.htmlIt is intended for the assessment of individual student blog entries, including comments on peers’ blogs.Karen FrankerInstructor, Online Professional DevelopmentUniversity of Wisconsin-Stout. v8573254 - September 27, 2010 at 5:41 pm We start with this one: https://my.wsu.edu/portal/page?_pageid=177,276578&_dad=portal&_schema=PORTAL It is a bit more complex than the one presented here, but in our work we have found more sophisticated rubrics, when used well, yield better outcomes. For instance, from a novice users point of view, what is the difference between “in depth engagement” and “moderate engagement”? Rubrics that are educative help define quality as well as describe the judgment in terms that are not simply…judgmental. tishaturk - September 28, 2010 at 9:10 am I like the language of your blog evaluation rubric, Mark, and may be adapting some of it for my own classes; thanks for sharing it!I haven’t had students write blog entries as such; my primary interest in using tech tools is encouraging students to interact with each other, and classroom blogs don’t necessarily facilitate that interaction. Too often, they’re just standard response papers moved online — valuable in their own right, certainly, but not what I’m aiming for. Instead, I have students post regularly to the online forum component of our course software. Each student is responsible for posting something very much like the blog posts you describe here, but they do so only two or three weeks out of the semester (depending on the number of students in the class). The other weeks, they’re responsible for commenting — either on one of the main posts or on another comment. Comments can be shorter than main posts, perhaps just a substantive paragraph or two. So each week we have two or three thoughtful posts that respond to the material in some depth, and then a series of comments taking up threads of those posts and examining them in more detail and from multiple perspectives. The result is more of a genuine conversation than a series of monologues; over the course of a semester, a distinctive discourse community usually starts to emerge. Like you, I find that reading these posts (and comments!) before class gives me a much clearer sense of students’ points of interest and confusion. But the post/comment model also, I think, gives students a sense of the (sometimes quite subtle) differences between posts that are “good” and posts that not only are good but actually prompt conversation. It’s typically the most tentative and exploratory posts, rather than the more polished performances, that open up space for others to respond in complex ways, and I think that seeing this difference in practice, more than any assessment from me, changes the way in which students approach posting over the course of the semester. michaelnelson - September 28, 2010 at 1:24 pm I like Marks’ rubric and may try to incorporate some of it into the criteria I use in future courses.Like some of the others, I evaluate the blog posts students write as a collective body of work. I also provide a provisional “midterm” grade on their blog posts that includes substantive feedback on what they have done and how they can improve.The instructions for students and grading rubric are on this page of my course website: http://africanworldpolitics.site.wesleyan.edu/work-policies/ djplaner - September 29, 2010 at 1:40 am The original rubric we used is here http://webfuse.cqu.edu.au/Courses/2007/T2/COIS20025/Assessment/Item_3/Criteria/It has some similarities with the rubric Mark described.Some description of the rationale for and design of blogs in the course is described in this paper http://davidtjones.wordpress.com/publications/blog-aggregation-management-reducingthe-aggravation-of-managing-student-blogging/Arising out of this work is the Moodle activity module called BIM. BIM is designed to help integrate the marking of externally hosted student blogs into the Moodle LMS, its gradebook, groups etc. more information on BIM can be found here http://davidtjones.wordpress.com/research/bam-blog-aggregationmanagement/ robertwgehl - September 29, 2010 at 11:03 am Mark -This is really useful. I especially agree with the need to comment on blog posts. I’ve found that if I simply write a brief note, something like “That’s a great point. I hadn’t thought about X…”, the students respond to that. One week when I was not feeling so great, I didn’t do that as much, and the students came up in class and asked what they were doing wrong. Just like we bloggers crave comments, Tweets, and feedback, students crave feedback beyond the letter grade. 11888233 - October 11, 2010 at 7:44 pm I am curious, do your institutions have guidelines for student blogs? Are they posted on the web or on an internal site? Do students post under their own names? These are some of the issues I am dealing with at the college where I am dean. crandavj - October 12, 2010 at 1:14 pm Our college uses the blog feature of Blackboard. The guidelines for posts on blogs are included in the general policies for student use of college computational and network resources. These include the netiquette matters of flaming, obscenity, defaming, etc. In my courses students post under their own names.