Earl’s Library of Universal Knowledge. Thanks to roberthuffstutter on Flikr for making this image available.

OH. MY. GOSH. THIS. IS. GOOD! Read this: A Letter From a Hybrid Student

Then think about these two points that Teo makes:

1) “…it takes courage to assert that one’s life is a legitimate classroom.”

2) “Our lives are our source material; our histories, a text worthy of exploring in community.”

Then consider that Prior Learning Assessment allows this assertion to gain ground and to have higher educational value – that is, that students can articulate their life-as-classroom learning and earn college credit for it.

We could say: “Good for you, you know a lot! You are learned! You are intelligent! You are knowledgeable!” Which is all true.  But the message that often comes with that (mostly from employers) is also, “…but you don’t have a degree.”

PLA addresses this issue – it helps students claim and earn credit for their knowledge (some say it legitimizes knowledge that adult learners come to college with, but I don’t believe that this knowledge is illegitimate prior to a credit or two being associated with it).

Just watch these student videos – hear their perspectives, their voices. Did they get credit for their experience? NOPE – for their learning!

Life is a legitimate classroom.

Here is a recent article that speaks to PLA, and a quote from me about how it can have quality and integrity:

College Credit Without College

Sleazy prior learning practices still exist, says Melanie Booth, dean of learning and assessment at Marylhurst University.

“There are some PLA programs out there that look like credit laundering,” she says. For it to hold water, “you’ve got to translate your experience to academic knowledge.”

– WE BREAK HERE FOR A TEACHABLE MOMENT –

Hear that students of mine? Peer Review! Yep – just like we do in our class, this process asks us reviewers to use criteria (“standards”) to assess how well we think an institution is doing based on their self-assessment report (called a “self-study”), interviews with lots and lots of people (including students), and direct evidence (such as meeting minutes, syllabi, catalogs, etc.) And you all thought I came up with peer review as a way to lighten my paper-reading load. NOPE – it’s about learning with and from others.

BACK TO MY POINT …

First, let me share with you a few fun facts about serving on an accreditation team. For one thing, you get to travel to beautiful and exotic places. For my first visit, this was my office:

For the second, this:

(Ok, ok. I took those pictures while on accreditation visits, but I really didn’t get to hang out and work right there, in the midst of that beauty. Well, except for the top one. I really did write half the report looking at that view. But of course, that’s not always the case. To be fair, I’ve heard colleagues talk about writing accreditation reports from truck stops and Denny’s restaurants.)

Serving on a peer review team is a fabulous learning experience. I learned not only from the institutions I visited, but also from my teammates. I have new ideas and strategies to bring back to my institution, and a new set of colleagues in my network. When serving on a team, you get to know other folks from other institutions who are serving with you, and because you may be tackling tough problems together in a condensed period of time (often working together into the wee hours of the night), you tend to get to know each other pretty well. In both cases this spring, I developed neat collaborative relationships with the team members, and many of us still keep in touch.

The peer review part of accreditation can present learning opportunities for an institution’s students too. A student at one institution covered the accreditation visit by writing two stories for her campus newspaper to help her fellow students know what was happening. The first was a “hey, they’re coming” story, and the second was a “hey, I had lunch with them” story. Read them here:

University makes progress with accreditation renewal

Food for thought: Accreditation luncheon

Finally, if institutions are amenable to constructive feedback (as we all should be) and if they see the process as one of genuine self-reflection and assessment in order to keep doing what works and change what doesn’t, they learn and improve too. To be clear: the reports are not easy to write or put together; looking in the mirror and calling attention to your flaws isn’t exactly a party (though you also get to call attention to your beauty marks, and identifying those can be rewarding). My own institution is a great example of the learning and improvements that can come from the process.  We have made huge improvements in how we educate and serve students since our last accreditation visit as a result of our self-assessment and feedback from peers about our practices. And it’s all good because it’s all learning.

All in all, accreditation sometimes gets a bad rap because it’s tangled into real and legitimate issues of compliance, accountability, and in some cases fear. A recent column in The Chronicle of Higher Education makes a compelling point for why faculty should get involved accordingly:

But it’s time for college and university faculty to start paying attention to this seemingly dry issue. Further, it’s time they joined the effort by administrators and accreditors to resist the government’s increasing intrusion into accreditation. That intrusion endangers both academic freedom and the unique American system of separation of the academy from the state.

Ultimately, if we really want to improve higher education, and if we want opportunities for learning and developing networks with others, participating in a regional accreditation process can be a great way to do so. If anything, through our participation and engagement, we can help accreditation be focused on learning and improvement for everyone, including regional accrediting agencies themselves.

• Listening
• Small Group Communication
• Leadership Communication
• Health Information Management
• Conflict Management
• Organizational Communication
• Nonverbal Communication
• Great Meetings
• Strategic Listening for the Workplace

In her final PLA Reflection Essay, Jennifer shared that writing for PLA credits was a rigorous process that she found difficult, thought-provoking, and entirely rewarding.  She also commented,

The successful PLA student must be able to objectively reflect upon her life experiences, and must be able to commit to the Prior Learning Assessment process. Being a successful PLA student myself, I feel part of an elite group of uncommon individuals. I know that this is an experience that I will reflect upon for the rest of my life.

In this video Jennifer shares her experience in the PLA program – the challenges, the benefits, and also some great tips for current or future PLA participants.

• Listening
• Public Speaking
• Child Development: Prenatal through Age Eight
• Child Development: School Age through Adolescence
• Infant /Toddler Caregiving
• Apparel Construction
• Beginning and Intermediate Word
• Introduction to Catholicism
• Louisiana History

 In her Final PLA Reflection Essay, Amy wrote, in part,

As the process was challenging me in academic ways as well as time management, goal setting, managing priorities, problem solving, researching and writing, I see that it was also preparing me for my years at Marylhurst. Each term I attend Marylhurst, I know that I will be challenged in each one of these areas. My experience with the PLA process has given me the foundation I need to be able to excel in all of my undergraduate course work.”

Amy talks more about her PLA experiences here:

"This Is Art, Not Food!" Artist: Mac (4 years old)

The OIA Blog (a blog written by the Office of Institutional Assessment of SCAD) published a piece called Abstraction in Art and Assessment. These two key paragraphs struck a chord with me (I added the bold for emphasis):

It became clear to me that the more abstract an image is, the more I can focus on its essence.  I will not become distracted by the details of the content, but instead focus on the overall beauty of the  shapes and colors.  Taking the focus away from technical mastery, modern movements bring to focus the main reason why I choose to look at art in the first place -  the emotion attached to looking at something familiar in new light.  This same thought explains why I value program assessment.  Program assessment, when done right, should allow faculty to look at their student’s course work – the same course work they grade in class -  in a new light.

The relationship between modern art and more traditional forms of art is a great metaphor to explain the relationship between program assessment and course assessment.  Program assessment (or modern art) is a more abstract form of course assessment (or traditional art).  Program assessment should evoke the essential features of student work -  the technique, the process, and the level of creativity and maturity – in order to measure how well the program is meeting its standards.  On the other hand, course assessment details every element of an assignment (scale, color, spatial awareness, supporting documentation, installation, etc.) in order to provide student’s with specific feedback for improvement.  Neither type of assessment is better than the other, both are equally important 1) because they provide information for different audiences and 2) because they are dependent upon each other.    Just as Miro’s expression of form in The Dutch Interior is dependent on the content in Sohr’s The Lute Player, so are the overarching themes of program assessment inextricably linked to the multiple elements of a course assessment.

The idea of using program assessment to see student learning in a new light is intriguing, as are the analogies of modern art to program assessment and traditional art to course assessment. I especially appreciate the idea that assessment in the course is feedback intended to extend students’ learning and development.

My main take away from this post is really about the importance of aligning our intentions across the different levels of learning and assessment. Are our intentions for student learning in courses aligned to our intentions for student learning in our programs and then, across an institution? If the intentions — often stated as learning outcomes — are in alignment, then we can see the trees (assessment of student learning in courses), the forest (program assessment), and the entire ecosystem (institutional assessment). And as the OIA article points out, indeed, we may use different lights and different lenses to see and to appreciate learning at each level.

RECOMMENDED RESOURCE

The Levels of Assessment white paper from AAC&U is a helpful overview of alignment of learning and assessment at various levels, and is a resource I often use to think about the relationships between individual student learning, learning in courses, learning across programs, and what the institution as a whole intends for student learning.

• Interpersonal Communication
• Business Ethics
• Real Estate Practices
• Solving Communication Problems with Technology
• Listening
• Customer Relations
• Sales
• Persuasion, Argumentation, Debate
• Computer Concepts

In Jodie’s Final Reflection Statement she wrote:

After writing seven essays and against the recommendation of my instructors, I decided to take a term off from PLA. I was so excited to delve into my core classes and obtain new learning. Ultimately it did not do me any favors when I went to finish up the last two essays…My eighth essay was an incredible struggle…I had to relearn the structure of Prior Learning…I should have kept on the motivated wave of writing and finished. It is the greatest lesson I can pass along to all those interested in moving ahead in their college career with PLA.

Jodie shares more PLA insights here:

One of the final summary points he makes about the “post-course” era is this (I added bold for emphasis):

Finally, we need to take the problem of learning in the post-course era very seriously. The learning we are coming to value most is not always where we are putting our greatest interest and effort in assessment, including the emerging discussions about “learning analytics.” To be sure, we should work very hard and carefully to align, document, and capture our current assessments of student learning; at the same time, we should be attentive and ambitious in figuring out how we want to cultivate and evaluate learning in this expansive environment.

He makes a good point: we need to talk about what I am calling “disrupting assessment.” I think this idea nicely works with the Assessment 2020 work coming from the Australian Learning & Teaching Council. The first — and in my mind most significant principle — framing this work is as follows:

Assessment is a central feature of teaching and the curriculum. It powerfully frames how students learn and what students achieve. It is one of the most significant influences on students’ experience of higher education and all that they gain from it. The reason for an explicit focus on improving assessment practice is the huge impact it has on the quality of learning.

Assessment has become a fraught word and unpopular concept because it’s become separated from learning and because it may often be used to “measure” the least important things we do (borrowing a phrase from my Provost). But it can and should serve learning — students’ learning, our learning as individual faculty and administrators, and our organizations’ learning. Why have we disconnected assessment from learning? Why have we focused on assessment OF learning instead of FOR and AS learning? Because we need institutional accountability? Some say so! (And to be fair, sometimes I am some of the “some.” More on this later…)

Image generously donated for use in this post by Noah Henscheid (noahhenscheid.com).

I keep coming back to the philosophical statement about assessment from CSU Monterey Bay (which I’ve written about before, HERE):

Assessment is a dynamic pedagogy that enhances, extends, supports, and expands student learning.

I think this is where I begin to connect important principles of  Prior Learning Assessment to disrupting assessment in higher education. PLA  is about prior learning chronologically, but more importantly perhaps, it is also about learning that occurs outside of, as Bass describes, “bounded, self-contained courses.” PLA is typically not about measurement or accountability; PLA, when done well, IS about students’ critical reflection on their outside-of-college-courses experiences, and the process of reflection (of making the implicit explicit, of making meaning, of constructing knowledge) helps turn their experiences into learning (as Boud, Keogh, and Walker contributed in their book Reflection: Turning Experience Into Learning; Boud, by the way, is a primary author of Assessment 2020, so perhaps it comes as no surprise that there’s a connection for me here – whereas some people like to play the game 6 Degrees of Kevin Bacon, I seem to be playing the game 6 Degrees of David Boud).

PLA is both about assessing learning and generating learning by reflecting on learning. PLA, as an assessment “method,” is learning! It is “a dynamic pedagogy that enhances, extends, supports, and expands student learning” in all sorts of ways! What if assessment in general could also be about reflective practice — ours and our students? Wouldn’t that be cool?

In 2000, Thomas wrote a piece about PLA as a “quiet revolution,” in which he asserted that PLA as a movement challenges formal educational systems, which not only define knowledge but also define how knowledge should be learned (and thus, perhaps by extension, assessed). Well now, as Bass has pointed out, there are myriad other things challenging these formal educational systems as well. So perhaps it’s time for PLA to be an unquiet revolution — to become an integrated force (along with all of the other forces outlined by Bass) that helps us disrupt assessment. I like this energy, and I believe it lines up with Bass’ call to action, accordingly:

If we are beginning to see that the greatest impact on learning is in these boundary-crossing, integrative, and socially networked experiences, then we need to re-create dimensions of these experiences in the learning designs that bridge the classroom with life outside of it.

I want this bridge to be anchored by the quiet but revolutionary ideas about learning and assessment and reflective practice that PLA has been putting on the table for the past 40+ years. In doing so, we can disrupt assessment in order to connect it to much more meaningful ventures.

___________

Boud, D. et al (eds.) (1985). Reflection. Turning experience into learning, London: Kogan.

Thomas, A. (2000). Prior learning assessment: The quiet revolution. In A.Wilson & E. Hayes (Eds.). Handbook of Adult and Continuing Education. (pp. 508-522). San Francisco: Jossey-Bass.

O this learning, what a thing it is! ~Grumio in Taming of the Shrew, William Shakespeare

Twice this past month I’ve heard the word “fear” used by faculty when referring to their experience of assessing student learning in their courses. One person described it as fear of students disagreeing with their grade or feedback, or generally unhappy with the judgment the instructor made about their work and requesting explanation and justification (much of which could be alleviated, I thought, if the instructor made the criteria transparent to students, or even better, if the criteria were collectively developed with students, but I digress…).

Thanks to Jimee, Jackie, Tom & Asha on Flickr for making this photo available for use.

The other person described her fear that she lacks the ability to discern quality and to really be able to tell what a student has learned. She described her lack of confidence in using a writing rubric to “judge” what about a student’s writing, as exemplified in a single assignment, is exceptional and what is developing (and every shade of grey in between). I appreciated her honesty with this challenge; I’ve certainly faced it as well (though in my case, “fear” was not a word I used to describe what I experienced as a “bleepin’ assessment conundrum!”). Nonetheless, her description reminded me of something from Parker Palmer’s The Courage to Teach: “Teaching is a daily exercise in vulnerability.”

So, too, is learning.

I am pretty certain that learners fear assessment as well, which is truly unfortunate and totally not necessary, and in the end, adversely affects our ability to learn. When faculty work from a “gotcha” perspective, of course assessment is something to fear! I remember a Shakespeare course I took in college that made me have night terrors; I couldn’t sleep that term because that class and that prof were seriously scary. Our final grade consisted of our scores on 5 tests: a test after each unit (comedy, drama, history, and what was the other??? – poetry, I guess), and the big ugly final exam, 3 hours of closed book / closed notes mental torture. These tests were tricky because they were designed as “gotcha” tests (including the essay part of the tests, for which we could use only one side of a single piece of unlined white 8.5 x 11″ paper to address the topic, for no clear reason other than the prof didn’t want to read more than what could fit in this designated space). It was always obvious from the smirk on his face and comments under his moldy breath that the curmudgeonly old prof enjoyed this process. These tests didn’t in any way advance or enhance my learning (I memorized a lot of Shakespeare that term but I didn’t learn any of it except for a few random quotes I can pull out of my head for cocktail parties or blog posts); they didn’t help me appreciate Shakespeare in new ways, or connect important themes or ideas to topics I was interested in. They freaked me out! Why was that necessary?

And now there is something else to fear: David Brooks, writing this op-ed piece in The New York Times, has called for value-added assessments.

Colleges have to test more to find out how they’re doing . . . There has to be some way to reward schools that actually do provide learning and punish schools that don’t. . . This is the beginning of college reform.

To which I reply: ARE YOU SERIOUS? How will THIS advance learning on the part of students, and on the part of faculty and institutions? Punish schools that don’t. Really? Punishment creates fear; punishment creates distrust. And fear and distrust do not promote learning — for students or any of us! I don’t disagree that we need to know how we’re doing … we do! We really, really do! But I absolutely believe that this approach is completely antithetical to actually promoting learning (note that I didn’t say “producing” learning, the term Brooks used, as if learning were something that gets assembled on a conveyor belt). This approach will foster fear; fear inhibits learning. Period.

Colleges (and faculty) have to remove fear first — this should be the beginning of college reform. I think it was Shakespeare who once wrote:

Things done well and with a care, exempt themselves from fear.

Thanks to Claudia M&M on Flickr for making this image available for use.

Joshua Brown, the editor of Research & Practice in Assessment (published by the Virginia Assessment Group), wrote in his From The Editor column in the Winter 2011 issue this interesting idea about assessment paradigms:

Whereas Western art focuses upon the freedom to move images around on paper or canvas to create fixed patterns, origami ignores the separation between the image and the paper. The paper becomes part of the image, and is twisted and folded until it is the picture, not merely the surface on which it lies. -John D. Barrow, The Artful Universe

Just as the artist of origami has a different approach to perceiving the relationship between image and paper, the thematic focus of this issue invites inquiry as to whether assessment might adopt similar connecting paradigms. In establishing and executing assessment initiatives, there are places where our focus is predominantly one of separation – our rubrics have multiple levels of competencies, item correlation allows us to maximize the efficiency of our scales, and purpose statements or objectives are arranged in a structured hierarchy. We strive for increased validity and reliability, but even good research techniques possess implications regarding their social, psychological, and educational contexts. There is an ongoing tension between focusing on the trees while at the same time giving appropriate attention to the forest.

As such, it is worth considering, to what extent can assessment also function as a mechanism that connects broader realms rather than one which at times is noted for solely focusing on measurement or standardization? In addition to its dominant descriptive or defining properties, is it possible for assessment to also possess generative properties? [bold added here for emphasis] I am not positing these philosophical assessment questions to establish rigid dichotomies. In fact, it may be more beneficial for me to ask these of my own assessment practices. While aiming to achieve the utilitarian ideals of efficiency and effectiveness, is it also possible for me to construct my assessments in a manner that advances good human behavioral, educational, and social theory? Is it really possible for me to look at a Scantron sheet in a manner that resembles the philosophical paradigm of the origami artist?

The paradigm of the origami artist … assessment as generative, as learning … paper and image as one … learningteachingassessmentlearningteachingassessmentlearning.

This poses assessment as a part of learning; learning as a part of assessment; the two entwined in meaningful ways. Not assessment of learning, but for and as learning.

From here on out I will see myself as an origami artist, connecting paper and image to become one, to generate, to advance, to learn.  In fact, perhaps the best use of a Scantron sheet might be to fold it into a bird so that it might fly away … far, far away.

2nd (and 3rd, and 4th) chances are vital. From Indexed.

Venn diagrams such as this are a great way to show intersections. I’ve been playing around with a few of my own. Here’s my latest:

My experience with downhill skiing

It clearly shows the relationship between three things that should probably never be put together. Sometimes learning and progress are a result of keenly understanding your own limits.