Feeds:
Posts
Comments

Milestones

This is a picture of my kid with his bike at the age of 3 and 11/12 months:

This is a more recent picture of him with his new bike at the age of 4 and 30 seconds:

Some pretty major things needed to happen to get from picture #1 to picture #2. For example, in our family:

  • Four year-olds need to be able to put on their own socks.
  • Four year-olds need to make their beds when they get up in the morning.
  • Four year-olds need to take their plates to the kitchen after they are done eating.
  • Four year-olds, for goodness sake, need to feed themselves!!!

That’s right. We instituted milestones.

Milestones are constructed to provide reference points along the road. This can be used to reassure travelers that the proper path is being followed, and to indicate either distance traveled or the remaining distance to a destination. ~Wikipedia

Milestones, in this way, promote learning and help us assess how well we are doing toward a learning outcome. In the world of educational assessment, we call milestones a kind of “formative assessment.”

In my family, it’s what got us sanely from three to four.

Ok, ok, in all fairness, we really created milestones so to preserve what’s left of our parental sanity, but we also wanted the kid to have a goal (being four), to work toward something significant and important (and I quote, “Mama, I fed myself my dinner all by myself; now I can be four!”), and to have a sense of accomplishment when he got there.

The payoff for reaching these milestones? Well, not only did the kid actually turn four (which frankly seemed significant enough to all of us), but he also got that new bike in picture #2.

And guess what! To prove to us that he had in fact turned four, he ate 2 pieces of this birthday cake!

All by himself!

Bobbi Stedman, a Business and Leadership major, recently completed her Prior Learning Assessment Portfolio, earning 35 credits for knowledge that she gained through her professional and personal experiences. She wrote for the following courses:

  • Team Building: Managing Work Groups
  • Great Meetings! Planning and Facilitating Difficult Group Discussion
  • Leadership Communication
  • Managing Transitions
  • Conflict Management
  • Negotiation
  • Legal Issues of Managing Human Organization
  • HR for the Career Minded Professional
  • Creating Inclusive Trust Cultures
  • Listening Skills
  • Public Presentations

Congratulations, Bobbi!

In Bobbi’s Final Reflection Essay she wrote, in part,

My biggest ‘ah-hah’ moment was towards the end of LRN 312 when I was seriously getting tired of writing essays. My inner voice was telling me that I was getting tired and I wanted to learn and write about something that I did not already know. Then it occurred to me that the PLA process and writing itself was, in fact, teaching me something new. I was learning how to and becoming a masterful writer!

Bobbi talks about her PLA journey and simple tips for success here:

Greg Carradine, a Human Communication major, recently completed his 32-credit Prior Learning Assessment Portfolio — CONGRATULATIONS, GREG!  Greg used his personal experiences as well as those from his professional life as a high school teacher and athletic coach to demonstrate his college-level competency for these courses:

  • Effective Listening
  • Small Group Communication
  • Conflict Management
  • Nonverbal Communication
  • Planning & Facilitating Difficult Group Discussions
  • Communication of Self-Esteem
  • Team Building
  • Intercultural Communication
  • Interpersonal Communication
  • Poverty and Schooling

In his Final Reflection Essay, Greg wrote, in part, “I learned how to analyze and evaluate theoretical texts from scholarly sources and to apply this material to my own life experience.  Organizing my essays produced a continuum, and with the completion of each paper the method became smoother.”  Greg talks more about his experiences with PLA and tips for PLA students here:

Velda Metelmann recently completed her undergraduate degree in Interdisciplinary Studies, with concentrations in English Literature & Writing and Human Studies, and is now in a graduate program to earn her Masters!  Congratulations, Velda!

As part of her undergraduate program, Velda earned 25 credits for the following courses through Prior Learning Assessment:

  • Effective Listening
  • Public Presentations
  • Human Emotion
  • Publications and Performance
  • Women Working for Change
  • Readings and Special Project in the Teachings of Abd’ul-Bahá

In her Final Reflection Essay, Velda talked about how writing for PLA credits increased her confidence in her writing skills, so that now a 6-8 page term paper seems like an easy task after working on a 20-25 page PLA essay. She also commented that, “My love of writing has been increased as well as my skill in the art, and I look forward to my next terms with excitement.”

In this video Velda shares her experience in the PLA program – her enthusiasm for life-long learning is infectious!

Carleen Walsh, an Interdisciplinary Studies major with concentrations in Early Childhood Education, Psychology, and Literature, recently completed her Prior Learning Assessment Portfolio, earning 45 credits for knowledge she gained through her professional and personal experiences – that’s the maximum number of PLA credits a Marylhurst student can earn!  Here is a list of the courses Carleen wrote for:

  • Introduction to Criminal Justice
  • Introduction to Law – Fundamentals
  • Introduction to Law – Substantive Areas
  • Criminal Law
  • Litigation
  • Evidence
  • Observation and Guidance I
  • Environment and Curriculum II
  • Instructional Strategies – Reading
  • Interpersonal Communication
  • Effective Listening
  • Introduction to Christian Bible
  • Nutrition
  • Backpacking: Map and Compass

CONGRATULATIONS, CARLEEN!

One thing of note that Carleen included in her Final Reflection Essay was this:

As I was writing each essay, I was totally caught up in what I was writing about, and became aware how much knowledge I gained through different experiences.  Some of these experiences were over 10 years ago, but I was back at that time as I was writing the essay, and reading material showed me how much I know about a certain subject.

Hear Carleen talk more about her PLA experience here:

Spirituality is the eternal human yearning to be connected with something larger that one’s own ego.

BUT

This “yearning” can connect us with great evil, as well as great good.

SO

Clearly, higher education ought to be inviting students to give thoughtful consideration to the energy fields of both sorts on their way to a diploma.

~Parker Palmer, The Heart of Higher Education: A Call to Renewal ( p. 48)

Is He Learning?

Last week we received my kid’s first report card from his new school and we had our first parent-teacher conference. So you all know, Mac is 3 and 11/12ths years old and he is in preschool. So this is all new to us. The report card and the conference have me thinking about assessment (of course) because really, that’s what it’s all about. Is Mac learning what we want him to learn, and what evidence do we have to prove it?

First Official School Photo

The report card is not a card that says “A” or “C” or any other grade, but is, in fact, a rubric.  There is a description of where his learning levels are in several categories, accordingly:

(E) = Exceeding – consistently exceeding grade-level expectations; a strength

(M) = Meeting – developmentally appropriate or meeting grade-level expectations

(D) = Developing – working towards grade-level expectations

(X) – Not assessed at this time; not applicable

For each category, there are specific learning items that are assessed using this framework (some are skills; some are knowledge areas; and a lot is behavior, as you might expect for students who are 3 and 11/12ths years old). Here is an example from the listening category:

LISTENING

  • Effort – M
  • Demonstrates comprehension in the daily routine – M
  • Listens attentively to spoken language – M

(No comment here about how I would assess his listening skills. Let me just say we might have a case of grade inflation happening here. Or an inability to transfer skills from one context to another. Either way … )

Thus, across several categories and skills, we now know where his teacher sees his strengths and where we can help support his improvement. For example, he can count from 1-6 (E) and sort objects by color, shape, and size (E), but he needs more work in demonstrating self-control (D) and accepting responsibility for his own actions (D). He is doing as expected in recognizing his own name in print (M) and cutting across paper with scissors (M).

This takes us to the parent-teacher conference, which was also about assessing his learning and was evidence-based. His teacher had an iPad with about 30 pictures of Mac taken from the beginning of the year. Together, we looked at evidence of how he held a marker in September, October, and November; we were able to see differences in technique by looking at actual letters, shapes, and pictures he had drawn in an accompanying portfolio of work. She also had samples of his writing in which we saw evidence of how he wrote M – A – C in September compared to how he writes M – A – C now (not much improvement there, frankly. The M is still upside down thus spelling WAC instead of MAC. No comment…)

My point?

THIS IS ASSESSMENT, AND IT’S AWESOME!

We pose questions: What and how well is he learning? What evidence do we have? And what do we need to keep working on? And in answering these questions, we learn and his teacher learns and his school learns! Assessment = Learning = Assessment = Learning and around and around we go through the learning cycle. And we love it because we care.

Overall, Mac seems to be learning and doing pretty well in school (which is awesome considering that he is 3 and 11/12ths years old and has trouble listening … but apparently only with us). To provide further evidence that he is learning, here is a conversation between Mac and his dad this morning:

Mac: I want to wear these pants today.

Dado: Cool! These are cords!

Mac: Oh – I can’t touch those. I am not supposed to play with cords. They’re dangerous!

This after yesterday’s moment of inquiry, accordingly:

Mac: After the champion wins, is that when they get the chips?

Dado: The chips? What chips?

Mac: Yeah, the champion chips, Dado.

(Yep – most certainly grade inflation.)

I recently wrote about the great benefits I am getting from learning visits — as visitor and visitee (is that a word? Well, you know what I mean). A few colleagues who read that piece have since had some questions for me, mostly about logistics. So I thought I would jot down some tips for planning a learning visit.

FIRST: WHAT DO YOU WANT TO LEARN?

The first step, of course, is to identify what you want to learn. What would the learning outcomes of a visit be? Surely you will learn stuff you didn’t know you wanted to learn too, but if you can identify a focus for yourself and your institution, proposing a visit and the visit itself will be a lot more focused.

For example, for my recent visit to a university in SoCal, I identified these focus areas and shared them with my colleague there:

  • What you are doing with Liberal Arts assessment, specifically using the VALUE rubrics and your institution’s core revision process?
  • What the librarians are doing with their assessment work?  (You’d mentioned that they were using SAILS – I’m wondering if it would be possible to meet with them to learn more about how they are doing assessment?)
  • A sense of how the Assessment Committee(s) work — their structure, charge, participants, etc.
  • More about your Program Review processes and outcomes
  • Your role in building the culture of evidence / assessment

This list helped her know who to set up meetings with and what materials I might be interested in seeing. (Indeed, it was a rather large list, but in all fairness, I was coming from out of town and only had one day to meet with them. I was trying to be comprehensive.)

TYPES OF VISITS

In my experience, there are two main types of learning visits:

1) Problem-based: This kind of visit is intended to help you work on a problem you or your institution has. For example, I arranged a phone visit for myself and 3 colleagues from my university to talk with a person at another institution in Chicago about how they manage the assessment of student learning in an outcomes-based liberal arts curriculum; this was a very real problem for us at the time. (Turns out it was for them too!)

2) Topic-based:  This kind of visit is more focused on a specific shared topic, such as “general education learning outcomes” or “facilitating internships.”  A while back, I set up a session with a person using the Mahara ePortfolio system at a different institution because we wanted to explore this system and see it in action. We used a web-based desktop sharing system and the phone, and she kindly took us on a 45-minute tour of how they are using Mahara ePortfolios. Nice!

IDENTIFYING WHERE & WITH WHOM TO VISIT

Figuring out where and with whom to visit per your desired learning outcomes is likely the next step. Here are some ideas for how to do so:

1) Look to your local network. Are there colleagues with similar job responsibilities at institutions near you? Do you know anyone at an institution near you that can connect you? Do any of your current colleagues have connections at these institutions that they could leverage for you?

2) Look to your distant network. Have you connected with folks at conferences that you can reconnect with? Even if you can’t visit physically, with the phone, Skype, or with other technologies you can visit virtually. I have a “coffee date” about once a term with a colleague from another institution across the country who I met at a conference; we both get a cup of coffee and talk on the phone for about an hour, and just learn from each other.

3) Look to your virtual network. If you use LinkedIn or Twitter, search for and follow people who are in similar roles or who have identified projects they are working on that are similar to yours. This is how I connected with the Mahara ePortfolio person; I had learned a lot from her by just following her on Twitter, and then when my colleagues and I were ready, I sent her a message with a few questions. From this initial conversation came the idea to have a short virtual meeting in which she took us on a tour.

PROPOSING THE VISIT

First, make contact and make a simple initial proposal. It might look something like this:

Hi there – My colleague XX shared with me your contact information because I am interested in learning about what you are doing with blah blah blah at your university; we are trying to implement this at my university as well, and I wonder if we might be able to set up a time to chat briefly about what is working and what’s not. Maybe we can learn some strategies from each other. Etc etc etc …

As demonstrated here, a proposal for a visit might be more compelling if you identify what you can bring to the table. What will be in the visit for them? What might you be able to contribute to the conversation?

Also, start small. You don’t need to visit for a whole day. Maybe you just begin with a short phone conversation, or maybe (if you’re close) you meet for lunch.

Finally, I think it’s useful to learn with others, as a team. If you can, take a colleague or two from your institution with you, or invite them to the phone / Skype conversation. Propose the person you’re meeting with do the same. The more the merrier!

DID YOU LEARN?

After the visit, assess your learning. Did you achieve your learning outcomes? If not, what might be next steps? What additional questions were raised for you, or what other resources should you explore? Likewise, was the person / institution you met with interested in learning more and continuing the conversation? If so, then maybe you all set up another learning visit with each other.

ONE LAST TIP

In the spirit of academic integrity,1) don’t take and just start using what is not yours and 2) give credit where credit is due. We all adopt and adapt ideas and materials all the time in higher education; if you want to borrow something from someone you’ve visited, ask permission and then attribute it. There may be nothing more irksome than being visited and sharing a rubric, for example, and not knowing the visitor adopted it or re-purposed it.

Happy visiting – learn lots!

The good folks over at the University of Venus began a networking challenge this fall. I never got around to actually signing up for it, but I thought it was a great idea and I intended to participate. Their challenge consisted of doing one of the following:

  • Go interdisciplinary
  • Go international
  • Go outside your institution
  • Go to a neighboring institution
  • Go to your local community

What a great way to broaden my perspectives and learn new things, and bring back good ideas to my own institution; what a neat form of professional development; and except for “go international,” many of these things I would be able do with low impact on my to-do list and relatively low-cost to me or my institution.

But then I realized that I already do this kind of stuff all the time. These kinds of activities have been integral to my own scholarship for a long time now (if you subscribe to Boyer’s definition of scholarship, which I do). Perhaps these kinds of activities might be defined as networking activities (as University of Venus does) or could even be considered some funny form of academic tourism, but I prefer to think of them as I have experienced them: learning visits.

Learning Visits, Not Academic Tourism

Let me share some recent examples. I will begin, first, with an experience of being visited:

Several months ago, colleagues from an institution similar to mine (but way across the country) contacted me about coming to my campus for a learning visit. I had met a few of these good folks at a conference a year before; we had a healthy exchange of ideas then and had remained loosely in touch. Their institution was planning to take a team of folks to three universities in the Pacific Northwest, just to learn. They came and spent a day with us, learning from and sharing with several folks on my campus.  It turned into a learning exchange within a learning community. Indeed, we asked as many questions of them as they did us, and we learned as much from them as I hope they learned from us.

Since then, one of the members of that visiting team and I have had virtual coffee dates to continue to discuss shared challenges and opportunities (mostly about assessment, but also about implementing liberal arts programs as well as working with adult learners in higher education). To continue our shared learning, next week several of us are visiting again (though this time virtually) to talk about Prior Learning Assessment. And we are visiting with each other just to learn: What’s working and why? What’s not? What ideas might we come up with to improve our programs and our students’ experiences?

This past Friday I completed a learning visit of my own to a university in Southern California (and my university will host them in a learning visit this coming week). This was actually one of the assignments for the WASC Assessment Leadership Academy in which I am participating, but it was a great excuse to spend the good part of a day at another institution learning about what they are doing with assessment and how they are building their teaching/learning/assessment culture. I met with folks from a few academic areas, student services, and institutional research, and also learned how their cross-college assessment committee supports this important work at their institution. I learned about their progress, and their challenges. The visit gave me several ideas for strategies and tools I might bring back to my institution (with adaptations of course), and it also confirmed some of the work we are already doing. I learned.

I am learning so much from these learning visits that I am planning more. With colleagues from our Assessment Program, I am planning a learning visit to a local college to explore their experiential learning simulations lab and think about how such teaching/assessment systems might apply to other disciplines. With a colleague from our Service Program, I am planning to visit another local university to learn about their service-learning program.

I have taken the challenge to heart, and I intend to keep doing so.  I think learning visits might be unique opportunities to higher education (perhaps I am incorrect, but I can hardly imagine car or technology companies doing “learning visits” with other car or technology companies). I also think they just might help all of us get better. If higher education is about learning — our students’ learning and our own — then learning visits are one relatively simple way we can achieve great learning outcomes.

It is true that I flunked out of Girl Scouts long before I could get a vest like this.

I am trying to understand badges. Given my background with Prior Learning Assessment programs and other forms of experiential learning, I totally get the idea conceptually. (Hey – I know a few boy and girl scouts too! They’ve earned badges for things they learned and could do too, right?)

Apparently, with a badge:

You can get credit for learning outside of school, on the web, or from work and life experience.

So it sounds like some sort of technologically-mediated PLA, except the credit you earn is is not college credit. There is some other currency here, though what value it will hold remains to be seen.  It seems to me that there’s great potential here, as this article explains. What with the rising costs of higher education and access issues, and the learning opportunities presented with new technologies, combined with learning one can obtain through experience (hopefully with some expert guidance and reflection), this might be something quite worthwhile.  I can see it now: Post a few badges onto your robust ePortfolio and your avatar may actually scream: Hire Me!

But here’s what I don’t get — where is the “quality control?” (Ack – I hate that term applied to learning, but I think it’s a legitimate question).  My burning question with all of this is:

So, how, exactly, will learning be assessed?

Of course I ask this question of my faculty colleagues in higher education too — it’s certainly not a question specific to badges. I am honestly trying to figure it out!

Here is some information about assessment and badges, according to the Badge FAQs (a wiki, so what I’ve copied in blue will likely change soon):

Who can issue badges?
Badges can be created, defined and issued by a number of sources, including:

  • Traditional educational institutions (e.g., x, y or z)
  • Professional bodies (e.g. doctors, engineers, accountants)
  • International credential assessment agencies
  • Non formal, community learning organizations (e.g. Adult Basic Education, Literacy, Employability)
  • Communities of practice (e.g., open education projects, peer learners, or the individual learners themselves)
  • After-school programs and learning networks.
  • Online courses and open courseware initiatives.
  • Companies/organizations that employ people

How will the value of the badges be authenticated? In this system, a digital badge is more than just an image – it is essentially a collection of metadata that fully explains the badge and includes information such as the issuer, issue date, criteria for earning the badge, expiration if needed, the learner work or evidence behind the badge, etc. So the badge acts as a gateway or conversation starter, but the bulk of the information is in that metadata and it can act as an informal validation system itself.

And this is what the Mozilla and P2PU badge pilot project will address regarding assessment specifically (also from the FAQs):

Assessment

The pilot will explore a range of assessment types, including:

  • peer assessment
  • self-assessment
  • portfolio assessment
  • stealth assessment
  • The Javascript badge assessment, for example, will require learners to submit work that demonstrates competency. Peers will then rate the work against a predefined rubric and set of criteria. Once the rating reaches a particular threshold, the badge will be issued.
  • The Accessibility badge will require experience designing or developing for challenged users or accessibility technologies, plus a blog post with reflection and analysis of the experience. A group of accessibility gurus within the community will then assess the work and issue badges accordingly.
  • Other badges may be aligned directly with courses, with course organizers able to assess work and issue badges.

And more:

How does assessment work?

  • For badges to hold real value and carry the weight of more traditional grades or degrees, assessment and quality is critical.
  • Badges can contain multiple levels of assessment, depending on the use case, community or intended audience
    • some will require distinct pre-defined assessment exercises and success criteria
    • others may be loosely defined and require learner reflection or peer recommendations.
  • Hard skills may require standard or more rigid rubrics to compare learner work against.
  • Softer skills can be more fluid and require more open and social assessments like peer reviews or endorsements.
  • For certification badges, intended for audiences like hiring managers, admission boards, more rigorous assessments can be required
  • For badges intended to simply build community or reward behaviors, simple assessments may be enough

How can badges provide greater flexibility and innovation in assessment?
Badges can help:

  • drive innovation around new types of assessments (e.g., x or y)
  • provide more personalized assessments for learners (e.g., x or y)
  • move beyond out of date or irrelevant testing practices (e.g., x or y)

For example:

  • Asynchronous assessment. Instead of being required to take an exam at a pre-determined time, for example, learners can seek out the assessment on their own time.
  • “Stealth assessment.” Assessment and awarding badges can happen automatically and provide immediate feedback. [Need a half sentence summary of what "stealth assessment is.]
  • Portfolio assessment. Work samples, projects and other artifacts the learner has produced or been involved in can demonstrate skills and competencies.
  • Multiple assessors or group assessment. In traditional classrooms, an individual instructor generally does most of the assessing. An open badge system can support assessment from multiple contexts, including course organizers, peers, or learners themselves. This flexible and networked nature could mean that there are multiple paths or assessment options for earning a badge, making the system more flexible, ensuring that the needs of each learner are met and limiting the learning path constraints.

I  think this is all very exciting. But I’ll need to keep learning about this badge idea and seeing where and how it goes because my jury is still out. But hey – maybe I can earn a badge for learning about badges. Then I can get an outfit for my avatar that looks something like this:

Just like I say about earning a college degree, maybe it’s never to late to earn a badge!

Older Posts »

Follow

Get every new post delivered to your Inbox.