Key Performance Indicators for OER

One of the things I’ll be looking into as part of my new role is key performance indicators for open educational resources.  At the University of Edinburgh we have a Vision and Policy for OER that encourages staff and students to use, create and publish OERs to enhance the quality of the student experience, enrich the University and the sector, showcase the highest quality learning and teaching, and make a significant collection of unique learning materials available to Scotland and the world.

Staff and students at the university are already making open educational resources available through a range of channels including Open.Ed, Media Hopper, TES, SketchFab, Youtube, Wikimedia Commons and Wikipedia, and there are a number of initiatives ongoing that promote and support the creation of OER including 23Things, Board Game Jam, various MOOC projects, our Wikimedian in Residence programme and others.

So how do we develop meaningful key performance indicators to measure and assess the success of these initiatives?

Quantitative indicators are relatively simple to measure in terms of OER produced. It’s not difficult to gather web stats for page views and downloads from the various platforms used to host and disseminate our OERs.  For example our open educational resources on TES have been viewed over 2,000 times, and downloaded 934 times, a Wikipedia article on Mary Susan MacIntosh, created during a UoE editathon for International Women’s Day has had 9,030 page views, and UoE MOOCs have reached two and a quarter million learners.

Measuring OER reuse, even within the institution, is much less straightforward.  To get an of idea of where and how OERs are being reused you need to track the resources. This isn’t necessarily difficult to do, Cetis did some research on technical approaches for OER tracking during the UKOER Programme, but it does raise some interesting ethical issues.  We also discovered during our UKOER research that once authors create OER and release them into the wild, they tend not to be motivated to collect data on their reuse, even when actively encouraged to do so.

There is also the issue of what actually constitutes re-use.  Often reuse isn’t as straightforward as taking an OER, adapting is and incorporating it into your course materials.  Reuse is often more subtle than that.  For example, if you are inspired by an idea, a concept or an activity you ome across in an OER, but you don’t actually download and use the resource itself, does that constitute reuse?  And if it does, how do we create KPIs to measure such reuse?  Can it even be measured in a meaningful way?

And then there’s the issue of qualitative indicators and measuring impact.  How do we assess whether our OERs really are enhancing the quality of the student experience and enriching the University and the sector?  One way to gather qualitative information is to go out and talk to people and we already have some great testimonies from UoE students who have engaged with UoE OER internships and Wikimedia in the Classroom projects. Another way to measure impact is to look beyond the institution, so for example 23 Things lornwas awarded the LILAC Credo Digital Literacy Award 2017 and has also been adapted and adopted by the Scottish Social Services Council, and the aforementioned article on Mary Susan McIntosh featured on the front page of English Wikipedia.

I know many other institutions and organisations have grappled with the issue of how to measure the impact of open education and OER.  In the US, where OER often equates to open textbooks, the focus tends to be on cost savings for students, however this is not a particularly useful measure in UK HE where course are less reliant on astronomically priced texbooks.  So what indicators can we use to measure OER performance?  I’d be really interested to hear how other people have approached this challenge, so if you have any comments or suggestions please do let me know.  Thanks!

Standard Measures, CC BY SA 2.0, Neil Cummings, https://flic.kr/p/aH8CPV

In Memorium Bassel Khartabil

This is my personal reflection on the devastating news that Syrian open knowledge advocate Bassel Khartabil was executed by the Syrian government in 2015. 

Qasr al Hallabat, Jordan, CC BY Lorna M. Campbell

Some of you will already know that before I worked in open education I used to be an archaeologist.  My main interest was the North Atlantic Iron Age and I spent a lot of time working on excavations in the Outer Hebrides where I was born and brought up.  However I also spent one memorable summer working in the South Hauran Desert in Jordan near the Syrian Border.  It was a bit of a life changing experience for me, I fell quietly in love with the Middle East and when I got back to Scotland I realised that I was stuck in a rut with my job so I decided to leave archaeology while I still loved the subject and turn my hand to something else instead.

By rather circuitous routes that something else turned out to be open education, and it’s something which I have had a deep personal and ethical commitment to for over ten years now.  I never lost my love of archaeology though and I always regretted that while I was in Jordan we didn’t cross the border into Syria to visit Palmyra and Damascus. We had one week free at the end of our fieldwork project and it was a toss up between Petra or Syria.  Petra won.  Years later I watched in horror as Syria descended into civil war and Palmyra became a battleground.  Tragic as the destruction of Palmyra has been, it pales into significance beside the huge number of lives that have been destroyed in the conflict.

Consequently, when I first came across the New Palmyra project I was really inspired.  Here was a project that used openness to capture the cultural and archaeological heritage of Syria before it’s lost forever.  What a fabulous idea.  I vaguely noted the name of Bassel Khartabil among the people involved but at the time I knew nothing more about him

“Bassel Khartabil (Safadi)” by Joi Ito – http://www.flickr.com/photos/joi/4670781482CC BY 2.0

About a year later Adam Hyde of Booksprints.net, who ran a booksprint for us at the end of the the UKOER programme, contacted me and asked if I would be willing to write a piece for a book to raise awareness of the disappearance of Syrian open knowledge advocate, Creative Commons representative and active Wikimedian, Bassel Khartabil.  I was horrified to learn of Bassel’s disappearance and immediately agreed.  My contribution to the open eBook The Cost of Freedom: A Collective Inquiry is called The Open World. Since then I have talked and blogged about Bassel at every opportunity, most recently at the OER17 Conference The Politics of Open and re:publica, in order to help raise awareness of his plight.

I never met Bassel, but his story touched me deeply.  Here was a man who lost his liberty, and we now know lost his life, for doing the very same job that I am doing now. This is why openness, open knowledge, open education, open advocacy matter.

I was on holiday in Brittany when I heard about Bassel’s death via Catherine Cronin on twitter and I was deeply, deeply saddened by the news.  I still am, and I’m still struggling to express this in words. At the moment, I’m not sure I can put it better than the words I used at the end of my OER17 lightning talk Shouting from the Heart.

The plight of Bassel Khartabil is a sobering reminder of the risks of openness, proof that open is always political, but it’s also shows why we need openness more than ever, because openness is inextricably bound up with freedom.  And in the words of another older declaration, the Declaration of Arbroath.

It is in truth not for glory, nor riches, nor honours that we are fighting, but for freedom – for that alone, which no honest man gives up but with life itself.

Resources

How is it almost August?

This is another of those blog posts that starts “Where the hell have the last two months gone?!”  I’ve been sorely neglecting this blog since early May, not because I’ve got nothing to write about, quite the opposite, I’ve been so busy I haven’t had a chance to get near it!  I’m about to go off on annual leave for a couple of weeks but I wanted to post a quick round up of the last two months before I go, so here’s wot I have been up to.

Innovation Projects

UoE OKN, CC BY Natalie Lankester-Carthy

A lot of my time has been tied up with two Information Services Innovation Fund projects.  The UoE Open Knowledge Network was a small project that aimed at drawing together the University’s activities in the area of Open Data, Open Access, Open Education, Open Research, Open Collections and Archives, to support cross-fertilisation and promote the institution’s activities in these areas. We ran three events, with the last one taking place in early July.  This event focussed on discussing priorities, ideas for the future and how we can sustain the network going forward.  You can read about the first two events on the project blog here: UoE Open Knowledge Network and I’ll be writing up the July event when I get back from leave in August.

The aim of the second project was to develop a MOOC for entrepreneurs, creative individuals, and SMEs to help them develop the knowledge and skills to find and access free and open licensed research, data and content produced by universities and higher education. I was lucky enough to recruit Morna Simpson of Geek Girl Scotland to work on the project however despite our best efforts and an incredible amount of work on Morna’s part the project faced a number of challenges which we struggled to overcome.  Rather than go ahead with a MOOC we will be releasing a series of twelve case studies on the theme of Innovating with Open Knowledge demonstrating how individuals and organisations can access and use the open outputs of University of Edinburgh research.  These case studies should be finished by early August so watch this space!

Media Hopper Replay

The University of Edinburgh is in the process of rolling out a new state of the art lecture recoding service, Media Hopper Replay, which will see 400 rooms enabled to deliver lecture recording by 2019.  As part of a training programme for staff, my colleague Charlie Farley and I have been developing training sessions on preparing for lecture recording covering accessible presentation design, copyright basics, and using open educational resources.

ALT

City of Glasgow College, CC BY Lorna M. Campbell

I was honoured to be invited by ALT to join the selection panel for the prestigious Learning Technologist of the Year Awards.  The quality and diversity of the entries was really inspiring and while I thoroughly enjoyed reading all the entries it wasn’t easy to pick the best from such a strong field.  The winners of the awards will be announced at the ALT Annual Conference which this year takes place at the University of Liverpool.  I’ll be there rejoining my old partner in crime Richard Goodman to provide social media coverage of the conference for the third year running.

In June I also helped to organise ALT Scotland’s annual conference which focused on sharing strategy, practice and policy in learning technology.  We had really interesting talks on lecture recording policy and practice from the Universities of Edinburgh and Glasgow and Joe Wilson reported back from two European open education policy events he recently attended on behalf of Open Scotland.  The real star of the show however was City of Glasgow College’s new state of the art campus where the event took place.

Celtic Knot Conference

In early July I was busy helping UoE’s Wikimedian in Residence, Ewan McAndrew, plan the University of Edinburgh / Wikimedia UK Celtic Knot Conference.  The conference showcased innovative approaches to open education, open knowledge and open data to support and grow Celtic and Indigenous language communities, and explore how our cultural heritage can be preserved as living languages.  The conference was attended by delegates from all over Europe and was an enormous success.  It was a real privilege to be involved in this event and as a Gael, I found the conference to be both moving and inspiring.  I may have got a little starry eyed listening to delegates talking animatedly in Gaelic, Welsh, Breton, Basque and too many other languages to mention.  And as an indication of the collaborative and supportive nature of the event, it was great to see all 50+ delegates come together to provide input and advice to Wikimedia Norge on how to support Sami language Wikipedia.

 

Wikimedia UK

Last weekend I was at the Wikimedia UK AGM and Board Meeting in London where it was a real pleasure to see Josie Fraser voted in as new chair of the Wikimedia Board and our very own UoE Wikimedia in Residence Ewan McAndrew awarded a very well deserved joint Wikimedian of the Year award together with Kelly Foster.  It was also great to hear that Sara Thomas has been appointed as the new Wikimedian in Residence at the Scottish Libraries and Information Council.

CMALT

And on top of all that I somehow managed to submit my CMALT portfolio at the end of May! Although it was a lot of hard work, and although I went right to wire (of course), I actually enjoyed the process of putting my portfolio together and I found it really useful to step back and reflect on my experience of working as a learning technologist in the broadest sense of the word. I would still like to write a proper post reflecting on my experience of developing my portfolio in the open but that will have to wait until the autumn.

That’s just a few of the things that have been taking up most of my time over the last couple of months.  I’m now off for a fortnight’s holiday during which we are going to attempt to coax our aged VW van to take us all the way to Brittany.  If we make it to the Borders we’ll be lucky!   I’ll be back in early August with a new role at the University of Edinburgh as Learning Technology Team Leader in the Department of Education Development and Engagement.

Mary Susan McIntosh and the Women in Red


I was chuffed to discover today that English Wikipedia’s main page features a link to sociologist, feminist, and campaigner for lesbian and gay rights Mary Susan McIntosh.  It’s always great to see women featured on Wikipedia’s main page, which is viewed by around 4 million people, but I confess to being doubly pleased because I created the article on Mary at a recent editathon to mark International Women’s Day here at the University of Edinburgh.  This editathon was facilitated by Ewan McAndrew, Wikimedian in Residence here at the University, and Ewan was also instrumental in nominating Mary to appear on the main page.

Wikipedia 11 May 2017

Only last week I had been complaining on twitter about the lack of gender balance on English Wikipedia’s main page which happened to feature 18 named men but only 4 named women that particular day. The main page changes on a daily basis but you can see the edition from 4th May on archive.org here.

WikiProject Women in Read

Of course this is not particularly surprising; Wikipedia has a well known problem with gender imbalance, only 16% of biographical entries on the English Wikipedia are of women, and the main page is a pretty accurate reflection of this imbalance.  The Wikimedia Foundation and the various Wikimedia chapters around the world, including Wikimedia UK, are well aware of this problem and are attempting to address it through a range of projects and initiatives.  WikiProject Women in Red raises awareness of this issue and aims to turn red links blue, by creating new biographical articles about women who are referenced on Wikipedia but who do not have their own pages. And here at the University of Edinburgh, one of the objectives of our Wikimedian in Residence is to encourage more women to get involved with editing Wikimedia.  Ewan regularly runs editathons focused on addressing the coverage of articles about women in general and Scottish women in particular.

Before I went along to the International Women’s Day editathon, I confess knew nothing about Mary Susan McIntosh, I picked her name at random from a list of “Women in Red” because she sounded interesting.  It didn’t take me long to realise what a hugely significant and influential woman Mary was.  In addition to being one of the early members of the UK Gay Liberation Front, and sitting on the committee that lowered the homosexual age of consent in the UK from 21 to 18, Mary published important research arguing that homosexuality should be regarded as a social construct, rather than a psychiatric or clinical pathology.  Mary’s paper The Homosexual Role helped to shape the concept of social constructionism, later developed by Michel Foucault.  Mary’s contribution to shaping this important philosophical construct has of course been largely overlooked.  My Wikipedia article barely scrapes the surface of Mary’s life and academic career and her important contribution to social theory and political activism.  I hope to do a bit more work on Mary’s Wikipedia page sometime in the future but it would be great if there are any philosophers, sociologists or critical theorists out there that could help with editing to ensure that Mary gets the recognition she deserves.

CMALT – An open portfolio

I’ve finally made a start on drafting my CMALT Portfolio, and in the interests of open practice I’m going to attempt to write and present the whole thing here on my blog.  If you look up on the nav bar you’ll see a new page, CMALT Portfolio, where I’ll be building up my portfolio over the coming weeks.  I’ve just drafted the first two sections of Core Area 1: Operational Issues and I’ll be adding more sections shortly I hope. I’d love to have some feedback on  my portfolio so if you’ve got any thoughts, comments or guidance I’d be very grateful indeed.  I’d also be very interested to know if anyone else has created their portfolio as an exercise in open practice, and if so, how they found the experience.

Wish me luck!

CC BY @BryanMMathers for ALT

re:publica – #FreeBassel: The cost of loving free culture

This video is a small contribution to a session taking place as part of the re:publica 17 media and digital culture convention in Berlin this week.  The session #FreeBassel : The Cost of Loving Free Culture is part of the Love Out Loud strand and is being led by Barbara Rhüling, CEO of Booksprints and Melanie Dulong de Rosnay, Research Associate Professor, CNRS.

The session will feature a public reading of texts dedicated to Bassel Khartabil, loved and celebrated Internet volunteer who was detained in Syria in 2012, demanding his immediate release and reflecting on the love and the costs of free culture.

“Bassel Khartabil, loved and celebrated Internet volunteer was detained in Syria on March 15, 2012. His name was deleted from the Adra Prison’s register, where he was detained, on 3 October 2015, and there has been no information about his current status or whereabouts since.

Seeing Bassel paying a high price for his love and participation in free culture, many of his friends and fellow free culture activists have reflected on their own fates, actions, and choices. As part of the #freebassel campaign, 44 activists, artists, designers, developers, researchers, and writers involved with free knowledge movements wrote and compiled more than 50 original contributions in the book “Cost of Freedom”. The contributions include paintings, poems, personal reflections, critical observations, polemical pieces, and theoretical treatises.

Many contributions by Bassel’s friends and family, including his wife Noura Safadi, create a collective memory of Bassel and urge for his immediate release to his normal life and freedom. Other contributions by free culture advocates such as Lorna Campbell, Lawrence Lessig, and Jon Phillips offer personal reflections about the experience of working within free culture.”

The video above is my reading of The Open World, the short piece I wrote for Cost Of Freedom, a book dedicated to Bassel in 2015.

International Open Science Conference report

A brief report on the International Open Science Conference held in Berlin in March, presented at the University of Edinburgh Open Knowledge Network event on 28th April 2017.

The Open Science Conference held in Berlin in April was the 4th international conference sponsored by the Leibniz Research Alliance and it grew out of the former Science 2.0 Conference.

The stated aim of the Open Science Conference is to bring together three communities; the research community engaging in open science, the library community and the computer centres who maintain and run the infrastructure.  Participants included researchers, librarians, practitioners, politicians, and other stakeholders.  Many of the delegates I spoke to were librarians and and it was interesting to note that many of them were familiar with the work of the Digital Curation Centre here at the University, and spoke highly of the service they provide.

Continue reading

Open Pedagogy – A view from a distance

I’ve been thinking on and off for the last few days about the fascinating discussions going on around Open Pedagogy. Maha Bali has curated a diverse and thought provoking series of posts on the topic here and has organized a hangout to discuss What is Open Pedagogy? later today. Other than commenting on a few blog posts here and there, I haven’t contributed much to this debate and it’s taken me a little while to figure out why.

To some extent this is bound up with a post I wrote last week What do you do? That post is an off the cuff reflection prompted by my first attempt to make a start on my CMALT portfolio, but it does relate, if only tangentially, to the question of open pedagogy too. I think one of the reasons that I’ve felt slightly distanced from the open pedagogy discussions is that to my mind pedagogy is intrinsically bound up with the theory and practice of teaching and although I’ve worked in Higher Education for years, I’ve rarely been involved in teaching and I have never considered myself to be a teacher or an academic. This is one of the issues I was trying to grapple with, all be it facetiously, in my What do you do? post. I’ve very rarely taught staff or students, though I do hope that people have learned things from me along the way. I do help to support teaching and learning, but even then, I’m several steps removed from the pedagogy and the teaching process. I don’t do teaching so I’ve always felt I don’t really do pedagogy either.

What I do consider myself to be is an education practitioner. I participate in the process and practice of education and hopefully, some way further down the line, this contributes to teaching and pedagogy. Perhaps more importantly for my own personal and professional identity, I see myself as an open practitioner. I try very hard to practice my profession in the open, I try to learn from other open practitioners, I try to listen and learn and engage, and I try to be guided by the principals of openness and inclusivity.

This is why I identified so strongly with the questions Josie asked in her blog post Waves not Ripples

“I’m suspicious of the current distinction between open pedagogy and open practice, and in particular, how little explanation is being given to the privileging or even just use of the term pedagogy over the term practice. Is the use of pedegogy being used as shorthand for educational practice? Is it being used to underline the importance of formal education, or the primacy of teaching? Why not open heutagogy? Is it being used as a form of interpellation, a signal to include and exclude specific groups within open education? What is wrong with ‘practice’? How do we benefit from continuing to insist on a break between theory and practice, or theory and politics? Is this distinction as harmful as the disavowal of the relationship between the personal and the political?”

Josie’s questions also called to mind the point Amber Thomas made in her wonderful blog post Perhaps I’m not one, which I linked to from my earlier post. Amber’s blog post is primarily a reflection on what makes a learning technologist, but she also includes this thought, which still resonates with me three years later.

“And another thing: I’m not an academic and I don’t teach. I consider myself to be a para-academic. (Like a paralegal, or a paramedic ). I have a particular skillset which has a place in universities. I’ve lost count of the number of sessions I’ve been in at elearning conferences over the year where the presenter asks “how many people in the room actually teach?”. Cue a few hands raised and the majority looking down at their feet, embarrassed, as if the 5/10/15 years experience in education counts for nowt. Universities are multi-professional places and learning technologists, in all their flavours, have a rightful place at the table. People like me shouldn’t have to pretend to be something we’re not.”

Like Amber, I’m not an academic and I don’t teach, so I’m not sure how much I can contribute to discussions about pedagogy. It’s not that I’m disinterested, far from it, it’s more that when people talk about pedagogy is often feels like they’re talking about something I don’t do, something I haven’t thought deeply enough about.

Of course that may simply be a massive misconception on my part, but there’s no denying that I tend to feel I have more to contribute to discussions about open practice, policy and politics than discussions about open pedagogy. Josie asks whether open pedagogy is being used as a signal to include and exclude specific groups within open education. I’m not sure I would go as far as to say that I feel excluded, but I do feel slightly distanced.

I don’t know how to draw this post to a sensible conclusion, because I don’t really know if I have one, but I suspect I’ll continue thinking about these issues of identity, experience, inclusion and exclusivity for some time to come. And perhaps if I can joint the hangout later today I’ll find out whether there is anything I can contribute to the discussions about open pedagogy, and whether this feeling of distance is just a misconception on my part after all.

A view from a distance

OER17 – Open Education in a time of Trump and Brexit

As well as my paper (The Distance Travelled) and lightning talk (Shouting from the Heart) at OER17, I also took part in a panel session organised by Jim Luke: Open Education in a time of Trump and Brexit.  The panel featured video provocations from Robin DeRosa, Nadine Aboulmagd, Chris Gilliard, and David Kernohan and responses from Jim, Martin Weller, Maha Bali and I.

The aim of the panel was to “provide different perspectives on the relationship between Open Education and the political changes represented by Brexit and the Trump election” and to address the following questions:

  • What challenges do these political movements pose for Open Education? What opportunities?
  • Open Education movement has largely embraced values of inclusiveness, sharing, connectedness, equity, voice, agency, and openness. How might these values be furthered under these new regimes? How might these values be hindered?
  • Will our work in the open education movement change?
  • In what ways can we shape the future of the Open Education Movement?

I don’t think any of us quite knew what to expect from the session, but we had a really lively and wide ranging conversation with some brilliant contributions from the audience including Helen Beetham, Audrey Watters, Laura Czerniewicz and Sheila MacNeil.

All the videos and materials created for the session are available from Jim’s website here Open Ed, Trump, Brexit and there’s a Storify of tweets here #Trexit.  Huge thanks to Autumn Caines who periscoped the whole session: #oer17 safety in open online learning, and to Bryan Mather’s for capturing the discussion.

@bryanMMathers, CC BY ND

OER17 – The Distance Travelled

Reflections on open education policy in the UK since the Cape Town Declaration

Paper presented at the OER17 Politics of Open conference.

[slideshare id=74455916&doc=distancetravelled01-170405150403]

2017 has officially been designated the “Year of Open”.

The Year of Open is a global focus on open processes, systems, and tools, created through collaborative approaches, that enhance our education, businesses, governments, and organizations … Open represents freedom, transparency, equity and participation … During the Year of Open, we want to capture and display these efforts to increase participation and understanding of how open contributes to making things better for everyone.

This initiative is backed by many of the major international players in the field of open education, including Creative Commons, the Open Education Consortium, OER Africa, etc.

And the reason that this is the Year of Open is that we have a number of important anniversaries

It’s the 15th anniversary of the Budapest Open Access Initiative, and it’s also the ¨ 15th anniversary of the release of the first Creative Commons licence.

It’s the 10th anniversary of the Cape Town Declaration which laid the foundations of the “emerging open education movement” and advocated the development of open education policy to ensure that taxpayer-funded educational resources are openly licensed. And if you haven’t read the Cape Town Declaration recently, I can highly recommend revisiting it, it’s really quite inspiring and inspiring statement.

And it’s also the 5th Anniversary of the UNESCO Paris OER Declaration which, five years after Cape Town, strengthened this call by encouraging governments and authorities to open license educational materials produced with public funds in order to realize substantial benefits for their citizens and maximize the impact of investment.

Continue reading