Key Performance Indicators for OER

One of the things I’ll be looking into as part of my new role is key performance indicators for open educational resources.  At the University of Edinburgh we have a Vision and Policy for OER that encourages staff and students to use, create and publish OERs to enhance the quality of the student experience, enrich the University and the sector, showcase the highest quality learning and teaching, and make a significant collection of unique learning materials available to Scotland and the world.

Staff and students at the university are already making open educational resources available through a range of channels including Open.Ed, Media Hopper, TES, SketchFab, Youtube, Wikimedia Commons and Wikipedia, and there are a number of initiatives ongoing that promote and support the creation of OER including 23Things, Board Game Jam, various MOOC projects, our Wikimedian in Residence programme and others.

So how do we develop meaningful key performance indicators to measure and assess the success of these initiatives?

Quantitative indicators are relatively simple to measure in terms of OER produced. It’s not difficult to gather web stats for page views and downloads from the various platforms used to host and disseminate our OERs.  For example our open educational resources on TES have been viewed over 2,000 times, and downloaded 934 times, a Wikipedia article on Mary Susan MacIntosh, created during a UoE editathon for International Women’s Day has had 9,030 page views, and UoE MOOCs have reached two and a quarter million learners.

Measuring OER reuse, even within the institution, is much less straightforward.  To get an of idea of where and how OERs are being reused you need to track the resources. This isn’t necessarily difficult to do, Cetis did some research on technical approaches for OER tracking during the UKOER Programme, but it does raise some interesting ethical issues.  We also discovered during our UKOER research that once authors create OER and release them into the wild, they tend not to be motivated to collect data on their reuse, even when actively encouraged to do so.

There is also the issue of what actually constitutes re-use.  Often reuse isn’t as straightforward as taking an OER, adapting is and incorporating it into your course materials.  Reuse is often more subtle than that.  For example, if you are inspired by an idea, a concept or an activity you ome across in an OER, but you don’t actually download and use the resource itself, does that constitute reuse?  And if it does, how do we create KPIs to measure such reuse?  Can it even be measured in a meaningful way?

And then there’s the issue of qualitative indicators and measuring impact.  How do we assess whether our OERs really are enhancing the quality of the student experience and enriching the University and the sector?  One way to gather qualitative information is to go out and talk to people and we already have some great testimonies from UoE students who have engaged with UoE OER internships and Wikimedia in the Classroom projects. Another way to measure impact is to look beyond the institution, so for example 23 Things lornwas awarded the LILAC Credo Digital Literacy Award 2017 and has also been adapted and adopted by the Scottish Social Services Council, and the aforementioned article on Mary Susan McIntosh featured on the front page of English Wikipedia.

I know many other institutions and organisations have grappled with the issue of how to measure the impact of open education and OER.  In the US, where OER often equates to open textbooks, the focus tends to be on cost savings for students, however this is not a particularly useful measure in UK HE where course are less reliant on astronomically priced texbooks.  So what indicators can we use to measure OER performance?  I’d be really interested to hear how other people have approached this challenge, so if you have any comments or suggestions please do let me know.  Thanks!

Standard Measures, CC BY SA 2.0, Neil Cummings, https://flic.kr/p/aH8CPV

How is it almost August?

This is another of those blog posts that starts “Where the hell have the last two months gone?!”  I’ve been sorely neglecting this blog since early May, not because I’ve got nothing to write about, quite the opposite, I’ve been so busy I haven’t had a chance to get near it!  I’m about to go off on annual leave for a couple of weeks but I wanted to post a quick round up of the last two months before I go, so here’s wot I have been up to.

Innovation Projects

UoE OKN, CC BY Natalie Lankester-Carthy

A lot of my time has been tied up with two Information Services Innovation Fund projects.  The UoE Open Knowledge Network was a small project that aimed at drawing together the University’s activities in the area of Open Data, Open Access, Open Education, Open Research, Open Collections and Archives, to support cross-fertilisation and promote the institution’s activities in these areas. We ran three events, with the last one taking place in early July.  This event focussed on discussing priorities, ideas for the future and how we can sustain the network going forward.  You can read about the first two events on the project blog here: UoE Open Knowledge Network and I’ll be writing up the July event when I get back from leave in August.

The aim of the second project was to develop a MOOC for entrepreneurs, creative individuals, and SMEs to help them develop the knowledge and skills to find and access free and open licensed research, data and content produced by universities and higher education. I was lucky enough to recruit Morna Simpson of Geek Girl Scotland to work on the project however despite our best efforts and an incredible amount of work on Morna’s part the project faced a number of challenges which we struggled to overcome.  Rather than go ahead with a MOOC we will be releasing a series of twelve case studies on the theme of Innovating with Open Knowledge demonstrating how individuals and organisations can access and use the open outputs of University of Edinburgh research.  These case studies should be finished by early August so watch this space!

Media Hopper Replay

The University of Edinburgh is in the process of rolling out a new state of the art lecture recoding service, Media Hopper Replay, which will see 400 rooms enabled to deliver lecture recording by 2019.  As part of a training programme for staff, my colleague Charlie Farley and I have been developing training sessions on preparing for lecture recording covering accessible presentation design, copyright basics, and using open educational resources.

ALT

City of Glasgow College, CC BY Lorna M. Campbell

I was honoured to be invited by ALT to join the selection panel for the prestigious Learning Technologist of the Year Awards.  The quality and diversity of the entries was really inspiring and while I thoroughly enjoyed reading all the entries it wasn’t easy to pick the best from such a strong field.  The winners of the awards will be announced at the ALT Annual Conference which this year takes place at the University of Liverpool.  I’ll be there rejoining my old partner in crime Richard Goodman to provide social media coverage of the conference for the third year running.

In June I also helped to organise ALT Scotland’s annual conference which focused on sharing strategy, practice and policy in learning technology.  We had really interesting talks on lecture recording policy and practice from the Universities of Edinburgh and Glasgow and Joe Wilson reported back from two European open education policy events he recently attended on behalf of Open Scotland.  The real star of the show however was City of Glasgow College’s new state of the art campus where the event took place.

Celtic Knot Conference

In early July I was busy helping UoE’s Wikimedian in Residence, Ewan McAndrew, plan the University of Edinburgh / Wikimedia UK Celtic Knot Conference.  The conference showcased innovative approaches to open education, open knowledge and open data to support and grow Celtic and Indigenous language communities, and explore how our cultural heritage can be preserved as living languages.  The conference was attended by delegates from all over Europe and was an enormous success.  It was a real privilege to be involved in this event and as a Gael, I found the conference to be both moving and inspiring.  I may have got a little starry eyed listening to delegates talking animatedly in Gaelic, Welsh, Breton, Basque and too many other languages to mention.  And as an indication of the collaborative and supportive nature of the event, it was great to see all 50+ delegates come together to provide input and advice to Wikimedia Norge on how to support Sami language Wikipedia.

 

Wikimedia UK

Last weekend I was at the Wikimedia UK AGM and Board Meeting in London where it was a real pleasure to see Josie Fraser voted in as new chair of the Wikimedia Board and our very own UoE Wikimedia in Residence Ewan McAndrew awarded a very well deserved joint Wikimedian of the Year award together with Kelly Foster.  It was also great to hear that Sara Thomas has been appointed as the new Wikimedian in Residence at the Scottish Libraries and Information Council.

CMALT

And on top of all that I somehow managed to submit my CMALT portfolio at the end of May! Although it was a lot of hard work, and although I went right to wire (of course), I actually enjoyed the process of putting my portfolio together and I found it really useful to step back and reflect on my experience of working as a learning technologist in the broadest sense of the word. I would still like to write a proper post reflecting on my experience of developing my portfolio in the open but that will have to wait until the autumn.

That’s just a few of the things that have been taking up most of my time over the last couple of months.  I’m now off for a fortnight’s holiday during which we are going to attempt to coax our aged VW van to take us all the way to Brittany.  If we make it to the Borders we’ll be lucky!   I’ll be back in early August with a new role at the University of Edinburgh as Learning Technology Team Leader in the Department of Education Development and Engagement.

OER17 – The Distance Travelled

Reflections on open education policy in the UK since the Cape Town Declaration

Paper presented at the OER17 Politics of Open conference.

[slideshare id=74455916&doc=distancetravelled01-170405150403]

2017 has officially been designated the “Year of Open”.

The Year of Open is a global focus on open processes, systems, and tools, created through collaborative approaches, that enhance our education, businesses, governments, and organizations … Open represents freedom, transparency, equity and participation … During the Year of Open, we want to capture and display these efforts to increase participation and understanding of how open contributes to making things better for everyone.

This initiative is backed by many of the major international players in the field of open education, including Creative Commons, the Open Education Consortium, OER Africa, etc.

And the reason that this is the Year of Open is that we have a number of important anniversaries

It’s the 15th anniversary of the Budapest Open Access Initiative, and it’s also the ¨ 15th anniversary of the release of the first Creative Commons licence.

It’s the 10th anniversary of the Cape Town Declaration which laid the foundations of the “emerging open education movement” and advocated the development of open education policy to ensure that taxpayer-funded educational resources are openly licensed. And if you haven’t read the Cape Town Declaration recently, I can highly recommend revisiting it, it’s really quite inspiring and inspiring statement.

And it’s also the 5th Anniversary of the UNESCO Paris OER Declaration which, five years after Cape Town, strengthened this call by encouraging governments and authorities to open license educational materials produced with public funds in order to realize substantial benefits for their citizens and maximize the impact of investment.

Continue reading

OER17 – Come and find me!

Image credit: Taro Taylor, CC-BY-NC, https://flic.kr/p/3pQWP

The OER17 Politics of Open Conference is taking place in London this week, and I can hardly believe it’s been a year since Melissa and I chaired last year’s conference in Edinburgh!  As always, I’m looking forward to catching up with friends from all over the world and meeting some long standing online colleagues irl for the first time.  I’ve got several sessions lined up up over the course of the two days, so if you want to catch me, this is where I’ll be. Come and say hello!

Perspectives on Open Education in a World of Brexit & Trump
Wed, Apr 5 2017, 11:20am – 12:40pm
Panellists: Maha Bali, Lorna Campbell, James Luke, and Martin Weller

Like the Internet itself, the Open Education movement, including OER and OEP, has grown in a world of globalised capitalism that has been dominant in North America and Europe, and indeed, developed and growing economies. The Brexit vote, Trump’s election, and shifts toward nationalist-right parties elsewhere are changing the political landscape. At a minimum, the rhetoric of these movements, both in support and opposition, has altered public discourse and often attitudes toward higher education. These political shifts have complex and multifaceted implications for the open education movement.

This panel aims to stimulate deeper thought beyond our initial reactions to these political movements. We will provide diverse, multiple perspectives on the relationship between Open Education and the political changes represented by Brexit and the Trump election. Many questions arise, including:

  • What challenges do these political movements pose for Open Education? What opportunities?
  • Open Education movement has largely embraced values of inclusiveness, sharing, connectedness, equity, voice, agency, and openness. How might these values be furthered under these new regimes? How might these values be hindered?
  • Will our work in the open education movement change?
  • In what ways can we shape the future of the Open Education Movement?

The Distance Travelled: Reflections on open education policy in the UK since the Cape Town Declaration
Wed, Apr 5 2017, 1:30pm – 2:50pm
Author: Lorna Campbell

Ten years ago the Cape Town Declaration laid the foundations for what it described as the “emerging open education movement” and called on colleagues to come together to commit to the pursuit and promotion of open education and to overcome the barriers to realizing this vision.  Among the barriers the Declaration recognized were “governments and educational institutions that are unaware or unconvinced of the benefits of open education” and it went on to advocate the development of open education policy to ensure that taxpayer-funded educational resources are openly licensed.  Five years later, the Paris OER Declaration strengthened this call by encouraging governments and authorities to open license educational materials produced with public funds in order to realize substantial benefits for their citizens and maximize the impact of investment.

This paper will provide an overview of the advances and mis-steps in open education policy and practice in the UK in the ten years since the Cape Town Declaration, while comparing and contrasting the UK experience with developments elsewhere in Europe and North America. The paper will include a case study on the Scottish Open Education Declaration and the efforts of the Open Scotland initiative to lobby the Scottish Government to endorse the principles of the declaration and adopt open licenses for publicly funded educational content.

Virtually Connecting
Wed, Apr 5 2017
With Martin Hawksey, John Robertson and Lorna Campbell

End of day session, from 1730-1800. With onsite buddy Teresa MacKinnon and virtual buddies Nadine Aboulmagd and Simon Ensor.

Shouting from the Heart 
Thu, Apr 6 2017, 11:40am – 12:40pm
Author: Lorna Campbell

This lightning talk will be a short polemic reflecting on political and personal events that have led me to both question and strengthen my commitment to open education over the last two years.  These include the detention and disappearance of Syrian open knowledge advocate Bassel Khartebil, and the project that created an open book dedicated to his life and work The Cost of Freedom: A Creative Enquiry.  The privilege of co-chairing the OER16 Open Culture Conference. The result of the UK’s European Membership referendum, announced the day after a meeting of European colleagues to discuss how we could work together to join up open education policy and practice across the Europe.  The appointment of the first Gaelic language Wikimedian in Residence by Wikimedia UK and the National Library of Scotland. The surge of horror and shout of rage following the results of the US presidential election.

My response to these disparate, seemingly unconnected events was to write, to blog, to try to find words to make sense of events and my reaction to them, and to reassert my belief that we have a moral responsibility to work together to improve education opportunities for all, not just the privileged few.

I can’t promise this talk will be neutral or balanced, but it will be honest and from the heart, and ultimately it will be open.

Crossing the Field Boundaries: Open Science, Open Data & Open Education

Last week I was invited to speak at the International Open Science Conference in Berlin which this year had a special focus on OER.  My talk featured a case study of the University of Edinburgh’s Geosicence Outreach and Engagement Course so I’d like to thank Colin Graham and all those involved in the course for allowing me to present their inspirational work.

This talk focuses on the interface between OER, open data and open science and our experience at the University of Edinburgh of promoting open education through the School of GeoSciences Outreach and Engagement course.

The title of this paper, “Crossing the field boundaries”, comes not from the domain of GeoScicences though, but from Maryam Mirzakhani, professor of mathematics at Stanford University and the first female winner of the Fields Medal.  In a 2014 interview Maryam said

“I like crossing the imaginary boundaries people set up between different fields—it’s very refreshing. There are lots of tools, and you don’t know which one would work. It’s about being optimistic and trying to connect things.”

A Tenacious Explorer of Abstract Surfaces, Quanta Magazine, August 2014

I am not a mathematician, or a scientist, but I do have some experience of crossing field boundaries, and since open education is all about breaking down boundaries and cutting across fields, this seems like a nice metaphor to hang this talk on. Continue reading

International Open Science Conference

This week I’m looking forward to presenting an invited talk on OER at the International Open Science Conference in Berlin.

My talk, Crossing the Field Boundaries will explore the interface between open education, open data and open science. The talk will highlight the Open Knowledge Open Education Group‘s influential study of Open Data as OER by Javiera Atenas and Leo Havemann, and using examples from the University of Edinburgh’s GeoScience Outreach and Engagement Course will highlight how student created open educational resources can be used to widen participation and encourage knowledge transfer and community engagement in science education.  I’ll post my paper and slides when I get back later in the week.

Thanks to the conference organisers for making these cute twitter cards!

Open Education and Co-Creation

Last month I was invited to present a guest lecture on Open Education and Co-Creation as part of the Institute for Academic Development’s Introduction to Online Distance Learning staff development course.The lecture covers an introduction and overview of open learning, OER and open licences and includes a co-creation case study about the fabulous work of our Open Content Curation Intern, Martin Tasker.

Because I was away the week the my lecture was scheduled, I recorded it in advance using the University of Edinburgh’s Media Hopper service and uploaded it with a CC BY license. You can find the lecture here and the slides are on Slideshare here.  Feel free to reuse and repurpose!

(PS The WordPress embed code is being a bit wonky, but if you download this presentation or view it on MediaHopper you’ll be able to see my slides and me talking at the same time.)

University of Edinburgh acknowledged in ALT Learning Technologist of the Year Awards

Two teams from the University of Edinburgh were acknowledged in the ALT Learning Technologist of the Year Awards at the annual ALT Conference at the University of Warwick last week.  The Open Education Team was placed third in the Team awards, with the team from Educational Design and Engagement being highly commended.  

The ALT Learning Technologist of the Year Awards celebrate and reward excellent practice and outstanding achievement in the learning technology field, and aim to promote intelligent use of Learning Technology on a national scale. 

Open Education Team

The Open Education Team is a virtual team within Information Services whose role is to coordinate open education and open knowledge activities across the University. The Team undertakes a wide range of activities that support staff and students to engage with OER, and help the institution to mainstream digital education across the curriculum.  Initiatives run by the Open Education Team include the OER Service, Open.Ed, support for CMALT accreditation, engagement with Wikimedia UK and support for Open Scotland which raises awareness of open education policy and practice to benefit all sectors of Scottish education.

Accepting the award on behalf of the Open Education Team by www.chrisbullphotographer.com

Accepting the award on behalf of the Open Education Team by
www.chrisbullphotographer.com

Educational Design and Engagement

The Educational Design and Engagement team, which came into existence less than two years ago, supports University teaching and learning by providing a central hub for developing awareness, support for staff and students and leadership for e-learning service improvements. With a developing portfolio of 35 MOOCs with over two million sign ups globally, the team continues to grow. In the past year alone, supporting a 20% increase in online assessment submission institution-wide as well as over 10,000 ePortfolio submissions.

Stuart Nicol accepts the award on behalf of EDE by www.chrisbullphotographer.com

Stuart Nicol accepts the award on behalf of EDE by
www.chrisbullphotographer.com

Melissa Highton, Assistant Principal Online Learning at the University of Edinburgh, said

“These awards recognise excellent achievement by the IS teams, they show that our work in open education and educational design is recognised and valued at a national level. I’m very proud of the teams and it was great fun to be at the ALT Conference when they received their award.”

Me speaking after receiving the award on behalf of the Open Education Team

ALTC Connect, Collaborate, Create Highlights

ALTC used to be one of those conferences I only attended every second or third year, but over the last couple of years it really has become unmissable.  Whether you attend in person or participate virtually, it undoubtedly provides the best way to get a broad overview of technology enhanced learning in the UK together with plenty of opportunity for in depth discussion around many of the issues currently affecting the sector.  And this years conference Connect, Collaborate, Create co-chaired by Nicola Whitton and Alex Moseley, at the University of Warwick was no exception.

I’m not going to attempt to blog a summary of the conference, as the ALT team has already rounded up a whole host of excellent conference reports here Enabling the Connection, so I’m just going to pick out a few or my own personal highlights.

Lets get the team back together

I was delighted that ALT invited Rich Goodman, Chris Bull and I back to join Martin Hawksey and the conference social media team again this year. Live tweeting the conference keynotes from the official ALT account can be more than a bit daunting but it’s also an extremely rewarding experience and it was great to be joined this year by Kenji Lamb and Sandra Huskinson.

tweet tweet tweet - me & Rich Goodman by www.chrisbullphotographer.com

tweet tweet tweet – me & Rich Goodman by www.chrisbullphotographer.com

Trolls, myths, privilege and freedom

Josie Fraser’s keynote In The The Valley of the Trolls took an intelligent look at the thorny subject of trolling and didn’t shy away from addressing Gamergate head on.  (By contrast, aside from a single comment about gender imbalance in the games industry, Ian Livingston failed to address the issue of representation, sexism and harassment in the gaming community.)  Lia Commissar gave a highly entertaining keynote on Education and Neuroscience: Issues and Opportunities, which exploded a whole host of neuromyths common in education, ranging from learning styles and right / left brain thinking to the magical power of fish oils.  Jane Secker’s thoughtful and thought provoking keynote Copyright and e-learning: understanding our privileges and freedoms touched on many issues that are of deep personal concern to me, including privilege, equality and the enclosure of our cultural commons.  I actually found myself getting quite over emulsional while Jane was talking :}

Me fangirling Jane Secker's  keynote by www.chrisbullphotographer.com

Me fangirling Jane Secker’s keynote by www.chrisbullphotographer.com

The issues

Although I didn’t manage to get to nearly as many sessions as I would have liked, because I was running around doing so many other things, my impression is that some of the main issues to emerge from the conference this year were learning analytics, policies for lecture capture, and games in education.

Open education

It was great to see so many presentations on different aspects of open education, particularly at a time when there is so little external funding going into OER.  My impression is that openness is slowly starting to become embedded across the sector,  with more institutions starting to consider the sustainability of the resources their staff and students create. I gave a presentation Into the Open – a critical overview of open education policy and practice in Scotland and I’d like to say a huge thank you to everyone who provided enthusiastic comments and feedback.

ALT Scotland SIG

And talking of Scotland….we had a very successful meeting of the ALT Scotland SIG.  It was great to see so many new faces!  You can find out more about ALT Scotland and join out mailing list for updates.

Learning Technologist of the Year Awards

The University of Edinburgh was acknowledged twice in the Learning Technologist of the Year awards.  The Open Education Team, which I work with, was placed third in the team awards and the Education Development and Enhancement team was highly commended.  The awards were great fun and it was a real honour to join so many of the award winners from 2007 – 2016 on the stage.

ALT Learning Technologists of the Year by  www.chrisbullphotographer.com

ALT Learning Technologists of the Year by
www.chrisbullphotographer.com

ALT Trustee

I’m delighted to have joined the ALT Central Executive Committee as a Trustee and look forward to hopefully making a positive contribution to the organisation.

Virtually Connecting

I took part in a great Virtually Connecting session with Fiona Harvey, Teresa MacKinnon, Nadine Aboulmagd and others.  We discussed a wide range of topics including the risks and privileges associated with openness.

#altc #play

Despite patiently explaining to co-chair Nicola Whitton that I am #notagamer she insisted that I joined her team for the Actionbound School of Rock challenge. Yes really. I have to admit it was a lot of fun and we had the most awesome team.  Also this happened…

Ed Tech Cool, edit by James Clay

Ed Tech Cool, edit by James Clay

We should have won.  We were robbed.

 

Social Media at ALTC Connect, Collaborate and Create

ALTC 2015, CC BY, Chris Bull

ALTC 2015, CC BY, Chris Bull

It’s that time of year again!  The ALT Conference is taking place at the University of Warwick next week. The theme of this years conference, which has a distinctly playful feel, is Connect, Collaborate and Create, and the conference is being co-chaired by Nicola Whitton and Alex Moseley.  I’ll be joining the ALTC social media team again with my partner in crime Richard Goodman from Loughborough University and we’ll be live tweeting all five (count ’em!) of the conference keynotes.   Chris Bull will be on hand again to photograph the conference and this year we’re also being joined by Kenji Lamb from the College Development Network and Sandra Huskinson, Loughborough University, who’ll be helping Martin Hawksey to livestream and broadcast the event.

I’ll also be presenting a paper, Into the Open – a critical overview of open education policy and practice in Scotland on Thursday afternoon, and on Wednesday at 12.15 I’ll be joining Virtually Connecting to talk about open education.  Feel free to join us!

Oh and the Open Education Team that I work with at the University of Edinburgh is up for the ALT Learning Technologist of the Year Community Choice Awards.  If you’d like to vote for us, which would be super nice of you, you can send an email to LTAwards-vote@alt.ac.uk with the subject line #LTA6 or tweet a message with the hashtags #altc #LTA6. 

Look forward to seeing you in Warwick!

Richard Goodman at ALTC 2015, CC BY, Chris Bull

Richard Goodman at ALTC 2015, CC BY, Chris Bull