July 17, 2018

Learning analytics, student satisfaction, and student performance at the UK Open University

There is very little correlation between student satisfaction and student performance. Image: Bart Rienties. Click on image to see the video.

Rienties, B. and Toetenel, L. (2016) The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules, Computers in Human Behaviour, Vol. 60, pp.333-341

Li, N. et al. (2017) Online learning experiences of new versus continuing learners: a large-scale replication study, Assessment and Evaluation in Higher Education, Vol. 42, No. 4, pp.657-672

It’s never too late to learn

It’s been a hectic month with two trips from Vancouver to Ontario and back and one to the UK and back, a total of four keynotes, two panel sessions and two one day consultancies. By the time I got to the end of the month’s travels, I had learned so much that at a conference in Toronto I had to go to my room and lie down  – I just couldn’t take any more!

At my age, it takes time to process all this new information, but I will try to summarise the main points of what I learned in the next three posts.

Learning analytics at the Open University

The Open University, with over 100,000 students and more than 1,000 courses (modules), and most of its teaching online in one form or another, is an ideal context for the application of learning analytics. Fortunately the OU has some of the world leaders in this field. 

At the conference on STEM teaching at the Open University that I attended as the opening keynote, the closing keynote was given by Bart Rienties, Professor of Learning Analytics at the Institute of Educational Technology at the UK Open University. Rienties and his team linked 151 modules (courses) and 111,256 students with students’ behaviour, satisfaction and performance at the Open University UK, using multiple regression models. 

His whole presentation (40 minutes, including questions) can be accessed online, and is well worth viewing, as it provides a clear summary of the results published in the two detailed papers listed above. As always, if you find my summary of results below of interest or challenging, I strongly recommend you view Bart’s video first, then read the two articles in more detail. Here’s what I took away.

There is little correlation between student course evaluations and student performance

This result is a bit of a zinger. The core dependent variable used was academic retention (the number of learners who completed and passed the module relative to the number of learners who registered for each module). As Rientes and Toetenel (p.340) comment, almost as an aside, 

it is remarkable that learner satisfaction and academic retention were not even mildly related to each other….Our findings seem to indicate that students may not always be the best judge of their own learning experience and what helps them in achieving the best outcome.’

The design of the course matters

One of the big challenges in online and blended learning is getting subject matter experts to recognise the importance of what the Open University calls ‘learning design.’ 

Conole (2012, p121) describes learning design as:

a methodology for enabling teachers/designers to make more informed decisions in how they go about designing learning activities and interventions, which is pedagogically informed and makes effective use of appropriate resources and technologies. LD is focussed on ‘what students do’ as part of their learning, rather than the ‘teaching’ which is focussed on the content that will be delivered.

Thus learning design is more than just instructional design.

However, Rienties at al. comment that ‘only a few studies have investigated how educators in practice are actually planning and designing their courses and whether this is then implemented as intended in the design phase.’ 

The OU has done a good job in breaking down some of the elements of learning design. The OU has mapped the elements of learning design in nearly 200 different courses. The elements of this mapping can be seen below (Rientes and Toetenal, 2016, p.335):

Rientes and Toetenel then analysed the correlations between each of these learning design elements against both learner satisfaction and learner performance. What they found is that what OU students liked did not match with learner performance. For instance, students were most satisfied with ‘assimilative’ activities, which are primarily content focused, and disliked communication activities, which are primarily social activities. However, better student retention was most strongly associated with communication activities, and overall, with the quality of the learning design.

Rientes and Toetenel conclude:

although more than 80% of learners were satisfied with their learning experience, learning does not always need to be a nice, pleasant experience. Learning can be hard and difficult at times, and making mistakes, persistence, receiving good feedback and support are important factors for continued learning….

An exclusive focus on learner satisfaction might distract institutions from understanding the impact of LD on learning experiences and academic retention. If our findings are replicated in other contexts, a crucial debate with academics, students and managers needs to develop whether universities should focus on happy students and customers, or whether universities should design learning activities that stretch learners to their maximum abilities and ensuring that they eventually pass the module. Where possible, appropriate communication tasks that align with the learning objectives of the course may seem to be a way forward to enhance academic retention.

Be careful what you measure

As Rientes and Toetenel put it:

Simple LA metrics (e.g., number of clicks, number of downloads) may actually hamper the advancement of LA research. For example, using a longitudinal data analysis of over 120 variables from three different VLE/LMS systems and a range of motivational, emotions and learning styles indicators, Tempelaar et al. (2015) found that most of the 40 proxies of simple” VLE LA metrics provided limited insights into the complexity of learning dynamics over time. On average, these clicking behaviour proxies were only able to explain around 10% of variation in academic performance.

In contrast, learning motivations, emotions (attitudes), and learners’ activities during continuous assessments (behaviour) significantly improved explained variance (up to 50%) and could provide an opportunity for teachers to help at-risk learners at a relatively early stage of their university studies.

My conclusions

Student feedback on the quality of a course is really important but it is more useful as a conversation between students and instructors/designers than as a quantitative ranking of the quality of a course.  In fact using learner satisfaction as a way to rank teaching is highly misleading. Learner satisfaction encompasses a very wide range of factors as well as the teaching of a particular course. It is possible to imagine a highly effective course where teaching in a transmissive or assimilative manner is minimal, but student activities are wide, varied and relevant to the development of significant learning outcomes. Students, at least initially, may not like this because this may be a new experience for them, and because they must take more responsibility for their learning. Thus good communication and explanation of why particular approaches to teaching have been chosen is essential (see my comment to a question on the video).

Perhaps though the biggest limitation of student satisfaction for assessing the quality of the teaching is the often very low response rates from students, limited evaluation questions due to standardization (the same questions irrespective of the nature of the course), and the poor quality of the student responses. This is no way to assess the quality of an individual teacher or a whole institution, yet far too many institutions and governments are building this into their evaluation of teachers/instructors and institutions.

I have been fairly skeptical of learning analytics up to now, because of the tendency to focus more on what is easily measurable (simple metrics) than on what students actually do qualitatively when they are learning. The focus on learning design variables in these studies is refreshing and important but so will be analysis of student learning habits.

Finally, this research provides quantitative evidence of the importance of learning design in online and distance teaching. Good design leads to better learning outcomes. Why then are we not applying this knowledge to the design of all university and college courses, and not just online courses? We need a shift in the power balance between university and college subject experts and learning designers resulting in the latter being treated as at least equals in the teaching process.

References

Conole, G. (2012). Designing for learning in an open world. Dordrecht: Springer

Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: learning analytics in a data-rich context. Computers in Human Behavior, 47, 157e167. http://dx.doi.org/10.1016/j.chb.2014.05.038.

 

Stanford University to be fully online by 2025?

A Stanford sophomore experiences the virtual world at its Virtual Human Interaction Lab

Today I have received a tip from a close colleague that Stanford University is planning to build a partnership with Alphabet Inc., the owner of Google, to enable Stanford to become a fully online global university by 2025. 

Because the university is on an Easter break, it was difficult to find anyone at Stanford to verify this rumour, but the planning seems to be quite advanced. Apparently a highly confidential strategic planning committee has been working for some time on a plan to convert all programs at Stanford into a fully online format, using advanced technologies such as Artificial Intelligence (AI), Virtual and Augmented Reality (VR and AR), and data analytics (DA), technologies in which both Stanford and Google are world leaders.

This will enable Stanford to offer fully accredited degrees to many thousands of students worldwide at a fraction of the current tuition fees, which are currently just under $50,000 a year. Once fully online, the low tuition fees, estimated be around $1,000 a year, will be made possible by a highly innovative business plan being worked out jointly by Stanford and Google. Stanford plans to sell that part of the campus that will no longer be needed for teaching purposes. The Farm, as it is affectionately known, is over 8,000 acres, located close to Silicon Valley. With real estate currently selling at approximately $65 million an acre in Stanford, just selling off half the land will provide sufficient capital for the investment needed to convert all programs into an online mode, leaving the other half of the land for research and administrative purposes. The partnership with Google will allow Google to use data analytics from student online activity for commercial purposes, which will more or less cover the operational costs of online delivery.

I did manage to get hold of a couple of the committee, who asked not to be named as they are not authorised to give information on this project. However, both were very excited. ‘We won’t have to sack any of the current professorial staff, as we still need their subject expertise’, said one. The other said he was really looking forward to developing the first fully augmented reality engineering degree. ‘This could have huge implications,’ he said. ‘Imagine designing a whole bridge without actually having to physically test it! It’s only ever been tried once before without VR and it didn’t work.’ The Director of Stanford University’s Division of Continuing Studies said, ‘You know, it’s not such a big deal. We’ve been delivering online courses in our division for nearly 20 years, so we do know what we’re doing.’

Others outside the university I talked to though were not quite so sanguine. A spokesperson from WCET was concerned about how the accreditation or professional bodies would react. ‘It’s one thing for the university to give degrees; it’s quite another to get recognized by the Accreditation Boards for Engineering and Technology, who in the past have not accepted any online qualifications. But, hey, it’s Stanford, so who knows?’

My personal view is that it still has to get through Stanford’s Senate and Board of Governors. This will be the real test. However, if it is successful, this model will be totally disruptive of the rest of post-secondary education worldwide. If Stanford can scale its model, it could be not just a global university, but THE one university for the whole world. How cool would that be? 

In the meantime, enjoy April the first.

Online learning in 2016: a personal review


global-peace-index-2016-aglobal-peace-initiative-b

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Image: © Institute for Economics and Peace. Canada is ranked seventh most peaceful. We don’t know where it ranks though in terms of online learning.

A personal review

I am not going to do a review of all the developments in online learning in 2016 (for this, see Audrey Watters’ excellent HackEducation Trends). What I am going to do instead is review what I actually wrote about in 2016 in this blog, indicating what to me was of particular interest in online learning during 2016. I have identified 38 posts I wrote in which I have explored in some detail issues that bubbled up (at least for me) in 2016.

1. Tracking online learning

Building a national survey of online learning in Canada (134 hits)

A national survey of university online and distance learning in Canada (1,529 hits)

In the USA, fully online enrollments continue to grow in 2014 (91 hits)

Are you ready for blended learning? (389 hits)

What the Conference Board of Canada thinks about online learning (200 hits)

I indulged my obsession with knowing the extent to which online learning is penetrating post-secondary education with five posts on this topic. In a field undergoing such rapid changes, it is increasingly important to be able to track exactly what is going on. Thus a large part of my professional activity in 2016 has been devoted to establishing, almost from scratch, a national survey of online learning in Canadian post-secondary institutions. I would have written more about this topic, but until the survey has been successfully conducted in 2017, I have preferred to keep a low profile on this issue.

However, during 2016 it did become clear to me, partly as a result of pilot testing of the questionnaire, and partly through visits to universities, that blended learning is not only gaining ground in Canadian post-secondary education at a much faster rate than I had anticipated, but is raising critical questions about what is best done online and what face-to-face, and how to prepare institutions and instructors for what is essentially a revolution in teaching.

This can be best summarized by what I wrote about the Conference Board of Canada’s report:

What is going on is a slowly boiling and considerably variable revolution in higher education that is not easily measured or even captured in individual anecdotes or interviews.

2. Faculty development and training

Getting faculty and instructors into online learning (183 hits)

Initiating instructors to online learning: 10 fundamentals (529 hits)

Online learning for beginners: 10. Ready to go (+ nine other posts on this topic = 4,238 hits)

5 IDEAS for a pedagogy of online learning (708 hits)

This was the area to which I devoted the most space, with ten posts on ‘Online Learning for Beginners’, aimed at instructors resisting or unready for online learning. These ten posts were then edited and published by Contact North as the 10 Fundamentals of Teaching Online.

Two fundamental conclusions: we need not only better organizational strategies to ensure that faculty have the knowledge and training they will need for effective teaching and learning in a digital age, but we also need to develop new teaching strategies and approaches that can exploit the benefits and even more importantly avoid the pitfalls of blended learning and learning technologies. I have been trying to make a contribution in this area, but much more needs to be done.

3. Learning environments

Building an effective learning environment (6,173 hits)

EDEN 2016: Re-imagining Learning Environments (597 hits)

Culture and effective online learning environments (1,260 hits)

Closely linked to developing appropriate pedagogies for a digital age is the concept of designing appropriate learning environments, based on learners’ construction of knowledge and the role of instructors in guiding and fostering knowledge management, independent learning and other 21st century skills.

This approach I argued is a better ‘fit’ for learners in a digital age than thinking in terms of blended, hybrid or fully online learning, and recognizes that not only can technology to be used to design very different kinds of learning environments from school or campus based learning environments, but also that technology is just one component of a much richer learning context.
Slide15

4. Experiential learning online

A full day of experiential learning in action (188 hits)

An example of online experiential learning: Ryerson University’s Law Practice Program (383 hits)

Is networked learning experiential learning? (163 hits)

These three posts explored a number of ways in which experiential learning is being done online, as this is a key methodology for developing skills in particular.

5. Open education

Acorns to oaks? British Columbia continues its progress with OERs (185 hits)

Talking numbers about open publishing and online learning (113 hits)

Towards an open pedagogy for online learning (385 hits)

These posts also tracked the development of open publishing and open educational resources, particularly in British Columbia, leading me to conclude that the OER ‘movement’ has far too narrow a concept of open-ness and that in its place we need an open pedagogy into which open educational resources are again just one component, and perhaps not the most significant.

6. Technology applications in online learning

An excellent guide to multimedia course design (659 hits)

Is video a threat to learning management systems? (603 hits)

Some comments on synchronous online learning technologies (231 hits)

Amongst all the hype about augmented reality, learning analytics and the application of artificial intelligence, I found it more useful to look at some of the technologies that are in everyday use in online learning, and how these could best be used.

7. Technology and alienation

Technology and alienation: online learning and labour market needs (319 hits)

Technology and alienation: symptoms, causes and a framework for discussion (512 hits)

Technology, alienation and the role of education: an introduction (375 hits)

Automation or empowerment: online learning at the crossroads (1,571 hits)

Why digital technology is not necessarily the answer to your problem (474 hits)

These were more philosophical pieces, prompted to some extent by the wider concerns of the impact of technology on jobs and how that has influenced Brexit and the Trump phenomena.

Nevertheless this issue is also very relevant to the teaching context. In particular I was challenging the ‘Silicon Valley’ assumption that computers will eventually replace the need for teachers, and in particular the danger of using algorithms in teaching without knowing who wrote the algorithms, what their philosophy of teaching is, and thus what assumptions have been built into the use of data.

Image: Applift

Image: Applift

8. Learning analytics

Learning analytics and learning design at the UK Open University (90 hits)

Examining ethical and privacy issues surrounding learning analytics (321 hits)

Continuing more or less the same theme of analysing the downside as well as the upside of technology in education, these two posts looked at how some institutions, and the UK Open University in particular, are being thoughtful about the implications of learning analytics, and building in policies for protecting privacy and gaining student ‘social license’ for the use of analytics.

9. Assessment

Developing a next generation online learning assessment system (532 hits)

This is an area where much more work needs to be done. If we are to develop new or better pedagogies for a digital age, we will also need better assessment methods. Unfortunately the focus once again appears to be more on the tools of assessment, such as online proctoring, where large gains have been made in 2016, but which still focus on proctoring traditional assessment procedures such as time-restricted exams, multiple choice tests and essay writing. What we need are new methods of assessment that focus on measuring the types of knowledge and skills that are needed in a digital age.

For instance, e-portfolios have held a lot of promise for a long time, but are still being used and evaluated at a painfully slow rate. They do offer though one method for assessment that reflects much better the needs of assessing 21st century knowledge and skills. However we need more imagination and creativity in developing new assessment methods for measuring the knowledge and skills needed for a digital age.

That was the year that was

Well, it was 2016 from the perspective of someone no longer teaching online or managing online learning:

  • How far off am I, from your perspective?
  • What were the most significant developments for you in online learning in 2016?
  • What did I miss that you think should have been included? Perhaps I can focus on this next year.

I have one more post looking at 2016 to come, but that will be more personal, looking at my whole range of online learning activities in 2016.

In the meantime have a great seasonal break and I will be back in touch some time in the new year.

Building a national survey of online learning in Canada

Image: Canada Explore

Image: Canada Explore

The players

Since April I have been leading a small team that has been trying to build from scratch a national survey of online learning in Canadian post-secondary institutions.

For many years the Babson Survey Research Group has been tracking the growth of online learning in higher education in the USA. With the U.S. Federal Department of Education now collecting this data through its annual IPEDS survey, Jeff Seaman of Babson has been working with Russ Poulin of WCET to help interpret the IPEDS data.

Through the intervention of Tricia Donovan, the director of eCampus Alberta, Jeff and Russ approached me to see if I would be willing to get a Canadian national survey off the ground. I guess I was chosen because through my blog I had been strongly critical of the lack of such data in Canada. (Warning to bloggers: be careful what you ask for as you may end up doing it yourself.)

As a Research Associate with Contact North, I approached its President, Maxim Jean-Louis, for his support. He immediately offered $10,000 towards the cost of the survey. This was a crucial contribution as it enabled me to sound out possible consultants for the project, because Babson had found that the most important contributor to success was ensuring close communication and co-operation with the institutions themselves before the survey was even designed.

The Contact North funding enabled me to approach Dr. Ross Paul, formerly President of two Canadian universities and more importantly, as the author of “Leadership Under Fire”, a book about the role of university presidents in Canada, he was extremely well connected with and knowledgeable about the whole Canadian university sector.

Maxim Jean-Louis also put me in touch with Brian Desbiens, a former college president and also a former chair of the Canadian College Presidents Network, another consultant with an immensely impressive network in the Canadian college sector.

Finally it was immediately clear to us that we needed someone with knowledge and expertise in the francophone sector, and through the assistance of REFAD, the francophone distance education network, Denis Mayer, a former Associate Vice President of Student Services at Laurentian University, also joined the team.

So we now had a steering group for the survey:

  • Tony Bates (lead researcher)
  • Ross Paul (universities)
  • Brian Desbiens (colleges)
  • Denis Mayer (francophone)
  • Tricia Donovan (provincial government agencies)
  • Jeff Seaman (survey design and implementation)
  • Russ Poulin (US liaison)

The process

Our first task was to ensure that we had support, or at least not opposition, from the institutions, about 80 universities and over 200 publicly funded colleges. Fortunately in Canada there are almost no private universities and there is a clear distinction between provincially funded and supported colleges and private career and language schools. Our survey is focused then solely on the public system of post-secondary education, consisting of just over 2 million students.

One challenge is that there is no overall federal responsibility for the delivery of post-secondary education in Canada. This means that there are 10 provinces with 10 slightly different systems of post-secondary education. In addition there are anglophone, francophone and bilingual institutions.

Nevertheless there are two key national organisations, Universities Canada (UC), and Colleges and Institutes Canada (CICAN), that between them cover most of the institutions, so one of our first tasks was to brief them and gain their support in communicating with the institutions. Also there are several francophone organisations that represent the interests of francophone universities and colleges, and the unique system in Québec of CEGEPs, publicly funded pre-university colleges that offer a pre-university qualification that is necessary for admission to Québec’s universities (except for mature students). Secondary school and undergraduate degrees are both one year shorter in Quebec as a result.

These initial contacts with the national or regional organisations enabled us to identify the population base for the survey: the list of institutions to be covered. This enabled the consultants to e-mail directly the provosts and VPs Academic of every institution for their support and participation in the study.

At the same time, the Steering Committee was engaged in a series of discussions around the design of the questionnaires. We had the advantage of the prior work of the Babson Survey Research Group in the USA, but the questionnaires had to be adapted to the unique Canadian post-secondary education system. At the same time we are anxious to ensure that we can make international comparisons. It became quickly clear that we will need several different versions of the questionnaire, as follows:

  •  anglophone universities
  • anglophone colleges
  • francophone universities
  • CEGEPS
  • francophone colleges (outside Québec).

Core questions would be the same across all versions, but others would reflect the unique nature of each institution (e.g. what qualifications were offered partly or wholly online).

To get early feedback on the questionnaire design, two consultants attended the CIRPA conference of Canadian institutional researchers and held a special session devoted to feedback on the initial questionnaire design and especially in the definitions of fully online and blended/hybrid learning.

The first full versions of the questionnaires have now been designed. We have identified 10 universities and eight colleges across all 10 provinces who have volunteered to give feedback on the pilot questionnaire, and they have been asked to reply by the end of December. We are planning one more round of piloting after that, and hope to have the final version of the questionnaire distributed to all the universities and colleges in March.

In order to keep the questionnaire as short as possible, we are collecting as much key data about the institutions, such as their size, from other sources. For instance, the Canadian Virtual University has provided data on distance education enrolments for its dozen or so member institutions that go back to 2001. In the end, we will have an extensive and comprehensive database of Canadian post-secondary educational institutions, and of their activities in online learning.

I am working with Jeff Seaman on the design of the questionnaire analysis, and we will use the Babson Survey Research Group’s data entry and analysis facilities to process the questionnaire data. We envisage one overall, national report in English and French and a number of smaller reports focused on specific sectors, including a specially written report on the francophone sector. These will be published in the summer of 2017, and the results will be presented at the ICDE’s World Congress on Online Learning in Toronto in October.

Lastly, we will not be identifying any individual institution, unless they expressly request to be identified, but we do aim to make the data open and accessible to other researchers. We hope to locate the data with one or more of the organizations representing the institutions.

Funding

The Babson surveys in the USA benefited from financial support from the Sloan Foundation and also from a number of private sponsors, such as publishers.  Funding frankly has been the biggest challenge so far for the Canadian survey.

We decided to divide the funding requirements into three stages. The first stage would be to acquire funds to develop the institutional support needed, build the database, and design and pilot the questionnaire. The second stage of funding would be to cover the costs of the data collection, data entry, data analysis, report writing and dissemination, as well as having sufficient funds to start the development of the following year’s survey. The third phase would be to cover long-term and regular funding for future annual surveys.

We have successfully completed the first phase of fund raising, thanks to the help of Contact North and the provincial eCampuses (BCcampus, eCampus Alberta, Campus Manitoba and eCampus Ontario). This has raised $45,000.

We are still seeking funding for the second phase. We estimate that we will need somewhere around $100,000 to complete the second phase, and for the third phase we will need to raise about $125,000 a year.

We have submitted requests for second stage funding to eCampus Ontario’s Research and Innovation Fund and to a Canadian foundation, and we are waiting to hear from them. The Canadian arm of a major publisher has also expressed an interest in supporting the survey. However, we are now at the point where we urgently need to secure firm funding for the second stage.

What we need

The project is now at a critical point in its development. We have secured the support of the institutions, we are ready to pilot the questionnaire, and we are building the institutional database. However, we still need the following:

  • money to cover the costs of the actual survey and report writing (in both English and French)
  • feedback on the definitions of online learning, whether we have the right questions, and whether institutions can actually provide the data requested; the piloting will provide this feedback
  • all institutions, large and small, whether they have strong or no online programs at all, to complete the questionnaire.

The benefits

If we are successful in completing the study, we hope that we will have achieved the following:

  • established a reliable snapshot of the state of online learning across Canada in post-secondary education
  • created a comprehensive, national database of Canadian post-secondary educational institutions that could be used for further research purposes
  • provided a baseline for future studies of online learning, so trends can be tracked
  • identified the areas where online learning is growing or declining
  • identified some of the key issues that institutions are facing regarding online learning
  • enabled institutions to see how they compare with other institutions in Canada in terms of their online learning development
  • enabled Canada to compare itself with developments in online learning in other countries.

Your help

Although we are still pursuing a number of possible sources of funding, if you have ideas of where or how to secure the the second and third stages of funding, please contact me at tony.bates@ubc.ca.

In particular, I urge Canadian readers of this blog to give their support within their institution to ensure that we get as good a response as possible to completing the questionnaire so that we have a reliable and comprehensive survey.

Any other comments about the value of the survey or the strategy we are following will also of course be welcome.

In the meantime, watch this space for further developments.

References

Paul, R. (2011) Leadership Under Fire: The Challenging Role of the Canadian University President Montreal & Kingston: McGill-Queen’s University Press, pp. 333

 

EDEN 2016: Re-imagining Learning Environments

Pesti Vigadó, where the conference dinner was held

Pesti Vigadó Concert Hall, where the conference dinner was held

The EDEN conference

I have just attended the annual conference of the European Distance and E-Learning Network in Budapest, Hungary.

EDEN is one of my favourite conferences because it always has a lot of interesting people attending and it is a quick way for me to stay abreast of what is happening in European online and distance learning. I provide here an overall report on the conference, but I will do a couple of other more detailed posts on the sessions I found particularly interesting.

There were just under 300 participants. My overall impression is that online and open learning are well and strong in Europe, and is now widespread. When I first started to come to EDEN conferences in the early 1990s, there were only two or three main players, but this year there were contributions from almost every European country. With the growth of online and open learning, there are many new people each year joining the field, coming from very diverse backgrounds. EDEN provides a pan-European opportunity to enable newcomers to learn about some of the basic principles and prior research and knowledge in the field, as well as allowing for the sharing of experience and networking, and reporting new trends and developments in online and open learning.

I was the opening keynote speaker, and talked about building effective learning environments, based on my chapter in Teaching in a Digital Age. I also gave the wrap-up to the conference, on which this post is based.

A concert at the Liszt Academy of Music

A concert at the Liszt Academy of Music

Policy, planning and management

This year there was a welcome number of contributions that focused on policy and management of online, open and distance learning.

Yves Punie of the European Commission’s Joint Research Centre’s Institute for Prospective Technological Skills reported that 70 million Europeans lacked basic literacy and numeracy skills, 24% had no upper secondary education and 45% have insufficient digital literacy skills, although 90% of jobs in Europe will require some sort of ICT skills. The Institute has developed a list of key digital competencies. He noted that while 21% of universities in Europe are now offering MOOCs, most have no overall strategy for open education.

George Ubachs of the European Association of Distance Teaching Universities in his presentation on The Changing Pedagogical Landscape offered an interesting vision for universities that emphasised:

  • personalized teaching and learning
  • small scale, intensive education
  • rich learning environments
  • open-ness and flexibility
  • networked education and mobility

Leslie Wilson of the European University Association commented that:

MOOCs have forced Vice Chancellors to focus on teaching and learning

This is probably a true if sad statement.

I was particularly impressed by Melissa Highton’s report on the open learning strategy of Edinburgh University. It is a highly ranked, old research university in Scotland that has aligned its approach to open education to the university’s core mission. She said:

Not being open is a risk and not being open costs us money.

Laureate University is a global private, for-profit university with over one million enrolments, and with campuses in Europe as well as North America. The leadership at Laureate has decided that the whole system will move from largely face-to-face teaching to blended learning. Alan Noghiu described the strategy that is being used and the challenges the organization is facing in implementing the strategy.

Finally, Alan Tait reported on a study by the International Council for Distance Education (ICDE) on student success factors, which identified the following as critical to student success:

  • pre-study information, advice, guidance and admission;
  • curriculum or programme design that matches the needs of students;
  • intervention at key points and in response to student need;
  • assessment to support learning as well as to judge achievement;
  • individualised and personalised systems of support to students;
  • information and logistical systems that communicate between all relevant participants in the system;
  • overall managing for student success.

This seems to me to be a list that proponents of MOOCs should bear in mind, as well as those offering more formal qualifications at a distance.

The use of multimedia and emerging technologies

Susan Aldridge of Drexel University presented some very interesting examples of educational uses of virtual reality, augmented reality, serious games and holography, including examples used in forensic investigation, meteorology, and medicine. One of the augmented reality tools she demonstrated, Aurasma, is free.

Danny Arati of Intel mentioned the University of Nottingham’s The Periodic Table of Videos, where each element in the period table has a short video about it.

The Periodic Table of Videos, University of Nottingham

The Periodic Table of Videos, University of Nottingham

MOOCs and online learning

I was surprised at how much importance European institutions are still giving to MOOCs. There were by far more papers on MOOCs than on credit-based online learning or even blended learning. Even the Oxford debate this year was on the following motion:

We Should Focus in the Short Term More on MOOCs than on OER

I was relieved when the motion was resoundingly defeated, although I am still a little disheartened that open education is still mainly focused on MOOCs and OERs, rather than on the broader concept of open textbooks, open research, and open data. It was noted that MOOCs are a product while open education is a movement, and it is important not to lose the idea that open education is as much about social justice and equity as it is about technology, as was pointed out by one of the participants, Ronald McIntyre.

Learning analytics

There was an excellent workshop organised by Sally Reynolds and Dai Griffiths from the European Commission funded LACE project: Learning Analytics Community Exchange. The workshop focused on privacy and ethics issues that arise from the use of learning analytics.

This is such an important topic that I will do a full blog post on it later. In the meantime, if you are interested in this topic, see the LACE report: Is Privacy a Show-stopper for Learning Analytics? A Review of Current Issues and their Solutions.

The foyer of the Gresham Hotel

The foyer of the Gresham Hotel

Bits and Pieces

There were several other interesting activities at the conference that are worth reporting:

Pre-conference workshop for young scholars. This was an interesting forum where editors of three of the journals in the field discussed with young (or more accurately, new) scholars how to get published.

Book and wine session This informal late evening session provided an opportunity for participants to share their reviews of interesting books. This is an event that could be expanded to cover both ‘classics’ in the field, as well as books on new developments.

Posters There were about a dozen posters. Again, I would like to see more posters at conferences such as this. A well designed poster can be read in a couple of minutes and impart as much if not more information than a 20 minute oral presentation, and can be seen by everyone at the conference, unlike a presentation at a parallel session, some of which, such as the horrible ‘speed-dating’ sessions, resembled having a fire hose of information turned on you – or am I just a visual learner?

Given that so many new people are moving into online and open learning all the time, much more needs to be done at conferences such as this to encourage sessions where prior knowledge and best practices are brought to the attention of new participants.

Conclusions

Overall, this was another excellent conference from EDEN in a wonderful location (it is the first time I have been immersed into Turkish baths). The next one will be next year in Jönköping, southern Sweden.

Art Nouveau stained glass windows at the Hotel Gellert

Art Nouveau stained glass windows at the Hotel Gellert

All photos: Tony Bates