December 5, 2016

Building a national survey of online learning in Canada

Listen with webReader
Image: Canada Explore

Image: Canada Explore

The players

Since April I have been leading a small team that has been trying to build from scratch a national survey of online learning in Canadian post-secondary institutions.

For many years the Babson Survey Research Group has been tracking the growth of online learning in higher education in the USA. With the U.S. Federal Department of Education now collecting this data through its annual IPEDS survey, Jeff Seaman of Babson has been working with Russ Poulin of WCET to help interpret the IPEDS data.

Through the intervention of Tricia Donovan, the director of eCampus Alberta, Jeff and Russ approached me to see if I would be willing to get a Canadian national survey off the ground. I guess I was chosen because through my blog I had been strongly critical of the lack of such data in Canada. (Warning to bloggers: be careful what you ask for as you may end up doing it yourself.)

As a Research Associate with Contact North, I approached its President, Maxim Jean-Louis, for his support. He immediately offered $10,000 towards the cost of the survey. This was a crucial contribution as it enabled me to sound out possible consultants for the project, because Babson had found that the most important contributor to success was ensuring close communication and co-operation with the institutions themselves before the survey was even designed.

The Contact North funding enabled me to approach Dr. Ross Paul, formerly President of two Canadian universities and more importantly, as the author of “Leadership Under Fire”, a book about the role of university presidents in Canada, he was extremely well connected with and knowledgeable about the whole Canadian university sector.

Maxim Jean-Louis also put me in touch with Brian Desbiens, a former college president and also a former chair of the Canadian College Presidents Network, another consultant with an immensely impressive network in the Canadian college sector.

Finally it was immediately clear to us that we needed someone with knowledge and expertise in the francophone sector, and through the assistance of REFAD, the francophone distance education network, Denis Mayer, a former Associate Vice President of Student Services at Laurentian University, also joined the team.

So we now had a steering group for the survey:

  • Tony Bates (lead researcher)
  • Ross Paul (universities)
  • Brian Desbiens (colleges)
  • Denis Mayer (francophone)
  • Tricia Donovan (provincial government agencies)
  • Jeff Seaman (survey design and implementation)
  • Russ Poulin (US liaison)

The process

Our first task was to ensure that we had support, or at least not opposition, from the institutions, about 80 universities and over 200 publicly funded colleges. Fortunately in Canada there are almost no private universities and there is a clear distinction between provincially funded and supported colleges and private career and language schools. Our survey is focused then solely on the public system of post-secondary education, consisting of just over 2 million students.

One challenge is that there is no overall federal responsibility for the delivery of post-secondary education in Canada. This means that there are 10 provinces with 10 slightly different systems of post-secondary education. In addition there are anglophone, francophone and bilingual institutions.

Nevertheless there are two key national organisations, Universities Canada (UC), and Colleges and Institutes Canada (CICAN), that between them cover most of the institutions, so one of our first tasks was to brief them and gain their support in communicating with the institutions. Also there are several francophone organisations that represent the interests of francophone universities and colleges, and the unique system in Québec of CEGEPs, publicly funded pre-university colleges that offer a pre-university qualification that is necessary for admission to Québec’s universities (except for mature students). Secondary school and undergraduate degrees are both one year shorter in Quebec as a result.

These initial contacts with the national or regional organisations enabled us to identify the population base for the survey: the list of institutions to be covered. This enabled the consultants to e-mail directly the provosts and VPs Academic of every institution for their support and participation in the study.

At the same time, the Steering Committee was engaged in a series of discussions around the design of the questionnaires. We had the advantage of the prior work of the Babson Survey Research Group in the USA, but the questionnaires had to be adapted to the unique Canadian post-secondary education system. At the same time we are anxious to ensure that we can make international comparisons. It became quickly clear that we will need several different versions of the questionnaire, as follows:

  •  anglophone universities
  • anglophone colleges
  • francophone universities
  • CEGEPS
  • francophone colleges (outside Québec).

Core questions would be the same across all versions, but others would reflect the unique nature of each institution (e.g. what qualifications were offered partly or wholly online).

To get early feedback on the questionnaire design, two consultants attended the CIRPA conference of Canadian institutional researchers and held a special session devoted to feedback on the initial questionnaire design and especially in the definitions of fully online and blended/hybrid learning.

The first full versions of the questionnaires have now been designed. We have identified 10 universities and eight colleges across all 10 provinces who have volunteered to give feedback on the pilot questionnaire, and they have been asked to reply by the end of December. We are planning one more round of piloting after that, and hope to have the final version of the questionnaire distributed to all the universities and colleges in March.

In order to keep the questionnaire as short as possible, we are collecting as much key data about the institutions, such as their size, from other sources. For instance, the Canadian Virtual University has provided data on distance education enrolments for its dozen or so member institutions that go back to 2001. In the end, we will have an extensive and comprehensive database of Canadian post-secondary educational institutions, and of their activities in online learning.

I am working with Jeff Seaman on the design of the questionnaire analysis, and we will use the Babson Survey Research Group’s data entry and analysis facilities to process the questionnaire data. We envisage one overall, national report in English and French and a number of smaller reports focused on specific sectors, including a specially written report on the francophone sector. These will be published in the summer of 2017, and the results will be presented at the ICDE’s World Congress on Online Learning in Toronto in October.

Lastly, we will not be identifying any individual institution, unless they expressly request to be identified, but we do aim to make the data open and accessible to other researchers. We hope to locate the data with one or more of the organizations representing the institutions.

Funding

The Babson surveys in the USA benefited from financial support from the Sloan Foundation and also from a number of private sponsors, such as publishers.  Funding frankly has been the biggest challenge so far for the Canadian survey.

We decided to divide the funding requirements into three stages. The first stage would be to acquire funds to develop the institutional support needed, build the database, and design and pilot the questionnaire. The second stage of funding would be to cover the costs of the data collection, data entry, data analysis, report writing and dissemination, as well as having sufficient funds to start the development of the following year’s survey. The third phase would be to cover long-term and regular funding for future annual surveys.

We have successfully completed the first phase of fund raising, thanks to the help of Contact North and the provincial eCampuses (BCcampus, eCampus Alberta, Campus Manitoba and eCampus Ontario). This has raised $45,000.

We are still seeking funding for the second phase. We estimate that we will need somewhere around $100,000 to complete the second phase, and for the third phase we will need to raise about $125,000 a year.

We have submitted requests for second stage funding to eCampus Ontario’s Research and Innovation Fund and to a Canadian foundation, and we are waiting to hear from them. The Canadian arm of a major publisher has also expressed an interest in supporting the survey. However, we are now at the point where we urgently need to secure firm funding for the second stage.

What we need

The project is now at a critical point in its development. We have secured the support of the institutions, we are ready to pilot the questionnaire, and we are building the institutional database. However, we still need the following:

  • money to cover the costs of the actual survey and report writing (in both English and French)
  • feedback on the definitions of online learning, whether we have the right questions, and whether institutions can actually provide the data requested; the piloting will provide this feedback
  • all institutions, large and small, whether they have strong or no online programs at all, to complete the questionnaire.

The benefits

If we are successful in completing the study, we hope that we will have achieved the following:

  • established a reliable snapshot of the state of online learning across Canada in post-secondary education
  • created a comprehensive, national database of Canadian post-secondary educational institutions that could be used for further research purposes
  • provided a baseline for future studies of online learning, so trends can be tracked
  • identified the areas where online learning is growing or declining
  • identified some of the key issues that institutions are facing regarding online learning
  • enabled institutions to see how they compare with other institutions in Canada in terms of their online learning development
  • enabled Canada to compare itself with developments in online learning in other countries.

Your help

Although we are still pursuing a number of possible sources of funding, if you have ideas of where or how to secure the the second and third stages of funding, please contact me at tony.bates@ubc.ca.

In particular, I urge Canadian readers of this blog to give their support within their institution to ensure that we get as good a response as possible to completing the questionnaire so that we have a reliable and comprehensive survey.

Any other comments about the value of the survey or the strategy we are following will also of course be welcome.

In the meantime, watch this space for further developments.

References

Paul, R. (2011) Leadership Under Fire: The Challenging Role of the Canadian University President Montreal & Kingston: McGill-Queen’s University Press, pp. 333

 

Second webinar on choosing media for online learning

Listen with webReader

khan-image-2

This morning I delivered (for the second time) a Contact North webinar: Choosing Media: How They Differ and How to make the Best Choices for Your Teaching‘ based on Chapters 6-8 of my open, online textbook, Teaching in a Digital Age.

The webinar was primarily a discussion with participants about the main issues involved in choosing appropriate media for teaching and learning.

The following topics were covered:

  • The difference between media and technology
  • Types of media
  • Pedagogical differences between media
  • SECTIONS: a model for deciding between media
  • General questions on the use of media in education

A full recording of the webinar is available from: https://contactnorth.webex.com/contactnorth/lsr.php?RCID=2235eb10bd59ef7234a13e5367d4e37b

 

A survey of distance education in Brazil

Listen with webReader

brazil-2

ABED (2016) 2015 Brazilian Census for Distance Learning: Analytical Report on Distance Learning in Brazil São Paulo, Brazil: Associação Brasileira de Educação a Distância (ABED)

“In God we trust. All others must bring data.”

W. Edwards Deming, quoted in the report.

This is the 8th year that ABED (the Brazilian Association of Distance Education) has surveyed distance learning in Brazil. The 82 page report with another 100 or so pages of tables is available in both English and Portuguese.

Methodology

The report states:

Because institutions have chosen to participate voluntarily, the survey that feeds this document seeks to be comprehensive, but does not intend to establish an exhaustive scenario of distance learning in Brazil. Its analyses, instead, aim to present a picture of market trends in regards to the categories of institutions that work with the distance learning modality, the types of courses offered, the audience they reach, the execution of distance learning activities, their organization and even profitability, necessary investments and challenges inherent to this modality.

The report covers:

  • Institutions accredited by the Brazilian National Education System at all levels: primary, technical, undergraduate and graduate;
  • Formal and informal educational institutions who offer open courses.
  • Institutions operating in corporate learning.
  • Companies that supply distance learning products and services.

Blended courses are defined by Federal Law as having up to 20% of the workload offered in distance learning mode.

ABED contacted 1,145 institutions via email newsletter and an open invitation published on the association’s website, with information about the survey for all establishments operating in distance learning. In total the survey was based on 368 responses, of which 339 were educational institutions, and 69 ‘suppling’ organizations. The 339 educational institutions were made up as follows:

  • public (federal, state and municipal): 92
  • for profit: 114
  • private not-for-profit: 71
  • other: 62

Participating institutions were from 27 states across the whole of Brazil.

Results are broken down by a range of variables, such as type of organization, size, region, etc.

Main findings

This survey had a significantly increased number of participants over previous surveys conducted by ABED and confirms the growth in the number of institutions and companies working in distance learning in 2015:

  • it identified a total of 5,048,000 students in fully distance or blended courses, of whom:
    • 1.1 million were in fully accredited (degree) courses
    • 3.9 million were in corporate or non-corporate open courses
  • just over half (53%) are women and almost half are aged between 31-40
  • 70% of the students are working as well as studying
  • the most common discipline area for both fully online and blended courses is teacher education/training
  • drop-out rates for distance learning courses are higher than for on-site courses, averaging between 26%-50% for fully distance accredited courses.
  • over 50% of the institutions had a centralized management structure for distance learning courses and programs
  • nearly a quarter of the surveyed institutions intend to increase their investments in distance learning in 2016, notably in strengthening blended learning
  • the investments made by non-profit and for-profit private institutions were higher compared to that of public institutions,
  • the majority of distance learning classes have between 31-50 students
  • more than 60% of institutions used open source learning management systems, customized within the institution, of which 43% were cloud-based
  • a good deal of information is provided about private companies offering distance learning services; these private companies provide services particularly to for-profit institutions.

Comment

Professor Fred Litto, the President of ABED, in his introduction states:

One must refer to quantitative data in order to be able to efficiently discuss what distance learning (DL) represents to a nation such as Brazil

This is a statement with which I fully concur, and I have lamented many times the complete lack of national data in Canada. The report is extremely wide-ranging and covers many areas that I have not seen in other national surveys. This no doubt is one of the benefits of doing surveys over a number of years.

Nevertheless I do have some serious concerns about this survey. Without a comparison with the total number of institutions in Brazil, it is difficult to know how representative this survey is. Even within the 1,145 institutions approached for the survey, the response rate was 32%.

Furthermore although there is a definition of blended learning given, I couldn’t find a definition of distance learning. In particular what proportion of the courses were fully online and what correspondence or print-based? There is a lot in the report about how text and audio-visual materials are acquired or developed, and even more about learning management systems, but as an outsider I am left wondering about how much is done online and how much by other methods. This is an important consideration given the different levels of access to the Internet in Brazil. Maybe though it has been covered in earlier reports.

However, given the huge challenge of surveying institutions in a country as large as Brazil (a population of 200 million and an area almost as large as the USA), and the tremendous differences between the regions and between socio-economic groups within regions, the report still provides a fascinating insight into distance learning in Brazil. For instance 15%-25% of the institutions surveyed offered open, ‘MOOC-like’ courses.

As always, you should read the full report yourself and come to your own conclusions, as there are many valuable nuggets buried in the more detail parts of the report, but it is clear that distance and especially blended learning continues to grow in Brazil, and ABED is to be congratulated for wrestling such a monster to the ground.

Scary tales of online learning and educational technology

Listen with webReader
The Centre for Digital Media, Vancouver BC

The Centre for Digital Media, Vancouver BC

The Educational Technology Users Group (ETUG) of British Columbia held an appropriately Halloween-themed get together today called ‘The Little Workshop of Horrors’ at which participants were encouraged to share tales of failure and horror stories in the use of learning technologies.

This seemed to me a somewhat risky strategy but it actually worked really well. First the workshop was held in ‘the Hangar’, a large, covered space in (or rather beside) the Centre for Digital Media, a shared building used by UBC, Simon Fraser University, BCIT and the Emily Carr University of Art and Design. The Centre itself is a good example of collaboration and sharing in developing media-based programs, such as its Master of Digital Media. The Hangar lent itself to a somewhat spooky atmosphere, enhanced by a DJ who often accompanied presenters with ghoulish music.

Audrey’s Monsters

The workshop got off to an excellent start with a brilliant keynote from Audrey Watters on the Monsters of Educational Technology (The link will take you to her book on the subject). She identified a range of monsters (the examples are partly Audrey’s, partly mine):

  • Frankenstein’s monster that went wrong because its (hir?) master failed to provide it (em?) with love or social company (teaching machines?): in Audrey’s word’s ‘a misbegotten creature of a misbegotten science’,
  • vampires that suck the blood of students, e.g. by using their personal data (learning analytics?),
  • zombies, i.e. technologies or ed tech ideas that rise and die then rise again (e.g. technology will remove the need for schools, an idea that goes back to the early 1900s),
  • giants that become obsolete and die (Skinner, Merrill)
  • the Blob, which grows bigger and bigger and invades every nook and cranny (MOOCs?)
  • and the dragons, are the libertarian, free-market, Silicon-valley types that preach the ‘destruction’ and ‘re-invention’ of education.

Audrey Watters’ larger point is that if we are not careful, educational technology easily turns itself into a monster that drives out all humanity in the teaching and learning process. We need to be on constant watch, and, whenever we can, we need to take control away from large technology corporations whose ultimate purpose is not educational.

Not only was it a great, on topic, presentation, but it was also such a pleasure to meet at last Audrey in person, as I am a huge fan of her blog.

He was a monster, not because he was a machine, but because he wasn't loved

Confessions

Then came the confessional, at which a series of speakers confessed their sins – or rather, classic failures – about educational technology, often in very funny ways. What was interesting though about most of the tales was that although there was a disaster, in most cases out of the disaster came a lot of good things. (As one speaker said, ‘Success is failing many times without losing your optimism’; or ‘ A sailor gets to know the sea only after he has waded ashore.’).

One presenter reported going to a university to ‘sell’ Blackboard but was so nervous that her presentation was so bad they ended up going with Canvas (you see what I mean about some good coming out of these disasters!) Another described how over 20 years she has been trying to move faculty into more interactive and engaging technology than learning management systems, yet here she is still spending most of her time supporting faculty using an LMS.

One talked about spending years trying to promote IMS-based learning objects, only to find that Google’s search engine made meta-data identification redundant. Revealingly, he felt he knew at the time that the meta-data approach to learning objects was too complex to work, but he had to do it because that was the only way he could get funding. More than one speaker noted that Canada in the past has spent millions of dollars on programs that focused heavily on software solutions (anyone remember EduSource?) but almost nothing on evaluating the educational applications of technology or on research on new or even old pedagogies.

Another spoke about the demise of a new university, the Technical University of British Columbia, that was a purpose-built, new university deliberately built around an “integrated learning” approach, combining heavy use of on-line learning with mixed face-to-face course structures – in 1999. However, by 2002 it had only about 800 FTEs, and a new incoming provincial government, desperate to save money and eager to diminish the previous government’s legacy, closed the university and transferred the students (but not the programs) to Simon Fraser University. Nevertheless, the legacy did live on, with many of the learning technology staff moving later into senior positions within the Canadian higher education system.

I see instructional designers, educational technologists or learning ecology consultants (which was a new title for me) as the Marine Corps of the educational world. They have seen many battles and have (mostly) survived. They have even learned how to occasionally win battles. That’s the kind of wisdom of which academic leaders and faculty and instructors should make much better use.

One participant had such a bad experience at Simon Fraser University that she thinks of it as 'the haunted house on the hill.'

One participant had such a bad ed tech experience at Simon Fraser University that she thinks of it as ‘the haunted house on the hill.’

Happy Halloween, everyone!

What the Conference Board of Canada thinks about online learning

Listen with webReader

conference-board-2

Grant, M. (2016) Learning in the Digital Age Ottawa: Conference Board of Canada

The Conference Board of Canada bills itself as ‘the foremost independent, evidence-based, not-for-profit applied research organization in Canada’. Its Board is made up mainly of representatives from major corporate or business organizations. So when it issues a report on e-learning in Canada, it is likely to be read across a broad swathe of corporate and governmental organizations not directly engaged in education, but with a major interest in the kinds of graduates being produced in Canada in a digital age. It is also something that Canadian university leaders are likely to pay attention to as well.

What the report is about

The introduction to the report states:

Information and communication technologies hold the potential to improve post-secondary learning by making learning more accessible and engaging. This report considers how and when e-learning may be used to improve post-secondary education in Canada.

Contents

Chapter 1: Introduction

E-learning is defined (‘online learning’ is considered as being more or less the same as e-learning), it is argued that the quality of teaching drops as face-to-face class sizes get larger, and e-learning can make learning less expensive and more accessible.

Chapter 2: the 5 Ws of e-learning:

The five Ws are the what, why, when, who, and where of e-learning in Canada. The main points of this chapter are as follows:

  • E-learning uses a range of information and communication technologies (ICTs) to deliver and manage learning.
  • The inherent differences between e-learning and traditional face-to-face classroom instruction relate to two factors: organization of time and space, and use of technology.
  • E-learning is becoming more popular because it appeals to learners, is cost-effective, and its quality is improving.
  • The North American e-learning market is mature in terms of e-learning adoption, but still developing in terms of the sophistication of e-learning offerings. Other markets around the world are rapidly adopting e-learning.

Chapter 3: Post-secondary e-learning in Canada

This provides a brief summary of current e-learning provision in Canadian universities and colleges. Almost the whole of the information in this chapter is based on secondary sources. It concludes:

Canada’s post-secondary institutions have been reluctant to offer e-learning as a degree option to full-time undergraduate students; perhaps because this would compete with residential learning programs.

This chapter also argues that investments in e-learning technologies such as LMSs are considerably under-utilized, that adoption is following the path of least resistance, and for the most part, e-learning is not being used as an alternative format for younger, full-time degree students because this would undermine institutions’ need to make use of existing classroom infrastructure.

Chapter 4: Advancing e-learning

This chapter particularly looks at the perceived barriers to e-learning:

There are a variety of institutional factors that must be addressed if e-learning is to be more widely adopted in the Canadian post-secondary system. These have to do with the way capital is funded at the institutions, institution management, and the way e-learning is designed and executed.

most of the people who make decisions about funding capacity favour building more physical classes. It matters little whether this is the most efficient and effective way to conduct post-secondary education….The economics of funding capacity help to explain why e-learning adoption is low. If capacity is funded in a different way, then the economics will change.

rational capacity planning and utilization should consider optimal pedagogy and learner preferences first, followed by investing in suitable learning capacity to accommodate the volume and type of learning. Then the pricing of learning should reflect its cost to deliver.

In this chapter it is argued that there is much poor quality e-learning in Canadian post-secondary institutions, but it provides three examples of effective e-learning design and execution (from York University, the University of Alberta, and Humber College).

Main report conclusions

  • E-learning holds the potential to profoundly change the way post-secondary education (PSE) is designed and delivered.
  • From a quality perspective, e-learning may be more engaging, less passive, and more customized to different learning styles than traditional lecture-based learning.
  • There are about 1.3 million enrolments in fully online university and college courses in Canada. E-learning accounts for between 10 and 15 per cent of PSE learning.
  • Greater adoption of e-learning will happen if institutional focus on traditional classroom delivery can be reduced; faculty are adequately supported when they teach online; and e-learning design, development, and delivery practices improve.

Report recommendations (summary)

‘Based on this report’s analysis, the following recommendations are made for consideration in the [Conference Board’s] Centre for Skills and Post-Secondary Education (SPSE) national strategy:

  1. Reduce economic barriers to e-learning adoption: Institutional administrators, governments, and benefactors need to work together to change the PSE approach to capacity planning. They need to consider how to use e-learning and blended learning to lower costs, improve accessibility, and increase quality.
  2. Tackle institutional constraints to e-learning: Faculty resistance will be broken down when more faculty members are supported in approaching their teaching responsibilities through blended and e-learning formats.
  3. Adopt excellent e-learning practices: Post-secondary institutions need to recognize e-learning instructional design as a unique discipline. They need to access these distinctive skills either through their own in-house teams or external providers. Forums need to be created for post-secondary stakeholders to share and adopt best practices in e-learning design and execution.

Comment

This is a curious report and I find it unusually difficult to comment on it. Most of the conclusions I would not disagree with, but the report has a peculiar feeling of being written by outsiders who haven’t really quite grasped what’s going on. What is going on is a slowly boiling and considerably variable revolution in higher education that is not easily measured or even captured in individual anecdotes or interviews.

The main weakness of the report is that it relies so heavily on secondary sources. It is really disappointing that the Conference Board did not do any original research to establish the state of e-learning in Canadian post-secondary education. By relying to large extent on a few selective interviews and a very limited range of previously published papers, the report suggests conclusions were arrived at early then evidence was looked for to support the conclusions. At no point does it provide any evidence to support statements such as ‘e-learning can make learning less expensive and more accessible.’ Yes, it can but we need evidence, and it would show (for instance see: Carey and Trick, 2013) that while relatively important gains in productivity can be made, there are also serious limitations to what can be done in this respect.

At the same time, it is an important report. It does make the excellent point that a great deal of investment in post-secondary education is driven by the need to maximize physical plant and that this seriously militates against the large investment needed in e-learning if it is to make a difference. Cutting ribbons on a new building is much more photogenic for politicians than enrolling another 1,000 students online.

However, when you look at the recommendations they are painfully obvious and in fact are being applied in many if not most Canadian post-secondary institutions, maybe too slowly or not aggressively enough but the report makes it clear why this is the case.

At the end of the day this report reads somewhat like the first draft of a masters’ dissertation on Canadian online learning. It does not provide the heft needed to bring about or rather accelerate the major changes I would agree that are needed in this area. In particular once again a major opportunity to provide some new, hard data on online learning, and particularly its potential for improving productivity, was missed.

Nevertheless I do hope that government policy makers, institutional leaders and corporations will pay attention to this report, because it does make clear that e-learning/online learning must be a critical component of a successful future for Canadian post-secondary education. We just need to invest more in it.

Reference

Carey, T., & Trick, D. (2013). How Online Learning Affects Productivity, Cost and Quality in Higher Education: An Environmental Scan and Review of the Literature. Toronto: Higher Education Quality Council of Ontario.