October 22, 2017

Results from the Canadian survey of online learning now available

Bates, T. (ed.) (2017) Tracking Online and Distance Education in Canadian Universities and Colleges: 2017 Vancouver BC: The National Survey of Online and Distance Education in Canadian Post-Secondary Education.

The anglophone version of the public report, as well as the full technical report, is now available for free downloading (Click on the title above or onlinelearningsurveycanada.ca – you will be asked for your e-mail address and a password).

The francophone version of the public report will be available on October 27 from https://formationenlignecanada.ca

Key findings of the report are:

  • Canada is a ‘mature’ online learning market: almost all Canadian colleges and universities now offer online courses and many have been doing so for 15 years or more;
  • there is at least one institution in every province that offers online courses or programs;
  • online enrolments have expanded at a rate of 10%-15% per annum over the last five years;
  • online learning now constitutes between 12%-16% of all post-secondary teaching for credit;
  • online learning courses can be found in almost all subject areas;
  • online learning is providing students with increased access and greater flexibility;
  • two-thirds of Canadian post-secondary institutions see online learning as very or extremely important for their future plans

  • most institutions have or are developing a strategy or plan for online learning
  • LMSs are used in almost every institution, but no particular brand dominates the Canadian market
  • a wide range technologies are being used with or alongside the LMS,the most predominant (over half the institutions) being online conferencing/webinar technologies, video-streaming and print;
  • OER are used in just under half of all institutions but moderately and open textbooks in less than 20%
  • there was no or little use reported of learning analytics, AI applications or competency-based learning, although tracking such use is difficult, as they are instructor- rather than institution-driven
  • hybrid learning (defined as a reduction in classroom time replaced by online learning activities) is widespread in terms of institutions, but low in use in most institutions (less than 10% of classes), although again this is not easily tracked; however, it was reported to lead to innovative teaching;
  • MOOCs were delivered in less than 20% of institutions in the 12 months prior to the survey, and one third reported they did not intend to offer MOOCs in the future
  • the main benefits of online learning were seen as:
    • increased access/flexibility
    • increased enrolments
    • more innovative teaching;
  • the main barriers were seen as:
    • lack of resources (particularly learning technology support staff)
    • faculty resistance
    • lack of government support (reported most in Québec and least in Ontario);
  • there were difficulties in obtaining reliable online course enrolment data: most institutions are not systematically tracking this and there are variations between provinces;
  • the report ends by recommending a standard system for reporting on digital learning.

Implications

The report deliberately does not draw out any implications or make any value judgements. Readers should draw their own conclusions. However here are my personal thoughts on the results, and these do not necessarily reflect those of the rest of the team:

  • smaller institutions (below 2,000 students) found lack of resources particularly difficult and were less likely to offer online courses: what could be done to provide better support for such institutions that want to offer more online teaching?
  • government support to institutions for online learning varied widely from province to province, and this showed in the figures for enrolment and for innovative teaching: some provinces may need to reconsider their policies and support for online learning or they will fall further behind other provinces in online provision for students
  • many institutions are in the process of developing strategies or plans for online learning: what worked and what did not work in those institutions that already have plans in place that could help inform those institutions now still developing plans in this area?

Next steps

This report would not have been possible without the support of many different organizations which are listed in the report itself. In particular, though, we are indebted to the staff in all the institutions who responded to the survey.

This is the first national snapshot of online and distance learning for both colleges and universities in Canada but its value will be much enhanced by a more longitudinal set of studies. The research team is working with potential sponsors to establish a stronger organizational structure, more secure long-term funding, and a more representative steering committee for the survey. I will be reporting back as these developments evolve.

In the meantime, thanks to everyone who helped make this report a reality.

Responses to the Canadian survey of online and distance learning

Hi, everyone, and welcome back. I hope you all had a great summer. As many readers will know, I am leading a team conducting a survey of online and distance learning in Canadian public post-secondary educational institutions. You can get more general information about the survey from earlier posts:

During the summer the survey team has been extremely busy. We have now completed the collection of data and have started on the analysis and report writing.

Thanks to support from Contact North, we are building a web site for the survey which will contain news about the survey, access to the reports, and opportunities to discuss the results and their implications. However this won’t be ready for a couple of weeks, so I wanted to provide an update on where we are at the moment, especially as I know some of you have been engaged in collecting data for the survey (many thanks!). 

Building a database of institutions

As this is the first year for the survey the focus is exclusively on provincially funded and accredited post-secondary educational institutions, which still represent by far the majority of post-secondary institutions and students in Canada.

One challenge the survey faced was the lack of a commonly used, publicly accessible database of all Canadian public post-secondary educational institutions. We worked our way through the membership listings of Universities Canada, Colleges and Institutes Canada (CICAN), Maclean’s EduHub, and provincial government web sites. From Statistics Canada we could find only aggregate data on student enrolments broken down by province and by part-time or full time students, but not data for individual institutions. 

We ended up with a list of 203 institutions, once we had eliminated duplications, incorporated affiliated colleges and universities with the main institution awarding the qualification, and removed institutions not funded by provincial governments. We also identified institutions by language (anglophone or francophone) and their total student headcount (full-time and part-time), almost entirely from information publicly available through provincial government web sites, although not all provinces provide this information. We then had to identify the appropriate contact person in each institution (usually Provosts or VPs Education).

This process resulted in 

  • 72 universities (35%),
  • 81 colleges outside Québec (40%), and
  • 50 CEGEPs/colleges within Québec (25%).

Of the 203 institutions, 70 (34%) were either francophone institutions or were bi-lingual institutions with a separate francophone program. 

One thing that became clear even at this stage is that there is no consistency between provinces and Statistics Canada on how data about students is collected or reported. Several different measures are used: student headcount (full time, or full time and part-time); student course enrolments; student FTEs (full-time equivalents); and student program enrolments, with variations within each of these broad categories. Also some data include non-credit, continuing education students as well as students taking courses for credit. All this variation in student statistics makes inter-provincial comparisons very difficult. In the end, for the database of all institutions, we used primarily official provincial student headcounts, the measure most common across all provinces.

Statistics Canada’s most recent figures for Canadian post-secondary student enrolments are for the fall of the 2014/2015 academic year (in our survey, we are looking at fall 2016 enrolments). Statistics Canada’s enrolment numbers are based on program counts and not student counts. If a student is enrolled in more than one program as of the snapshot date, then all of their programs are included in the count.

Table 1: Comparison of StatCan student enrolment numbers, and student headcount totals from institutions in the survey population base

Without knowing more about the basis on which Statistics Canada built its data, we cannot explain the difference between the two populations sets, but the differences are relatively small, except for CEGEPs. We are confident we have included all the CEGEP institutions but we probably do not have all enrolled students counted, just those for which the Québec provincial government provides funding, from which we derived the data. Nevertheless, if we take Statistics Canada data as the comparator, our population base appears to represent a very large proportion (93%) of students studying for institutional credit at Canadian public post-secondary institutions.

We will be providing on the survey web site a list of all the institutions we included in the population database.

Response rates

The questionnaire itself was online and was accessed using a link unique for each participant institution. The final cut-off date for the full questionnaire was June 30, 2017. At this point, for those institutions that had not responded, an invitation was sent to complete a shorter questionnaire that excluded questions on student enrolments.

Table 2: Response rate by type of institution

It can be seen that 128 institutions (63%) completed the full questionnaire, and 140 (69%) completed either the full or the shorter version of the questionnaire. The response rate was lower for small institutions (59% overall for institutions with less than 2,000  students, compared with 79% for institutions with more than 10,000 students). The responding institutions were spread proportionately across all provinces and nearly all territories.

If we look at the response rate by the number of student enrolments, Table 3 below indicates that the survey covered institutions with 78% of the overall Canadian student population in public post-secondary education.

Table 3: Student headcounts for institutions responding compared to overall student headcounts.

Conclusion

It should be remembered that this was a voluntary survey with no formal government requirement to complete. Our target was a 75% response rate, which we have achieved in terms of the number of students covered by the survey, although the number of institutions covered fell a little short of the target at 69%. Nevertheless we think we have a large enough response rate to make valid and reliable statements about the state of online and distance learning in Canadian post-secondary education.

This would not have been possible without first of all a huge effort by the institutions to provide the data, and secondly a great deal of support from the various professional associations such as CICAN, Universities Canada, the eCampuses in Ontario, Manitoba, Alberta and British Columbia, Contact North, REFAD, and others too numerous to describe in a short blog post.

Next steps

We are now in the process of analyzing the results. We expect to have a draft report that will go out to selected readers in two weeks time. We will then produce two ‘public’ reports:

  • a main executive report that covers the main findings (in English and French)
  • a full research report that provides an analysis of all the data collected from the survey.

Both these reports will be ready for publication and a launch at the ICDE World Conference on Online Learning in Toronto on October 17, 2017. 

We will also be developing a number of sub-reports, such as one on francophone institutions, and one on Ontario (which was a primary funder of the survey).

In the meantime, as soon as the survey web site is ready I will let you know. This will contain preliminary results and an update on activities surrounding the survey, such as future plans and developments, and, from October 17, copies of all the reports as they become available.

Update on Canadian survey of online learning

This update builds on two earlier posts:

The online questionnaire has now been distributed by e-mail to every public university and college in Canada, a total of 215 institutions in all. The questionnaire will have been routed through the office of the Provost or VP Education, although it is probable that several people will be involved in each institution in collecting data for the questionnaire. 

There are in fact five versions of the questionnaire:

  • anglophone universities
  • francophone universities
  • anglophone colleges
  • francophone colleges (outside Québec)
  • CEGEPs 

The questionnaire asks for data on

  • distance education enrolments, irrespective of method of delivery
  • online student enrolments (headcount and student course registrations) at different academic levels and in different program areas
  • how many years the institution has been offering online courses
  • the current status of blended and hybrid courses
  • the main technologies being used
  • information about any MOOCs offered
  • future institutional directions in online learning
  • benefits and challenges of online learning.

The deadline for completion has been set at June 12. 

We anticipate the main report will be ready in September, with sub-reports for the following sectors:

  • all universities (anglophone and francophone)
  • all colleges, institutes and CEGEPs
  • all francophone institutions (report in French)

We will also produce other sub-reports on request (for example, a provincial analysis) as well as infographics.

The reports will be available for free on request and the data will be housed at the Ontario College Application Service, and, subject to privacy requirements, will be open to other researchers.

There will be a full presentation of the report and its results at the ICDE Conference on Online Learning in Toronto in October.

We are reliant on e-mails and contact information being up-to-date and sometimes e-mails with attachments get filtered out as spam. So, if you are working in a Canadian public post-secondary institution and are not aware that this data is being collected for this survey, please contact your Provost’s Office to check that the invitation has been received. We need a high response rate from every institution to ensure that the results are valid.

However, to date we are pleased with the immediate response – we already have over 20 full responses within the first week.

What is online learning? Seeking definition

Using Kubi robots and iPads for telepresence at Michigan State University: the new online learning?

The survey

One reason I have not been blogging much this year is because I have been heavily engaged in leading a national survey of online learning and distance education in Canadian public post-secondary education. We have now secured sufficient funding to at least complete the survey, thanks to further grants of $80,000 from eCampus Ontario’s Research and Innovation fund, and $20,000 from Pearson Canada.

The questionnaire for the survey has been piloted in 14 institutions and is in the process of being distributed to all the institutions this week. The questionnaire is going to 78 universities, 88 colleges and 46 Cégeps (Collèges d’Enseignment Général Et Professionnelle), a total of 212 institutions in total, all Canadian.

The questionnaire is being routed primarily through the office of the Provost or VP Education in most cases. There are francophone as well as anglophone versions of the questionnaire, depending on the main language used by each institution. Institutions have up to three weeks to complete it. We are asking all institutions to complete the questionnaire whether or not they are currently offering online or distance courses or programs as we are also asking about future directions. The results will be available in early September. 

What are we talking about?

One of our greatest challenges has been ensuring that every institution uses the same understanding of what a distance education course or program means, what constitutes a fully online course, and especially what terms such as blended or hybrid learning mean.

It was clear from feedback from the piloting of the questionnaire in 14 colleges and universities that there is no general agreement about these terms, so we have had to make somewhat arbitrary definitions to guide the institutions. I thought it might be interesting to share these with you and get your reactions, although it is now too late to change the definitions for the survey this year.

Distance education courses. Distance education courses are those where no classes are held on campus – all instruction is conducted at a distance. Distance education courses may use a variety of delivery methods, such as print-based, video/audioconferencing, as well as internet-based.

Online courses. A form of distance education where the primary delivery mechanism is via the internet. These could be delivered synchronously or asynchronously. All instruction is conducted at a distance.

Synchronous online courses. Courses where students need to participate at the same time as an instructor, but at a separate location other than an institutional campus. These courses may be delivered by video conferencing, web conferencing, audio conferencing, etc.

Asynchronous courses. Courses where students are not required to participate in any sessions at the same time as the instructor. These may be print-based courses, or online courses using a learning management system, for instance.

For the purposes of this survey, we wish to exclude inter-campus delivery where students are required to attend a different campus from the instructor. However, we wish to include delivery via the internet or other distance technologies to small learning centres in remote areas.

Online programs. A for-credit program that can be completed entirely by taking online courses, without the need for any on-campus classes. These could be delivered synchronously or asynchronously.

Blended/hybrid courses. These are courses designed to combine both online and face-to-face teaching in any combination. For the purposes of this questionnaire, we are interested in those courses where some, but not all, of the face-to-face teaching has been replaced by online study.

Credit courses. These are courses that lead to institutional credits (degrees, diplomas, etc.). We wish to include information on all credit online courses, whether they are managed by a central service or by individual departments or by Continuing Studies. [For the purpose of this survey, the focus is primarily on online and distance courses and programs for credit]. 

Online contract training. These are online training programs that may or may not be for credit recognition but are designed to meet a particular industry or training need. 

MOOCs. These are massive, open, online courses. The key features are:

  • No fee (except possibly for an end of course certificate),
  • The courses are open to anyone: there is no requirement for prior academic qualifications in order to take the course,
  • The courses are not for credit.

Note that we are distinguishing between distance education and online learning. We are treating online learning as just one form of distance education. We will be particularly interested to see if there are still significant amounts of non-online distance education still in use.

The problem with definitions

Although from about the late 1990s until quite recently, most online learning was asynchronous, and based primarily on the use of text-based learning management systems, that context appears to be rapidly shifting, with more synchronous approaches either replacing or being combined with asynchronous learning (another definition of ‘blended’), and the increasing use of streamed audio and video. What is already clear from the piloting is that we are trying to describe a very dynamic and fast changing phenomenon, and the terminology often struggles to keep up with the reality of what is happening.

We hope that the questionnaire will be able to capture, at least for a moment in time, the extent to which the field of online learning and distance education is fragmenting into many different approaches and delivery methods. In such a volatile context, ‘best practices’ based on a context that is no longer dominant will become more challenged and some interesting questions about the quality and effectiveness of these new approaches are bound to be raised.

But that is jumping ahead. I must learn to be patient and wait for the results to come in. In the meantime, your comments about the definitions we are using or about the value of such a survey will be most welcome.

Tracking innovations in online learning in Canada

Rue St Jean, Québec City. Temperatures ranged from -17 C to -23 C -without wind chill added

I’ve not been blogging much recently because, frankly, I’ve been too busy, and not on the golf course or ski slopes, either. (Yeah, so what happened to my retirement? Failed again).

Assessing the state of online learning in Canada

I am working on two projects at the moment:

These two projects in fact complement one another nicely, with the first aiming to provide a broad and accurate picture of the extent of online learning in Canada, and the other focusing on the more qualitative aspects of innovation in online learning, and all in time for not only for the 150th anniversary of Confederation in Canada (which was really the creation of a new, independent state in North America) but also ICDE’s World Congress on Online Learning in Toronto in October, whose theme is, guess what, Teaching in a Digital Age (now there’s a co-incidence).

Of course, I’m not doing this on my own. In both projects I am working with a great group of people.

Methodology

My mandate for Contact North is to identify 8-12 cases of innovation in online learning from all of Canada other than Ontario. I started of course in British Columbia, early in January, and last week I visited six post-secondary institutions in four cities in Québec.

To find the cases, I have gone to faculty development workshops where instructors showcase their innovations, or I have contacted instructional designers I know in different institutions to recommend cases. The institutions are chosen to reflect provinces, and universities and colleges within each province.

Each visit involves an interview with the instructor responsible for the innovation, and where possible a demonstration or examples of the innovation. (One great thing about online learning is that it leaves a clear footprint that can be captured).

I then write up a short report, using a set of headings provided by Contact North, and then return that to the instructor to ensure that it is accurate. I then submit the case report to Contact North.

I am not sure whether Contact North will publish all the cases I report on its web site, as I will certainly cover much more than 8-12 cases in the course of this project. However, it is hoped that at least some of the instructors featured will showcase their innovations at the World Congress of Online Learning.

Progress to date

I have conducted interviews (but not finished the reports yet) for the following:

British Columbia

  • the use of an online dialectical map to develop argumentation skills in undergraduate science students (Simon Fraser University – SFU)
  • peer evaluation as a learning and assessment strategy for building teamwork skills in business school programs (SFU)
  • the development of a mobile app for teaching the analysis of soil samples (University of British Columbia)
  • PRAXIS: software to enable real-time, team-based decision-making skills through simulations of real-world emergency situations (Justice Institute of British Columbia)

Québec

  • comodal synchronous teaching, enabling students to choose between attending a live lecture or participating at the same time from home/at a distance (Laval University)
  • synchronous online teaching of the use of learning technologies in a teacher education program (Université du Québec à Trois-Rivières – UQTR)
  • achieving high completion rates in a MOOC on the importance of children’s play (UQTR)
  • a blended course on effective face-to-face teaching for in-service teachers (TÉLUQ)
  • use of iBook Author software for content management for cardiology students and faculty in a teaching hospital (Centre Hospitalier Universitaire de Sherbrooke – Sherbrooke University Hospital: CHUS)
  • a decision-making tool to develop active and coherent learning scenarios that leverage the use of learning technologies (Université de Montréal).
  • Mathema-TIC: francophone open educational resources for teaching mathematics in universities and colleges (Université de Montréal).

These visits would not have been possible without the assistance of France Lafleur, an online instructor from UQTR who not only arranged many of the meetings but also did all the driving. Anyone from outside Québec who has tried to drive across the province in winter, and especially tried to navigate and drive to several parts of Montréal the same day, will understand why this help was invaluable.

Response and reaction

Faculty and instructors often receive a lot of criticism for being resistant to change in their teaching. This project however starts from an opposite position. What are faculty and instructors actually doing in terms of innovation in their teaching? What can we learn from this regarding change and the development of new teaching approaches? What works and what doesn’t?

It is dangerous at this stage to start drawing conclusions. This is not a representative selection of even innovative projects, and the project – in terms of my participation – has just started. The definition of innovation is also imprecise. It’s like trying to describe an elephant to someone who’s never seen one: you might find it difficult to imagine, but you’ll know it when you see it.

However, even with such a small sample, some things are obvious:

  • innovation in online teaching is alive and well in Canadian post-secondary education: there is a lot going on. It was not difficult to identify these 11 cases; I could have easily found many more if I had the time;
  • the one common feature across all the instructors I have interviewed is their enthusiasm and passion for their projects. They are all genuinely excited by what they were doing. Their teaching has been galvanised by their involvement in the innovation; 
  • in some of the cases, there are measured improvements in student learning outcomes, or, more importantly, new ’21st century skills’ such as teamwork, evidence-based argumentation, and knowledge management are being developed as a result of the innovation;
  • although again these are early days for me, there seems to be a widening gap between what is actually happening on the ground and what we read or hear about in the literature and at conferences on innovation in online learning. The innovation I am seeing is often built around simple but effective changes, such as a web-based map, or a slight change of teaching approach, such as opening up a lecture class to students who don’t want to – or can’t – come in to the campus on a particular day. However, these innovations are radically changing the dynamics of classroom teaching;
  • blended learning is breaking out all over the place. Most of these cases involve a mix of classroom and online learning, but there is no standard model – such as flipped classrooms – emerging. They all vary quite considerably from each other; 
  • the innovations are still somewhat isolated although a couple have gone beyond the original instructor and have been adopted by colleagues; however there is usually no institutional strategy or process for evaluating innovations and making sure that they are taken up across a wider range of teaching, although instructional designers working together provide one means for doing this. Evaluation of the innovation though is usually just left to the innovator, with all the risks that this entails in terms of objectivity.

Next steps

I still have at least one more case from another institution in British Columbia to follow up, and I now have a backlog of reports to do. I hope to have these all finished by the end of this month.

I have two more trips to organise. The first will be to the prairie provinces:

  • Alberta, Saskatchewan and Manitoba, which I hope to do in mid-March.

The next will be to the Maritimes,

  • Nova Scotia, New Brunswick, PEI, and Newfoundland, which I will do probably in April or May.

No further cases or institutions have been identified at this moment, and I am definitely open to suggestions in these provinces if you have any. The criterion for choice is as follows:

  • The focus is first and foremost on practice, on actual teaching and learning applications – not policy, funding, planning issues, descriptions of broad services, or broader concerns.
  • The interest is in applications of pedagogy using technology for classroom, blended, and online learning with the emphasis on student learning, engagement, assessment, access, etc. The pedagogy is as important as the technology in terms of innovation.
  • The emphasis is on innovative practices that can be replicated or used by other instructors.
  • We are particularly looking for cases where some form of evaluation of the innovation has been conducted or where there is clear evidence of success.

If you can recommend a case that you think fits well these parameters, please drop me a line at tony.bates@ubc.ca.

In the meantime, look out for the case studies being posted to Contact North’s Pocket of Innovation web site over the next few months. There are also more cases from Ontario being done at the same time.