September 20, 2017

Responses to the Canadian survey of online and distance learning

Hi, everyone, and welcome back. I hope you all had a great summer. As many readers will know, I am leading a team conducting a survey of online and distance learning in Canadian public post-secondary educational institutions. You can get more general information about the survey from earlier posts:

During the summer the survey team has been extremely busy. We have now completed the collection of data and have started on the analysis and report writing.

Thanks to support from Contact North, we are building a web site for the survey which will contain news about the survey, access to the reports, and opportunities to discuss the results and their implications. However this won’t be ready for a couple of weeks, so I wanted to provide an update on where we are at the moment, especially as I know some of you have been engaged in collecting data for the survey (many thanks!). 

Building a database of institutions

As this is the first year for the survey the focus is exclusively on provincially funded and accredited post-secondary educational institutions, which still represent by far the majority of post-secondary institutions and students in Canada.

One challenge the survey faced was the lack of a commonly used, publicly accessible database of all Canadian public post-secondary educational institutions. We worked our way through the membership listings of Universities Canada, Colleges and Institutes Canada (CICAN), Maclean’s EduHub, and provincial government web sites. From Statistics Canada we could find only aggregate data on student enrolments broken down by province and by part-time or full time students, but not data for individual institutions. 

We ended up with a list of 203 institutions, once we had eliminated duplications, incorporated affiliated colleges and universities with the main institution awarding the qualification, and removed institutions not funded by provincial governments. We also identified institutions by language (anglophone or francophone) and their total student headcount (full-time and part-time), almost entirely from information publicly available through provincial government web sites, although not all provinces provide this information. We then had to identify the appropriate contact person in each institution (usually Provosts or VPs Education).

This process resulted in 

  • 72 universities (35%),
  • 81 colleges outside Québec (40%), and
  • 50 CEGEPs/colleges within Québec (25%).

Of the 203 institutions, 70 (34%) were either francophone institutions or were bi-lingual institutions with a separate francophone program. 

One thing that became clear even at this stage is that there is no consistency between provinces and Statistics Canada on how data about students is collected or reported. Several different measures are used: student headcount (full time, or full time and part-time); student course enrolments; student FTEs (full-time equivalents); and student program enrolments, with variations within each of these broad categories. Also some data include non-credit, continuing education students as well as students taking courses for credit. All this variation in student statistics makes inter-provincial comparisons very difficult. In the end, for the database of all institutions, we used primarily official provincial student headcounts, the measure most common across all provinces.

Statistics Canada’s most recent figures for Canadian post-secondary student enrolments are for the fall of the 2014/2015 academic year (in our survey, we are looking at fall 2016 enrolments). Statistics Canada’s enrolment numbers are based on program counts and not student counts. If a student is enrolled in more than one program as of the snapshot date, then all of their programs are included in the count.

Table 1: Comparison of StatCan student enrolment numbers, and student headcount totals from institutions in the survey population base

Without knowing more about the basis on which Statistics Canada built its data, we cannot explain the difference between the two populations sets, but the differences are relatively small, except for CEGEPs. We are confident we have included all the CEGEP institutions but we probably do not have all enrolled students counted, just those for which the Québec provincial government provides funding, from which we derived the data. Nevertheless, if we take Statistics Canada data as the comparator, our population base appears to represent a very large proportion (93%) of students studying for institutional credit at Canadian public post-secondary institutions.

We will be providing on the survey web site a list of all the institutions we included in the population database.

Response rates

The questionnaire itself was online and was accessed using a link unique for each participant institution. The final cut-off date for the full questionnaire was June 30, 2017. At this point, for those institutions that had not responded, an invitation was sent to complete a shorter questionnaire that excluded questions on student enrolments.

Table 2: Response rate by type of institution

It can be seen that 128 institutions (63%) completed the full questionnaire, and 140 (69%) completed either the full or the shorter version of the questionnaire. The response rate was lower for small institutions (59% overall for institutions with less than 2,000  students, compared with 79% for institutions with more than 10,000 students). The responding institutions were spread proportionately across all provinces and nearly all territories.

If we look at the response rate by the number of student enrolments, Table 3 below indicates that the survey covered institutions with 78% of the overall Canadian student population in public post-secondary education.

Table 3: Student headcounts for institutions responding compared to overall student headcounts.

Conclusion

It should be remembered that this was a voluntary survey with no formal government requirement to complete. Our target was a 75% response rate, which we have achieved in terms of the number of students covered by the survey, although the number of institutions covered fell a little short of the target at 69%. Nevertheless we think we have a large enough response rate to make valid and reliable statements about the state of online and distance learning in Canadian post-secondary education.

This would not have been possible without first of all a huge effort by the institutions to provide the data, and secondly a great deal of support from the various professional associations such as CICAN, Universities Canada, the eCampuses in Ontario, Manitoba, Alberta and British Columbia, Contact North, REFAD, and others too numerous to describe in a short blog post.

Next steps

We are now in the process of analyzing the results. We expect to have a draft report that will go out to selected readers in two weeks time. We will then produce two ‘public’ reports:

  • a main executive report that covers the main findings (in English and French)
  • a full research report that provides an analysis of all the data collected from the survey.

Both these reports will be ready for publication and a launch at the ICDE World Conference on Online Learning in Toronto on October 17, 2017. 

We will also be developing a number of sub-reports, such as one on francophone institutions, and one on Ontario (which was a primary funder of the survey).

In the meantime, as soon as the survey web site is ready I will let you know. This will contain preliminary results and an update on activities surrounding the survey, such as future plans and developments, and, from October 17, copies of all the reports as they become available.

Virtual Reality and education: some thoughts

I spent a very interesting evening this week at a Vancouver VR Community event at Mobify‘s headquarters in downtown Vancouver. Mobify is a provider of progressive web apps for e-commerce and has a really cool area for events such as this one, with lots of open spaces.

Vancouver is part of a growing North West Pacific Silicon Valley, and there are now over 500 members of the Vancouver VR community, which indicates how much activity and development are going into VR, at least in this region. 

The event was a mix of show and tell, and an opportunity to play with and experience some VR programs. Most of the applications available to play with at the VR event were typically combat games (including a very realistic one-on-one boxing encounter) but I was more interested in possible educational applications (although the boxing app might come in useful on a dark night on campus).

I particularly enjoyed using Google Blocks, a free software program for developing 3D models, that was being demonstrated by  Scott Banducci who runs a company that hosts VR events (VRtogo). With the headset on and a couple of hand-operated panels that include a colouring palette and tools for moving and stretching objects, it was easy even for a novice such as me to create in a few minutes a really cool 3D model of a plane. There is an excellent introductory video on the Google Blocks web site that explains the process. 

This was my first visit and I hardly knew anyone there (I was the oldest person by at least 40 years). I was hoping to meet someone from one of the many educational institutions in the Vancouver area who might be interested in using VR for teaching and learning but most of the people there not surprisingly were developers or producers of VR. Nevertheless this seems like a great community of practice and I strongly recommend anyone in the Vancouver area interested in the educational use of VR to join. The next event is at Mobify at 6.15 pm on August 22.

In the meantime, here are some of my thoughts about the use of VR, for what they are worth.

  1. VR is not just a fad that will disappear. There are already a large number of commercial applications, mainly in entertainment and public relations, but also increasingly for specific areas of training (more on that below). There is already a lot of excellent, off-the-shelf software for creating VR environments, and the cost of hardware is dropping rapidly (although good quality headsets and other equipment are still probably too expensive for required use by large numbers of students).
  2. What killed earlier two-dimensional VR developments such as Second Life for widespread educational use was the high cost and difficulty of creating the sets and contexts for learning. Thus even if the hardware and software costs for VR are low enough for individual student use, it is the production costs of creating educational contexts and scenarios that are likely to inhibit its use.
  3. Thus most suitable educational applications are likely to be where the cost of alternative or traditional ways of learning are too expensive or too dangerous. In particular, VR would be good for individual, self-learning in contexts where real environments are not easily accessible, or where learners need to cope with strong emotions when making decisions or operating under pressure in real time. Examples might be emergency management, such as shutting down an out-of-control nuclear reactor, or defusing a bomb, or managing a fire on an oil tanker. However, not only will the VR environment have to be realistic, as much attention will need to be paid to creating the specific learning context. The procedure for defusing the bomb and the interaction between learner and the virtual bomb must also be built in to the production. Thus VR may often need to be combined with simulation design and quality media production to be educationally effective, again pushing up the cost. For these reasons, medicine is a likely area for experiment, where traditional training costs are really high or where training is difficult to provide with real patients.
  4. Having said that, we need more experimentation. This is still a relatively new technology, and there may be very simple ways to use it in education that are not costly and meet needs that cannot be easily met in traditional teaching or with other existing technology. For this to happen, though, educators, software developers, and media producers need to come together to play and experiment. The VR Vancouver Community seems to me to be an ideal venue to do this. In the meantime, I can’t wait to see Bad Cookies Pictures VR horror movie when it comes out! Now that will be an immersive experience.

And since originally posting this, I have been directed to the blog post of Ryan Martin, a trainer on Vancouver Island, who has come up with a more comprehensive list of ways to learn through VR, with some excellent links.

If you know of other examples and are willing to share them, I will add the links to this post.

 

Update on Canadian survey of online learning

This update builds on two earlier posts:

The online questionnaire has now been distributed by e-mail to every public university and college in Canada, a total of 215 institutions in all. The questionnaire will have been routed through the office of the Provost or VP Education, although it is probable that several people will be involved in each institution in collecting data for the questionnaire. 

There are in fact five versions of the questionnaire:

  • anglophone universities
  • francophone universities
  • anglophone colleges
  • francophone colleges (outside Québec)
  • CEGEPs 

The questionnaire asks for data on

  • distance education enrolments, irrespective of method of delivery
  • online student enrolments (headcount and student course registrations) at different academic levels and in different program areas
  • how many years the institution has been offering online courses
  • the current status of blended and hybrid courses
  • the main technologies being used
  • information about any MOOCs offered
  • future institutional directions in online learning
  • benefits and challenges of online learning.

The deadline for completion has been set at June 12. 

We anticipate the main report will be ready in September, with sub-reports for the following sectors:

  • all universities (anglophone and francophone)
  • all colleges, institutes and CEGEPs
  • all francophone institutions (report in French)

We will also produce other sub-reports on request (for example, a provincial analysis) as well as infographics.

The reports will be available for free on request and the data will be housed at the Ontario College Application Service, and, subject to privacy requirements, will be open to other researchers.

There will be a full presentation of the report and its results at the ICDE Conference on Online Learning in Toronto in October.

We are reliant on e-mails and contact information being up-to-date and sometimes e-mails with attachments get filtered out as spam. So, if you are working in a Canadian public post-secondary institution and are not aware that this data is being collected for this survey, please contact your Provost’s Office to check that the invitation has been received. We need a high response rate from every institution to ensure that the results are valid.

However, to date we are pleased with the immediate response – we already have over 20 full responses within the first week.

What is online learning? Seeking definition

Using Kubi robots and iPads for telepresence at Michigan State University: the new online learning?

The survey

One reason I have not been blogging much this year is because I have been heavily engaged in leading a national survey of online learning and distance education in Canadian public post-secondary education. We have now secured sufficient funding to at least complete the survey, thanks to further grants of $80,000 from eCampus Ontario’s Research and Innovation fund, and $20,000 from Pearson Canada.

The questionnaire for the survey has been piloted in 14 institutions and is in the process of being distributed to all the institutions this week. The questionnaire is going to 78 universities, 88 colleges and 46 Cégeps (Collèges d’Enseignment Général Et Professionnelle), a total of 212 institutions in total, all Canadian.

The questionnaire is being routed primarily through the office of the Provost or VP Education in most cases. There are francophone as well as anglophone versions of the questionnaire, depending on the main language used by each institution. Institutions have up to three weeks to complete it. We are asking all institutions to complete the questionnaire whether or not they are currently offering online or distance courses or programs as we are also asking about future directions. The results will be available in early September. 

What are we talking about?

One of our greatest challenges has been ensuring that every institution uses the same understanding of what a distance education course or program means, what constitutes a fully online course, and especially what terms such as blended or hybrid learning mean.

It was clear from feedback from the piloting of the questionnaire in 14 colleges and universities that there is no general agreement about these terms, so we have had to make somewhat arbitrary definitions to guide the institutions. I thought it might be interesting to share these with you and get your reactions, although it is now too late to change the definitions for the survey this year.

Distance education courses. Distance education courses are those where no classes are held on campus – all instruction is conducted at a distance. Distance education courses may use a variety of delivery methods, such as print-based, video/audioconferencing, as well as internet-based.

Online courses. A form of distance education where the primary delivery mechanism is via the internet. These could be delivered synchronously or asynchronously. All instruction is conducted at a distance.

Synchronous online courses. Courses where students need to participate at the same time as an instructor, but at a separate location other than an institutional campus. These courses may be delivered by video conferencing, web conferencing, audio conferencing, etc.

Asynchronous courses. Courses where students are not required to participate in any sessions at the same time as the instructor. These may be print-based courses, or online courses using a learning management system, for instance.

For the purposes of this survey, we wish to exclude inter-campus delivery where students are required to attend a different campus from the instructor. However, we wish to include delivery via the internet or other distance technologies to small learning centres in remote areas.

Online programs. A for-credit program that can be completed entirely by taking online courses, without the need for any on-campus classes. These could be delivered synchronously or asynchronously.

Blended/hybrid courses. These are courses designed to combine both online and face-to-face teaching in any combination. For the purposes of this questionnaire, we are interested in those courses where some, but not all, of the face-to-face teaching has been replaced by online study.

Credit courses. These are courses that lead to institutional credits (degrees, diplomas, etc.). We wish to include information on all credit online courses, whether they are managed by a central service or by individual departments or by Continuing Studies. [For the purpose of this survey, the focus is primarily on online and distance courses and programs for credit]. 

Online contract training. These are online training programs that may or may not be for credit recognition but are designed to meet a particular industry or training need. 

MOOCs. These are massive, open, online courses. The key features are:

  • No fee (except possibly for an end of course certificate),
  • The courses are open to anyone: there is no requirement for prior academic qualifications in order to take the course,
  • The courses are not for credit.

Note that we are distinguishing between distance education and online learning. We are treating online learning as just one form of distance education. We will be particularly interested to see if there are still significant amounts of non-online distance education still in use.

The problem with definitions

Although from about the late 1990s until quite recently, most online learning was asynchronous, and based primarily on the use of text-based learning management systems, that context appears to be rapidly shifting, with more synchronous approaches either replacing or being combined with asynchronous learning (another definition of ‘blended’), and the increasing use of streamed audio and video. What is already clear from the piloting is that we are trying to describe a very dynamic and fast changing phenomenon, and the terminology often struggles to keep up with the reality of what is happening.

We hope that the questionnaire will be able to capture, at least for a moment in time, the extent to which the field of online learning and distance education is fragmenting into many different approaches and delivery methods. In such a volatile context, ‘best practices’ based on a context that is no longer dominant will become more challenged and some interesting questions about the quality and effectiveness of these new approaches are bound to be raised.

But that is jumping ahead. I must learn to be patient and wait for the results to come in. In the meantime, your comments about the definitions we are using or about the value of such a survey will be most welcome.

One reason we are not getting enough engineers in Canada: the professional associations

The CN Tower in Toronto: construction supervised by an engineer originally from Iran

From nearly 2,500 posts over nine years, none has generated so many comments as Can you teach ‘real’ engineering at a distance? 

What you will see from the comments from readers is a deep and widespread frustration at the lack of recognition by Canadian professional engineering associations of any courses or programs taken by distance. This is now getting to the point where it is becoming a national scandal. Rather than your having to read through the 120 comments or so on this post, I will summarise them for you.

Accreditation as a professional engineer in Canada

I am not an engineer by background, so please correct me if I am wrong about the process. But this seems to me to be how it works.

In order to obtain work as a professional engineer in Canada, most employers require you to be accredited through the Canadian Engineering Accreditation Board (CEAB). However, this means applying to one of the provincial accreditation agencies such as the Professional Engineers of Ontario (PEO) or the Association of Professional Engineers and Geoscientists of Alberta (APEGA), who assess your qualifications and issue membership to their organisation.

These organisations are groups made of of professional engineers and educators (usually Deans of Engineering Schools in universities and Institutes of Technology), so it is a self-regulating process. Usually the minimum qualification for membership is a four year bachelor’s degree in engineering from a Canadian university or its equivalent (i.e. a university in the USA whose engineering program is recognized by the U.S. Accreditation Board for Engineering and Technology (ABET).

The decision about what foreign qualifications will be accepted is entirely at the discretion of the Canadian professional associations. This is not unlike other professions in Canada, such as teaching, medicine or nursing.

The professional association will require an individual to take further qualifications if it deems the existing qualifications do not meet the standards set.

Engineering and online learning in Canada

Until very recently, there were no fully online undergraduate courses, let alone degree programs, offered by Canadian universities in engineering. That is beginning to change. For instance:

  • Queens University, Ontario is now offering a fully online Bachelor of Mining Engineering Technology. This program is particularly directed at those already working in the mining industry. Queen’s University is one of the oldest and most well-established public universities in Canada;
  • McMaster University, Ontario, is developing an online B.Tech (mainly software engineering) in partnership with Mohawk College. Students can take a diploma program from Mohawk then take the third and fourth year courses from McMaster University. Although the campus-based B. Tech. is well-established and successful, the online version is still in development and not yet available at the time of writing. McMaster University is another well-established Canadian public university with an outstanding reputation in engineering, especially in the automative and steel industries;
  • Cape Breton University, Nova Scotia, offers a one year online B.Tech Manufacturing degree. It is available to students with technology diploma programs from colleges across Canada which have an articulation agreement in place with CBU providing for immediate advanced standing in the BET (Manufacturing) program. Students complete the B. Tech program via distance format in as little as one academic year.

These are the only online programs in engineering from accredited Canadian universities that I know about. If you know of others please let me know.

In addition there are more (but not many) accredited universities in the USA that offer fully online engineering degrees, for example:

  • the University of North Dakota (a highly respected state university) has been offering a range of engineering courses (civil, mechanical, petroleum) mainly or fully online for several years. 
  • Embry-Riddle Aeronautical University (Bachelor of Science in Aeronautics)

Will these qualifications be recognised?

Here’s what Queen’s University states about its Bachelor of Mining Engineering Technology:

The BTech program is unaccredited. Graduates seeking professional licensure would need to apply to write the Board Exams in mining engineering. In Ontario, the application would go to the Professional Engineers Ontario (PEO). As with applications from an accredited program, graduates would also need to write the law and ethics exam, and complete the required supervised work experience program in order to be considered for licensure.

Neither the McMaster nor the Cape Breton web sites provides any statement about professional accreditation.

What do the professional associations say about online or distance learning?

The Professional Engineers of Ontario (PEO) stated in 2016 that

  • ‘PEO does not recognize online or distance education.’

Similarly from APEGA:

  • ‘The current Board of Examiners practice is that they do not recognize distance learning programs.’ 

So frankly, don’t bother to take an online program in engineering in Canada if you want to be a professional engineer.

Determining eligibility: obfuscation and confusion

Furthermore the whole process of identifying from the professional associations whether an online program would be accepted is circuitous and unhelpful. One reader of my blog wrote and told me that he had written to APEGA to ask whether the University of North Dakota engineering degree would be recognised as a qualification towards membership of APEGA. Here is the response he received:

 
The eligibility of any courses you’ve completed will be determined by our Academic Examiners. If the courses were completed in Canada, you will need to submit the transcripts for them to be reviewed. If they were from outside of Canada, you will need to obtain an Academic Assessment Report from World Education Services (WES).

In other words, spend several thousand dollars in tuition fees, THEN we will tell you whether we accept your qualifications or not.

Note that the UND program had already been accredited by the ABET in the USA. Alberta’s APEGA was in fact prepared to make an exception for this degree, but this was not acceptable to Ontario’s PEO. Discussions were to continue with the Canadian Engineering Accreditation Board, but I could find no record of such discussions in a search of their recent documentation. So who knows whether or not the UND degree will be accepted by which provincial association?
 
Or let’s say you are a recent immigrant with an engineering degree from another country. In Alberta, the Alberta Council for Admissions and Transfer (ACAT) is the official body that provides information on admission requirements to engineering programs in Alberta universities and colleges. If you go to the ACAT web site to find out whether you degree would be accredited in Alberta, you are referred to another web site, The Canadian Information Centre for International Credentials. They then refer you back to APEGA.

Why it’s a scandal

Without obtaining a P.Eng. from the professional engineering association in a particular province, it is difficult if not impossible to get a job as a professional engineer. Of course such associations are important to ensure that engineering is being done professionally. Nobody wants their bridges to collapse or car parks on shopping malls to crash into shoppers below (Oh, wait – both of those did happen recently in Ontario).

Why we need high standards in engineering qualifications: Elliott Lake shopping mall collapse

But are these organizations making it unnecessarily difficult for people to qualify as professional engineers? From the 120 comments or so to my blog, there is strong evidence that they are. Yet at the same time we have great hand-wringing from employers, especially, about the lack of qualified engineers.

Let’s be clear about this. This engineering gap is not going to be met purely from high school leavers going into engineering programs at conventional universities. The demographics mean that many of those already working at the technical level in engineering will need upgrading and further qualifications, many while still working – hence the brave but unaccredited program from Queen’s University in mining engineering. Presumably employers will take these graduates even if the PEO holds its nose and sniffs at them because the program was done online.

I heard recently on CBC radio there are currently 18,000 engineers in Canada who came from Iran, one of whom was the supervisor for the construction of the CN tower in Toronto. We will need more engineers from immigrants who should be able to upgrade their existing engineering qualifications online while working at a lower level, without having to start from scratch.

I am not arguing that all engineering can be done fully online. Hands-on experience with equipment and laboratory work are essential. However, increasingly we are seeing co-op programs where employers provide that hands-on experience, often with more advanced and newer equipment than the universities have. Furthermore, more and more engineering is itself virtual (automation for driverless cars, for instance). Simulations and animations are increasingly replacing hands-on training. All the theoretical components of an engineering degree can be handled just as well online, and probably better, than in a face-to-face lecture class.

APEGA and PEO, like many professional bodies, are basically a closed shop or guild that restrict entry to create shortages so that members then can charge higher fees. More importantly they are often run, on a voluntary basis, by older engineers who are blissfully ignorant of new developments in engineering education. At a time when we need more highly qualified people we need greater flexibility in accepting credentials from other countries and more openness to online and distance education qualifications.

It’s time the professional associations in engineering realised that this is the 21st century and recognized appropriate online qualifications.