February 11, 2016

The future of learning content – and campus bookstores

Listen with webReader

Bookstore line-up

Ellis, T. (2016) Developing a course content strategy University Business, February

This article has made me realise the still massive difference between what actually happens on campus and the future we are moving to. This article is written primarily for campus book store managers and makes me think that they don’t know what’s going to hit them over the next few years.

The article was based on a survey that came to the following conclusion:

students and faculty prefer printed textbooks but cost and enhanced learning experiences are fuelling interest in the transition to digital and ultimately to adaptive learning courseware and platform-based products… content creators… will continue to proliferate…conditions will favor retail giants and smaller niche players

The article then goes on (not surprisingly) to argue that campus store managers should play a key role in making decisions about course materials and related services.

Why they are in for a shock

We’ve already seen that BCcampus has now developed online, open textbooks for most of the core curriculum for first and second year university and college courses, saving students over $1 million in text book costs. How long before other jurisdictions move in this direction?

Secondly, increasing amounts of research, data and learning materials are now available through open access journals. Increasingly ‘niche’ textbooks for more advanced or higher level courses will also be available online through Amazon, Apple and other ‘retail giants’ – or delivered to the student’s door. Faculty and students will increasingly use online open educational resources as content. And finally, faculty and instructors will increasingly move away from recommending ‘packaged’ content to getting learners to find, analyse, integrate and evaluate the massive amount of content that will be freely available over the Internet, thus facilitating the development of learners fit for a knowledge-based society.

So the day when students have to queue for hours in the book store for the first few days of the semester should become a distant memory, as soon as possible. More seriously, why then would book store managers be involved in decisions about learning content any more?

Sure there will always be a role for a store on campus, and it may have a very small section for niche books, but campus ‘book stores’ will soon be as outdated as typewriters.

MIT aims to expand its research into learning

Listen with webReader
Diffusion tension imaging Satrajit Ghosh, MIT

Diffusion tension imaging Satrajit Ghosh, MIT

Chandler, D. (2016) New initiatives accelerate learning research and its applications MIT News, February 2

The President of MIT has announced a significant expansion of the Institute’s programs in learning research and online and digital education, through the creation of the MIT Integrated Learning Initiative (MITili).

The integrated science of learning — now emerging as a significant field of research — will be the core of MITili (to be pronounced “mightily”), a cross-disciplinary, Institute-wide initiative to foster rigorous quantitative and qualitative research on how people learn.

MITili will combine research in cognitive psychology, neuroscience, economics, engineering, public policy, and other fields to investigate what methods and approaches to education work best for different people and subjects. The effort will also examine how to improve the educational experience within MIT and in the world at large, at all levels of teaching.

The findings that spin out of MITili will then be applied to improve teaching on campus and online.

Comment

First, I very much welcome this initiative by a prestigious research university seriously to research what MIT calls the ‘science of learning’. Research into learning has generally been relatively poorly funded compared with research into science, engineering and computing.

However, I hope that MIT will approach this in the right way and avoid the hubris they displayed when moving into MOOCs, where they ignored all previous research into online learning.

It is critical that those working in MITili do not assume that there is nothing already known about learning. Although exploring the contribution that the physical sciences, such as biological research into the relationship between brain functionality and learning, can make to our understanding of learning is welcome, as much attention needs to be paid to the environmental conditions that support or inhibit learning, to what kind of teaching approaches encourage different kinds of learning, and to the previous, well-grounded research into the psychology of learning.

In other words, not only a multi-disciplinary, but also a multi-epistemological approach will be needed, drawing as much from educational research and the social sciences as from the natural sciences. Is MIT willing and able to do this? After all, learning is a human, not a mechanical activity, when all is said and done.

Why digital technology is not necessarily the answer to your problem

Listen with webReader
The darker the shade, the higher the Internet population

The darker the shade, the higher the Internet population

World Bank (2016) World Development Report 2016: Digital Dividends. Washington, DC: World Bank.

What is the report about?

This 359 page report, partly funded by Canada’s Department of Foreign Affairs, Trade, and Development and the International Development Research Centre, involved the work of several hundred people and was based on consultation meetings in 27 different countries (see here for more information on these consultations).
The report notes that more households in developing countries own a mobile phone than have access to electricity or clean water, and nearly 70 percent of the bottom fifth of the population in developing countries own a mobile phone. The number of internet users has more than tripled in a decade—from 1 billion in 2005 to an estimated 3.2 billion at the end of 2015.

The key question addressed by this report then is as follows:

Have [these] massive investments in information and communication technologies (ICTs) generated faster growth, more jobs, and better services? Indeed, are countries reaping sizeable digital dividends?
I can only briefly summarise this lengthy report, and if this post peaks your interest, please read the full report.

Main conclusions

Despite this vast investment in digital technologies, the digital dividend in terms of greater productivity, less inequality, more democracy, and greater wealth for all has not been gained. For instance:

  • global productivity growth has slowed;
  • labor markets have become more polarized and inequality is rising—particularly in the wealthier countries, but increasingly in developing countries;
  • while the number of democracies is growing, the share of free and fair elections is falling.

Digital divide Africa 2

Furthermore:

  • nearly 60 percent of the world’s people are still offline and can’t participate in the digital economy in any meaningful way;
  • many advanced economies face increasingly polarized labor markets and rising inequality—in part because technology augments higher skills while replacing routine jobs, forcing many workers to compete for low-paying jobs;
  • public sector investments in digital technologies, in the absence of accountable institutions, amplify the voice of elites, which can result in policy capture and greater state control;
  • because the economics of the internet favour natural monopolies, the absence of a competitive business environment can result in more concentrated markets, benefiting incumbent firms;
  • not surprisingly, the better educated, well connected, and more capable have received most of the benefits, circumscribing the gains from the digital revolution.

The fundamentals (‘complements’) of development are:

  • good governance;
  • a robust and open business market;
  • accountability (i.e. lack of corruption);
  • strong human capital (i.e. a well educated work-force)

In countries where these fundamentals are weak, digital technologies have not boosted productivity or reduced inequality. These poor trends persist, not because of digital technologies, but in spite of them. Thus while digital technologies have been spreading, digital dividends have not. On the other hand, countries that complement technology investments with broader fundamental reforms reap digital dividends in the form of faster growth, more jobs, and better services.

Thus the report’s main conclusion is:

The full benefits of the information and communications transformation will not be realized unless countries continue to improve their business climate, invest in people’s education and health, and promote good governance.

Barriers to success

For digital technologies to improve productivity and reduce inequality, there are important ‘analogue’ factors that must accompany or support (‘complement’) the introduction of digital technology in order to get the benefits:
  • digital technologies can make routine, transaction-intensive tasks dramatically cheaper, faster, and more convenient. But most tasks also have an aspect that cannot be automated and that requires human judgment, intuition,and discretion; the better educated the workforce the higher the quality of such human decision-making;
  • when technology is applied to automate tasks without matching improvements in other, non-digital social, economic and political activities, such as governance, accountability and education, technology can fail to bring broad-based gains;
  • the digital revolution can give rise to new business models that would benefit consumers, but not when incumbents control market entry;
  • technology can make workers more productive, but not when they lack the know-how to use it;
  • digital technologies can help monitor teacher attendance and improve learning outcomes, but not when the education system lacks accountability.

What should be done?

  • make the internet universally accessible and affordable. The internet, in a broad sense, has grown quickly, but it is by no means universal. For every person connected to high-speed broadband, five are not. Worldwide, some 4 billion people do not have any internet access, nearly 2 billion do not use a mobile phone, and almost half a billion live outside areas with a mobile signal.
  • access to the internet is critical, but not sufficient. The digital economy also requires strong regulations that create a vibrant business climate and let firms leverage digital technologies to compete and innovate; skills that allow workers, entrepreneurs, and public servants to seize opportunities in the digital world; and accountable institutions that use the internet to empower citizens.
The Internet promoted development through three mechanisms

The Internet promotes development through three mechanisms

A favourable business climate, strong human capital and good governance are standard requirements for economic growth. But digital technology has two particular roles to play in development:

  • digital technologies amplify the impact of good (and bad) policies, so any failure to reform means falling farther behind those who do reform. With digital technologies, the stakes have risen for developing countries, which have more to gain than high-income countries, but also more to lose;
  • digital technologies can enable and accelerate the impact of these standard requirements for growth, for example, by creating new jobs and business opportunities, through online learning raising the skills level of workers, and by enabling government to make evidence-based decisions.

Comment

This report is a powerful antidote to those who think digital technologies are the silver bullet for increasing equality, improving education, and reducing the gap between rich and poor. What becomes very clear is that digital technology amplifies change: if things are going badly, digital technology will make it happen worse and faster; if things are going well, digital technology will make it better. Thus digital technology is neither cause nor effect in development, but a catalyst that amplifies change.

This means of course that the hard work of making governments and business transparent and accountable, developing an educated workforce, and having an open, well regulated business environment all need to be done. Digital technology can facilitate this, but on its own it will not lead to a better world except for a very few.

One last point. There is a very interesting article in today’s Globe and Mail newspaper by Jim Balsillie, one of the founders of Blackberry, railing against the TPP, the Trans-Pacific Trade Agreement, because it protects incumbent intellectual property holders. This gives a huge advantage to the USA, by protecting them from innovation originating in other countries with a small number of patents, relatively speaking (such as Canada). Balsillie argues that one reason digital technology has led to a greater increase in inequality is because of the distortion of U.S. patent law which makes it very difficult for new entrants to the digital technology market – although China, interestingly, has been smart enough to work around these barriers by its sheer size and more closed culture. Another barrier we see here in Canada is the power of incumbent organizations such as the three telecommunications companies who, through their control of national network infrastructure, can freeze out new competitors.

It sure ain’t a fair world out there, and digital technology is not helping. We need better regulation, and patent reform, that’s for sure, if digital technology is to reap fully its promise.

Developing a next generation online learning assessment system

Listen with webReader
Facial recognition

Facial recognition

Universitat Oberta de Catalunya (2016) An Adaptive Trust-based e-assessment system for learning (@TeSLA) Barcelona: UOC

This paper describes a large, collaborative European Commission project headed by the Open University of Catalonia, called TeSLA, (no, not to develop a European electric car, but) a state-of-the-art online assessment system that will be accepted as equal to if not better than traditional face-to-face assessment in higher education.

The challenge

The project argues that at the moment there is no (European?) online assessment system that:

  • has the same level of trust as face-to-face assessment systems
  • that is universally accepted by educational institutions, accreditation agencies and employers
  • incorporates pedagogical as well as technical features
  • integrates with other aspects of teaching and learning
  • provides true and secure ‘authentication’ of authorship.

I added the ‘European’, as I think this claim might come as a surprise to Western Governors’ University, which has been successfully using online proctoring for some time. It is also why I used the term ‘next generation’ in the heading, as the TeSLA project is aiming at something much more technologically advanced than the current WGU system, which consists mainly of a set of web cameras observing learners taking an assessment (click here for a demonstration).

Also, the TeSLA proposal makes a good point when it says any comprehensive online assessment system must also be able to handle formative as well as summative assessment, and that this can be a challenge as formative assessment is often embedded in the day-to-day teaching and learning activities.

But the main reason for this project is that online learning assessment currently lacks the credibility of face-to-face assessment.

The solution

A non-invasive system that is able to provide a quality continuous assessment model, using proportionate and necessary controls that will ensure student identity and authorship [in a way that offers] accrediting agencies and society unambiguous proof of academic progression….

Any solution must work fully online and take into account ‘academic requirements’ for assessment, including enriched feedback, adaptive learning, formative assessment and personalized learning.

This will require the use of technologies that provide reliable and accurate user authentication and identification of authorship, face and voice recognition, and keystroke dynamics recognition (see here for video examples of the proposed techniques).

The solution must result in

a system based on demonstrable trust between the institution and its students. Student trust is continuously updated according to their interaction with the institution, such as analysis of their exercises, peer feedback in cooperative activities or teacher confidence information. Evidence is continuously collected and contrasted in order to provide such unambiguous proof.

The players

The participants in this project include

  • eight universities,
  • four research centres,
  • three educational quality assurance agencies,
  • three technology companies,
  • from twelve different countries.

In total the project will have a team of about 80 professionals and will use large-scale pilots involving over 14,000 European students.

Comment

I think this is a very interesting project and is likely to grab a lot of attention. At the end of the day, there could well be some significant improvements to online assessment that will actually transfer to multiple online courses and programs.

However, I spent many years working on large European Commission projects and I am certainly glad I don’t have to do that any more. Quite apart from the truly mindless bureaucracy that always accompanies such projects (the form-filling is vast and endless), there are real challenges in getting together participants who can truly contribute to such a project. Participants are determined more by political considerations, such as regional representation, rather than technical competence. Such projects in the end are largely driven by two or three key players; the remaining participants are more likely to slow down or inhibit the project, and they certainly divert essential funding away from the those most able to make the project succeed. However, these projects are as much about raising the level of all European countries in terms of learning technologies as becoming a world leader in this field.

These criticisms apply to any of the many European Commission projects, but there are some issues that are particular to this project:

  1. I am not convinced that there is a real problem here, or at least a problem that requires better technology as a solution. Assessment for online learning has been successfully implemented now for more than 20 years, and while it mostly depends on some form of face-to-face invigilation, this has not proved a major acceptability problem or a barrier to online enrolments. There will always be those who do not accept the equivalence of online learning, and the claimed shortcomings of online assessment are just another excuse for non-acceptance of online learning in general.
  2. Many of the problems of authenticity and authorship are the same for face-to-face assessment. Cheating is not exclusive to online learning, nor is there any evidence that it is more prevalent in online learning where it is provided by properly accredited higher education institutions. Such a study is just as likely to reduce rather than increase trust in online learning by focusing attention on an issue that has not been a big problem to date.
  3. Even if this project does result in more ‘trustworthy’ online assessment, there are huge issues of privacy and security of data involved, not to mention the likely cost to institutions. Perhaps the most useful outcome from this project will be a better understanding of these risks, and development of protocols for protecting student privacy and the security of the data collected for this purpose. I wish though that a privacy commissioner was among the eighteen different participants in this project. I fail to see how such a project could be anything but invasive for students, most of whom will be assessed from home.

For all these reasons, this project is well worth tracking. It has the potential to radically change the way we not only assess online learners, but also how we teach them, because assessment always drives learner behaviour. Whether such changes will be on balance beneficial though remains to be seen.

Keyboard dynamics

Keyboard dynamics

An example of online experiential learning: Ryerson University’s Law Practice Program

Listen with webReader

Lawyers 2

Alexandris, G., Buontrogianni, M, and Djafarova, N. (2015) Ground-breaking program for Ontario Law School Graduates – Virtual Law Firms, Berlin: OEB Conference

Online, experiential learning

Experiential learning is a very popular concept in education these days, but it is not always well understood, and in particular some see experiential learning and online learning as contradictory. It’s important then to have examples of successful online experiential programs.

Ryerson University in Toronto has one such program. Although hybrid rather than fully online, the online component is both substantial and essential.

Why Ryerson?

One of the many challenges in legal training is moving new law school graduates into the real world of law practice. Although most graduates become articled to a particular law firm, they are often ill-prepared for the actual work, which is much more skills- and context-based than the more theory- and content-based approach in law school.

The Law Society of Upper Canada, which regulates the profession in Ontario, recently introduced changes to its licensing process, requiring a new ‘transition to practice’ training that focuses on skills development. Although Ryerson does not have its own law school, it does have a strong reputation for innovative approaches to skills development in higher education, and as a result in 2013 the Law Society of Upper Canada chose Ryerson to develop the transition to practice program, now called the Law Practice Program (LPP).

The challenge

Ryerson had to develop an experience-based program, drawing initially 220 participants during each of its first two years, spread across the whole province of Ontario and beyond, but also capable of expansion if necessary. The program required developing realistic cases and practices, and a teaching approach that of necessity directly involved ‘real’ law firms and busy, practising lawyers and judges as mentors. At the same time, the training must not interfere with the actual practice of law while participants were engaged in training.

The overall program strategy

Ryerson turned to two of its centres, the Chang School of Continuing Education’s Centre for Digital Education, and the Interpersonal Skills Teaching Centre, which offers simulated learning and teaching of interpersonal communications skills.

Externally Ryerson partnered with the Ontario Bar Association. This enabled Ryerson to annually engage over 250 lawyers across the province as mentors and contributors to the program, and 220 law firms and organizations for work placements. This also allowed the program to integrate technology and legal resources already used in the law profession.

The program adopts a hybrid approach, with a four month practical training period consisting of 14 weeks online and three separate weeks on campus. During these seventeen weeks, candidates work on simulated files developed by practising lawyers. This training is then followed by a four month work placement, where participants work on actual files.

Curriculum

The practical training component consists of developing skills and competency in the following areas:

  • professionalism and ethics
  • analytical skills
  • research
  • oral and written communication
  • client management
  • practice management.

using seven practice areas of law:

  • administrative law
  • business law
  • civil litigation
  • criminal law
  • family law
  • real estate law
  • wills and estates law.

Program design

This is where the program becomes unique and innovative. There are several components of the design.

a. Virtual ‘firms’

Virtual firms are created with four participants, and an external lawyer as a mentor. Each firm also has multiple clients, actors specially trained to play a specific role. There are weekly firm meetings, often in virtual, but real-time, format.

b. Specially designed learning resources

Participants have access to more than 90 pieces of simulated legal correspondence, several specialized legal applications and databases, 40 custom-made videos, and 20 learning modules.

LPP presentation 2

A number of multiple choice assessments and interactive learning objects have been designed to facilitate comprehension and understanding of legal issues and the development of skills.

There are also in-person and virtual presentations by experts in key competency and substantive legal areas, and participants also have to meet virtually and in-person with clients, other lawyers and judges.

c. Communication

A wide variety of tools are used for communication between participants, mentors and clients, including:

  • a standard learning management system
  • online communications tools used within the legal profession (Clio, Webex)

d. Assessment

Participants are assessed through their interaction with lawyers and judges during the program, including live legal presentations and argument.

Conclusion

The main success of the program, now in its second year, has been the ability of the participants ‘to hit the ground running’ when they join a law firm/legal employer. Employers’ responses to the program have been generally highly favourable (see here), although no formal evaluation of the program has yet been conducted. The strong involvement of lawyers and judges as well as law firms has ensured that the training is both relevant and practical, while the firms benefit from better prepared future employees.

The creation of virtual cases, processes and procedures, the use of simulations and virtual meetings and virtual firms, and work placements under supervision, have combined to provide a strong, experience-based approach to learning which both participants and mentors have found highly motivating.

Lastly the ability for participants and mentors to work primarily online has provided the flexibility necessary for busy, working professionals.

There are of course many other online experiential learning programs, such as the virtual reality-based program on custom border services for Canada Border Service Agents at Loyalist College, Ontario. I would welcome other contributions or examples for future blog posts.

LPP case 2

Disclaimer

Since 1st January 2016 I am a Distinguished Visiting Professor at Ryerson University, but I have not been engaged in any way with the design, development or delivery of this program. I am though indebted to Gina Alexandris, the program director for the LPP, for her help and advice in preparing this post.