May 28, 2016

Technology and alienation: symptoms, causes and a framework for discussion

Listen with webReader
Edvard Munch's The Scream (public domain) Location: National Gallery, Norway

Edvard Munch’s The Scream (public domain)
Location: National Gallery, Norway

This is the second post on the topic of technology, alienation and the role of education, with a particular focus on the consequences for teaching and learning. The first post was a general introduction to the topic. This post focuses on how technology can lead to alienation, and provides a framework for discussing the possibility of technology alienation in online learning and how to deal with it.

What do I mean by ‘alienation’?

Alienation is a term that has been around for some time. Karl Marx described alienation as the perception by people that they are becoming increasingly unable to control the social forces that shape their lives. Ultimately, highly alienated workers come to lose the sense that they can control any aspect of their lives, whether at work or at home, and become highly self-estranged. Such people are profoundly discontent, prone to alcohol and drug abuse, mental illness, violence, and the support of extreme social and political movements (Macionis and Plummer, 2012). Although Marx had an industrial society in mind, the definition works equally well to describe some of the negative effects of a digital society, as we shall see.

Causes

There are of course many different but related causes of alienation today:

  • the increasing inequality in wealth and in particular the perception by unemployed or low paid workers that they are being ‘passed by’ or not included in the wealth-generating economy. The feeling is particularly strong among workers who previously had well paid jobs (or expectations of well paid jobs) in manufacturing but have seen those jobs disappear in their lifetime. However, there are now also growing numbers of well educated younger people struggling to find well paid work while at the same time carrying a large debt as a result of increasingly expensive higher education;
  • one reason for the loss of manufacturing jobs is the effect of globalization: jobs going abroad to countries where the cost of labour is lower;
  • dysfunctional political systems are another factor, where people feel that they have little or no control over decisions made by government, that government is controlled by those with power and money, and political power is used to protect the ‘elites’;
  • lastly, and the main consideration in these posts, the role of technology, which operates in a number of ways that create alienation:
    • the most immediate is its role in replacing workers, originally in manufacturing, but now increasingly in service or even professional areas of work, including education;
    • a more subtle but nevertheless very powerful way in which technology leads to alienation is in controlling what we do, and in particular removing choice or decision-making from individuals. I will give some examples later;
    • lastly, many people are feeling increasingly exploited by technology companies collecting personal data and using it for commercial purposes or even to deny services such as insurance; in particular, the benefits to the end-user of technology seem very small compared to the large profits made by the companies that provide the services.

Symptoms

Here are some examples of how technology leads to alienation.

There have been several cases where intimate images of people have been posted on the Internet, without permission, and yet it has been impossible for the victims to get the images removed, at least until well after the damage has been done. The Erin Andrews case is the most recent, and the suicide of the 15 year old Amanda Todd is another example. These are extreme cases, but illustrate the perception that we have less and less control over social media and its potentially negative impact on their lives.

Sometimes the alienation comes from decisions made by engineers that pre-empt or deny human decision-making. I have always driven BMWs. Even when I had little money, I would buy a second hand BMW, mainly because of its superb engineering. However, I am driven crazy by my latest purchase. The ignition switches off automatically when I stop the car and automatically switches on again when I take my foot off the brake. One day I drove into my garage. I had stopped the car, and turned round to get something off the back seat. I took my foot off the brake and the car lurched forward and hit the freezer we have in the garage. If I had been on the street and done that, I could well have hit another car or even a pedestrian. The car also automatically locks the passenger doors. I have parked the car and started to walk away only to see my passengers pounding on the window to get out. I could cite nearly a hundred instances from this one car of decisions made by engineers that I don’t want made for me. In most cases (but not all) these default conditions can be changed, but that requires going through a 600 page printed manual. Furthermore these ‘features’ all cost money to install, money I would rather not pay if I had a choice.

We are just starting to see similar decisions by engineers creeping into online learning. One of the most popular uses of data analytics is to identify students ‘at risk’ of non-completion. As with the features in a car, there are potential benefits in this. However, the danger is that decisions based on correlations of other students’ previous behaviour with course completion may end up denying access to a program for a student considered ‘at risk’ but who may nevertheless might well succeed. In particular it could negatively profile black students in the USA, aboriginal students in Canada, or students from low income families.

A framework for discussion

I am dealing here with a highly emotive issue, and one where there will be many different and often contradictory perspectives. Let’s start with the ‘moral’ or ‘value’ issues. I start from the position that alienation is to be avoided if at all possible. It leads to destructive forces. In education in particular, alienation is the opposite of engagement, and for me, engagement is critical for student success. On the other hand, if people are really suffering, then alienation may well be a necessary starting point on the road to change or revolution. So it is difficult to adopt an objective stance to this topic. I want therefore to focus the discussion around the following issues:

  • what are the main developments in online learning that are occurring or will occur over the next few years?
  • who are the main drivers of change in this area?
  • what is the main value proposition? Why is this area being promoted? Who stands to benefit most from this development?
  • what are the risks or what is the downside of these developments? In particular, what is the risk that such developments may actually increase alienation in learners?

I will look at each of the following developments in the next series of blog posts within this framework, developments in online learning that have great promise but at the same time could, if not carefully managed, end up increasing alienation:

  • competency-based learning;
  • personalised and adaptive learning;
  • learning analytics;
  • online assessment methods (badges, machine marking, e-proctoring, e-portfolios, etc.);
  • unbundling of educational services

I will then end this series of posts with a discussion of ‘defensive’ strategies for learners and educators to deal with the negative impact of technology in a digital age.

References

Macionis, J. and Plummer, K. (2012) Sociology: A Global Introduction Don Mills ON: Pearson Education

Technology, alienation and the role of education: an introduction

Listen with webReader
One definition of alienation Image: Reuters

One definition of alienation
Image: Reuters

Is there a problem here?

I live a 30 minute drive from the U.S. border, and like many of my fellow Canadians (and many U.S. colleagues) I have been watching with a mixture of disgust and horror the Donald Trump presidential campaign gathering increasing momentum. However unlike most Canadians, I am not surprised at Trump’s growing success (nor is Canada immune – Rob Ford’s support also comes from the same origins). Trump derives his support from an ever expanding body of people who feel alienated and marginalized by technology, globalization and the growing gap between rich and poor.

On the other side of the political spectrum, the supporters of Bernie Sanders as a candidate for the Democratic presidential nomination, and the anti-austerity movements in Europe, are also driven by increasing alienation due to perceived failures of the capitalist/’democratic’ system to meet the interests of ordinary people. Both sides see government as having been captured by special interest groups, especially but not exclusively financial establishments and the major media and Internet companies.

There is of course no single reason for this growing alienation, but the way technology, and particularly digital technology, has been moving recently is one major cause of this alienation. People feel they are losing control to forces they do not understand. In particular, there is a growing sense that the benefits of technology are going to an increasingly smaller and richer group of people. The public, the end users of technology, increasingly feel that they are being exploited for the benefit of those that control the technology. People are losing jobs and those that have jobs are working harder or longer to stand still.

Dealing with the problem (or challenge)

I plan to explore this issue further in several blog posts that focus particularly on the role of education, and how we deal with technology, both as a field of study, and with its use for teaching and learning. I will argue that educators have a special responsibility to prepare students better for this rapidly changing and increasingly threatening digital world, so students can try to wrest some control and make technology work better for them in the future. I will also be arguing that some potential developments in the use of technology in education could be more harmful than beneficial, and will further increase feelings of alienation, if we are not careful.

This is very much an exploratory journey on my part. I will outline a series of topics for discussion in different blog posts, but this may well change as we get into it. In particular, I am looking for discussion and interaction, an exchange of views, and different perspectives on what I see as an increasingly important topic. The focus will always be on the implications for teaching and learning.

Here is my initial breakdown of topics:

  • introduction (this post)
  • technology and alienation: symptoms, causes and a framework for discussion (next post)
  • skills development and the labour market: are we fighting the last war? (This will include a discussion of competency-based learning, and the difference between skills and competencies – or competences, if you are European), with the goal of better preparing learners for an increasingly hostile digital age;
  • automation vs empowerment in educational technology (already done; maybe some revisions)
  • unbundling of educational services: who benefits; alternative models; privatisation versus state funding; risk management
  • the myth of the autonomous learner: the changing relationship between teachers and learners; creating effective learning environments (partly done); how to personalise learning to the benefit of the learner
  • teaching ‘defensive’ skills: protecting privacy, avoiding monopolies, citizen engagement, understanding and controlling the technology
  • globalization and online learning: think/learn globally, act/do locally; ways to open the curriculum; building bridges with other cultures
  • wrap-up.

Help!

This is starting to look like a mini-course, maybe even a cMOOC, but my thinking is so unformed at this stage that I want to keep the topic and approach as open as possible, and in particular I want to clarify my own thoughts through the process of writing (yes, that does work sometimes). So:

  • do you believe that alienation is increasing/a serious problem, due to the way technology is being managed and controlled? Or am I being paranoid?
  • what topics would you add to this list? Is there anything essential in discussing the topic of technology-based alienation and the role of education that needs to be included that I have missed?
  • can education really make a difference? Can it help prevent alienation – or should it encourage it? Or are we already stitched up?
  • would you be interesting in contributing to this discussion; if so how? (e.g. guest posts; comments; suggested readings/videos)
  • are you thinking: ‘Don’t even go there, Tony – it’s a waste of time!’?

Building an effective learning environment

Listen with webReader

Learning environment 2

I was asked by the Chang School of Continuing Studies at Ryerson University to do a master class on this topic at their ChangSchoolTalks on February 17, based on Appendix 1 in my open, online textbook, Teaching in a Digital Age.

I was a little surprised by the request. I had moved what had originally been the second chapter of the book to an appendix, as I thought it was rather obvious and most instructors would already be aware of the key factors in an effective learning environment, so I was somewhat nervous about doing a master class for faculty and instructors on this topic.

As it turned out, I need not have worried. The master class was the first to be fully booked and the way the master class developed suggested that participants found the topic both stimulating and challenging. I think the reason for this is that my approach to building an effective learning environment is driven by a particular philosophy of education that is not always understood in post-secondary education. For this reason I thought I would share with you my thoughts on this in this post.

Learning as a ‘natural’ human activity

One premise behind building an effective learning environment is that it is inbuilt in humans to learn. If we had not been reasonably good at learning, we would have been killed off early in the earth’s history by faster, bigger and more ferocious animals. The ability not only to learn, but to learn in abstract and conscious ways, is therefore part of human nature.

If that is the case, a teacher’s job is not to do the learning for the student, but to build a rich environment that facilitates the kind of learning that will benefit the learner. It is not a question of pouring knowledge into a student’s head, but enabling the learner to develop concepts, think critically, and apply and evaluate what they have learned, by providing opportunities and experiences that are relevant to such goals.

Learning as development

A second premise is that knowledge is not fixed or static, but is continually developing. Our concept of heat changes and becomes richer as we grow older and become more educated, from understanding heat through touch, to providing a quantitative way of measuring it, to understanding its physical properties, to being able to apply that knowledge to solving problems, such as designing refrigerators. In a knowledge-based society, knowledge is constantly developing and growing, and our understanding is always developing.

This is one reason why I believe that one negative aspect of competency-based education is its attempt to measure competencies in terms of ‘mastery’ and limiting them to competencies required by employers. The difference between a skill and a competency is that there is no limit to a skill. You can continually improve a skill. We should be enabling students to develop skills that will carry them through maybe multiple employers, and enable them to adapt to changing market requirements, for instance.

If then we want students to develop knowledge and skills, we need to provide the right kind of learning environments  that encourage and support such development. Although analogies have their limitations, I like to think of education as gardening, where the learners are the plants. Plants know how to grow; they just need the right environment, the right balance of sun and shadow, the right soil conditions, enough water, etc. Our job as teachers is to make sure we are providing learners with those elements that will allow them to grow and learn. (The analogy breaks down though if we think of learners as having consciousness and free will, which adds an important element to developing an effective learning environment.)

There are many possible effective learning environments

Teaching is incredibly context-specific so the learning environment must be suitable to the context. For this reason, every teacher or instructor needs to think about and build their own learning environment that is appropriate to the context in which they are working. Here are some examples of different learning environments:

  • a school or college campus
  • an online course
  • military training
  • friends, family and work
  • nature
  • personal, technology-based, learning environments
A personal learning environment Image: jason Hews, Flikr

A personal learning environment
Image: jason Hews, Flikr

Nevertheless I will argue that despite the differences in context, there are certain elements or components that will be found in most effective learning environments.

In developing an effective learning environment, there are two issues I need to address up front:

  • First, it is the learner who has to do the learning.
  • Second, any learning environment is much more than the technology used to support it.

With regard to the first, teachers cannot do the learning for the learner. All they can do is to create and manage an environment that enables and encourages learning. My focus then in terms of building an effective learning environment is on what the  teacher can do, because in the end that is all they can control. However, the focus of what the teacher does should be on the learner, and what the learner needs. That of course will require good communication between the learners and the teacher.

Second, many technology-based personal learning environments are bereft of some of the key components that make an effective learning environment. The technology may be necessary but it is not sufficient. I suggest below what some of those components are.

Key components

These will vary somewhat, depending on the context. I will give examples below, but it is important for every individual teacher to think about what components may be necessary within their own context and then on how best to ensure these components are effectively present and used. (There is a much fuller discussion of this in Appendix 1 of my book)

Learner characteristics

This is probably the most important of all the components: the learners themselves. Some of the key characteristics are listed below:

  • what are their goals and motivation to learn what I am teaching them?
  • in what contexts (home, campus, online) will they prefer to learn?
  • how diverse are they in terms of language, culture, and prior knowledge?
  • how digitally capable are they?

Given these characteristics, what are the implications for providing an effective learning environment for these specific learners?

Content

  • what content do students need to cover? What are the goals in covering this content?
  • what sources of content are necessary? Who should find, evaluate, and apply these sources: me or the students? If the learners, what do I need to provide to enable them to do this?
  • how should the content be structured? Who should do this structuring: me or the learners? If learners, what do I need to provide to help them?
  • what is the right balance between breadth and depth of content for the learners in this specific context?
  • what activities will learners need in order to acquire and manage this content?

Skills

  • what skills do students need to develop?
  • what activities will enable learners to develop and apply these skills? (e.g. thinking, doing, discussing)
  • what is the goal in skill development? Mastery? A minimal level of performance? How will learners know this?

Learner support

  • what counselling and/or mentoring will learners need to succeed?
  • how will learners get feedback (particularly on skills development)?
  • how will learners relate to other learners so they are mutually supporting?

Resources

  • how much time can I devote to each of the components of a learning environment? What’s the best way to split my time?
  • what help will I get from other teaching staff, e.g. teaching assistants, librarians? What is the best way to use them?
  • what facilities will the learners have available (e.g. learning spaces, online resources)?
  • what technology can the learners use; how should this be managed and organized?

Assessment

  • what types of assessment should be used? (formative, essays, e-portfolios, projects)?
  • how will these measure the content and skills that learners are expected to master?

These questions are meant mainly as examples. Each teacher needs to develop and think about what components will be necessary in their context and how best to provide those components.

For instance, I did not include culture as a component. In some contexts, cultural change is one of the most important goals of education. Negative examples of this might include the culture of privilege encouraged in private British boarding schools, or the attempt to replace indigenous cultures with a western culture, as practiced in Canada with aboriginal residential schools. More positive cultural components may be to encourage inclusivity or ethical behaviour. Again, each teacher should decide on what components are important for their learners.

Necessary but not sufficient

Thinking about and implementing these components may be necessary, but they are not sufficient in themselves to ensure quality teaching and learning. In addition effective teaching still needs:

  • good design
  • empathy for the learners
  • teacher competence (e.g. subject knowledge)
  • imagination to create an effective learning environment.

Conclusions

The learners must do the learning. We need to make sure that learners are able to work within an environment that helps them do this. In other words, our job as teachers is to create the conditions for success.

There are no right or wrong ways to build an effective learning environment. It needs to fit the context in which students will learn. However, before even beginning to design a course or program, we should be thinking of what this learning environment could look like.

Technology now enables us to build a wide variety of effective learning environments. But technology alone is not enough; it needs to include other components for learner success. This is not to say that self-managing learners cannot build their own effective, personal learning environments, but they need to consider the other components as well as the technology.

Questions

  1. What other components would you add to a successful learning environment?
  2. Could you now design a different and hopefully better learning environment for your courses or programs? If so, what would it look like?
  3. Is this a helpful way to approach the design of online learning or indeed any other form of learning?

 

Why digital technology is not necessarily the answer to your problem

Listen with webReader
The darker the shade, the higher the Internet population

The darker the shade, the higher the Internet population

World Bank (2016) World Development Report 2016: Digital Dividends. Washington, DC: World Bank.

What is the report about?

This 359 page report, partly funded by Canada’s Department of Foreign Affairs, Trade, and Development and the International Development Research Centre, involved the work of several hundred people and was based on consultation meetings in 27 different countries (see here for more information on these consultations).
The report notes that more households in developing countries own a mobile phone than have access to electricity or clean water, and nearly 70 percent of the bottom fifth of the population in developing countries own a mobile phone. The number of internet users has more than tripled in a decade—from 1 billion in 2005 to an estimated 3.2 billion at the end of 2015.

The key question addressed by this report then is as follows:

Have [these] massive investments in information and communication technologies (ICTs) generated faster growth, more jobs, and better services? Indeed, are countries reaping sizeable digital dividends?
I can only briefly summarise this lengthy report, and if this post peaks your interest, please read the full report.

Main conclusions

Despite this vast investment in digital technologies, the digital dividend in terms of greater productivity, less inequality, more democracy, and greater wealth for all has not been gained. For instance:

  • global productivity growth has slowed;
  • labor markets have become more polarized and inequality is rising—particularly in the wealthier countries, but increasingly in developing countries;
  • while the number of democracies is growing, the share of free and fair elections is falling.

Digital divide Africa 2

Furthermore:

  • nearly 60 percent of the world’s people are still offline and can’t participate in the digital economy in any meaningful way;
  • many advanced economies face increasingly polarized labor markets and rising inequality—in part because technology augments higher skills while replacing routine jobs, forcing many workers to compete for low-paying jobs;
  • public sector investments in digital technologies, in the absence of accountable institutions, amplify the voice of elites, which can result in policy capture and greater state control;
  • because the economics of the internet favour natural monopolies, the absence of a competitive business environment can result in more concentrated markets, benefiting incumbent firms;
  • not surprisingly, the better educated, well connected, and more capable have received most of the benefits, circumscribing the gains from the digital revolution.

The fundamentals (‘complements’) of development are:

  • good governance;
  • a robust and open business market;
  • accountability (i.e. lack of corruption);
  • strong human capital (i.e. a well educated work-force)

In countries where these fundamentals are weak, digital technologies have not boosted productivity or reduced inequality. These poor trends persist, not because of digital technologies, but in spite of them. Thus while digital technologies have been spreading, digital dividends have not. On the other hand, countries that complement technology investments with broader fundamental reforms reap digital dividends in the form of faster growth, more jobs, and better services.

Thus the report’s main conclusion is:

The full benefits of the information and communications transformation will not be realized unless countries continue to improve their business climate, invest in people’s education and health, and promote good governance.

Barriers to success

For digital technologies to improve productivity and reduce inequality, there are important ‘analogue’ factors that must accompany or support (‘complement’) the introduction of digital technology in order to get the benefits:
  • digital technologies can make routine, transaction-intensive tasks dramatically cheaper, faster, and more convenient. But most tasks also have an aspect that cannot be automated and that requires human judgment, intuition,and discretion; the better educated the workforce the higher the quality of such human decision-making;
  • when technology is applied to automate tasks without matching improvements in other, non-digital social, economic and political activities, such as governance, accountability and education, technology can fail to bring broad-based gains;
  • the digital revolution can give rise to new business models that would benefit consumers, but not when incumbents control market entry;
  • technology can make workers more productive, but not when they lack the know-how to use it;
  • digital technologies can help monitor teacher attendance and improve learning outcomes, but not when the education system lacks accountability.

What should be done?

  • make the internet universally accessible and affordable. The internet, in a broad sense, has grown quickly, but it is by no means universal. For every person connected to high-speed broadband, five are not. Worldwide, some 4 billion people do not have any internet access, nearly 2 billion do not use a mobile phone, and almost half a billion live outside areas with a mobile signal.
  • access to the internet is critical, but not sufficient. The digital economy also requires strong regulations that create a vibrant business climate and let firms leverage digital technologies to compete and innovate; skills that allow workers, entrepreneurs, and public servants to seize opportunities in the digital world; and accountable institutions that use the internet to empower citizens.
The Internet promoted development through three mechanisms

The Internet promotes development through three mechanisms

A favourable business climate, strong human capital and good governance are standard requirements for economic growth. But digital technology has two particular roles to play in development:

  • digital technologies amplify the impact of good (and bad) policies, so any failure to reform means falling farther behind those who do reform. With digital technologies, the stakes have risen for developing countries, which have more to gain than high-income countries, but also more to lose;
  • digital technologies can enable and accelerate the impact of these standard requirements for growth, for example, by creating new jobs and business opportunities, through online learning raising the skills level of workers, and by enabling government to make evidence-based decisions.

Comment

This report is a powerful antidote to those who think digital technologies are the silver bullet for increasing equality, improving education, and reducing the gap between rich and poor. What becomes very clear is that digital technology amplifies change: if things are going badly, digital technology will make it happen worse and faster; if things are going well, digital technology will make it better. Thus digital technology is neither cause nor effect in development, but a catalyst that amplifies change.

This means of course that the hard work of making governments and business transparent and accountable, developing an educated workforce, and having an open, well regulated business environment all need to be done. Digital technology can facilitate this, but on its own it will not lead to a better world except for a very few.

One last point. There is a very interesting article in today’s Globe and Mail newspaper by Jim Balsillie, one of the founders of Blackberry, railing against the TPP, the Trans-Pacific Trade Agreement, because it protects incumbent intellectual property holders. This gives a huge advantage to the USA, by protecting them from innovation originating in other countries with a small number of patents, relatively speaking (such as Canada). Balsillie argues that one reason digital technology has led to a greater increase in inequality is because of the distortion of U.S. patent law which makes it very difficult for new entrants to the digital technology market – although China, interestingly, has been smart enough to work around these barriers by its sheer size and more closed culture. Another barrier we see here in Canada is the power of incumbent organizations such as the three telecommunications companies who, through their control of national network infrastructure, can freeze out new competitors.

It sure ain’t a fair world out there, and digital technology is not helping. We need better regulation, and patent reform, that’s for sure, if digital technology is to reap fully its promise.

Developing a next generation online learning assessment system

Listen with webReader
Facial recognition

Facial recognition

Universitat Oberta de Catalunya (2016) An Adaptive Trust-based e-assessment system for learning (@TeSLA) Barcelona: UOC

This paper describes a large, collaborative European Commission project headed by the Open University of Catalonia, called TeSLA, (no, not to develop a European electric car, but) a state-of-the-art online assessment system that will be accepted as equal to if not better than traditional face-to-face assessment in higher education.

The challenge

The project argues that at the moment there is no (European?) online assessment system that:

  • has the same level of trust as face-to-face assessment systems
  • that is universally accepted by educational institutions, accreditation agencies and employers
  • incorporates pedagogical as well as technical features
  • integrates with other aspects of teaching and learning
  • provides true and secure ‘authentication’ of authorship.

I added the ‘European’, as I think this claim might come as a surprise to Western Governors’ University, which has been successfully using online proctoring for some time. It is also why I used the term ‘next generation’ in the heading, as the TeSLA project is aiming at something much more technologically advanced than the current WGU system, which consists mainly of a set of web cameras observing learners taking an assessment (click here for a demonstration).

Also, the TeSLA proposal makes a good point when it says any comprehensive online assessment system must also be able to handle formative as well as summative assessment, and that this can be a challenge as formative assessment is often embedded in the day-to-day teaching and learning activities.

But the main reason for this project is that online learning assessment currently lacks the credibility of face-to-face assessment.

The solution

A non-invasive system that is able to provide a quality continuous assessment model, using proportionate and necessary controls that will ensure student identity and authorship [in a way that offers] accrediting agencies and society unambiguous proof of academic progression….

Any solution must work fully online and take into account ‘academic requirements’ for assessment, including enriched feedback, adaptive learning, formative assessment and personalized learning.

This will require the use of technologies that provide reliable and accurate user authentication and identification of authorship, face and voice recognition, and keystroke dynamics recognition (see here for video examples of the proposed techniques).

The solution must result in

a system based on demonstrable trust between the institution and its students. Student trust is continuously updated according to their interaction with the institution, such as analysis of their exercises, peer feedback in cooperative activities or teacher confidence information. Evidence is continuously collected and contrasted in order to provide such unambiguous proof.

The players

The participants in this project include

  • eight universities,
  • four research centres,
  • three educational quality assurance agencies,
  • three technology companies,
  • from twelve different countries.

In total the project will have a team of about 80 professionals and will use large-scale pilots involving over 14,000 European students.

Comment

I think this is a very interesting project and is likely to grab a lot of attention. At the end of the day, there could well be some significant improvements to online assessment that will actually transfer to multiple online courses and programs.

However, I spent many years working on large European Commission projects and I am certainly glad I don’t have to do that any more. Quite apart from the truly mindless bureaucracy that always accompanies such projects (the form-filling is vast and endless), there are real challenges in getting together participants who can truly contribute to such a project. Participants are determined more by political considerations, such as regional representation, rather than technical competence. Such projects in the end are largely driven by two or three key players; the remaining participants are more likely to slow down or inhibit the project, and they certainly divert essential funding away from the those most able to make the project succeed. However, these projects are as much about raising the level of all European countries in terms of learning technologies as becoming a world leader in this field.

These criticisms apply to any of the many European Commission projects, but there are some issues that are particular to this project:

  1. I am not convinced that there is a real problem here, or at least a problem that requires better technology as a solution. Assessment for online learning has been successfully implemented now for more than 20 years, and while it mostly depends on some form of face-to-face invigilation, this has not proved a major acceptability problem or a barrier to online enrolments. There will always be those who do not accept the equivalence of online learning, and the claimed shortcomings of online assessment are just another excuse for non-acceptance of online learning in general.
  2. Many of the problems of authenticity and authorship are the same for face-to-face assessment. Cheating is not exclusive to online learning, nor is there any evidence that it is more prevalent in online learning where it is provided by properly accredited higher education institutions. Such a study is just as likely to reduce rather than increase trust in online learning by focusing attention on an issue that has not been a big problem to date.
  3. Even if this project does result in more ‘trustworthy’ online assessment, there are huge issues of privacy and security of data involved, not to mention the likely cost to institutions. Perhaps the most useful outcome from this project will be a better understanding of these risks, and development of protocols for protecting student privacy and the security of the data collected for this purpose. I wish though that a privacy commissioner was among the eighteen different participants in this project. I fail to see how such a project could be anything but invasive for students, most of whom will be assessed from home.

For all these reasons, this project is well worth tracking. It has the potential to radically change the way we not only assess online learners, but also how we teach them, because assessment always drives learner behaviour. Whether such changes will be on balance beneficial though remains to be seen.

Keyboard dynamics

Keyboard dynamics