July 30, 2016

Examining ethical and privacy issues surrounding learning analytics

Listen with webReader
Image: SecurityCamExpert, 2013

Image: SecurityCamExpert, 2013

Drachsler, H. et al. (2016) Is Privacy a Show-stopper for Learning Analytics? A Review of Current Issues and Their Solutions Learning Analytics Review, no. 6, January 2016, ISSN: 2057-7494

About LACE

One of the most interesting sessions for me at last week’s EDEN conference in Budapest was a workshop run by Sally Reynolds of  ATiT in Brussels and Dai Griffiths of the University of Bolton, UK. They are both participants in a European Commission project called LACE (Learning Analytics Community Exchange).

The LACE web site states:

LACE partners are passionate about the opportunities afforded by current and future views of learning analytics (LA) and educational data mining (EDM) but we were concerned about missed opportunities and failing to realise value. The project aimed to integrate communities working on LA and EDM from schools, workplace and universities by sharing effective solutions to real problems.

There are a number of reviews and case studies of the use of learning analytics available from the web site, which, if you are interested in (or concerned) about the use of learning analytics, are well worth reading.

The EDEN workshop

The EDEN workshop focused on one of the reviews concerned with issues around ethics and privacy in the use of learning analytics, and in particular the use of big data.

I am reasonably familiar with the use of ‘small’ data for learning analytics, such as the use of institutional student data regarding the students in the courses I am teaching, or the analysis of participation in online discussions, both in quantitative and qualitative terms. I am less familiar with the large-scale use of data and especially how data collected via learning management or MOOC registration systems are or could be used to guide teaching and learning.

However, the focus of the workshop was specifically on ethical and privacy issues, based on the review quoted above, but nevertheless I learned a great deal about learning analytics in general through the workshop.

What is the concern?

This is best stated in the review article:

Once the Pandora’s Box of data availability has been opened, then individuals lose control of the data about them that have been harvested. They are unable to specify who has access to the data, and for what purpose, and may not be confident that the changes to the education system which result from learning analytics will be desirable. More generally, the lack of transparency in data collection and analysis exacerbates the fear of undermining privacy and personal information rights in society beyond the confines of education. The transport of data from one context to another can result in an unfair and unjustified discrimination against an individual.

In the review article, these concerns are exemplified by case studies covering schools, universities and the workplace. These concerns are summarized under the following headings:

  • privacy
  • informed consent and transparency in data collection
  • location and interpretation of data
  • data management and security
  • data ownership
  • possibility of error
  • role of knowing and obligation to act

There are in fact a number of guidelines regarding data collection and use that could be applied to learning analytics, such as the Nuremberg Code on research ethics, the OECD Privacy Framework, (both of which are general), or the JISC code of practice for learning analytics. However, the main challenge is that some proponents of learning analytics want to approach the issue in ways that are radically different from past data collection methods (like my ‘small’ data analysis). In particular they propose using random data collection then subsequently analysing it through data analysis algorithms to identify possible post-hoc applications and interpretations.

It could be argued that educational organizations have always collected data about students, such as registers of attendance, age, address and student grades. However, new technology, such as data trawling and the ability to combine data from completely different sources, as well as automated analysis, completely changes the game, raising the following questions:

  • who determines what data is collected and used within a learning management system?
  • who ensures the security of student (or instructor) data?
  • who controls access to student data?
  • who controls how the data is used?
  • who owns the data?

In particular, increasingly student (and instructor) data is being accessed, stored and used not just outside an institution, but even outside a particular country, and hence subject to laws (such as the U.S. Patriot Act) that do not apply in the country from which the data was collected.

Recommendations from the LACE working group

The LACE working group has developed an eight point checklist called DELICATE, ‘to support a new learner contract, as the basis for a trusted implementation of Learning Analytics.’

Delicate 2

For more on DELICATE see:

Drachsler, H. and Greller, W. (2016) Privacy and Learning Analytics – its a DELICATE issue Heerlen NL: The Open University of the Netherlands

Issues raised in the workshop

First it was pointed out that by today’s standards, most institutional data doesn’t qualify as ‘big data’. In education, what would constitute big data would for example be student information from the whole education system. The strategy would be to collect data about or from all students, then apply analysis that may well result in by-passing or even replacing institutions with alternative services. MOOC platforms are possibly the closest that come to this model, hence their potential for disruption. Nevertheless, even within an institution, it is important to develop policies and practices that take into account ethics and privacy when collecting and using data.

As in many workshops, we were divided into small groups to discuss some of these issues, with a small set of questions to guide the discussion. In my small group of five conference participants, none of the participants was in an institution that had a policy regarding ethics and privacy in the use of learning analytics (or if it existed, they were unaware of it).

There was a concern on our table that increasing amounts of student data around learning was accessible to external organizations (such as LMS software companies and social media organizations such as Facebook). In particular, there was a  concern that in reality, many technology decisions, such as choice of an institutional learning platform, were influenced strongly by the CIO, who may not take into sufficient account ethical and privacy concerns when negotiating agreements, or even by students themselves, who are often unaware of the implications of data collection and use by technology providers.

Our table ended by suggesting that every post-secondary institution should establish a small data ethics/privacy committee that would include, if available, someone who is a specialist in data ethics and privacy, and representatives of faculty and students, as well as the CIO, to implement and oversee policy in this area.

This was an excellent workshop that tried to find solutions that combine a balance between the need to track learner behaviour and privacy and ethical issues.

Over to you

Some questions for you:

  • is your institution using learning analytics – or considering it
  • if so, does your institution have a policy or process for monitoring data ethics and privacy issues?
  • is this really a lot of fuss over nothing?

I’d love to hear from you on this.

EDEN 2016: Re-imagining Learning Environments

Listen with webReader
Pesti Vigadó, where the conference dinner was held

Pesti Vigadó Concert Hall, where the conference dinner was held

The EDEN conference

I have just attended the annual conference of the European Distance and E-Learning Network in Budapest, Hungary.

EDEN is one of my favourite conferences because it always has a lot of interesting people attending and it is a quick way for me to stay abreast of what is happening in European online and distance learning. I provide here an overall report on the conference, but I will do a couple of other more detailed posts on the sessions I found particularly interesting.

There were just under 300 participants. My overall impression is that online and open learning are well and strong in Europe, and is now widespread. When I first started to come to EDEN conferences in the early 1990s, there were only two or three main players, but this year there were contributions from almost every European country. With the growth of online and open learning, there are many new people each year joining the field, coming from very diverse backgrounds. EDEN provides a pan-European opportunity to enable newcomers to learn about some of the basic principles and prior research and knowledge in the field, as well as allowing for the sharing of experience and networking, and reporting new trends and developments in online and open learning.

I was the opening keynote speaker, and talked about building effective learning environments, based on my chapter in Teaching in a Digital Age. I also gave the wrap-up to the conference, on which this post is based.

A concert at the Liszt Academy of Music

A concert at the Liszt Academy of Music

Policy, planning and management

This year there was a welcome number of contributions that focused on policy and management of online, open and distance learning.

Yves Punie of the European Commission’s Joint Research Centre’s Institute for Prospective Technological Skills reported that 70 million Europeans lacked basic literacy and numeracy skills, 24% had no upper secondary education and 45% have insufficient digital literacy skills, although 90% of jobs in Europe will require some sort of ICT skills. The Institute has developed a list of key digital competencies. He noted that while 21% of universities in Europe are now offering MOOCs, most have no overall strategy for open education.

George Ubachs of the European Association of Distance Teaching Universities in his presentation on The Changing Pedagogical Landscape offered an interesting vision for universities that emphasised:

  • personalized teaching and learning
  • small scale, intensive education
  • rich learning environments
  • open-ness and flexibility
  • networked education and mobility

Leslie Wilson of the European University Association commented that:

MOOCs have forced Vice Chancellors to focus on teaching and learning

This is probably a true if sad statement.

I was particularly impressed by Melissa Highton’s report on the open learning strategy of Edinburgh University. It is a highly ranked, old research university in Scotland that has aligned its approach to open education to the university’s core mission. She said:

Not being open is a risk and not being open costs us money.

Laureate University is a global private, for-profit university with over one million enrolments, and with campuses in Europe as well as North America. The leadership at Laureate has decided that the whole system will move from largely face-to-face teaching to blended learning. Alan Noghiu described the strategy that is being used and the challenges the organization is facing in implementing the strategy.

Finally, Alan Tait reported on a study by the International Council for Distance Education (ICDE) on student success factors, which identified the following as critical to student success:

  • pre-study information, advice, guidance and admission;
  • curriculum or programme design that matches the needs of students;
  • intervention at key points and in response to student need;
  • assessment to support learning as well as to judge achievement;
  • individualised and personalised systems of support to students;
  • information and logistical systems that communicate between all relevant participants in the system;
  • overall managing for student success.

This seems to me to be a list that proponents of MOOCs should bear in mind, as well as those offering more formal qualifications at a distance.

The use of multimedia and emerging technologies

Susan Aldridge of Drexel University presented some very interesting examples of educational uses of virtual reality, augmented reality, serious games and holography, including examples used in forensic investigation, meteorology, and medicine. One of the augmented reality tools she demonstrated, Aurasma, is free.

Danny Arati of Intel mentioned the University of Nottingham’s The Periodic Table of Videos, where each element in the period table has a short video about it.

The Periodic Table of Videos, University of Nottingham

The Periodic Table of Videos, University of Nottingham

MOOCs and online learning

I was surprised at how much importance European institutions are still giving to MOOCs. There were by far more papers on MOOCs than on credit-based online learning or even blended learning. Even the Oxford debate this year was on the following motion:

We Should Focus in the Short Term More on MOOCs than on OER

I was relieved when the motion was resoundingly defeated, although I am still a little disheartened that open education is still mainly focused on MOOCs and OERs, rather than on the broader concept of open textbooks, open research, and open data. It was noted that MOOCs are a product while open education is a movement, and it is important not to lose the idea that open education is as much about social justice and equity as it is about technology, as was pointed out by one of the participants, Ronald McIntyre.

Learning analytics

There was an excellent workshop organised by Sally Reynolds and Dai Griffiths from the European Commission funded LACE project: Learning Analytics Community Exchange. The workshop focused on privacy and ethics issues that arise from the use of learning analytics.

This is such an important topic that I will do a full blog post on it later. In the meantime, if you are interested in this topic, see the LACE report: Is Privacy a Show-stopper for Learning Analytics? A Review of Current Issues and their Solutions.

The foyer of the Gresham Hotel

The foyer of the Gresham Hotel

Bits and Pieces

There were several other interesting activities at the conference that are worth reporting:

Pre-conference workshop for young scholars. This was an interesting forum where editors of three of the journals in the field discussed with young (or more accurately, new) scholars how to get published.

Book and wine session This informal late evening session provided an opportunity for participants to share their reviews of interesting books. This is an event that could be expanded to cover both ‘classics’ in the field, as well as books on new developments.

Posters There were about a dozen posters. Again, I would like to see more posters at conferences such as this. A well designed poster can be read in a couple of minutes and impart as much if not more information than a 20 minute oral presentation, and can be seen by everyone at the conference, unlike a presentation at a parallel session, some of which, such as the horrible ‘speed-dating’ sessions, resembled having a fire hose of information turned on you – or am I just a visual learner?

Given that so many new people are moving into online and open learning all the time, much more needs to be done at conferences such as this to encourage sessions where prior knowledge and best practices are brought to the attention of new participants.

Conclusions

Overall, this was another excellent conference from EDEN in a wonderful location (it is the first time I have been immersed into Turkish baths). The next one will be next year in Jönköping, southern Sweden.

Art Nouveau stained glass windows at the Hotel Gellert

Art Nouveau stained glass windows at the Hotel Gellert

All photos: Tony Bates

An excellent guide to multimedia course design

Listen with webReader
© University of Waterloo, 2016

© University of Waterloo, 2016

Centre for Extended Learning (2016) How do we create useful online learning experiences? Waterloo ON: University of Waterloo

The University of Waterloo’s Centre for Extended Learning has combined Peter Morville’s user experience (UX) honeycomb and Richard Mayer’s theory and research on the use of multimedia for learning, to create a well-designed set of guidelines for online course design. This should be compulsory reading/viewing for all instructors moving into online learning.

Thanks to Naza Djafarova, Director, Digital Education Strategies, The Chang School of Continuing Education, Ryerson University, for directing me to this invaluable resource.

Average speed 2

 

Technology and alienation: symptoms, causes and a framework for discussion

Listen with webReader
Edvard Munch's The Scream (public domain) Location: National Gallery, Norway

Edvard Munch’s The Scream (public domain)
Location: National Gallery, Norway

This is the second post on the topic of technology, alienation and the role of education, with a particular focus on the consequences for teaching and learning. The first post was a general introduction to the topic. This post focuses on how technology can lead to alienation, and provides a framework for discussing the possibility of technology alienation in online learning and how to deal with it.

What do I mean by ‘alienation’?

Alienation is a term that has been around for some time. Karl Marx described alienation as the perception by people that they are becoming increasingly unable to control the social forces that shape their lives. Ultimately, highly alienated workers come to lose the sense that they can control any aspect of their lives, whether at work or at home, and become highly self-estranged. Such people are profoundly discontent, prone to alcohol and drug abuse, mental illness, violence, and the support of extreme social and political movements (Macionis and Plummer, 2012). Although Marx had an industrial society in mind, the definition works equally well to describe some of the negative effects of a digital society, as we shall see.

Causes

There are of course many different but related causes of alienation today:

  • the increasing inequality in wealth and in particular the perception by unemployed or low paid workers that they are being ‘passed by’ or not included in the wealth-generating economy. The feeling is particularly strong among workers who previously had well paid jobs (or expectations of well paid jobs) in manufacturing but have seen those jobs disappear in their lifetime. However, there are now also growing numbers of well educated younger people struggling to find well paid work while at the same time carrying a large debt as a result of increasingly expensive higher education;
  • one reason for the loss of manufacturing jobs is the effect of globalization: jobs going abroad to countries where the cost of labour is lower;
  • dysfunctional political systems are another factor, where people feel that they have little or no control over decisions made by government, that government is controlled by those with power and money, and political power is used to protect the ‘elites’;
  • lastly, and the main consideration in these posts, the role of technology, which operates in a number of ways that create alienation:
    • the most immediate is its role in replacing workers, originally in manufacturing, but now increasingly in service or even professional areas of work, including education;
    • a more subtle but nevertheless very powerful way in which technology leads to alienation is in controlling what we do, and in particular removing choice or decision-making from individuals. I will give some examples later;
    • lastly, many people are feeling increasingly exploited by technology companies collecting personal data and using it for commercial purposes or even to deny services such as insurance; in particular, the benefits to the end-user of technology seem very small compared to the large profits made by the companies that provide the services.

Symptoms

Here are some examples of how technology leads to alienation.

There have been several cases where intimate images of people have been posted on the Internet, without permission, and yet it has been impossible for the victims to get the images removed, at least until well after the damage has been done. The Erin Andrews case is the most recent, and the suicide of the 15 year old Amanda Todd is another example. These are extreme cases, but illustrate the perception that we have less and less control over social media and its potentially negative impact on their lives.

Sometimes the alienation comes from decisions made by engineers that pre-empt or deny human decision-making. I have always driven BMWs. Even when I had little money, I would buy a second hand BMW, mainly because of its superb engineering. However, I am driven crazy by my latest purchase. The ignition switches off automatically when I stop the car and automatically switches on again when I take my foot off the brake. One day I drove into my garage. I had stopped the car, and turned round to get something off the back seat. I took my foot off the brake and the car lurched forward and hit the freezer we have in the garage. If I had been on the street and done that, I could well have hit another car or even a pedestrian. The car also automatically locks the passenger doors. I have parked the car and started to walk away only to see my passengers pounding on the window to get out. I could cite nearly a hundred instances from this one car of decisions made by engineers that I don’t want made for me. In most cases (but not all) these default conditions can be changed, but that requires going through a 600 page printed manual. Furthermore these ‘features’ all cost money to install, money I would rather not pay if I had a choice.

We are just starting to see similar decisions by engineers creeping into online learning. One of the most popular uses of data analytics is to identify students ‘at risk’ of non-completion. As with the features in a car, there are potential benefits in this. However, the danger is that decisions based on correlations of other students’ previous behaviour with course completion may end up denying access to a program for a student considered ‘at risk’ but who may nevertheless might well succeed. In particular it could negatively profile black students in the USA, aboriginal students in Canada, or students from low income families.

A framework for discussion

I am dealing here with a highly emotive issue, and one where there will be many different and often contradictory perspectives. Let’s start with the ‘moral’ or ‘value’ issues. I start from the position that alienation is to be avoided if at all possible. It leads to destructive forces. In education in particular, alienation is the opposite of engagement, and for me, engagement is critical for student success. On the other hand, if people are really suffering, then alienation may well be a necessary starting point on the road to change or revolution. So it is difficult to adopt an objective stance to this topic. I want therefore to focus the discussion around the following issues:

  • what are the main developments in online learning that are occurring or will occur over the next few years?
  • who are the main drivers of change in this area?
  • what is the main value proposition? Why is this area being promoted? Who stands to benefit most from this development?
  • what are the risks or what is the downside of these developments? In particular, what is the risk that such developments may actually increase alienation in learners?

I will look at each of the following developments in the next series of blog posts within this framework, developments in online learning that have great promise but at the same time could, if not carefully managed, end up increasing alienation:

  • competency-based learning;
  • personalised and adaptive learning;
  • learning analytics;
  • online assessment methods (badges, machine marking, e-proctoring, e-portfolios, etc.);
  • unbundling of educational services

I will then end this series of posts with a discussion of ‘defensive’ strategies for learners and educators to deal with the negative impact of technology in a digital age.

References

Macionis, J. and Plummer, K. (2012) Sociology: A Global Introduction Don Mills ON: Pearson Education

Building an effective learning environment

Listen with webReader

Learning environment 2

I was asked by the Chang School of Continuing Studies at Ryerson University to do a master class on this topic at their ChangSchoolTalks on February 17, based on Appendix 1 in my open, online textbook, Teaching in a Digital Age.

I was a little surprised by the request. I had moved what had originally been the second chapter of the book to an appendix, as I thought it was rather obvious and most instructors would already be aware of the key factors in an effective learning environment, so I was somewhat nervous about doing a master class for faculty and instructors on this topic.

As it turned out, I need not have worried. The master class was the first to be fully booked and the way the master class developed suggested that participants found the topic both stimulating and challenging. I think the reason for this is that my approach to building an effective learning environment is driven by a particular philosophy of education that is not always understood in post-secondary education. For this reason I thought I would share with you my thoughts on this in this post.

Learning as a ‘natural’ human activity

One premise behind building an effective learning environment is that it is inbuilt in humans to learn. If we had not been reasonably good at learning, we would have been killed off early in the earth’s history by faster, bigger and more ferocious animals. The ability not only to learn, but to learn in abstract and conscious ways, is therefore part of human nature.

If that is the case, a teacher’s job is not to do the learning for the student, but to build a rich environment that facilitates the kind of learning that will benefit the learner. It is not a question of pouring knowledge into a student’s head, but enabling the learner to develop concepts, think critically, and apply and evaluate what they have learned, by providing opportunities and experiences that are relevant to such goals.

Learning as development

A second premise is that knowledge is not fixed or static, but is continually developing. Our concept of heat changes and becomes richer as we grow older and become more educated, from understanding heat through touch, to providing a quantitative way of measuring it, to understanding its physical properties, to being able to apply that knowledge to solving problems, such as designing refrigerators. In a knowledge-based society, knowledge is constantly developing and growing, and our understanding is always developing.

This is one reason why I believe that one negative aspect of competency-based education is its attempt to measure competencies in terms of ‘mastery’ and limiting them to competencies required by employers. The difference between a skill and a competency is that there is no limit to a skill. You can continually improve a skill. We should be enabling students to develop skills that will carry them through maybe multiple employers, and enable them to adapt to changing market requirements, for instance.

If then we want students to develop knowledge and skills, we need to provide the right kind of learning environments  that encourage and support such development. Although analogies have their limitations, I like to think of education as gardening, where the learners are the plants. Plants know how to grow; they just need the right environment, the right balance of sun and shadow, the right soil conditions, enough water, etc. Our job as teachers is to make sure we are providing learners with those elements that will allow them to grow and learn. (The analogy breaks down though if we think of learners as having consciousness and free will, which adds an important element to developing an effective learning environment.)

There are many possible effective learning environments

Teaching is incredibly context-specific so the learning environment must be suitable to the context. For this reason, every teacher or instructor needs to think about and build their own learning environment that is appropriate to the context in which they are working. Here are some examples of different learning environments:

  • a school or college campus
  • an online course
  • military training
  • friends, family and work
  • nature
  • personal, technology-based, learning environments
A personal learning environment Image: jason Hews, Flikr

A personal learning environment
Image: jason Hews, Flikr

Nevertheless I will argue that despite the differences in context, there are certain elements or components that will be found in most effective learning environments.

In developing an effective learning environment, there are two issues I need to address up front:

  • First, it is the learner who has to do the learning.
  • Second, any learning environment is much more than the technology used to support it.

With regard to the first, teachers cannot do the learning for the learner. All they can do is to create and manage an environment that enables and encourages learning. My focus then in terms of building an effective learning environment is on what the  teacher can do, because in the end that is all they can control. However, the focus of what the teacher does should be on the learner, and what the learner needs. That of course will require good communication between the learners and the teacher.

Second, many technology-based personal learning environments are bereft of some of the key components that make an effective learning environment. The technology may be necessary but it is not sufficient. I suggest below what some of those components are.

Key components

These will vary somewhat, depending on the context. I will give examples below, but it is important for every individual teacher to think about what components may be necessary within their own context and then on how best to ensure these components are effectively present and used. (There is a much fuller discussion of this in Appendix 1 of my book)

Learner characteristics

This is probably the most important of all the components: the learners themselves. Some of the key characteristics are listed below:

  • what are their goals and motivation to learn what I am teaching them?
  • in what contexts (home, campus, online) will they prefer to learn?
  • how diverse are they in terms of language, culture, and prior knowledge?
  • how digitally capable are they?

Given these characteristics, what are the implications for providing an effective learning environment for these specific learners?

Content

  • what content do students need to cover? What are the goals in covering this content?
  • what sources of content are necessary? Who should find, evaluate, and apply these sources: me or the students? If the learners, what do I need to provide to enable them to do this?
  • how should the content be structured? Who should do this structuring: me or the learners? If learners, what do I need to provide to help them?
  • what is the right balance between breadth and depth of content for the learners in this specific context?
  • what activities will learners need in order to acquire and manage this content?

Skills

  • what skills do students need to develop?
  • what activities will enable learners to develop and apply these skills? (e.g. thinking, doing, discussing)
  • what is the goal in skill development? Mastery? A minimal level of performance? How will learners know this?

Learner support

  • what counselling and/or mentoring will learners need to succeed?
  • how will learners get feedback (particularly on skills development)?
  • how will learners relate to other learners so they are mutually supporting?

Resources

  • how much time can I devote to each of the components of a learning environment? What’s the best way to split my time?
  • what help will I get from other teaching staff, e.g. teaching assistants, librarians? What is the best way to use them?
  • what facilities will the learners have available (e.g. learning spaces, online resources)?
  • what technology can the learners use; how should this be managed and organized?

Assessment

  • what types of assessment should be used? (formative, essays, e-portfolios, projects)?
  • how will these measure the content and skills that learners are expected to master?

These questions are meant mainly as examples. Each teacher needs to develop and think about what components will be necessary in their context and how best to provide those components.

For instance, I did not include culture as a component. In some contexts, cultural change is one of the most important goals of education. Negative examples of this might include the culture of privilege encouraged in private British boarding schools, or the attempt to replace indigenous cultures with a western culture, as practiced in Canada with aboriginal residential schools. More positive cultural components may be to encourage inclusivity or ethical behaviour. Again, each teacher should decide on what components are important for their learners.

Necessary but not sufficient

Thinking about and implementing these components may be necessary, but they are not sufficient in themselves to ensure quality teaching and learning. In addition effective teaching still needs:

  • good design
  • empathy for the learners
  • teacher competence (e.g. subject knowledge)
  • imagination to create an effective learning environment.

Conclusions

The learners must do the learning. We need to make sure that learners are able to work within an environment that helps them do this. In other words, our job as teachers is to create the conditions for success.

There are no right or wrong ways to build an effective learning environment. It needs to fit the context in which students will learn. However, before even beginning to design a course or program, we should be thinking of what this learning environment could look like.

Technology now enables us to build a wide variety of effective learning environments. But technology alone is not enough; it needs to include other components for learner success. This is not to say that self-managing learners cannot build their own effective, personal learning environments, but they need to consider the other components as well as the technology.

Questions

  1. What other components would you add to a successful learning environment?
  2. Could you now design a different and hopefully better learning environment for your courses or programs? If so, what would it look like?
  3. Is this a helpful way to approach the design of online learning or indeed any other form of learning?