November 28, 2014

‘Flash’ Design: Flexible designs for the digital age

Listen with webReader
Zen Yoga Chair: Image © Best Interior and Architecture,

Zen Yoga Chair: Image © Best Interior and Architecture

Before I was rudely interrupted by MOOCs, I had almost finished my chapter on Models for Designing Teaching and Learning for my open textbook, ‘Teaching in a Digital Age.‘ I have now finished the last of the design models, which I have called ‘Flash Design’ because it is a new and as yet unestablished approach to course design.

I have to admit going out on a limb with this particular section, because I couldn’t really find any prior literature that adequately describes this approach, and there are elements of other design models that appear in ‘Flash’ design, but I have seen a few examples of it and they are clearly different from other approaches to course design. All this means that I’m really looking for feedback and advice, so here goes.

Scenario E: ETEC 522: Ventures in e-Learning

Mike: Hey, George, come and sit down and tell Allison and Rav about that weird course you’re taking from UBC.

George: Hi, you two. Yeah, it’s a great course, very different from any other I’ve taken.

Rav.: What’s it about?

George: It’s how to go about starting up a technology company.

Allison: But I thought you were doing a masters in education.

George: Yeah, I am. This course is looking at how new technologies can be used in education and how to build a business around one of these technologies.

Mike: Really, George? So what about all your socialist principles, the importance of public education, and all that? Are you giving up and going to become a fat capitalist?

George: No, it’s not like that. What the course is really making me do is think about how we could be using technology better in school or college.

Mike: And how to make a profit out of it, by the sound of it.

Rav.: Shut up, Mike – I’m curious, George, since I’m doing a real business program. You’re going to learn how to set up a business in 13 weeks? Gimme a break.

George: It’s more about becoming an entrepreneur – someone who takes risks and tries something different.

Mike.: With someone else’s money.

George: Do you really want to know about this course, or are you just wanting to give me a hard time?

Allison: Yes, shut up, Mike. Have you chosen a technology yet, George?

George: Almost. We spend most of the course researching and analysing emerging technologies that could have an application in education. We have to find a technology, research it then come up with a plan of how it could be used in education, and how a business could be built around it. But I think the real aim is to get us to think about how technology could improve or change teaching or learning..

Rav.: So what’s the technology you’ve chosen?

George: You’re jumping too far ahead, Rav. We go through two boot camps, one on analysing the edtech marketplace, and one on entrepreneurship: what it takes to be an entrepreneur. Why are you laughing, Mike?

Mike: I just can’t see you in combat uniform, crawling through tubes under gun fire, with a book in your hand.

George: Not that kind of bootcamp. This course is totally online. Our instructor points us in the direction of a few technologies to get us started, but because there’s more stuff coming out all the time, we’re encouraged to make our own choices about what to research. And we all help each other. I must have looked at more than 50 products or services so far, and we all share our analyses. I’m down to possibly three at the moment, but I’m going to have to make my mind up soon, as I have to do a YouTube elevator pitch for my grade.

Rav.: A what?

George: If you look at most of these products, there’s a short YouTube video that pitches the business. I’ve got to make the case for whatever technology I choose in just under eight minutes. That’s going to be 25% of my grade.

Allison: Wow, that’s tough.

George: Well, we all help each other. We have to do a preliminary recording, then everyone pitches in to critique it. Then we have a few days to send in our final version.

Allison: What else do you get grades for?

George: I got 25% of my marks for an assignment that analysed a particular product called Dybuster which is used to help learners with dyslexia. I looked mainly at its educational strengths and weaknesses, and its likely commercial viability. For my second assignment, also worth 25%, we had to build an application of a particular product or service, in my case a module of teaching using a particular product. There were four of us altogether working as  a team to do this. Our team designed a short instructional module that showed a chemical reaction, using an off-the-shelf online simulation tool that is free for people to use. I’ll get my last 25% from an e-portfolio where I’ve collected together my contributions to helping other students on the course with their projects.

Allison: But what I don’t understand is: what’s the curriculum? What text books do you have to read? What do you have to know?

George: Well, there isn’t a set curriculum, except for the two boot camps, and they only take a week each. I’ve already learned a lot, just by searching and analysing different products over the Internet. We have to think about and justify our decisions. What kind of teaching philosophy do they imply? What criteria am I using when I support or reject a particular product? Is this a sustainable tool? I don’t want to have to get rid of good teaching material because the company’s gone bust and doesn’t support the technology I’m using any more. What I’m really learning though is to think about technology differently. Previously I wasn’t really thinking about teaching differently. I was just trying to find a technology that made my life easier. But this course has woken me up to the real possibilities. I feel I’m in a much better position now to shake up my own school and move them into the digital age.

Allison (sighs): Well, I guess that’s the difference between an undergraduate and a graduate course. You couldn’t do this unless you already knew a lot about education, could you?

George: I’m not so sure about that, Allison. It doesn’t seem to have stopped a lot of entrepreneurs from developing tools for teaching!

Mike: George, I’m sorry. I can’t wait for you to become a rich capitalist – it’s your turn to buy the drinks.

Scenario based on a UBC graduate course for the Master in Educational Technology.

The instructors are David Vogt and David Porter, assisted by Jeff Miller, the instructional designer for the course.

6.8.1 Why the need for more flexible design models?

Adamson (2012) states:

The systems under which the world operates and the ways that individual businesses operate are vast and complex – interconnected to the point of confusion and uncertainty. The linear process of cause and effect becomes increasingly irrelevant, and it is necessary for knowledge workers to begin thinking in new ways and exploring new solutions.

In particular knowledge workers must deal with situations and contexts that are volatile, uncertain, complex and ambiguous (what Adamson calls a VUCA environment). This certainly applies to teachers working with ever new, emerging technologies, very diverse students, and a rapidly changing external world that puts pressure on institutions to change.

If we look at course design, how does a teacher respond to rapidly developing new content, new technologies or apps being launched on a daily basis, to a constantly changing student base, to pressure to develop the knowledge and skills that are needed in a digital age? For instance, even setting prior learning outcomes is fraught in a VUCA environment, unless you set them at an abstract ‘skill’ level such as thinking flexibly, networking, and information retrieval and analysis. Students need to develop the key knowledge management skills of knowing where to find relevant information, how to assess, evaluate and appropriately apply such information. This means exposing them to less than certain knowledge and providing them with the skills, practice and feedback to assess and evaluate such knowledge, then apply that to solving real world problems.

In order to do this, learning environments need to be created that are rich and constantly changing, but which at the same time enable students to develop and practice the skills and acquire the knowledge they will need in a volatile, uncertain, complex and ambiguous world.

6.8.2 Core features of flexible design models

Describing the design features is a challenge, for two reasons. First, there is no single approach to flexible design. The whole point of a flexible design is to be adaptable to the circumstances in which it operates. Second, it is only with the development of light, easy to use technology and media in the last few years that instructors and course designers have started to break away from the standard design models, so flexible designs are still emerging.

First, it is important to distinguish this approach from rapid instructional design (Meier, 2000) or rapid prototyping, which are really both streamlined versions of the ADDIE model. Although rapid instructional design/rapid protyping enable courses or modules to be designed more quickly (especially important for corporate training), they still follow the same kind of sequential or iterative processes as in the ADDIE model, but in a more compressed form. Rapid instructional design and rapid prototyping might be considered particular kinds of flexible design, but they lack some of the most important characteristics outlined below:

  • Light and nimble: if ADDIE is a 100-piece orchestra, with a complex score and long rehearsals, then flexible design models are a jazz trio who get together for a single performance then break up until the next time. Although there may be a short preparation time before the course starts, most of the decisions about what will go into the course, what tools will be used, what activities learners will do, and sometimes even how students will be assessed, are decided as the course progresses. On the teaching side, there are usually only a few people involved in the actual design, one or sometimes two instructors and possibly an instructional designer, who nevertheless meet frequently during the offering of the course to make decisions based on feedback from learners and how learners are progressing through the course. However, many more content contributors may be invited – or spontaneously offer – to participate on a single occasion as the course progresses.
  • Content, learner activities, tools used and assessment vary, according to the changing environment. The content to be covered in a course is likely to be highly flexible, based more on emerging knowledge and the interests or prior experience of the learners, although the core skills that the course aims to develop are more likely to remain constant. For instance, for ETEC 522, the overall objective is to develop the skills needed to be a pioneer or innovator in education, and this remains constant over each iteration of the course. However, because the technology is rapidly developing with new products, apps and services every year, the content of the course is quite different from year to year. Also learner activities and methods of assessment are also likely to change, because students can use new tools or technology themselves for learning as they become available. Very often learners themselves seek out and organise much of the core content of the course and are free to choose what tools they use.
  • The design attempts to exploit the affordances of either existing or emerging technologies. Flexible design aims to exploit fully the educational potential of new tools or software, which means sometimes changing at least sub-goals. This may mean developing different skills in learners from year to year, as the technology changes and allows new things to be done. The emphasis here is not so much on doing the same thing better with new technology, but striving for new and different outcomes that are more relevant in a digital world. ETEC 522 for instance did not start with a learning management system. Instead,  a web site, built in WordPress, was used as the starting point for student activities, because students as well as instructors were posting content, but in another year the content focus of the course was mainly on mobile learning, so apps and other mobile tools were strong components of the course.
  • Sound, pedagogical principles guide the overall design of a course – to a point. Just as most successful jazz trios work within a shared framework of melody, rhythm, and musical composition, so is flexible design shaped by overarching principles of best practice. Most successful flexible designs have been guided by core design principles associated with ‘good’ teaching, such as clear learning outcomes or goals, assessment linked to these goals, strong learner support, including timely and individualised feedback, active learning, collaborative learning, and regular course maintenance based on learner feedback, all within a rich learning environment. Sometimes though deliberate attempts are made to move away from an established best practice for experimental reasons, but usually on a small scale, to see if the experiment works without risking the whole course..
  • Experiential, open and applied learning. Usually this kind of course design is strongly embedded in the real, external world. Much or all the course may be open to other than registered students. For instance, a good deal of ETEC 522, such as the final YouTube business pitches, is openly available to those interested in the topics. Sometimes this results in entrepreneurs contacting the course with suggestions for new tools or services, or just to share experience. Another example is a course on Latin American studies from a Canadian university. This particular course had an open, student-managed wiki, where they could discuss contemporary events as they arose. This course was active at the same time that the Argentine government nationalised the Spanish oil company, Repsol. Several students posted comments critical of the government action, but after a week, a professor from a university in Argentina, who had come across the wiki by accident while searching the Internet, responded, laying out a detailed defence of the government’s policy. This was then made a formal topic for discussion within the course. Such courses may though be only partially open. Discussion of sensitive subjects for instance may still take place behind a password controlled discussion forum, while other parts of the course may be open to all.

As experience grows in this kind of design, other and perhaps clearer design principles are likely to emerge.

Strengths and weaknesses of flexible design models

The main advantage of flexible design is that it focuses directly on preparing students for a volatile, uncertain, complex and ambiguous world. It aims explicitly at helping students develop many of the specific skills they will need in a digital age, such as knowledge management, multimedia communications skills, critical thinking, innovation, and digital literacy embedded within a subject domain. Where flexible design has been successfully used, students have found the design approach highly stimulating and great fun, and instructors have been invigorated and enthused with their teaching. Flexible design enables courses to be developed and offered quickly and at much lower initial cost than ADDIE-based approaches.

However, flexible design approaches are very new and have not really been much written about, never mind evaluated. There is no ‘school’ or set of agreed principles to follow. (Maybe it needs a catchy name, which is why, somewhat tongue in cheek, I entitled the chapter: ‘Flash Design.’) The flexible design model though is not however the same as rapid instructional design (Meier, 2000) which is really a boiled down version of the ADDIE approach, but it could be argued that most of the things in flexible design are covered in other teaching models, such as discovery and/or experiential learning. Despite this, innovative instructors are beginning to develop courses such as ETEC 522 and there is a consistency in the basic design principles that give them a certain coherence and shape, even though each course or program appears on the surface to be very different (another example of flexible design, but with quite a different overall program from ETEC 522, is the Integrated Science program at McMaster University.)

Certainly flexible design approaches require confident instructors willing to take a risk, and success is heavily dependent on instructors having a good background in best teaching practices and/or strong instructional design support from innovative and creative instructional designers. Because of the relative lack of experience in such design approaches the limitations are not well identified yet. For instance, this approach can work well with relatively small class sizes but how well will it scale? Successful use probably also depends on learners already having a good foundational knowledge base in the subject domain. Nevertheless I expect more flexible designs for learning to grow over the coming years, because they are more likely to meet the needs of a VUCA world.

Over to you

What I really need here are more examples of flexible learning design. Do you know a course that meets these five design principles? If so please let me know (and a link to the course or course materials would be really appreciated). I would expect that some courses built around open educational resources might reflect this model, for instance.

Now for some more specific questions:

1. Is this design model truly different from others or is it just a variation on other design models? If so which?

2. If you have experience of teaching in this way, can you add to the strengths or weaknesses of this approach and also provide  a short description of the how the course is designed?

3. Do you think a ‘flash’/flexible design approach will increase or undermine academic excellence? What are your reasons?

4. Is ‘Flash Design’ an appropriate name for this design model? Can you suggest a better one?

Next

I will be finalizing the chapter on design models, so I will do a final post that sets out the main conclusion on design models and key takeaways from the chapter.

A ‘starter’ bibliography on MOOCs

Listen with webReader
Image: © educatorstechnology.com, 2014

Image: © educatorstechnology.com, 2014

For the increasing number of students doing Masters’ dissertations or Ph.D’s on MOOCs I have collected together for convenience all the references made in my chapter on MOOCs for my open textbook, ‘Teaching in a Digital World.’ However, there are many other publications – this cannot be considered a comprehensive list. Also note the date of this blog post: anything published after this will not be here, unless you let me know about it.

In return, I would really appreciate other suggestions for references that you have found to be valuable or influential. I’m now less interested in ‘opinion pieces’ but I am looking for more papers that reflect actual experience or research on MOOCs.

Balfour, S. P. (2013). Assessing writing in MOOCs: Automated essay scoring and calibrated peer review. Research & Practice in Assessment, Vol. 8.

Bates, A. (1985) Broadcasting in Education: An Evaluation London: Constables

Bates, A. and Sangrà, A. (2011) Managing Technology in Higher Education San Francisco: Jossey-Bass/John Wiley and Co

Bates, T. (2012) What’s right and what’s wrong with Coursera-style MOOCs Online Learning and Distance Education Resources, August 5

Bayne, S. (2014) Teaching, Research and the More-than-Human in Digital Education Oxford UK: EDEN Research Workshop (keynote: no printed record available)

Blackall, L. (2014) Open online courses and massively untold stories, GoogleDocs

Book, P. (2103) ACE as Academic Credit Reviewer–Adjustment, Accommodation, and Acceptance WCET Learn, July 25

Chauhan, A. (2014) Massive Open Online Courses (MOOCS): Emerging Trends in Assessment and Accreditation Digital Education Review, No. 25

Christensen, C. (2010) Disrupting Class, Expanded Edition: How Disruptive Innovation Will Change the Way the World Learns New York: McGraw-Hill

Christensen, C. and Eyring, H. (2011), The Innovative University: Changing the DNA of Higher Education, New York, New York, USA: John Wiley & Sons,

Christensen, C. and Weise, M. (2014) MOOCs disruption is only beginning, The Boston Globe, May 9

Collins, E. (2013) SJSU Plus Augmented Online Learning Environment Pilot Project Report San Jose CA: The Research and Planning Group for California Colleges

Colvin, K. et al. (2014) Learning an Introductory Physics MOOC: All Cohorts Learn Equally, Including On-Campus Class, IRRODL, Vol. 15, No. 4

Daniel, J. (2012) Making sense of MOOCs: Musings in a maze of myth, paradox and possibility Seoul: Korean National Open University

Dillenbourg, P. (ed.) (1999) Collaborative-learning: Cognitive and Computational Approaches. Oxford: Elsevier

Dillenbourg, P. (2014) MOOCs: Two Years Later, Oxford UK: EDEN Research Workshop (keynote: no printed record available)

Downes, S. (2012) Massively Open Online Courses are here to stay, Stephen’s Web, July 20

Downes, S. (2014) The MOOC of One, Valencia, Spain, March 10

Engle, W. (2104) UBC MOOC Pilot: Design and Delivery Vancouver BC: University of British Columbia

Falchikov, N. and Goldfinch, J. (2000) Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks Review of Educational Research, Vol. 70, No. 3

Firmin, R. et al. (2014) Case study: using MOOCs for conventional college coursework Distance Education, Vol. 35, No. 2

Friedland, T. (2013) Revolution hits the universities, New York Times, January 26

Harasim, L. (2012) Learning Theory and Online Technologies New York/London: Routledge

Haynie, D. (2014). State Department hosts ‘MOOC Camp’ for online learners. US News,January 20

Hernandez, R. et al. (2014) Promoting engagement in MOOCs through social collaboration Oxford UK: Proceedings of the 8th EDEN Research Workshop

Hill, P. (2012) Four Barriers that MOOCs Must Overcome to Build a Sustainable Model e-Literate, July 24

Ho, A. et al. (2014) HarvardX and MITx: The First Year of Open Online Courses Fall 2012-Summer 2013 (HarvardX and MITx Working Paper No. 1), January 21

Hollands, F. and Tirthali, D. (2014) MOOCs: Expectations and Reality New York: Columbia University Teachers’ College, Center for Benefit-Cost Studies of Education

Hülsmann, T. (2003) Costs without camouflage: a cost analysis of Oldenburg University’s  two graduate certificate programs offered  as part of the online Master of Distance Education (MDE): a case study, in Bernath, U. and Rubin, E., (eds.) Reflections on Teaching in an Online Program: A Case Study Oldenburg, Germany: Bibliothecks-und Informationssystem der Carl von Ossietsky Universität Oldenburg

Jaschik, S. (2013) MOOC Mess, Inside Higher Education, February 4

Knox, J. (2014) Digital culture clash: ‘massive’ education in the e-Learning and Digital Cultures Distance Education, Vol. 35, No. 2

Kop, R. (2011) The Challenges to Connectivist Learning on Open Online Networks: Learning Experiences during a Massive Open Online Course International Review of Research into Open and Distance Learning, Vol. 12, No. 3

Lave, J. and Wenger, E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge: Cambridge University Press

Lyotard, J-J. (1979) La Condition postmoderne: rapport sur le savoir: Paris: Minuit

Mackness, J. (2013) cMOOCs and xMOOCs – key differences, Jenny Mackness, October 22

Milligan, C., Littlejohn, A. and Margaryan, A. (2013) Patterns of engagement in connectivist MOOCs, Merlot Journal of Online Learning and Teaching, Vol. 9, No. 2

Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., & Koller, D. (2013). Tuned models of peer assessment in MOOCs. Palo Alto, CA: Stanford University.

Rumble, G. (2001) The costs and costing of networked learning, Journal of Asynchronous Learning Networks, Vol. 5, No. 2

Suen, H. (2104) Peer assessment for massive open online courses (MOOCs) International Review of Research into Open and Distance Learning, Vol. 15, No. 3

Tapscott, D. (undated) The transformation of education dontapscott.com

University of Ottawa (2013) Report of the e-Learning Working Group Ottawa ON: The University of Ottawa

van Zundert, M., Sluijsmans, D., van Merriënboer, J. (2010). Effective peer assessment processes: Research findings and future directions. Learning and Instruction, 20, 270-279

Watters, A. (2012) Top 10 Ed-Tech Trends of 2012: MOOCs Hack Education, December 3

Yousef, A. et al. (2014) MOOCs: A Review of the State-of-the-Art Proceedings of 6th International Conference on Computer Supported Education – CSEDU 2014, Barcelona, Spain

Note:

I’m glad I called this a ‘starter’ list. See the comment section for many more references, but especially Katy Morgan’s MOOC Research Literature Browser, which has many more articles published in peer review journals. Thanks to Jim Ellis, UKOU, for directing me to this, and above all to Katy Morgan for doing a much more thorough coverage of the literature than I have.

Thanks also to all the others who have made suggestions for this list.

Why MOOCs are only part of the answer for higher education

Listen with webReader
Formal education is the necessary launchpad for successful MOOCs

Formal education is the necessary launchpad for successful MOOCs

OK, except for the next post, which will be a list of publications on MOOCs for graduate students studying the topic, and a scenario for a ‘good’ MOOC, this will be my last post on MOOCs for a while.

This is the conclusion to my chapter on MOOCs for my open textbook, ‘Teaching in a Digital Age‘. This whole chapter is now published here. There will be a scenario illustrating what I define as a ‘good’ MOOC to go with this conclusion. Here is the extract:

The importance of context and design

I am frequently categorised as a major critic of MOOCs, which is somewhat surprising since I have been a longtime advocate of online learning. In fact I do believe MOOCs are an important development, and under certain circumstances they can be of tremendous value in education.

But as always in education, context is important. There is not one but many different markets and needs for education. A student leaving high school at eighteen has very different needs and will want to learn in a very different context from a 35 year old employed engineer with a family who needs some management education. Similarly a 65 year old man struggling to cope with his wife’s early onset of Alzheimers and desperate for help is in a totally different situation to either the high school student or the engineer. When designing educational programs, it has to be horses for courses. There is no single silver bullet or solution for every one of these various contexts.

Secondly, as with all forms of education, how MOOCs are designed matters a great deal. If they are designed inappropriately, in the sense of not developing the knowledge and skills needed by a particular learner in a particular context, then they have little or no value for that learner. However, designed differently and a MOOC may well meet that learner’s needs.

The potential of cMOOCs

So let me be more specific. cMOOCs have the most potential, because lifelong learning will become increasingly important, and the power of bringing a mix of already well educated and knowledgeable people from around the world to work with other committed and enthusiastic learners on common problems or areas of interest could truly revolutionise not just education, but the world in general.

However, cMOOCs at present are unable to do this, because they lack organisation and do not apply what is already known about how online groups work best. Once we learn these lessons and apply them, though, cMOOCs can be a tremendous tool for tackling some of the great challenges we face in the areas of global health, climate change, civil rights, and other ‘good civil ventures.’  The beauty of a cMOOC is that they involve not just the people who have the will and the power to make changes, but cMOOCs give every participant the power to define and solve the problems being tackled.

But socially transformative MOOCs will almost certainly benefit from the resources of strong institutions to provide initial impetus, simple to use software, overall structure, organization and co-ordination within the MOOC, and some essential human resources for supporting the MOOC when running. At the same time, it does not have to be an educational institution. It could be a Public Health Authority, or a broadcasting organization, or an international charity, or a consortium of organisations with a common interest. Also, of course, we need to recognise the danger that even cMOOCs  could be manipulated by corporate or government  interests. Finally, I don’t see cMOOCs as being a replacement for formal education, but as a rocket that needs formal education as its launch pad.

The limitations of xMOOCs

The real threat of xMOOCs is to the very large face-to-face lecture classes found in many universities at the undergraduate level. MOOCs, at a cost of around $20-$50 a student, are a more effective way of replacing such lectures. They are more interactive and permanent so students can go over the materials many times. I have heard MOOC instructors argue that their MOOCs are better than their classroom lectures. They put more care and effort into them.

However, we should question why we are teaching in this way on campus. Content is now freely available anywhere on the Internet – including MOOCs. What is needed is information management: how to identify the knowledge you need, how to evaluate it, how to apply it. MOOCs do not do that. They pre-select and package the information. My big concern with xMOOCs is their limitation, as currently designed, for developing the higher order intellectual skills needed in a digital world. Unfortunately, xMOOCs are taking the least appropriate design model for developing 21st century skills from on-campus teaching,  and moving this inappropriate design model online. Just because the lectures come from elite universities does not necessarily mean that learners will develop high level intellectual skills, even though the content is of the highest quality. More importantly, with MOOCs, relatively few students succeed, in terms of assessment, and those that do are tested mainly on comprehension and limited application of knowledge.

We can and have done much better in terms of skills for a digital age with other pedagogical approaches on campus, such as problem- or inquiry-based learning, and with online learning using more constructivist approaches in online credit courses, but these alternative methods to lectures do not scale so easily. The interaction between an expert and a novice still remains critical for developing deep understanding, transformative learning resulting in the learner seeing the world differently, and for developing high levels of evidence-based critical thinking, evaluation of complex alternatives, and high level decision-making. Computer technology to date is extremely poor at enabling this kind of learning to develop. This is why credit-based classroom and online learning still aim to have a relatively low instructor:student ratio and still need to focus a great deal on interaction between instructor and students.

I have no problem however with xMOOCs as a form of continuing education or as a source of open educational materials that can be part of a broader educational offering. They can be a valuable supplement to campus-based education. It is when the claim is made that they can replace both conventional education or the current design of online credit programs when I become really concerned. As a form of continuing education, low completion rates and the lack of formal credit is not of great significance. However, completion rates and quality assessment DO matter if MOOCs are being seen as a substitute or a replacement for formal education, even classroom lectures.

Undermining the public higher education system?

The real danger is that if we are not vigilant, MOOCs will undermine what is admittedly an expensive public higher education system. If elite universities can deliver MOOCs for free, why do we need crappy state universities? The risk is a sharply divided two tier system, with a relatively small number of elite universities catering to the rich and privileged, and developing the knowledge and skills that will provide rich rewards, and the masses going to MOOC-delivered courses with state universities providing minimal and low cost learner support for such courses. This would be both a social and economic disaster, because it would fail to produce enough learners with the high-level skills that are going to be needed for good jobs in the the coming years – unless you believe that automation will remove all decently paid jobs except for a tiny elite (bring on the Hunger Games).

It should be noted that even for credit-based online programs, content accounts for less than 15 per cent of the total cost over five years; the main costs required to ensure high quality outcomes and high rates of completion are spent on learner support, providing the learning that matters most. The kind of MOOCs being promoted by politicians and the media fail spectacularly to do this. We do need to be careful that the open education movement in general, and MOOCs in particular, are not used as a stick by those in the United States and elsewhere who are deliberately trying to undermine public education for ideological and commercial reasons. Open content, OERs and MOOCs do not automatically lead to open access to high quality credentials for everyone. In the end, a well-funded public higher education system remains the best way to assure access to higher education for the majority of the population.

Having said that, there is enormous scope for improvements within that system. MOOCs, open education and new media offer promising ways to bring about some much needed improvements. However, that means building on what we already know from the use of credit based online learning, from prior experience in open and distance learning, and designing courses and programs in a variety of ways appropriate to the wide range of learning needs. MOOCs can be one important part of that environment, but not a replacement for other forms of educational provision that meet different needs.

Key Takeaways

1. MOOCs are forcing every higher education institution to think carefully both about its strategy for online teaching and its approach to open education.

2. MOOCs are not the only form of online learning or of open educational resources. It is important to look at the strengths and weaknesses of MOOCs within the overall context of online learning and open-ness.

3. There are considerable differences in the design of MOOCs, reflecting different purposes and philosophies.

4. MOOCs are at still a relatively early stage of maturity. As their strengths and weaknesses become clearer, and as experience in improving their design grows, they are likely to occupy a significant niche within the higher education learning environment.

5. There are still major structural limitations in MOOCs for developing deep or transformative learning, or for developing the high level knowledge and skills needed in a digital age.

6. MOOCs could well replace some forms of traditional teaching (such as large lecture classes). However, MOOCs are more likely to remain an important supplement or alternative to other conventional education methods. They are not on their own a solution to the high cost of higher education, although MOOCs are and will continue to be an important factor in forcing change.

7. Perhaps the greatest value of MOOCs in the future will be for providing a means for tackling large global problems through community action.

Next

I am now trying to finish Chapter 6, on design models. I will be writing about (a) personal learning environments and (b) flexible design models based on sound educational design principles.

As always, I welcome comments on either this final section on MOOCs, or on the Chapter as a whole. You can use either the comment page here or the one at the end of the Chapter.

EDEN research papers: OERs (inc. MOOCs), quality/assessment, social media, analytics and research methods

Listen with webReader

EDEN RSW me 2

EDEN has now published a second report on my review of papers submitted to the EDEN research workshop in Oxford a couple of weeks ago. All the full papers for the workshop can be accessed here.

Main lessons (or unanswered questions) I took away:

OERs and MOOCs

  • what does awarding badges of certificates for MOOCs or other OER actually mean? For instance will institutions give course exemption or credits for the awards, or accept such awards for admission purposes? Or will the focus be on employer recognition? How will participants who are awarded badges know what their ‘currency’ is worth?
  • can MOOCs be designed to go beyond comprehension or networking to develop other critical 21st century skills such as critical thinking, analysis and evaluation? Can they lead to ‘transformational learning’ as identified by Kumar and Arnold (see Quality and Assessment below)
  • are there better design models for open courses than MOOCs as currently structured? If so what would they look like?
  • is there a future for learning object repositories when nearly all academic content becomes open and online?

Quality and assessment

  • research may inform but won’t resolve policy issues
  • quality is never ‘objective’ but is value-driven
  • the level of intervention must be long and significant enough to result in significant learning gains
  • there’s lots of research already that indicates the necessary conditions for successful use of online discussion forums but if these conditions are not present then learning will not take place
  • the OU’s traditional model of course design constrains the development of successful collaborative online learning.

Use of social media in open and distance learning

There were surprisingly few papers on this topic. My main takeaway:

  • the use of social media needs to be driven by sound pedagogical theory that takes into account the affordances of social media (as in Sorensen’s study described in an earlier post under course design)

Data analytics and student drop-out

  • institutions/registrars must pay attention to how student data is tagged/labeled for analytic purposes, so there is consistency in definitions, aggregation and interpretation;
  • when developing or applying an analytics software program, consideration needs to be given to the level of analysis and what potential users of the data are looking for; this means working with instructional designers, faculty and administrators from the beginning
  • analytics need to be integrated with action plans to identify and support early at risk students

Research methods

Next

If these bullets interest you at all, then I strongly recommend you go and read the original papers in full – click here. My summary is of necessity personal and abbreviated and the papers provide much greater richness of context.

 

 

Why the fuss about MOOCs? Political, social and economic drivers

Listen with webReader
Daphne Koller's TED talk on MOOCs (click to activate video)

Daphne Koller’s TED talk on MOOCs (click to activate video)

The end of MOOCs

This is the last part of my chapter on MOOCs for my online open textbook, Teaching in a Digital Age. In a series of prior posts, I have looked at the strengths and weaknesses of MOOCs. Here I summarise this section and look at why MOOCs have gained so much attention.

Brief summary of strengths and weaknesses of MOOCs

The main points of my analysis of the strengths and weaknesses of MOOCs can be summarised as follows:

Strengths

  • the main value proposition of MOOCs is that through the use of computer automation and/or peer-to-peer communication MOOCs can eliminate the very large variable costs in higher education associated with providing learner support and quality assessment
  • MOOCs, particularly xMOOCs, deliver high quality content from some of the world’s best universities for free to anyone with a computer and an Internet connection
  • MOOCs can be useful for opening access to high quality content, particularly in Third World countries, but to do so successfully will require a good deal of adaptation, and substantial investment in local support and partnerships
  • MOOCs are valuable for developing basic conceptual learning, and for creating large online communities of interest or practice
  • MOOCs are an extremely valuable form of lifelong learning and continuing education
  • MOOCs have forced conventional and especially elite institutions to reappraise their strategies towards online and open learning
  • institutions have been able to extend their brand and status by making public their expertise and excellence in certain academic areas

Weaknesses

  • the high registration numbers for MOOCs are misleading; less than half of registrants actively participate, and of these, only a small proportion successfully complete the course; nevertheless, absolute numbers of successful participants are still higher than for conventional courses
  • MOOCs are expensive to develop, and although commercial organisations offering MOOC platforms have opportunities for sustainable business models, it is difficult to see how publicly funded higher education institutions can develop sustainable business models for MOOCs
  • MOOCs tend to attract those with already a high level of education, rather than widen access
  • MOOCs so far have been limited in the ability to develop high level academic learning, or the high level intellectual skills needed in a knowledge based society
  • assessment of the higher levels of learning remains a challenge for MOOCs, to the extent that most MOOC providers will not recognise their own MOOCs for credit
  • MOOC materials may be limited by copyright or time restrictions for re-use as open educational resources

Why the fuss about MOOCs?

It can be seen from the previous section that the pros and cons of MOOCs are finely balanced. Given though the obvious questions about the value of MOOCs, and the fact that before MOOCs arrived, there had been substantial but quiet progress for over ten years in the use of online learning for undergraduate and graduate programs, you might be wondering why MOOCs have commanded so much media interest, and especially why a large number of government policy makers, economists, and computer scientists have become so ardently supportive of MOOCs, and why there has been such a strong, negative reaction, not only from many traditional university and college instructors, who are right to be threatened by some of the claims being made for MOOCs, but also from many professionals in online learning (see for instance, Bates, 2012; Daniel, 2012; Hill, 2012; Watters, 2013), who might be expected to be more supportive of MOOCs

It needs to be recognised that the discourse around MOOCs is not usually based on a cool, rational, evidence-based analysis of the pros and cons of MOOCs, but is more likely to be driven by emotion, self-interest, fear, or ignorance of what education is actually about. Thus it is important to explore the political, social and economic factors that have driven MOOC mania.

Massive, free and Made in America!

This is what I will call the intrinsic reason for MOOC mania. It is not surprising that, since the first MOOC from Stanford professors Andrew Ng and Daphne Koller attracted 270,000 sign-ups from around the world, since the course was free, and since it came from professors at one of the most prestigious private universities in the USA, the American media were all over it. It was big news in its own right, however you look at it, especially as courses from Sebastian Thrun, another Stanford professor, and others from MIT and Harvard followed shortly, with equally staggering numbers of participants.

It’s the Ivy Leagues!

Until MOOCs came along, the major Ivy League universities in the USA, such as Stanford, MIT, Harvard and UC Berkeley, as well as many of the most prestigious universities in Canada, such as the University of Toronto and McGill, and elsewhere, had largely ignored online learning in any form.

However, by 2011, online learning, in the form of for credit undergraduate and graduate courses, was making big inroads at many other, very respectable universities, such as Carnegie Mellon, Penn State, and the University of Maryland in the USA, and also in many of the top tier public universities in Canada and elsewhere, to the extent that almost one in three course enrolments in the USA were now in online courses. Furthermore, at least in Canada, the online courses were often getting good completion rates and matching on-campus courses for quality.

The Ivy League and other highly prestigious universities that had ignored online learning were beginning to look increasingly out of touch by 2011. By launching into MOOCs, these prestigious universities could jump to the head of the queue in terms of technology innovation, while at the same time protecting their selective and highly personal and high cost campus programs from direct contact with online learning. In other words, MOOCs gave these prestigious universities a safe sandbox in which to explore online learning, and the Ivy League universities gave credibility to MOOCs, and, indirectly, online learning as a whole.

It’s disruptive!

For years before 2011, various economists, philosophers and industrial gurus had been predicting that education was the next big area for disruptive change due to the march of new technologies (see for instance Lyotard, 1979; Tapscott, undated; Christensen and Eyring, 2011).

Online learning in credit courses though was being quietly absorbed into the mainstream of university teaching, through blended learning, without any signs of major disruption, but here with MOOCs was a massive change, providing evidence at long last in the education sector to support the theories of disruptive innovation.

It’s Silicon Valley!

It is no coincidence that the first MOOCs were all developed by entrepreneurial computer scientists. Ng and Koller very quickly went on to create Coursera as a private commercial company, followed shortly by Thrun, who created Udacity. Anant Agarwal, a computer scientist at MIT, went on to head up edX.

The first MOOCs were very typical of Silicon Valley start-ups: a bright idea (massive, open online courses with cloud-based, relatively simple software to handle the numbers), thrown out into the market to see how it might work, supported by more technology and ideas (in this case, learning analytics, automated marking, peer assessment) to deal with any snags or problems. Building a sustainable business model would come later, when some of the dust had settled.

As a result it is not surprising that almost all the early MOOCs completely ignored any pedagogical theory about best practices in teaching online, or any prior research on factors associated with success or failure in online learning. It is also not surprising as a result that a very low percentage of participants actually successfully complete MOOCs – there’s a lot of catching up still to do, but so far Coursera and to a lesser extent edX have continued to ignore educators and prior research in online learning. They would rather do their own research, even if it means re-inventing the wheel. The commercial MOOC platform providers though are beginning to work out a sustainable business model.

It’s the economy, stupid!

Of all the reasons for MOOC mania, Bill Clinton’s famous election slogan resonates most with me. It should be remembered that by 2011, the consequences of the disastrous financial collapse of 2008 were working their way through the economy, and particularly were impacting on the finances of state governments in the USA.

The recession meant that states were suddenly desperately short of tax revenues, and were unable to meet the financial demands of state higher education systems. For instance, California’s community college system, the nation’s largest, suffered about $809 million in state funding cuts between 2008-2012, resulting in a shortfall of 500,000 places in its campus-based colleges. Free MOOCs were seen as manna from heaven by the state governor, Jerry Brown.

One consequence of rapid cuts to government funding was a sharp spike in tuition fees, bringing the real cost of higher education sharply into focus. Tuition fees in the USA have increased by 7% per annum over the last 10 years, compared with an inflation rate of 4% per annum. Here at last was a possible way to rein in the high cost of higher education.

Now though the economy in the USA is picking up and revenues are flowing back into state coffers, and so the pressure for more radical solutions to the cost of higher education is beginning to ease. It will be interesting to see if MOOC mania continues as the economy grows, although the search for more cost-effective approaches to higher education is not going to disappear.

Don’t panic!

These are all very powerful drivers of MOOC mania, which makes it all the more important to try to be clear and cool headed about the strengths and weaknesses of MOOCs. The real test is whether MOOCs can help develop the knowledge and skills that learners need in a knowledge-based society. The answer of course is yes and no.

As a low-cost supplement to formal education, they can be quite valuable, but not as a complete replacement. They can at present teach conceptual learning, comprehension and in a narrow range of activities, application of knowledge. They can be useful for building communities of practice, where already well educated people or people with a deep, shared passion for a topic can learn from one another, another form of continuing education.

However, certainly to date, MOOCs have not been able to demonstrate that they can lead to transformative learning, deep intellectual understanding, evaluation of complex alternatives, and evidence-based decision-making, and without greater emphasis on expert-based learner support and more qualitative forms of assessment, they probably never will, at least without substantial increases in their costs.

At the end of the day, there is a choice between throwing more resources into MOOCs and hoping that some of their fundamental flaws can be overcome without too dramatic an increase in costs, or whether we would be better investing in other forms of online learning and educational technology that could lead to more cost-effective learning outcomes. I know where I would put my money, and it’s not into MOOCs.

Over to you

This will be my last contribution to the discussion of MOOCs for my book, so let’s have it!

1. Do you agree with the strengths and weaknesses of MOOCs that I have laid out? What would you add or remove or change?

2. What do you think of the drivers of MOOC mania? Are these accurate? Are there other, more important drivers of MOOC mania?

3. Do you even agree that there is a mania about MOOCs, or is their rapid expansion all perfectly understandable?

References

Bates, T. (2012) What’s right and what’s wrong about Coursera-style MOOCs, Online learning and distance education resources, August 5

Christensen, C. and Eyring, H. (2011), The Innovative University: Changing the DNA of Higher Education, New York, New York, USA: John Wiley & Sons,

Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox and possibility.Journal of Interactive Media in Education, Vol. 3

Hill, P. (2012) Four Barriers that MOOCs must overcome to build a sustainable model, e-Literate, July 24

Lyotard, J-J. (1979) La Condition postmoderne: rapport sur le savoir: Paris: Minuit

Tapscott, D. (undated) The transformation of education dontapscott.com

Watters, A. (2013) MOOC Mania: Debunking the hype around massive, open online courses The Digital Shift, 18 April