March 30, 2017

Next steps for the European HE system

The University of Siena: founded in 1240, but is it still relevant today?

The University of Siena: founded in 1240, but is it still relevant today?

Klemenčič, M. and Ashwin, P. (2015) What’s next for Europe? Inside Higher Ed, May 26

As my holiday in Italy draws to a close, I thought it would be appropriate to do a short blog on developments in European higher education. I look to my many readers in Europe to comment and correct me as appropriate.

What the article is about

This is an interesting article about future policy for European Higher Education, following the Bologna Process Ministerial Conference on May 14-15 in Yerevan, Armenia. (Sigh! Yes, you are right, Armenia is not yet part of the European Union, but it is a member of the Council of Europe, and, since 2005 has been part of the Bologna Process, which sets out pan-European strategy for higher education.)

This article gives a pretty good overview of what the Bologna Process has achieved to date, and also what it has not achieved, and also gives a good description of where European education ministers want to go in the future, in terms of pan-European policy.

The achievements of the Bologna Process

The Bologna Process is:

a voluntary convergence and coordinated reform of higher education systems across the member countries of the European Union and beyond. The aims have been to promote the mobility of students and staff and to enhance the quality and international competitiveness of European higher education.

The European Higher Education Area (EHEA) now has 48 members, including non-European Union countries such as the Russian Federation, Belarus, Armenia and the Ukraine.

Its successes include:

  • a common three-cycle degree structure across countries;
  • student mobility: students can transfer course credits acquired at one institution to any another institution in the EHEA;
  • European Standards and Guidelines for Quality Assurance and the European Register of Quality Assurance Agencies, ensuring that all countries have compatible internal and external quality assurance procedures.

This of course raises the question: If the Europeans can enable students to transfer seamlessly between 4,000 higher education institutions across Europe and beyond (and they do, in droves), why is it so difficult to do this in Canada, and particularly within Ontario, for God’s sake?

One of the great scandals of Canadian higher education is the refusal of Ontario universities or the Ontario government to put in place any form of automatic transfer of credits. (Yeah, there are seven universities in Ontario that have a paper agreement amongst themselves, but the reality is that it is NOT an automatic process even between these seven institutions).

BC and Alberta have had a mutual transfer system in place for many years, but the only thing more difficult than moving from a university in BC (or from anywhere else in Canada) to a university in Ontario is taking a bottle of BC wine with you to Ontario (yes, that is actually illegal in Canada). Talk about provincialism.

The challenges of the Bologna Process

Like anything to do with the European Union, excessive bureaucracy is a major challenge. In particular, to quote from the article:

much of the energy of the Bologna Follow-Up Group, the governing body of the process, has been channeled into detailed questions about decision structures and processes. The Bologna Process needed a new sense of purpose to bring the governments together and re-energize international cooperation within the EHEA. And this indeed happened [at the Yerevan conference].

What’s driven this new sense of purpose is youth unemployment:

The unemployment rate for people 29 and younger in the European Union is 19 percent, the highest in at least 10 years. In Spain, the figure was 53 percent in November 2014; it was 49 percent, in Greece, followed closely by Croatia and Italy. Higher education is seen as one key pillar in Europe’s vision to fight unemployment among young people, preventing them from becoming a “lost generation” and source of social upheaval. The communiqué emphasizes the need to ensure that graduates possess competencies that will make them employable.

The article lists several ways this is to be done, such as:

  • a better dialogue between higher education institutions and employers,
  • a good balance between theoretical and practical components in curricula, and
  • continued support for international mobility for study and work placement.

The authors though acknowledge that:

higher education alone, of course, cannot solve the problem that is so clearly linked to economic growth and also labor regulations.

They might also have mentioned the failed economic policy of austerity, which is a major cause of youth unemployment in Europe.

A second objective is to make European higher education more inclusive. A particular concern is the low participation rate of immigrants from the Middle East and Africa in European higher education, and the possible radicalization of immigrant youth:

three types of mobility are accentuated in the communiqué: for students and staff from conflict areas, students from disadvantaged backgrounds, and mobility of teacher education students.

The third objective is to improve the quality of teaching and learning in universities and colleges. The authors note that it is surprising that it has taken so long for this to emerge as a priority for this first time at the Armenia conference:

..the quality of teaching and learning is far from satisfactory and varies significantly across European systems and institutions…the majority of countries do not have a strategy for the advancement of teaching and learning or specific structures to support it. At best, higher education institutions are developing their own units for supporting excellence in teaching and learning or funding teaching development programs. At worse, higher education teachers are left to their own devices to improve their teaching (or not) when alerted by the outcomes of student satisfaction surveys.

In Yerevan, the ministers have committed to support higher education institutions in pedagogical innovation, exploring the use of digital technologies for learning and teaching, and in better linking learning and teaching with research, innovation and entrepreneurship. You have to wonder though why it took almost 20 years to get these items on the agenda.

What next?

The authors of the article are surprisingly optimistic that these new policies will be successfully implemented by the governments of member states. However, by 2018, the set target gate for implementation, both Greece and Britain may well have left the European Union, and I will be surprised if countries such as Italy, the Ukraine and Bulgaria will have made much progress towards these objectives, because of structural and economic difficulties.

Nevertheless, on balance, despite the stifling bureaucracy of the European Union, and the political and economic challenges faced by many European countries, the Bologna Process has enabled many European universities to improve their standards and to modernise, and is likely to continue to do so into the future.

One of the University of Siena's student computer labs

One of the University of Siena’s student computer labs

Update on online learning in Africa

One of the AVU’s new distance-learning centres is launched at the University of Education, Winneba in Ghana. Photograph: AVU

One of the AVU’s new distance-learning centres is launched at the University of Education, Winneba in Ghana. Photograph: AVU

Anderson, M. (2015) Out of Africa: e-learning makes further education a reality for tens of thousands The Guardian, May 20

The opening this week of the 10th e-Learning Africa international conference prompted this informative report by the British newspaper, the Guardian, about the state of virtual learning in Africa. I have used this to pull together a number of different strands about online learning developments in Africa.

The e-Learning Africa conference

Only 6% of Africans continue to any form of higher education (compared with a world average of 26%). Thus this year’s e-Learning Africa conference is particularly significant as it is taking place in Addis Ababa, the HQ of the African Union,which has prioritized virtual learning in its long-term development strategy.The conference is also hosted by the government of Ethiopia. Rebecca Stromeyer, one of the driving forces behind e-Learning Africa, has done a tremendous job in using the conference to promote the development of virtual and online learning in Africa.

The African Virtual University

The African Virtual University, a Pan African Intergovernmental Organization established by charter with the mandate of significantly increasing access to quality higher education and training through the innovative use of information communication technologies, is a major force in promoting virtual learning in Africa.

It is still relatively small in terms of student numbers, with a total of 43,000 students since it started in 1997. So far, 19 African countries signed a charter establishing AVU as an intergovernmental organisation. The AVU offered its first MOOC to 1,700 African students in March this year. Perhaps more significantly it is opening 29 new distance learning centres in 21 African countries at a cost of $200,000 each.

The AVU at the moment does not offer its own degrees, but works in partnership with other African universities to deliver online programs across Africa, sometimes in partnership also with foreign universities such as Indiana University in the USA and Laval University in Canada. AVU plans to start offering its own degrees next year.

UNISA

South Africa has been a leader in distance education in Africa for many years, with over 300,000 students a year currently enrolled in UNISA (the University of South Africa), but although it has some programs offered online, it has been somewhat reluctant to invest heavily in online technologies, because as an open university it has been concerned with the high cost and difficulties of access to the Internet for many Africans.

However, the AVU is considering making lectures accessible on mobile phones, which would tap into Africa’s estimated 112-million smartphones, and UNISA will need to move more quickly if it is to stay relevant in South African online and open education..

Fibre optics

Another major factor that is impacting on virtual learning in Africa is the spread of fibre optics. The first map shows the submarine networks and their international links and the second shows the internal, terrestrial fibre optic networks.

African submarine fibre optic networks Image: © African Politics Portal, 2010

African submarine fibre optic networks
Image: © African Politics Portal, 2010 

African terrestrial fibre optic networks Image: AfTerFibre: https://manypossibilities.net/afterfibre/

African terrestrial fibre optic networks
Image: AfTerFibre: https://manypossibilities.net/afterfibre/

The key factor here is capacity. Fibre optics enable much higher Internet speeds and bandwidth than mobile technologies (although of course the two will be used in combination) but the end result will be much cheaper Internet connectivity in Africa in the coming years.

Comment

I hesitate to suggest solutions for Africa – I’m too far away and the best solutions will be African originated. However, here’s my opinion, for what it’s worth.

Those institutions and organisations that are moving now into virtual learning will have a major competitive advantage as Internet access widens and the cost of access drops dramatically. Bakary Diallo, the rector of the AVU, believes that the AVU can drive down the cost of higher education in Africa, without losing quality. Timing will be critical though – too early a move and the large market will not be ready; too late and other providers will have moved in.

The key challenges though will be the following:

  • appropriate content: African developed OERs (such as OER Africa’s and the OERu’s) will be an essential component of a low cost, high quality, virtual learning system in Africa; at the same time, actual courses and programs available online will also be critically important and this will need substantial investment, mainly in teachers and instructional designers;
  • political recognition of the integrity and quality of virtual learning: African politicians have been very conservative in the past in recognising the value of online and distance learning. Nigeria, the major economic nation now in Africa, for instance, has almost no publicly funded online learning at a higher education level., because the government won’t recognise such qualifications. It is good that 19 countries have signed on to the AVU and the African Union has made virtual learning a priority. This though now has to be accepted by other African countries, and policies and strategies for virtual learning and above all recognition of qualifications now need rapid implementation by African governments;
  • institutional management. Even in highly developed countries, university administrators have struggled to manage well the development and maintenance of online learning. African universities will struggle even more with this challenge;
  • lack of qualified professionals: Africa has few professional instructional designers, although countries such as Kenya do have very good IT professionals and web designers. However, the private sector can offer much better salaries;
  • lack of funding: there is a high cost of investment in adopting online learning, and it will take political courage to put aside the funds needed at the level of magnitude to drive real change. However, this is no longer impossible for many African countries such as Nigeria, South Africa and Kenya, whose economies are rapidly growing. It is therefore more a question of political will than resources, for at least some African countries, although others will take much longer to catch up;
  • corruption: this has two aspects, open corruption, where government funds for online learning are diverted to individuals (usually politicians, but also sometimes local administrators), but probably much more significant will be the influence of major technology-based multinational corporations, who will lobby for money to be spent on (their) technology rather than on the human resources needed to sustain online learning (i.e. well qualified teachers).

Lastly, the challenge for Africa is to walk two paths at the same time. Online learning should not be used as a replacement for a high quality campus-based higher education system but as an integral part of a comprehensive system of higher education that includes face-to-face teaching, blended learning and fully online learning. Getting that balance right will be a mjor challenge.

Overall, though, I am very optimistic that the future belongs to Africa, and that online learning will be a critical component of that future.

Choosing a ‘good’ post-secondary online learning program

woman at computer 2

I am constantly asked to recommend ‘good’ online learning programs. This is a difficult question to answer, as it’s impossible for any single person to know all the good online programs, and in any case, any selection is going to be highly subjective. However, it is possible to suggest a set of criteria or questions to help you in your decision, if you are thinking of taking an online program.

Criteria for selection

1. What prior qualifications do I need in order to take this program? Although courses may be online, they are not necessarily open. Generally high school completion is the minimum level of qualification for admission for a college or university online program, or a bachelor’s degree for graduate programs, except for open universities (see below).

2. What is the general status of the offering institution, for example, is it an accredited school with a generally good reputation?

3. Experience in online learning: how long has it been offering online programs? Institutions, like people, get better with practice.

4. The size of the operation: does it have many online courses, whole online programs, and lots of online students? If it does it is likely to have good systems in place to support online learning. On the other hand, if it’s grown very rapidly, it may have cut corners on quality.

5. Does any tenured or full-time instructor have overall responsibility for the course or program? If not, it is likely to be primarily a money-making operation for the institution.

6. What is the instructor:student ratio? Will students be taught by full-time faculty, adjunct faculty or teaching assistants? (I have no problem with adjunct faculty, so long as they are well qualified academically and responsible to a full-time faculty member, but beware of courses taught online by teaching assistants or unqualified ‘tutors’.)  Do instructors or faculty receive any training in teaching online? (This is especially important for contract or adjunct instructors.)

7. Do you personally know anything about the program? Have you studied any of their online courses – or on-campus courses for that matter? Do you know the people managing the online program?

8. What do students think about the program? What’s the completion rate? (Well designed online courses should have a successful completion rate of above 80%, and for a whole program, more than half of those who start the program should complete it.)

9. How expensive is it? Can I afford it? Will I be eligible for grants or student loans if I take this program?

10. What can I do with the qualification? Can I transfer the credits from an online course into an on-campus program? Will the qualification be recognised by any appropriate professional or accrediting agency?

My recommendation to anyone considering an online course or program is to apply the above criteria to any course or program you are interested in. Any self-respecting institution should be able to answer these questions, through the program web site, or by your calling the office that supports the program. Getting answers to these ten questions is more likely to enable you to find the right course than any recommendation I may make about individual courses or programs.

Personal recommendations

Nevertheless, I’m willing to stick my neck out, based mainly on my personal knowledge, but caveat emptor: you are responsible for your own decisions, so don’t blame me if one of these recommendations doesn’t work out for you. And just because I haven’t mentioned a particular institution doesn’t mean that it has poor quality programs – there are too many good programs to list them all.

1. Publicly funded dual mode institutions

These are publicly funded and accredited institutions that offer both on-campus and distance teaching, and usually have done so for many years. Typical examples are the land grant universities in the USA, which were established originally with state-wide responsibilities, e.g. Penn State’s World Campus, the University of Wisconsin System eCampus, and the University of New Mexico Online. These online courses and programs carry exactly the same weight as their on-campus courses. In Canada, similar institutions would be Memorial University, Laval University (in French), the University of Saskatchewan, the University of Manitoba, and the University of British Columbia.

These universities usually use their own ‘on-campus’ faculty combined with professional support staff such as instructional designers experienced in online and distance learning, although they usually also hire contract or adjunct instructors to support the main faculty instructor.

In Mexico, the Universidad de Guadalajara has an excellent online program in Spanish through its Virtual Campus.

There are many others, too numerous to list all of them, so check your local state or province’s public universities and then ask the ten questions above, as not all ‘dual-mode’ institutions have moved quickly enough away from print-based to fully online, so check that the course or program you are interested in is available online.

However, in general, choosing an online program from any university in this category is probably your safest bet in terms of quality and value.

2. Publicly funded universities that have specialised in online or blended learning.

These are universities or colleges that did not have much prior history of distance education but have moved extensively into online learning, both in blended and fully online formats. The best example in the USA is the University of Central Florida, Another with a strong online program is Empire State College in the State University of New York system. In Canada, the University of Guelph, the University of Ottawa (English and French), Laurentian University (English and French) and Queen’s University in Ontario, and Simon Fraser University in British Columbia, all have extensive online programs.

One of the largest online programs in the USA is the University of Maryland University College, which has many US servicemen as students. However, having been a guest tutor on some of their courses, I’m not particularly impressed with the overall quality, although some individual courses/programs are good.

In Canada, Royal Roads University in British Columbia offers a unique blended learning model consisting of one semester on campus and two or more semesters online, as well as some fully online programs, mainly at graduate level.

3. Publicly funded two-year community colleges

Many publicly funded community colleges in both the USA and Canada have excellent online programs. George Brown College and Algonquin College in Ontario have extensive online programs.

The Colorado Community College System offers a wide range of courses online, including science courses using home kits and remote labs. There are several other regional or state-wide online consortia in the USA, such as the Southern Regional Education Board’s Electronic Campus, covering 16 states.

Rio Salado Community College in Arizona has one of the largest online programs in the USA. However, there have been criticisms about the quality, because of its heavy reliance on short-term contract instructors who often lack training in online teaching. This is something to watch for in any institution that has suddenly and rapidly expanded its online programs.

3. Private, non-profit universities

The Western Governors University specializes in competency-based learning, which allows you to study at your own pace and take into account any prior learning or competencies, which means you may be able to complete a program more quickly. Usually programs are designed in consultation with major employers, ensuring acceptance of the degree. For more on the Western Governors model, click here.

The University of Southern New Hampshire has one of the largest online programs in the USA, and is also moving heavily into competency based learning.

Tec de Monterrey is a dual-mode private, non-profit university in Mexico that offers high quality online programs in Spanish.

4. Publicly funded open universities.

The best online is the Open University of Catalonia, in Spain, which was founded in 1996 as a purely online university. It offers several graduate programs in English, and many undergraduate as well as graduate programs in Spanish and Catalan. It accepts many international enrolments, particularly from Latin America.

Tèluq in Quebec offers high quality online programs in French.

The U.K. Open University and the Open University of the Netherlands are also leaders in online learning. The U.K. Open University consistently ranks in the top ten universities in the U.K. (out of over 180) in terms of teaching.

There are many other open universities around the world, some with hundreds of thousands of students (e.g. the Open University of China, Anadolu Open University in Turkey, the Open University in Indonesia, Indira Gandhi Open University in India, and the University of South Africa). However, because many students in these countries lack easy access to the Internet, most of these universities are still primarily print-based.

Indeed, most open universities have a heavy legacy of print-based education which has limited their ability to move completely online. I’m not currently recommending Athabasca University in Canada, because it’s future is uncertain, and many of its undergraduate programs are still print-based, although it has some excellent online graduate programs. The same applies to Thompson Rivers University’s Open Learning program in British Columbia.

Nevertheless, open universities offer many people their only chance of a higher education, especially in developing countries.

5. For-profit private universities

I hesitate to recommend for-profit institutions such as the University of Phoenix, or Kaplan, not because they don’t offer high quality online programs – they do – but because of ongoing problems with federal student aid and recognition of their degrees. For further discussion especially of the University of Phoenix, see ‘How does the University of Phoenix measure up?

6. MOOCs

If you are not looking for a qualification, but are just interested in a particular topic, there are many free, massive open online courses (MOOCs) available to you from many of the world’s leading universities. The following are the main platforms/sites where you can find such courses:

Open Education Europa provides a comprehensive list of MOOCs being offered by European institutions.

However, be warned: while certificates may be offered for successful course completion, these are not usually accepted by even the offering institutions towards a formal degree. However the OERu is building a free degree program on open educational resources.

7. General advice

It makes sense to take an online program from any local institution that you know well and trust. There are risks in taking online programs from out of state or out of country, unless the institution has an international reputation. There may also be language or cultural issues. It is particularly important that you get frequent and good quality interaction with an instructor on the program. Nevertheless the choice has never been so rich.

Over to you

There are many other universities and colleges offering excellent online programs, too many to number, but if you have experience of taking online programs and would like to make recommendations (positive or negative), please use the comment box below.

However, I will not publish any comments that are not offered in a thoughtful and constructive manner, and especially if they are being used solely to market (or trash) a particular program.

And any requests to list or mention the many commercial providers of online programs will be ignored.

 

Ensuring quality teaching in a digital age: key takeaways

Building the foundations of quality teaching and learning

Building the foundations of quality teaching and learning

I have now completed and published Chapter 11, ‘Ensuring quality teaching in a digital age‘, for my online open textbook, Teaching in a Digital Age.’

Unlike earlier chapters, I have not published this as a series of blog posts, as it is based on an earlier set of blog posts called: ‘Nine steps to quality online learning.’

However, there are some substantial changes. The focus here is as much on applying basic principles of course design to face-to-face and blended/hybrid learning as to fully online course design.

More importantly, this chapter attempts to pull together all the principles from all previous ten chapters into a set of practical steps towards the design of quality teaching in a digital age.

Purpose of the chapter

When you have read this chapter, and in conjunction with what has been learned in previous chapters, you should be able to:

  • define quality in terms of teaching in a digital age
  • determine what your preferred approaches are to teaching and learning
  • decide what mode of delivery is most appropriate for any course you are responsible for
  • understand why teamwork is essential for effective teaching in a digital age
  • make best use of existing resources for any course
  • choose and use the right technology and tools to support your learning
  • set appropriate learning goals for teaching in a digital age
  • design an appropriate course structure and set of learning activities
  • know when and how to communicate with learners
  • evaluate your teaching, make necessary improvements, and improve your teaching through further innovation.

What is covered in this chapter

Key takeaways

1. For the purposes of this book, quality is defined as: teaching methods that successfully help learners develop the knowledge and skills they will require in a digital age.

2. Formal national and institutional quality assurance processes do not guarantee quality teaching and learning. In particular, they focus on past ‘best’ practices, processes to be done before actual teaching, and often ignore the affective, emotional or personal aspects of learning. Nor do they focus particularly on the needs of learners in a digital age.

3. New technologies and the needs of learners in a digital age require a re-thinking of traditional campus-based teaching, especially where it is has been based mainly on the transmission of knowledge. This means re-assessing the way you teach and determining how you would really like to teach in a digital age. This requires imagination and vision rather than technical expertise.

4. It is important to determine the most appropriate mode of delivery, based on teaching philosophy, the needs of students, the demands of the discipline, and the resources available.

5. It is best to work in a team. Blended and especially fully online learning require a range of skills that most instructors are unlikely to have. Good course design not only enables students to learn better but also controls teacher and instructor workload. Courses look better with good graphic and web design and professional video production. Specialist technical help frees up teachers and instructors to concentrate on the knowledge and skills that students need to develop.

6. Full use should be made of existing resources, including institutionally-supported learning technologies, open educational resources, learning technology staff, and the experience of your colleagues.

7. The main technologies you will be using should be mastered, so you are professional and knowledgeable about their strengths and weaknesses for teaching.

8. Learning goals that are appropriate for learners in a digital age need to be clearly defined. The skills students need should be embedded within their subject domain, and these skills should be formally assessed.

9. A coherent and clearly communicable structure, and learning activities for a course, should be developed that are manageable in terms of workload for both students and instructor.

10. Regular and on-going instructor/teacher presence, especially when students are studying partly or wholly online, is essential for student success. This means effective communication between teacher/instructor and students. It is particularly important to encourage inter-student communication, either face-to-face or online.

11. The extent to which the new learning goals of re-designed courses aimed at developing the knowledge and skills needed in a digital age have been achieved should be carefully evaluated and ways in which the course could be improved should be identified.

Over to you

Although the previous blog posts on nine steps to quality online learning were well received (they have been used in some post-secondary education courses) feedback on this revised book version will be much appreciated.  I haven’t seen anything similar that tries to integrate basic principles across all three modes of delivery, so I am especially interested to see how these are perceived in terms of regular classroom and blended learning.

Up next

The final chapter, which will take a brief look at the institutional policies and strategies needed to support teachers and instructors wanting to teach well in a digital age. It will deal explicitly with what we should expect (and more importantly, not expect) of teachers and instructors, issues around faculty development and teacher training, working methods for teachers and instructors, and learning technology support.

I aim to finish this (and the whole book, at least in first draft form) by March 14. French and Spanish translations are already under way.

What do we mean by quality when teaching in a digital age?

© Insights, 2012

© Insights, 2012

Before I start on my nine steps to quality learning for my open textbook, Teaching in a Digital Age, I have needed to ‘clear the decks’ about what we mean by quality. I thought this bit might be useful to share, as quality is a very slippery concept at the best of times.

The aim of this chapter is to provide some practical guidelines for teachers and instructors to ensure quality teaching in a digital age. Before I can do this, however, it is necessary to clarify what is meant by ‘quality’ in education, because I am using ‘quality’ here in a very specific way.

Definitions

Probably there is no other topic in education which generates so much discussion and controversy as ‘quality’. Many books have been written on the topic, but I will cut to the chase and give my definition of quality up-front. For the purposes of this book, quality is defined as:

teaching methods that successfully help learners develop the knowledge and skills they will require in a digital age.

This of course is the short answer to the question. A longer answer means looking, at least briefly, at:

  • institutional and degree accreditation
  • internal (academic) quality assurance processes
  • differences in quality assurance between traditional classroom teaching and online and distance education
  • the relationship between quality assurance processes and learning outcomes
  • ‘quality assurance fit for purpose’: meeting the goals of education in a digital age.

This will then provide the foundations for my recommendations for quality teaching that will follow in this chapter.

Institutional and degree accreditation

Most governments act to protect consumers in the education market by ensuring that institutions are properly accredited and the qualifications they award are valid and are recognised as of being of ‘quality.’ However, the manner in which institutions and degrees are accredited varies a great deal. The main difference is between the USA and virtually any other country.

The U.S. Department of Education’s Network for Education Information states in its description of accreditation and quality assurance in the USA:

Accreditation is the process used in U.S. education to ensure that schools, postsecondary institutions, and other education providers meet, and maintain, minimum standards of quality and integrity regarding academics, administration, and related services. It is a voluntary process based on the principle of academic self-governance. Schools, postsecondary institutions and programs (faculties) within institutions participate in accreditation. The entities which conduct accreditation are associations comprised of institutions and academic specialists in specific subjects, who establish and enforce standards of membership and procedures for conducting the accreditation process.

Both the federal and state governments recognize accreditation as the mechanism by which institutional and programmatic legitimacy are ensured. In international terms, accreditation by a recognized accrediting authority is accepted as the U.S. equivalent of other countries’ ministerial recognition of institutions belonging to national education systems.

In other words, in the USA, accreditation and quality assurance is effectively self-regulated by the educational institutions and faculty through their control of accreditation agencies, although the government does have some ‘weapons of enforcement’, mainly through the withdrawal of student financial aid for students at any institution that the U.S. Department of Education deems to be failing to meet standards.

In many other countries, government has the ultimate authority to accredit institutions and approve degrees, although in countries such as Canada and the United Kingdom, this is often exercised by arm’s length agencies appointed by government, but consisting mainly of representatives from the various institutions within the system. These bodies have a variety of names, but Degree Quality Assurance Board is a typical title.

However, more important than the formal lines of responsibility for quality is how the accrediting agencies actually operate. Usually, once a degree program is approved, there is little follow-up or monitoring afterwards, unless formal complaints are subsequently made about the quality of the program, although many institutions now voluntarily review programs every five years or so. Also, once an institution has been accredited, the accreditation agency may delegate back to the institution the approval of it own degree programs, providing that it has an internal process in place for assuring quality, although where government is formally responsible, new degrees may still come to an accrediting agency, to ensure there is no duplication within the system, that there is a defined market for the program, or where approval to deviate from government guidelines on fees may be requested. Nevertheless, mainly to ensure academic freedom from direct government interference, universities in particular have a large degree of autonomy in most economically advanced countries for determining ‘quality’ in programming.

However, in recent years, some regulatory agencies such as the United Kingdom’s Quality Assurance Agency for Higher Education have adopted formal quality assurance processes based on practices that originated in industry. The U.K. QAA’s Quality Code for Higher Education which aims to guide universities on what the QAA is looking for runs to several hundred pages. Chapter B3 on Learning and Teaching is 25 pages long and has seven indicators of quality. Indicator 4 is typical:

Higher education providers assure themselves that everyone involved in teaching or supporting student learning is appropriately qualified, supported and developed.

Many institutions as a result of pressure from external agencies have therefore put in place formal quality assurance processes over and beyond the normal academic approval processes (see Clarke-Okah et al., 2014, for a typical, low-cost example).

Internal quality assurance

It can be seen then that the internal processes for ensuring quality programs within an institution are particularly important. Although again the process can vary considerably between institutions, at least in universities the process is fairly standard. A proposal for a new degree will usually originate from a group of faculty/instructors within a department. The proposal will be discussed and amended at departmental and/or Faculty meetings, then once approved will go to the university senate for final approval. The administration in the form of the Provost’s Office will usually be involved, particularly where resources, such as new appointments, are required.

Although this is probably an over-generalisation, significantly the proposal will contain information about who will teach the course and their qualifications to teach it, the content to be covered within the program (often as a list of courses with short descriptions), a set of required readings, and usually something about how students will be assessed. Increasingly, such proposals may also include broad learning outcomes for the program.

If there is a proposal for courses within a program or the whole program to be delivered fully online, it is likely that the proposal will come under intense internal scrutiny. What is unlikely to be included in a proposal though is what methods of teaching will be used. This is usually considered the responsibility of individual faculty members. It is this aspect of quality with which this chapter is concerned.

Lastly, some institutions require every program to be reviewed after five or more years of operation, or at the discretion of the senior administration. Again whether and how this is done varies considerably. One common approach is for an internal review process, with an internal evaluation report by a committee set up by the department offering the program, followed by a review of the internal committee’s report by external assessors. This review may or (more frequently) may not lead to significant changes in a program, but this will depend on the instructors responsible for teaching the program agreeing to implement any recommended changes. Less frequently, where enrolment for a program has declined to unacceptable levels or where external complaints about a program have been received, the Vice President Academic may call for an external review of the program, in which case anything is possible, up to and including closure of the program.

Jung and Latchem (2102), in a review of quality assessment processes in a large number of online and distance education institutions around the world, make the following important points about quality assurance processes within institutions:

  • focus on outcomes as the leading measure of quality
  • take a systemic approach to quality assurance
  • see QA as a process of continuous improvement
  • move the institution from external controls to an internal culture of quality
  • poor quality has very high costs so investment in quality is worthwhile.

In particular, Butcher and Wilson-Strydom (2013) warn:

you should not assume that creating quality assurance structures… automatically improves quality….Institutional quality assurance structures and processes are important, but beware of making them an exercise in compliance for accountability, rather than a process of learning and self-improvement that really improves quality.

There are many guidelines for quality traditional classroom teaching. Perhaps the most well know are those of Chickering and Gamson (1987), based on an analysis of 50 years of research into best practices in teaching. They argue that good practice in undergraduate education:

  1. Encourages contact between students and faculty
  2. Develops reciprocity and cooperation among students.
  3. Encourages active learning.
  4. Gives prompt feedback.
  5. Emphasizes time on task.
  6. Communicates high expectations.
  7. Respects diverse talents and ways of learning.

Online courses and programs

Because online learning was new and hence open to concern about its quality, there have also been many guidelines, best practices and quality assurance criteria created and applied to online programming. All these guidelines and procedures have been derived from the experience of previously successful online programs, best practices in teaching and learning, and research and evaluation of online teaching and learning.

Some degree quality assurance boards (such as the QAA in the UK and PEQAB in Ontario) have put in place specific ‘benchmarks’ for online courses. A comprehensive list of online quality assurance standards, organizations and research on online learning can be found in Appendix 3. Graham et al. (2001) applied Chickering and Gamson’s seven principles for face-to-face teaching to the evaluation of four online courses from a mid-western university in the USA, and adapted these principles for online learning.

Thus ensuring quality in online learning is not rocket science. There is plenty of evidence of what works and what doesn’t, which will be examined in more detail in this chapter. There is no need to build a bureaucracy around this, but there does need to be some mechanism, some way of calling institutions when they fail to meet these standards. However, we should also do the same for campus-based teaching. As more and more already accredited (and ‘high quality’) campus-based institutions start moving into hybrid learning, the establishment of quality in the online learning elements of programs will become even more important.

Thus there are plenty of evidence-based guidelines for ensuring quality in teaching, both face-to-face and online. The main challenge then is to ensure that teachers and instructors are aware of these best practices and that institutions have processes in place to ensure that guidelines for quality teaching are implemented and followed.

Quality assurance, innovation and learning outcomes

It may have been noted that most QA processes are front-loaded, i.e. they look at inputs – such as the academic qualifications of faculty, or the processes to be adopted for effective teaching, such as clear learning objectives – rather than outputs, such as what students have actually learned. They also tend to be backward-looking, that is, they focus on past best practices.

This is particularly important for evaluating new teaching approaches. Butcher and Hoosen (2014) state:

The quality assurance of post-traditional higher education is not straightforward, because openness and flexibility are primary characteristics of these new approaches, whereas traditional approaches to quality assurance were designed for teaching and learning within more tightly structured frameworks.

 However, Butcher and Hoosen (2014) go on to say that:

fundamental judgements about quality should not depend on whether education is provided in a traditional or post-traditional manner …the growth of openness is unlikely to demand major changes to quality assurance practices in institutions. The principles of good quality higher education have not changed…. Quality distance education is a sub-set of quality education…Distance education should be subject to the same quality assurance mechanisms as education generally.’

Such arguments though offer a particular challenge for teaching in a digital age, where it is argued that learning outcomes need to include the development of skills such as independent learning, facility in using social media for communication, and knowledge management, skills that have not been explicitly identified in the past. Quality assurance processes are not usually tied to specific types of learning outcomes, but are more closely linked to general performance measures such as course completion rates, time to degree completion and grades based on past learning goals.

Furthermore, we have already seen in Chapters 9 and 10 that new media and new methods of teaching are emerging that have not been around long enough to be subject to analysis of best practices. A too rigid view of quality assessment based on past practices could have serious negative implications for innovation in teaching and for meeting newly emerging learning needs. ‘Best practice’ may need occasionally to be challenged, so new approaches can be experimented with and evaluated.

Quality assurance: fit for purpose in a digital age

Maxim Jean-Louis, the President of Contact North, at a presentation in 2010 to the Higher Education Quality Council of Ontario, made a very useful distinction about different ways of looking at quality in education:

  • Quality as ‘Excellence’– a definition that sets abstract goals for institutions and academic communities to always striving to be the best, mainly taken as having elitist undertones. In post-secondary education this could mean winning Nobel prizes, attraction of research funds or the “best” faculty as measured by research output and teaching evaluations. The drawback here is that this tends to also exclude the work of the ‘further education’ sectors, and is not applied equally between disciplines (citation counts do not exist for historians and many other subjects).
  • Quality as ‘Meeting a pre-determined standard’– a definition that requires only a given standard to be met, e.g. a minimum grade, basic competency, the ability to read, write, use a computer, etc. [It might also include competencies and skills, degree completion rates, time to degree completion, etc.] The drawback of this is that setting and measuring this ‘standard’ is difficult at best and idealistic at worst.
  • Quality as ‘fitness for purpose’ – in this construction of quality, we have to decide the extent to which the service or product meets the goals set – does this course or program do what it says it was going to do? Such a construction of quality allows institutions/sectors to define goals themselves according to their mandate and concentrates on meeting the needs of their customers (whether this be upgrading learners, graduate researchers, industry, etc.).

Quality assurance processes must address the increasing diversity of our educational systems. Distance education organizations are not the same as elite traditional universities and shouldn’t try to be. This would mean looking for different measures of quality in the Open University, for instance, than in Cambridge University. Neither one is necessarily better (depending on what they are trying to achieve), but the learning experience ought to be different, even though the intended learning outcomes may be similar; this will mean different design criteria but not necessarily different criteria for assessing the quality of the learning.

In the meantime, much more attention needs to be directed at what campus-based institutions are doing when they move to hybrid or online learning. Are they following best practices, or even better, developing innovative, better teaching methods? The design of xMOOCs and the high drop-out rates of many new two year colleges new to online learning in the USA suggest they are not.

This means that different types of institution will and should evaluate quality differently. If the goal or purpose is to develop the knowledge and skills that learners will need in a digital age, then this is the ‘standard’ by which quality should be assessed, while at the same time taking into account what we already know about general best practices in teaching. The recommendations for quality teaching in a digital age that follow in this chapter are based on these principles.

Over to you

There is so much I wanted to write here about the stupidity of the current system of institutional accreditation and internal quality assurance processes, especially but not exclusively in the United Kingdom, but this section is meant as an introduction to practical guidelines for teaching and learning. So I’ve tried to be uncharacteristically restrained in writing this section. But feedback is even more welcome than usual.

1. (a) First, are there any incorrect facts in this section? This is a large and complex topic and it is easy to get things wrong.

(b) Have I left out anything really important about assessing quality in teaching and learning?

2. One problem with this topic is that it tends to gravitate between two polarised positions: those who believe in absolute truth and those who are relativists. Absolute truthers believe that there is a God-given set of ‘quality’ standards that are set primarily by elite institutions that everyone else should strive to meet. Relativists (like myself) believe that quality is in the eye of the beholder; it all depends on what your goals are. Hence my definition of quality is set among the rather limited goal in one way – and extremely ambitious in another – of developing teaching methods that will help learners develop the knowledge and skills they will need in a digital age. So: any views on my definition of quality? Is it fit for purpose?

3. What do you think of the current system of (a) institutional accreditation and (b) internal quality assurance processes?

My own view is that institutional accreditation is definitely needed to protect against really incompetent or downright dishonest organisations, but, depending on the jurisdiction, it is very much an insider’s process and not very transparent, and while current accreditation processes may set minimum standards it certainly doesn’t do much to improve quality in the system.

Similarly, internal quality assurance processes are far too cosy and protect the status quo. The internal program approval processes are based again on peer review of a very limited kind, with often ‘I’ll scratch your back if you’ll scratch mine’ approach to program approval. I’ve been on a number of program reviews as an external reviewer, but rarely see any significant changes, despite sometimes scathing reviews from the externals.

And as for formal QA processes, they are the kiss of death for quality, tangling faculty and administrators in incredibly bureaucratic processes without dealing with the real issues around quality teaching and learning.

Of course, all these practices are in the name of protecting academic freedom, which is important – but surely better processes can be derived for improving quality without threatening academic freedom.

4. So lastly, is it wise for me to restrain myself from adding these types of comments in the book – or will I muddy the waters of what is to come if I do?

References and further reading

Butcher, N. and Wilson-Strydom, M. (2013) A Guide to Quality in Online Learning Dallas TX: Academic Partnerships

Butcher, N. and Hoosen, S. (2014) A Guide to Quality in Post-traditional Online Higher Education Dallas TX: Academic Partnerships

Chickering, A., and Gamson, Z. (1987) ‘Seven Principles for Good Practice in Undergraduate Education’ AAHE Bulletin, March 1987.

Clarke-Okah, W. et al. (2014) The Commonwealth of Learning Review and Improvement Model for Higher Education Institutions Vancouver BC: Commonwealth of Learning

Graham, C. et al. (2001) Seven Principles of Effective Teaching: A Practical Lens for Evaluating Online Courses The Technology Source, March/April

Jung, I. and Latchem, C. (2012) Quality Assurance and Accreditation in Distance Education and e-Learning New York/London: Routledge