April 29, 2017

What counts when you cost online learning?

Poulin, R. and Straut, T. (2017) Distance Education Price and Cost Report Boulder CO: WCET

This highly controversial report has generated considerable discussion in WCET’s own Forum, and has received a good deal of media coverage. When you read the report you will see why.

Much of the media coverage has focused on the finding that respondents to the survey on which this report is based were by and large of the opinion that distance education costs more than classroom teaching. But you need to read the report more carefully to understand why respondents responded in this way. It all comes down to how you cost distance education or online learning. In particular, you need to understand the context of the report. 

As always, you should read the report itself, not my summary, especially if you disagree with what’s in my summary.

The context

The context for this report is very political and very American (by which I mean USAnian, i.e. applying specifically to the USA). The report is more about price – what institutions charge students – than it is about cost.

The cost of tuition (the fees students or their parents pay to the institution) continues to increase in the USA way beyond the rate of inflation, and many institutions not only charge the same tuition rates for online or distance education courses, but also add additional fees. In other words, many American institutions increase the price for an online or distance course compared to its face-to-face equivalent.

However, the political perception, especially in state legislatures, is that distance education is cheaper than on-campus teaching, so some states (e.g. Wisconsin and Florida) have introduced legislation or initiatives to reduce the price of online learning courses below that of face-to-face programs.

As the authors note:

Historically, distance education’s mission has been to overcome the barriers of place or time. The mission was not to control costs. In fact, to reach some locations is costly. Distance education should not be held accountable to a mission it was never given.

distance education professionals are caught in a higher education economics ethos that shuns open examination of price and cost…and are expected to answer to a “controlling cost” mission that was not given them in the first place.

It is within this context that WCET decided to do the study in order to challenge some of the assumptions about the price and cost of distance education.

Methodology

As always, you need to know the methodology in order to interpret the results. The report indeed is very transparent about its methodology, which is not tucked away in an appendix or not discussed at all (which seems to be a practice that is increasing in many so-called ‘studies’ these days), but is front and centre in the report.

Definitions

The authors provide the following definition:

  • Price – This is the amount of money that is charged to a student for instruction. The components are tuition and fees. In the questions, we will be clear as to which “price” component (tuition, fees, or total price) is being queried. 
  • Cost – This is the amount of money that is spent by the institution to create, offer, and support instruction. 
  • Distance Education – When thinking of “distance education,” we favor the Babson Survey Research Group definition of 80% or more of the course being taught at a distance.

Sample

WCET surveyed mainly its own members and members of other distance education consortia. Overall, 197 responded.

We had hoped for more participation in the survey. It is important to note that the responses provided represent only the institutional representatives who answered the survey questions. Even though we provide comparisons between the responding population and the overall higher education population, we do not assert that the results may be generalized to the universe of all institutions of higher education in the U.S. and Canada that offer distance education courses.

What can be said is that the response came mainly from distance education and educational technology professionals, rather than faculty or senior administrators, mainly in public HE institutions.

Main results

I will deal with these very briefly, although the detailed findings are more nuanced.

  1. The price of DE is generally higher than for face-to-face teaching. More than half (54%) of the respondents reported that their institution charged more for distance education courses than for on-campus courses.
  2. A majority of respondents believed that the cost of DE was higher than for face-to-face teaching on certain defined components (e.g. faculty development, technologies, instructional design, assessments, state authorization – a long and complex process of ‘accrediting’ DE courses unique to the USA).
  3. ‘Experts’ in the costs of DE tended to disagree that costs of DE are necessarily higher
  4. The experts also noted that cost discussions are often avoided by higher education leadership and that more could be done to control costs, not just in distance education.

The reports main conclusions

The conclusions were split into recommendations for legislators and institutions:

For legislators

  • focus questions on future costs and in particular the likely impact of investing in buildings vs distance education in terms of the impact of the cost to students
  • provide more incentives for institutions to reduce the price to students
  • don’t be prescriptive but help institutions develop a vision for state higher education that is realistic and shared

For institutions

  • pay as much attention to the cost to students as to the cost to the institution of various delivery methods
  • be more open about costs and track them for all modes of delivery
  • changing the cost structure requires structural changes in how we design and deliver programs; this requires leadership from the senior administration.

My comments on the report

The report is right to draw attention to the creeping costs to students (e.g. price) resulting from institutional policies in the USA. What is also apparent is that there is a large disconnect between institutions and government about the cost of distance education. Many educators believe that DE is more expensive; government thinks it should be cheaper. Somewhere in the middle is a discussion about quality: does cheaper mean worse?

Cherry-picking costs

Unfortunately, though, for methodological reasons, I fear the report has confused rather than clarified the discussion about costs and price. In particular, by focusing on components that are specific to distance education, such as faculty support, the use of technologies, and the cost of state authorization of DE, the report has clearly given the impression that most educators believe that distance education is more expensive. It can be, but it doesn’t have to be.

It is unfortunate that the report has given this impression because you cannot just look at the costs of specific components of distance education without looking also at specific components of face-to-face teaching that are not represented in the costs of distance education, in particular the very substantial ‘sunk’ costs of buildings, parking, etc. There are better ways of measuring the costs of distance education and online programs – see Chapter 7 in Bates and Sangra (2011).

Making DE cost-effective

While we can develop cost-effective fully online programs, this normally depends on generating new revenues from new students. Offering online courses as an alternative to already existing students on campus, while increasing access and student flexibility, is much more financially risky.

Again, this can be managed cost-effectively, but it depends on having enough students taking both on-campus and online versions of the course, and the use of additional adjunct professors for online courses with more than 30 students. Bringing in new students who you wouldn’t get without the courses being online is the best bet to ensure economic viability. ‘Diluting’ your on-campus students by offering the same course online will add costs unless the numbers can justify it.

What about the costs of blended learning?

One last point. I think we are going to have a period of considerable cost turmoil as we move to blended learning, because this really does add costs unless there are dramatic redesigns, especially of the large first and second year classes. Carol Twigg of the National Centre for Academic Transformation for many years has been able to bring down costs – or more often increase effectiveness for the same cost – for these large lecture classes by using blended learning designs (although there are some criticisms of her costing methodology).

By and large though, while fully online courses can maybe increase enrolments by 10-15% and therefore help pay their way, we will have major cost or academic time problems if we move to nearly all courses being blended, without increased training for faculty, so they can manage without the same level of support provided by instructional designers, etc. that are normally provided for fully online courses (see ‘Are we ready for blended learning?‘).

Moving forward 

I’m glad then that WCET has produced a report that focuses not only on the costs of distance education to institution but also on pricing policies. There is in my view no economic justification for charging more for an online course than a face-to-face course as a matter of principle. You need to do the sums and institutions are very bad at doing this in a way that tracks the cost of activities rather than throwing everything into one bucket then leaking it out at historical rates to different departments.

Institutions need to develop more rigorous methods for tracking the costs of different modes of delivery while also building in a measure of the benefits as well. If the report at least moves institutions towards this, it will have been well worth it.

When MOOCs crash and burn

Jaschick, S. (2013) MOOC Mess, Inside Higher Education, February 4

Krause, S. (2013) Two Thoughts on the crash of the “Fundamentals of Online Education” MOOC Stevendkrause.com, February 4

Strauss, V. (2013) How online class about online learning failed miserably Washington Post, February 5

Well, it had to happen. You all probably know the story of the course on how to plan and manage online courses that wasn’t planned or managed. After two weeks, with 40,000 students online, this course from an instructor at the Georgia Institute of Technology really crashed and burned. The tool selected for group-work couldn’t handle the numbers, the faculty member was overwhelmed, so cancelled the course with barely an explanation.

Now I do feel sympathy not only with the students, but also with the instructor. I’ve made mistakes on my first online courses, but here are some questions that someone should be asking:

  1. Where is the quality control? Surely Coursera should accept some responsibility for this. They are getting paid by the institutions to host these courses. Shouldn’t they at least be asking some questions about what tools people are planning to use, and whether or not they will work with very large numbers? Are they doing due diligence before accepting and advertising their MOOCs? Apparently not. Nor did Georgia Institute of Technology. What has this done to its reputation?
  2. Are questions being asked about the qualifications or experience of the people who are offering MOOCs? Just a brief glance at this particular course suggests that the instrutor had little experience herself in planning and managing online courses. Georgia Institute of Technology is not at the top of my list of institutions with experience in online learning. But then, anyone can teach an online course about online learning, can’t they?

What really makes me angry is that badly designed MOOCs do such damage, both to their students and to the image of online learning. You just cannot go on ignoring best practice and hope to get away with it, especially with 40,000 students in the class.

Again, this is a classic example of the clash between computer scientists and educators. If you are trying out an app and it fails, no big deal, you’ve lost a bit of money – try another one. But in education you are playing with people’s hopes and dreams. Do the job properly.