Skip to Content

Technology and Education Reform

I’ve recently been in a number of conversations about the education system in the United States and the role of technology in improving things.  So I thought I’d take a minute to write down some of my thoughts on the subject. While I don’t think technology is a silver bullet by any means (as evidenced by the fact that I’m still having this conversations 20 years after I entered the field!), I do think technology has a role to play in improving learning outcomes. “Improving learning outcomes” is a loaded phrase but, for the present purpose, I’ll define it to mean substantially increasing the number of students completing high quality post-secondary education. This is a big problem in the US and has been documented in a number of places, so I won’t belabor it here. If you don’t agree it’s a problem that’s a separate thread.

I’ll begin with a few observations that strongly influence my thinking:

  • Student interest is critical. If students aren’t interested in what they are being asked to do, they won’t learn effectively. Or they won’t learn at all, as illustrated in The Silent Epidemic, a report sponsored by the Gates Foundation. The report found that at least half nearly 500 dropouts surveyed left school because their classes were boring, they did not see its relevance to their lives outside of school, and they were not motivated to learn. Whatever solutions you put in place must ensure that students will be interested in what you’re offering. Better access to more boring and irrelevant content isn’t going to do the trick.
  • The current default model for classroom instruction is obsolete. This has been stated over and over again by people smarter than me. Actually, it probably works just fine for the people privileged and accomplished enough to go to places like Stanford and Harvard and Michigan and Berkeley, but it doesn’t work for the vast majority. There are several major problems with the current system, one that evolved a long time ago for a society that doesn’t resemble the one we live in today. I’ll mention four here:
    • Most jobs today entail working with others, yet most of our efforts to teach have students working alone. 
    • Today’s workers need to combine communication skills with analytical and mathematical skills, yet the strict curricular boundaries represented by our subject divisions don’t encourage or even allow these skills to utilized simultaneously.
    • There are different paths to learning and an improved and productive life beyond school, but we still see many instances of “everyone on the same page at the same time.”
    • The internet has made access to factual information extremely easy, yet our learning activities too often emphasize rote memorization of facts instead of conceptual understanding and practical application.
  • Assessments are narrow and unhelpful to students.  Assessment is clearly important. I worry, though, that the focus on a small number of standardized exams is not only reinforcing the obsolete instructional model but also embedding it even more deeply in the system. Moreover, as a “capstone” of your educational experience, a score on a multiple-choice exam is not something that is going to help you get a job (except, of course, to the extent you need a minimal score to get a degree). It isn’t an artifact a student can take to a prospective employer and say “Here’s what I can do.” And yet schools are under increasing pressure to spend more time preparing students to do well on these exams. It can’t be surprising therefore, that students find school boring and irrelevant.
  • Good teachers matter. Too often in the past technologists have focused substantial energy in trying to create learning systems that bypassed instructors. While there are some applications where this may make sense, I generally believe we should use technology (a) to allow of good teachers to reach more students effectively and (b) increase the number of good teachers.

Some thoughts on improving the situation

I’m not going to claim to have all the answers to address these issue. The system is incredibly complex (although the health care system is probably even more difficult to make sense of).  Moreover, there isn’t going to be one answer that serves all communities or individuals—a multitude of approaches will be needed to address the issues in different places and for different people. Still, working from the observations above, I'll mention two directions I think are fruitful.

  • I would work to explore how to introduce substantially more project-based learning into the curriculum. The primary reason is student interest—practical and relevant project work is much more likely to engage students. This is especially true if students have some degree of choice in the project they undertake (by choosing from an instructor-provided list or constructing their own) and if the project results in some real-world impact. Project work, especially group project work, also addresses other aspects of the “obsolete” school: It has students working in groups and it is much more likely to require interdisciplinary work.

There is ample literature on how well these approaches work. There is also ample literature on the difficulties of implementing and scaling approaches like this. Projects may require additional resources, they may take a teacher outside the comfort-zone of their own knowledge, and they can more difficult to objectively evaluate. Technology has a role in helping, in a variety of ways from easing the administrative burden for teachers to bringing structure, tools and content to students so that they can complete project work more independently.

  • The role of assessments is key to any attempt to reform the educational system. With the (fundamentally sound) calls for increased accountability, the role of assessments becomes increasingly important.  Unfortunately, the “teaching to the test” phenomenon coupled with inadequate assessments will result in a system that is arguably worse than the one we have now. Assessment must be strengthened but it must, simultaneously, also be made more varied and complex. Increased use of rich assessments (e.g. essays, performance assessment, oral presentations, demonstrations, exhibitions, and portfolios) is a must.

There are at least two reasons these vehicles have not seen extensive use. First, they are more time-consuming. Second, they are perceived to lack objectivity. We can overcome both of these obstacles and, again, technology can play a significant role.  Technology has proven its ability to improve the efficiency of complex workflows like those entailed in evaluating richer assessments. While the effort may still be greater than feeding a stack of bubble-sheets into an automated scanner, the rewards will be well worth the investment. Technology can also help with increasing the objectivity of rich assessments. A state-wide (or national) platform that provides standard rubrics and examples for teachers and that allows randomized inspection of local practices can go along way to giving us the tools we need to enact these reforms in a meaningful way. And the results of these richer assessments can give students an artifact they can leverage in their next stage of life whether that will be further education or employment.

The difficulty of change

I often mention a picture from Larry Cuban’s Teachers and Machines shows a group of students and a teacher taking advantage of a new technology, the airplane, in their study of geography. The educational implications of aviation are obvious; instead of relying solely on maps and photographs, the students will be able to actually visit the particular locales and see geographical features from the air. Remembering the capital city, rivers, mountains, political systems and economic strengths of a region become much easier when you have spent some time there. What a wonderful way to make history and geography and politics come alive.

Instead we see the teacher standing at the front of the room directing everyone’s attention to one of the oldest tools for teaching geography: a globe. The class may very well be taking a trip on the plane to visit some interesting and educational location that will enable the students to truly understand and remember its significance. But, with the exception of the shape of the windows (windows that no one is looking through), the scene is indistinguishable from an ordinary classroom. This photo encapsulates one lesson from Cuban’s book quite well—classroom practices are extraordinarily resistant to change and the seemingly most interesting and innovative technologies will generally be absorbed into existing pedagogical practice without changing much.

 Aerial Geography

From primary school through college, the classic image of a teacher dispensing wisdom from the front of a room full of silent students remains all too easy to find. And the classic definition of a lecture comes all to quickly to mind: Lecture is the art of transmitting information from the notes of the lecturer to the notes of students without passing through the minds of either.

That’s not to say, of course, that no wonderful exceptions to this standard picture exist, as evidenced by the Teaching With Sakai Innovation Award entrants and winners. Nor is it to say that these exceptions don’t take advantage of modern technologies in interesting and important ways. It is simply to acknowledge that technology isn’t automatically going to change anything about the quality of a course. I take two lessons from this.

First, the fundamental determinants of course quality have always been, and remain, the course content, the instructor(s), the learning activities in which the students are engaged and the students themselves. If you want to reform pedagogy, reform pedagogy first and bring technology in where it makes sense to support the change. Don’t hope that technology will do it for you—it is not a Trojan horse that you can use to smuggle in improved teaching and learning practices.

The second lesson is, simply, that the system is complex and that changing one piece of it without changing the others is impossible. The web of forces in the system is very resilient and can (unwittingly!) undermine innovation. We need to be sure to address changes systemically and modify multiple components in the system simultaneously.

Thanks for listening....I'd love to hear your comments.

Something to watch

Finally, a couple of videos that relate to the topics above. I’m sure you’ve seen them but, if not….

Sir Ken Robinson video: Schools Kill Creativity (doesn’t really get going until half-way through)

Tom Chapin’s Not on the Test

Liz Koelman on Reforming Liberal Education

Guido Sarduci’s Five Minute University

With regard to your comment about technology being able to help make the assessment of a variety of project based experiences more rigorous and "objective", I think that there is a small group of folks that would like to use tools to support that sort of holistic assessment...and the sort of paradigm switch that this approach to education would imply.

Jan and I will be releasing a 0.1 release of the AAC&U VALUE rubrics as a set of Sakai evaluation forms and a simple "Essential Learning Outcomes" matrix to the openedpractices.org library next week. While the tech isn't the focus here, I hope that the implementation of these well researched rubrics for assessing ePortfolios will spark some thinking about how an eLearning platform like Sakai could support a systematic approach to assessment that goes beyond "tests and quizzes".

Michael,
I enjoyed your thoughts on how to improve education and the potential of technology to contribute to that improvement. I agree that project-based and group work has great potential to enliven and engage students in their learning....and that technology can assist in the implementation of project-based and group learning. As an instructor that uses this approach substantially in my own teaching of distance students who use Sakai to mediate learning, I wonder how you envision sakai3 to better support project based and group learning. Specifically Sakai is weak in process support tools and in group work support tools. For example, groups in my courses usually gravitate toward google docs and skype as well as other "outside" of sakai tools to work together on assignments.

Perhaps this is already documented somewhere but I think your call for more project based and group learning could be enhanced by models, examples, use cases, etc. of how sakai3 will foster the type of interactions that are fundamental to project based and group learning.

Thanks for any further thoughts you can offer on this question.

Michael. Thanks for the post ... to which I fully agrree. I would add that we need to bring a more "scientific approach" to teaching and learning. What strikes me is that instructors/faculty have a dual approach. In their research, they adopt the open, collaborative and peer-reviewed way of producing content. In their course, they use the closed, individual and informal way of designing and delivering their course. We need much more hard evidence of learning outomes along the work done in the physics literature (http://www.physics.indiana.edu/~hake/CaseForClickersJ.pdf).Technology could help us collect, manage and analyze learning outome data. Educational data mining should help us sort out what works from what is ineffective .... like UX designers at Google and Yahoo get hard evidence on layout improvements through users' responses.

Jacques Raynauld, Chair of Teaching and Learning, HEC Montréal.

Since you ushered me into this field, it should come as little surprise that I agree with most of what you say here. But not all...

I actually think pedagogy inside the trojan horse of digital is EXACTLY the strategy for effecting instructional reform. Instructors, esp higher ed instructors, rightly or wrongly (usually wrongly) see themselves as learning experts. This correlation between content knowledge and educational effectiveness is specious, insidious and has caused immeasurable harm to student learning. But this belief is so deeply entrenched, I don't think you can change it head on. Support for digital adoptions affords a wonderful opportunity to sneak in some progressive pedagogy under the auspices of learning these new tools. And frankly, many of them require new ways of teaching anyway.

Given its central role in your thesis, what for you defines a good teacher?

Even the best teachers struggle to overcome the logistical hurdles posed by student attendance. Central Florida has classes with as many as 1500 students! And Obama's plan to take the US from its current graduation rate of 39% to 60% means overcrowding is only going to get worse. In 500 person lectures, I'd almost go as far as to aver that there are no good teachers; less bad, sure; good, no. I think this is a huge obstacle to meaningful reform that introduces more constructivist activities and group work. What's your solution to this?

Assessment poses a similar problem. The assertion that there are digital tools to increase efficiencies is terribly vague. What are they?

Great post, though. Isn't that Ken Robinson video great? One of my favorite Ted Talks.

-Nathan

Michael -

I was very impressed by your post, and especially your observation that, "Increased use of rich assessments (e.g. essays, performance assessment, oral presentations, demonstrations, exhibitions, and portfolios) is a must."

As someone who has been part of a team developing a more flexible e-portfolio system at NYU, this struck a particular chord (and I want to note that everything I say here is an attempt to articulate what has been a collaborative vision with a long history; it belongs in particular as much to Lucy Appert and Barbra Mack as to me, though they should not be blamed for anything I have badly phrased).

Our program, Liberal Studies, is a liberal arts program with a particularly strong global element. Let me first lay out the assessment dilemma we have, and then suggest how e-portfolios can help solve it.

To us, the goal of liberal arts education is to develop each student’s capacity to lead a self-directed intellectual life. While there is great value in a program or department becoming more conscious of its learning goals by having to articulate them, assessing self-direction via rubrics that are transparent to students is problematic. One can't, for instance, use as a program rubric "students must demonstrate that they have on their own seen and understood a contemporary play by choosing to interpret it in light of its relation to a historical context of their choice," because then they aren't seeing it on their own nor choosing the mode of interpretation. This is a central dilemma for humanities education – there is a need to articulate specific learning goals for basic program assessment purposes, but at the same time these goals are all means to the greater end of promoting self-directed education, of forming an integrated individual, rather than an agglomeration of discrete educational acquisitions, whether skills, facts, or paraphrased ideas. Even when sharing a syllabus with students, instructors need to be very careful that they don't confuse the means (success at what's demanded on paper A and presentation B) for the end (being able to fend for themselves educationally). It's an issue educators face constantly - the "what do I need to do to get an A?" question – and the best response is not to answer it, but to subvert the question.

Indeed, these principles apply to many “data-driven” fields as well. While students in a medical or nursing program must certainly demonstrate the mastery of particular factual material, the tendency in recent years has been to recognize the extent to which medical practitioners must treat not merely the disease, but the patient. While one might be able to assess a practitioner’s ability to administer the correct drug for a particular disease, one cannot so assess his or her ability to understand patients’ cultural assumptions well enough to translate their descriptions of symptoms into a secure diagnosis. Assessment of interactions with the people a practitioner in any field treats, assessment of how they deal with unexpected situations that fall outside the scenarios with which they have been taught to cope, must take a more holistic form than checking off boxes in a list of valuable skills.

We see great potential for using a flexible e-portfolio to develop substantially different and possibly far superior means of assessment. Rubrics are applied to the end product of learning on the assumption that the process of change that led to those final products, the growth of the student's mind, is not available itself for observation. But with a dynamic portfolio tool, one in which students do not merely stockpile the precise items the program prescribes but control the types of items they save and the manner in which they are presented, one might have a window into the development of each student's mind. In order to configure an open-ended portfolio, students need to practice taxonomy, placing items in categories that reflect the way they think about the relations between them. If such a portfolio is versioned and makes space for student reflection, it becomes possible to see how a student's way of thinking and modes of understanding develop (or fail to) over time; if such a portfolio is allowed to grow organically, the very sorts of items students choose to save and comment upon, the ways they choose to represent themselves, can tell a program a great deal about what is and is not having an influence on students over time, what is and is not sticking. In other words, a program can look directly at how a student's work has changed over his or her time at the University, see both what they produced and what they thought about it at a metacognitive level, and get a sense of the real difference what they teach is making. Educators have always wanted to see how students' ways of thinking change over time; it was just never practical in a world of discrete courses in which the work of one term was basically wiped clean to start the next. Now that the products and by-products of a student's education can be digitally preserved and organized, the development of the capacity to think independently can be captured in flight. We'd have a much better idea that learning goals are being met if we found students were spontaneously manifesting them in the way they represented their educations, rather than producing them on command.

Wow, great comments and feedback. I'm going to borrow lots of these for future posts. A few replies:

  • Jim: Sakai 3 embraces, as fundamental, the notion that everyone is a contributor of content. I think making it easy to create, not just consume, is a key part to enabling project-based learning (among other things). You might be interested in some of the Sakai 3 visioning activities that are occurring in the Sakai Teaching and Learning group.
  • Jacques: Yes, I agree and wish I'd made that point as well. Truly successful methods need to be identified and propogated. Technology plays a role in both.
  • Nathan: My ideal for a teacher is more like a coach or a guide (in most cases). But perhaps you misundertand my point. I'm trying to say that introducing "great interactive content" into classrooms with the same instructional models and assessments won't lead to meaningful change (Cuban's point). You have to change all the pieces together. I don't think this will be easy and I'm not optimistic it will happen quickly so I don't have an answer to the questions of scale.
  • Bob: Fantastcially eloquent riff on my comparatively brief (shallow!) mention of portfolios. I'm wondering what you think of what Liz Koelman has to say? (Reforming Liberal Education)

Sorry for the delays in responding to these comments...I need to figure out how to get notified when comments come in. The challenges of changing blogging platforms!

Getting email notification is a registered user account profile setting (the default was set for no notification).

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

More information about formatting options