Standardized Tests: School change at its worst.
I was involved in the discussion the other day about school change when I was asked why I am so opposed to standardized tests. So I thought I would take a few minutes to justify my position.
It’s not that I believe standardized tests are inherently bad. They’re like many other things they are neither good nor bad inherently it’s just how you use them that turnes out to be good or bad.
Let me try to give you an analogy. My son coaches college baseball, he’s a pitching coach. He keeps an array of statistics for his pitchers, one of which is ERA. Earned run average is an important statistic for pitchers, but ultimately if they don’t win the game the ERA may make him feel better but ultimately he, and the other coaches, will lose their jobs if they don’t win enough games. Is the ERA an indicator of how well they’re doing? Yes, but it isn’t the only indicator.
In schools the only indicator that seems to matter are the scores on standardized tests. Yet increasingly our students are unprepared for the world they will live in. Standardized test, while they do give us some information, aren’t the only or the best information. In essence we are raising the “ERA” but losing the game.
In addition, the behaviors that we are instilling in our students as a result of the focus on standardized test are counterproductive to the behaviors that our students need to possess when they leave our schools. Let me explain.
Standardized test prepare every student to answer the same uninteresting questions, using the same uninteresting strategies, to come up with the same uninteresting answers, in the same amount of time. Dan Pink has described this process is algorithmic. Meaning there is a prescribed set of steps to reach a single answer. Mackenzie and Associates estimate that less than 30% of new jobs being created in America are algorithmic in nature. In fact, jobs that are algorithmic in nature are the first ones to be outsourced to other countries, or replaced by technology.
What our kids really need are heuristic behaviors. Heuristic problems have a defined path to solving problems, that lead to one correct answer. Rather there are many ways to approach these problems and there may be multiple solutions. At least 70% of all new jobs being created in America are heuristic in nature according to McKinsey and Associates.
So by focusing on standardized tests we are preparing our students to be perfectly suited for jobs that are least likely to exist, and most likely to be low paying, when they leave our schools. When we talk about school change I think we need to change the conversation from, ”how do we change schools to get higher standardized test scores,” to “how do we change schools to better prepare our students to be productive members of society in the 21st century?” – Steve Wyckoff
Why do so many authors give advice to overcome education?
I used to be surprised, I’m not anymore. It used to be noteworthy when I would read a book and the author would give some advice to help individuals overcome the effects of public education. Today I’m more surprised if I read a book and they don’t give advice to help individuals overcome the effects of public education.
Just recently I have read Linchpin by Seth Godin, Book Yourself Solid by Michael Port, Drive by Daniel Pink, and Inbound Marketing by Brian Halligan. In each of these books there is significant advice for the reader about how they might overcome the learning that they experienced in public school. And these are just a few of the recent examples.
One of the reasons I’m sure I see this a lot is because I read so many books that deal with how to be successful in the 21st century. And our schools have nothing to do with being successful in the 21st century. Our core curriculum has nothing to do with preparing students to be successful as adults. While there is some movement in our high schools to try to do a better job it’s the side dish, not the entrée. Their focus is much more on improving standardized test scores, and preparing kids to go to college. And even in those subjects that don’t do standardized testing, raising test scores is still their excuse for not changing education.
Our two-year post secondary education institutions, community colleges and technical colleges, are doing an excellent job of preparing their students for the real world. Unfortunately we lack emphasis in K-12 schools to prepare our kids to attend those post secondary institutions that prepare students for industry-standard certifications and associate degrees, that lead to high-paying, highly satisfying careers.
I was especially struck by Dan Pink’s description in Drive of the two kinds of work that exist today, the algorithmic and heuristic. Our schools focus almost entirely on preparing students to do algorithmic work, and almost completely ignore preparation for heuristic work. This, in spite of the fact that estimated 70% of all the new jobs being created involve heuristic work. So perhaps the advice that the authors give to overcome the effects of public schools is important and valuable. – Steve Wyckoff
The 10 most important behaviors for students.
Of all the things I speak about, the slide I use that lists 10 behaviors that I identify as “21st-century behaviors” is one of the most popular. I put this list together over the last many years from various sources. To be added to the list a behavior must be frequently mentioned in many sources. The 10 behaviors are:
- Technological Fluency: The ability to use technology as a tool. To be completely comfortable using various forms of technology and use it with the ease that we would use paper and pencil.
- Communication … Verbal proficiency: Of all the subjects we make students take, the one we make them take every year of their educational experience is English/Language arts. You would think with all that effort our students would be excellent communicators. Yet one of the most commonly heard concerns from the business community is the inability of our students to communicate either verbally, or in writing.
- Collaboration … Leadership/Coordination/ Teamwork/Interpersonal Skills/Relationships/horizontal collaboration: The ability to work with others in all of its forms is critical today. Most of our kids will function in work environment that requires them to be a team player.
- Solve Complex Problems: The world we live in and the problems that arise in that world are growing ever more complex. Often times requiring skills and knowledge from multiple disciplines, including use of technology. It is imperative that our graduates have the ability to work in this complex society and solve problems.
- Gumption … Self-Direction and Reflection Skills: Gumption is not a word that we hear often but it describes clearly what employers today expect. We sometimes hear stick-to-itiveness used as a synonym for gumption. The point is in the workplace today when confronted with difficulties individuals are expected to work through the issues, to be self-directed and to stick to a problem until it is solved.
- Creativity and Innovative: Creativity is more often thought about in the extracurriculars but that’s not necessarily the kind of creativeness I’m referring to. While art and music are excellent preparation for the real world, the creativity I’m talking about is the ability to think differently than others and to come up with solutions that not only work but are innovative.
- Analytical and Critical Thinking Skills: Related to gumption and complex problem solving, individual today are expected to analyze the situation and think about it critically and solving problems.
- Initiative, Work Ethic, Honesty, Integrity and Ambition: This collection of adjectives centers on the attributes that are desirable of all employees, and many times are referred to as character.
- Adaptable … Versatilist: In a rapidly changing society it is imperative that individuals are able to adapt to change and modifications in the workplace, practices, and even knowledge. Versatilist is a term that was coined by Thomas Friedman in The World Is Flat to describe those individuals who are versatile and adaptable.
- Inquisitiveness: Last but not least those individuals who are asking why and how, in other words always inquiring in order to improve their knowledge, or processes, or procedures.
In the lower right-hand corner of the slide that I use during presentations I place the following picture. And the question I ask is this, in the classroom pictured can these 10 critical behaviors be practiced on a regular basis? The typical answer, “no.”
For our schools to give students the opportunity to develop these behaviors it is essential that schools, especially high schools, engage in school improvement processes that involve learning by doing rather than memorization for standardized tests. Practicing these behaviors to make them habitual cannot be done sitting in a desk listening to a teacher in a traditional classroom.
Dan Pink would say that we need less algorithmic practice that we see in traditional classrooms, and more heuristic practice to prepare kids for the 21st century. Those heuristic behaviors, innovative and creative, can only be practiced in an environment that is more customized and individualized for each student. – Steve Wyckoff
School Reform: What will it take?
For the last 20+ years I’ve constantly considered what it would take to make systemic change in the public education system. I’ve looked at it from every angle and I’ve changed my mind many times. Apparently, this is another one of those times, because I have change my mind again. In the past I’ve looked at policies, regulations, and practices, from the perspective of what should we require schools to do. I’ve considered universal vouchers, and while I think they are still a good idea, they aren’t going to happen, and even if they did under the current conditions it wouldn’t change much. I admit that up until now I’ve got universal vouchers were the answer.
Let me explain. I think vouchers, at least in a state like Kansas, would be very much like the charter schools. The charter school law while well-crafted, and well-meaning, has had little or no impact on the educational system. This is true in Kansas because control of charter schools has been left in the hands of local school districts and the state Board of Education. To become a charter school in Kansas, in spite of what the law says, you must look exactly like traditional public schools, in order to be granted a charter. This clearly violates the intent of the law, but I think lawmakers were more concerned with having a charter school law that having charter schools.
I realize that in some states charter schools have had a tremendous impact in terms of systemic change. States where this has occurred have had the benefit of a charter school law that is strong, and a legislature that intended to really have innovation in their schools. Neither of these is true in a state like Kansas.
So why do I think vouchers would fail in a state like Kansas? They would fail because there are so many regulations and policies that force every school to operate within the very narrow parameters of what we’ve always done in school. On top of that overcoming the inertia of more than 100 years in the current system is a daunting task.
What’s become clear to me is that if we really hope to implement real systemic change in public schools the solution lies in eliminating or dramatically reducing the ability of the state Department of Education and the state Board of Education to regulate and control schools. In an age of customization and individualization in all aspects of our life, it makes no sense for 10 laypeople to make decisions that require every single school in the state to behave in exactly the same way. Nor does it make sense to have bureaucrats make decisions that each and every school must follow in spite of the fact that in almost all cases there are many possible solutions that might work well.
Again I refer to Dan Pink’s book, Drive, or perspective. Pink outlines the factors that lead heuristic behavior. Exactly the kind of behavior we need in our schools if we hope to meet the needs of our students in the 21st century. One of the key elements that Pink talks about his autonomy. He identifies four components that must be present to satisfy the need for autonomy. He called them the four “T’s”: the task, the time, the technique, and the team,
The task is what you actually have people working on, they must have some control over the task. Currently the KSDE, and KSBE, are continually narrowing down exactly what the task is that schools must accomplish in spite of the fact that neither students nor society are served well by the defined tasks. They define the core curriculum, most of which is out of date, and the metrics for measurement, define standardized tests, that turn our kids into test taking machines and our schools into test preparation academies. If regulations didn’t exist mandating exactly what every student will receive in school, schools would immediately start to redefine what it is they want every student should know, do, and be like. And in turn to a much better job of meeting the needs of individual students and society.
The second “T” time is also mandated by the state. In fact every school must account for 1118 hours (I think that’s the right number, but it’s so irrelevant who would bother to remember it). In addition there are hosts of regulations and guidelines surrounding the “how’s” and “when’s” those hours must be counted. Another side effect of standardized testing mandated by the state and federal government, is that schools are controlling the timing of instruction and learning more rigidly than ever before. Which flies in the face of the fact that all kids learn at a different pace and are ready to learn things in a different time.
The third “T” is technique, the how you go about your business. Through certification requirements and collaboration with colleges, every teacher must be certified in the subject area that they teach. This ensures that how we teach and what we teach will never very from a traditional classroom model. This model is several centuries old now. I do concede that we are doing the best job of traditional instruction that we’ve ever done. The research surrounding this method is extensive. But it leaves no latitude other than direct instruction as the dominant instructional mode.
The fourth “T” is team, or who you work with. Once again through certification and departmentalization, mostly as a result of college entrance requirements, teachers work in isolation, teaching their subject in isolation. Not only do they not have the choice of who they team with, they don’t team. We do have anecdotal evidence of schools that are promoting teaming among their teachers, but they certainly are not the rule, nor do they seem to have much shelflife.
My contention, that if we would eliminate most of the rules and regulations forced upon us by state and federal regulations and policies we would see the kind of innovation that occurs in other industries, and a real focus on preparing students for their future, rather than forcing them to “fit” into a system that is over 100 years old.
Leave me a comment, I’d love to hear from you.
Why our kids aren’t prepared for their future
One of the biggest issues that we face in education is that we are in adequately preparing our kids for their future. I recently finished Dan pink’s new book Drive, and sure enough more evidence that we’re not preparing our kids for the 21st century.
Let me explain. In his book he talks about two kinds of work. The first, algorithmic, “are those tasks in which you follow a set of established instruction down to a single pathway to one conclusion.” The second, heuristic, are “tasks that are just the opposite. Because no algorithm exists for it, you have to experiment with possibilities and devise a novel solution.” Now, which of those most sound like school. You got it, the vast majority of the work done by our kids in school is algorithmic. In fact, the measure that the public, well politicians anyway, love is the standardized test. Most of which measure how well the student follows established instructions down a single pathway to one conclusion.
Interestingly, those activities in school that are most algorithmic are in our beloved core curriculum. Which by the way happen to be the classes that kids see as the most boring and irrelevant. On the other hand, those activities which are the most heuristic are found in the co-curricular courses, and extracurricular activities. Drama, band, art, newspaper, yearbook, athletics … you get the picture.
But here’s the kicker, again from Pink’s book, “McKinsey & Co. estimates that in the United States, only 30% of job growth now comes from algorithmic work, while 70% comes from heuristic work.” He goes on, “A key reason routine work can be outsourced or automated; artistic, empathic, nonroutine, work generally cannot.”
One of my favorite educational researchers Larry Lezotte always said, “What gets measured gets taught.” Well, what we’re measuring in schools is the algorithmic stuff, that means that it will get taught! So we are doing a great job spending most of our time making sure that students acquire the skills and behaviors that are most likely to be outsourced to other countries.
What do you think? Leave me a comment.
