Showing posts with label math wars. Show all posts
Showing posts with label math wars. Show all posts

Starting the Standards Era: NCTM and the 1980s (Part 6 of 6, Focusing the Council on Standards)

(See Part 1, Part 2, Part 3, Part 4, and Part 5 of this six-part series.)

The successful release of the 1989 NCTM Standards paved the way for the release of the next two NCTM standards documents, the Professional Standards for Teaching Mathematics (1991) and the Assessment Standards for School Mathematics (1995). While neither received all the attention of the 1989 Standards, a change in administration in the federal government and changing attitudes at private foundations meant money for later Standards-based projects was more easily obtainable.

In order to provide teachers and district-level mathematics specialists a clearer vision of what Standards-guided lessons would look like, the NCTM launched a project called the Addenda Series, with a committee chaired by Bonnie Litwiller of the University of Northern Iowa1. Although initially intended to produce just a few books a year for one or two years, the project eventually produced 22 books in five years, covering all grade levels K-12. Each book in the Addenda Series provided a set of lesson plans that a teacher could use directly in his or her classroom, offering some of the specificity lacking in the original Standards. The Addenda Series also supported NCTM financially, as it became their most profitable set of publications (S. Frye, personal communication, April 19, 2013).

In order to focus all the NCTM publications on the Standards, a deliberate effort was made by the editors of NCTM's journals to acquire and publish articles that cited the Standards (Lindquist, 2003, p. 837). Authors of research articles that did not refer to the Standards were asked as part of the peer review process to refocus their writing to include the Standards. With this de-facto policy in place, soon nearly every article listed the Standards as a reference. Somewhat ironically, the Standards themselves contain a reference list of only 27 sources (NCTM, 1989, pp. 257-258).

Conclusion

The creation and publication of the NCTM Standards is generally recognized as the event that launched our current era of standards-based reform. Given the rapidity with which educational reforms come and go, such a lasting impact from a document published almost 25 years ago deserves to be well-understood by education policymakers as well as teachers and other education stakeholders. The most significant positive, negative, and fortunate aspects of NCTM's Standards process can be summarized as:

Positive:

  • Leadership desired an organization-level policy influence.
  • Working groups possessed expertise and represented diverse stakeholders.
  • Goals were set conservatively in an effort to broaden public acceptance.
  • Drafts of the Standards were sent to a very wide audience for review and commentary.
  • Standards were promoted through a massive public relations campaign.

Negative:

  • Despite seeking consensus, reconciliation with the most vocal critics in the mathematics community has yet to happen.
  • The working groups lacked writing talent.

Fortunate:

  • A well-timed "crisis" came in the form of A Nation at Risk.
  • NCTM membership rebounded in the mid-80s before the Standards project had an opportunity to put the organization in greater financial jeopardy.
  • Attitudes about the federal government's role in education, as well as national efforts like the Standards, became more favorable after the end of the Reagan Administration.

It's evident that NCTM's leadership in standards-based educational reform didn't come without a sizeable bit of good fortune. The shifting of any number of events by a year or two might have jeopardized the entire process, or relegated the Standards to be that "book on the shelf" to which few paid much attention.

When compared to the Common Core State Standards, a few significant differences stand out to me. First, the NCTM Standards were created largely for the purposes of comparing and judging curriculum, whereas the CCSSM were created as student learning targets and as part of a larger accountability structure. The NCTM Standards were not grade-level specific like the CCSSM, nor were they ever "adopted" wholesale by states or districts. Instead, the NCTM Standards became a foundation for states and districts to write their own standards, and the CCSSM represents the effort to de-duplicate the efforts of states by having a single, agreed-upon set of standards. Although not without their detractors, standards efforts on this scale do have the potential to drive positive change and anchor collaboration between educators across states and districts. Time will tell if any lasting effects of the CCSSM measure up to those of the NCTM Standards, and how.

References

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

National Council of Teachers of Mathematics. (1991). Professional standards for teaching mathematics (p. 196). Reston, VA: Author.

National Council of Teachers of Mathematics. (1995). Assessment standards for school mathematics (p. 102). Reston, VA: Author.


  1. Bonnie Litwiller was my academic advisor and twice my methods professor while I was an undergraduate mathematics major at UNI. 

Starting the Standards Era: NCTM and the 1980s (Part 5 of 6, Making a Draft Widely Available for Review; Publishing and Promoting)

(See Part 1, Part 2, Part 3, and Part 4 of this six-part series.)

So far this series has described the first three of six characteristics of the policy process I outlined in Part 1. This installment will look at the next two characteristics. Despite their shorter descriptions, both were critical in NCTM's effort to have the Standards see wide adoption.

Making a Draft Widely Available for Review

There was one aspect of the Standards draft review process that had significant policy implications. Instead of just sending drafts to a limited number of outside experts, as is often the norm in such cases, NCTM sent out 10,000 copies of the 1987 draft to more than fifty other groups with interests in mathematics education (McLeod, 2003, p. 779). Every single page of the draft contained room for comments, and the working groups received comments by the thousands. Not only did such wide distribution create anticipation for the final draft, the NCTM garnered the support of sixty organizations whose names were printed in the opening pages of the final draft (NCTM, 1989, pp. vi-viii). Listing as endorsers the American Mathematical Society, the American Statistical Association, the Mathematical Association of America, and the Mathematical Sciences Education Board helped moderate the opinion by some that mathematicians were excluded from the Standards writing process.

In the end, the Standards incorporated the perspectives of many people and organizations, but not without compromise. Building consensus while being provocative is a tricky balance, something to which Michael Apple (1992) applied the term "slogan system," meaning they were

a statement of goals that was specific enough to provide direction to the field, vague enough to be acceptable to most mathematics teachers, and novel enough for its vision to catch the attention of the many different groups having a stake in mathematics education. (McLeod, 2003, p. 783)


Publishing and Promoting

While the public relations campaign undertaken by the NCTM to promote the Standards may not have been notable from Mary Lindquist's perspective as a writer (see the difference between her four characteristics and my six in Part 1), it certainly deserves attention as a matter of policy. Without a massive effort, the immediate and lasting policy influence of both the NCTM and the Standards would have certainly been reduced. By the time of publication in March 1989, the total expense of the Standards project had reached approximately $1,000,000, far exceeding the initial estimate of $258,000 (McLeod et al., 1996, p. 44). Included in the million-dollar total was $200,000 in expenses paid to public relations firms. Without this and continuing effort, the worry was that the Standards would be resigned to "sit on shelves" (Lindquist, 2003, p. 840), where all but a few curious graduate students would ever look at them again.

The public relations efforts had all the signs of a six-figure expense (McLeod et al, 1996, pp. 15-16). First, NCTM leadership, including President Shirley Frye and Tom Romberg, were coached to improve their ability to positively present themselves and to handle tough questions gracefully. They then hosted a press conference in Washington D.C. for about 200 members of the media. NCTM leaders made appearances on the Today Show and other major news programs and Astronaut Sally Ride was brought in to help by lending her endorsement. A video featuring jazz musician Wynton Marsalis describing the Standards was "shown over 6000 times by 121 television stations, reaching an audience in the millions" (McLeod et al., 1996, p. 64).

Perhaps most significant was how many copies of the Standards the NCTM had arranged to give away. Unlike the Agenda's relatively short 30 pages, the Standards were 258 pages in length. Still, the NCTM gave away a copy to each one of their 51,000-plus members, as well as anyone and everyone who might have influence but wasn’t an NCTM member. Judith Sowder, Standards Coordinating Committee chair, remembered:

The mailing lists were enormous. The NCTM lobbyist took [the Standards] around personally and handed them to members of Congress. Certainly every dean of sciences, every chair of a mathematics department, every math coordinator, high school principal, and elementary school principal who was on our mailing lists got one. We sent to PTA presidents, school board presidents, and on and on and on. Every mailing list that could possibly be used was used. (McLeod et al., 1996, p. 63)

While the size of this giveaway represented a huge cost to NCTM, it was necessary to ensure widespread adoption. Fortunately for NCTM and their budget, by 1995 more than 258,000 copies of the Standards had been distributed, including the giveaways, and the $25 cost per purchased copy made up for the lost revenue and helped pay for the expenses of the project (McLeod et al., 1996, p. 63).

Now that NCTM had written, published, and promoted the Standards, the last important piece was to make sure they played a part in future efforts. In Part 6, we'll look at how the NCTM focused efforts around the Standards, and I'll wrap up the series with some reflection.

References

Apple, M. W. (1992). Do the standards go far enough? Power, policy, and practice in mathematics education. Journal for Research in Mathematics Education, 23(5), 412-431. doi:10.2307/749562

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

Starting the Standards Era: NCTM and the 1980s (Part 4 of 6, Establishing and Supporting Working Groups)

(See Part 1, Part 2, and Part 3 of this six-part series.)

NCTM's standards-writing process began in 1986 when the Council proposed the creation of a Commission on Standards, chaired by Tom Romberg, and four working groups: grades K-4, 5-8, 9-12, and evaluation. Each working group was chosen for its expertise and consisted of six people, generally a mix of mathematics teachers, state and district math supervisors, mathematics professors from major university mathematics departments, and mathematics education researchers (Lindquist, 2003, pp. 826-827; McLeod, 2003, pp. 772-773). The working groups were somewhat conservative, as radical suggestions would likely make for a less marketable policy recommendation. John Dossey, then president of NCTM, remarked that each group included

somebody who had been around and had a lot of experience – who could represent not a traditional view, but someone who understood the status quo well, who understood the dangers of change, and who was a worker for change, but who knew that you could not just flip a switch and have it happen. (McLeod et al., 1996, p. 46)

While expertise and diversity are generally key ingredients in a policy-making process, a quality that may have been overlooked was the recruitment of quality writers. While some members of the working groups had written textbooks, "neither writing experience nor the ability to produce polished prose was a criterion for selection, and the writing teams often struggled to produce high-quality text" (McLeod, 2003, p. 774). Writing quality was an unexpected struggle during the almost two-year process of writing the Standards.

Although the working groups were tasked with writing standards focusing on mathematical content, they were also mindful of equity issues – including how the inclusion of equity statements might help or hinder the adoption of the Standards. Christian Hirsch, chair of the 9-12 working group, remarked:

I think a careful look at the Standards would show that, in the case of the high school mathematics curriculum, there were two issues that the Standards politically decided not to take a stand on. One was the issue of tracking, and the other was the issue of whether the mathematics studied each year at the high school should be an integrated or unified curriculum, as opposed to a curriculum that was subject-matter oriented each year: algebra, geometry, advanced algebra. That decision was very conscious, in that we felt that we needed to identify in the Standards what we believed at the time in history to be the most important mathematics that all students should have the opportunity to study. And that in itself was advancing thinking on the curriculum quite a ways, because if one looked at the curriculum of the 1970s and 1980s, there was a marked contrast between the mathematics that was in college prep programs and the mathematics that one found in general math, consumer math, remedial courses. We felt it was most important to get out on the table (and over time gain acceptance for) the notion that all kids should be studying different mathematics, rather than getting the Standards caught up in a heated debate over how that mathematics could be organized and made available to students – that is, through sequences of courses that may or may not be tracked. (McLeod et al., 1996, pp. 56-57)

With the exception of a small grant from the AT&T Foundation for $25,000, NCTM chose to finance the writing of the Standards themselves, despite having recently been in significant financial difficulty. The organization had seen its membership fall from 82,000 in 1968 to 56,000 in 19831, and the loss of revenue forced the Board of Directors to consider a proposal to eliminate NCTM's publication program (McLeod et al., 1996, p. 20). Despite the risk of bearing the responsibility for the Standards total estimated cost of $258,000 (McLeod et al., 1996, p. 42) former Executive Director James Gates claimed "the proposal [to fund the Standards] was not submitted to either NSF or the U.S. Department of Education, so that no claims could be made that the federal government had funded the development of curriculum and evaluation standards" (Gates, 2003, p. 742). In addition, the self-funding of the Standards and the decision to not write textbooks, as had been the case during the new math era, afforded the working groups relative independence from textbook publishers. The "corrupting process" (McLeod et al., 1996, p. 33) of working with textbook publishers was a shared concern among the working groups, explained by Arthur Coxford in his chapter in A History of School Mathematics:

Publishers tend to be concerned with the 'bottom line,' whereas curriculum developers desire to try new ideas and organizations. Editors for publishers listen carefully to state textbook adoption committees and to teachers in the field. Neither of these groups was demanding radically different curricula in the 1980s. In fact, they often recommended retaining topics (Cramer's rule or computation using logarithms, for example) long after the usefulness, mathematical or in application, of the topic had diminished. Often it seemed such recommendations were based on an individual's opinion rather than the result of a careful analysis of needs. (Coxford, 2003, p. 613)

While self-funding did afford the working groups a degree of independence and James Gates' statement is at least partially true, the reality of the situation is that the federal government had very little, if any, money to give for a project like the Standards. In 1982, the Reagan Administration has stripped all K-12 funding for mathematics and science from NSF's budget (McLeod et al., 1996, p. 25). Moreover, the same Reagan Administration that had recently sought to dismantle the U.S. Department of Education in the name of local control was not likely to award large sums of money for the development of a national set of curriculum standards. NCTM had applied for a sizable amount of other private money, but the AT&T grant was the only one awarded. Clearly the organization had no other real options but to pay for the Standards itself and use the independence to its advantage, including spinning the effect of that independence as a policy tool.

In Part 5 of this series, we'll look at how NCTM collected and incorporated feedback about the Standards and the measures they took to promote the published draft.

References

Coxford, A. F. (2003). Mathematics curriculum reform: A personal view. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 599-621). Reston, VA: National Council of Teachers of Mathematics.

Gates, J. D. (2003). Perspective on the recent history of the National Council of Teachers of Mathematics. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 737-752). Reston, VA: National Council of Teachers of Mathematics.

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Teachers of Mathematics. (2013). NCTM at a glance. Retrieved from http://www.nctm.org/about/content.aspx?id=174


  1. Membership began to rebound in 1984. NCTM's membership grew to 118,000 in 1995 (McLeod et al., 1996, p. 20) and currently stands at 80,000 members (National Council of Teachers of Mathematics, 2013). 

Starting the Standards Era: NCTM and the 1980s (Part 3 of 6, Meeting a [Perceived] Need)

(See Part 1 and Part 2 of this six-part series.)

"Exactly where the Agenda's call for action might have led without the appearance of a new crisis is not clear" (Fey & Graeber, 2003, p. 553). If the research and public sentiment regarding mathematics education had looked positive as the country moved into the 1980s, there would have been little need for the NCTM to flex its new policy muscles. But that wasn't the case. Instead, growing concern over the state of math education would give the NCTM a reason to put the Agenda for Action into action.

In the late 1970s, the NSF funded a series of surveys and case studies to determine a baseline of the nation's mathematics performance. The case studies indicated that most classrooms were still exhibiting a traditional view of mathematics and showed little influence of the new math efforts of the 1960s (McLeod, 2003, p. 757). Furthermore, early results from the National Assessment of Educational Progress (NAEP) raised doubts that students were able to perform anything but the most basic mathematical tasks.

Less publicly visible but yet of concern to mathematics educators was the continued trend towards "basic" math textbooks. In particular, the claims of outspoken textbook author John Saxon "became a preoccupation of NCTM leaders" (McLeod, 2003, pp. 760-761). Saxon (1982), in a three-page Phi Delta Kappan article, made boisterous claims about the effectiveness of his textbooks. The article lacked a description of how (or if) the treatment and control groups were randomized, what textbooks were used by the students in the control group, how the assessment used to measure students' learning was constructed, and failed to use any real statistical tests. It did, however, include the address of the publisher and the cost of his textbook, as well as statements like, "A general scanning of the scores suggests that gifted students who used the normal textbooks were severely damaged and that less gifted students who used the normal textbooks were destroyed" (p. 484).

NCTM’s Research Advisory Committee (RAC) fielded concerns over Saxon's claims, some requesting censure of Saxon's texts and others requesting further research regarding the effectiveness of the Saxon texts. John Dossey, NCTM president from 1986-1988, recalled that "RAC members felt that it was inappropriate for professional groups to censure material, especially in the absence of an agreed-upon set of standards" (McLeod et al., 1996, p. 31). Concurrently, NCTM's Instructional Issues Advisory Committee (IIAC) was considering the creation of a document that could be used by schools when selecting textbooks. Jim Fey, an IIAC member at the time, said, "There was some concern from several places that textbooks, and therefore curricula, were being driven by non-professional considerations, political log rolling, and so on" (McLeod et al., 1996, p. 31). The RAC and IIAC were already considering such a textbook selection document in the spring of 1983 when a much more public educational crisis would demand the attention of the NCTM.

In April the National Commission on Excellence in Education (1983) published A Nation at Risk: The Imperative for Educational Reform. This critical document used Cold War-era language combined with threats of losing our nation's economic competitiveness to assert that it was imperative that schools change to meet the nation's growing needs. A Nation at Risk convinced many that an increase in the amount rigorous coursework required in schools, specifically in mathematics and science, should be a top national priority. While there is substantial evidence suggesting that the nation wasn't any more "at risk" than it ever had been (Berliner & Biddle, 1995), the perception of risk was more important than the truth.

By the end of 1983, two small conferences were held to determine the math education community's response to A Nation at Risk. Only sixty-eight people attended in total, with only six people attending both conferences (McLeod, 2003, p. 767). One of those six people was Tom Romberg, the University of Wisconsin professor who would later be named chairperson of the NCTM Standards Commission. Among the recommendations to come out of those conferences was the organization of a group who could write a set of guidelines specifying qualities of a proper mathematics curriculum (Romberg & Stewart, 1984).

Romberg remembered that "A Nation at Risk served primarily as a spark plug, a starting point for people" (McLeod et al., 1996, p. 27). Others downplayed the influence of A Nation at Risk. Mary Lindquist claimed "The Standards came mainly from within mathematics education rather than as a reaction to A Nation at Risk or federal policies" (McLeod et al., 1996, p. 37). The deciding measure of A Nation at Risk's impact might be found in the Standards themselves, in the first line of the first paragraph of the Introduction: "These standards are one facet of the mathematics education community's response to the call for reform in the teaching and learning of mathematics" (NCTM, 1989, p. 1). The footnote for that sentence contains the statement "See A Nation at Risk."

NCTM had prepared itself to take a stand on matters of policy and now they had their greatest opportunity. In Part 4 of this series, we'll look at how NCTM organized itself to write the Standards, and the risks they took and avoided in doing so.

References

Berliner, D. C., & Biddle, B. J. (1995). The manufactured crisis: Myths, fraud, and the attack on America’s public schools (p. 414). New York, NY: Basic Books.

Fey, J. T., & Graeber, A. O. (2003). From the New Math to the Agenda for Action. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (Vol. 1, pp. 521-558). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM‟s role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, D.C. Retrieved from http://www2.ed.gov/pubs/NatAtRisk/index.html

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

Romberg, T. A., & Stewart, D. M. (Eds.). (1984). School mathematics: Options for the 1990s. Retrieved from http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED250196

Saxon, J. (1982). Incremental development: A breakthrough in mathematics. Phi Delta Kappan, 63(7), 482-484. Retrieved from http://www.jstor.org/stable/20386409.

Starting the Standards Era: NCTM and the 1980s (Part 2 of 6, Asserting a Policy-Minded Orientation)

From the NCTM's inception in 1920 until the 1960s, the organization "played an important but usually secondary role" (McLeod, Stake, Schappelle, Mellissinos, & Gierl, 1996, p. 18) in mathematics education policy. NCTM's primary role "focused on supporting mathematics teachers through the exchange and promotion of good ideas, not through its influence on educational policy" (McLeod, 2003, p. 759), and many NCTM leaders thought it was best to avoid "positions that might be opposed by some of its members" (McLeod et al., 1996, pp. 18-19). Therefore, during the Sputnik-era calls for reform in the late 1950s and the "new math" era of the 1960s (Fey & Graeber, 2003), organizational leadership from NCTM was insignificant.

Fueled by the battles over the new math and events of the mid-1960s, attitudes at NCTM began to change:

Although the attempt to change school mathematics during the new math era was not very successful, the idea that an activist professional organization could have an impact on society still had some appeal. The change from passive to more active stances was a topic of discussion for many professional organizations during the 1960s and 1970s. Opposition to the war in Vietnam was one source of these discussions. As academics became involved in teach-ins and other protests against the war, there was a natural spread of their concerns into the domain of professional organizations. (McLeod, 2003, p. 758)

NCTM's hands-off policy stance changed in 1966 when the Board of Directors voted to be more willing to assert its position on controversial issues. Reflecting on his thirty-one years (1964-1995) as NCTM Executive Director, James D. Gates (2003) characterized the decision and its effects: "It was a bold step for the Council, to take actions that were more visible in the public sector, leading to the development and distribution of position statements, the publication of guidelines and standards, and testimony before congressional committees" (p. 747).

While the NCTM struggled to use its new policy-minded powers during the 1970s (Fey & Graeber, 2003), the critical turning point came with the election of Shirley Hill as NCTM President in 1978. Joe Crosswhite, NCTM president from 1984-1986, remarked that, "Prior to Shirley's time, you couldn't interest an NCTM president in having a national presence in Washington – an NCTM presence" (McLeod et al., 1996, p. 19). Shirley Hill explained that she

felt a certain frustration that we weren't being listened to seriously enough outside our own circles....I remember attending some meeting of the presidents of like organizations in Washington, DC, in the 1970s and noticing the frequent absence of the president of one of our sister organizations. It turned out that he was being escorted by his staff government relations expert in visits to members of Congress. At that time his organization seemed to be very influential in the establishment of federal programs. I thought that we in NCTM should be doing more of these things. I thought that we and most of our sister organizations were being a little naïve about government relations and public relations at that time. (McLeod et al., 1996, pp. 19-20)

In addition to hiring Richard Long, a former lobbyist for the International Reading Association (McLeod, 2003, p. 760), two documents published by NCTM during this time mark NCTM's emerging policy perspective. The first was actually a republishing of a position paper of the National Council of Supervisors of Mathematics (NCSM), a sister organization of the NCTM. The paper, A Position Paper on Basic Mathematical Skills (1977), was notable because instead of refuting the "back to basics" theme of school mathematics in the 1970s, it co-opted the language and redefined the meaning of "basic skills" for NCSM's and NCTM's own purpose (Fey & Graeber, 2003, p. 552; McLeod, 2003, p. 761). With this action, NCTM and NCSM showed that both organizations understood the importance of controlling the vocabulary and discourse in educational policy.

The second document published by the NCTM solidified their stance as a policy influencer. The Agenda for Action (1980) was the product of NCTM's Committee for Mathematics Curriculum for the 1980s, chaired by George Immerzeel of the University of Northern Iowa. While only about thirty pages in length and containing eight somewhat non-specific recommendations, the Agenda was NCTM's most prominent and powerful policy document to date, and "laid the groundwork for a major reform effort that continued through the end of the twentieth century" (Gates, 2003, p. 741). Shirley Hill described the context for the Agenda at her 1980 presidential address:

In the 1960s we learned that curriculum change is not a simple matter of devising, trying out, and proposing new programs. In the 1970s we learned that many pressures, from both inside and particularly outside the institution of the school, determine goals and directions and programs....A major obligation of a professional organization such as ours is to present our best knowledgeable advice on what the goals and objectives of mathematics education ought to be....In my opinion, we are approaching a crisis stage in school mathematics. Policy makers in education are not confronting the deepest problems because the public and its representatives have been diverted by a fixation on test scores....We are still battling an excessive narrowing of the curriculum in the name of "back to basics." (Hill, 1980, pp. 473-476, as cited in McLeod et al., 1996, pp. 24-25)

Furthermore, in the introduction of the 1983 NCTM Yearbook, The Agenda in Action, Shirley Hill described the NCTM's implementation of the Agenda in five categories:

  1. Public relations.
  2. Political action.
  3. Support for local efforts.
  4. Collection and dissemination of model programs.
  5. Production of guidelines and instructional resources.

Certainly the first two items in the list would have been far less likely to appear even ten years earlier. The words and actions of Shirley Hill clearly demonstrate the policy orientation NCTM had asserted by the early 1980s. But a willingness to affect policy and an opportunity to affect policy are two different things, and that opportunity would come soon enough. In Part 3 of this series, we'll look at the events that set NCTM to work on the Standards.

References

Fey, J. T., & Graeber, A. O. (2003). From the New Math to the Agenda for Action. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (Vol. 1, pp. 521-558). Reston, VA: National Council of Teachers of Mathematics.

Gates, J. D. (2003). Perspective on the recent history of the National Council of Teachers of Mathematics. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 737-752). Reston, VA: National Council of Teachers of Mathematics.

Hill, S. (1983). An agenda for action: Status and impact. In G. Shufelt & J. R. Smart (Eds.), The
agenda in action
(pp. 1-7). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Supervisors of Mathematics. (1977). Position paper on basic mathematical skills (p. 4). Minneapolis, MN. Retrieved from http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED139654

National Council of Teachers of Mathematics. (1980). An Agenda for Action: Recommendations for School Mathematics of the 1980s. Reston, VA. Retrieved from http://www.nctm.org/standards/content.aspx?id=17278

Starting the Standards Era: NCTM and the 1980s (Part 1 of 6, Where Curriculum and Policy Meet)

The Common Core State Standards might be the current story, but to gain a broader perspective of this "standards era" of educational reform we would be wise to look at where the era got its start. Over the next six posts, borrowing generously from the work of Douglas McLeod and others, I'll attempt to tell the story of how the National Council of Teachers of Mathematics (NCTM) created the first widely-recognized set of curriculum standards, and the policy process that developed along the way.

NCTM's publication of the Curriculum and Evaluation Standards for School Mathematics (1989) stands as the landmark event that launched our nation's current era of standards-based educational reform1. While the effect of this effort led to a new period of reform in school mathematics, marked by new textbooks and materials and what has come to be known as the "math wars," the process undertaken by NCTM in writing the Standards has been both praised and panned by critics. Diane Ravitch (1995) claimed the Standards "emerged from a successful consensus process that included many classroom teachers and the nation's leading mathematics educators.... [They are] an example for emulation" (p. 57). Roy Romer (1995), then the Governor of Colorado, said the Standards "were arrived at correctly, from the bottom up. They represent the best thinking in the country, collectively" (p. 67).

Critics were far tougher on NCTM and the process for writing standards for school mathematics. Ralph A. Raimi, a prominent figure in the math wars, claimed that whenever he was asked to help write or review math standards, he'd send the following recommendation:

If your standards were composed without the significant participation of mathematicians, let me advise you to go down to your best state university and find a professor of mathematics, at least 40 years old, who is willing to help you. He need not have heard of Piaget and Bruner, and he might very well be of such a personality that you would never trust him in a fifth grade class, but he should be an English-speaking American who himself has gone through our public school system, and he should be a genuine mathematician who has published at least a handful of research articles in the refereed professional journals of pure or applied mathematics. (Not journals of math education; you have such people in your department of education already.) Find out that this mathematician is willing to devote a few days to your project. Give him a copy of the Fordham Foundation report on the state standards to read....Then give him a copy of your own state's draft standards and ask for written commentary. Then use it. (Raimi, 2000, p. 57)

Raimi's suggested process for writing or reviewing mathematics standards might have some admirers, but it does not reflect the process undertaken by most standards-writing groups who wish to have a lasting impact on education practice and policy. Because the NCTM Standards have had an influence lasting now over twenty years, this series of writings will examine the specific process undertaken by NCTM that led to the publication of the Standards in 1989.

The Standards as a Policy Process

A review of the literature describing the NCTM's efforts can be undertaken from multiple perspectives. Teachers of mathematics might be most interested in the content of the Standards themselves, along with the contrasting arguments that influenced the curricular content emphasized and de-emphasized by the Standards. Historians of education might wish to study the development of the Standards as a sequence of events set in the context of greater educational and societal movements. Those who participated in the writing of the Standards bring yet another perspective of the process, such as that of Mary Lindquist, a member of the Grades K-4 working group that wrote the Standards. In Lindquist's chapter of NCTM's A History of School Mathematics (2003), she describes the effort to develop and promote the standards as having "four fundamental characteristics:"

  1. Accepting responsibility for standards.
  2. Establishing and supporting working groups.
  3. Making a draft widely available for review.
  4. Focusing the Council on standards.

Although any review of the NCTM's standards-writing process will probably be more alike than different, to gain a broader, policy-making perspective, this series of posts will be organized into six areas that share much similarity with Mary Lindquist's fundamental characteristics:

  1. Asserting a policy-minded orientation.
  2. Meeting a (perceived) need.
  3. Establishing and supporting working groups.
  4. Making a draft widely available for review.
  5. Publishing and promoting.
  6. Focusing the Council on standards.

The addition of the first two areas acknowledges that efforts to impact policy are: (a) generally conscious efforts undertaken by an organization and (b) most successful when done in response to a perceived crisis. The fifth area, publishing and promoting, describes the sometimes extraordinary effort an organization must take to make their message heard and to make it lasting.

In Part 2, we'll look at how and why NCTM decided to assert itself in the education policy arena.

References

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

National Council of Teachers of Mathematics. (1991). Professional standards for teaching mathematics (p. 196). Reston, VA: Author.

National Council of Teachers of Mathematics. (1995). Assessment standards for school mathematics (p. 102). Reston, VA: Author.

Raimi, R. A. (2000). Judging state standards for K-12 mathematics education. In S. Stotsky (Ed.), What’s at stake in the K-12 standards wars (pp. 33-58). New York, NY: Peter Lang.

Ravitch, D. (1995). National standards in American education (p. 223). Washington, D.C.: Brookings Institution.

Romer, R. (1995). Explaining standards to the public. In D. Ravitch (Ed.), Debating the future of American education: Do we need national standards and assessments? (pp. 66-72). Washington, D.C.: Brookings Institution.


  1. Although NCTM’s Curriculum and Evaluation Standards for School Mathematics is just the first in a set of three publications, with the second two addressing the teaching (NCTM, 1991) and assessment (NCTM, 1995) of mathematics, this first document is the most well-known and is frequently referred to simply as the Standards. ↩

RYSK: Dewey's The Child and the Curriculum (1902)

This is the 20th in a series describing "Research You Should Know" (RYSK).

In my last RYSK post, I joined some other math teachers in discussing Richard Skemp's Relational Understanding and Instrumental Understanding (1976). Skemp's is a classic article that wrestles with a duality; in Skemp's case, the distinction between math for procedural skill versus a deeper mathematical understanding. For this meeting we turned the clock back further to Dewey's The Child and the Curriculum (1902), another classic article struggling with a duality in learning.

As D. C. Phillips (1998) noted in his review of The Child and the Curriculum, Dewey had a particular passion for dualisms, addressing more than three dozen of them in Democracy and Education (1916) alone. As Skemp and many others have shown, dualisms can be a starting point towards building a more nuanced understanding, as "neither is the world divided into a series of polar opposites, nor is it one" (Phillips, 1998, p. 404). Somewhere in between the opposites and the same lies the understanding many of us seek.

The Child and the Curriculum presents a particular dualism that very much persists to this day: should education be rooted in content, or in the needs and wants of the child? In Dewey's time, the push for a content focus was seen in the report by The Committee of Ten, not totally unlike how we currently push for content with documents like the Common Core State Standards. Dewey, like Skemp, also uses the metaphor of the map, using it to describe the logical versus psychological ordering of subject matter. Again, we still struggle with this duality today; last November Jere Confrey remarked at a conference, "There are some parts of the common core standards that I would express as mathematicians’ thought experiments," meaning we often guess how mathematical understanding is developed based on the structure of the mathematics instead of research on how children actually learn. These, of course, are not opposites, but they aren't the same, either.

Most of our discussion used Dewey as a prompt for thinking how Dewey's words more than a century ago frame modern challenges in education. (Reading Dewey seems particularly good for this kind of activity.) I was joined by +Nik Doran, +Bryan Meyer, +Nat Banting, and +Chris Robinson was feeding us ideas in the chat as we went along.



I plan to have more of these discussions, and hope we can get into some literature that really addresses research in math education versus some of these more theoretical or philosophical pieces. If you have suggestions for articles to read, please add them and vote them up or down in Google Moderator!

References

Phillips, D. C. (1998). John Dewey’s The Child and the Curriculum: A century later. The Elementary School Journal, 98(5), 403–414.

NCTM Denver 2013: Boaler's Using Research to Make a Difference

Research Presession - Plenary Session - Wednesday, April 17, 10:30 am

Jo Boaler, Stanford University

"I think math is the subject with the greatest gap between what we know works from research and what happens in classrooms."

Jo Boaler used her plenary session as a plea to the research community to not only do good work with their research, but to find ways to make it more shareable. "New knowledge is not enough," says Boaler. As part of a presentation she made at ICME in 2006, she surveyed teachers from countries around the world, asking, "What research study has made the biggest impact on your practice?" She found that in the Netherlands, the Freudenthal Institute has a huge impact in classrooms, and the Centre for Research in Pedagogy & Practice has a similar impact in Singapore. But often in other countries, including the U.S., teachers often cannot tie any of their practice to an influential body of research.

That doesn't mean that U.S. research hasn't had an impact on practice. When Boaler asked math ed researchers, Jeremy Kilpatrick pointed to Cognitively Guided Instruction (CGI) for having a long history of helping elementary teachers and their students. Boaler found other examples, but they were all from elementary. She suspected that elementary teachers are both eager to learn about students' mathematical learning, and they recognize the enormous capacity for learning they see in elementary students.

Boaler pointed out one of the tensions of sharing research: Just as we know students don't learn simply because we tell them something, teachers don't learn simply because we hand them a journal article. "I am really sure that teacher learning, one thing about it, needs to be generative and we need to be giving teachers things they can take back to their classroom and continue to learn from." Boaler also recognized doing research in partnership with teachers is probably the gold standard, both for identifying questions that are really important for teachers and working along side them.

Boaler stressed the need for "records of practice," including student work, curriculum materials, videos of classroom teaching, teacher notes, and assessments. "The most powerful impact I've had comes from showing these records of practice." As an example, Boaler showed a video of two classrooms in the same high school. The first classroom, as a result of the math wars, was a class that reverted from using IMP to a traditional approach. The teacher in the classroom is talking while they work out an example, and students sit quietly in rows. Engagement is passive -- at best, the students are listening. The second video Boaler showed was from a classroom down the hall. They were working a problem of a skateboarder spinning off a merry-go-round towards a wall, and the engagement in that classroom was much different. Before the students had solved the problem, the teacher stopped students to share their strategies. Students were active at the board and at their desks, questioning each other or reaffirming each others' strategies.

Using Research to Make a Difference

In the second part of her talk, Boaler used the metaphor of hedgehogs and foxes to describe a divide in the math education research community. Hedgehogs tend to look through the lens of one idea, while foxes are more interested in variety and looking across ideas. Jeremy Kilpatrick claims that mathematics education has an oversupply of hedgehogs, and it would be good for mathematics classrooms if there were more foxes in our field. (A chapter by Kilpatrick on this topic will be appearing in a book called "Vital Directions for Mathematics Education Research.")

Boaler then showed some of the successes and difficulties she's faced in her own journey as a researcher. Her book, What's Math Got to Do with It?, has brought focus to math education to a widespread audience. Boaler found herself talking on radio shows or in interviews for newspapers with people sharing their traumatic experiences as math students in traditional classrooms. Boaler also decided to reach out to press outlets, writing articles for newspapers, and was invited to speak with politicians about policies regarding math education. In those discussions, Boaler has found many opportunities to share the research of others, including the negative uses of timed tests and tracking.

Boaler shared difficulties related to her long-running scuffle with Jim Milgram and other mathematicians who strongly favor a more traditional form of mathematics. Boaler has told much of this story on her website, so I won't recap all of it here. She took this as an opportunity to thank people for the support she's received from so many people, and believes that while it's good to question and disagree, it's not okay to attack and attempt to discredit. There are, and likely will continue to be those in the math community who don't share visions for reform mathematics, as evidenced by this quote from Milgram: "Those of us who actually know the subject strongly believe that in order to improve outcomes we have to dramatically increase teacher knowledge of the subject, and that teachers need to more or less directly impart that knowledge to students." As a field we should work with people who want to cooperate and don't claim that some fields of research are inferior to their own.

Turning back towards ways we can improve math education, Boaler looked to new technologies for sharing research and records of practice. She's been working with Udacity and will be offering a course this summer called "How To Learn Math." The course will first be offered to learners, but she will be releasing a teacher version of the course. Boaler has recognized a lot of desire in the Silicon Valley community to improve the way we teach and learn mathematics, but they don't know the body of research in mathematics education to help make that happen. For example, Sebastian Thrun of Udacity once told her, "My friend Bill Gates tells me that algebra is the big problem for students in school." Boaler boldly replied, "Oh, Bill Gates, the math educator told you that, did he?" This opened a long conversation that exposed the curiosity of Thrun and others to find ways to teach math better, and the need to put the expertise of math educators in front of those who can drive change.

Photo courtesy of Rita Sanchez

Lastly, Boaler made four points for going forward and using research to make a difference:
  • Work harder and more intentionally to translate and communicate research to teachers and the public
  • Engage with different forms of media
  • Stand up to unethical behavior and academic bullying
  • Work as hedgehogs, foxes, and hedgefoxes to make math classrooms places in which all students thrive


RYSK: Skemp's Relational Understanding and Instrumental Understanding (1976)

This is the 19th in a series describing "Research You Should Know" (RYSK).

This classic think piece from Richard Skemp, despite being now almost 40 years old, still gets a great deal of attention amongst mathematics educators. I'd somehow missed it in my own preparation, which I find surprising how much I've spent studying the math wars. Skemp describes two perspectives on understanding mathematics, one which he calls relational and the other he describes as instrumental. Relational understanding is related to what we might think of a "deeper" understanding, something that reflects how and why mathematics works and is applied. Instrumental understanding relates to those reliable and typically efficient procedures we apply to produce mathematically correct answers. The part of Skemp's article that really sticks out for me is his suggestion that "mathematics" might be used too broadly: "I used to think that maths teachers were all teaching the same subject, some doing it better than others. I now believe that there are two effectively different subjects being taught under the same name, 'mathematics'" (p. 91)

Today +Chris Robinson, +Joshua Fisher, +Nat Banting, +Nik Doran, and I (pictured left-to-right along the bottom) met via Google+ Hangout to discuss Skemp's article. We discussed examples of each kind of understanding, whether one is a subset or prerequisite to the other, and the various influences that lead us to emphasize one over the other, such as curriculum and assessment.


(Some research needs to be summarized, while some needs to be expanded on. That's my explanation for why it will likely take you longer to watch the video than to read the original article.)

I've been in discussions like this before and I always find them to be fascinating. Still, it seems difficult to really get at the root: What is mathematics, and how can and should our beliefs about mathematics change? There are also strong implications for curriculum design and learning theory, as finding the right balance in our approach to both kinds of understanding should lead to better student outcomes.

References


Skemp, R. R. (1976/2006). Relational understanding and instrumental understanding. Mathematics Teaching in the Middle School, 12(2), 88–95. Originally published in Mathematics Teaching. Retrieved from http://www.jstor.org/stable/41182357

Jo Boaler, Standing Tall

Last night, Jo Boaler (whose work I've written about before) took to Twitter (welcome, Jo!) to share details of "harassment and persecution" regarding her research, which she has written about on Stanford's website (PDF). Those in the math community had some understanding that this had been going on, and I applaud Boaler's decision to bring it out in the open.

I'm sure much will be said about this in the coming days, but I hope at least some small part of the conversation addresses the discoverability and sharability of academic work. When I search for "boaler railside" on Google, this is what I see:


Instead of the first result pointing me to Boaler's 2008 article in Teachers College Record, I'm instead pointed directly to the Bishop, Clopton, and Milgram paper at the heart of this controversy. As Boaler has pointed out, it has never been published in a peer-reviewed journal. But it is published, in the modern sense, with perhaps something more important than peer review: a top ranking on Google. The second link points to Boaler's faculty profile, through which a couple of clicks will take you Boaler's self-hosted copy of the Railside article. I'm linking directly to it here not only because it's an article you should keep and read, but because it obviously needs all the Google PageRank help it can get. The third link in my search also refers to the "refutation" of Boaler's work, although the site no longer appears to exist.

Why is Boaler's original work not easier to find? Let's look at the Copyright Agreement of the Teacher's College Record. According to TCR, it is their policy to "acquire copyright for all of the material published on TCRecord.org" and that such a policy "is designed to promote the widest distribution of the material appearing on TCRecord.org while simultaneously protecting the rights of authors and of TCRecord.org as the publisher." For TCR, this "widest distribution" means putting the article behind a $7 paywall -- not an extravagant amount, but enough to keep most people from reading the work, which means not linking to it and not elevating its search rankings. (A search in Google Scholar, however, returns it as the top result.) Given the attacks on Boaler and her scholarship, has this copyright policy been "protecting the rights of authors?" In Boaler's case, it's obvious it hasn't. But then again, by signing over copyright I'm not sure exactly what rights TCR says she has left to protect.

I'm glad Boaler is sharing the article on her website. If she wasn't, I'd attempt to gain the rights to share it here, and that's not cheap:


Yes, republishing the article costs $500. Is it worth it for me to pay out of my own pocket? Probably not. But is it worth $500 to the greater mathematics education community to have it more discoverable, searchable, and sharable? Given what she's went through, is it worth it to Jo Boaler? Yes, it is, and that's why encourage all authors to publish in open access journals or otherwise negotiate their copyright agreement to ensure greater rights over their own work, including the ability to post and share in ways that improve search rankings.

RYSK: Boaler's Open and Closed Mathematics: Student Experiences and Understandings (1998)

This is the sixth in a series of posts describing "Research You Should Know" (RYSK).

The math wars might have quieted a bit since their heyday in the mid- and late-1990s, but if you hold your ear up to the internet and listen closely it won't be long before you hear the sound of reformists and traditionalists trading fire. A recent story in Education News by Barry Garelick triggered a battle in the comment section, bringing out many of the usual suspects to fight for the ground held by the other side.

While I might find such battles interesting (in a "straw-men-knocked-down-per-minute" sort of way), rarely do they accomplish anything but bolster the ill-will between the two camps. Occasionally there are hints at research findings, and perhaps somebody links to another story, blog, or website, but I never see much that might convince either side they might be wrong. Remember, this is the world of mathematics we're talking about, and "proving" anything right or wrong requires a standard of evidence not easily found.

Part of what sustains the math wars is the vast divide in what the two sides see as quality research and research methods, how they see the nature of mathematics itself, and how we measure success in mathematics[1]. A lot of math warriors might be willing to concede defeat if they came out on the wrong end of a large-scale, randomized, longitudinal experiment with high-fidelity implementations of reform and traditional curriculum and pedagogy, and multiple forms of assessment measuring a range of mathematical skills and abilities. But such experiments are very rare in social science – not because nobody wants to do them, but because the randomizing and controlling of people quickly veer towards the impossible and the unethical. So in the place of an idealized experiment, researchers have been trying to answer the traditional-vs.-reform question using the best methods available.

One such researcher is Jo Boaler. If I were to conduct a Family Feud-style survey of 100 math teachers, asking them to name a math education researcher, I'd expect Boaler to make it on the board. (Debating who else would be on the list might make for interesting Google+ and Twitter fodder.) Since earning her PhD in mathematics education from Kings College, London University in 1996, she has spent time in both the U.K. and the U.S. and is currently a professor at Stanford. While perhaps not as well-known as her later Railside study, her 3-year Open and Closed case study in the U.K. of two schools with traditional and reform approaches is worth examining here.

Boaler's research grew out of a concern that mathematical knowledge, when learned in a "traditional" way (which I'll define in a moment), isn't very transferrable to contexts outside the classroom. Learning transfer is a slippery subject for learning scientists to pin down, partly because we have a history of viewing learning as a cognitive ("in the head") activity, while transfer requires us to question the importance of our surroundings to what we learn, which is often referred to as situated learning (Lave & Wenger, 1991). Boaler wanted to investigate if, and how, being taught in mathematics affected future math performance in a variety of contexts.

For Boaler's study, she spent three years in two U.K. high schools, observing the daily activities inside mathematics classrooms. A great deal of the work was ethnographic, but she also conducted about 25 interviews per year, collected about 300 surveys, and administered a series of assessments. While the schools were not chosen randomly, they were in the same community, fed by the same primary schools, and had students with very similar demographic backgrounds. Test score averages for the two schools were roughly the same for students entering the 3-year study.

Math classes in "Amber Hill," the traditional school, generally consisted of a 15-20 minute lecture and working of example problems, followed by time for students to practice similar problems. Students were tracked into one of eight different levels depending on their prior test scores and teachers' judgment of their abilities. Overall, the atmosphere was described as calm and the students were motivated; in a short study of time-on-task, Boaler never observed fewer than 90% of students doing their work during the class. However, interview and survey data revealed that students found the work to be "boring and tedious" (Boaler, 1998, p. 45), and students described math as "rule following" (p. 46) and "cue-based" (p. 47), meaning students typically expected a task to indicate which rule to follow for solving a particular type of problem.

The other school in the study, "Phoenix Park," favored progressive education over traditional schooling. The atmosphere was very relaxed, and students were encouraged to accept responsibility for their own learning. Most of the math lessons were open-ended projects and students worked in mixed-ability groups. Boaler's description of the curriculum includes tasks like, "The volume of a shape is 216, what can it be?" When students needed math they did not know, they would get help from the teacher. When students lost interest, they were free to wander both physically and mentally in search of other work that might interest them. In the same short study of time-on-task, Boaler never recorded more than 70% of students working, and some students never appeared to do any work. When asked to describe their math lessons, the most common response from students was "noisy," followed by "good atmosphere" and "interesting" (p. 50). About a fifth of the students reported not liking having so much freedom in the classroom.

When comparing student attitudes in the two schools, Boaler found that Phoenix Park students reported being more interested in their lessons/projects, while Amber Hill students complained about their textbooks. At Amber Hill, boys reported being significantly more positive about mathematics than girls; at Phoenix Park there were no such differences.

One of the ways Boaler measured math performance was to give students a pre-test measuring their skills with volume and angles, then two weeks later give them an architectural activity using those same skills in context. A score of 1 represented a correct (or nearly correct) answer, while a 2 represented an incorrect answer. The percentage of students scoring a 1 on each task is shown in the table below.

Pre-Test
Volume
Pre-Test
Angle
Architectural
Task Volume
Architectural
Task Angle
Amber Hill72%94%55%64%
Phoenix Park60%94%75%82%

So while Amber Hill students scored better with decontextualized problems, Phoenix Park students did better with the tasks that more closely resembled using math in the real world. Boaler noticed a pattern in Amber Hill students' responses for the architectural angle task: many students took the word "angle" as a prompt to use trigonometry, even though none was needed.

While many might assume the traditional style of Amber Hill would result in those students receiving higher standardized test scores, Boaler suspected that transferring their knowledge from textbook to exam might be more difficult for Amber Hill students, as the exam contained questions that went beyond the simple application of rules and procedures. In examining GCSE exam scores from the end of Year 11, Boaler found 11% of students at both Amber Hill and Phoenix Park received an A-C grade, but 88% of Phoenix Park students passed the exam compared to only 71% at Amber Hill. Boys at Amber Hill received significantly higher grades than girls (20% to 9%), while no such significant differences were found at Phoenix Park (13% for boys, 15% for girls).

In the discussion section of the article, Boaler returns to survey data and exposes the differences in attitudes towards math among students from both schools. Amber Hill students admit that they didn't see connections between their textbook exercises and the real world, while Phoenix Park students talked more about the process of solving problems and using mathematics as an adaptable tool. In her conclusion, Boaler claims that while Amber Hill students knew more mathematics, the students from Phoenix Hill could apply more mathematics because their style of learning had forced them to become more flexible in their approach and more forgiving of their environment. Boaler does criticize the open approach of Phoenix Park because despite the relatively favorable test scores in comparison to Amber Hill, it led to a great deal of wasted student time. Regardless of the curricular and pedagogical details, Boaler's final conclusion is that "a traditional textbook approach that emphasizes computation, rules, and procedures, at the expense of depth of understanding, is disadvantageous to students, primarily because it encourages learning that is inflexible, school-bound, and of limited use" (p. 60).

Are Boaler's findings enough to end the math wars? If the answer was "yes," they would have ended in 1998 when the article was published. While the article does come across as a victory for reform, I don't think we can equate the progressive, open style of Phoenix Park with the expectation of "normal" reform classrooms. Similarly, Amber Hill might be more traditional than a "normal" traditional classroom. Still, Boaler's methodology helps shed light on how researchers try to answer the "traditional-vs.-reform" question, and this work helps us think about the importance of how we assess and how our perspective of learning changes when we view it through the lens of learning transfer. Boaler's conclusion should still be useful information regardless of your perceived approach, even if it falls short of declaring a cessation of hostilities.

[1] In addition, the lack of free public access to high-quality mathematics education research also sustains the math wars. After all, it's largely public opinion that keeps the war going, and researchers have allowed themselves to contribute to a system that discourages the public from seeing their published results. I'm hoping these posts put a dent in that knowledge gap, but I can only do so much. For a big step towards a long-term solution to this problem, I urge you to support HR 4004, the Federal Research Public Access Act, as well as http://thecostofknowledge.com/. Finally, something I think both the traditionalists and reforms can both get behind.

References

Boaler, J. (1998). Open and closed mathematics: Student experiences and understandings. Journal for Research in Mathematics Education, 29(1), 41-62.

Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation (p. 138). Cambridge, UK: Cambridge University Press.

A Quick-and-Dirty Guide to Fighting the Math Wars

I just posted this to a reply to a post by David Wees on Google+, but I thought it might be useful to some if it had some permanence here.

I've been in and out of "Math Wars" debates for 10+ years, and I find it's helpful to examine the issue at a more granular level. Here's a quick list of questions I jotted down:

What is your definition of mathematics? (Someone who answers, "It's a subject you learn in school" may have very different views from someone who answers, "It's a human activity we undertake to solve problems relating to number and shape.")

What is your philosophy of mathematics? (A Hardyist and a Mathematical Maoist have very different views, as do a Platonist and a Formalist. And for all the consistency in mathematics, this is not something with which we as individuals are necessarily consistent.)

What is our goal for students learning mathematics? (Is it to prepare them for work? For more school? To gain an appreciation of mathematics? For mental exercise?)

How should we assess mathematics? (Often when we claim that students do or do not perform well in mathematics, we are basing those claims on an assessment that may not embrace a balanced view of the issues above. Or, failing that, we make those claims without regard to the biases of the assessment.)

What learning theories do we use, and how do we use them? (A difficulty with learning theories is that in most all cases we can design curriculum and pedagogy around them that show they work -- at least to a degree. The workings of the human brain aren't easy to study, explain, or leverage in a classroom.)

How do we perceive "failure" or "success" of practices of the past? (I fear sometimes we stereotype certain historical movements, such as "New Math" and the "Back to Basics" movement, and we falsely assume that those movements were implemented in every classroom with high fidelity. We also sometimes forget that as time has passed, we are trying to teach higher and higher levels of mathematics to more and more students.)

How do we avoid false dichotomies? (False dichotomies were addressed in that article and Zwaagstra was wise to try to avoid them. But it's such an *easy* trap to fall into! [I've probably done it here without realizing it.] For example, he cited a paper by Alfieri, et al. (2011) that claimed through meta-analysis that "unassisted discovery does not benefit learners." But why would a well-trained constructivist teacher believe discovery should be unassisted? That's the same as assuming that a traditional teacher only has students listen to lectures and work problems in isolation. No teacher or student thrives exclusively on either. Interestingly, Zwaagstra in the next sentence says learners should be "scaffolded," an idea developed by Jerome Bruner in support of learning in a social constructivist environment.)

What skills, abilities, and philosophies do we believe teachers need to be successful? (I'm not sure we fully comprehend the effects on the received curriculum when it's taught by a teacher with skills, abilities, and philosophies that run counter to those supported by the curriculum. In such cases it's easy to misplace blame for poor outcomes.)

I'm sure there are more that I could add, but I strongly recommend that anyone who is serious about this debate to take on these issues one by one. Only if there is some agreement, or at least some sympathy and understanding, on these issues does it become truly productive to talk about "what works."

RYSK: Erlwanger's Benny's Conception of Rules and Answers in IPI Mathematics (1973)

This is the second in a series of posts describing "Research You Should Know" (RYSK).

In 1973, Stanley Erlwanger was a doctoral student at the University of Illinois at Urbana studying under Robert Davis (who taught many of us math as an advisor for Sesame Street) and Jack Easley when he published his landmark "Benny" article in Davis's new Journal of Children's Mathematical Behavior. (Now simply the Journal of Mathematical Behavior.) This and other Erlwanger articles became known as disaster studies (Spieser & Walter, 2004, p. 33) because they painfully reveal learning gone wrong, and they continue to impact the way we think about learning math and how we do research in mathematics education.

During the back-to-basics movement of the 1970s there was a push for programs that supported individualized instruction. One such program was Individually Prescribed Instruction, or IPI. IPI was designed for students to "proceed through sequences of objectives that are arranged in a hierarchical order so that what a student studies in any given lesson is based on prerequisite abilities that he has mastered in preceding lessons" (Lindvall and Cox, as cited in Erlwanger, 1973, p. 51). To measure that mastery, IPI relied heavily on assessments that were checked by the teacher or an aide, who would then have the opportunity to conference with the student and check for understanding. Erlwanger, however, saw a conflict inherent in the program: while the goals of IPI were "pupil independence, self-direction, and self-study" (Erlwanger, 1973, p. 52), teachers were supposed to have "continuing day-by-day exposure to the study habits, the interests, the learning styles, and the relevant personal qualities of individual students" (Lindvall and Cox, as cited in Erlwanger, 1973, p. 52). So is a teacher, with a class of students each working at their own pace, supposed to continuously monitor each individual student? How? The logical way to do this is to monitor assessment results and focus attention on strugging students. After all, if a student is passing the assessments and "mastering" objectives, how much could go wrong?

Benny was a twelve-year-old boy with an IQ of 110-115 in a 6th grade IPI classroom. Benny had been in the IPI program since 2nd grade, and the teacher identified Benny as one of her best students. By sitting down and talking to Benny about the math he was learning, Erlwanger discovered that Benny's conception of math was not only very rule based, but in many cases Benny's rules yielded wrong answers. For example:

  • Benny believed that the fraction \(\frac{5}{10} = 1.5\) and \(\frac{400}{400} = 8.00\) because he believed the rule was to add the numerator and denominator and then divide by the number represented by the highest place value. Benny was consistent and confident with this rule and it led him to believe things like \(\frac{4}{11} = \frac{11}{4} = 1.5\).
  • Benny converted decimals to fractions with the inverse of his fraction-to-decimal rule. If he needed to write 0.5 as a fraction, "it will be like this ... \(\frac{3}{2}\) or \(\frac{2}{3}\) or anything as long as it comes out with the answer 5, because you're adding them" (Erlwanger, 1973, p. 50).
  • When Benny adds decimals, he adds the number and moves the decimal point the total number of places he sees in the problem. So \(0.3 + 0.4 = 0.07\) and \(0.44 + 0.44 = 0.0088\). Benny's rule for multiplication is very similar: \(0.7 \times 0.5 = 0.35\), \(0.2 \times 0.3 \times 0.4 = 0.024\), and \(8 \times 0.4 = 3.2\). Because these are correct answers, that only served to reinforce Benny's rules about the addition of decimals.
  • Benny thinks different kinds of numbers should yield different answers: "2 + 3, that's 5. If I did 2 + .3, that will give me a decimal; that will be .5. If I did it in pictures [i.e., physical models] that will give me 2.3. If I did it in fractions like this [i.e., \(2 + \frac{3}{10}\)] that will give me \(2\frac{3}{10}\)" (Erlwanger, 1973, p. 53).

As you might guess, Benny got a lot of wrong answers and sometimes failed to achieve the 80% mastery mark on his assessments. It's clear that Benny isn't simply guessing and getting wrong answers -- his methods are consistent and he can confidently explain his reasoning. When Benny is wrong, he tries to change his answers until he gets ones that match the answer key, a process he called a "wild goose chase" (Erlwanger, 1973, p. 53). Because Benny's teacher/aide is only looking for answers that match the key (and trying to do so quickly), the emphasis is on the answer, not the reasoning. It was only Benny's persistence that resulted in him mastering more objectives than most of his classmates.

This style of learning led Benny to believe that math is little more than a collection of arbitrary rules and singularly correct answers: "In fractions, we have 100 different kinds of rules" (Erlwanger, 1973, p. 54). Erlwanger asked Benny where he thought the rules came from. "By a man or someone who was very smart. ... It must have took this guy a long time ... about 50 years ... because to get the rules he had to work all of the problems out like that..." (Erlwanger, 1973, p. 54). For both reasons of scholarship and concern for Benny, Erlwanger returned to the school twice a week for 8 weeks to work with Benny one-on-one. Unfortunately, despite Benny's eagerness to learn, Erlwanger found this to be too little time to change Benny's firmly-established view of mathematics and little progress was made.

What Benny Means to Theory, Research, and to Khan Academy

(It might be helpful to read yesterday's post about constructivism and the Khan Academy before reading this section.)

Erlwanger summed up the theoretical aspect in his conclusion:
Benny's misconceptions indicate that the weakness of IPI stems from its behaviorist approach to mathematics, its mode of instruction, and its concept of individualization. The insistence in IPI that the objectives in mathematics be defined in precise behavioral terms has produced a narrowly prescribed mathematics program that rewards correct answers only regardless of how they were obtained, thus allowing undesirable concepts to develop. (1973, p. 57)
Looking back at Benny in 1994, Steffe and Kieren summarized that
Erlwanger was able to demonstrate how Benny's understanding of mathematics conflicted with any "common sense" understanding of what would be regarded as "good mathematics." This was a crucial part of Erlwanger's work, because by demonstrating what a "common sense" view of mathematics should not be, Erlwanger was able to falsify (naively) the behavioristic movement in mathematics education at that very place where behaviorism has its greatest appeal -- at the level of common sense. (p. 72)
Prior to Benny, the large majority of research in mathematics education depended on quantitative methods -- using statistics to summarize and compare the performance of treatment and control groups. Erlwanger had opened the door to qualitative research, which essentially meant that researchers could now see the value of interviews, case studies, and similar methods. In other words, Benny showed researchers that they can, and should, talk to children.

Although we're approaching the 40th anniversary of the Benny study, anyone who has been paying attention to the debates regarding Khan Academy should be able to draw parallels between it and IPI and realize we're retreading a lot of the same water. In a recent Wired Magazine article about Khan, stories are told of students working individually, at their own pace, with their progress measured by a computer that judges answers right or wrong. The article highlights Matthew Carpenter, a fifth grader who has completed "an insane 642 inverse trig problems" (Thompson, para. 2). Carpenter has earned many Khan Academy badges, a sign of progress that pleases his teacher and amazes his classmates. Unfortunately, the article provides no evidence that Matthew Carpenter is not Benny. I, and hopefully everyone, sincerely hope he is not Benny. I hope he's developing a proper view of the nature of mathematics and developing solid mathematical reasoning and understanding. But I can't be sure, and maybe Carpenter's teacher can't be sure, either. While we sometimes can and do use behaviorist programs of instruction to learn, we can't rely on them to be sure that learning is happening the right way. That's Benny's lesson, and that's why we need to be critical (but not necessarily dismissive) of Khan Academy. People who fail to do so might be surprised with the results they get for all the wrong reasons.

References

Erlwanger, S. H. (1973/2004). Bennyʼs conception of rules and answers in IPI Mathematics. In T. P. Carpenter, J.A. Dossey, & J. L. Koehler (Eds.), Classics in mathematics education research (pp. 48-58). Reston, VA: NCTM.

Speiser, B., & Walter, C. (2004). Remembering Stanley Erlwanger. For the Learning of Mathematics, 24(3), 33-39. Retrieved from http://www.jstor.org/stable/40248471.

Steffe, L. P., & Kieren, T. (1994/2004). Radical constructivism and mathematics education. In T. P. Carpenter, J. A. Dossey, & J. L. Koehler (Eds.), Classics in Mathematics Education Research (pp. 68-82). Reston, VA: NCTM.

Thompson, C. (2011, July). How Khan Academy is changing the rules of education. Wired. Retrieved from http://www.wired.com/magazine/2011/07/ff_khan/all/1.

Constructivism and the Khan Academy

Not long after sitting down at my computer this morning, there was this tweet from David Wees:
“How would you explain constructivism to someone not (well) versed in pedagogy? You have 140 characters. #edchat #BCed”
I took David’s challenge and what followed was a pretty good conversation with David Cox, Ira Socol, and Jennifer Borgioli. For the sake of clarity, yet with an attempt at brevity, I thought a follow-up post would be good here. My goal is to share the kind of knowledge that David asked for -- a short explanation for someone who might be new or unclear about these ideas -- so please excuse me if I don’t touch on some of the nuanced bits (and there are many, trust me!) of the theory.



Before we talk about learning theory, we should take a step back and talk about epistemology - the branch of philosophy concerned with the nature of knowledge. There are multiple epistemologies, but two are important here.

Objectivism: An objectivist epistemology holds that knowledge and meaning exists independently of the learner. It is not just believing that “a rock would be a rock if we were here or not.” Instead, it is a belief that the rock carries some meaning of what it is to be a rock, and when we study rocks we are discovering that meaning. Objectivism is sometimes called empiricism or externalism.

Constructivism: A constructivist epistemology holds that there is no objective knowledge. This doesn’t mean that there aren’t objects, but that the knowledge and meaning we associate with objects is constructed by us as we engage and interact with the world. Constructivism can take several different forms, depending on the importance placed on social and historical interactions.

Hopefully you can already see how different epistemologies can affect a person’s view of teaching and learning. Now let’s compare three learning theories associated with these epistemologies.

Behaviorism: Behaviorist learning theory is often associated with an objectivist epistemology. Human actions, including exhibitions of our knowledge, are viewed as behaviors that respond to a stimulus. The process begins with a transmission of knowledge from the teacher (which can be a non-human source of knowledge) to the student. If the response is the expected behavior, the student is rewarded. If the response is not the expected behavior, the student is punished. By stimulating the student with rewards and punishments, the teacher encourages the student to receive the transmissions of knowledge.

Information Processing: IP theory still applies an objectivist epistemology, but differs from behaviorism in that learning is seen as an inner cognitive process and not just a response to a stimulus. The brain is seen roughly as analogous to a computer -- it has memory and processing systems that serve to store and analyze information, although the analogy doesn't extend to understanding exactly how those systems actually work. Application of this theory in teaching generally involves heavy doses of repetition to ensure that knowledge is retained in memory.

Constructivism: Not surprisingly, constructivist learning theory is associated with a constructivist epistemology. Because knowledge is constructed by the learner, the teaching/learning process focuses on creating conditions for that construction to happen. There is no "transmission" of knowledge. Depending on the form of constructivism, the teacher might facilitate the construction of knowledge through the inclusion of contexts and social interaction.



The science of education would be much easier if we could prove that some theories never work and one works all the time. But we can’t. However, I don’t know of an educational psychologist that doesn’t think constructivist learning theory (in at least one of its variants) works better than those based on an objectivist epistemology. So why doesn’t every teacher do it? Or do it well? Teachers in classrooms have resource, time, and other constraints that makes constructivism more difficult than we all wished it was. Also, it’s not always clear cut which theory is being applied by a teacher. Suppose you were to peek into a classroom and see a teacher speaking to the entire class. Maybe the teacher is trying to transmit knowledge in a behaviorist/IP way. Maybe the teacher is trying to help students get into a certain frame of mind and is a constructivist. You can’t tell at a glance because the learning theories don’t always present themselves as extreme opposite ends of the spectrum. But when there’s controversy, we like to pretend that they do. Enter Salman Khan.

There’s been a lot written about Sal Khan and the Khan Academy over the past several months, including a recent article in Wired Magazine that became a large part of this morning’s discussion on Twitter. The idea of learning by watching videos isn’t necessarily behaviorist or solely an application of information processing theory, but it’s more easily seen as a medium for the transmission of knowledge, not construction, and the point-keeping for problems right and wrong also fits the stimulus/response model. Phrases such as "Khan and Gates both admit there’s no easy way to automate the teaching of writing" also point at behaviorism and IP. (There’s an underlying assumption here that if teaching can be automated, learning will be automated.) The Wired article quotes parents and teachers who are amazed at the progress their kids are making, measured by problems completed, modules finished, and badges earned. Are those students learning? Of course they are, but exactly what they are learning and how well they understand it is at the core of the debate.

Behaviorism and information processing aren't mentioned by name in the article. Perhaps they don't need to be; it’s a style of education that most all of us are familiar with and perhaps it doesn’t need much explaining. Constructivists are named as Khan’s critics, and the theory is described using terms such as "play around" and "fumbling around," the latter of which was probably an unfortunate choice of words by a constructivism supporter. Saying that "it’s better to give kids activities that let them discover the principles of math and physics on their own" doesn’t give enough credit to teachers in good constructivist learning environments. When done well, teachers don’t just "give" activities and students aren’t "on their own." Instead, there’s a careful orchestration going on and the teacher is with the students 100% of the way, asking questions, providing feedback, provoking the student to look at tasks in ways that help students construct deep understandings. Can a video do this? Obviously there are severe limitations -- not limitations that prevent all learning, but limitations that might be preventing the best kind of learning.

Look for an upcoming post about what happens when the instruction is based on objectivism but the student, a kid we'll call "Benny," constructs knowledge in his own, incorrect way. The "Benny" paper by Stanley Erlwanger in 1973 had huge ramifications for research and teaching in mathematics education, and has interesting parallels to learning via the Khan Academy.

I'd like to give great thanks to Jackie Hotchkiss for helping review a draft of this post. (Any final shortcomings are solely mine, of course.) When in doubt, talk to an educational psychologist!