Showing posts with label reform. Show all posts
Showing posts with label reform. Show all posts

2024 Year In Review

Teachers leading PD in the San Luis Valley

Where did the year go? In order to get at least one post up on this blog before the calendar flips to 2025, let me recap some big events of the last year.

January 2024: Math Routines in the San Luis Valley

The first highlight of the past year happened in Alamosa in January, and it was the result of many months of work. In Summer of 2023, my CDE colleagues and I recruited a dozen teachers from Colorado's San Luis Valley to attend conferences in Denver for four days and then turn what they learned into local professional development for districts in the San Luis Valley in January. I'm skipping over a lot of details, but it was great to work with these teachers and support them in their sessions.

February 2024: Launch Years Convening in Anaheim

It was a great year working with Colorado's Math Pathways Task Force and receiving support through the Launch Years Initiative. A contingent from Colorado joined up with more than 20 other states in a very rainy Anaheim, California to share progress and strategies about how to improve high school math and transitions for students as they matriculate to college and other postsecondary opportunities.

 

It rains in California, sometimes

July 2024: Math Intervention Design Workshop

In July, CDE teamed up with CCTM to host a design workshop in Summit County for a week. As I told the attendees, it probably felt like (a) work that felt like a vacation, or (b) a vacation that required a lot of work. Either way, Summit County in the summer is a delightful place to be. About 20 educators of all kinds -- higher ed, K-12, veterans, novices -- worked to develop materials that should be useful with students who are still struggling after regular instruction. We were all really pleased with the effort that went into these materials and we're looking forward to getting them into people's hands and getting feedback about how well they work.

The design workshop participants got to test their creations with summer school kids in Leadville, who graciously hosted us for a morning

September 2024: ASSM, NCSM, and NCTM in Chicago

This year's ASSM, NCSM, and NCTM conferences were in Chicago. To take in all three conferences requires a 9-day stay and by the time it's over, my head is swimming with all sorts of ideas and things I want to do and learn more about. ASSM held their conference in a hotel on Navy Pier, which was a treat.

In recent years, I've tried to blog at the end of each day of my conference trips. That didn't happen this year -- I was more social in the evenings than usual, with takes time, and I had two presentations at NCTM to finish preparing for. I kept thinking I'd get around to writing some recaps, but maybe I'll settle for a few bullet points here:

  • A decade ago, I joked with many people that if you wanted people to show up at your session, all you needed to do was name it something like, "Common Core iPad Games for the Flipped Classroom." I don't know what would get the equivalent amount of attention today, but surely it has "AI" in the title. I've seen a few AI presentations so far and I'm still waiting for one that (a) focuses on the use of AI in math education specifically and (b) is practical without too much hype / too little skepticism.
  • There's a national momentum for reforming high school math. I don't know exactly what the results of that momentum will bring, but I hope it's great. What we currently have isn't serving enough of our students as well as it should.
  • I used to read stories about how many baby boomer teachers would be retiring. I think we're on the other side of that now, and it feels like we have a lot of younger and more novice teachers who can really benefit from the support they get at conferences and in their other professional learning. I know what teachers can get out of a 60- or 90-minute conference session is limited, but the overall exposure to new ideas and the enthusiasm behind them is something I hope every teacher has a chance to experience.

Navy Pier, Chicago, is a great place to enjoy a conference

October 2024: Fall Math Pathways Summit

To put an explanation point on Colorado's math pathways work, the task force hosted a summit in Colorado Springs. About 100 people attended from all over, and there's a lot of excitement about the work.

Thanks to Pikes Peak State College for providing a great space for the Fall Math Pathways Summit


NCTM's Grand Challenges and Opportunities in Mathematics Education Research

Last summer, the NCTM Research Committee asked members to identify grand challenges in mathematics education (written about here and here), and today they've published their findings in the Journal of Research in Mathematics Education. First thing's first: If you're not a JRME subscriber your access to the article is blocked by a paywall. Sadly, this feels like another case of NCTM's reluctance to move past old models of publishing and communication, leaving teachers interested in the grand challenges to feel like second-class NCTM members, begging for a handout from the privileged NCTM research community. I've written about my concerns and suggestions for NCTM's relationship with its members, so here I'll just focus on the key points found in today's report. Ready to be inspired? Slow your roll, turbo. You might want to prepare yourself to be a bit puzzled, if not disappointed.

The report begins by placing the concept of a "grand challenge" in the hands of researchers:

Mathematics education researchers seek answers to important questions that will ultimately result in the enhancement of mathematics teaching, learning, curriculum, and assessment, working toward “ensuring that all students attain mathematics proficiency and increasing the numbers of students from all racial, ethnic, gender, and socioeconomic groups who attain the highest levels of mathematics achievement” (National Council of Teachers of Mathematics [NCTM], 2014, p. 61). Although mathematics education is a relatively young field, researchers have made significant progress in advancing the discipline. As Ellerton (2014) explained in her JRME editorial, our field is like a growing tree, stable and strong in its roots yet becoming more vast and diverse because of a number of factors.

Next the report talks about the purpose of grand challenges and their development and use in other fields. In some ways, it reminded me of the spread of the standards movement: "Math has standards, we should too!", except now it's "The National Academy of Engineering has grand challenges, math ed should too!" Then the report spends four paragraphs talking about Hilbert's problems and how they influenced the last 100-plus years of research in mathematics. The report shifts back to the present, summarizing grand challenges in other disciplines. Readers at this point are likely getting anxious, sensing that their grand challenge lies just ahead.

But wait! What's the criteria for a grand challenge again? The report slows to grind away at feedback about how a "grand challenge" was defined in the initial survey. Saying a grand challenge is "doable," for example, wasn't specific enough for some concerned respondents. Okay, point taken. Nobody wants a grand challenge that can't be met. (Ahem...NCLB...100% proficiency targets. Been there, done that.) So now, we prepare ourselves for the challenge...

But first, let's talk about three themes of responses the committee got from the math ed community. Let me be clear: These aren't the challenges, just the themes describing a body of suggested challenges:

  1. Changing perceptions about what it means to do mathematics.
  2. Changing the public’s perception about the role of mathematics in society.
  3. Achieving equity in mathematics education.

I was hoping to have a strong, positive reaction to these, but I fear my inner cynic took over: "In a nutshell, survey respondents argued our grand challenge for the future is to finally win the math wars that we've been fighting for the past 25 years." The details that followed this list, while short, were thoughtful. My inner cynic quieted down. We do need public support for improved ways of teaching mathematics. We do need to conceive of equity and teaching that goes beyond simply narrowing the achievement gap. All good things. But like I said, those were just themes. So now, I stand ready for the distillation of those themes to form itself in the shape of a grand challenge. So the winner is...

Will you settle for a "hypothetical" grand challenge instead? NCTM suggests this as a mere example: All students will be mathematically literate by the completion of eighth grade, accompanied with this disclaimer:

Our example is only meant to illustrate how a Grand Challenge could satisfy the criteria listed in the previous section; we are not suggesting that it is necessarily a Grand Challenge we should pursue.

There are then six paragraphs describing the attention and importance given to literacy (the read-and-write text kind) and how we should give the same attention and importance to mathematical literacy. But this isn't the grand challenge. It could be, but it's not. Unless we decide it is. Which we haven't.

What we need next, says the report, is to think about the process we need to draft grand challenges. The design researcher in me says, "Yes, this is how to do this. We asked for grand challenges, got input, and now we're going to make revisions to our thinking and ask for more input, and it's going to be better input the next time around." I get it. But readers expecting a call to action might think NCTM is just calling a big, frustrating "Do over!" on the process. Here's NCTM's proposed plan, which they encourage people to critique: Engage many voices. Give people opportunities to draft the grand challenges and comment on drafts written by others. Engage in conversations online (!) and at conferences. Avoid just handing this work to a committee. So expect to see the NCTM Grand Challenge Grand Tour coming to a town near you — they'll have sessions in Boston at the Research Conference and Annual Meeting, as well as at AREA, AMATYC, AMTE, the Benjamin Banneker Association, EONAS, MAA, NCSM, PME-NA, TODOS, WME, regional NCTM meetings, and online venues. (Forgive me for not spelling out all the organizations. I figure if you don't know what it is, you're probably not attending.) I found this bit interesting:

The NCTM Research Committee will also convene a diverse group with a wide variety of expertise to review all submitted challenges, write additional challenges, vet them according to the criteria set forth in the invitation, and provide opportunities for the field to comment on them.

That sounds a bit like a hand-picked committee working in conjunction yet parallel to all the work described above. There's little detail, but I think NCTM better be clear about how the work of this committee will be weighed against the suggestions of the broader community. So, are we ready? Psyched? Ready to push that boulder back up the hill? I hope not, because the last section, while probably necessary, is a bit of a downer.

The Research Committee knows that a grand challenge — if and when we have one — will have consequences for researchers:

Any time a representative group of people is given an opportunity to identify Grand Challenges for an entire field, there is a moral obligation to consider the associated risks and weigh them against the potential benefits. The risks associated with creating a document that identifies our field’s Grand Challenges could be significant, yet we hope to minimize the risks by acknowledging and addressing them throughout the process.

What are the risks? Some people's research and work will get privileged over others. Funding will get reallocated. Journals will rethink what should and should not be published. The groups we consider to be "stakeholders" in math education could change. In some cases, people's feelings might get hurt; in other cases, careers could be threatened. I know this sounds overly dramatic, but the tenure and promotion game for academic researchers can be a rough one, and the research committee knows that. It still struck me as odd to see this "inside baseball"-type discussion near the end of the report, but it might comfort some and give fair warning to others.

So that's it. NCTM's grand challenge was not, and will not be, the "we asked, you answered" kind of process that some of us might have expected. I guess you could call that the bad news. If you were ready to jump to collective action, you're going to have to wait. But there is good news: If you are looking to give your input, it looks like you'll have multiple opportunities. And now that the task ahead is defined more clearly, we can think not just of possible challenges, but the ways we'll organize ourselves to tackle those challenges. To me, the key to the former will be the latter.

References

Stephan, M. L., Chval, K. B., Wanko, J. J., Civil, M., Fish, M. C., Herbel-Eisenmann, B., … Wilkerson, T. L. (2015). Grand challenges and opportunities in mathematics education research. Journal for Research in Mathematics Education, 46(2). Retrieved from http://www.nctm.org/Publications/journal-for-research-in-mathematics-education/2015/Vol46/Issue2/Grand-Challenges-and-Opportunities-in-Mathematics-Education-Research/

On Major Problems and Grand Challenges, Part 2

Prompted by NCTM's call for "grand challenges," in my last post I looked back at Hans Freudenthal's 1981 "Major Problems" paper. We've made progress in the past 30+ years, and we should recognize that. But that doesn't mean other challenges don't await us, and in this post I'll look at some suggestions made by some fellow bloggers. If this looks like "armchair challenging" it's probably because it is, rambling commentary and all.

Before I continue, it's worth noting that all four bloggers I found writing on this topic are white males. (And I am, too.) If this doesn't bring to mind a grand challenge for the future of math education, I don't know what should.

Robert Talbert: Grand Challenges for Mathematics Education

Robert's first suggestion is to develop an open curriculum for high school and early college. Sure, we've had many curriculum projects, but I can't say I've seen many that try to seamlessly span high school and college. It makes me realize that textbook companies typically package things in ways that align with the jurisdictions of district decision-makers, but there's really no reason it has to be that way.

We currently have some open curriculum projects that might give us a start on this challenge, such as the Mathematics Vision Project out of Utah and the EngageNY materials from New York. I say "give us a start" for two reasons: neither set of materials are very mature (and thus quality can be suspect) and such a project should plan for the evolution and improvement of the materials over time.

Side story: I was having dinner this summer with a retired mathematics education professor and she was telling me about her experiences volunteering to help tutor kids at a local high school. Our conversation went like this:

Her: "I didn't recognize the materials they were using, but they're a mess. It's something they found online and I don't know who put it together, but it looks like different people wrote adjacent lessons and never talked to each other, because there were big jumps from one topic to another with no explanation."

Me: "Let me guess. Are the materials from New York?"

Her: "No, Utah."

Me: "That was my second guess. And your guess about different people writing different lessons without much coordination is a very good guess of what probably happened."

Robert's second and third challenges involve the creation and use of concept inventories for mathematics, like the force concept inventory (FCI) for physics. I hear this get discussed occasionally and I'm aware of some efforts for inventories in calculus and statistics, but they aren't nearly as well recognized or used as the FCI. What's the advantage of having these inventories? They tend to make for great pre-post tests for a course or to judge if a particular teaching approach is better for students' conceptual understanding. Last week I attended a talk by Stephen Pollock who talked about his work in physics education research and the improved results we're getting in CU's physics program. The FCI played a key role in that progress, as it allowed professors to self-monitor their courses and compare their results to others who were attempting to improve their teaching. These kinds of standardized assessment tools could be equally useful and powerful in mathematics departments, especially when used in a self-monitoring sort of way instead of the all-too-common external-and-top-down-accountability-enforcing sort of way.

Robert's last recommendation is to have a preprint server for math education research. As he notes, this is a road we've tried to go down before and we didn't get very far. I don't think the problem has nearly as much to do with policy or categories of the arXiv as it does with the lack of a "preprint culture" in mathematics education. What I learned in those previous preprint discussions, and in my observations as a developing scholar, is that math educators regularly and happily share work in progress — with a select group of people. In math ed, there doesn't seem to be widespread faith in anything like Linus' Law, the open source software dictum that says, "With enough eyeballs, all bugs are shallow." I think the math wars led to a lot of distrust, and some of it is very rational. It's safer to only share preliminary work with a few scholars who share similar methods and theoretical frameworks, and then refine the work after peer review before publication in a journal whose readership is likely to understand the work. Maybe it shouldn't be this way, but to move forward we're going to have to confront some of these beliefs.

Patrick Honner: My Grand Challenge for Mathematics Education

Patrick described in some detail a single grand challenge: "Build and maintain a free, comprehensive, modular, and adaptable repository of learning materials for all secondary mathematics content." It's worth reading his post and the comments. This challenge hits close to home for me because it touches on my own research, including the difficulty of coordinating distributed curriculum development and the infrastructure needed to support the customization of curriculum.

I've always been intrigued by the concept of "modular and adaptable" curriculum materials. Personally, I thought I did my best work as a teacher when I offloaded my curriclum to a high-quality textbook that I'd been trained to use. That's an anathema to many math teachers who take improvisation of curriculum to be a sign of quality teaching. (It's not, by the way. There can be good and bad improvisation, just as there can be good and bad offloading.) I tried writing my own curriculum for a while and found it exhausting and ineffective. In a couple hours per day, I just couldn't create from scratch anything that I thought was as good as the texts coming from university-based curriculum teams with decades of experience and millions of dollars of funding. Go figure. I got better results when I leveraged the rigor and coherence of a text that integrated topics, contexts, tools, and routines across its lessons and units.

With enough effort, however, Patrick's recommendation could lead to a set of materials that are both modular and coherent. I've always seen these in opposition, a sort of "textbook paradox." I speculate that teachers who value being able to adapt and improvise with their curriculum will resist or find ineffective those textbooks built around coherence. It's relatively straightforward to replace a lesson in a very traditional textbook that relies on an isolated set of examples and practice problems. But for reform-based materials, such as IMP, CPM, and Everyday Math, skipping around in the textbook can lead to trouble. Saxon texts, for that matter, with their use of "incremental development," should make a teacher think twice before skipping or improvising a lesson. Thus, the paradox: teachers who want to improve the quality of their curriculum materials probably have an easier time adapting materials that are lower quality to begin with, but if they start with higher-quality materials, adaptation can sacrifice coherence and make adaptation more difficult.

Adaptation can still be done with any curriculum, but it takes skill. Currently, that skill must come almost entirely from the teacher, as the texts aren't smart enough to know what you've been skipping. Take Patrick's challenge far enough, however, and maybe we could have a curriculum that is smart enough to know what you've used and not used. Imagine a statistics curriculum that automatically modifies tasks to use a preferred data set, or a system that reminds you that you should probably include a lesson and practice with mean absolute deviation prior to teaching standard deviation. Or, for algebra, imagine a system that let you decide whether to teach exponential functions before or after quadratics, with the curriculum being smart enough to recommend appropriate modeling tasks. When I helped a school pilot Accelerated Math in 1999 and used the exprience as my student teaching action research project, I really thought we were on the cusp of a wave of "smart curriclum" that would help build coherence into teacher-adapted curriculum. We're not there yet, but a challenge like the one Patrick describes could get us much closer.

David Wees: Grand Challenge for NCTM

David's grand challenges focuses more on people than materials: "Develop a comprehensive, national professional development model that supports the high quality mathematics instruction they have been promoting for many years." ("They" refers to NCTM.) David breaks this challenge into bullet points around the development and scaling of "core practices."

I'm a firm believer in this idea. I get resistance from those who love the creative and spontaneous aspects of teaching, but I think that learning to teach should involve the learning and practicing of key teaching practices. Thankfully, there are some very good people working in this area. Until recently, their efforts were somewhat scattered and referred to with such names as "high-leverage practices" or "ambitious teaching." Thankfully, at AERA this past spring, many of the heavy hitters doing this work came together to address the need for a common language around these practices and supporting their development and use. For a good idea of what a list of core practices might look like, check out the Teaching Works project from the University of Michigan. I have a hard time finding anything on that list that doesn't seem essential to quality teaching, and it reminds me that the list is really the easy part. The real work comes in developing those practices in preservice and inservice teachers, and I'm glad that David had his mind on that development when he articulated his grand challenge.

Bryan Meyer:

Bryan's challenge isn't math-specific but it could help a lot of math teachers. Our expectations for teacher collaboration exceed our opportunities, and changing this involves a lot of people and resources. In some countries there are limits to how many student contact hours a teacher can have because they are expected to be collaborating with or observing other teachers for several hours each day. What if we did that in the United States? We'd have to seriously rethink our resources. Suppose you currently teach six periods a day with about 24 students in each class. What if you only taught four periods with 36 students in each class, and you had the extra two periods to work with other teachers to ensure your instruction in those four periods was better? (For those of you who already have 36 students in your classes and are working out even larger classes in your heads, I'm sorry.) Or, instead of changing class sizes, what if salaries were lowered to accommodate the hiring of extra teachers?

While these questions suggest difficult choices, they do seem like questions that could be answered with adequate research, and maybe there exists some research already that could help us answer them. Still, research in education isn't always very effective at changing school cultures or how resources are allocated. I don't want to sound too pessimistic, but I'm thinking that Bryan's challenge is going to have to focus as much on understanding and developing cultures of collaboration amongst teachers as it would scheduling and resource allocations.

Parting Thoughts

While it may have been personally beneficial for me to put a couple thousand words into a grand challenge I thought about on my own, I realize that our best hopes for meeting a grand challenge come when we share and push each other's ideas. As a student of curriculum and instruction, I find much to like in Robert and Patrick's thoughts about curriculum and David and Bryan's thoughts about instruction. There's some really meaty stuff there.

I've also tried to think about what wasn't mentioned as a challenge. Nobody said, "I really think we need to better understand how students think about ratio/functions/number/proof/etc." While people are hard at work on such questions, I don't think there's any widespread perception that a lack of research in specific areas of student mathematical understanding is what is holding us back. (If there's a challenge I should be writing about, it's about the dissemination and use of this information.) I'm also happy to see that people weren't writing challenges involving new sets of academic standards. It's rather unfortunate that so much energy is being put into debating Common Core when it seems quite likely that standards account for little of the variability in student outcomes. We have a list of stuff we want students to learn. Fine. I'm ready to focus more of our efforts on the learning, not the list.

Lastly, to touch briefly on the challenge I hinted at near the top of this post, I didn't see any equity-focused grand challenges. I think I speak for Robert, Patrick, David, and Bryan when I say we all believe in achieving equitable participation and outcomes in mathematics education. Then again, we can't just say that and expect equity to come about by accident. There are elements of each challenge mentioned that could be used to promote equity, but it's going to take a more explicit focus than we've given it. In fact, maybe the first step is to significantly change the representation implied when I say "we." It seems simple enough, but privilege has a way of producing thoughts of "for" and "to" instead of "with," and that's a challenge for the kinds of people and organizations who pose challenges.

On Major Problems and Grand Challenges, Part 1

Last month the NCTM Research Committee asked its members to help it identify the grand challenges for mathematics education. Grand challenges, said NCTM, (a) are hard yet doable, (b) affect millions of people, (c) need a comprehensive research program, (d) are goal-based with progress we can measure, and (e) capture the public's attention and support. I'm a month too late to contribute to NCTM's survey, and before blogging my thoughts into the wider conversation I thought I should look back at someone else's previous attempt. Maybe I'd gain some perspective on what grand challenges are and how persistent they might be.

Hans Freudenthal (Wikimedia Commons, CC-BY-SA)
In 1980, Hans Freudenthal gave a plenary address at ICME that later turned into an article in Educational Studies in Mathematics titled, Major Problems of Mathematics Education. I've briefly summarized the article on the MathEd Wiki and here I'll note the progress I think we've made on Freudenthal's 11 problems.
  1. Freudenthal believed we "need[ed] more pardigmatic cases, paradigms of diagnosis and prescription, for the benefit of practitioners and as bricks for theory builders" (p. 135). In the case of arithmetic, which was Freudenthal's example, I think Cognitively Guided Instruction (CGI) is very much the kind of thing Hans was looking for.
  2. Freudenthal wanted us to more carefully consider how people learn and observe their learning processes. I think several decades of teachers' awareness of constructivist theories of learning has changed how most people think of learning, and newer work in the area of teacher noticing puts fine points on what teachers notice and why.
  3. How do we design curriculum and instruction around progressive formalization? There is always more to learn, but the Freudenthal Institute in the Netherlands has now worked on this for decades and the frameworks for curriculum design are well-established.
  4. How do we retain and leverage mathematical insight? Freudenthal wrapped this into the conceptual vs. procedural debate, one that's still very much alive. However, I think we have better examples of productive approaches to this problem, and some research results (the BEAR project work at Berkeley comes to mind) showed that more focus on the conceptual didn't come at the expense of procedural facility. Still, this problem gets wrapped up in people's beliefs about mathematics and the teaching and learning of mathematics, and those beliefs sometimes aren't swayed by current evidence.
  5. How do we reflect on our learning? This is another problem we now know much more about, particularly due to Schoenfeld and his work on metacognition.
  6. How do we develop a mathematical attitude? This is still a challenge, and not just because some students say they don't like math. I think this problem might be closest to what Jo Boaler is currently trying to change with her focus on mindsets in learning mathematics.
  7. How do we coordinate students working together when the are at different levels of learning? Many teachers and scholars have worked quite hard on this problem and I feel like most teachers now see the benefit of heterogeneous ability groups. For more, I'd suggest Ilana Horn's book, Strength in Numbers.
  8. How do we create contexts for mathematizing? I think there's been a wealth of work in this area, from work based in Realistic Mathematics Education, work on word problems like that from Verschaffel, Greer, and de Corte, and, most recently, Dan Meyer's work. I could go on, as there are many more examples, and perhaps future work will give us a clearer picture about which contexts work best and why.
  9. Can we teach geometry by having the learner reflect on spatial intuitions? Maybe it's my lack of expertise in geometry education research, but I really don't know where we stand on this problem. Freudenthal seemed to be reaching in his article on this problem, and maybe a more tangible articulation of the problem would have helped me better judge any solutions we might have.
  10. How can technology increase mathematical understanding? Freudenthal admitted not being tech-savvy even in 1981 (he used "the ballpoint" as an example of technology that changed instruction, and not in an obviously historical way), but I think we now have numerous examples of tech that helps increase understanding. We also have a lot of examples of tech that doesn't, and I'm sure Freudenthal would have seen problems in our ability to judge the good from bad.
  11. How do we use a holistic approach to educational development for change? In his native Netherlands, Freudenthal would likely be pleased today to see his colleagues' commitment to design-based, participatory approaches to research. We have some of that here in the U.S., too, but we also struggle for a "scientific" approach to finding "what works" based on experimental studies. We also have too much faith in how standards affect change; if Freudenthal thought curriculum development for change was a wrong perspective, surely he'd think the same about standards. Those things are just part of a much bigger picture.
Looking at this list, I think we have a lot to be proud of. Even though Freudenthal's article wasn't some sort of directive or command to fellow and future math education researchers and teachers, many people over many years worked so we'd have some answers to these questions. Still, there's a gap between ''what the field of math ed knows'' and ''what a teacher does with this knowledge, if they know it," which hints at what might be a grand challenge of its own. I'd like to get to that, but in a later post. Next, I'll look at some of the grand challenges that I've seen others post on the web in response to NCTM's call for input.

RYSK: Boaler's The Development of Disciplinary Relationships: Knowledge, Practice and Identity in Mathematics Classrooms (2002)

This is the 22nd in a series describing "Research You Should Know" (RYSK)

Today Geoff Krall (@emergentmath) posed this on Twitter:



It's a cycle I've seen before, and you probably have, too. Students struggle on complex tasks (or, far worse, we just assume they'll struggle without giving them the opportunity) so we opt for the "back to basics" approach and change our mathematical practices to include a lot of repetition on lower-level, procedural tasks. We convince ourselves that this is the right thing until either the students tune out, or underperform, or both, and then we bark about "raising the bar" and the cycle begins anew.

Geoff's cycle reflects knowledge and practice, but I wanted to dig a little deeper into the idea of "student resistance." Jo Boaler (@joboaler) found herself in a similar position after she'd done some studies that linked reform-oriented practices to a more flexible and robust form of mathematical knowledge, but felt there were some stronger links to make between knowledge and a student's mathematical identity, or the way they see themselves as and becoming knowers and do-ers of mathematics.

Boaler described this process in an article titled The Development of Disciplinary Relationships: Knowledge, Practice and Identity in Mathematics Classrooms, published in 2002 in the journal For the Learning of Mathematics. You can find a preprint of the article on Boaler's faculty website, but I took the time tonight to add a summary of the article to the MathEd.net Wiki:

http://mathed.net/wiki/Boaler_(2002)_FLM

My takeaway from reading this particular Boaler article is that while both traditional and reform approaches can result in student learning, the attention to student identity and affect in the reform approach shapes student learning in a way that makes the knowledge more useful in more situations, or, in the relative absence of knowledge, gives students both the disposition and a set of practices to make mathematical progress. When students get caught in Geoff's "Cycle of Low Performance," it's not that they aren't learning. Instead, they just don't see their knowledge as particularly valuable, nor do they see themselves as active users of that knowledge. As teachers, we need to design our classrooms and activities in ways that give students opportunities to have some authority over their mathematical ideas if we expect them to use their knowledge productively.

Starting the Standards Era: NCTM and the 1980s (Part 6 of 6, Focusing the Council on Standards)

(See Part 1, Part 2, Part 3, Part 4, and Part 5 of this six-part series.)

The successful release of the 1989 NCTM Standards paved the way for the release of the next two NCTM standards documents, the Professional Standards for Teaching Mathematics (1991) and the Assessment Standards for School Mathematics (1995). While neither received all the attention of the 1989 Standards, a change in administration in the federal government and changing attitudes at private foundations meant money for later Standards-based projects was more easily obtainable.

In order to provide teachers and district-level mathematics specialists a clearer vision of what Standards-guided lessons would look like, the NCTM launched a project called the Addenda Series, with a committee chaired by Bonnie Litwiller of the University of Northern Iowa1. Although initially intended to produce just a few books a year for one or two years, the project eventually produced 22 books in five years, covering all grade levels K-12. Each book in the Addenda Series provided a set of lesson plans that a teacher could use directly in his or her classroom, offering some of the specificity lacking in the original Standards. The Addenda Series also supported NCTM financially, as it became their most profitable set of publications (S. Frye, personal communication, April 19, 2013).

In order to focus all the NCTM publications on the Standards, a deliberate effort was made by the editors of NCTM's journals to acquire and publish articles that cited the Standards (Lindquist, 2003, p. 837). Authors of research articles that did not refer to the Standards were asked as part of the peer review process to refocus their writing to include the Standards. With this de-facto policy in place, soon nearly every article listed the Standards as a reference. Somewhat ironically, the Standards themselves contain a reference list of only 27 sources (NCTM, 1989, pp. 257-258).

Conclusion

The creation and publication of the NCTM Standards is generally recognized as the event that launched our current era of standards-based reform. Given the rapidity with which educational reforms come and go, such a lasting impact from a document published almost 25 years ago deserves to be well-understood by education policymakers as well as teachers and other education stakeholders. The most significant positive, negative, and fortunate aspects of NCTM's Standards process can be summarized as:

Positive:

  • Leadership desired an organization-level policy influence.
  • Working groups possessed expertise and represented diverse stakeholders.
  • Goals were set conservatively in an effort to broaden public acceptance.
  • Drafts of the Standards were sent to a very wide audience for review and commentary.
  • Standards were promoted through a massive public relations campaign.

Negative:

  • Despite seeking consensus, reconciliation with the most vocal critics in the mathematics community has yet to happen.
  • The working groups lacked writing talent.

Fortunate:

  • A well-timed "crisis" came in the form of A Nation at Risk.
  • NCTM membership rebounded in the mid-80s before the Standards project had an opportunity to put the organization in greater financial jeopardy.
  • Attitudes about the federal government's role in education, as well as national efforts like the Standards, became more favorable after the end of the Reagan Administration.

It's evident that NCTM's leadership in standards-based educational reform didn't come without a sizeable bit of good fortune. The shifting of any number of events by a year or two might have jeopardized the entire process, or relegated the Standards to be that "book on the shelf" to which few paid much attention.

When compared to the Common Core State Standards, a few significant differences stand out to me. First, the NCTM Standards were created largely for the purposes of comparing and judging curriculum, whereas the CCSSM were created as student learning targets and as part of a larger accountability structure. The NCTM Standards were not grade-level specific like the CCSSM, nor were they ever "adopted" wholesale by states or districts. Instead, the NCTM Standards became a foundation for states and districts to write their own standards, and the CCSSM represents the effort to de-duplicate the efforts of states by having a single, agreed-upon set of standards. Although not without their detractors, standards efforts on this scale do have the potential to drive positive change and anchor collaboration between educators across states and districts. Time will tell if any lasting effects of the CCSSM measure up to those of the NCTM Standards, and how.

References

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

National Council of Teachers of Mathematics. (1991). Professional standards for teaching mathematics (p. 196). Reston, VA: Author.

National Council of Teachers of Mathematics. (1995). Assessment standards for school mathematics (p. 102). Reston, VA: Author.


  1. Bonnie Litwiller was my academic advisor and twice my methods professor while I was an undergraduate mathematics major at UNI. 

Starting the Standards Era: NCTM and the 1980s (Part 5 of 6, Making a Draft Widely Available for Review; Publishing and Promoting)

(See Part 1, Part 2, Part 3, and Part 4 of this six-part series.)

So far this series has described the first three of six characteristics of the policy process I outlined in Part 1. This installment will look at the next two characteristics. Despite their shorter descriptions, both were critical in NCTM's effort to have the Standards see wide adoption.

Making a Draft Widely Available for Review

There was one aspect of the Standards draft review process that had significant policy implications. Instead of just sending drafts to a limited number of outside experts, as is often the norm in such cases, NCTM sent out 10,000 copies of the 1987 draft to more than fifty other groups with interests in mathematics education (McLeod, 2003, p. 779). Every single page of the draft contained room for comments, and the working groups received comments by the thousands. Not only did such wide distribution create anticipation for the final draft, the NCTM garnered the support of sixty organizations whose names were printed in the opening pages of the final draft (NCTM, 1989, pp. vi-viii). Listing as endorsers the American Mathematical Society, the American Statistical Association, the Mathematical Association of America, and the Mathematical Sciences Education Board helped moderate the opinion by some that mathematicians were excluded from the Standards writing process.

In the end, the Standards incorporated the perspectives of many people and organizations, but not without compromise. Building consensus while being provocative is a tricky balance, something to which Michael Apple (1992) applied the term "slogan system," meaning they were

a statement of goals that was specific enough to provide direction to the field, vague enough to be acceptable to most mathematics teachers, and novel enough for its vision to catch the attention of the many different groups having a stake in mathematics education. (McLeod, 2003, p. 783)


Publishing and Promoting

While the public relations campaign undertaken by the NCTM to promote the Standards may not have been notable from Mary Lindquist's perspective as a writer (see the difference between her four characteristics and my six in Part 1), it certainly deserves attention as a matter of policy. Without a massive effort, the immediate and lasting policy influence of both the NCTM and the Standards would have certainly been reduced. By the time of publication in March 1989, the total expense of the Standards project had reached approximately $1,000,000, far exceeding the initial estimate of $258,000 (McLeod et al., 1996, p. 44). Included in the million-dollar total was $200,000 in expenses paid to public relations firms. Without this and continuing effort, the worry was that the Standards would be resigned to "sit on shelves" (Lindquist, 2003, p. 840), where all but a few curious graduate students would ever look at them again.

The public relations efforts had all the signs of a six-figure expense (McLeod et al, 1996, pp. 15-16). First, NCTM leadership, including President Shirley Frye and Tom Romberg, were coached to improve their ability to positively present themselves and to handle tough questions gracefully. They then hosted a press conference in Washington D.C. for about 200 members of the media. NCTM leaders made appearances on the Today Show and other major news programs and Astronaut Sally Ride was brought in to help by lending her endorsement. A video featuring jazz musician Wynton Marsalis describing the Standards was "shown over 6000 times by 121 television stations, reaching an audience in the millions" (McLeod et al., 1996, p. 64).

Perhaps most significant was how many copies of the Standards the NCTM had arranged to give away. Unlike the Agenda's relatively short 30 pages, the Standards were 258 pages in length. Still, the NCTM gave away a copy to each one of their 51,000-plus members, as well as anyone and everyone who might have influence but wasn’t an NCTM member. Judith Sowder, Standards Coordinating Committee chair, remembered:

The mailing lists were enormous. The NCTM lobbyist took [the Standards] around personally and handed them to members of Congress. Certainly every dean of sciences, every chair of a mathematics department, every math coordinator, high school principal, and elementary school principal who was on our mailing lists got one. We sent to PTA presidents, school board presidents, and on and on and on. Every mailing list that could possibly be used was used. (McLeod et al., 1996, p. 63)

While the size of this giveaway represented a huge cost to NCTM, it was necessary to ensure widespread adoption. Fortunately for NCTM and their budget, by 1995 more than 258,000 copies of the Standards had been distributed, including the giveaways, and the $25 cost per purchased copy made up for the lost revenue and helped pay for the expenses of the project (McLeod et al., 1996, p. 63).

Now that NCTM had written, published, and promoted the Standards, the last important piece was to make sure they played a part in future efforts. In Part 6, we'll look at how the NCTM focused efforts around the Standards, and I'll wrap up the series with some reflection.

References

Apple, M. W. (1992). Do the standards go far enough? Power, policy, and practice in mathematics education. Journal for Research in Mathematics Education, 23(5), 412-431. doi:10.2307/749562

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

Starting the Standards Era: NCTM and the 1980s (Part 4 of 6, Establishing and Supporting Working Groups)

(See Part 1, Part 2, and Part 3 of this six-part series.)

NCTM's standards-writing process began in 1986 when the Council proposed the creation of a Commission on Standards, chaired by Tom Romberg, and four working groups: grades K-4, 5-8, 9-12, and evaluation. Each working group was chosen for its expertise and consisted of six people, generally a mix of mathematics teachers, state and district math supervisors, mathematics professors from major university mathematics departments, and mathematics education researchers (Lindquist, 2003, pp. 826-827; McLeod, 2003, pp. 772-773). The working groups were somewhat conservative, as radical suggestions would likely make for a less marketable policy recommendation. John Dossey, then president of NCTM, remarked that each group included

somebody who had been around and had a lot of experience – who could represent not a traditional view, but someone who understood the status quo well, who understood the dangers of change, and who was a worker for change, but who knew that you could not just flip a switch and have it happen. (McLeod et al., 1996, p. 46)

While expertise and diversity are generally key ingredients in a policy-making process, a quality that may have been overlooked was the recruitment of quality writers. While some members of the working groups had written textbooks, "neither writing experience nor the ability to produce polished prose was a criterion for selection, and the writing teams often struggled to produce high-quality text" (McLeod, 2003, p. 774). Writing quality was an unexpected struggle during the almost two-year process of writing the Standards.

Although the working groups were tasked with writing standards focusing on mathematical content, they were also mindful of equity issues – including how the inclusion of equity statements might help or hinder the adoption of the Standards. Christian Hirsch, chair of the 9-12 working group, remarked:

I think a careful look at the Standards would show that, in the case of the high school mathematics curriculum, there were two issues that the Standards politically decided not to take a stand on. One was the issue of tracking, and the other was the issue of whether the mathematics studied each year at the high school should be an integrated or unified curriculum, as opposed to a curriculum that was subject-matter oriented each year: algebra, geometry, advanced algebra. That decision was very conscious, in that we felt that we needed to identify in the Standards what we believed at the time in history to be the most important mathematics that all students should have the opportunity to study. And that in itself was advancing thinking on the curriculum quite a ways, because if one looked at the curriculum of the 1970s and 1980s, there was a marked contrast between the mathematics that was in college prep programs and the mathematics that one found in general math, consumer math, remedial courses. We felt it was most important to get out on the table (and over time gain acceptance for) the notion that all kids should be studying different mathematics, rather than getting the Standards caught up in a heated debate over how that mathematics could be organized and made available to students – that is, through sequences of courses that may or may not be tracked. (McLeod et al., 1996, pp. 56-57)

With the exception of a small grant from the AT&T Foundation for $25,000, NCTM chose to finance the writing of the Standards themselves, despite having recently been in significant financial difficulty. The organization had seen its membership fall from 82,000 in 1968 to 56,000 in 19831, and the loss of revenue forced the Board of Directors to consider a proposal to eliminate NCTM's publication program (McLeod et al., 1996, p. 20). Despite the risk of bearing the responsibility for the Standards total estimated cost of $258,000 (McLeod et al., 1996, p. 42) former Executive Director James Gates claimed "the proposal [to fund the Standards] was not submitted to either NSF or the U.S. Department of Education, so that no claims could be made that the federal government had funded the development of curriculum and evaluation standards" (Gates, 2003, p. 742). In addition, the self-funding of the Standards and the decision to not write textbooks, as had been the case during the new math era, afforded the working groups relative independence from textbook publishers. The "corrupting process" (McLeod et al., 1996, p. 33) of working with textbook publishers was a shared concern among the working groups, explained by Arthur Coxford in his chapter in A History of School Mathematics:

Publishers tend to be concerned with the 'bottom line,' whereas curriculum developers desire to try new ideas and organizations. Editors for publishers listen carefully to state textbook adoption committees and to teachers in the field. Neither of these groups was demanding radically different curricula in the 1980s. In fact, they often recommended retaining topics (Cramer's rule or computation using logarithms, for example) long after the usefulness, mathematical or in application, of the topic had diminished. Often it seemed such recommendations were based on an individual's opinion rather than the result of a careful analysis of needs. (Coxford, 2003, p. 613)

While self-funding did afford the working groups a degree of independence and James Gates' statement is at least partially true, the reality of the situation is that the federal government had very little, if any, money to give for a project like the Standards. In 1982, the Reagan Administration has stripped all K-12 funding for mathematics and science from NSF's budget (McLeod et al., 1996, p. 25). Moreover, the same Reagan Administration that had recently sought to dismantle the U.S. Department of Education in the name of local control was not likely to award large sums of money for the development of a national set of curriculum standards. NCTM had applied for a sizable amount of other private money, but the AT&T grant was the only one awarded. Clearly the organization had no other real options but to pay for the Standards itself and use the independence to its advantage, including spinning the effect of that independence as a policy tool.

In Part 5 of this series, we'll look at how NCTM collected and incorporated feedback about the Standards and the measures they took to promote the published draft.

References

Coxford, A. F. (2003). Mathematics curriculum reform: A personal view. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 599-621). Reston, VA: National Council of Teachers of Mathematics.

Gates, J. D. (2003). Perspective on the recent history of the National Council of Teachers of Mathematics. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 737-752). Reston, VA: National Council of Teachers of Mathematics.

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Teachers of Mathematics. (2013). NCTM at a glance. Retrieved from http://www.nctm.org/about/content.aspx?id=174


  1. Membership began to rebound in 1984. NCTM's membership grew to 118,000 in 1995 (McLeod et al., 1996, p. 20) and currently stands at 80,000 members (National Council of Teachers of Mathematics, 2013). 

Starting the Standards Era: NCTM and the 1980s (Part 3 of 6, Meeting a [Perceived] Need)

(See Part 1 and Part 2 of this six-part series.)

"Exactly where the Agenda's call for action might have led without the appearance of a new crisis is not clear" (Fey & Graeber, 2003, p. 553). If the research and public sentiment regarding mathematics education had looked positive as the country moved into the 1980s, there would have been little need for the NCTM to flex its new policy muscles. But that wasn't the case. Instead, growing concern over the state of math education would give the NCTM a reason to put the Agenda for Action into action.

In the late 1970s, the NSF funded a series of surveys and case studies to determine a baseline of the nation's mathematics performance. The case studies indicated that most classrooms were still exhibiting a traditional view of mathematics and showed little influence of the new math efforts of the 1960s (McLeod, 2003, p. 757). Furthermore, early results from the National Assessment of Educational Progress (NAEP) raised doubts that students were able to perform anything but the most basic mathematical tasks.

Less publicly visible but yet of concern to mathematics educators was the continued trend towards "basic" math textbooks. In particular, the claims of outspoken textbook author John Saxon "became a preoccupation of NCTM leaders" (McLeod, 2003, pp. 760-761). Saxon (1982), in a three-page Phi Delta Kappan article, made boisterous claims about the effectiveness of his textbooks. The article lacked a description of how (or if) the treatment and control groups were randomized, what textbooks were used by the students in the control group, how the assessment used to measure students' learning was constructed, and failed to use any real statistical tests. It did, however, include the address of the publisher and the cost of his textbook, as well as statements like, "A general scanning of the scores suggests that gifted students who used the normal textbooks were severely damaged and that less gifted students who used the normal textbooks were destroyed" (p. 484).

NCTM’s Research Advisory Committee (RAC) fielded concerns over Saxon's claims, some requesting censure of Saxon's texts and others requesting further research regarding the effectiveness of the Saxon texts. John Dossey, NCTM president from 1986-1988, recalled that "RAC members felt that it was inappropriate for professional groups to censure material, especially in the absence of an agreed-upon set of standards" (McLeod et al., 1996, p. 31). Concurrently, NCTM's Instructional Issues Advisory Committee (IIAC) was considering the creation of a document that could be used by schools when selecting textbooks. Jim Fey, an IIAC member at the time, said, "There was some concern from several places that textbooks, and therefore curricula, were being driven by non-professional considerations, political log rolling, and so on" (McLeod et al., 1996, p. 31). The RAC and IIAC were already considering such a textbook selection document in the spring of 1983 when a much more public educational crisis would demand the attention of the NCTM.

In April the National Commission on Excellence in Education (1983) published A Nation at Risk: The Imperative for Educational Reform. This critical document used Cold War-era language combined with threats of losing our nation's economic competitiveness to assert that it was imperative that schools change to meet the nation's growing needs. A Nation at Risk convinced many that an increase in the amount rigorous coursework required in schools, specifically in mathematics and science, should be a top national priority. While there is substantial evidence suggesting that the nation wasn't any more "at risk" than it ever had been (Berliner & Biddle, 1995), the perception of risk was more important than the truth.

By the end of 1983, two small conferences were held to determine the math education community's response to A Nation at Risk. Only sixty-eight people attended in total, with only six people attending both conferences (McLeod, 2003, p. 767). One of those six people was Tom Romberg, the University of Wisconsin professor who would later be named chairperson of the NCTM Standards Commission. Among the recommendations to come out of those conferences was the organization of a group who could write a set of guidelines specifying qualities of a proper mathematics curriculum (Romberg & Stewart, 1984).

Romberg remembered that "A Nation at Risk served primarily as a spark plug, a starting point for people" (McLeod et al., 1996, p. 27). Others downplayed the influence of A Nation at Risk. Mary Lindquist claimed "The Standards came mainly from within mathematics education rather than as a reaction to A Nation at Risk or federal policies" (McLeod et al., 1996, p. 37). The deciding measure of A Nation at Risk's impact might be found in the Standards themselves, in the first line of the first paragraph of the Introduction: "These standards are one facet of the mathematics education community's response to the call for reform in the teaching and learning of mathematics" (NCTM, 1989, p. 1). The footnote for that sentence contains the statement "See A Nation at Risk."

NCTM had prepared itself to take a stand on matters of policy and now they had their greatest opportunity. In Part 4 of this series, we'll look at how NCTM organized itself to write the Standards, and the risks they took and avoided in doing so.

References

Berliner, D. C., & Biddle, B. J. (1995). The manufactured crisis: Myths, fraud, and the attack on America’s public schools (p. 414). New York, NY: Basic Books.

Fey, J. T., & Graeber, A. O. (2003). From the New Math to the Agenda for Action. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (Vol. 1, pp. 521-558). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM‟s role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, D.C. Retrieved from http://www2.ed.gov/pubs/NatAtRisk/index.html

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

Romberg, T. A., & Stewart, D. M. (Eds.). (1984). School mathematics: Options for the 1990s. Retrieved from http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED250196

Saxon, J. (1982). Incremental development: A breakthrough in mathematics. Phi Delta Kappan, 63(7), 482-484. Retrieved from http://www.jstor.org/stable/20386409.

Starting the Standards Era: NCTM and the 1980s (Part 2 of 6, Asserting a Policy-Minded Orientation)

From the NCTM's inception in 1920 until the 1960s, the organization "played an important but usually secondary role" (McLeod, Stake, Schappelle, Mellissinos, & Gierl, 1996, p. 18) in mathematics education policy. NCTM's primary role "focused on supporting mathematics teachers through the exchange and promotion of good ideas, not through its influence on educational policy" (McLeod, 2003, p. 759), and many NCTM leaders thought it was best to avoid "positions that might be opposed by some of its members" (McLeod et al., 1996, pp. 18-19). Therefore, during the Sputnik-era calls for reform in the late 1950s and the "new math" era of the 1960s (Fey & Graeber, 2003), organizational leadership from NCTM was insignificant.

Fueled by the battles over the new math and events of the mid-1960s, attitudes at NCTM began to change:

Although the attempt to change school mathematics during the new math era was not very successful, the idea that an activist professional organization could have an impact on society still had some appeal. The change from passive to more active stances was a topic of discussion for many professional organizations during the 1960s and 1970s. Opposition to the war in Vietnam was one source of these discussions. As academics became involved in teach-ins and other protests against the war, there was a natural spread of their concerns into the domain of professional organizations. (McLeod, 2003, p. 758)

NCTM's hands-off policy stance changed in 1966 when the Board of Directors voted to be more willing to assert its position on controversial issues. Reflecting on his thirty-one years (1964-1995) as NCTM Executive Director, James D. Gates (2003) characterized the decision and its effects: "It was a bold step for the Council, to take actions that were more visible in the public sector, leading to the development and distribution of position statements, the publication of guidelines and standards, and testimony before congressional committees" (p. 747).

While the NCTM struggled to use its new policy-minded powers during the 1970s (Fey & Graeber, 2003), the critical turning point came with the election of Shirley Hill as NCTM President in 1978. Joe Crosswhite, NCTM president from 1984-1986, remarked that, "Prior to Shirley's time, you couldn't interest an NCTM president in having a national presence in Washington – an NCTM presence" (McLeod et al., 1996, p. 19). Shirley Hill explained that she

felt a certain frustration that we weren't being listened to seriously enough outside our own circles....I remember attending some meeting of the presidents of like organizations in Washington, DC, in the 1970s and noticing the frequent absence of the president of one of our sister organizations. It turned out that he was being escorted by his staff government relations expert in visits to members of Congress. At that time his organization seemed to be very influential in the establishment of federal programs. I thought that we in NCTM should be doing more of these things. I thought that we and most of our sister organizations were being a little naïve about government relations and public relations at that time. (McLeod et al., 1996, pp. 19-20)

In addition to hiring Richard Long, a former lobbyist for the International Reading Association (McLeod, 2003, p. 760), two documents published by NCTM during this time mark NCTM's emerging policy perspective. The first was actually a republishing of a position paper of the National Council of Supervisors of Mathematics (NCSM), a sister organization of the NCTM. The paper, A Position Paper on Basic Mathematical Skills (1977), was notable because instead of refuting the "back to basics" theme of school mathematics in the 1970s, it co-opted the language and redefined the meaning of "basic skills" for NCSM's and NCTM's own purpose (Fey & Graeber, 2003, p. 552; McLeod, 2003, p. 761). With this action, NCTM and NCSM showed that both organizations understood the importance of controlling the vocabulary and discourse in educational policy.

The second document published by the NCTM solidified their stance as a policy influencer. The Agenda for Action (1980) was the product of NCTM's Committee for Mathematics Curriculum for the 1980s, chaired by George Immerzeel of the University of Northern Iowa. While only about thirty pages in length and containing eight somewhat non-specific recommendations, the Agenda was NCTM's most prominent and powerful policy document to date, and "laid the groundwork for a major reform effort that continued through the end of the twentieth century" (Gates, 2003, p. 741). Shirley Hill described the context for the Agenda at her 1980 presidential address:

In the 1960s we learned that curriculum change is not a simple matter of devising, trying out, and proposing new programs. In the 1970s we learned that many pressures, from both inside and particularly outside the institution of the school, determine goals and directions and programs....A major obligation of a professional organization such as ours is to present our best knowledgeable advice on what the goals and objectives of mathematics education ought to be....In my opinion, we are approaching a crisis stage in school mathematics. Policy makers in education are not confronting the deepest problems because the public and its representatives have been diverted by a fixation on test scores....We are still battling an excessive narrowing of the curriculum in the name of "back to basics." (Hill, 1980, pp. 473-476, as cited in McLeod et al., 1996, pp. 24-25)

Furthermore, in the introduction of the 1983 NCTM Yearbook, The Agenda in Action, Shirley Hill described the NCTM's implementation of the Agenda in five categories:

  1. Public relations.
  2. Political action.
  3. Support for local efforts.
  4. Collection and dissemination of model programs.
  5. Production of guidelines and instructional resources.

Certainly the first two items in the list would have been far less likely to appear even ten years earlier. The words and actions of Shirley Hill clearly demonstrate the policy orientation NCTM had asserted by the early 1980s. But a willingness to affect policy and an opportunity to affect policy are two different things, and that opportunity would come soon enough. In Part 3 of this series, we'll look at the events that set NCTM to work on the Standards.

References

Fey, J. T., & Graeber, A. O. (2003). From the New Math to the Agenda for Action. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (Vol. 1, pp. 521-558). Reston, VA: National Council of Teachers of Mathematics.

Gates, J. D. (2003). Perspective on the recent history of the National Council of Teachers of Mathematics. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 737-752). Reston, VA: National Council of Teachers of Mathematics.

Hill, S. (1983). An agenda for action: Status and impact. In G. Shufelt & J. R. Smart (Eds.), The
agenda in action
(pp. 1-7). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B. (2003). From consensus to controversy: The story of the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 753-818). Reston, VA: National Council of Teachers of Mathematics.

McLeod, D. B., Stake, R. E., Schappelle, B. P., Mellissinos, M., & Gierl, M. J. (1996). Setting the standards: NCTM's role in the reform of mathematics education. In S. A. Raizen & E. D. Britton (Eds.), Bold ventures: Case studies of U.S. innovations in mathematics education (pp. 13-132). Dordrecht, The Netherlands: Kluwer.

National Council of Supervisors of Mathematics. (1977). Position paper on basic mathematical skills (p. 4). Minneapolis, MN. Retrieved from http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED139654

National Council of Teachers of Mathematics. (1980). An Agenda for Action: Recommendations for School Mathematics of the 1980s. Reston, VA. Retrieved from http://www.nctm.org/standards/content.aspx?id=17278

Starting the Standards Era: NCTM and the 1980s (Part 1 of 6, Where Curriculum and Policy Meet)

The Common Core State Standards might be the current story, but to gain a broader perspective of this "standards era" of educational reform we would be wise to look at where the era got its start. Over the next six posts, borrowing generously from the work of Douglas McLeod and others, I'll attempt to tell the story of how the National Council of Teachers of Mathematics (NCTM) created the first widely-recognized set of curriculum standards, and the policy process that developed along the way.

NCTM's publication of the Curriculum and Evaluation Standards for School Mathematics (1989) stands as the landmark event that launched our nation's current era of standards-based educational reform1. While the effect of this effort led to a new period of reform in school mathematics, marked by new textbooks and materials and what has come to be known as the "math wars," the process undertaken by NCTM in writing the Standards has been both praised and panned by critics. Diane Ravitch (1995) claimed the Standards "emerged from a successful consensus process that included many classroom teachers and the nation's leading mathematics educators.... [They are] an example for emulation" (p. 57). Roy Romer (1995), then the Governor of Colorado, said the Standards "were arrived at correctly, from the bottom up. They represent the best thinking in the country, collectively" (p. 67).

Critics were far tougher on NCTM and the process for writing standards for school mathematics. Ralph A. Raimi, a prominent figure in the math wars, claimed that whenever he was asked to help write or review math standards, he'd send the following recommendation:

If your standards were composed without the significant participation of mathematicians, let me advise you to go down to your best state university and find a professor of mathematics, at least 40 years old, who is willing to help you. He need not have heard of Piaget and Bruner, and he might very well be of such a personality that you would never trust him in a fifth grade class, but he should be an English-speaking American who himself has gone through our public school system, and he should be a genuine mathematician who has published at least a handful of research articles in the refereed professional journals of pure or applied mathematics. (Not journals of math education; you have such people in your department of education already.) Find out that this mathematician is willing to devote a few days to your project. Give him a copy of the Fordham Foundation report on the state standards to read....Then give him a copy of your own state's draft standards and ask for written commentary. Then use it. (Raimi, 2000, p. 57)

Raimi's suggested process for writing or reviewing mathematics standards might have some admirers, but it does not reflect the process undertaken by most standards-writing groups who wish to have a lasting impact on education practice and policy. Because the NCTM Standards have had an influence lasting now over twenty years, this series of writings will examine the specific process undertaken by NCTM that led to the publication of the Standards in 1989.

The Standards as a Policy Process

A review of the literature describing the NCTM's efforts can be undertaken from multiple perspectives. Teachers of mathematics might be most interested in the content of the Standards themselves, along with the contrasting arguments that influenced the curricular content emphasized and de-emphasized by the Standards. Historians of education might wish to study the development of the Standards as a sequence of events set in the context of greater educational and societal movements. Those who participated in the writing of the Standards bring yet another perspective of the process, such as that of Mary Lindquist, a member of the Grades K-4 working group that wrote the Standards. In Lindquist's chapter of NCTM's A History of School Mathematics (2003), she describes the effort to develop and promote the standards as having "four fundamental characteristics:"

  1. Accepting responsibility for standards.
  2. Establishing and supporting working groups.
  3. Making a draft widely available for review.
  4. Focusing the Council on standards.

Although any review of the NCTM's standards-writing process will probably be more alike than different, to gain a broader, policy-making perspective, this series of posts will be organized into six areas that share much similarity with Mary Lindquist's fundamental characteristics:

  1. Asserting a policy-minded orientation.
  2. Meeting a (perceived) need.
  3. Establishing and supporting working groups.
  4. Making a draft widely available for review.
  5. Publishing and promoting.
  6. Focusing the Council on standards.

The addition of the first two areas acknowledges that efforts to impact policy are: (a) generally conscious efforts undertaken by an organization and (b) most successful when done in response to a perceived crisis. The fifth area, publishing and promoting, describes the sometimes extraordinary effort an organization must take to make their message heard and to make it lasting.

In Part 2, we'll look at how and why NCTM decided to assert itself in the education policy arena.

References

Lindquist, M. M. (2003). My perspective on the NCTM Standards. In G. M. A. Stanic & J. Kilpatrick (Eds.), A History of School Mathematics (pp. 819-842). Reston, VA: National Council of Teachers of Mathematics.

National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.

National Council of Teachers of Mathematics. (1991). Professional standards for teaching mathematics (p. 196). Reston, VA: Author.

National Council of Teachers of Mathematics. (1995). Assessment standards for school mathematics (p. 102). Reston, VA: Author.

Raimi, R. A. (2000). Judging state standards for K-12 mathematics education. In S. Stotsky (Ed.), What’s at stake in the K-12 standards wars (pp. 33-58). New York, NY: Peter Lang.

Ravitch, D. (1995). National standards in American education (p. 223). Washington, D.C.: Brookings Institution.

Romer, R. (1995). Explaining standards to the public. In D. Ravitch (Ed.), Debating the future of American education: Do we need national standards and assessments? (pp. 66-72). Washington, D.C.: Brookings Institution.


  1. Although NCTM’s Curriculum and Evaluation Standards for School Mathematics is just the first in a set of three publications, with the second two addressing the teaching (NCTM, 1991) and assessment (NCTM, 1995) of mathematics, this first document is the most well-known and is frequently referred to simply as the Standards

RYSK: Greeno, Pearson, & Schoenfeld's Implications for NAEP of Research on Learning and Cognition (1996)

This is the 14th in a series describing "Research You Should Know" (RYSK).

You might have read my recent post about Lorrie Shepard's 2000 article The Role of Assessment in a Learning Culture and assumed she focused on classroom assessment because changing large-scale, standardized assessments was a lost cause. Think again. By that time, an effort to integrate new theories of learning and cognition into the NAEP was already underway, traceable back to a 1996 report titled Implications for NAEP of Research on Learning and Cognition written by by James G. Greeno, P. David Pearson, and Alan H. Schoenfeld. For years Greeno has been recognized as one of education's foremost learning theorists, while Pearson and Schoenfeld are highly-regarded experts in language arts and mathematics education, respectively.

The National Assessment of Educational Progress, sometimes called "The Nation's Report Card," has been given to students in various forms since 1969. Unlike the high-stakes assessments given by states to all students, the NAEP is given to samples of 4th, 8th, and 12th grade students from around the country, and the use of matrix sampling means no student ever takes the entire test. The goal of the NAEP is to inform educators and policymakers about performance and trends, and details about how different NAEP exams try to achieve this are described in depth at the NAEP website.

Greeno et al. tried to answer two main questions in their report: (a) Does the NAEP inform the nation "about significant aspects of the knowing and learning" (p. 2) in math and reading, and (b) What changes in NAEP would make it a better tool for informing the nation about the performance and progress of our educational system? The authors acknowledge the tradition with what they call differential and behaviorist perspectives on learning, and focus more of their attention on the ability to assess cogntiive and situative perspectives, which have strong theoretical foundations but hadn't been reflected in most large-scale assessments.

Concisely, the report says the "key features of learning in the cognitive perspective are meaningful, conceptual understanding and strategic thinking" and that the "key feature of learning in the situative perspective is engaged participation with agency" (p. 3, emphasis in original). Greeno et al. say that if students are engaged in learning activities that reflect these perspectives, then the NAEP should try to capture the effects of those experiences.

One of the main reasons I'm writing about this report is because it gives me another chance to describe current learning perspectives that go beyond the simpler "behaviorism vs. constructivism" argument I knew as a teacher and heard from others. This report does this well without burdening the reader with all the gory details that learning theorists grapple with as they try to push these theories even further. So here's my summary of their summaries of each perspective:

Differential

This perspective accepts the assumption that "Whatever exists, exists in some amount and can be measured" (p. 10). For knowledge, that "whatever" is referred to as a trait, and different people have traits in different amounts. Evidence of traits can be detected by tests, and the correlation of different tests supposedly measuring the same trait is an indication of our confidence in our ability to measure the trait. Because the person-to-person amount of a trait is assumed to be relative, it's statistically important to design tests where few people will answer all items correctly or incorrectly.

Behaviorist

Behaviorism assumes that "knowing is an organized collection of stimulus-response associations" (p. 11). To learn is to acquire skills (usually and best in small pieces) and measuring learning is seen as an analysis of behaviors which can be decomposed into responses to stimuli. Behaviorism's influence on curriculum is seen when behavioral objectives are organized as a sequence building bigger ideas out of smaller, prerequisite objectives.

Cognitive

The cognitive perspective primarily focuses "on structures of knowledge, including principles and concepts of subject-matter domains, information organized by schemata, and procedures and strategies for problem solving and reasoning" (p. 12). Learners actively construct their knowledge rather than accept it passively, and conceptual understanding is not just the sum total of facts. The early part of the cognitive revolution was reflected in the math and science reforms of the 1950s and 1960s, while Piagetian ideas and research on student understanding have pushed the perspective further. Assessments need to determine more than right and wrong answers, and research involving think-aloud protocols, student interviews, eye-tracking studies, and patterns of responses have yielded better theories about how to assess for student understanding.

Situative

The situative perspective is a social view of learning focused on "interactive processes in which people participate in practices that are organized by the societies and communities they belong to, using the technologies and natural resources in their environments" (p. 14). Knowing is no longer in the head -- instead it is seen as participation in a community, and learning is represented by increased and more effective participation. John Dewey took parts of this perspective in the early 20th century, but we owe much of the theory to Lev Vygotsky, whose work in the 20s and 30s in the Soviet Union eventually emerged and has heavily influenced learning science since the late 1970s. The situative perspective is more readily applied to interactions between people or between people and technology (which is seen as a cultural artifact with social roots), but even solitary learners can be assessed with the situative perspective if we focus on "the individual's participation in communities with practices, goals, and standards that make the individual's activity meaningful, either by the individual's adoption of or opposition to the community's perspective" (p. 14). The influence of the situative perspective on curriculum and classrooms is most easily seen in the focus on student participation, project work, small-group discussions, and authentic work in subject-area disciplines.

In summary, achievement in each perspective can be described as:
Differential/Behaviorist
- "progress a student has made in the accumulation of skills and knowledge" (p. 16)
Cogntive
- a combination of five aspects (pp. 16-18):
  1. Elementary skills, facts, and concepts
  2. Strategies and schemata
  3. Aspects of metacognition
  4. Beliefs
  5. Contextual factors
Situative
- a combination of five aspects (pp. 19-21):
  1. Basic aspects of participation
  2. Identity and membership in communities
  3. Formulating problems and goals and applying standards
  4. Constructing meaning
  5. Fluency with technical methods and representations

What Does This Mean for the NAEP?

Greeno et al. declared that the NAEP was "poorly aligned" (p. 23) with the cognitive perspective. It hadn't captured the complexity of student knowledge and they recommended a greater focus on problems set in meaningful contexts and tasks that reflected the kind of knowledge models and structures theorized in the research. As for the situative perspective, Greeno et al. went so far to say that what the NAEP had been measuring was "of relatively minor importance in almost all activities that are significant for students to learn" (p. 27). Whereas the situative perspective focuses on participation in a particular community or knowledge domain, it's impossible to escape the reality that on the NAEP, the domain is test-taking itself, a "special kind of situation that is abstracted from the variety of situations in which students need to know how to participate" (pp. 28-29). Measuring learning from the situative perspective would require a complicated set of inferences about a student's actual participation practices in an authentic domain, and the technical limitations of the NAEP limits our ability to make those inferences.

The report continues with specific details about how we might measure learning in language arts and mathematics with the NAEP from both a cognitive and situative perspective. In the conclusion, the authors first recommend some systemic changes: First, NAEP needed more capacity for attending to the long-term continuity of the test and its design. Given how important NAEP is for measuring longitudinal trends, we can't change it without a careful study of how to compare new results to old. Second, the authors wanted a national system for evaluating changes in the educational system. The NAEP alone can't tell us everything we need to know about the effectiveness of educational reforms.

As for recommendations for the test itself, Greeno et al. emphasized the need to align the assessment with ongoing research, especially in the cognitive perspective. Instead of planning for NAEP tests one at a time and contracting out various work, the development process needed to become more continuous with particular sustained attention given to progress in the cognitive and situative dimensions. More ambitiously, the authors recommended a parallel line of test development to begin establishing new forms of assessment that might capture learning in these newer perspectives. This is a critical challenge because while we know the least about assessing from the situative perspective, the situative is often the perspective that frames our national educational goals. The NAEP can't measure progress to situative-sounding goals without better measurement of learning from a situative perspective.

It has now been 12 years since the release of this report. I don't know how Greeno et al.'s recommendations have specifically been followed, but there is good news. If you read most any of the current NAEP assessment frameworks, you can find evidence of progress. The frameworks have changed to better measure student learning, particularly from the cognitive perspective. Some frameworks honesty address the difficulty in measuring the situative perspective using an on-demand, individualized, pencil-and-paper (but increasingly computer-based) test. (See Chapter One of the science framework, for example.) Will we see any radical changes any time soon? I doubt it. The information we get about long-term trends from the NAEP requires a certain amount of stability. Given the onset of new national consortia tests based on the Common Core State Standards, I think the educational system will get its fill of radical change in the next 3-5 years. With that as the comparison, we all might contently appreciate the stability and attention to careful progress reflected in the NAEP.

References

Greeno, J. G., Pearson, P. D., & Schoenfeld, A. H. (1996). Implications for NAEP of research on learning and cognition (p. 84). Menlo Park, CA.