RYSK: Shepard's The Role of Assessment in a Learning Culture (2000)

This is the 13th in a series describing "Research You Should Know" (RYSK).

In her presidential address at the 2000 AERA conference, Lorrie Shepard revealed a vision for the future of educational assessment. That message turned into an article titled The Role of Assessment in a Learning Culture, and its message is still very much worth hearing today. Lorrie Shepard remains a globally-respected expert in assessment, psychometrics, and their misuses, and I'd think she was totally awesome even if she wasn't my boss.

Shepard is often present for debates about large-scale testing, but this paper focuses on classroom assessment -- the kind, says Shepard, "that can be used as a part of instruction to support and enhance learning" (p. 4). Shepard does this by first explaining a historical perspective, then describing a modern view of learning theories, then envisioning how new assessment practices could support those theories. Impressively, she does this all in just 11 well-written pages. (In fact, given that the paper is available on the web, I wouldn't blame you at all for skipping this summary and just reading the article for yourself.)

History

Shepard highlights several major themes from history that have continued to drive our assessment practices. One is the social efficiency movement, which "grew out of the belief that science could be used to solve the problems of industrialization and urbanization" (p. 4). While this movement might have helped our economic and educational systems scale rapidly (think about Ford and the assembly line), social efficiency carries with it a belief that people have a certain innate (and largely fixed) set of capabilities, and our society operates its most efficiently when we measure people and match their capabilities to appropriate education and employment. For example, students were often given IQ tests to determine if their future path should lie on a particular academic or vocational track.

The dominant learning theories of the early and mid-1900s were associationism and behaviorism, both of which promoted the idea that learning was an accumulation of knowledge that could be broken into very small pieces. Behaviorism was also tied closely to theories of motivation, as it was believed learning was promoted when knowledge was made smaller and opportunities for positive reinforcement for learning were made greater. Much of the assessment work related to these beliefs can be traced back to Edward Thorndike, considered to be the father of scientific measurement and earliest promoter of "objective" testing. It's been 100 years since Thorndike was elected president of the American Psychological Association, and decades since his ideas seriously influenced the leading edges of learning theory. Still, as most anyone who works in schools or experienced a traditional education can attest, ideas of social efficiency and behaviorism are still evident in schools -- especially in our assessment practices.

Together, the theories of social efficiency, scientific measurement, and beliefs about intelligence and learning form what Shepard sees as the dominant 20th-century paradigm. (See page 6 of the paper for a diagram.) It's important to begin our discussion here, says Shepard, because "any attempt to change the form and purpose of classroom assessment to make it more fundamentally a part of the learning process must acknowledge the power of these enduring and hidden beliefs" (p. 6).

Modern Theories

In the next section, Shepard describes a "social-constructivist" framework that guides modern thought on learning:

The cognitive revolution reintroduced the concept of mind. In contrast to past, mechanistic theories of knowledge acquisition, we now understand that learning is an active process of mental construction and sense making. From cognitive theory we have also learned that existing knowledge structures and beliefs work to enable or impede new learning, that intelligent thought involves self-monitoring and awareness about when and how to use skills, and that "expertise" develops in a field of study as a principled and coherent way of thinking and representing problems, not just as an accumulation of information. (pp. 6-7)

These ideas about cognition are complimented by Vygotskian realizations that the knowledge we construct "is socially and culturally determined" (p. 7). Unlike Piaget's view that development preceded learning, this modern view sees how development and learning interact as social processes. While academic debates remain about the details of cognitive vs. social (and vs. situative vs. sociocultural vs. social constructivist vs. ...), for practical purposes these theories can coexist and are already helping teachers view student learning in ways that improve upon behaviorism. However, Shepard says, since about the 1980s this has left us in an awkward state of using new theories to inform classroom instruction, while still depending on old theories to guide our assessments.

Improving Assessment

If we wish to make our theories of assessment compatible with our theories of learning, Shepard says we need to (a) change the form and content of assessments and (b) change the way we use and regard assessment in classrooms. Some of the potential changes in form are already familiar to most teachers, such as a greater use of open-ended performance tasks and setting assessment tasks in real-world contexts. Furthermore, Shepard suggests that classroom routines and related assessments should reflect the need to socialize students "into the discourse and practices of academic disciplines" (p. 8) as well as foster metacognition and important dispositions. Shepard does not go into much more detail here because others have already given attention to these ideas, but gives us this simple yet powerful idea (p. 8):

"Good assessment tasks are interchangeable
with good instructional tasks."

Next Shepard pays special attention to negative effects of high-stakes testing. Shepard could be called a believer in standards-based education, but recognizes how "the standards movement has been corrupted, in many instances, into a heavy-handed system of rewards and punishments without the capacity building and professional development originally proposed as part of the vision (McLaughlin & Shepard, 1995)" (p. 9). Unfortunately, Shepard's predictions have held true over the past 12 years: we've seen test scores distorted under political pressure, a corruption of "teaching to the test," and a trend towards the "de-skilling and de-professionalization of teachers" (p. 9). What's worse might be a decade of new teachers who've learned to "hate standardized testing and at the same time reproduce it faithfully in their own pre-post testing routines" (p. 10) because they've had such little exposure to better forms of assessment.

For the rest of the article, Shepard focuses on how assessment can and should be used to support student learning. First, classrooms need to support a learning culture where "students and teachers would have a shared expectation that finding out what makes sense and what doesn't is a joint and worthwhile project" (p. 10). This means assessment that is more informative and reflective of student learning, one where "students and teachers look to assessment as a source of insight and help instead of an occasion for meting out rewards and punishments" (p. 10). To do this, Shepard describes a set of specific strategies teachers should use in combination in their classrooms.

Dynamic Assessment

When Shepard wrote this article, formal ideas and theories about formative assessment were still emerging and the field had yet to settle on some of the language we now use. But if you're at all familiar with formative assessment, Shepard's description of "dynamic" assessment will sound familiar: teacher-student interactions continuing through the learning process rather than delayed until the end, with the goal of gaining insight about what students understand and can do both on their own and with assistance from classmates or the teacher.

Prior Knowledge

The idea of a pre-test to see what students know before instruction begins is not new, but Shepard says we should recognize that traditional pretests don't usually take account of social and cultural contexts. Because students are unfamiliar with a teacher's conceptualization of the content prior to instruction (and vice versa), scores might not accurately reflect students' knowledge as well as, say, a conversation or activity designed to elicit the understandings students bring to the classroom. Also, as Shepard has frequently observed, traditional pre-testing often doesn't significantly affect teachers' instruction. So why do it? Instead, why not focus on building a learning culture of assessment: "What safer time to admit what you don't know than at the start of an instructional activity?" (p. 11)

Feedback

The contrast in feedback under old, behaviorist theories and newer, social-constructivist theories is clear. Feedback under old theories generally consisted of labeling answers right or wrong. Feedback under new theories takes greater skill: teachers need to know how to ignore student errors that aren't immediately relevant to the learning at hand, while crafting questions and comments that force the student to question themselves and any false knowledge they might be constructing. (See Lepper, Drake, and O'Donnell-Johnson, 1997, for more on this.)

Transfer

While it is our hope that our students will be able to generalize the specific knowledge they have learned and apply it to other situations, our ability to accurately research and make claims about knowledge transfer turns out to be a pretty tricky business. Under a strict behaviorist perspective, it was appropriate to believe that each application of knowledge should be taught separately. Many of our current theories support an idea of transfer, and evidence shows that we can help students by giving them opportunities to see how their knowledge reliably works in multiple applications and contexts. So while some students might not agree, Shepard says teachers should not "agree to a contract with our students which says that the only fair test is one with familiar and well-rehearsed problems" (p. 11).

Explicit Criteria

If students are to perform well, they need to have clear guidance about what good performances look like. "In fact, the features of excellent performance should be so transparent that students can learn to evaluate their own work in the same way their teachers would" (p. 11). This reinforces ideas of metacognition and, perhaps more importantly, fairness.

Self-Assessment

There are cognitive reasons to have students self-assess, but other goals are to increase student self-responsibility and make teacher-student relationships more collaborative. Students who self-evaluate become more interested in feedback from others, are more aware of standards of excellence, and take more ownership over the learning process.

Evaluation of Teaching

This is another idea now heavily intertwined with formative assessment, but Shepard takes it one step farther than I normally see it. Instead of just using assessment to improve one's teaching, Shepard recommends that teachers be transparent about this process and "make their investigations of teaching visible to students, for example, by discussing with them decisions to redirect instruction, stop for a mini-lesson, and so-forth" (p. 12). This, Shepard says, is critical to cultural change in the classroom:

If we want to develop a community of learners -- where students naturally seek feedback and critique of their own work -- then it is reasonable that teachers would model this same commitment to using data systematically as it applies to their own role in the teaching and learning process. (p. 12)

Conclusion

Shepard admits that describing this new assessment paradigm is far easier than it is to implement in practice. It relies on a great deal of teacher ability and confronting some long-held beliefs. Shepard recommended a program of research accompanied by a public education campaign to help citizens and policymakers understand the different goals of large-scale and classroom assessments. Neither the research or educating the public is easy, because both are built upon a history of theories and practice that a new paradigm needs to discard. Perhaps we haven't taken on this challenge with the effort and seriousness we've needed, and I worry that now we're more apt to talk about "learning in an assessment culture" rather than the other way around, as Shepard titled this article. I sometimes wonder if she's considered writing a follow-up with that title, or if she's hoping she'll never have to. I guess the next time it comes up I'll have to ask her.

Math note: This is an article about assessment and not specific to mathematics, but I'd be remiss if I didn't share Shepard's inclusion of one of my all-time favorite fraction problems:


References

Lepper, M. R., Drake, M. F., O'Donnell-Johnson, T (1997). Scaffolding techniques of expert human tutors. In K. Hogan & M. Presley (eds.), Scaffolding student learning: Instructional approaches & issues. Cambridge, MA: Brookline Books.

McLaughlin, M. W., & Shepard, L.A. (1995). Improving education through standards-based reform: A report of the National Academy of Education panel on standards-based educational reform. Stanford, CA: National Academy of Education.

Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14. doi:10.2307/1176145

Thompson, P. W. (1995). Notation, convention, and quantity in elementary mathematics. In J. T. Sowder & B. P. Schappelle (Eds.), Providing a foundation for teaching mathematics in the middle grades (pp. 199-221). New York: State University of New York Press.

RYSK: Gravemeijer's Local Instruction Theories as Means of Support for Teachers in Reform Mathematics Education (2004)

This is the 12th in a series describing "Research You Should Know" (RYSK) and part of my OpenComps.

Gravemeijer (from above) at the 2011 RME Conference
I began my recent reading of the literature on learning trajectories by reading Clements & Sarama's (2004) Learning Trajectories in Mathematics Education, and then went back to where the idea formally began, Simon's (1995) Reconstructing Mathematics Pedagogy from a Constructivist Perspective. Now I'm jumping to 2004 again with Koeno Gravemeijer's Local Instruction Theories as Means of Support for Teachers in Reform Mathematics Education. Koeno Gravemeijer (pronounced Koo-no Grav-meyer) has worked at multiple institutions in the Netherlands and spent time at Vanderbilt working with Paul Cobb, but he's best known for his long time association and leadership with the Freudenthal Institute and his advancements of Realistic Mathematics Education (RME).

When Martin Simon introduced the concept of hypothetical learning trajectories in his 1995 paper Reconstructing Mathematics Pedagogy from a Constructivist Perspective, he described them as part of a teaching cycle that was informed by the teacher's knowledge and then revised after assessment of student understanding. While much of the focus was placed on the idea of the trajectory, Simon made clear that no two trajectories will be alike, as each one is hypothesized for a unique group of students who are uniquely constructing knowledge. In other words, you can't just prescribe a trajectory and ask teachers to follow it to the letter. Instead, Simon suggested we needed to build an understanding of the knowledge teachers were using to inform and modify their trajectories:

A possible contribution that can be made by the analysis of data and the resulting model reported in this paper is to encourage other researchers to examine teachers' "theorems in action" and to make teachers' assumptions, beliefs, and emerging theories about teaching explicit. (p. 142)

This paper by Gravemeijer is, in part, a response to Simon's call to other researchers. Gravemeijer first states that in a constructivism-inspired reform mathematics, the traditional goals of instructional design must change:

What is needed for reform mathematics education is a form of instructional design supporting instruction that helps students to develop their current ways of reasoning into more sophisticated ways of mathematical reasoning. For the instructional designer this implies a change in perspective from decomposing ready-made expert knowledge as the starting point for design to imagining students elaborating, refining, and adjusting their current ways of knowing. (p. 106)

Next, Gravemeijer recognizes that while every teacher can use their knowledge to hypothesize a learning trajectory, we (researchers, teacher educators, curriculum designers) need to have some knowledge in common if we want to help teachers:

The example Simon (1995) worked out shows that designing hypothetical learning trajectories for reform mathematics is no easy task. We can, therefore, ask ourselves what kind of support can be given to teachers. It is clear that we cannot rely on fixed, ready-made, instructional sequences, because the teacher will continuously have to adapt to the actual thinking and learning of his or her students. Thus it seems more adequate to offer the teacher some framework of reference, and a set of exemplary instructional activities that can be used as a source of inspiration. (p. 107)

This is where Gravemeijer introduces the concept of a local instruction theory, which he describes as "the description of, and rationale for, the envisioned learning route as it relates to a set of instructional activities for a specific topic" (p. 107). I admit, it's difficult at first to discern this from a hypothetical learning trajectory, but I think the key is the relationship to instructional activities (which are more fixed/solid) instead of a trajectory's relationship to student understanding (which is more flexibile/fluid). By addressing the relationship of learning to the instructional activities, Gravemeijer uses local instruction theories to describe a common foundation teachers can use for building trajectories, saying that "Externally developed local instruction theories are indispensable for reform mathematics education" and that it is "unfair to expect teachers to invent hypothetical learning trajectories without any means of support" (p. 108). (If you're still confused, I think I can safely oversimplify it like this: Simon says trajectories are about student learning, not mathematical tasks. Gravemeijer agrees, but since trajectories are unique because student learning is unique, it helps if we have some agreed-upon ideas about how mathematical tasks should be designed.) Given Gravemeijer's long association with the Freudenthal Institute, he naturally describes how design principles from Realistic Mathematics Education (RME) provide the kind of instructional design framework for creating a local instruction theory.

Design Research and RME

Some curricula and instructional strategies are developed then subjected to treatment and control groups to test their effectiveness. That's not design research and not how RME has been developed. Instead, design research consists of cyclical iterations of thought experiments, teaching experiments, and retrospective analyses. It's similar to how teachers improve their instruction as they gain experience: they plan an activity for year one, then conduct that activity, then reflect on the activity so it will be better in year two. Of course, a team of researchers who are carefully theorizing, observing, collecting data, and analyzing the results across multiple classrooms can more quickly and effectively improve tasks and instruction than a teacher can alone.

Gravemeijer describes the design research he conducted with Paul Cobb and others around the development of mental computation strategies for addition and subtraction with elementary students. There are numerous papers and at least part of one dissertation all related to this work, so I won't describe it here. I will, however, describe the three RME design principles that Gravemeijer cites as helping form the local instruction theory that guided the design research process.

Guided Reinvention

Hans Freudenthal (1973) believed mathematics is best learned when students get to experience a process of learning that's similar to the way the mathematics was invented.

If mathematics is to be applied, applying mathematics should be taught and learned. Applying is often interpreted, as mentioned above, as substituting numerical values for parameters in general theorems and theories. This is a misleading terminology. Mathematics is applied by creating it anew each time -- I will expound this in more detail too. This activity can never be exercised by learning mathematics as a ready-made product. Drilling algorithms may be indispensable, but inventing problems to drill algorithms does not create opportunities to teach applying mathematics. This so-called applied mathematics lacks the flexibility of good mathematics. (Freudenthal, 1973, p. 118)

I've heard criticisms of this approach. "How in the world can a student reinvent mathematics that took mathematicians hundreds of years to understand?" That's a valid question, and the best answer is: "Through carefully designed curriculum and instruction." The goal is not to replicate the invention of the mathematics, but learn from history how a mathematical idea might be constructed in the mind of a student. Of course, this takes an extensive and special knowledge of the history of mathematics, and largely explains why Freudenthal's Mathematics as an Educational Task is almost 700 pages long.

Didactical Phenomenology

The concept of didactical phenomenology relates the mathematical "thought thing" and the phenomenon it describes. This is not a theory I know well but hope to study more in the future.

Mathematical concepts, structures, and ideas serve to organise phenomena -- phenomena from the concrete world as well as from mathematics -- and in the past I have illustrated this by many examples. By means of geometrical figures like triangle, parallelogram, rhombus, or square, one succeeds in organising the world of contour phenomena; numbers organise the phenomenon of quantity. On a higher level the phenomenon of geometrical figure is organised by means of geometrical constructions and proofs, the phenomenon "number" is organised by means of the decimal system. So it goes in mathematics up to the highest levels: continuing abstraction brings similar looking mathematical phenomena under one concept -- group, field, topological space, deduction, induction, and so on. (Freudenthal, 1983, p. 28)

Traditionally we teach an abstract mathematics and then find examples for students to make the mathematics concrete. With didactical phenomenology, we focus on progressive mathematization, suggesting "looking for phenomena that might create opportunities for the learner to constitute the mental object that is being mathematized" (Gravemeijer, p. 116). Yes, it's hard to understand without a lot of specific examples, and that's why Freudenthal wrote almost 600 pages on this topic. It's all in a book I have yet to read, so I'll forgive myself for giving a better description here.

Emergent Modeling

I can best describe emergent modeling with an example. Imagine an elementary class learning about fractions. Instead of giving students a formal model (like a numerator and denominator), the concept of emergent modeling says we should let students reach these models informally and progressively. If a task involves the sharing of parts of cookies with the students, students might begin with breaking apart actual cookies. Once realizing this isn't convenient, students might move to drawing cookies on paper. At some point they'll realize that drawing all the details of the cookie isn't necessary and just use a circle to represent a cookie. Up until this point, these are all models-of a cookie. The key step in this process is when students start using circles to model other contextual situations, like working with fractions of time, money, space, etc. Now the circle is a model-for a part-whole relationship, and not representing a specific object like a cookie. These models-for have the power to generalize to other contexts, and eventually students no longer need the circle and rely on formal mathematics to represent and work with fractions. Gravemeijer describes a similar process in this paper, except with how bead strings, unifix cubes, and rulers can lead to marked and empty number lines as students develop ideas of cardinality, ordinality, and distance as they learn mental strategies for addition and subtraction.

Conclusion

I hope by now you have some sense for a local instruction theory. The three RME principles above -- guided reinvention, didactical phenomenology, and emergent modeling -- do not describe a detailed instructional sequence of tasks and instructions for a teacher. They are, however, a way of theorizing how a particular instructional sequence should work, grounded in the design research conducted by Gravemeijer et al. This kind of local instruction theory is what allows teachers to design hypothetical learning trajectories that focus on the construction of student understanding, and provide some common ground for helping teachers become better at trajectory hypothesizing.

References

Freudenthal, H. (1973). Mathematics as an educational task (p. 680). Dordrecht, The Netherlands: D. Reidel.

Freudenthal, H. (1983). Didactical phenomenology of mathematical structures (p. 595). Dordrecht, The Netherlands: D. Reidel.

Gravemeijer, K. (2004). Local instruction theories as means of support for teachers in reform mathematics education. Mathematical Thinking and Learning, 6(2), 105–128. doi:10.1207/s15327833mtl0602_3

Simon, M. A. (1995). Reconstructing mathematics pedagogy from a constructivist perspective. Journal for Research in Mathematics Education, 26(2), 114–145. doi:10.2307/749205

RYSK: Simon's Reconstructing Mathematics Pedagogy from a Constructivist Perspective (1995)

This is the 11th in a series describing "Research You Should Know" (RYSK) and part of my OpenComps.

After reading Clements & Sarama's (2004) Learning Trajectories in Mathematics Education a few days ago, I wanted to go back to the origins of learning trajectories: a 1995 paper from Martin Simon that explored how mathematics can and should be taught differently with a constructivist mindset. Simon is a professor of math education at NYU and has a history of researching how students and their teachers come to understand their mathematical knowledge.

From the start, I immediately appreciated two strengths of this article: Simon's clear writing and the relatively straightforward description of constructivism he offers. When you're still trying to sort out what constructivism is and is not (like me and many classroom teachers), it's a whole lot easier to parse this article from 1995 than, say, a heavily theoretical, mid-2000s piece by Jim Greeno. Recognizing that there are multiple (and often subtly different) ways to describe constructivism, Simon lays out his interpretation like this:

Constructivism derives from a philosophical position that we as human beings have no access to an objective reality, that is, a reality independent of our way of knowing it. Rather, we construct our knowledge of our world from our perceptions and experiences, which are themselves mediated through our previous knowlege. Learning is the process by which human beings adapt to their experiential world. (p. 115)

So when we have an idea that "works," meaning it does what we need it to do to make sense of our experiences, then we've constructed knowledge. This can be a tough sell to the mathematically-minded who say things like, "I didn't construct two plus two equals four. That's an objective fact." In response, the constructivist would disagree about having access to objective reality, but acknowledge that we (almost?) universally construct the knowledge that 2+2=4 because we experience no evidence suggesting otherwise (what Simon and others refer to as disequilibrium).

There's also a theoretical debate about the construction of knowledge as an individual, cognitive process versus a social process. This is an interesting debate, to be sure, and it has been pushing the leading edges of theories for learning mathematics for about the past twenty years. If you're wearing a theoretician hat, then you care deeply about how this debate might be won. But if you're wearing a researcher hat (like Simon is here), then you use both theories to help you gain whatever insights they might afford you. Simon (crediting work by Cobb, Yackel, and Wood) calls this coordination of psychological and sociological approaches "social constructivism," and compares it to how a physicist can better explain the nature of light by considering it both a particle and a wave.

Simon takes pains in this article to separate the theory of constructivism from a notion of "constructivist teaching." It's a mistake that I've seen and heard many times, and it's important to understand the differences and nuances. Simon states:

As I stated above, constructivism, as an epistemological theory, does not define a particular way of teaching. It describes knowledge development whether or not there is a teacher present or teaching is going on. ... There is no simple function that maps teaching methodology onto constructivist principles. A constructivist epistemology does not determine the appropriateness or inappropriateness of teaching strategies. ... The commonly used misnomer, "constructivist teaching," [suggests that] constructivism offers one set notion of how to teach. The question of whether teaching is "constructivist" is not a useful one and diverts attention from the more important question of how effective it is. From a theoretical perspective, the question that needs attention is, In what ways can constructivism contribute to the development of useful theoretical frameworks for mathematics pedagogy? (p. 117)

Using this perspective and a lot of theoretical support from work done in the early 1990s, Simon sets out to explore "the ongoing and inherent challenge to integrate the teacher's goals and direction for learning with the trajectory of students' mathematical thinking and learning" (p. 121, emphasis in original). Unlike a traditional perspective, where the pedagogical focus tended towards chopping mathematical content into manageable pieces to be demonstrated and practiced, Simon wished to focus on student understanding and a plan for mathematical tasks that improved that understanding.

I won't describe Simon's teaching experiment in great detail (after all, it was data-rich enough for Simon to publish multiple papers), but it involved a group of preservice elementary teachers and a set of tasks designed to elicit understandings about how multiplication related to the simple area formula A = l x w. Simon knew that his students had no trouble multiplying or using the formula. That wasn't the problem. Instead, he gave them this task:

Determine how many rectangles, of the size and shape of the rectangle that you were given, could fit on the top surface of your table. Rectangles cannot be overlapped, cannot be cut, nor can they overlap the edges of the table. Be prepared to describe to the class how you solved this problem. (p. 123)

Students used their rectangle (I'm imagining an index card) to measure the length and width of their table. A few groups questioned whether the rectangle should maintain its orientation, or if the long edge should always align with the edge of the table. This launched a class discussion and Simon pushed students to explain how they found the area without defaulting to "I used the formula." Some students talked about rows and columns, some talked about counting rectangles, but comments about "overlapping" rectangles suggested misunderstanding was still apparent. Compounding the problem was that these students were not accustomed to provide this level of justification.

Simon tried varying the task to elicit better student explanations. Some students seemed to get it while others still struggled or remained silent. (The transcript excerpts in Simon's paper are very valuable here, if you can get a copy of it.) Simon began to worry that students were actually misunderstanding things about area, not just how multiplication relates to rectangle area, so he assigned a second task about finding the area of an irregular shape. This was less of a problem for students, so Simon returned to the "turned rectangle" problem and tried another activity with measuring tables, both with rectangular cards and also with sticks. Some students were stuck in their thinking that the area unit must be the size and shape of the card, while others began to see how using the long edge of the card for length and width of the table created new, square units not shaped like the card.

All these classes were observed by researchers who took notes and videotaped the classroom activity. Simon also kept a journal of his reflections after each lesson and planning session. Following the teaching experiment, Simon analyzed his role as the decision maker in the classroom activities. First, he had hypothesized that his students would otherwise be satisfied with knowing and using a formula for area, but had probably never explored why the formula worked. This hypothesis was based on prior experience with similar students, prior research, and pretesting. Simon carefully thought out what he thought would happen in his initial activity, saying this thinking

provides an example of the reflexive relationship between the teacher's design of activities and consideration of the thinking that students might engage in as they participate in those activities. The consideration of the learning goal, the learning activities, and the thinking and learning in which students might engage make up the hypothetical learning trajectory, a key part of the Mathematical Learning Cycle described in the next section. (p. 133)

The "Mathematical Learning Cycle" Simon, in a simplified way, suggests how a teacher's knowledge can be used to create a hypothetical learning trajectory (containing a learning goal, a plan for learning activities, and a hypothesis about the learning process), and how assessment of student knowledge gives the teacher new and better knowledge upon which to refine the hypothetical learning trajectory. (I can't help but wonder if Simon once thought he'd be remembered for "learning cycles," not "learning trajectories.") The trajectory as planned is always hypothetical because it is just the teacher's prediction and the true trajectory cannot be known in advance. Modification of the trajectory happens as the teacher increases his/her knowledge about what students understand, which can be during a planning session between lessons or on-the-fly during a classroom activity. Of course, the more knowledge a teacher has in advance -- about their students, about the mathematical content, and about theories of learning that content -- the better the hypothetical learning trajectory can be. Sometimes we don't have all the information we want, says Simon:

As a teacher, I often do not have a well-developed map of the mathematical conceptual area in which I am engaging my students; that is, I may not have fully articulated for myself (or found in the literature) the specific connections that constitute understanding or the nature of development of understanding in that area. ... Thus, in such cases, my operational definition of understanding is the ability to overcome these particular difficulties; I may not have unpacked the difficulties in order to understand the conceptual issues that are implicated. Thus, even if I do not have a thorough knowledge of what constitutes mathematical understanding in a particular domain, having a rich set of problem situations that challenge students and having knowledge of conceptual difficulties that they typically encounter provide me with an approximation that lets me be reasonably effective in promoting learning in the absence of more elaborated knowledge. (This is not to suggest that the more elaborated understanding would not be more powerful.) (p. 139)

In his summary, Simon reiterates some major themes:
  1. Student understanding is prioritized in the design of instruction
  2. Teachers learn as students learn
  3. Planning instruction includes the creation of a hypothetical learning trajectory
  4. Because of #2, teachers need to constantly revise #3
Lastly, Simon emphasizes the challenge of teaching using the methods and example he's described. "Teachers will need access to relevant research on children's mathematical thinking, innovative curriculum materials, and ongoing professional support in order to meet the demands of this role" (pp. 142-143). I plan on summarizing more work on learning trajectories, so hopefully I can provide a little bit of that needed support.

References

Simon, M. A. (1995). Reconstructing mathematics pedagogy from a constructivist perspective. Journal for Research in Mathematics Education, 26(2), 114–145. doi:10.2307/749205

Scholarly Reading Strategies

While I welcome greater diversity in higher education, I recognize graduate studies aren't for everybody. More specifically, I'd suggest you think twice about a PhD if you're the kind of person who doesn't like to read. The written word is the stuff on which academia survives and thrives, and as such many more scholarly words are produced than any one person could possibly read. But yet our work depends on reading huge chunks of scholarly literature.

I was only a few weeks into my first semester as a PhD student when I realized that there were going to be times when I couldn't finish all of the assigned readings for class. Thankfully, the ever-kind Elizabeth Dutro addressed this problem in class and told us all that this was okay. Yes, sometimes there were things we'd need to understand in great detail, but other times it was enough to just gain familiarity with an article in case we needed to refer to it later. Some readings (for me, Foucault comes to mind) need multiple readings before they make any coherent sense.

I discussed this with my advisor at the time, Finbarr (Barry) Sloane. Knowing that he was a voracious reader with incredible retention and memory (Vicki Hand once told me she wished her internet connected directly to Barry's brain), I asked if he had any special reading strategies. This is essentially what he told me:

I read things three times. The first time I just read and get a sense for the article. The second time I read for details, take notes, and make connections. On the third reading, I read the article out-of-order. If I can read paragraphs or sections at random and understand them without having to re-read the surrounding context, then I know I understand it.

Now I was understanding why Barry's knowledge of the literature was so strong. Unfortunately, I was also understanding why he routinely only got a few hours of sleep every night -- all that reading and re-reading takes time. He wasn't shy about his love of reading; he said that while in graduate school in the mid-1980s, he read every single article in the Journal for Research in Mathematics Education since its first publication in 1970. That's intense.

Maybe I can't read every JRME article three times between now and my comprehensive exams, but I do need to make the most of my comps readings. So long as the quantity of reading doesn't overwhelm me, my three-part strategy will be (a) read, (b) read for detail and take notes, and (c) blog a summary. That's the approach I took with my last post and I felt very good about it. (It helped that the Clements & Sarama article was less than 10 pages long.) The written part of my comprehensive exam gives me a week to answer three questions with essays/reports of about 8-10 pages each. I figure the more I've written on my blog, the more prepared I'll be to write for comps. There's also the side benefit of giving my advisor a convenient way to keep up with my preparation while he's traveling during his sabbatical this semester. I'd love to blog about at least four or five readings a week, and you'll be the first to know if I can keep up that pace.

RYSK: Clements & Sarama's Learning Trajectories in Mathematics Education (2004)

This is the tenth in a series describing "Research You Should Know" (RYSK) and part of my OpenComps.

When I shared my comps reading list with my committee, Bill Penuel quickly replied with the suggestion that I read this article about learning trajectories by Doug Clements and Julie Sarama. I'd seen Clements present on this topic at last year's RME conference (which focused on learning trajectories/progressions), and I recognized the paper as something I found last spring too late in the writing of a final paper to really read and process, so I am happy to return to it now.

At their most basic, learning trajectories can be thought of as sequences of tasks and activities aimed at the progressive development of mathematical thinking and skill. This appeals to me because, quite frankly, I'm not all that great at focusing on single mathematical tasks. Even with a great task, I find myself wondering, "Where in the curriculum does this task fit? What should students know and be able to do before attempting it? Once students complete this task, what new thing are they ready for?" You could say I get a bit distracted in an effort to see the big picture, a habit of mine that's not necessarily new. Learning trajectories are one way of thinking about curriculum on a larger scale, and the better I understand them, the more organized my thinking can be.

Clements finds the roots of learning trajectories in a 1995 paper by Martin Simon titled Reconstructing Mathematics Pedagogy from a Constructivist Perspective (which I should also add to my comps reading list, I'm sure). While it's certainly possible to create a learning trajectory thinking only about instructional tasks, Clements & Sarama stress the interconnections between the instructional sequence and the psychological developmental progression of students. As teachers, sometimes we make the mistake of breaking down an instructional sequence according to the structure of the mathematics, which may or may not reflect the ways students will actually construct their mathematical knowledge. To avoid this mistake, Clements & Sarama suggest designing learning trajectories using this three-stage process:

  1. Specify a research-based learning model that describes how students construct the mathematical knowledge needed for the trajectory. I think this is a tough task for teachers, both because the specific models in the research are not widely known and understood and because there are surely many areas of mathematics for which specific learning models have not been thoroughly studied.
  2. Select key mathematical tasks to promote learning at each level of students' psychological development. Again, it takes the help of research to judge if a task truly targets a certain level of development or not.
  3. Complete the hypothetical learning trajectory by sequence the tasks to match the students' developmental progression.

Of course, the completed learning trajectory should (a) take advantage of specific and relevant cultural knowledge and practices of your students and (b) be subjected to repeated revision and refinement. Clements & Sarama do not understate the potential of well-constructed learning trajectories:

The enactment of an effective, complete learning trajectory can actually alter developmental progressions or expectations previously established by psychological studies because it opens up new paths for learning and development. This, of course, reflects the traditional debate between Vygotsky (1934/1986) and Piaget and Szeminska (1952) regarding the priority of development over learning. We believe that learning trajectory research, along with other research corpi, suggests the Vygotskian position that, at least in some domains and some ways, learning and teaching tasks can change the course of development. (p. 84)

Finally, Clements & Sarama make two more recommendations regarding the creation of learning trajectories. First, be sure to think carefully about how a trajectory might work for an individual student (following a more cognitive theoretical approach) and also how it might work for a class, complete with student interactions and classroom discourse (a more sociocultural theoretical approach). Second, recognize that these trajectories are always hypothetical and will work best when teachers take the time to create and re-create them to work best with their students.

References

Clements, D. H., & Sarama, J. (2004). Learning trajectories in mathematics education. Mathematical Thinking and Learning, 6(2), 81–89. doi:10.1207/s15327833mtl0602_1

Piaget, J. & Szeminska, A. (1952). The child's conception of number. London, UK: Routledge and Kegan Paul.

Simon, M. A. (1995). Reconstructing mathematics pedagogy from a constructivist perspective. Journal for Research in Mathematics Education, 26(2), 114–145. doi:10.2307/749205

Vygotsky, L. S. (1934/1986). Thought and language. Cambridge, MA: MIT Press.