Showing posts with label research. Show all posts
Showing posts with label research. Show all posts

Announcing announce@list.mathed.net

"Maybe someday you could continue Jerry Becker's email listserv." --David Webb, circa 2015

Dr. Jerry Becker died on April 16 at the age of 85, leaving behind his wife, three children, many grandchildren and great-grandchildren, and a very useful set of email listservs. By way of my Ph.D., Dr. Becker is an academic great-uncle of mine, although I never had the pleasure of meeting him. I can't pretend to fill his shoes, but there is something I can do to continue in his tradition by providing a service similar to what he offered for so many years.

Today I'm announcing announce@list.mathed.net. (Self-subscribe here.) It's an email distribution list to share the kinds of things people used to share through Dr. Becker: job openings, conference announcements, requests for articles for journal issues, and other items of interest to the mathematics education community. Instead of sending items to me, subscribers to the list can email the list address directly and I'll moderate items along that appear legitimate and useful. I'll tweak things along the way and, if there's demand for additional lists or services, I can consider offering them. The service is provided by an international GNU Mailman host. The software isn't flashy, but it works and isn't going anywhere. I may not live to 85 to keep hosting the list like Dr. Becker did, but I'll stick around as long as I can and I won't be surprised if Mailman sticks around that long, too.

So who am I and why am I doing this? I'm the mathematics specialist at the Colorado Department of Education, and prior to that I was a high school math teacher and a Ph.D. student at CU Boulder. Regardless if I was working in practice, research, or policy, I've been interested in the organization of education communities and how they communicate ideas. This includes professional organizations, Twitter, the Global Math Department, and forums like MyNCTM. Under the mathed.net domain, I've blogged and maintained a wiki, and at one time spun up an experimental instance of a social network using free software. In my current role with CDE I operate the CoMath listserv, which has been in existence since 1995, and I help edit the Colorado Mathematics Teacher journal. My advisor, David Webb, made the comment above somewhat offhandedly partway through my graduate school experience and it's stuck in my head ever since. Dr. Becker didn't leave his listservs to a successor, and the subscription lists they contained are (as they should be) the private information of his university. But that doesn't mean we can't try starting anew to continue the old.

I've long believed that if mathematics teachers and educators are going to all be part of a professional community, it's going to take many different related sub-communities in many different forms, using different technologies, membership structures, languages, and different target audiences. We're too numerous to all huddle under one hashtag, and too smart to think that our ideas could—or should—fit in one place. Maybe others will start email list services of their own to meet a particular need, or find other ways to communicate. That would be excellent. The more the merrier. We all have a part in this, and my next part is to moderate a new email list. So if you have something to share, or need to have things shared with you, I'll be at announce@list.mathed.net waiting for you to subscribe and post your messages.

RYSK: Gutiérrez's Political Conocimiento for Teaching Mathematics: Why Teachers Need It and How to Develop It (2018)

Rochelle Gutiérrez keynoting the 2016 CCTM Conference
I haven't used the "RYSK" tag for a blog post in almost four years, but only because I've taken to summarizing research over on the MathEd.net Wiki. That wiki turns five years old this month while this blog turns eight! I think my best strategy is to summarize on the wiki and editorialize here on the blog, and the events of this week demanded that I break my blogging silence and deal with an issue of the moment.

Last Monday I was riding the bus home when Google stuck an article from an anti-liberal education site called Campus Reform into my news feed. It was about a math education professor and white privilege, so I checked it out (in incognito mode — I try not to give Google the wrong ideas about the sites I want more news from). The article was about Rochelle Gutiérrez and honestly, it didn't say all that much except to highlight connections Rochelle was making between math and white privilege. The comments below the article were...what you'd probably expect. I closed the story and didn't think much about it, other than, "I wonder if this story will go anywhere?"

Go somewhere, it did. On Wednesday Google showed me that Fox News had picked up the story. Predictably in this era of internet news, it wasn't original reporting on the content of Rochelle's work. It was just a rehash of the Campus Reform article and it was getting a lot of comments. Judging by what I was seeing, the Fox News patrons didn't seem to have read Rochelle's work either. I searched Twitter for use of Rochelle's handle and saw she was getting a lot of negative comments with some blatant harassment thrown in (I reported one person whose account was subsequently found in violation of Twitter's rules). Those people didn't appear to have read Rochelle's chapter, either. (A notable exception: Jason Miller's post and conversation on Google+, which took the rational approach of asking "Does anyone know more about this?" and got replies like, "Here's more info, but not enough to draw conclusions." Score +1 for Google+.)

If I've learned anything in 2017, it's that I need to be upset/outraged on my own schedule and on my own terms. That usually means doing more listening and learning and not jumping into a soon-forgotten online fray. So I ordered the book Building Support for Scholarly Practices in Mathematics Methods, in which Rochelle's chapter appears, and waited a few days for it to arrive so I could actually read it before commenting.

I've now read and summarized the chapter on the MathEd.net Wiki. Did Rochelle link the privilege of mathematics to the privilege of being White? Did she say we perpetuate that privilege when we focus on Greek mathematical history and not that of other peoples? Did she say we should see mathematical knowledge is relational, and not objective? Yes, she did say all those things, and in that way the original Campus Reform article was mostly accurate. Where it wasn't accurate — and led many other sites and their audiences astray — was representing Rochelle's chapter as mostly about those things. Rochelle made most of those statements in a page or two, then spent the rest of her 27 pages laying out a framework of teacher knowledge meant to help prospective teachers deal with the political realities that affect their work.

What strikes me after reading the chapter is that Rochelle names many political influences on teaching and education that are also common targets of the right: Common Core, Pearson, big philanthropic foundations, bureaucratic inefficiency and misdirection, and control of schools that doesn't reflect local needs. There is plenty of common ground to be explored in the chapter if people choose to look for it and discuss it. The news sites could have done that, but they didn't. It wouldn't be sensational enough to generate traffic and ad revenue, and their typical narrative doesn't leave room for discussing the development of political knowledge meant to benefit traditionally underserved students.

Now that things have (probably) quieted down, we can look at Rochelle's chapter for the reasons she wrote it: to inform math teacher educators who want to help prospective teachers deal with the political pressures and distractions that can interfere with giving students the help they need. If you are a math teacher educator, this looks like a book you should have. I've put the table of contents on the wiki along with the summary of Rochelle's chapter.

Notes on the 2016 NCTM Research Conference

Following my participation in 25 sessions at the ASSM Annual Meeting, the second leg of my big San Francisco conference trip was the NCTM Research Conference. As usual, the Research Conference overlapped with the NCSM Conference. There are a lot of good reasons to go to NCSM, but I figured that I'd take advantage of still having one foot firmly planted in the research world and get as much out of the RC as I could. (See here for more pictures.)

Monday, April 11

Cynthia Langrall
  1. "JRME: A Tale of Unicorns, Mastodons, and Ants" (Cynthia Langrall): In past years NCTM has had an opening plenary speaker from outside math education, but this year we were entertained by a — dare I say — fun talk by Cynthia Langrall about her perspectives on the Journal for Research in Mathematics Education (JRME). I saved my weird question for her until after she left the stage: "Why are NCTM article URLs so long, and why aren't there DOIs for the articles?" (Typical me, paying attention to details but probably not the details others are paying attention to.) Answer: NCTM isn't exactly Springer or Elsevier when it comes to journal publishing and it takes longer for them to figure these things out. Anyway, I made a personal recording of this talk and plan on listening to it again.

Tuesday, April 12

  1. "Activity and Impact of Elementary Mathematics Specialists in Rural Schools" (Patricia Campbell and Matt Griffin): This research involved hierarchical linear modeling and a bunch of statistical results that I didn't fully understand, but I did understand these findings: there was a tendency for math specialists to take on more non-specialist duties from Year 1 to Year 2 of the study, and no good reason to think more bus duty increases student math achievement.
  2. "Designing Professional Development to Support Teachers in Learning Trajectory-Based Instruction" (Jennifer Kobrin and Nicole Panorkou): In this session, Nicole described PD that included teacher task ranking activities, strategy identification activities, and video analysis, all designed to help teachers elicit and interpret student thinking in a geometry unit based on a learning progression on area. I'm not sure the learning trajectory focus came out in the session, as it felt like it could have just as easily been framed as a mathematics knowledge for teaching (MKT) session instead.
  3. "Research on Math Teacher Education in an Online Multimedia Environment" (Wendy Rose Aaron, Emina Alibegovic, Joel Amidon, Sandra Crespo, Amanda Milewski, Kristi Hanby, Crystal Kalinec-Craig, and Alyson Lischka): It's a LessonSketch party! In various ways, all the presenters used LessonSketch to help conduct some kind of online teacher education or professional development.

    Wendy Rose Aaron
  4. "Examining the Impact of Multiple Representations on Students' Achievement" (Raymond Flores, Fethi Inan, and Sunyoung Han): I'm always intrigued by negative results, so when this session description said their study showed an algorithm-focused approach outperformed an approach with multiple representations, I was interested. While that was indeed the finding, the study methodology was relatively weak: it was only a two-week study using a cross-over design (half the students got algorithms for a week, while the other have explored representations, and then they switched for another week).
  5. "Cracking Her Codes: Investigating Technology Boundary Objects Using Interaction Analysis" (Gretchen Matthews, Nicole Bannister, and Amber Simpson): I'm a fan of both cryptography and the theory of boundary objects, so this session drew me in. The presenters were clear that they were still in the thick of analyzing data and applying theory to it, and there was some good discussion about how boundary objects may and may not work well, and what some theoretical alternatives might be.
  6. "A Unified Framework of Teachers' Conceptions of Learning and Assessment" (Raymond Johnson, Frederick Peck, Derek Briggs, Jessica Alzen) Fred and I presented some findings of our work with CADRE, in which we noticed teachers having conceptions of learning and assessment that varied between what we called a "count up points" conception and a "developmental progression" conception. Fred did a great job with the first draft of our paper and we got some good feedback at the session, so I think this is something I'll be able to talk more about in the future.
  7. "Understanding Changes in Novice Teachers' Social Networks" (Anne Garrison Wilhelm and Dawn Woods) I met with some Reasearch + Practice Collaboratory during the poster session (they awarded me a travel fellowship to attend the conference) so I missed out on most of the posters, but did sneak in some time with Anne to talk about how new teachers often leave old advice networks behind in favor of smaller networks they build in their schools.

Wednesday, April 13

  1. "Examining the Impact of Elementary Mathematics Specialists and Coaches" (Patricia Campbell, James Tarr, Corey Webel, Kim Markworth, and Lynsey Gibbons): This symposium brought together a number of people who study specialists and coaches, and some of what I got out of it was simply a better understanding of different coaching models, such as team teaching and co-teaching. One surprising result: When time was tracked, sending elementary students to a different teacher for math actually took less transition time than having math with the same teacher in a self-contained classroom. However, self-contained teachers have more flexibility with their time and can extend math lessons in ways that can't be done as easily with specialists.

    Lynsey Gibbons
  2. "How Research into Second-Language Learning Might Be Useful to Mathematics Educators" (Brent Davis): This was the big plenary talk of the conference, where I became introduced to the great work of Brent Davis. I recorded it for Sam Otten's Math Ed Podcast so you can listen to the talk yourself if you'd like.

    Brent Davis
  3. "Measuring and Supporting the Improvement of Mathematics Teaching at Scale" (Mary Kay Stein, Richard Correnti, and Katelyn Kelly): In this session, "scale" means "state-wide," as the work involved getting some understanding of math teaching across the state of Tennessee for grades 4 through 8. They're using what they call "quadrant theory," where one dimension of the quadrant is divided into high and low opportunities for students to struggle meaningfully with mathematics, and the second dimension is divided into high and low attention to mathematical concepts. It's a bit of a gamble to boil down the quality of teaching into something so coarse, but it really helps to do this work at scale. It also leads to interesting thinking about teachers in each of the four quadrants, such as those who give a lot of attention to concepts but don't let students struggle with them.
    Stein and Correnti's "Quadrant Theory"
  4. "Measuring Teachers' Beliefs in Relation to Standards for Mathematical Practice" (Iris Riggs, Davida Fischman, Matt Riggs, Madeleine Jetter, and Joseph Jesunathadas): Development and validation of research instruments is really important, but do you know what I liked best about this session? The presenters were clearly enjoying themselves and I had fun watching them. That counts for something, right?
Positive: I didn't attend anything specific to teaching statistics, but there was quite a bit to choose from if I'd chosen to. It's really good to see the research community increase its stats education efforts because we have a lot to learn about stats ed if we're going to shift high school and college pathways to engage more students in statistics.

Negative: With NCSM in Oakland and the RC in San Francisco, the conference felt quite small this year. It just wasn't possible for people to quickly slip back and forth between the two venues.

Neutral?: Remember all that talk of "Grand Challenges" at last year's conference? I heard not one peep about it this year. Maybe that's a lost opportunity, but from the sessions I attended last year I didn't come away feeling very positive that a grand challenge was going to mobilize the organization. Math ed has plenty of challenges, whether we label them grand or not, and when the right one comes along we can be ready for it.

Following the Research in Mathematics Education

As a beginning Ph.D. student, most of the readings you do are to provide some breadth and to grow some roots in your field, and most of them are assigned as coursework. Once you get past your comprehensive exam, there tends to be less coursework and the reading you do typically is closely related to your dissertation topic. If I were facing a future as a tenure-track faculty member, I guess 80% of my reading would be done specifically to help me conduct further research or write the next paper, while the other 20% might simply be to keep up with other goings-on in the realm of educational research.

I now know my next job is not that of a tenure-track researcher. Instead, I'm working for the department of education and my primary role is to provide support to math teachers across the state. I need to keep up-to-date on math education research not so much for myself, but for the teachers I'll be working with, and they will certainly have a more diverse set of concerns than the narrow focus of my dissertation. So how do I go about following the breadth of research in mathematics education?

I decided to start with a long list of journals where mathematics educators typically publish. Thankfully, Sam Otten maintains such a list. I think the world of education research journals as it relates to mathematics education looks a bit like this:

Three categories of education journals as they relate to mathematics education

There's basically the big world of all education research, and within that the subset of journals where math educators are likely to publish, and then a smaller subset of journals that publish only work about mathematics education. There's no good way to monitor everything in the big set, as altogether I'm sure that represents hundreds of journals and 10,000+ articles annually. Tracking a set of journals that resembles the middle set might be possible, but it gets pretty noisy: for each article relevant to mathematics education published in Educational Researcher, for example, you'd probably have to wade through 10-20 irrelevant articles. The inner set should be trackable, as now we're probably down to a few dozen journals and a relatively high signal-to-noise ratio.

Thinking about where impactful mathematics education research gets published makes things more complicated. For example, a top researcher in mathematics education is more likely to publish a major article in a high-profile yet non-math education journal like AERA's American Educational Research Journal instead of a lower-profile math ed-specific journal like the Journal of Mathematics Education at Teachers College. (Don't get me wrong - the Journal of Mathematics Education at Teachers College is a fine journal that publishes work from prominent names in math education — but work there doesn't have the exposure and impact as work does in AERJ.)

Sam has about 100 journals on his list, and Pat Thompson's list has even more. The journals on Pat's list that aren't on Sam's list include a lot of non-English journals and ones that probably belong in the outer circle of my diagram. Sam's list focuses more on English-language journals from the inner two subsets. Still, 100 journals is too many for me to track consistently, so I combed through and found 20 that I know I've read from on multiple occasions as a graduate student. I then put those 20 journals in a poll that let other researchers sort and rank, and here's what resulted:

Ranking journals relevant to mathematics education

The poll instructions said, "If you were tasked with keeping up with K-12 research in mathematics education, and had to choose a limited number of journals to follow or subscribe to, which journals would you follow? Use the choices below to rank the importance of each journal." Only five people (I'm one of the five) responded, but you can see that we're in general agreement about which journals are most relevant for keeping up with mathematics education research. Some differences in rankings can be explained: I, for example, was the one who ranked Educational Researcher at #2, because math education articles published in ER typically represent a synthesis of a major body of work and are written to appeal to the broad audience of education researchers. I often feel a bit embarrassed when someone catches me having not read something math ed-related in ER, so I assigned it a higher rank. Opinions about ZDM are all over, ranking as high as 4th on one list and as low as 20th on another. That one is more difficult to explain, but maybe it's higher-volume, international, invitation-only, and themed-issue approach appeals to different researchers in different ways.

When I created the poll, I thought I'd be using the results to narrow my focus down to the top 10-12, but so far for TWiME I've kept up with all 20. I'm also following some open access math education journals, both because I value open access and because I know everyone who reads my blog can also read those articles. I'm not making any effort to check journals in the outer set, but occasionally something relevant published in something like Educational Evaluation and Policy Analysis crosses my path and I give it a look. I've tried using RSS and email subscriptions to follow everything, but I'm finding that keeping all the journals in my browser bookmarks and going through them one-by-one is the easiest approach. Below is the list of everything I'm checking weekly:

Open access journals:
If you're asking, "Raymond, are you concerned about your level of access to the paywalled journals above after you're no longer affiliated with the university?" my answer is, "Yes. Yes I am. But I think I'll manage."

Education, Neuroscience, and Tangled Webs We Weave

I'm far from the first to point this out, but some of us in the education game hold some ill-informed beliefs about the brain and what it should mean to us as teachers. These are known as "neuromyths" and there's even an organization, the International Mind, Brain and Education Society, working to improve how educators use knowledge from neuroscience. A study by Dekker, Lee, Howard-Jones, and Jones (2012) in the Netherlands found that when given 32 statements about the brain, 15 of which were myths, on average teachers believed in about 50% of the myths. I doubt teachers in the United States would fare any better, given what I see about left brain vs. right brain, "learning styles," and "only use 10%" nonsense.

Even though there is more communication than ever on peer-reviewed brain research, a lot of that communication distorts the science and ends up spreading or creating new neuromyths (Howard-Jones, 2014). What does that distortion look like? I present to you two examples, where something I saw on social media referring to the brain ended up linking back to research with claims that looked quite different.

Example One: "Your Brain Grew"

Yesterday +Joshua Fisher  pointed out this tweet:
Being sensitive to neuromyths, I admit I poked a little fun at this tweet-length, out-of-context claim. Rightly, +Paul Hartzer called me out and suggested I search for some context, such as this:

http://tvoparents.tvo.org/HH/making-mistakes

I immediately went for the "growing evidence" link, which took me to this:

https://www.psychologytoday.com/blog/the-science-willpower/201112/how-mistakes-can-make-you-smarter

As this was a review of two studies, I dove down to the reference section and tracked down the research. The first, by Moser et al. (2011), had this abstract:

Abstract:
How well people bounce back from mistakes depends on their beliefs about learning and intelligence. For individuals with a growth mind-set, who believe intelligence develops through effort, mistakes are seen as opportunities to learn and improve. For individuals with a fixed mind-set, who believe intelligence is a stable characteristic, mistakes indicate lack of ability. We examined performance-monitoring event-related potentials (ERPs) to probe the neural mechanisms underlying these different reactions to mistakes. Findings revealed that a growth mind-set was associated with enhancement of the error positivity component (Pe), which reflects awareness of and allocation of attention to mistakes. More growth-minded individuals also showed superior accuracy after mistakes compared with individuals endorsing a more fixed mind-set. It is critical to note that Pe amplitude mediated the relationship between mind-set and posterror accuracy. These results suggest that neural mechanisms indexing on-line awareness of and attention to mistakes are intimately involved in growth-minded individuals' ability to rebound from mistakes.
This sounds familiar to those who know things about growth vs. fixed mindsets, and shows that growth mindsets are associated with some brain activity that we don't see with fixed mindsets. So maybe brain "growth" doesn't happen to everyone. The second article, by Downar, Bhatt, and Montague (2011), is even more neuroscience-y:

Abstract:
Accurate associative learning is often hindered by confirmation bias and success-chasing, which together can conspire to produce or solidify false beliefs in the decision-maker. We performed functional magnetic resonance imaging in 35 experienced physicians, while they learned to choose between two treatments in a series of virtual patient encounters. We estimated a learning model for each subject based on their observed behavior and this model divided clearly into high performers and low performers. The high performers showed small, but equal learning rates for both successes (positive outcomes) and failures (no response to the drug). In contrast, low performers showed very large and asymmetric learning rates, learning significantly more from successes than failures; a tendency that led to sub-optimal treatment choices. Consistently with these behavioral findings, high performers showed larger, more sustained BOLD responses to failed vs. successful outcomes in the dorsolateral prefrontal cortex and inferior parietal lobule while low performers displayed the opposite response profile. Furthermore, participants' learning asymmetry correlated with anticipatory activation in the nucleus accumbens at trial onset, well before outcome presentation. Subjects with anticipatory activation in the nucleus accumbens showed more success-chasing during learning. These results suggest that high performers' brains achieve better outcomes by attending to informative failures during training, rather than chasing the reward value of successes. The differential brain activations between high and low performers could potentially be developed into biomarkers to identify efficient learners on novel decision tasks, in medical or other contexts.
Now we're talking about some brain activity, but the results aren't so simple. Take-away? A group of doctors who performed well on a task had brains that appeared to respond better to failure, while low-performing doctors didn't. Also, don't overlook the last bit: This study is less about finding better teaching than it is about identifying biomarkers that indicate who might be more easily taught. That's an important difference — teachers don't get to scan kids in fMRI machines and only teach the best of the lot.

Example Two: Common Core is Bad for Your Brain

Last year Lane Walker pointed me to this claim in a post on LinkedIn:

https://www.linkedin.com/groups/Did-anyone-get-any-interesting-4204066.S.5912659047466680321

Curious (and very skeptical), I followed the link to find this:

https://peter5427.wordpress.com/2014/08/28/stanford-study-common-core-is-bad-for-the-brain/

That post was referencing this article on Fox News:

http://www.foxnews.com/health/2014/08/18/kids-brains-reorganize-when-learning-math-skills/

A search for the actual research took me to an article by Qin et al. (2014) with this abstract:

Abstract:
The importance of the hippocampal system for rapid learning and memory is well recognized, but its contributions to a cardinal feature of children's cognitive development—the transition from procedure-based to memory-based problem-solving strategies—are unknown. Here we show that the hippocampal system is pivotal to this strategic transition. Longitudinal functional magnetic resonance imaging (fMRI) in 7–9-year-old children revealed that the transition from use of counting to memory-based retrieval parallels increased hippocampal and decreased prefrontal-parietal engagement during arithmetic problem solving. Longitudinal improvements in retrieval-strategy use were predicted by increased hippocampal-neocortical functional connectivity. Beyond childhood, retrieval-strategy use continued to improve through adolescence into adulthood and was associated with decreased activation but more stable interproblem representations in the hippocampus. Our findings provide insights into the dynamic role of the hippocampus in the maturation of memory-based problem solving and establish a critical link between hippocampal-neocortical reorganization and children's cognitive development.
As I suspected, the neuroscience really had nothing to do with Common Core or how to teach math. It just found out which part of the brain became more active as children increase their ability to do things from memory. That should sound exciting if you're a neuroscientist, but pretty useless if you're a teacher.

Why We Have Theories of Learning

Like a predictable telephone game, you can see how research gets distorted as it morphs its way through news articles, blog posts, and social media posts. You could criticize me for not quite backtracking all the way to the source, as I'm only referring to abstracts and not digging deeply into the research described and cited in the articles themselves. To take that last step, frankly, requires more of a neuroscience background than I possess. I don't expect that of myself, and wouldn't expect a teacher to do that, either. Daniel Willingham wrote about this a few years ago, and acknowledged the role of institutions like schools of education to collectively make sense of such research and make it useful for teachers. There are people like Jo Boaler who are doing this work. I admire her for taking on the challenge of making complex ideas understandable and appealing to a wide audience of educators, and I'm sure every day she thinks hard about what messages she has to craft and how she has to craft them. It's tricky work.

My hope for teachers is this: When you hear claims about the brain and what they mean for your teaching, be skeptical. Avoid the possibility that you'll be fooled by the next big neuromyth. Realize that a lot of neuroscience relies on placing individuals in an fMRI machine and observing their brain activity while they perform a task. Is that cool science? You bet it is. Does this kind of research capture the context and complexity of your classroom? It does not.

Instead, understand and appreciate why education and related fields have theories of learning that don't rely on knowing what the brain does. In general, theories of construcivism don't go into detail about what's happening at the synapse level, nor do they need to. Cognitive theories use schema to theorize what's going on in the head, but no fMRI machines are necessary. Situated and sociocultural theories of learning gain their usefulness not by trying to look inside the learner's head, but rather outward to that learner's environment, the tools they use, the communities they participate in, and how culture and history shape their activity. So teachers, focus on that — focus on the culture of your classroom, how your students participate, and the learning community you support. Focus on how a carefully constructed curriculum, well-enacted, supports a trajectory of student learning. It will get you much further than neuromyths.

References

Dekker, S., Lee, N. C., Howard-Jones, P., & Jolles, J. (2012). Neuromyths in education: Prevalence and predictors of misconceptions among teachers. Frontiers in Psychology, (Oct), 1–8. doi:10.3389/fpsyg.2012.00429 Retrieved from http://journal.frontiersin.org/article/10.3389/fpsyg.2012.00429/full

Downar, J., Bhatt, M., & Montague, P. (2011). Neural correlates of effective learning in experienced medical decision-makers. PLoS ONE. doi:10.1371/journal.pone.0027768 Retrieved from http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0027768

Howard-Jones, P. A. (2014). Neuroscience and education: Myths and messages. Nature Reviews Neuroscience, 15, 817–824. doi:10.1038/nrn3817 Retrieved from http://www.nature.com/nrn/journal/v15/n12/full/nrn3817.html

Moser, J., Schroder, H., Heeter, C., Moran, T., & Lee, Y. (2011). Mind your errors: Evidence for a neural mechanism linking growth mind-set to adaptive posterror adjustments. Psychological Science, 22(12), 1484-1489. doi:10.1177/0956797611419520 Retrieved from http://pss.sagepub.com/content/22/12/1484

Qin, S., Cho, S., Chen, T., Rosenberg-Lee, M. Geary, D., & Menon, V. (2014) Hippocampal-neocortical functional reorganization underlies children's cognitive development. Nature Neuroscience, 17, 1263-1269. doi:10.1038/nn.3788 Retrieved from http://www.nature.com/neuro/journal/v17/n9/abs/nn.3788.html

NCTM's Grand Challenges and Opportunities in Mathematics Education Research

Last summer, the NCTM Research Committee asked members to identify grand challenges in mathematics education (written about here and here), and today they've published their findings in the Journal of Research in Mathematics Education. First thing's first: If you're not a JRME subscriber your access to the article is blocked by a paywall. Sadly, this feels like another case of NCTM's reluctance to move past old models of publishing and communication, leaving teachers interested in the grand challenges to feel like second-class NCTM members, begging for a handout from the privileged NCTM research community. I've written about my concerns and suggestions for NCTM's relationship with its members, so here I'll just focus on the key points found in today's report. Ready to be inspired? Slow your roll, turbo. You might want to prepare yourself to be a bit puzzled, if not disappointed.

The report begins by placing the concept of a "grand challenge" in the hands of researchers:

Mathematics education researchers seek answers to important questions that will ultimately result in the enhancement of mathematics teaching, learning, curriculum, and assessment, working toward “ensuring that all students attain mathematics proficiency and increasing the numbers of students from all racial, ethnic, gender, and socioeconomic groups who attain the highest levels of mathematics achievement” (National Council of Teachers of Mathematics [NCTM], 2014, p. 61). Although mathematics education is a relatively young field, researchers have made significant progress in advancing the discipline. As Ellerton (2014) explained in her JRME editorial, our field is like a growing tree, stable and strong in its roots yet becoming more vast and diverse because of a number of factors.

Next the report talks about the purpose of grand challenges and their development and use in other fields. In some ways, it reminded me of the spread of the standards movement: "Math has standards, we should too!", except now it's "The National Academy of Engineering has grand challenges, math ed should too!" Then the report spends four paragraphs talking about Hilbert's problems and how they influenced the last 100-plus years of research in mathematics. The report shifts back to the present, summarizing grand challenges in other disciplines. Readers at this point are likely getting anxious, sensing that their grand challenge lies just ahead.

But wait! What's the criteria for a grand challenge again? The report slows to grind away at feedback about how a "grand challenge" was defined in the initial survey. Saying a grand challenge is "doable," for example, wasn't specific enough for some concerned respondents. Okay, point taken. Nobody wants a grand challenge that can't be met. (Ahem...NCLB...100% proficiency targets. Been there, done that.) So now, we prepare ourselves for the challenge...

But first, let's talk about three themes of responses the committee got from the math ed community. Let me be clear: These aren't the challenges, just the themes describing a body of suggested challenges:

  1. Changing perceptions about what it means to do mathematics.
  2. Changing the public’s perception about the role of mathematics in society.
  3. Achieving equity in mathematics education.

I was hoping to have a strong, positive reaction to these, but I fear my inner cynic took over: "In a nutshell, survey respondents argued our grand challenge for the future is to finally win the math wars that we've been fighting for the past 25 years." The details that followed this list, while short, were thoughtful. My inner cynic quieted down. We do need public support for improved ways of teaching mathematics. We do need to conceive of equity and teaching that goes beyond simply narrowing the achievement gap. All good things. But like I said, those were just themes. So now, I stand ready for the distillation of those themes to form itself in the shape of a grand challenge. So the winner is...

Will you settle for a "hypothetical" grand challenge instead? NCTM suggests this as a mere example: All students will be mathematically literate by the completion of eighth grade, accompanied with this disclaimer:

Our example is only meant to illustrate how a Grand Challenge could satisfy the criteria listed in the previous section; we are not suggesting that it is necessarily a Grand Challenge we should pursue.

There are then six paragraphs describing the attention and importance given to literacy (the read-and-write text kind) and how we should give the same attention and importance to mathematical literacy. But this isn't the grand challenge. It could be, but it's not. Unless we decide it is. Which we haven't.

What we need next, says the report, is to think about the process we need to draft grand challenges. The design researcher in me says, "Yes, this is how to do this. We asked for grand challenges, got input, and now we're going to make revisions to our thinking and ask for more input, and it's going to be better input the next time around." I get it. But readers expecting a call to action might think NCTM is just calling a big, frustrating "Do over!" on the process. Here's NCTM's proposed plan, which they encourage people to critique: Engage many voices. Give people opportunities to draft the grand challenges and comment on drafts written by others. Engage in conversations online (!) and at conferences. Avoid just handing this work to a committee. So expect to see the NCTM Grand Challenge Grand Tour coming to a town near you — they'll have sessions in Boston at the Research Conference and Annual Meeting, as well as at AREA, AMATYC, AMTE, the Benjamin Banneker Association, EONAS, MAA, NCSM, PME-NA, TODOS, WME, regional NCTM meetings, and online venues. (Forgive me for not spelling out all the organizations. I figure if you don't know what it is, you're probably not attending.) I found this bit interesting:

The NCTM Research Committee will also convene a diverse group with a wide variety of expertise to review all submitted challenges, write additional challenges, vet them according to the criteria set forth in the invitation, and provide opportunities for the field to comment on them.

That sounds a bit like a hand-picked committee working in conjunction yet parallel to all the work described above. There's little detail, but I think NCTM better be clear about how the work of this committee will be weighed against the suggestions of the broader community. So, are we ready? Psyched? Ready to push that boulder back up the hill? I hope not, because the last section, while probably necessary, is a bit of a downer.

The Research Committee knows that a grand challenge — if and when we have one — will have consequences for researchers:

Any time a representative group of people is given an opportunity to identify Grand Challenges for an entire field, there is a moral obligation to consider the associated risks and weigh them against the potential benefits. The risks associated with creating a document that identifies our field’s Grand Challenges could be significant, yet we hope to minimize the risks by acknowledging and addressing them throughout the process.

What are the risks? Some people's research and work will get privileged over others. Funding will get reallocated. Journals will rethink what should and should not be published. The groups we consider to be "stakeholders" in math education could change. In some cases, people's feelings might get hurt; in other cases, careers could be threatened. I know this sounds overly dramatic, but the tenure and promotion game for academic researchers can be a rough one, and the research committee knows that. It still struck me as odd to see this "inside baseball"-type discussion near the end of the report, but it might comfort some and give fair warning to others.

So that's it. NCTM's grand challenge was not, and will not be, the "we asked, you answered" kind of process that some of us might have expected. I guess you could call that the bad news. If you were ready to jump to collective action, you're going to have to wait. But there is good news: If you are looking to give your input, it looks like you'll have multiple opportunities. And now that the task ahead is defined more clearly, we can think not just of possible challenges, but the ways we'll organize ourselves to tackle those challenges. To me, the key to the former will be the latter.

References

Stephan, M. L., Chval, K. B., Wanko, J. J., Civil, M., Fish, M. C., Herbel-Eisenmann, B., … Wilkerson, T. L. (2015). Grand challenges and opportunities in mathematics education research. Journal for Research in Mathematics Education, 46(2). Retrieved from http://www.nctm.org/Publications/journal-for-research-in-mathematics-education/2015/Vol46/Issue2/Grand-Challenges-and-Opportunities-in-Mathematics-Education-Research/

On Major Problems and Grand Challenges, Part 2

Prompted by NCTM's call for "grand challenges," in my last post I looked back at Hans Freudenthal's 1981 "Major Problems" paper. We've made progress in the past 30+ years, and we should recognize that. But that doesn't mean other challenges don't await us, and in this post I'll look at some suggestions made by some fellow bloggers. If this looks like "armchair challenging" it's probably because it is, rambling commentary and all.

Before I continue, it's worth noting that all four bloggers I found writing on this topic are white males. (And I am, too.) If this doesn't bring to mind a grand challenge for the future of math education, I don't know what should.

Robert Talbert: Grand Challenges for Mathematics Education

Robert's first suggestion is to develop an open curriculum for high school and early college. Sure, we've had many curriculum projects, but I can't say I've seen many that try to seamlessly span high school and college. It makes me realize that textbook companies typically package things in ways that align with the jurisdictions of district decision-makers, but there's really no reason it has to be that way.

We currently have some open curriculum projects that might give us a start on this challenge, such as the Mathematics Vision Project out of Utah and the EngageNY materials from New York. I say "give us a start" for two reasons: neither set of materials are very mature (and thus quality can be suspect) and such a project should plan for the evolution and improvement of the materials over time.

Side story: I was having dinner this summer with a retired mathematics education professor and she was telling me about her experiences volunteering to help tutor kids at a local high school. Our conversation went like this:

Her: "I didn't recognize the materials they were using, but they're a mess. It's something they found online and I don't know who put it together, but it looks like different people wrote adjacent lessons and never talked to each other, because there were big jumps from one topic to another with no explanation."

Me: "Let me guess. Are the materials from New York?"

Her: "No, Utah."

Me: "That was my second guess. And your guess about different people writing different lessons without much coordination is a very good guess of what probably happened."

Robert's second and third challenges involve the creation and use of concept inventories for mathematics, like the force concept inventory (FCI) for physics. I hear this get discussed occasionally and I'm aware of some efforts for inventories in calculus and statistics, but they aren't nearly as well recognized or used as the FCI. What's the advantage of having these inventories? They tend to make for great pre-post tests for a course or to judge if a particular teaching approach is better for students' conceptual understanding. Last week I attended a talk by Stephen Pollock who talked about his work in physics education research and the improved results we're getting in CU's physics program. The FCI played a key role in that progress, as it allowed professors to self-monitor their courses and compare their results to others who were attempting to improve their teaching. These kinds of standardized assessment tools could be equally useful and powerful in mathematics departments, especially when used in a self-monitoring sort of way instead of the all-too-common external-and-top-down-accountability-enforcing sort of way.

Robert's last recommendation is to have a preprint server for math education research. As he notes, this is a road we've tried to go down before and we didn't get very far. I don't think the problem has nearly as much to do with policy or categories of the arXiv as it does with the lack of a "preprint culture" in mathematics education. What I learned in those previous preprint discussions, and in my observations as a developing scholar, is that math educators regularly and happily share work in progress — with a select group of people. In math ed, there doesn't seem to be widespread faith in anything like Linus' Law, the open source software dictum that says, "With enough eyeballs, all bugs are shallow." I think the math wars led to a lot of distrust, and some of it is very rational. It's safer to only share preliminary work with a few scholars who share similar methods and theoretical frameworks, and then refine the work after peer review before publication in a journal whose readership is likely to understand the work. Maybe it shouldn't be this way, but to move forward we're going to have to confront some of these beliefs.

Patrick Honner: My Grand Challenge for Mathematics Education

Patrick described in some detail a single grand challenge: "Build and maintain a free, comprehensive, modular, and adaptable repository of learning materials for all secondary mathematics content." It's worth reading his post and the comments. This challenge hits close to home for me because it touches on my own research, including the difficulty of coordinating distributed curriculum development and the infrastructure needed to support the customization of curriculum.

I've always been intrigued by the concept of "modular and adaptable" curriculum materials. Personally, I thought I did my best work as a teacher when I offloaded my curriclum to a high-quality textbook that I'd been trained to use. That's an anathema to many math teachers who take improvisation of curriculum to be a sign of quality teaching. (It's not, by the way. There can be good and bad improvisation, just as there can be good and bad offloading.) I tried writing my own curriculum for a while and found it exhausting and ineffective. In a couple hours per day, I just couldn't create from scratch anything that I thought was as good as the texts coming from university-based curriculum teams with decades of experience and millions of dollars of funding. Go figure. I got better results when I leveraged the rigor and coherence of a text that integrated topics, contexts, tools, and routines across its lessons and units.

With enough effort, however, Patrick's recommendation could lead to a set of materials that are both modular and coherent. I've always seen these in opposition, a sort of "textbook paradox." I speculate that teachers who value being able to adapt and improvise with their curriculum will resist or find ineffective those textbooks built around coherence. It's relatively straightforward to replace a lesson in a very traditional textbook that relies on an isolated set of examples and practice problems. But for reform-based materials, such as IMP, CPM, and Everyday Math, skipping around in the textbook can lead to trouble. Saxon texts, for that matter, with their use of "incremental development," should make a teacher think twice before skipping or improvising a lesson. Thus, the paradox: teachers who want to improve the quality of their curriculum materials probably have an easier time adapting materials that are lower quality to begin with, but if they start with higher-quality materials, adaptation can sacrifice coherence and make adaptation more difficult.

Adaptation can still be done with any curriculum, but it takes skill. Currently, that skill must come almost entirely from the teacher, as the texts aren't smart enough to know what you've been skipping. Take Patrick's challenge far enough, however, and maybe we could have a curriculum that is smart enough to know what you've used and not used. Imagine a statistics curriculum that automatically modifies tasks to use a preferred data set, or a system that reminds you that you should probably include a lesson and practice with mean absolute deviation prior to teaching standard deviation. Or, for algebra, imagine a system that let you decide whether to teach exponential functions before or after quadratics, with the curriculum being smart enough to recommend appropriate modeling tasks. When I helped a school pilot Accelerated Math in 1999 and used the exprience as my student teaching action research project, I really thought we were on the cusp of a wave of "smart curriclum" that would help build coherence into teacher-adapted curriculum. We're not there yet, but a challenge like the one Patrick describes could get us much closer.

David Wees: Grand Challenge for NCTM

David's grand challenges focuses more on people than materials: "Develop a comprehensive, national professional development model that supports the high quality mathematics instruction they have been promoting for many years." ("They" refers to NCTM.) David breaks this challenge into bullet points around the development and scaling of "core practices."

I'm a firm believer in this idea. I get resistance from those who love the creative and spontaneous aspects of teaching, but I think that learning to teach should involve the learning and practicing of key teaching practices. Thankfully, there are some very good people working in this area. Until recently, their efforts were somewhat scattered and referred to with such names as "high-leverage practices" or "ambitious teaching." Thankfully, at AERA this past spring, many of the heavy hitters doing this work came together to address the need for a common language around these practices and supporting their development and use. For a good idea of what a list of core practices might look like, check out the Teaching Works project from the University of Michigan. I have a hard time finding anything on that list that doesn't seem essential to quality teaching, and it reminds me that the list is really the easy part. The real work comes in developing those practices in preservice and inservice teachers, and I'm glad that David had his mind on that development when he articulated his grand challenge.

Bryan Meyer:

Bryan's challenge isn't math-specific but it could help a lot of math teachers. Our expectations for teacher collaboration exceed our opportunities, and changing this involves a lot of people and resources. In some countries there are limits to how many student contact hours a teacher can have because they are expected to be collaborating with or observing other teachers for several hours each day. What if we did that in the United States? We'd have to seriously rethink our resources. Suppose you currently teach six periods a day with about 24 students in each class. What if you only taught four periods with 36 students in each class, and you had the extra two periods to work with other teachers to ensure your instruction in those four periods was better? (For those of you who already have 36 students in your classes and are working out even larger classes in your heads, I'm sorry.) Or, instead of changing class sizes, what if salaries were lowered to accommodate the hiring of extra teachers?

While these questions suggest difficult choices, they do seem like questions that could be answered with adequate research, and maybe there exists some research already that could help us answer them. Still, research in education isn't always very effective at changing school cultures or how resources are allocated. I don't want to sound too pessimistic, but I'm thinking that Bryan's challenge is going to have to focus as much on understanding and developing cultures of collaboration amongst teachers as it would scheduling and resource allocations.

Parting Thoughts

While it may have been personally beneficial for me to put a couple thousand words into a grand challenge I thought about on my own, I realize that our best hopes for meeting a grand challenge come when we share and push each other's ideas. As a student of curriculum and instruction, I find much to like in Robert and Patrick's thoughts about curriculum and David and Bryan's thoughts about instruction. There's some really meaty stuff there.

I've also tried to think about what wasn't mentioned as a challenge. Nobody said, "I really think we need to better understand how students think about ratio/functions/number/proof/etc." While people are hard at work on such questions, I don't think there's any widespread perception that a lack of research in specific areas of student mathematical understanding is what is holding us back. (If there's a challenge I should be writing about, it's about the dissemination and use of this information.) I'm also happy to see that people weren't writing challenges involving new sets of academic standards. It's rather unfortunate that so much energy is being put into debating Common Core when it seems quite likely that standards account for little of the variability in student outcomes. We have a list of stuff we want students to learn. Fine. I'm ready to focus more of our efforts on the learning, not the list.

Lastly, to touch briefly on the challenge I hinted at near the top of this post, I didn't see any equity-focused grand challenges. I think I speak for Robert, Patrick, David, and Bryan when I say we all believe in achieving equitable participation and outcomes in mathematics education. Then again, we can't just say that and expect equity to come about by accident. There are elements of each challenge mentioned that could be used to promote equity, but it's going to take a more explicit focus than we've given it. In fact, maybe the first step is to significantly change the representation implied when I say "we." It seems simple enough, but privilege has a way of producing thoughts of "for" and "to" instead of "with," and that's a challenge for the kinds of people and organizations who pose challenges.

On Major Problems and Grand Challenges, Part 1

Last month the NCTM Research Committee asked its members to help it identify the grand challenges for mathematics education. Grand challenges, said NCTM, (a) are hard yet doable, (b) affect millions of people, (c) need a comprehensive research program, (d) are goal-based with progress we can measure, and (e) capture the public's attention and support. I'm a month too late to contribute to NCTM's survey, and before blogging my thoughts into the wider conversation I thought I should look back at someone else's previous attempt. Maybe I'd gain some perspective on what grand challenges are and how persistent they might be.

Hans Freudenthal (Wikimedia Commons, CC-BY-SA)
In 1980, Hans Freudenthal gave a plenary address at ICME that later turned into an article in Educational Studies in Mathematics titled, Major Problems of Mathematics Education. I've briefly summarized the article on the MathEd Wiki and here I'll note the progress I think we've made on Freudenthal's 11 problems.
  1. Freudenthal believed we "need[ed] more pardigmatic cases, paradigms of diagnosis and prescription, for the benefit of practitioners and as bricks for theory builders" (p. 135). In the case of arithmetic, which was Freudenthal's example, I think Cognitively Guided Instruction (CGI) is very much the kind of thing Hans was looking for.
  2. Freudenthal wanted us to more carefully consider how people learn and observe their learning processes. I think several decades of teachers' awareness of constructivist theories of learning has changed how most people think of learning, and newer work in the area of teacher noticing puts fine points on what teachers notice and why.
  3. How do we design curriculum and instruction around progressive formalization? There is always more to learn, but the Freudenthal Institute in the Netherlands has now worked on this for decades and the frameworks for curriculum design are well-established.
  4. How do we retain and leverage mathematical insight? Freudenthal wrapped this into the conceptual vs. procedural debate, one that's still very much alive. However, I think we have better examples of productive approaches to this problem, and some research results (the BEAR project work at Berkeley comes to mind) showed that more focus on the conceptual didn't come at the expense of procedural facility. Still, this problem gets wrapped up in people's beliefs about mathematics and the teaching and learning of mathematics, and those beliefs sometimes aren't swayed by current evidence.
  5. How do we reflect on our learning? This is another problem we now know much more about, particularly due to Schoenfeld and his work on metacognition.
  6. How do we develop a mathematical attitude? This is still a challenge, and not just because some students say they don't like math. I think this problem might be closest to what Jo Boaler is currently trying to change with her focus on mindsets in learning mathematics.
  7. How do we coordinate students working together when the are at different levels of learning? Many teachers and scholars have worked quite hard on this problem and I feel like most teachers now see the benefit of heterogeneous ability groups. For more, I'd suggest Ilana Horn's book, Strength in Numbers.
  8. How do we create contexts for mathematizing? I think there's been a wealth of work in this area, from work based in Realistic Mathematics Education, work on word problems like that from Verschaffel, Greer, and de Corte, and, most recently, Dan Meyer's work. I could go on, as there are many more examples, and perhaps future work will give us a clearer picture about which contexts work best and why.
  9. Can we teach geometry by having the learner reflect on spatial intuitions? Maybe it's my lack of expertise in geometry education research, but I really don't know where we stand on this problem. Freudenthal seemed to be reaching in his article on this problem, and maybe a more tangible articulation of the problem would have helped me better judge any solutions we might have.
  10. How can technology increase mathematical understanding? Freudenthal admitted not being tech-savvy even in 1981 (he used "the ballpoint" as an example of technology that changed instruction, and not in an obviously historical way), but I think we now have numerous examples of tech that helps increase understanding. We also have a lot of examples of tech that doesn't, and I'm sure Freudenthal would have seen problems in our ability to judge the good from bad.
  11. How do we use a holistic approach to educational development for change? In his native Netherlands, Freudenthal would likely be pleased today to see his colleagues' commitment to design-based, participatory approaches to research. We have some of that here in the U.S., too, but we also struggle for a "scientific" approach to finding "what works" based on experimental studies. We also have too much faith in how standards affect change; if Freudenthal thought curriculum development for change was a wrong perspective, surely he'd think the same about standards. Those things are just part of a much bigger picture.
Looking at this list, I think we have a lot to be proud of. Even though Freudenthal's article wasn't some sort of directive or command to fellow and future math education researchers and teachers, many people over many years worked so we'd have some answers to these questions. Still, there's a gap between ''what the field of math ed knows'' and ''what a teacher does with this knowledge, if they know it," which hints at what might be a grand challenge of its own. I'd like to get to that, but in a later post. Next, I'll look at some of the grand challenges that I've seen others post on the web in response to NCTM's call for input.

Schneider's From the Ivory Tower to the Schoolhouse, Chapter 5: Ideas Without a Foothold

In the first four chapters of From the Ivory Tower to the Schoolhouse: How Scholarship Becomes Common Knowledge in Education, Jack Schneider details how four ideas (Bloom's taxonomy, multiple intelligences, the project method, and Direct Instruction) traversed the gap between the education research world and K-12 classrooms. Now, in Chapter 5, he identifies counterparts to each idea that failed to make the leap: Krathwohl's taxonomy for the affective domain (the sequel to Bloom's Taxonomy for the cognitive domain), Sternberg's triarchic theory (which paralleled multiple intelligences), Wittrock's generative learning model (see Michael's post), and the behavior analysis model (similar to Direct Instruction in more ways than one). If my personal experience is any indication, Schneider has chosen these well, as I knew as a teacher about all the ideas in Schneider's first four chapters (to various degrees, anyway) but can't say I knew any of the four ideas compared in Chapter 5. To be honest, Chapter 5 served as my proper introduction to these latter ideas — not only did I not know of them as a teacher, I can't recall having learned about them in grad school, either.

In his review of Chapter 5, Michael Pershan takes the position that even though he hadn't heard of Wittrock's generative learning model, surely there existed some path by which he was at the tail end of some chain of Wittrock's influence. I think this is probably true; while teachers might only recognize Piaget and Vygotsky by name, the rise of the study of cognition and how we construct knowledge is the result of the work of many scholars, not just two. I think this falls under Schneider's concept of perceived importance: Piaget and Vygotsky seem important because so many scholars built upon their work, even if the scholars in that crowd remain nameless to us.

Still, it's difficult to say this is good enough. Even though it's not possible for a teacher (or anyone!) to have a direct connection to all available research, shorter paths would be preferable to long ones. I agree with Michael: teachers would likely benefit from knowing Wittrock and his work. But to what degree?

One of the things we learned from Schneider's first four chapters is that familiarity sometimes does not breed fidelity in education research. This felt most true in the multiple intelligences chapter, where some consultants seemed to play fast-and-loose with Gardner's theories, and I imagine the teachers who sat through those workshops or read those books played even faster-er and looser-er with multiple intelligences. Should we be worried that a little bit of knowledge is indeed a dangerous thing in education research?

I would be more worried if not for one thing: constructivist theories of learning tell us that not only to bits of knowledge matter, they're the stuff upon which more knowledge is constructed. In fact, there's a particular learning theory that addresses this called knowledge in pieces, and, if you can find it, it's worth reading Andy diDessa's 1988 chapter by that title. This should be of particular interest to Michael as the theory gives a nice way of explaining misconceptions, whether they be the ones we see in students or the ones we see teachers make when research finds its way to them by vague and indirect paths. In short, misconceptions aren't just the acquisition of "wrong" knowledge that needs to be confronted with "right" knowledge. Rather, knowledge in pieces says learners systematize their pieces of knowledge. What we think of as a "misconception" can be explained as a system of knowledge built upon pieces of available knowledge. The pieces aren't "wrong" and neither is the system, but as more pieces of knowledge get added we expect the system to adapt and become more sophisticated. Now, I admit that my understanding of the theory might be short a few pieces, but I think the key to wrapping your head around it is to force yourself to think knowledge exists with the learner, and nowhere else. Knowledge gets constructed from experience, not with the acquisition of knowledge from an external source. (See also: radical constructivism.)

Opening quote from diSessa's 1988 chapter

This leads us back to one of the ideas Michael mentioned in his post: teachers need exposure to research followed by opportunities to engage with the research more deeply. Teachers will take the pieces of knowledge they have — whether gained from teaching experiences, experiences engaging with research, or elsewhere — and systematize that knowledge in variously sophisticated ways. What we need, then, are opportunities for teachers to further systematize their knowledge. I'll talk about that in my next post, a review of Schneider's recommendations for improving research-to-practice.

Note: Michael Pershan (@mpershan) and I are reading Jack Schneider's book From the Ivory Tower to the Schoolhouse: How Scholarship Becomes Common Knowledge in Education. Our previous posts:

References

diSessa, A. A. (1988). Knowledge in pieces. In G. Forman & P. B. Pufall (Eds.), Constructivism in the computer age (pp. 49–70). Hillsdale, NJ: Lawrence Erlbaum Associates.

Schneider's From the Ivory Tower to the Schoolhouse, Chapter 4: Direct Instruction

The fourth chapter of Jack Schneider's From the Ivory Tower to the Schoolhouse: How Scholarship Becomes Common Knowledge in Education represents a needed turn in the overall narrative of the book. As a bonus, this chapter will likely keep me from throwing around the phrase "direct instruction" in unintended ways.

Schneider's previous three chapters focused on Bloom's Taxonomy, multiple intelligences, and the project method. Each of those cases seemed to rely heavily on Schneider's constructs of philosophical compatibility and transportability. In other words, fidelity of implementation didn't seem to matter much: teachers adoption of the research seemed tied to their freedom to interpret and implement the research in whatever way they saw fit. In more than a few instances, Schneider leaves the reader to question if the research has been implemented with any fidelity at all, or if teachers are adopting it in name only.
In this chapter, titled Lessons of Last Resort, Schneider tells the story of Direct Instruction. I've heard and used the term direct instruction (little "d" little "i") to simply describe teaching as telling, but it has a more specific research heritage exending back 50+ years. The researcher there from the beginning is Siegfried Engelmann, seen here:


Unlike Bloom's Taxonomy, multiple intelligences, and the project method, Englemann's Direct Instruction works (with the research to show it) when teachers are philosophically compatible with the method and they implement it with fidelity. The actual effectiveness of research wasn't addressed in Schneider's first three chapters, but it is here because it's one of the big reasons for Direct Instruction's success.

This success isn't something that makes some progressive educators very comfortable, as they resist the scripted nature of the curriculum. These progressive educators are usually in schools where illiteracy and innumeracy isn't a persistent problem, and they're given autonomy to choose other, more philosophically compatible curriculum and methods. (To be clear, just because Direct Instruction has been shown to be effective, that doesn't mean it's the only effective thing, or the most effective. Also, it should go without saying, showing something to be "effective" is a tricky business, even when we agree what "effective" means.) But in schools where illiteracy and innumeracy persists, often in low-income schools with underrepresented populations and difficulties finding skilled teachers, Direct Instruction is more popular. Schneider addresses the issue of philosophical compatibility:
In addition to its effect on teacher authority, scripting also promised to reduce the responsibilities of those in classrooms. Working with a program like Direct Instruction, teachers would no longer be responsible for lesson design, for expertise about children, or for the task of dealing with the uncertainty of classroom life. As Direct Instruction promoters put it on their Web site: "The popular valuing of teacher creativity and autonomy as high priorities must give way to a willingness to follow certain carefully prescribed instructional practices." And as Englemann put it: "The teacher is a teacher—not a genius, an instructional designer, or a counselor. The teacher must be viewed as a consumer of instructional material." Engelmann saw this aspect of Direct Instruction as occupationally realistic, and he may have been right. But reducing teacher responsibility also raised serious philosophical compatibility issues insofar as it threatened teacher professionalism. (p. 122)
You might be reading this right now and saying to yourself, "No way. I'd never use this stuff." That's the philosophical incompatibility talking. There's reasearch for that, too: reform curricula might be good, but the results aren't nearly as good when placed in the hands of a traditional teacher. I believe vice-versa has been found to be better, but still not as good as reform curriculua with reform teachers. But where do we draw the line between philosophical compatibility and the need for teachers to be open minded? To be learners? As professionals, when should our philosophies give way to what we can gain from research, regardless of compatibility?

I don't have an answer for this question, but perhaps Michael Pershan (@mpershan) will have some thoughts in his reply. If you haven't been following along, we've been reading the book together and here are our posts so far: