math Archives - The Hechinger Report https://hechingerreport.org/tags/math/ Covering Innovation & Inequality in Education Mon, 29 Apr 2024 18:08:45 +0000 en-US hourly 1 https://hechingerreport.org/wp-content/uploads/2018/06/cropped-favicon-32x32.jpg math Archives - The Hechinger Report https://hechingerreport.org/tags/math/ 32 32 138677242 PROOF POINTS: Many high school math teachers cobble together their own instructional materials from the internet and elsewhere, a survey finds https://hechingerreport.org/proof-points-many-high-school-math-teachers-cobble-together-their-own-instructional-materials-from-the-internet-and-elsewhere-a-survey-finds/ https://hechingerreport.org/proof-points-many-high-school-math-teachers-cobble-together-their-own-instructional-materials-from-the-internet-and-elsewhere-a-survey-finds/#comments Mon, 29 Apr 2024 10:00:00 +0000 https://hechingerreport.org/?p=100387

Writing lesson plans has traditionally been a big part of a teacher’s job.  But this doesn’t mean they should be starting from a blank slate. Ideally, teachers are supposed to base their lessons on the textbooks, worksheets and digital materials that school leaders have spent a lot of time reviewing and selecting.  But a recent […]

The post PROOF POINTS: Many high school math teachers cobble together their own instructional materials from the internet and elsewhere, a survey finds appeared first on The Hechinger Report.

]]>

Writing lesson plans has traditionally been a big part of a teacher’s job.  But this doesn’t mean they should be starting from a blank slate. Ideally, teachers are supposed to base their lessons on the textbooks, worksheets and digital materials that school leaders have spent a lot of time reviewing and selecting. 

But a recent national survey of more than 1,000 math teachers reveals that many are rejecting the materials they should be using and cobbling together their own.

“A surprising number of math teachers, particularly at the high school level, simply said we don’t use the district or school-provided materials, or they claimed they didn’t have any,” said William Zahner, an associate professor of mathematics at San Diego State University, who presented the survey at the April 2024 annual meeting of the American Educational Research Association in Philadelphia. Students, he said, are often being taught through a “bricolage” of materials that teachers assemble themselves from colleagues and the internet. 

“What I see happening is a lot of math teachers are rewriting a curriculum that has already been written,” said Zahner. 

The survey results varied by grade level. More than 75 percent of elementary school math teachers said they used their school’s recommended materials, but fewer than 50 percent of high school math teachers said they did. 

Share of math teachers who use their schools recommended materials

Source: Zahner et al, Mathematics Teachers’ Perceptions of Their Instructional Materials for English Learners: Results from a National Survey, presented at AERA 2024.

The do-it-yourself approach has two downsides, Zahner said, both of which affect students. One problem is that it’s time consuming. Time spent finding materials is time not spent giving students feedback, tailoring existing lessons for students or giving students one-to-one tutoring help. The hunt for materials is also exhausting and can lead to teacher burnout, Zahner said.

Related: Education research, condensed. The free Proof Points newsletter delivers one story every Monday.

The other problem is that teacher-made materials may sacrifice the thoughtful sequencing of topics planned by curriculum designers.  When teachers create or take materials from various sources, it is hard to maintain a “coherent development” of ideas, Zahner explained. Curriculum designers may weave a review of previous concepts to reinforce them even as new ideas are introduced. Teacher-curated materials may be disjointed. Separate research has found that some of the most popular materials that teachers grab from internet sites, such as Teachers Pay Teachers, are not high quality

The national survey was conducted in 2021 by researchers at San Diego State University, including Zahner, who also directs the university’s Center for Research in Mathematics and Science Education, and the English Learners Success Forum, a nonprofit that seeks to improve the quality of instructional materials for English learners. The researchers sought out the views of teachers who worked in school districts where more than 10 percent of the students were classified as English learners, which is the national average. More than 1,000 math teachers, from kindergarten through 12th grade, responded. On average, 30 percent of their students were English learners, but some teachers had zero English learners and others had all English learners in their classrooms.

Teachers were asked about the drawbacks of their assigned curriculum for English learners. Many said that their existing materials weren’t connected to their students’ languages and cultures. Others said that the explanations of how to tailor a lesson to an English learner were too general to be useful.  Zahner says that teachers have a point and that they need more support in how to help English learners develop the language of mathematical reasoning and argumentation.

It was not clear from this survey whether the desire to accommodate English learners was the primary reason that teachers were putting together their own materials or whether they would have done so anyway. 

Related: Most English lessons on Teachers Pay Teachers and other sites are ‘mediocre’ or ‘not worth using,’ study finds

“There are a thousand reasons why this is happening,” said Zahner. One high school teacher in Louisiana who participated in the survey said his students needed a more advanced curriculum. Supervisors inside a school may not like the materials that officials in a central office have chosen. “Sometimes schools have the materials but they’re all hidden in a closet,” Zahner said.

In the midst of a national debate on how best to teach math, this survey is an important reminder of yet another reason why many students aren’t getting the instruction that they need. 

This story about math lessons was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for Proof Points and other Hechinger newsletters. 

The post PROOF POINTS: Many high school math teachers cobble together their own instructional materials from the internet and elsewhere, a survey finds appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-many-high-school-math-teachers-cobble-together-their-own-instructional-materials-from-the-internet-and-elsewhere-a-survey-finds/feed/ 9 100387
PROOF POINTS: Stanford’s Jo Boaler talks about her new book ‘MATH-ish’ and takes on her critics https://hechingerreport.org/proof-points-stanfords-jo-boaler-book-math-ish-critics/ https://hechingerreport.org/proof-points-stanfords-jo-boaler-book-math-ish-critics/#comments Mon, 22 Apr 2024 10:00:00 +0000 https://hechingerreport.org/?p=100161

Jo Boaler is a professor at the Stanford Graduate School of Education with a devoted following of teachers who cheer her call to make math education more exciting. But despite all her fans, she has sparked controversy at nearly every stage of her career. Critics say she misrepresents research to make her case and her […]

The post PROOF POINTS: Stanford’s Jo Boaler talks about her new book ‘MATH-ish’ and takes on her critics appeared first on The Hechinger Report.

]]>
“I am the next target,” says Stanford professor Jo Boaler, who is the subject of an anonymous complaint accusing her of a “reckless disregard for accuracy.” Credit: Photo provided by Jo Boaler

Jo Boaler is a professor at the Stanford Graduate School of Education with a devoted following of teachers who cheer her call to make math education more exciting. But despite all her fans, she has sparked controversy at nearly every stage of her career. Critics say she misrepresents research to make her case and her ideas actually impede students. Now, with a new book coming out in May, provocatively titled “MATH-ish,” Boaler is fighting back. 

“This is a whole effort to shut me down, my research and my writing,” said Boaler. “I see it as a form of knowledge suppression.”

Academic fights usually don’t make it beyond the ivory tower. But Boaler’s popularity and influence have made her a focal point in the current math wars, which also seem to reflect the broader culture wars.  In the last few months, tabloids and conservative publications have turned Boaler into something of an education villain who’s captured the attention of Elon Musk and Texas Sen. Ted Cruz on social media. Critics have even questioned Boaler’s association with a former reality TV star.

“I am the next target,” Boaler said, describing the death threats and abusive email she’s been receiving.

This controversy matters on a much larger level because there is a legitimate debate about how math should be taught in American schools. Cognitive science research suggests that students need a lot of practice and memorization to master math. And once students achieve success through practice, this success will motivate them to learn and enjoy math. In other words, success increases motivation at least as much as motivation produces success. 

Yet, from Boaler’s perspective, too many students feel like failures in math class and hate the subject. That leaves us with millions of Americans who are innumerate. Nearly 2 out of every 5 eighth graders don’t even have the most basic math skills, according to the 2022 National Assessment of Educational Progress (NAEP). On the international Program for International Student Assessment (PISA), American 15-year-olds rank toward the bottom of economically advanced nations in math achievement. 

Boaler draws upon a different body of research about student motivation that looks at the root causes of why students don’t like math based on surveys and interviews. Students who are tracked into low-level classes feel discouraged. Struggling math students often describe feelings of anxiety from timed tests. Many students express frustration that math is just a collection of meaningless procedures. 

Boaler seeks to fix these root causes. She advocates for ending tracking by ability in math classes, getting rid of timed tests and starting with conceptual understanding before introducing procedures. Most importantly, she wants to elevate the work that students tackle in math classes with more interesting questions that spark genuine curiosity and encourage students to think and wonder. Her goal is to expose students to the beauty of mathematical thinking as mathematicians enjoy the subject. Whether students actually learn more math the Boaler way is where this dispute centers. In other words, how strong is the evidence base?

The latest battle over Boaler’s work began with an anonymous complaint published in March by the Washington Free Beacon, the same conservative website that first surfaced plagiarism accusations against Claudine Gay, the former president of Harvard University. The complaint accuses Boaler of a “reckless disregard for accuracy” by misrepresenting research citations 52 times and asks Stanford to discipline Boaler, a full professor with an endowed chair. Stanford has said it’s reviewing the complaint and hasn’t decided whether to open an investigation, according to news reports. Boaler stands by her research (other than one citation that she says has been fixed) and calls the anonymous complaint “bogus.” (UPDATE: The Hechinger Report learned after this article was published that Stanford has decided not to open an investigation.)

“They haven’t even got the courage to put their name on accusations like this,” Boaler said. “That tells us something.”

Boaler first drew fire from critics in 2005, when she presented new research claiming that students at a low-income school who were behind grade level had outperformed students at higher-achieving schools when they were taught in classrooms that combined students of different math achievement levels. The supposed secret sauce was an unusual curriculum that emphasized group work and de-emphasized lectures. Critics disparaged the findings and hounded her to release her data. Math professors at Stanford and Cal State University re-crunched the numbers and declared they’d found the opposite result.

Boaler, who is originally from England, retreated to an academic post back in the U.K., but returned to Stanford in 2010 with a fighting spirit. She had written a book, “What’s Math Got to Do with It?: How Parents and Teachers Can Help Children Learn to Love Their Least Favorite Subject,” which explained to a general audience why challenging, open-ended problems would help more children to embrace math and how the current approach of boring drills and formulas was turning too many kids off. Teachers loved it.

Boaler accused her earlier critics of academic bullying and harassment. But she didn’t address their legitimate research questions. Instead, she focused on changing classrooms. Tens of thousands of teachers and parents flocked to her 2013 online course on how to teach math. Building on this new fan base, she founded a nonprofit organization at Stanford called youcubed to train teachers, conduct research and spread her gospel. Boaler says a half million teachers now visit youcubed’s website each month.

Boaler also saw math as a lever to promote social justice. She lamented that too many low-income Black and Hispanic children were stuck in discouraging, low-level math classes. She advocated for change. In 2014, San Francisco heeded that call, mixing different achievement levels in middle school classrooms and delaying algebra until ninth grade. Parents, especially in the city’s large Asian community, protested that delaying algebra was holding their children back. Without starting algebra in middle school, it was difficult to progress to high school calculus, an important course for college applications. Parents blamed Boaler, who applauded San Francisco for getting math right. Ten years later, the city is slated to reinstate algebra for eighth graders this fall. Boaler denies any involvement in the unpopular San Francisco reforms.

Before that math experiment unraveled in San Francisco, California education policymakers tapped Boaler to be one of the lead writers of a new math framework, which would guide math instruction throughout the state. The first draft discouraged tracking children into separate math classes by achievement levels, and proposed delaying algebra until high school. It emphasized “social justice” and suggested that students could take data science instead of advanced algebra in high school. Traditional math proponents worried that the document would water down math instruction in California, hinder advanced students and make it harder to pursue STEM careers. And they were concerned that California’s proposed reforms could spread across the nation. 

In the battle to quash the framework, critics attacked Boaler for trying to institute “woke” mathematics. The battle became personal, with some criticizing her for taking $5,000-an-hour consulting and speaking fees at public schools while sending her own children to private school. 

Critics also dug into the weeds of the framework document, which is how this also became a research story. A Stanford mathematics professor catalogued a list of what he saw as research misrepresentations. Those citations, together with additional characterizations of research findings throughout Boaler’s writings, eventually grew into the anonymous complaint that’s now at Stanford.

By the time the most recent complaint against Boaler was lodged, the framework had already been revised in substantial ways. Boaler’s critics had arguably won their main policy battles. College-bound students still need the traditional course sequence and cannot substitute data science for advanced algebra. California’s middle schools will continue to have the option to track children into separate classes and start algebra in eighth grade. 

But the attacks on Boaler continue. In addition to seeking sanctions from Stanford, her anonymous critics have asked academic journals to pull down her papers, according to Boaler. They’ve written to conference organizers to stop Boaler from speaking and, she says, they’ve told her funders to stop giving money to her. At least one, the Valhalla Foundation, the family foundation of billionaire Scott Cook (co-founder of the software giant Intuit), stopped funding youcubed in 2024. In 2022 and 2023, it gave Boaler’s organization more than $560,000. 

Boaler sees the continued salvos against her as part of the larger right-wing attack on diversity, equity and inclusion or DEI. She also sees a misogynistic pattern of taking down women who have power in education, such as Claudine Gay. “You’re basically hung, drawn and quartered by the court of Twitter,” she said.

From my perch as a journalist who covers education research, I see that Boaler has a tendency to overstate the implications of a narrow study. Sometimes she cites a theory that’s been written about in an academic journal but hasn’t been proven and labels it research. While technically true – most academic writing falls under the broad category of research –  that’s not the same as evidence from a well-designed classroom experiment.  And she tends not to factor in evidence that runs counter to her views or adjust her views as new studies arise. Some of her numerical claims seem grandiose. For example, she says one of her 18-lesson summer courses raised achievement by 2.8 years.

“People have raised questions for a long time about the rigor and the care in which Jo makes claims related to both her own research and others,” said Jon Star, a professor of math education at Harvard Graduate School of Education. 

But Star says many other education researchers have done exactly the same, and the “liberties” Boaler takes are common in the field. “That’s not to suggest that taking these liberties is okay,” Star said, “but she is being called out for it.”

Boaler is getting more scrutiny than her colleagues, he said, because she’s influential, has a large following of devoted teachers and has been involved in policy changes at schools. Many other scholars of math education share Boaler’s views. But Boaler has become the public face of nontraditional teaching ideas in math. And in today’s polarized political climate, that’s a dangerous public face to be.

The citation controversy reflects bigger issues with the state of education research. It’s often not as precise as the hard sciences or even social sciences like economics. Academic experts are prone to make wide, sweeping statements. And there are too few studies in real classrooms or randomized controlled trials that could settle some of the big debates. Star argues that more replication studies could improve the quality of evidence for math instruction. We can’t know which teaching methods are most effective unless the method can be reproduced in different settings with different students. 

Credit: Cover image provided by the author Jo Boaler

It’s also possible that more research may never settle these big math debates and we may continue to generate conflicting evidence. There’s the real possibility that traditional methods could be more effective for short-term achievement gains, while nontraditional methods might attract more students to the subject, and potentially lead to more creative problem-solvers in the future. 

Even if Boaler is loose with the details of research studies, she could still be right about the big picture. Maybe advanced students would be better off slowing down on the current racetrack to calculus to learn math with more depth and breadth. Her fun hands-on approach to math might spark just enough motivation to inspire more kids to do their homework. Might we trade off a bit of short-term math achievement for a greater good of a numerate, civic society?

In her new book, “MATH-ish,” Boaler is doubling down on her approach to math with a title that seems to encourage inexactitude. She argues that approaching a problem in a “math-ish” way gives students the freedom to take a guess and make mistakes, to step back and think rather than jumping to numerical calculations. Boaler says she’s hearing from teachers that “ish” is far more fun than making estimates.

“I’m hoping this book is going to be my salvation,” she said, “that I have something exciting to do and focus on and not focus on the thousands of abusive messages I’m getting.”

This story about Jo Boaler was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: Stanford’s Jo Boaler talks about her new book ‘MATH-ish’ and takes on her critics appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-stanfords-jo-boaler-book-math-ish-critics/feed/ 5 100161
PROOF POINTS: How Covid narrowed the STEM pipeline https://hechingerreport.org/proof-points-how-covid-narrowed-the-stem-pipeline/ https://hechingerreport.org/proof-points-how-covid-narrowed-the-stem-pipeline/#respond Mon, 25 Mar 2024 10:00:00 +0000 https://hechingerreport.org/?p=99394

Universities, philanthropies, and even the U.S. government are all trying to encourage more young Americans to pursue careers in STEM,  an acronym for science, technology, engineering and mathematics. Many business sectors, from high tech to manufacturing, are plagued with shortages of workers with technical skills. In New York City, where I live, the subway is […]

The post PROOF POINTS: How Covid narrowed the STEM pipeline appeared first on The Hechinger Report.

]]>
The STEM pipeline –  a metaphor for the development of future scientists, engineers and other high tech workers –  likely starts with a narrower funnel in the post-pandemic era. Credit: CSA Images via Getty Images

Universities, philanthropies, and even the U.S. government are all trying to encourage more young Americans to pursue careers in STEM,  an acronym for science, technology, engineering and mathematics. Many business sectors, from high tech to manufacturing, are plagued with shortages of workers with technical skills. In New York City, where I live, the subway is frequently plastered with advertisements carrying the message that STEM fields pay well. But studying STEM requires more than an interest in science or a desire to make good money. Students also need adequate training, even in elementary and middle school.

That’s why it’s concerning that high-achieving students, who’ve received less public attention than lower achieving students, were also set back by remote learning and pandemic uncertainty.  Fewer students with math skills shrinks the pool of people who are likely to cultivate an expertise in science, engineering and technology a decade from now. In other words, the STEM pipeline –  a metaphor for the development of future scientists, engineers and other high tech workers –  likely starts with a narrower funnel in the post-pandemic era.

The stakes are high not only for Gen Z, as they age out of school and enter the workforce, but also for the future of the U.S. economy, which needs skilled scientists and engineers to grow.

The leading indicators of STEM troubles ahead are apparent within the 2022 scores from a national test called the National Assessment of Educational Progress (NAEP). The immediate headlines from that first post-pandemic test focused on the fact that two decades of academic progress had been suddenly erased. Low-achieving children, who tend to be poor, had lost the most ground. An alarming number of American children – as high as 38 percent of eighth graders  – were functioning below the “basic” level in math, meaning that they didn’t have even the most rudimentary math skills.

Statisticians at the National Center for Education Statistics (NCES) have continued to dig into the 2022 data, and they’ve been also turning their attention to students at the top. These children are on grade level, but the eighth grade NAEP assessment shows that far fewer of them are hitting an advanced performance level, or even a proficient one. Math scores among top performers dropped as steeply as scores did among low performers. Even the scores of students at Catholic schools, who otherwise weathered the pandemic well, plummeted in eighth grade math. 

We don’t have data for other private schools because they have refused to participate in NAEP testing, but the eighth grade math declines among both high-achieving public school and Catholic school students are not good signs. 

NAEP tests reading and math in both fourth and eighth grades every two years in order to track educational progress. It’s one of the only tests that can be used for comparisons across states and generations. More than 400,000 students are specially selected to represent the regions and demographic characteristics of the nation. 

Among the four NAEP tests, eighth grade math showed the sharpest pandemic drop.  Math took a bigger hit than reading because kids can still read at home, while math is something that students primarily learn at school. If you didn’t read “The Hobbit” in your seventh grade English class because you were out sick with Covid, you can still be a good lifelong reader  But not getting enough practice with rates, ratios and percentages in middle school can derail someone who might have otherwise excelled. 

Why eighth grade math was hit harder than fourth grade math is a bit less obvious. One explanation is that the concepts that students need to learn are more difficult. Square roots and exponents are possibly more challenging to master than multiplication and division. And fewer parents are able to assist with homework as the math increases in complexity.

Yet another explanation is a psychological one. These eighth graders were in sixth grade when the pandemic erupted in the spring of 2020. This is a critical time in adolescent development when children are figuring out who they are and where they belong. A lot of this development occurs through social interaction. The isolation may have stunted psychological development and that ultimately affected motivation, study skills and the ability to delay gratification – all necessary to excel in math.

Let’s walk through the numbers together.

Highest achieving students lost ground in eighth grade math

Source: NAEP Report Card Mathematics 2022

This chart shows that the highest performing students, those at the top 10 percent and the top 25 percent, lost as much as low-achieving students at the bottom in eighth grade math. These eighth graders were in the spring of sixth grade when the pandemic hit in 2020, and it’s possible that they didn’t master important prerequisite skills, such as rates and ratios. These kids at the top are performing at grade level, but not as high performing as past eighth graders.

Fewer eighth grade students hit advanced and proficient levels

Source: NAEP Report Card Mathematics 2022

This bar chart shows that before the pandemic 10 percent of the nation’s eighth graders were performing at an advanced level in math. That fell to 7 percent. And the number of students deemed proficient in eighth grade math fell even more, from 24 percent to 20 percent. Before the pandemic, arguably, 34 percent of the eighth grade population was on track to pursue advanced math in high school and a future STEM career if they wanted one. After the pandemic in 2022, only 27 percent were well prepared.

Students at Catholic schools are generally much higher performing than students at public schools. In large part, that’s because of family income; wealthier students tend to have higher test scores than poorer students. Catholic school students tend to be wealthier; their families can afford private school tuition. In recent years, the Catholic Church has closed hundreds of schools that catered to low-income families, leaving a higher income population in its remaining classrooms. 

Catholic schools outperformed public schools but also dropped 

Source: NAEP Report Card Mathematics 2022

This chart shows that Catholic school students, depicted by the diamonds, outperformed public school students, depicted by the circles, in eighth grade math. But it was still a sharp five-point decline in eighth grade math performance for Catholic school students, almost as large as the eight-point decline for public school students. Scores of white students at Catholic schools declined five points; scores of students at Catholic schools in the suburbs declined seven points. Almost a quarter of Catholic school students are now functioning below a basic level in math for their grade. 

Despite the good academic reputation of Catholic schools and the praise Catholic schools received for resuming in-person instruction sooner, math scores suggest a problem. And it’s a problem that potentially extends to the whole private school universe, where 9 percent of students are enrolled, according to the most recently available data from 2019. 

I talked with Ron Reynolds, the executive director of the California Association of Private School Organizations, who explained that not just Catholic schools, but also many other private schools suffered even if they hadn’t been closed for long. Reynolds said that private schools were still hit by illnesses, deaths and absences and that might have affected instruction.

“Private schools are tightly knit communities in which teachers tend to be more intertwined in the lives of the children and families they serve,” he said. “When you have a crisis, and so many people experiencing stress and loss, that can certainly impact the teacher in some significant ways.”

Unfortunately, we don’t know exactly how other private schools fared during the pandemic because they have refused to participate in the NAEP tests for the past decade. Reynolds, who serves on the governing board that oversees the NAEP exam, has been trying to lobby more private schools to participate, but so far, to no avail.

Together private schools, selective public schools and affluent suburban schools have been important training grounds for the nation’s future scientists and engineers. Of course, it is possible that these high achieving students, now 10th graders, will catch up. Many of them are from wealthier families who can afford tutors, or attend well-resourced schools. But I am not seeing much evidence that schools have had the ability to think about the pipeline of advanced students when many students are so needy. And with post-pandemic grade inflation, students and parents may not be getting the signals they need to seek extra help independently. 

The administration of the 2024 NAEP test wrapped up in March, but results won’t be known for many months. I’ll be keeping an eye on eighth grade math and on SAT, ACT and Advanced Placement scores in the years to come.

This story about math scores was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: How Covid narrowed the STEM pipeline appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-how-covid-narrowed-the-stem-pipeline/feed/ 0 99394
Calculating the value of data science classes https://hechingerreport.org/calculating-the-value-of-data-science-classes/ https://hechingerreport.org/calculating-the-value-of-data-science-classes/#comments Thu, 14 Mar 2024 10:00:00 +0000 https://hechingerreport.org/?p=99214 A teacher helps a student with a math workbook assignment.

Editor’s note: This story led off this week’s Future of Learning newsletter, which is delivered free to subscribers’ inboxes every other Wednesday with trends and top stories about education innovation. Subscribe today! Last year, I began reporting on the growing interest in teaching young people about data science amid calls that Algebra II and other […]

The post Calculating the value of data science classes appeared first on The Hechinger Report.

]]>
A teacher helps a student with a math workbook assignment.

Editor’s note: This story led off this week’s Future of Learning newsletter, which is delivered free to subscribers’ inboxes every other Wednesday with trends and top stories about education innovation. Subscribe today!

Last year, I began reporting on the growing interest in teaching young people about data science amid calls that Algebra II and other higher-level math classes are being taught in outdated ways and need to be modernized. Experts were already raising concerns about falling math scores before the pandemic, and those scores nationwide have only continued to worsen.

There’s no easy answer – math experts, STEM professors, high school educators, parents, advocates and even students have vastly different opinions on what math knowledge and courses should be required for students to succeed in college and careers.

Nowhere has this been clearer than in California. As I wrote in my latest story, co-published with The Washington Post, the state’s public higher education system has gone back and forth on whether data science (an interdisciplinary field that combines computer programming, math and statistics) and other statistics-based courses fit into existing math pathways and can serve as an alternative to Algebra II in admissions.

But missing from these debates was the voices of students and educators – those most affected by any decisions made by the state’s public university system. I wanted to see for myself what students were learning in high school data science classes, why they were signing up for the course and how decisions about which math classes to take were being determined.

In December, I visited Oxnard Union High School District, which launched a data science pathway in 2020. The class targeted students who didn’t plan to major in STEM fields in college, as well as those who planned to attend a community college or go straight into the workforce or military. A “math class for poets” was how the district’s superintendent, Tom McCoy, had jokingly described it.

From my visits to the district’s high school data science classes and my conversations with teachers and students, two things became clear: The course’s structure is very different than a traditional math class – it’s an applied, project-based learning course in which students collaborate closely as they learn the material. And the way different teachers and schools approach the class differs greatly, even within a single district. Some teachers emphasize data literacy (teaching students how to read and analyze data); others incorporate math concepts from algebra and statistics; and still others may inject more computer programming or coding.

That variation — both in how the classes are taught and their content – has added to concerns that data science courses are low quality and insufficiently rigorous. And it’s in part why there’s an emerging push to develop standards around the course, and tackle the question of what an effective data science course should look like.

Much of the concern around data science in California centers around three programs — Introduction to Data Science, Youcubed and CourseKata — that make up the majority of data science courses available there. According to a recent report from University of California committee that sets admissions standards, none of the courses “even come close to meeting the required standard to be a ‘more advanced’ course,” and are more similar to data literacy courses than advanced mathematics. (Oxnard Union uses a different curricula, one developed by ed tech vendor Bootstrap.)  

Mahmoud Harding is the instructional design director at Data Science 4 Everyone, a national initiative based at the University of Chicago. He co-developed a high school data science program at the North Carolina School of Science and Mathematics and teaches a course  at North Carolina State’s Data Science Academy. He said a high school data science course should help students find more real-world applications for concepts they learn in algebra.

In addition, the class should build conceptual knowledge of statistical topics through computation, visualizations and simulations, and help students understand bias within data and ethical concerns in using flawed data. Data science courses also need to be substantively different from statistics or computer programing courses, he said, noting that data science is “inherently interdisciplinary.”

“I don’t think a data science course is the same as an Algebra II course,” Harding said. “But it doesn’t mean that a data science course isn’t rigorous, or it doesn’t mean that you can’t matriculate into higher forms of algebra because you’ve taken data science.”

Harding’s group, Data Science 4 Everyone, is helping to lead the new effort to develop standards for data science. Zarek Drozda, the group’s executive director, said this year it will convene a working group of experts, K-12 educators, STEM professors, curriculum providers, state and district leaders, students and industry and workforce professionals including those with tech companies, to help create a list of recommendations of baseline data science standards.

As career opportunities involving AI, computing and data increase, Drozda said it is “critical” that we think about the foundational knowledge students need by the time they graduate from college. The group is engaging people from all sides of the data science debate to look critically at the courses currently offered and identify how to create classes that will better meet the needs of students.

Drozda said he also hopes the working group will consider how exposure to data science classes can help more students get excited about STEM fields that don’t necessarily require a four-year degree.

“I think there’s a false perception that we are trying to replace fundamental mathematics,” Drozda said. “In reality, we are trying to modernize, add options and enhance the relevance of mathematics and prove to students that math matters in the 21st century.”

This story about data science classes was produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Hechinger newsletter. 

The post Calculating the value of data science classes appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/calculating-the-value-of-data-science-classes/feed/ 1 99214
PROOF POINTS: Learning science might help kids read better https://hechingerreport.org/proof-points-learning-science-might-help-kids-read-better/ https://hechingerreport.org/proof-points-learning-science-might-help-kids-read-better/#respond Mon, 11 Mar 2024 10:00:00 +0000 https://hechingerreport.org/?p=99123

A growing chorus of education researchers, pundits and “science of reading” advocates are calling for young children to be taught more about the world around them. It’s an indirect way of teaching reading comprehension. The theory is that what we grasp from what we read depends on whether we can hook it to concepts and […]

The post PROOF POINTS: Learning science might help kids read better appeared first on The Hechinger Report.

]]>

A growing chorus of education researchers, pundits and “science of reading” advocates are calling for young children to be taught more about the world around them. It’s an indirect way of teaching reading comprehension. The theory is that what we grasp from what we read depends on whether we can hook it to concepts and topics that we already know. Natalie Wexler’s 2019 best-selling book, The Knowledge Gap, championed knowledge-building curricula and more schools around the country, from Baltimore to Michigan to Colorado, are adopting these content-filled lesson plans to teach geography, astronomy and even art history. 

Makers of knowledge-building curricula say their lessons are based on research, but the truth is that there is scant classroom evidence that building knowledge first increases future reading comprehension. 

In 2023, University of Virginia researchers promoted a study of Colorado charter schools that had adopted E.D. Hirsch’s Core Knowledge curriculum. Children who had won lotteries to attend these charter schools had higher reading scores than students who lost the lotteries. But it was impossible to tell whether the Core Knowledge curriculum itself made the difference or if the boost to reading scores could be attributed to other things that these charter schools were doing, such as hiring great teachers and training them well. 

More importantly, the students at these charter schools were largely from middle and upper middle class families. And what we really want to know is whether knowledge building at school helps poorer children, who are less likely to be exposed to the world through travel, live performances, and other experiences that money can buy.

A new study, published online on Feb. 26, 2024, in the peer-reviewed journal Developmental Psychology, now provides stronger causal evidence that building background knowledge can translate into higher reading achievement for low-income children. The study took place in an unnamed, large urban school district in North Carolina where most of the students are Black and Hispanic and 40 percent are from low-income families.

In 2019, a group of researchers, led by James Kim, a professor at Harvard University’s Graduate School of Education, randomly selected 15 of the district’s 30 elementary schools to teach first graders special knowledge-building lessons for three years, through third grade. Kim, a reading specialist, and other researchers had developed two sets of multi-year lesson plans, one for science and one for social studies. Students were also given related books to read during the summer. (This research was funded by the Chan Zuckerberg Initiative, which is among the many funders of The Hechinger Report.)

The remaining 15 elementary schools in the district continued to teach their students as usual, still delivering some social studies and science instruction, but not these special lessons. Regular reading class was untouched in the experiment. All 30 schools were using the same reading curriculum, Expeditionary Learning, which follows science of reading principles and teaches phonics. 

Covid hit in the middle of the experiment. When schools shut down in the spring of 2020, the researchers scrapped the planned social studies units for second graders. In 2021, students were still not attending school in person. The researchers revised their science curriculum and decided to give an abridged online version to all 30 schools instead of just half. In the end, children in the original 15 schools received one year of social studies lessons and three years of science lessons compared to only one year of science in the comparison group. 

Still, approximately 1,000 students who had received the special science and social studies lessons in first and second grades outperformed the 1,000 students who got only the abbreviated online science in third grade. Their reading and math scores on the North Carolina state tests were higher not only in third grade, but also in fourth grade, more than a year after the knowledge-building experiment ended. 

It wasn’t a huge boost to reading achievement, but it was significant and long-lasting. It cost about $400 per student in instructional materials and teacher training.

Timothy Shanahan, a literacy expert and a professor emeritus at the University of Illinois at Chicago who was not involved in this research or the development of these science lessons, praised the study. “The study makes it very clear (as have a few others recently) that it is possible to combine reading with social studies and science curriculum in powerful ways that can improve both literacy and content knowledge,” he said by email. 

Connecting background knowledge to reading comprehension is not a new idea.  A famous 1987 experiment documented that children who were weaker readers but knowledgeable about baseball understood a reading passage about baseball better than children who were stronger readers but didn’t know much about the sport. 

Obviously, it’s not realistic for schools to attempt to familiarize students with every topic they might encounter in a book. And there is disagreement among researchers about how general knowledge of the world translates into higher reading performance.

Kim thinks that a knowledge-building curriculum doesn’t need to teach many topics. Random facts, he says, are not important. He argues for depth instead of breadth. He says it’s important to construct a thoughtful sequence of lessons over the years, allowing students to see how the same patterns crop up in different ways. He calls these patterns “schemas.” In this experiment, for example, students learned about animal survival in first grade and dinosaur extinction in second grade. In third grade, that evolved into a more general understanding of how living systems function. By the end of third grade, many students were able to see how the idea of functioning systems can apply to inanimate objects, such as skyscrapers. 

It’s the patterns that can be analogized to new circumstances, Kim explained. Once a student is familiar with the template, a new text on an unfamiliar topic can be easier to grasp.

Kim and his team also paired the science lessons with clusters of vocabulary words that were likely to come up again in the future – almost like wine pairings with a meal. 

The full benefits of this kind of knowledge building didn’t materialize until after several years of coordinated instruction. In the first years, students were only able to transfer their ability to comprehend text on one topic to another if the topics were very similar. This study indicates that as their content knowledge deepened, their ability to generalize increased as well.  

There’s a lot going on here: a spiraling curriculum that revisits and builds upon themes year after year; an explicit teaching of underlying patterns; new vocabulary words, and a progression from the simple to the complex. 

There are many versions of knowledge-rich curricula and this one isn’t about exposing students to a classical canon. It remains unclear if all knowledge-building curricula work as well. Other programs sometimes replace the main reading class with knowledge-building lessons. This one didn’t tinker with regular reading class. 

The biggest challenge with the approach used in the North Carolina experiment is that it requires schools to coordinate lessons across grades. That’s hard. Some teachers may want to keep their favorite units on, say, growing a bean plant, and may bristle at the idea of throwing away their old lesson plans.

It’s also worth noting that students’ math scores improved as much as their reading scores did in this North Carolina experiment. It might seem surprising that a literacy intervention would also boost math. But math also requires a lot of reading; the state’s math tests were full of word problems. Any successful effort to boost reading skills is also likely to have positive spillovers into math, researchers explained.

School leaders are under great pressure to boost test scores. To do that, they’ve often doubled time spent on reading and cut science and social studies classes. Studies like this one suggest that those cuts may have been costly, further undermining reading achievement instead of improving it. As researchers discover more about the science of reading, it may well turn out to be that more time on science itself is what kids need to become good readers.

This story about background knowledge was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: Learning science might help kids read better appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-learning-science-might-help-kids-read-better/feed/ 0 99123
PROOF POINTS: The surprising effectiveness of having kids study why they failed https://hechingerreport.org/proof-points-the-surprising-effectiveness-of-having-kids-study-why-they-failed/ https://hechingerreport.org/proof-points-the-surprising-effectiveness-of-having-kids-study-why-they-failed/#comments Mon, 04 Mar 2024 11:00:00 +0000 https://hechingerreport.org/?p=98943

For a few weeks in the spring of 2016, nearly all the eighth graders at a small public school affiliated with Columbia University agreed to stay late after school to study math. They were preparing for a critical test, the New York State’s Regents examination in algebra. Half of the kids came from families that […]

The post PROOF POINTS: The surprising effectiveness of having kids study why they failed appeared first on The Hechinger Report.

]]>
In an experiment on how best to study for a math test, learning through errors was pitted against working through practice problems in a Barron’s study guide, pictured above. Credit: Jill Barshay/ The Hechinger Report / The Hechinger Report

For a few weeks in the spring of 2016, nearly all the eighth graders at a small public school affiliated with Columbia University agreed to stay late after school to study math. They were preparing for a critical test, the New York State’s Regents examination in algebra. Half of the kids came from families that lived below the poverty line in Harlem and upper Manhattan. They attended a selective middle school, and were advanced enough to be taking algebra in eighth instead of ninth grade. Many others were the children of Columbia professors, and none of them – rich or poor – really needed help passing the test.

But researchers set up a review class to test a theory about the best way to study for a test. For the first eight sessions, half the students had a traditional review class. They were given a Barron’s Regents review study guide with lots of practice problems. Their teachers worked through the first half of the problems, explaining how to solve them step by step. 

The other half of their classmates studied the same algebra topics in a different way. They spent the first 45-minute session taking a mini practice test. They received no instruction and worked independently. The following day, their teachers went over the students’ errors. The students had four test-and-review cycles like this, for a total of four mini tests and four sessions of error review. 

Then, the two groups swapped. The kids who had been taught via traditional, explicit instruction switched to reviewing the remaining algebra topics through their errors. And the kids who had been correcting their errors received eight sessions of traditional test prep. Their teachers taught both ways too, so that differences between the two modes couldn’t be attributed to a particular teacher. The following year, the same four teachers repeated the entire experiment with a fresh group of eighth graders. All told, 175 kids participated in the experiment. 

Which method worked best? 

On the surface, it was a tie. Students improved by about the same amount – 12 percent – whether they learned through explicit instruction or error review. Students had taken tests before and after the test prep course. Noting how much they improved on various algebra topics, researchers were able to trace those gains back to whether students learned that topic through explicit instruction or through their errors.

There was one big difference, however. Learning through errors was twice as powerful based on instructional time. Teachers had to teach all eight sessions in the traditional instruction condition, totaling 360 minutes of instructional time. But teachers only had to teach every other session when students learned through errors, adding up to only 180 minutes.

“You get more bang from your teacher buck, if you will, from the learning from errors condition,” said Janet Metcalfe, a psychologist at Columbia University who led the study, which was published online in the British Journal of Educational Psychology in January 2024. (The Hechinger Report is an independent news organization based at Teachers College, Columbia University, but has no relationship with the middle school or the researchers involved in the study.)

Of course, students might not see it that way. They still had to be in class for the full 360 minutes after school, with half the time spent taking practice tests in order to generate the errors.

The study is not a repudiation of explicit instruction. The students were also taking an algebra class during the school day where they had likely had a lot of explicit instruction and were already familiar with the concepts. Metcalfe said that having this background knowledge is critical for learning by errors to work. The students aren’t just guessing, but they’re making common mistakes. 

“They’re just doing one little thing wrong,” said Metcalfe. “And once they understand what that one little thing is, and remember not to fall into a habit where they’ll make the same mistake, they can overcome it.”

Metcalfe offered the example of fractions. A student might mistakenly think that a large denominator means it’s a large number, but then remembers discussing the error in a review session and knows that a fraction with a large denominator might actually be a tiny number. The memory of discussing the error stops the student from making it again, she explained.

Learning from errors, however, was inconsistent. One of the four teachers produced more than twice the test score gains for students than a colleague. It’s not that this teacher was much better than the others. All four teachers produced almost identical test score gains when they taught explicitly how to solve problems. They were all good explainers. 

But being a good explainer is not always the same thing as being a good teacher. Metcalfe and her team analyzed videos and transcripts of the review sessions to understand what the teachers were doing differently. And it turns out there are multiple ways to teach through errors. 

The teacher who got the best results employed a sort of Socratic method. “Okay, you guys got this wrong? Why would somebody get this wrong?” recalled Metcalfe. “And he did very little lecturing, almost none.” 

This teacher asked his students to talk about how they had solved the problem and why they did it that way.  He asked them to talk about what they found difficult. Students would often explain their thinking to each other. Finally, the teacher would ask his students to come up with ideas on how to recognize and avoid such mistakes in the future. This teacher had a knack for maintaining a fast pace and getting through a lot of problems from the previous day’s mini test. His students’ test scores jumped by far more than 12 percent when he taught this way.

By contrast, the teacher who produced the lowest test score gains tended to lecture students on the correct way to solve the problems that they had gotten wrong. The focus was on the corrections, not the errors. His classes weren’t very interactive.  His students’ test scores improved by only 6 percent instead of 12 percent. Still, on a per minute basis, he was as effective teaching through errors as he had been teaching traditionally. 

Another teacher was extremely slow paced. “I was convinced when I was watching the teachers that the second teacher would have no success at all,” recalled Metcalfe. “He would take five minutes on one problem, and just let them mull over it.”

Her prediction was wrong. “His students did really well,”  Metcalfe said, laughing. Perhaps this is an error that Metcalfe won’t make again. Like the star teacher, he didn’t lecture.

It’s worth emphasizing again that these were highly motivated, high-achieving students who cared about their Regents exam scores. This method might not work with less motivated students who are struggling in school.  

Even with ideal students, it also seems like it takes a special teacher to pull off this kind of teaching. It reminds me of other progressive teaching approaches, from inquiry learning to project-based learning, for which researchers have documented remarkable results with masterful teachers. But maybe it’s asking too much of the average teacher to teach this way, thinking of questions on the fly that will magically steer students to the right answers. Should we be promoting ways of teaching that only a small minority of teachers can realistically do well? 

My big takeaway from this study is for students. When preparing for a math exam, they should take a practice test, go over mistakes and make sure they understand why they made them. 

This story about test prep was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: The surprising effectiveness of having kids study why they failed appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-the-surprising-effectiveness-of-having-kids-study-why-they-failed/feed/ 1 98943
PROOF POINTS: How to get teachers to talk less and students more https://hechingerreport.org/proof-points-how-to-get-teachers-to-talk-less-and-students-more/ https://hechingerreport.org/proof-points-how-to-get-teachers-to-talk-less-and-students-more/#respond Mon, 15 Jan 2024 11:00:00 +0000 https://hechingerreport.org/?p=97983

Silence may be golden, but when it comes to learning with a tutor, talking is pure gold. It’s audible proof that a student is paying attention and not drifting off, research suggests. More importantly, the more a student articulates his or her reasoning, the easier it is for a tutor to correct misunderstandings or praise […]

The post PROOF POINTS: How to get teachers to talk less and students more appeared first on The Hechinger Report.

]]>
Example of the talk meter shown to Cuemath tutors at the end of the tutoring session. Source: Figure 2 of Demszky et. al. “Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform.”

Silence may be golden, but when it comes to learning with a tutor, talking is pure gold. It’s audible proof that a student is paying attention and not drifting off, research suggests. More importantly, the more a student articulates his or her reasoning, the easier it is for a tutor to correct misunderstandings or praise a breakthrough. Those are the moments when learning happens.

One India-based tutoring company, Cuemath, trains its tutors to encourage students to talk more. Its tutors are in India, but many of its clients are American families with elementary school children. The tutoring takes place at home via online video, like a Zoom meeting with a whiteboard, where both tutor and student can work on math problems together. 

The company wanted to see if it could boost student participation so it collaborated with researchers at Stanford University to develop a “talk meter,” sort of a Fitbit for the voice, for its tutoring site. Thanks to advances in artificial intelligence, the researchers could separate the audio of the tutors from that of the students and calculate the ratio of tutor-to-student speech.

In initial pilot tests, the talk meter was posted on the tutor’s video screen for the entire one-hour tutoring session, but tutors found that too distracting. The study was revised so that the meter pops up every 20 minutes or three times during the session. When the student is talking less than 25 percent of the time, the meter goes red, indicating that improvement is needed. When the student is talking more than half the time, the meter turns green. In between, it’s yellow. 

Example of the talk meter shown to tutors every 20 minutes during the tutoring session. Source: Figure 2 of Demszky et. al. “Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform.”

More than 700 tutors and 1,200 of their students were randomly assigned to one of three groups: one where the tutors were shown the talk meter, another where both tutors and students were shown the talk meter, and a third “control” group which wasn’t shown the talk meter at all for comparison.

When just the tutors saw the talk meter, they tended to curtail their explanations and talk much less. But despite their efforts to prod their tutees to talk more, students increased their talking only by 7 percent. 

When students were also shown the talk meter, the dynamic changed. Students increased their talking by 18 percent. Introverts especially started speaking up, according to interviews with the tutors. 

The results show how teaching and learning is a two-way street. It’s not just about coaching teachers to be better at their craft. We also need to coach students to be better learners. 

“It’s not all the teacher’s responsibility to change student behavior,” said Dorottya Demszky, an assistant professor in education data science at Stanford University and lead author of the study. “I think it’s genuinely, super transformative to think of the student as part of it as well.”

The study hasn’t yet been published in a peer-reviewed journal and is currently a draft paper, “Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform,” so it may still be revised. It is slated to be presented at the March 2024 annual conference of the Society of Learning Analytics in Kyoto, Japan. 

In analyzing the sound files, Demszky noticed that students tended to work on their practice problems with the tutor more silently in both the control and tutor-only talk meter groups. But students started to verbalize their steps aloud once they saw the talk meter. Students were filling more of the silences.

In interviews with the researchers, students said the meter made the tutoring session feel like a game.  One student said, “It’s like a competition. So if you talk more, it’s like, I think you’re better at it.” Another noted:  “When I see that it’s red, I get a little bit sad and then I keep on talking, then I see it yellow, and then I keep on talking more. Then I see it green and then I’m super happy.” 

Some students found the meter distracting.  “It can get annoying because sometimes when I’m trying to look at a question, it just appears, and then sometimes I can’t get rid of it,” one said.

Tutors had mixed reactions, too. For many, the talk meter was a helpful reminder not to be long-winded in their explanations and to ask more probing, open-ended questions. Some tutors said they felt pressured to reach a 50-50 ratio and that they were unnaturally holding back from speaking. One tutor pointed out that it’s not always desirable for a student to talk so much. When you’re introducing a new concept or the student is really lost and struggling, it may be better for the teacher to speak more. 

Surprisingly, kids didn’t just fill the air with silly talk to move the gauge. Demszky’s team analyzed the transcripts in a subset of the tutoring sessions and found that students were genuinely talking about their math work and expressing their reasoning. The use of math terms increased by 42 percent.

Unfortunately, there are several drawbacks to the study design. We don’t know if students’ math achievement improved from the talk meter. The problem was that students of different ages were learning different things in different grades and different countries and there was no single, standardized test to give them all. 

Another confounding factor is that students who saw the talk meter were also given extra information sessions and worksheets about the benefits of talking more. So we can’t tell from this experiment if the talk meter made the difference or if the information on the value of talking aloud would have been enough to get them to talk more.

Excerpts from transcribed tutoring sessions in which students are talking about the talk meter. Source: Table 4 of Demszky et. al. “Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform.”

Demszky is working on developing a talk meter app that can be used in traditional classrooms to encourage more student participation. She hopes teachers will share talk meter results with their students. “I think you could involve the students a little more: ‘It seems like some of you weren’t participating. Or it seems like my questions were very closed ended? How can we work on this together?’”

But she said she’s treading carefully because she is aware that there can be unintended consequences with measurement apps. She wants to give feedback not only on how much students are talking but also on the quality of what they are talking about. And natural language processing still has trouble with English in foreign accents and background noise. Beyond the technological hurdles, there are psychological ones too.

 “Not everyone wants a Fitbit or a tool that gives them metrics and feedback,” Demszky acknowledges.

This story about student participation was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: How to get teachers to talk less and students more appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-how-to-get-teachers-to-talk-less-and-students-more/feed/ 0 97983
PROOF POINTS: 2023 in review https://hechingerreport.org/proof-points-2023-in-review/ https://hechingerreport.org/proof-points-2023-in-review/#respond Mon, 18 Dec 2023 11:00:00 +0000 https://hechingerreport.org/?p=97600

Every December, I compile a list of the most popular Proof Points columns. In 2023, the big story was the failure of schools to help children catch up from pandemic learning losses. I was proud to write several watchdog stories about the online tutoring that schools are buying and the crazy job of an online […]

The post PROOF POINTS: 2023 in review appeared first on The Hechinger Report.

]]>

Every December, I compile a list of the most popular Proof Points columns. In 2023, the big story was the failure of schools to help children catch up from pandemic learning losses. I was proud to write several watchdog stories about the online tutoring that schools are buying and the crazy job of an online tutor. I was surprised that those were not among the most popular stories. What struck a chord with readers was research about math, math and more math….and some handy study tips. 

Thank you to everyone who read and commented on my weekly stories about education data and research. I look forward to continuing this conversation with you next year. If you would like to receive my email newsletter and be notified when the column comes out each week, please click here and fill out the form. I’ll be back again on Jan. 2, 2024 with a story about college applications. Happy New Year!

Credit: Erika Rich for Hechinger Report
  1. PROOF POINTS: Inside the perplexing study that’s inspired colleges to drop remedial math

CUNY’s seven-year study of its experiment to get rid of remedial math has arguably been one of the most influential attempts to use experimental evidence to change how higher education operates and is now affecting the lives of millions of college students. However, many colleges may not realize that the study never looked at how to help students pass college algebra, an important prerequisite course. Some researchers argue that the shift to statistics instead of the elimination of remedial ed might have driven the results.

  1. PROOF POINTS: How a debate over the science of math could reignite the math wars

This column explained the origins of the new “science of math” movement, and how a group of special education researchers are seeking to copy the science of reading playbook. Their first manifesto attacked what they described as common misconceptions about teaching math.

Credit: Kevin Wolf/ Associated Press
  1. PROOF POINTS: Professors say high school math doesn’t prepare most students for their college majors

College professors often lament that their students are unprepared for the rigor of college-level math. But this Alabama survey highlighted another problem: high schools aren’t teaching the math skills that college professors in non-STEM fields want students to have. 

Credit: Carol Yepes/ Moment via Getty Images
  1. PROOF POINTS: Do math drills help children learn?

I took a look at  the contentious research debate on timed math tests. Short quizzes might be a more efficient way to memorize multiplication tables, but even advocates caution that there are many pitfalls. 

Credit: National Student Clearinghouse DEI Data Lab 2023
  1. PROOF POINTS: New higher ed data by race and ethnicity

Five charts document that white, Black and Hispanic Americans are going to college at about the same rates. But starting does not mean finishing. The likelihood of making it through the coursework and tuition payments and ultimately earning a degree varies by race and ethnicity. 

  1. PROOF POINTS: New research review questions the evidence for special education inclusion

People often assert that the research shows that students with disabilities learn better when they are included in regular classrooms. But a new meta-analysis says the research isn’t nearly as clear cut as advocates assert; some students with disabilities may be worse off and learn less in general education classes.

Credit: Photo illustration by Chesnot/Getty Images
  1. PROOF POINTS: A spate of recent studies on the “Google effect” adds to evidence that the internet is making us dumber

Here’s some news all of us can use. The stuff we’re Googling isn’t sticking in our memories and is quickly forgotten. One experiment finds that we’d retain more if we tried to guess before Googling.

  1. PROOF POINTS: The best way to teach might depend on the subject

Researchers find that math students learn best through individual practice while English students thrive in groups.

Credit: Matt McClain/The Washington Post via Getty Images
  1. PROOF POINTS: Flashcards prevail over repetition in memorizing multiplication tables

Here’s some concrete research advice for teachers on how to help their students memorize things. Since reading about this flashcard experiment, I’ve been telling my daughter to go straight to the cards and skip the studying. Kids may get frustrated not knowing something and looking at the answer over and over again. But she aced two vocab quizzes. (I was sad that multiplication songs weren’t the winner, but if you are nostalgic for Schoolhouse Rock and Billy Leach, I’ve included bonus links in this piece for you to sing along to.) 

Credit: Adam Mohr for Simon & Schuster
  1. PROOF POINTS: One expert on what students do wrong

The University of Virginia’s Daniel Willingham explains why reading our notes, using highlighters and making to-do lists are not the best ways to learn. Read the piece for the most effective methods.

This story about the top education research stories of 2023 was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Proof Points newsletter.

The post PROOF POINTS: 2023 in review appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-2023-in-review/feed/ 0 97600
PROOF POINTS: There is a worldwide problem in math and it’s not just about the pandemic https://hechingerreport.org/proof-points-there-is-a-worldwide-problem-in-math-and-its-not-just-about-the-pandemic/ https://hechingerreport.org/proof-points-there-is-a-worldwide-problem-in-math-and-its-not-just-about-the-pandemic/#comments Mon, 11 Dec 2023 11:00:00 +0000 https://hechingerreport.org/?p=97449

Numbers don’t lie, right? But they also don’t always tell the whole story. That’s the case with the most recent results from a key global education test, the Program for International Student Assessment or PISA.  In the past, PISA results have often spurred anguished discussion about why U.S. students are so far behind other countries […]

The post PROOF POINTS: There is a worldwide problem in math and it’s not just about the pandemic appeared first on The Hechinger Report.

]]>
Sample question on the math section of the 2022 PISA exam. This one is rated a level 2, a level of difficulty that 34 percent of U.S. 15-year-olds could not answer correctly. (Answer revealed at the bottom of this story.) For more PISA questions, there are PISA practice questions on Khan Academy and publicly released questions from the 2022 test. Source: OECD PISA 2022.

Numbers don’t lie, right? But they also don’t always tell the whole story. That’s the case with the most recent results from a key global education test, the Program for International Student Assessment or PISA. 

In the past, PISA results have often spurred anguished discussion about why U.S. students are so far behind other countries like Finland, Korea and Poland. But the most recent rankings, released in December 2023, indicated that U.S. 15-year olds moved up in the international rankings for all three subjects –  math, reading and science. Education Secretary Miguel Cardona credited the largest federal investment in education in history – roughly $200 billion – for keeping the United States “in the game” during the pandemic. (The tests were administered in 2022.)

But that rosy spin hides a much grimmer picture. Rankings may have risen, but test scores did not. The only reason the U.S. rose is because academic performance in once higher ranking countries, such as Iceland and the Slovak Republic, fell by even more since the previous testing round in 2018. Neither India nor China, which topped the rankings in 2018, participated in the 2022 PISA. In math, the U.S. rose from 29th place to 28th place, still in the bottom half of economically advanced nations of the Organization for Economic Cooperation and Development (OECD), an international organization of 38 member countries that oversees the PISA exam.

Click here to see a larger version of the 2022 PISA math results by country. Source: OECD PISA 2022.
Click here for a larger version of the 2022 PISA reading results. Source: OECD PISA 2022.

The deterioration in math was particularly devastating. American students scored 13 points lower than in 2018, equivalent to losing two-thirds of a year of education in the subject. These were the lowest U.S. math scores recorded in the history of the PISA math test, which began in 2003. More than a third of U.S. 15-year-olds (mostly 10th graders) are considered to be low performers, unable to compare distances between two routes or convert prices into a different currency. Over the past decade, the share of U.S. students in this lowest level has swelled; back in 2012, a little over a quarter of U.S. students were considered to be low performers.

Only seven percent of American students can do math at advanced levels. The United States has more students in the bottom group and fewer students in the top group than most other industrialized countries that are part of the OECD. (Click here to see an international ranking of low and top performers in each country.)

The results also confirmed the widespread inequalities in U.S. education. Black and Hispanic students, on average, scored far below Asian and white students. Those from low-income backgrounds scored lower than their more affluent peers.

Andreas Schleicher, director for education and skills at the OECD, emphasized that the inequities in the U.S. are often misunderstood to be primarily problem of weak schools in poor neighborhoods. His analysis indicates that low math performance is common throughout U.S. schools. Some students are performing much worse than others within the same school, and that range between low and advanced students within U.S. schools is much greater than the range in scores between schools. 

This new PISA test is the first major international education indicator since the Covid pandemic closed schools and disrupted education. Test scores declined all around the world, but the OECD found there was only a small relationship between how long schools were closed and their students’ performance on the PISA test. School closures explained only 11 percent of the variation in countries’ test scores; nearly 90 percent is attributable to other, unclear reasons. However, the OECD looked at the absolute level of test scores and not how much test scores fell or rose. More analysis is needed to see if there’s a stronger link between school closures and test score changes. 

This image has an empty alt attribute; its file name is export-2023-12-07T18_08_39.826Z-1024x683.png
Math performance has been deteriorating worldwide for two decades, but the US lags behind other advanced nations. Source: OECD PISA 2022.

Even if school closures eventually prove to be a more important factor, the pandemic isn’t the only reason students are struggling. Global scores have generally been declining for the past two decades. One hypothesis is that technology is distracting teenagers. Students were asked about technology distraction for the first time on the 2022 PISA. Forty-five percent of students said they feel anxious if their phones are not near them. Sixty-five percent report being distracted by digital devices during math lessons. Up to an hour a day of computer time for leisure was associated with higher performance. But heavy users, those who spent five to seven hours on computers for fun, had lower academic performance, even after adjusting for family and school socioeconomic profiles. 

Another factor could be the rise in migration across the world. Perhaps declining test scores reflect the challenge of educating new immigrants. However, the OECD didn’t find a statistically significant correlation between immigration and academic performance on average. In the United States, immigrants outscored students with native-born parents in math after adjusting for socio-economic status. There was no difference between immigrants and non-immigrants in reading.

Japan was one of the few countries to defy the trends. Both its math and reading scores rose considerably between 2018 and 2022. Akihiko Takahashi, professor emeritus of mathematics and mathematics education at Chicago’s DePaul University, said schools were closed for a shorter period of time in Japan and that helped, but he also credits the collective spirit among Japanese teachers. In his conversations with Japanese teachers, Takahashi learned how teachers covered for each other during school closures to make sure no students in their schools fell behind. Some went house to house, correcting student homework.  

It’s tempting to look at the terrible PISA math scores and say they are evidence that the U.S. needs to change how it teaches math. But the PISA results don’t offer clear recommendations on which math approaches are most effective. Even Japan, one of the top performing nations, has a mixed approach. Takahashi says that students are taught with a more progressive approach in elementary school, often asking students to solve problems on their own without step-by-step instructions and to develop their own mathematical reasoning. But by high school, when this PISA exam is taken, direct, explicit instruction is more the norm.

The new results also highlighted the continued decline of a former star. For years, Finland was a role model for excellent academic performance. Education officials visited from around the world to learn about its progressive approaches. But the country has dropped 60 points over the past few testing cycles – equivalent to losing three full school years of education. I suspect we won’t be hearing calls to teach the Finnish way anymore. “You have to be careful because the leaders of today can be the laggards of tomorrow,” said Tom Loveless, an independent researcher who studies international assessments.

There was one bright spot for American students. Fifteen-year-olds scored comparatively well on the PISA reading test, with their scores dropping by just one point while other countries experienced much steeper declines. But that good news is also tempered by the most recent scores on the National Assessment for Educational Progress (NAEP) test, often called the Nation’s Report Card. Reading scores of fourth and eighth graders deteriorated over the last two testing cycles in 2019 and 2022.

Overall, the PISA results provide additional confirmation that U.S. students are in trouble, especially in math, and we can’t put all the blame on the pandemic.

This story about the 2022 PISA results was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Hechinger newsletter.

The post PROOF POINTS: There is a worldwide problem in math and it’s not just about the pandemic appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-there-is-a-worldwide-problem-in-math-and-its-not-just-about-the-pandemic/feed/ 2 97449
PROOF POINTS: Professors say high school math doesn’t prepare most students for their college majors https://hechingerreport.org/proof-points-professors-say-high-school-math-doesnt-prepare-most-students-for-their-college-majors/ https://hechingerreport.org/proof-points-professors-say-high-school-math-doesnt-prepare-most-students-for-their-college-majors/#comments Mon, 13 Nov 2023 11:00:00 +0000 https://hechingerreport.org/?p=97081

The typical ambitious high school student takes advanced algebra, trigonometry, pre-calculus and calculus. None of that math may be necessary for the vast majority of undergraduates who don’t intend to major in science or another STEM field.  But those same students don’t have many of the math skills that professors think they actually do need. […]

The post PROOF POINTS: Professors say high school math doesn’t prepare most students for their college majors appeared first on The Hechinger Report.

]]>
A survey of college professors indicates that most fields of study don’t require many of the math topics that high school students learn in high school. Credit: Kevin Wolf/ Associated Press

The typical ambitious high school student takes advanced algebra, trigonometry, pre-calculus and calculus. None of that math may be necessary for the vast majority of undergraduates who don’t intend to major in science or another STEM field. 

But those same students don’t have many of the math skills that professors think they actually do need. In a survey, humanities, arts and social science professors say they really want their students to be able to analyze data, create charts and spreadsheets and reason mathematically – skills that high school math courses often skip or rush through.

“We still need the traditional algebra-to-calculus curriculum for students who are intending a STEM major,” said Gary Martin, a professor of mathematics education at Auburn University in Alabama who led the team that conducted this survey of college professors. “But that’s maybe 20 percent. The other 80 percent, what about them?” 

Martin said that the survey showed that high schools should stress “reasoning and critical thinking skills, decrease the emphasis on specific mathematical topics, and increase the focus on data analysis and statistics.”

This damning assessment of the content of high school math comes from a survey of about 300 Alabama college professors who oversee majors and undergraduate degree programs at both two-year and four-year public colleges in the humanities, arts, social sciences and some natural sciences. Majors that require calculus were excluded. 

The 2021 survey prompted Alabama’s public colleges and universities to allow more students to meet their math requirements by taking a statistics course instead of a traditional math class, such as college algebra or calculus. 

Martin and his colleagues later realized that the survey had implications for high school math too, and presented these results at an Oct. 26, 2023 session of the National Council of Teachers of Mathematics annual conference in Washington D.C.  Full survey results are slated to be published in the winter 2024 issue of the MathAMATYC Educator, a peer-reviewed journal of the American Mathematical Association of Two-Year Colleges.

In the survey, professors were asked detailed questions about which mathematical concepts and skills students need in their programs. Many high school math topics were unimportant to college professors. For example, most professors said they wanted students to understand functions, particularly linear and exponential functions, which are used to model trends, population changes or compound interest. But Martin said that non-STEM students didn’t really need to learn trigonometric functions, which are used in satellite navigation or mechanical engineering. 

College professors were more keen on an assortment of what was described as mathematical “practices,” including the ability to “interpret quantitative information,” “strategically infer, evaluate and reason,” “apply the mathematics they know to solve everyday life, society and the workplace,” and to “look for patterns and relationships and make generalizations.”

“Teachers are so focused on covering all the topics that they don’t have time to do the practices when the practices are what really matters,” said Martin.

Understanding statistics was high on the list. An overwhelming majority of college professors said students in their programs needed to be familiar with statistics and data analysis, including concepts like correlation, causation and the importance of sample size. They wanted students to be able to “interpret displays of data and statistical analyses to understand the reasonableness of the claims being presented.” Professors say students need to be able to produce bar charts, histograms and line charts. Facility with spreadsheets, such as Excel, is useful too.

“Statistics is what you need,” said Martin. “Yet, in many K-12 classrooms, statistics is the proverbial end-of-the-year unit that you may or may not get to. And if you do, you rush through it, just to say you did it. But there’s not this sense of urgency to get through the statistics, as there is to get through the math topics.”

Though the survey took place only in Alabama and professors in other states might have different thoughts on the math that students need, Martin suspects that there are more similarities than differences.

The mismatch between what students learn in high school and what they need in college isn’t easy to fix. Teachers generally don’t have time for longer statistics units, or the ability to go deeper into math concepts so that students can develop their reasoning skills, because high school math courses have become bloated with too many topics. However, there is no consensus on which algebra topics to jettison.

Encouraging high school students to take statistics classes during their junior and senior years is also fraught. College admissions officers value calculus, almost as a proxy for intelligence. And college admissions tests tend to emphasize math skills that students will practice more on the algebra-to-calculus track. A diversion to data analysis risks putting students at a disadvantage. 

The thorniest problem is that revamping high school math could force students to make big choices in school before they know what they want to study in college. Students who want to enter STEM fields still need calculus and the country needs more people to pursue STEM careers. Taking more students off of the calculus track could close doors to many students and ultimately weaken the U.S. economy.

Martin said it’s also important to remember that vocational training is not the only purpose of math education.  “We don’t have students read Shakespeare because they need it to be effective in whatever they’re going to do later,” he said. “It adds something to your life. I felt that it really gave me breadth as a human being.”  He wants high school students to study some math concepts they will never need because there’s a beauty to them. “Appreciating mathematics is a really intriguing way of looking at the world,” he said.

Martin and his colleagues don’t have any definitive solutions, but their survey is a helpful data point in demonstrating how too few students are getting the mathematical foundations they need for the future. 

This story about high school math was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, independent news organization focused on inequality and innovation in education. Sign up for the Hechinger newsletter.

The post PROOF POINTS: Professors say high school math doesn’t prepare most students for their college majors appeared first on The Hechinger Report.

]]>
https://hechingerreport.org/proof-points-professors-say-high-school-math-doesnt-prepare-most-students-for-their-college-majors/feed/ 10 97081