Ed Policy & Research

 The
use of military and sports metaphors to describe teaching and learning makes me
crazy. I hate it when teachers say they're "in the trenches." Calling
common standards "goalposts" grates on my sensibilities, as do drills,
recruits, maneuvers, tactics and racing to the top. I can never figure out who's
fighting--or who's winning--or why we're at war to begin with.

 

And
now we've been advised to develop instructional "platoons" in
elementary school
, the better to lock and load, pinpointing our achievement targets
with more precision. We can become an elite teaching force, a well-oiled
instructional machine, mowing down mathematical skills like Sherman marching to
the sea, and all that.

 

In
2005, I was teaching music in a K-4 building. I ate lunch with the three fourth
grade teachers, all of whom were smart and hip. I was consistently impressed
with their ongoing conversations about How to Make Things Better for Fourth
Graders.  They shared everything--lesson
planning, materials, moments of instructional illumination, things kids said in
class. In the fall, they started dividing up the lesson creation process, with
each teacher going deeper into one of three subjects in the fourth grade
curriculum--math, science and social studies. They all taught reading at the
same time, using the assigned building-wide program, but they were
experimenting with flexibly sharing their students for mini-lessons around
particular skills and topics.

 

There
were about 85 kids in the 4th grade, and their rooms were side by side. By the
end of September, the teachers knew all the 4th graders--and were convinced
that they could do a better job of instruction if they specialized in teaching one
subject, and ran the 4th grade reading program collaboratively, as well. They
drew up an elaborate plan--they called it "switching"--detailing
the benefits.

 

They
didn't make it past the first 15 minutes with the principal, who emphatically
said that parents preferred a single teacher for their young children--a teacher
who would be responsive to a particular child's unique needs. It would also take
valuable instructional time for the kids to move to a new class; when the
teachers explained that the kids would sit tight, and that it would take approximately
30 seconds for teachers to move next door, the principal got huffy.

 

She
said there was research showing that elementary students achieved more when
they stayed with the same teacher all day. At the time, the K-8 movement (a
reactionary response to the maligned "middle school concept") was taking
root in urban districts, keeping kids together all day. And finally, she shot
the plan dead by telling them that she was the decision-maker, and she was
convinced that their plan was nothing more than a sneaky way to make their
lives easier and reduce their personal workload.

 

They
had a second meeting with the principal, and this time the union representative
came, but no dice. Further--the principal had now noticed that the teachers
were occasionally switching kids for reading and put the kibosh on that as
well. One teacher, 28 kids, no switching--and that was that. Because I got to
hear lots of lunchtime exasperation about this situation, I did a quick scan of
research and found one or two old studies that supported the principal's position,
and a couple that supported the teachers' position. What all the research does
say is that the quality of teaching matters a great deal--and that teachers'
relationships with students are all-important. No surprises. But no research slam
dunk for either side of the issue.

 

Of
course, that was just switching, not platooning, which suddenly seems to be all the rage.
There is now a widely accepted theory that elementary teachers' lack of
mathematical knowledge is the cause of our failure to rout and crush the
international competition on math battles--I mean tests. It's worth pointing
out that the research on this is mixed, too--but we're already on the march, strategically
selecting a few good teachers to lead the charge.

 

In
the end, it's just another example of our national faith in tools and
levers--rather than people--to solve problems. The fourth grade teachers in my
school were willing to lead and invested in the outcomes of their simple plan.
That should count for more than snappy language.

My
favorite professor at Michigan State (known locally as "Moo U") was
fond of telling his grad students that researchers should just explain what
they found in their studies, and resist the urge to add specific policy
implications. Good research should stand on its own, he said--and determining
What It All Means was the reader's job. 

Cynic
that I am, I would add that readers should draw their own conclusions without
input from research funders, as well--whose strategic fingerprints often turn
up in the policy implications section of glossy, graphics-laden reports.

Public
Agenda's fascinating new report, Teaching
for a Living: How Teachers See the Profession Today,
divides teachers into
three loose groups--the disheartened (40%), the contented (37%) and the
idealists (23%). Discussing the report with a group of teachers in New York
this week, one teacher noted that she is frequently idealistic, disheartened
and contented in the space of a single day--but we generally agreed that the
data and characterizations squared with our prima facie impressions about our teacher
colleagues. Some are passionate believers in using education to change the
world, some have settled into situations where they have support and resources,
and feel confident that they're efficacious. And some, unfortunately, see
little to be optimistic about--poor working conditions, poor leadership, and
poor results.

What
struck me in the Education Week article about Teaching for a Living was the summary of policy implications:

Are the
Idealists the best prospects for high-needs schools and for reinvigorating the
profession, and what do school leaders need to do to retain them in the field?
Given the Idealists’ passion for improving their students’ lives, how can
administrators ensure that they have the skills and support to fulfill that
goal? More than a third of Idealists voiced a desire to move eventually into
other jobs in education. How does the field respond to those aspirations? The
Disheartened pose a different challenge. Some may be ill-fitted to the job and
ready to move on, but how should the field encourage and support their
transition? Others may be good teachers trapped in dysfunctional schools and,
in the right environment, might change their views and become Idealists.

Which
group is missing in this analysis?

Why
would we want to convert disheartened teachers into firebrands, especially since
idealistic teachers in the survey were overwhelmingly young and frequently
admitted that they weren't interested in teaching as a long-term career? The
thing about idealists is that they burn out--or they become pragmatic,
understanding that changing the world happens slowly, but is worth the effort.

Maybe
giving the satisfied and confident teachers a bovine label--contented--was
intentional. 

Public
Agenda has a reputation for solid, non-ideological research and thoughtful
analysis. Here's the teaser for the report, on their own web page:

Two out of
five of America’s 4 million K-12 teachers appear disheartened and disappointed
about their jobs, while others express a variety of reasons for contentment
with teaching and their current school environments, new research by Public
Agenda and Learning Point Associates shows.

Compare
that to Education Week's opener for a similar report published in February--the "MetLife Survey
of the American Teacher: Past, Present and Future:"

Teachers’
views on their profession have become markedly more positive over the past
quarter century, at least partially validating the widespread
school-improvement efforts of the period, concludes a retrospective survey
report released this week by MetLife Inc.

Sixty-two
percent of American teachers said they were "very satisfied" with
their job in the MetLife survey
, taken in 2008. When you add up Public Agenda's
idealistic teachers and contented teachers, you come up with 60%--about the same
number, actually. The difference? Policy suggestions for what to do
about teachers who are dissatisfied. Maybe we should be providing them with the
resources and support that they say they need, turning their
discouragement into realism.

Contented
cows give better milk
, after all.

Image: dali, Flickr Creative Commons

Let’s
get biases and politics out of the way first. I am a big fan of the charter
school concept—defined as the rich idea that when it comes to schooling, one
size does not fit all, and big monolithic districts do not and cannot serve diverse
children as well as site-directed, purpose-driven, innovative schools. If I
lived in Detroit, I would choose a magnet school or charter school for my
children—and even though I live in a district with fine public schools, one of
my children attended a public school and the other attended a private school. Ideologically,
I’m with Dewey on this one: I want the best possible education for all
children, the kind of carefully chosen options my own children had.

One
more thing: I think that positioning charter schools as the opposite of public
schools, rather than a necessary supplement to public education, has poisoned
the discourse. And—it goes both ways. It’s not just public schools and public
school teachers being skeptical (or downright nasty) in their remarks about
charter schools.  Public school academies—charters—seem
to be bent on repeating the worst sound bites about public schools, whether
they’re strictly true or not, thereby displaying the aphorism that your mother
repeated when you were seven years old: you don’t make yourself look better by
tearing someone else down. 

I
have a number of friends now working in the charter school movement in Detroit,
a city where a handful of good charter schools have begun to flourish and bear
fruit. Last week, they invited me to attend a showing of “The Providence Effect,”
a full-length film depicting a school success story: Providence St. Mel, a K-12
Catholic school
on Chicago’s tough west side.

Providence
St. Mel has accrued considerable recognition after parents adamantly refused to
close it on Diocese recommendation, 30 years ago: President Reagan visited,
around the time the “Nation at Risk” report was being crafted, and Oprah
Winfrey has taken a personal interest (and contributed more than a million
dollars). Providence’s outcomes—an average ACT score of 23, and 100% college
admission for graduates—resemble those of well-heeled suburban public schools.
Now, there is an attempt to replicate the “Providence effect:” a charter school
in Englewood, led by Providence graduates and veteran teachers, and based on
programs and principles at the original PSM.

The
screening was part of a two-day professional conference for charter school
proponents and teachers, and featured a panel discussion with Big Names in the Michigan
charter school movement, a State Board of Education member, various business-leadership
types, and the principal of the new Providence charter school. The room was set
up for hundreds of people, but I’m sure the attendance numbers (perhaps 60
people) were disappointing to the organizers. As I was parking on the rooftop
of Cobo Hall, charter school teachers wearing conference badges were flooding
out of the building, recognizable as teachers by their youth, their post-collegiate
dress and willingness to carry a tote bag—plus their “let’s go get a beer”
demeanor.

Impressions
from the film and the panel discussion:

  • The
    movie has a campaign-film aura—gauzy graduation footage with students
    inexplicably wearing white gloves, bits of talking-head rhetoric, quick-cut
    black and white shots from Chicago’s troubled past, backed by a vocal track of
    adolescents singing. It’s impressive, all right, especially their catch phrase:
    It’s not rocket science. The
    lingering message: anybody with high expectations and tight rules can turn around
    kids destined for the dumpster.
  • There
    is curiously little about instruction in the film; we do see a few examples of
    very traditional classroom teaching. There is a clip of first-graders in a race-to-the-board
    competitive spelling game (the teacher assigning points to teams, a la
    Professor Dumbledore), and a HS math lesson where the teacher puts an equation
    on the board and announces “No calculators!” (which drew a spatter of applause
    from the audience). An elementary teacher models a familiar and effective
    questioning strategy but then suggests that nobody in his circle believes that
    second graders can do work at this level.
  • Among
    the panelists, the principal of the new Providence charter school was most
    grounded in reality. She admitted that while they were on a strong upward curve,
    test scores were still mediocre. Asked how they deal with discipline, she said
    that students were put on a “three strikes and out” contract—if they couldn’t
    abide by the rules, they held a conference with parents to decide if the child
    was a “good fit” for Providence. According to the principal, every child, even
    kindergarteners, has a grade point average (another murmur of approval from the
    audience). Nobody asked about parents who never bothered to come to school, the
    advisability of a five-year old having a GPA before he understands cumulative
    averaging, or where the kid who is not a good fit ends up.
  • There
    was a kind of professional pep rally atmosphere. The panel moderator took
    questions from people who seemed pre-selected, often acknowledging the “great
    work” Joe was doing or the “outstanding leadership” of Mary. There was an angry
    question on why charter schools get less money than public schools, on average,
    from the public coffers. Reginald Turner, the State Board member, clarified:
    charter schools get the same per-pupil allowance as other public schools in the
    surrounding area. And guess what? There aren’t many charter schools in Grosse
    Pointe, where the funding level is high; charter schools are generally found
    where there is dissatisfaction with public education and not much money. And
    they get the same public monies as the other schools nearby—you might even call
    that equitable.
  • When
    asked what Detroit could do as a first step to fix its failing public school,
    the business folks agreed: get new teachers, preferably from Teach for America
    (which one panelist described as “the Peace Corps of teaching,” an unfortunate
    metaphor in a city trying to pull itself out of devastating depression). A
    woman asked what special training Teach for America corps members got that
    would make them particularly effective in Detroit. The panelist replied that it
    wasn’t a matter of training—it was a chance to get “graduates of the top
    colleges” into the classroom.

If you believe U.S. News and World
Report, two of the top twenty Schools of Education are right here in Michigan,
including the long-running #1 in Elementary and Secondary teacher preparation,
Michigan State University, and the #4 public university in the country, the
University of Michigan. There is also a strong network of regional teacher
preparation programs. There is no shortage of highly qualified and skilled teachers
here in Michigan.

Michigan is a teacher-exporting state.
About three-quarters of our best and brightest would-be teachers go to work in
other states (when they can get jobs). Of those who remain in Michigan, a
significant segment gets jobs in newly formed charter schools—because there are
no jobs in public schools. The best new teachers in Michigan? They’re the folks
who went streaming out the door to grab a beer with their teaching colleagues
as I was parking my car.

When
it comes to evaluating charter schools, the key question is always: Compared to
what? Charter schools in Detroit have many potential resources that public schools
do not, beginning with positive public assumptions and PR.

Charter
World is an interesting place, with different beliefs, incentives and catch
phrases than Public School World. It would be a shame to lose the opportunity
to do something truly different with charter schools, relying instead on rhetorical
flourishes and empty myths.

 At
10:38 this morning, I got an e-message from a mildly progressive group that
sends me regular (requested) e-mails on political and economic issues. The
subject line: Reality Check on Health Care Lies. At 11:01 a.m. this morning I
got a message from one of the women in my virtual book group. Subject line:
Information on the Obama Death Plan.

Now--I
like the women in this book group. I share lots of personal information with
them--my feelings on literary themes, love and life. I respect them. And I can
only assume that the woman who sent the "death plan" forward
(which--to make matters worse--came from her shady-pants congressman) has
strong feelings on retaining her health care. I respect those too.  

While
I was staring at the flat-out falsehoods and phony bogeymen on my screen, and
wondering how much money Big Pharma and Big Insurance are ponying up to
preserve their dominance in perpetuity, another book club member took a deep
breath and hit "reply to all." Hey, she said. This is too important!
We have to get health care right--and we're not going to do it unless a little
civility and rationality can be injected into the discussion.

By
12:01, Book Club Member #2 had been both warmly supported and excoriated
(sample: You obviously live in the
Twilight Zone, you freak
), and the hostilities had enlarged to include a
rundown of the negative impact of Equal Rights Amendment  on school sports (yeah--I know--it never
actually passed--but when you're on a roll, why stop for the facts...). 

So--whom
do you trust?

For
me, that's the critical question on all of the issues alive and bubbling in the
Home of the Free. I have little faith in political parties--either of them, at
the moment--although individual political figures do inspire me to trust. As do
some education thinkers, non-profits, writers, scholars, friends.

At
12:47, I got a link to this blog, wherein the Eduflack wonders what happened to
raging dissent in education policy world. He dismisses certain parties who are speaking now  as chronic whiners (including dissatisfied
Chicago Public Schools parent groups)--and suggests that
people had better start pushing back against favored policy initiatives or they
"will have little ground to stand on
if they want to play 'I told you so' a year or two from now."

None
of this--attack now or lose your right to attack later?--strikes me as
productive talk, the kind of dialogue that might lead us to making better
decisions about education.

At
1:05 p.m., while eating my lunch, I noticed that Heather Wolpert-Gawron had
posted a new blog. Heather is a person whose viewpoints I do trust--not just
because she's a teacher (there are lots of untrustworthy teachers)--but because
she's smart and knows whereof she speaks, when it comes to schools and kids. A
quick clip from Heather's musings (prodded by an article in which Arne Duncan
says it's likely that the swine flu will impact school attendance and wouldn't
it be great if teachers would use this health crisis to inject innovative technology
into their instruction):

But once
again, schools are being put to the task of solving a problem that the other
elements have a hand in creating and solving. After all, families with no
healthcare and no childcare options continuously send their sick children to
school. And the government has never devoted enough funds to develop
deep-seated educational technology in our schools. Yet here we are, a la NCLB,
with a missive and no guidance or enough resources.

The
funny part about Arne Duncan's message? He trusts that teachers will try to do
the right thing for kids, come the great swine flu epidemic.

 It's 4:30, and I'm weary of reading angry e-mail.
I'm wondering whether a country where rugged individualism is celebrated above
other values--where "get them before they get you" is our modus
operandi--can ever elevate mutual benefits to the community over "me and
mine first." Another funny thing: trust in schools absolutely raises
student achievement
.  You know where they
did the critical research? Chicago.

“In schools characterized by high relational trust,
educators were more likely to experiment with new practices and work together
with parents and colleagues to advance improvements. As a result, these schools
were also more likely to demonstrate marked gains in student learning. In
contrast, schools with weak trust relations saw virtually no improvement in
their reading or mathematics scores."                  
Anthony Bryk &
Barbara Schneider


Image: seenyaRita, Flickr Creative Commons

For
the past six months, looking at the big picture in education policy has felt a
bit like this photograph, shared by Stories
from School
blogger Travis Wittwer. Wittwer and his family are avid bikers
(socially-conscious bikers, not Hells-Angels bikers), and his son Soren is a frequent
passenger in a Bakfiets (a Dutch-made bike adapted for kids and cargo). Soren's
handmade version of his Bakfiets is beyond charming. I stuck the shot on my
desktop, and every time I looked at it, I thought--this is what we do with
schools. Every time things look shaky in education policy, we just add more
masking tape (and rhetoric) and keep smiling.

But...

Is
it just me--or is there a subtle shift in the education policy wind? Nothing
like a sea change, yet--more like ripples on the surface, a tiny drift in
course.

Item:
Jay Mathews opens a column with the following: If the No Child Left Behind law, focused on raising test scores, proves
to be a dead end, what do we do next? Why do those of us who care about schools
keep bickering over the current system, rather than expand the debate to
realistic alternatives?

Item:
Linda Darling-Hammond writes: Why don't
people demand an excellent teacher in every classroom? We have behaved for a
very long time as if that is not something to be expected, in contrast to
high-achieving nations that have put in place an infrastructure for producing
high-quality teaching.
She then goes on to outline precisely how America
could, in fact, create that infrastructure. Here's the best part--the article
appeared in the very heartlandish Des Moines Register.

Item: Alexander Russo asks: What current
beliefs about schools and education do you think will no longer dominate, say,
a generation from now?  Education mandatory for 12 years? Student learning
organized by chronological age? Government grants only for higher education?
Schools organized and funded by obscure geographic entities (districts)?
(It's
well worth following this link back to Reddit to see which current beliefs web-riders
think will be embarrassingly outdated in a generation.)

Item:
Today, in the Washington Post, Marc Tucker, Ray Marshall and William Brock propose
a National World Class Schools Act, ten interdependent and aligned proposals
that, taken together, form a coherent, systemic school reform package that
might actually do what NCLB was supposed to: seriously address the achievement gap,
and use economic incentives in smart, non-punitive ways to cultivate educational
improvement for every child in America.

I. Set higher standards
for licensing teachers. Recruit purposefully from only the top tier of college
graduates. Raise teachers' pay significantly, and use financial bonuses to
build teacher capacity in hard-to-staff schools.

II. Get the brightest
students to pursue teaching. Treat teachers like professionals, not blue-collar
workers. Put teachers in charge of their schools.

III. Reward schools
that exceed expectations, with a bonus representing 10% of their budget. The
faculty decides how to spend the money. Forget paying individual teachers for
increased test scores, as the measurements are suspect, and team spirit is more
important in building a good school.

IV. Take over every
school or district that cannot meet the following standard: three-quarters of
the schools in the district are able to get 90 % of their students
college-ready. Void all employee contracts in these schools.

V.  Fix the way we measure student performance. Dump
current statewide assessments, and replace them with examinations based on rigorous
course content. Using cheap, multiple-choice, computer-scored tests does not lead
to applied knowledge, imagination or innovation.

VI.  Let parents choose which public schools their
children attend. Information on student and school performance should be easily
accessible to parents, students and teachers.

VII. Help every
school whose students are not successful. Most struggling schools don't know what
to do to improve. The federal government can provide proven training and
assistance.

VIII. Limit differences
in state-provided per-pupil funding to 5 percent, between schools (with the
exception of expenditures for students with disabilities).

IX. Offer a selection
of social and health services to low-income children, coordinated with school
facilities and programs.

X. Begin dropout
prevention early, with high-quality early-childhood education for all
4-year-olds and all low-income 3-year-olds.

I opened the
"World Class Schools" piece this morning prepared for more of the
same blah-blah dominating the edusphere lately: the seduction of data analysis,
the appeal of paternalism, the necessity of accountability and sanctions, the
laziness of teachers--and let's standardize everything in sight.

But
no. I recognized--again--the stirring of hope (an audacious feeling). Maybe
we can solve these problems in a generation. Maybe the paradigm is shifting--or
lifting.

The
last word really should go to Brock, Marshall & Tucker:

We have the most unequal distribution of income of any
industrialized nation. If the problems posed by students' poverty are not dealt
with, it may be nearly impossible for schools to educate the students to
world-class standards.

Amen. And thanks,
Soren, for the wonderful pictures!

Over
at Flypaper, Mike Petrilli is all excited about the seminar Fordham sponsored
today--especially the fact that at the conclusion of the program, a majority of
people in the audience raised their hands when asked if they thought we would
have a system of national standards in five years. This reminded me of Catholic
grade-school stories my husband tells, wherein Father Flanagan visits the 3rd
grade classroom to urge children to consider a life as a priest or nun. Who
wants to become a priest? Raise your hands--keeping in mind that it's the
highest possible goal you can have, kids. A quick look at the list of
presenters and panelists will tell you that using this hand-raising thing as a
poll would present some, um, sampling errors.

Not
that I'm opposed to national standards, as long as they are structured as voluntary
curriculum frameworks and benchmarks. Sequencing important content to keep
students following the same general path is a good idea. But--let's look at the
reasons Petrilli's turning cartwheels over the prospect:

There
are innumerable reasons that national standards and tests would be better for
the country than the fifty state patchwork we have today
(numbers added by
TIASL):

#1)
greater comparability of schools across state lines

#2)
the opportunity to aim much higher than most states do 

#3)
the potential that it could create a national marketplace for instructional
materials, professional development, and teacher preparation, and on and on.

#4)
the leaders of the common standards initiative are interested in getting to
common tests—and to use these standards and tests to drive instructional change
at the classroom level.

So--notice
anything missing in this list of reasons to endorse national standards? To whom
do benefits, control and power flow in Petrilli's vision? Well--data analysts,
commercial education publishers, test developers and those who would re-shape
instruction and teacher preparation, or sell professional development. I don't
see anything about direct advantages for students, especially those in challenging
contexts. "Aiming higher" is something that can be done--and is done,
every day--in individual schools and classrooms, driven by goal-oriented
teachers and school leaders. And just how "high" is high enough to
honor top-scoring states, while leaving no state behind? Speaking of "comparability,"
every data lover's #1 goal.

Not
that Petrilli is overly sanguine:

What’s
the process for making decisions about what the common standards will entail?
With the NGA and CCSSO leading an ad-hoc group of “partners” (including
Achieve, ACT, and the College Board), it remains unclear who, at the end of the
day, will make judgments about the scope of the standards themselves. If these
folks think that they will find a way to avoid the math wars and the reading
wars, or the content vs. 21st Century Skills debate, they are kidding
themselves. I also fear that they don’t yet have a process in place that will
successfully adjudicate these pressures and come out with a solid product.

I'm
guessing that Petrilli could give them a short list of who should be
"adjudicating" these thorny issues to develop a solid product that
would please the NGA and CCSSO (politicians all) and Achieve, ACT and the College
Board (developers and monitors of standardized tests).  I'm wondering: might they need any other
partners or input, to make this expensive national initiative pay off for students and teachers?

                                                                                                                                                Remember
transactional analysis? "I'm OK--You're OK" (or not, as the case may be)?

When
this newsy little tidbit popped up in Blogworld last week, I figured it would
be just a matter of hours until the usual blog suspects trotted out a
full-scale assault on any researcher (in this case, Geoffrey Cohen of
CU-Boulder) daring to suggest that kids perform better when given simple tools by
their teachers to re-affirm their competence:

If
a student starts off the year feeling more stress due to negative stereotypes,
and then performs poorly during the first few weeks of school, this can
establish a downward cycle of increasing stress and poor performance that is
hard to break. The self-affirmation exercise, by reminding students about what
is really important to them, could help reduce that stress, the researchers
suggest.

Like
TA, Values Clarification and polyester Saturday shirts, self-esteem as a
workable premise for improving student learning is seriously out of fashion
these days. Mostly, we see articles like "Are We Good-Jobbing Our Kids to
Pieces?"
--followed by 186 comments from people who are convinced that
while they're OK, other people's children have been given way too much empty
praise causing their egos to blow up like fraudulent balloons. Use the word
"self-esteem" in any educational context, and you're likely to be hit
with a barrage of low-information platitudes about grade inflation, college
admissions based on the wrong stuff, and our miserable international test-score
standings.

The
concept of self-esteem is pretty squishy, involving considerable latitude of opinion
around ego health and evaluating achievement, when you deconstruct it.
Policymakers who believe that American kids are wallowing in unsubstantiated self-esteem
still believe it's a good idea to pay them for grades and test scores. Coaches
who declare that it's good for kids to lose occasionally still schedule extra practices
on Sunday mornings to prevent that from happening. We idolize Susan Boyle, the
modest, mousy Scottish lady who apparently kept her singing talents hidden for
50 years--but we don't want our children to be silenced by their own personal
Simon Cowell when they subject their early work products to scrutiny. That's
why refrigerator magnets were invented.

Every
first-rate classroom teacher understands the paradox here: you have to have a
base of self-esteem to withstand and benefit from honest and productive
criticism of your own work.  And
sometimes, kids come to school with very little sense of their own worth. The
research on self-esteem and social learning is pretty consistent: you need to
feel OK in order to learn effectively.

There
is also plenty of research showing that people running successful drug rings
and beating up their spouses have high self-esteem
.  Teachers don't want to be nurturing the next
generation of narcissists. Self-esteem
in isolation can become a psychological defense for anti-community behaviors.
One of the most chilling and sordid examples of this was the HS athletes in
Glen Ridge, New Jersey, who raped a mildly retarded 8-year old girl with a
baseball bat, detailed in Our Guys by Bernard Lefkowitz. Plenty of self-esteem
there--plus a healthy dose of disgusting entitlement.

Most
of the people railing against the excess of self-esteem in American schools
aren't thinking about our national adulation of sports heroes or entertainers.
They're pushing to keep "standards" in place--to hold teachers and
students accountable, to increase rigor, to raise the bar--plus a couple dozen
other academic clichés.  If students feel
too good about themselves and their work, the reasoning goes, they will not see
a need to try harder to compete against our economic competitors. The problem
with this get-tough rhetoric is that students won't produce more if they feel
bad about themselves, either. It's a balancing act between sincere encouragement
and honest critique. And it happens in the classroom, not in Policy World.

Continuing
the conversation on testing, with Marjorie Larner:

[Marjorie]
As I walk the hallways and observe in classrooms in schools across our country,
I wonder what we as a nation envision as an outcome for the students spending
their time learning how to take tests.  Often,
the generic test preparation instruction doesn’t lead to success on the test,
but schools are hedging bets by doing it anyway.  What are we preparing our students to be and
do?

[Teacher
in a Strange Land] I made a big pitch in the last blog about the usefulness of curriculum-linked
tests as one valid form of assessment--but deliberately training children how
to outsmart standard testing  protocols is,
to put it bluntly, despicable teaching.  

The
underlying message to kids, especially young kids taking their first
high-stakes tests? It doesn't matter what things you know for sure, or which
skills you can demonstrate. Instead, here are some tricks to help you pump up
your test numbers. Your teachers insist that your learning will help you as an
adult, but then they spend time on things you'll never experience in real life
(filling in bubbles, speed-writing to mystery prompts under a strict time
limit). Schools hold test-prep rallies,
and send home letters reminding mom to tuck you into bed early, and feed you a
hot breakfast on test day.  Because at
the moment, they care more about those numbers than about your strengths, your
anxieties--or the rest of your life.

[Marjorie]
 I wish we could reach clear consensus
about criteria for determining who is a "bad teacher," and what we
see as a "failed school," or “struggling student.”  Why can't we be honest about where we stand as
a nation in regard to every child’s learning?

[Teacher
in a Strange Land] I have spent the last month reading portfolios and watching
videotaped lessons from National Board Certification candidates--teachers who
take a professional risk and ask an outsider to watch them teach, then read
their rationales for teaching decisions and self-critiques. They
are requesting
comments and feedback. This takes a certain amount of courage, a willingness to
be challenged on ingrained practices and beliefs. I've watched lots of teachers
working in high-needs schools--districts where achievement data is dismal, and an
entire school might be considered "failing."

I've
seen lots of students struggling. What I haven't observed is bad teachers. I've
seen teachers who do not have success with every child, but keep trying new
strategies. I've watched teachers steer a lesson into different territory when an
opportunity presented itself, later admitting that their original learning goals
were not achieved, although useful knowledge was acquired. I've read analyses
of what teachers glean from student discussions, written responses,
problem-solving, projects linking skills and applied knowledge--and tests. But
I haven't seen a teacher who has missed the boat entirely--whose content knowledge
is shaky, who is blithely teaching away with no visible results, who cannot
identify weaknesses in her own teaching. I know bad teachers are out there--but
they aren't signing up for self-assessment. So maybe we need to develop better assessments of their work, beyond the inadequate means of matching them to their students' scores.

Teachers
pursuing board certification are certainly more ambitious and confident than the
norm (although fewer than half of them certify on their first try). But it
strikes me that measuring teachers' effectiveness by watching them teach to
state or district goals, then asking them to analyze choices they made to
advance learning, is more likely to improve teaching in the process of weeding
out bad teachers.  

We
need a national conversation on the goals we want teachers to pursue
relentlessly, our preferred choices. And we need new voices in that dialogue,
including the people who are most affected. What is a teacher's primary goal? 

[Marjorie,
optimistically] We are inching closer to finding a way to make our case that we
need a bigger vision of achievement and success than is possible to assess
through these standardized tests.

[Teacher
in a Strange Land, trying to adopt Marjorie's optimism]  We're lying to our students, when we tell them
that high scores are a critical mark of personal achievement. Raising test
scores is a small, unimaginative goal; it's also cheap and easily quantifiable.
Constructing standardized tests, interpreting and manipulating test data are
specialized skills--and we have now given the power of defining and measuring
important learning to people removed from our classrooms, who stand to make a
profit from our quest for more data.

I
want to believe in that expanded vision of success, too, Marjorie. My vision
includes deeper and more challenging applied content; free, year-round academic
enrichment activities for students across the range of abilities; a national
belief in learning as the tool for success (rather than credentials or scores);
and a clear commitment to providing more human resources for kids at the bottom
of the gap.

 I
really appreciate what Marjorie Larner wrote in the previous blog. Deciding
what to measure without first establishing a set of outcomes and aims is
lunacy. When you cede power to standardized test creators to determine what all
students should know, you give away a lot of other things that are central and
valuable in the education process. 
Teacher judgment and discretion, for example. Learning goals should be
set in the district and classroom, not in Washington D.C., and certainly not by
a commercial test developer.

There
are really only two things that standardized test data can tell us. The first
is what kids reliably
know and are able to do, relative to a selected set of
skills and knowledge. The second is how one child--or one school, state, or
nation--compares to another. 

The
first reason for testing is, IMHO, a no-brainer. It doesn't hurt students to
take the occasional test, especially if there is no manufactured anxiety around
the process. A good test should tell everyone involved what to do next, what's
been mastered, and where the weak spots are--useful information. Every teacher
in America should be able to construct valid tests that accurately measure what
their students are learning. And every teacher should be skilled in analyzing
the information generated by standardized tests linked to curricular goals--and
using those statistics to determine next steps. 

It
drives me crazy when teachers push up the panic and aversion level around
testing. I am a staunch advocate of performance-based assessments and using
real student work to measure growth--but I also understand that often, a criterion-referenced
test is the most efficient way to find out what students know.

Unfortunately,
your average citizen--let's call him Joe the Talker--is clueless about the difference
between tests that measure the things we have decided are essential knowledge
and skills, and the norm-referenced tests designed to sort kids into quintiles,
prescribe their futures, or compare students in the Mississippi Delta to
students in Singapore. If Joe understood how testing worked (and who really benefits
from developing stockpiles of standardized tests, and vast banks of data on
young children), he might be more willing to care more about what his kids have
learned and less worried about whether the United States is "ahead"
of the Czech Republic on the PISA. Here's an unnamed Joe, speaking his mind on
international testing, in an HBO "Real Time" Forum:

How many of those
countries ranked higher than the US use test scores on students to direct them
in to different programs?
 Seems
that a few of us in here have already stated that they should use the test
scores to realize which kids they should educate and which kids they should
give job training to. Throwing more money at a poor scoring student seems like
a waste, put more money in to the better performing students education and
train those poorer performing students to do something else. You can take my
gun after I empty the clip into you.

I
have never understood the devotion of policymakers, economic analysts and
journalists to comparing  international
test data as rationale for launching massive school reforms in the United
States.  We clearly are not in a cutthroat
economic rivalry with Finland. And it must be obvious to anyone (even Joe) that
schools in other countries are incalculably different from American
schools--their size, demographics, curriculum, annual days of schooling, teacher
preparation, funding, and cultural emphasis on the importance of education,
including who actually gets to go to school.  It's equally obvious that Americans have no
intention of adopting "reform" practices from higher-scoring
nations--we're not about to add five weeks to the school year, eliminate expensive
competitive sports programs in favor of cram-school tutoring, or wait until
kids are seven years old before teaching them to read.  

Instead,
we use international testing as a rhetorical bludgeon--proof that our schools
are dreadful and we're falling further behind. "Public schools are incompetent"
has become our conventional wisdom over the past decade. The worst aspects of
this sad refrain: #1) it's not really true and #2) it makes people feel
hopeless about a system that could be greatly improved, should we decide as a
nation to invest, rather than score political points in the media.

A
must-read article on international testing, by Hal Salzman and Lindsay Lowell,
in Nature, makes several cogent points:

  • Average
    test scores are irrelevant; what matters most in economic development and
    innovation is the numbers of highest-scoring students, and the United States
    has by far the greatest share of those, nearly twice as many as second-place
    Japan.
  • National
    rankings are based on statistically insignificant differences. When nations are
    clustered into similar groups, the United States falls into a middle group in
    Math and Science, and in the highest group in Civics. Generally speaking, about
    one-fifth of nations rank above the United States, and two-fifths below.
  • Comparisons
    of education as economic indicator between the United States, with a gross
    domestic product of $14 trillion, and nations like New Zealand, with a GDP of
    $124 billion, are meaningless. It makes more sense to consider individual state
    economies and industries as competitors with countries whose students take
    international tests.
  •  Historically,
    creating policies to emphasize math and science instruction and increase the
    numbers of technology and engineering graduates has led to an oversupply and high
    unemployment in those fields. We appear to be heading in that direction at the
    moment.
  •  The
    disaster that we should be paying attention to is the one million
    low-performing students we produce every year. These students do more than drag
    down our average. They represent the dangerous gap between educational haves
    and have-nots. 

And
if we don't believe that gaping disparity between the successful and the
disadvantaged is socially treacherous, we ought to be reading history--or
watching the protests at the G-20 Summit.

From
the estimable Deborah Meier, in Bridging Differences, best education blog on the planet:

The tendency to fit our facts to our biases
is inescapably part of our competition with each other. I suspect there’s a
purpose in this constant reiteration of bleak facts and non-facts. (Otherwise,
why is there no cheering over our incontrovertible high international test
score standing in literacy, or why is the NAEP data on pre- and post-NCLB so
rarely made public?) Hopefully, during the coming four years...we can see
“reform” as something beside a horse race or marketplace with winners and
losers.

This blog--the first in a series on testing--is written by guest blogger and Teacher Leaders Network member Marjorie Larner, an instructional coach and facilitator in Colorado.

"Now that the Data Quality Campaign has put
data quality on the map, we need to work together to leverage this work and
push it to the next level by using data to drive reform.
The path to real reform begins with the
truth - and we must keep facing the truth and finding the answers until
every classroom has a great teacher, and every child has an education that
prepares him for college, for work, and for life."
 Secretary of Education Arne Duncan, Data
Quality Campaign Forum
.

What is Secretary Duncan using as the basis
for this truth he says we must face? What does he
think constitutes data that
is evidence of the truth about
education to prepare children for college, work and life? We have been immersed
in data-driven instruction and decision-making. Some schools are now wholly devoted
to producing good data, defined by standardized test scores. Students’ success
or failure depends on test performance, with perhaps a nod to graduation or
attendance rates. Secretary Duncan calls for "data driven school reform"--while
President Obama acknowledges that using standardized test scores as the measure
of good or bad teaching creates other problems.

These kinds of public statements demand a
definition of specific outcomes aligned with instruments that gather valid,
reliable and relevant data--all  kinds of
evidence of student progress toward agreed-upon outcomes. Those of us working
in the field now have an opportunity to offer advice and ideas based on our
real work experience--because as of this moment, we are still committed to standardized
tests.

Here's a story about a school I worked in
many years ago. Their test scores were very high. One year, all 3rd graders got
a perfect score in reading, but the numbers for writing were weaker. In the
following years, the district used this information to launch a required
school-wide focus on writing. We gave the kids the message that they were weak
in writing, and needed to improve.  We also
paid for a few released test items ($7 for one student’s response to one item),
to analyze these weaknesses. We realized that the students were all proficient
and advanced on the actual writing samples. It was the multiple-choice
questions, where they had to choose an answer with no context, where they lost
points. What did this tell us about the data we had used to “drive” our
instruction for several years? They knew how to apply the rules to actual
writing, but their actual “weakness” was choosing between tricky
multiple-choice answers on isolated rules for writing. Should we spend less
time teaching them to be writers, in order to work on testing strategies for multiple
choice? Should we drill them on memorizing the rules? What would this do for
them, in their lives as writers? What effect would this kind of teaching have
on their skills and motivation for real writing?

I have now been working for two years in a
school that is based on a big vision for every students' active participation
and positive contribution in the 21st century world. Measures on standardized
tests are inadequate to assess the internalized habits, dispositions, skills
and knowledge that we see our students developing: capacity for leadership,
creativity in overcoming constraints, active willingness to help others, issue
analysis using multiple perspectives, belief in their own responsibility and
agency, ability to build a case or analyze another's argument. It is not easy
or simple, nor could it be standardized to hold teachers and students who were
not committed to this particular vision "accountable."

But I have seen students challenged and
inspired to work hard, investigate, create, strive for greatness in all
subjects--and still not consistently score well on a test.  I feel a very deep responsibility for these
children’s growth and well-being. After ten years of accepting accountability
for test scores, with increasingly narrowed results for kids, I now feel passionate
about communicating the truth of what it means for our students’ future
prospects if we continue to rely on standardized tests as the measure and
definition of success. We need to learn from our experiences with the limits of
standardized tests. We must develop strong alternatives for gathering evidence
of progress, aligned with a clear vision of who our students will become, what
they need to know and be able to do as a result of their years in school. 

 As an educator with a background in
qualitative assessment, it breaks my heart to see children’s
abilities and
potential reduced to test scores, their days in schools reduced to test
preparation, teaching reduced to scripted lessons and canned curricula. The
truth about data? I'm frustrated, and it's not because I do not believe in
accountability, rigor or quality teaching-- but precisely because I do.

Image: TEST/Sidelong/Creative Commons

Syndicate content