Description
This presentation explain leading indicators of school turnarounds.
How to Know When
Dramatic Change
Is On Track
leading indicators of
school turnarounds
by Julie Kowal and
Joe Ableidinger
About the Authors
Julie Kowal is a senior consultant with Public Impact.
She consults and leads teams to ofer research-based guid-
ance on several challenging policy and management issues
in education, including teacher quality, evaluation, reten-
tion, and compensation; and dramatic change in persis-
tently underperforming schools. Ms. Kowal recently led
Public Impact’s involvement in several applications for the
federal Race to the Top and Investing in Innovation com-
petitions. An alumna of AmeriCorps NCCC and Public
Allies DC, Ms. Kowal earned her law degree with honors
from the University of North Carolina at Chapel Hill.
Joe Ableidinger is a consultant with Public Impact.
His work focuses on a variety of education policy issues,
including emerging technologies in education, teacher and
leader policy, and charter schools. Before joining Public
Impact, Mr. Ableidinger taught high school English with
the Fulbright Program in Korea and started a family re-
source center at an underperforming elementary school
as an AmeriCorps VISTA Volunteer. Mr. Ableidinger
received his B.A. with highest honors from Duke Univer-
sity, his master’s in public administration from the John
F. Kennedy School of Government at Harvard University,
and his law degree with honors from Harvard Law School.
Acknowledgements
This report was made possible by the support of the
University of Virginia’s Darden/Curry Partnership for
Leaders in Education and its School Turnaround Special-
ist Program. The authors are grateful to Jef Kutash of
FSG, Emily Pallin of Mass Insight Education, and Eileen
Reed of ERS Consulting for their thoughtful reviews
and insights. We are also indebted to Bryan Hassel and
Emily Ayscue Hassel for their editing, and to Jacob Rosch
of Public Impact for his research assistance. Finally, we
would like to thank Sharon Kebschull Barrett for careful
editing, and April Leidig-Higgins for the design of the
report.
Leading Indicators of School Turnarounds: How to Know
When Dramatic Change Is On Track was made possible by
the support of
© 2011 Public Impact, Chapel Hill, NC
© 2011 University of Virginia’s Darden/Curry Partnership
for Leaders in Education, Charlottesville, VA
Public Impact is a national education policy and manage-
ment consulting frm based in Chapel Hill, NC. We are a
team of researchers, thought leaders, tool-builders, and on-
the-ground consultants who help education leaders and
policymakers improve student learning in K–12 education.
For more on Public Impact and our research, please visit:
www.publicimpact.com.
Public Impact encourages the free use, reproduction, and
distribution of this working paper for noncommercial use.
We require attribution for all use. For more information
and instructions on the commercial use of our materials,
please contact us at www.publicimpact.com.
Please cite this report as:
Kowal, J., & Ableidinger, J. (Public Impact). (2011). Lead-
ing indicators of school turnarounds: How to know when
dramatic change is on track. Charlottesville: University
of Virginia’s Darden/Curry Partnership for Leaders in
Education. Retrieved from www.DardenCurry.org
• 1
Executive Summary
I
n recent years, national policymakers have
placed new emphasis on “school turnarounds”
as a strategy for rapid, dramatic improvement
in chronically failing schools, calling on educa-
tion leaders to turn around performance in the 5,000
lowest-achieving schools nationwide. This goal may
seem daunting, given the dismal success rates of school
improvement eforts of past years. Indeed, even outside
education — in for-proft businesses, nonproft organi-
zations and government agencies — bad-to-great turn-
around and “major change” eforts succeed only about
30 percent of the time.
Given these odds, the success of the turnaround
strategy in education will depend largely on the speed
with which districts and leaders spot schools that are
of-track and quickly redirect major change. Leading
indicators are the early signs that leaders outside edu-
cation use regularly to determine whether an organiza-
tion is on the right track or destined to fail. In school
turnarounds, leading indicators can provide early evi-
dence about whether a school is on track — and if not,
how to intervene to increase the odds of success.
In this report, we summarize the research and
experience from other settings — including venture
capital, franchising, and research and development in
industries such as pharmaceuticals — in which leaders
have long relied on leading indicators to enhance the
likelihood of success. From these lessons, we identify
key principles and processes to guide the design and use
of leading indicators in education. By critically examin-
ing systems in other sectors, and analyzing potential
lessons for school turnarounds, education leaders can
bring the benefts of leading indicators to bear where it
is not simply dollars but students’ futures at stake.
In other sectors, organization leaders identify a set
of starting leading indicators based on known success
factors in the industry and the nature of the venture
being monitored; zealously monitor those indicators
for signs of impending success or failure; and then act
on what the indicators reveal, using data to target as-
sistance, modify investments, or redirect their focus.
What Principles Should Guide Selection
of Leading Indicators?
A group of core principles guides the selection of lead-
ing indicators in other sectors, where indicators are:
• Based on known success factors in similar set-
tings. Investors and organization leaders choose
indicators based on factors that have been shown
to contribute to organizational success in the past.
2 • le adi ng i ndi cators of school tur narounds
Indicators may be grounded in rigorous research,
specifc past experiences, or standard practice in a
given feld.
• Constantly evolving to predict success at each
stage. Successful organizations continually reassess
and redefne individual indicators at each stage of an
efort, and over time across all eforts, ensuring that
each indicator they use can predict success.
• Tailored to specifc circumstances and settings.
Leading indicators are fnely tailored based on in-
dustry-, market-, and situation-specifc predictors
of success. Initial sets of indicators, ofen selected
before an efort begins, form the basis for ongoing
monitoring and evaluation.
• Based on specifc timetables. Organization lead-
ers in other sectors pay careful attention to when
progress is made. Timing is especially crucial for
achieving progress on certain key indicators, which
may have a domino efect on progress on other key
indicators and long-term outcomes.
How Should Schools and Districts Monitor
Leading Indicators?
Afer selecting a set of leading indicators, organizations
in other sectors monitor progress rigorously, setting
guideposts and using indicators to analyze prospects
for long-term performance. In these other sectors,
monitoring is:
• Frequent and ongoing. Monitors — including
venture capitalists, franchisors, and R&D manag-
ers — examine progress in their ventures frequently
and on an ongoing basis. While some indicators may
be designed for only annual or semiannual review,
several are designed to allow much more frequent
monitoring, such as quarterly, monthly, weekly, or
even daily in some cases.
• Hands-on. Monitors are typically intimately in-
volved in the operations of the organizations they
monitor, such as by consulting with leaders on key
decisions, conducting frequent site visits, engaging
in regular communications, serving on boards, and
recruiting members of the management team.
• Tailored to needs and current circumstances.
Monitors tailor their approaches over time based
on information they receive about an organization’s
success and future prospects. They ofen increase
or decrease their monitoring or their level of invest-
ment over time in response to what leading indica-
tors reveal.
How Should Schools and Districts Put
Leading Indicators to Use?
Organizations in other sectors use what they learn
through leading indicators to make strategic decisions
that alter operations and dramatically improve out-
comes. Their actions take many forms, but generally
fall into one of two broad categories:
• Intervention, from targeted assistance to major
change. Signs of impending failure may trigger in-
tense assistance, increased involvement by investors
and monitors in key decisions, or a release of the
investment entirely.
• Increased autonomy or other reward. Early, dra-
matic success as shown by leading indicators may
prompt organizations to decrease the intensity of
their oversight. Positive initial results may also serve
as “green lights,” allowing projects to continue or
even triggering increased investment.
Key Actions for State and District Leaders
The principles and strategies that other sectors use in
developing, monitoring, and acting upon leading indica-
tors provide important guidance for district leaders, state
departments of education, and other partners as they
embark on and monitor school turnarounds. By collect-
ing and acting upon the information provided by lead-
ing indicators, education leaders will be able to intervene
rapidly to increase cumulative success rates over time.
On page 13 (Table 1), we present suggestions for district,
state, and other education leaders to identify leading
indicators for their own turnaround schools. Table 2 on
page 17 sets out a proposed timetable to guide tracking
of leading indicators in turnaround schools.
le adi ng i ndi cators of school tur narounds • 3
As they consider these recommendations and design
and implement their own systems of leading indicators
in turnaround schools, education leaders can build on
the experience base in other sectors by:
1. Starting with known success factors. In turn-
around schools, this includes the competencies of
the turnaround leader, the leader’s actions, steps
that all staf members take to achieve goals ac-
cording to plan, and common routines that must
improve in any school seeking learning gains.
2. Monitoring turnaround schools frequently
and intimately. Most districts and states need to
monitor turnaround schools much more ofen
than they do, collecting and analyzing data on a
monthly or quarterly basis. Monitoring should
also involve hands-on, active engagement such
as weekly site visits and collaboration by district,
state, or partner staf.
3. Acting on early indicators of success or failure.
Where leading indicators show that an efort is
not on track, states and districts must be will-
ing to provide targeted intervention and, if that
fails, pursue dramatic change. Early indicators
of success in turnaround schools might prompt
decreased monitoring, performance rewards, or
opportunities for highly capable leaders to extend
their reach to more students. Early indicators of
failure, on the other hand, should lead to targeted
assistance or a new attempt at major change.
4. Collecting mountains of data, and narrowing
to the most predictive over time. Because success
factors in school turnarounds are just beginning
to be understood, district and state leaders should
begin with expansive data collection on numer-
ous possible leading indicators, and narrow the
list over time to those indicators that have the
strongest and most persistent connections to stu-
dent success.
• 5
Introduction
I
n too many schools across the country, we
fail to equip our students with the skills they need
to succeed in college, work, and life. In elementary
and middle school, far too few students receive
the basic foundation necessary to prepare them for
the demands of high school. Nationwide, profciency
rates among elementary and middle school students in
reading and math hover between 20 and 50 percent.1
Of the students who make it to high school, too many
fail to graduate: one in 10 American high schools lose
more than 40 percent of their students between ninth
and 12th grades.2 Students who do graduate from high
school ofen leave without the necessary skills to thrive
in college or the workforce: more than one-third of all
college students require remedial courses to acquire
basic skills, and minority and low-income students are
even more likely to need remediation.3
These national and state averages mask signifcant
diferences in the quality of education provided to stu-
dents in individual districts and schools. An enormous
number of students are trapped in persistently low-
achieving elementary and middle schools and “dropout
factory” high schools, which serve high proportions of
students failing to meet state standards year afer year.4
Even though the number of such schools has decreased
in recent years, the rate of progress is far too slow to
meet national goals for high school graduation and
postsecondary education.5
Our nation has struggled for decades to solve the
intractable problem of dramatically improving these
chronically failing schools. Although there are noted
exceptions, the vast majority of the lowest performing
schools have not changed course, either because they
have received insufcient support or they have tried
weak or only piecemeal interventions.
In response to a heightened awareness nationally
about the consequences of our persistently low-achiev-
ing schools, policymakers have increasingly focused
their eforts on “turnarounds,” one strategy for rapid,
dramatic improvement typically led by a new principal
with a new or newly empowered staf.6 Today, this ap-
proach is central to federal education policy and to
reform eforts in many states and districts, with specifc
calls to turn around the 5,000 lowest achieving schools
nationwide.7
This goal may seem daunting, given the dismal suc-
cess rates of school improvement eforts of past years.
Even outside education — in for-proft businesses, non-
proft organizations and government agencies — bad-to-
great turnaround and “major change” eforts succeed
only about 30 percent of the time. If turnarounds are
more difcult in public education due to restrictive pol-
icies, talent shortages, and other constraints, the success
rate of school turnarounds may well be even lower, and
perhaps signifcantly lower.8
Does this mean the situation is hopeless? Are we
doomed to a success rate no better than 20 or 30
percent?
The answer depends on a critical variable: the speed
with which we “retry” change when our initial attempts
fall short.9 If we allow unsuccessful schools to languish
in improvement for fve years or more, our cumulative
success rate in turnarounds will indeed hover around
Policymakers are increasingly
focusing on “turnarounds” as a
strategy for rapid, dramatic
improvement in persistently
low-achieving schools.
6 • le adi ng i ndi cators of school tur narounds
20 or 30 percent, if that. But if we spot schools that are
of-track early and quickly redirect major change ef-
forts, we can do much better over time.
Even if only 30 percent of individual turnaround
attempts succeed, by redirecting turnaround eforts
in schools that are not on the right track we could
increase the cumulative success rate dramatically over
time.10
To retry major change more rapidly, though, leaders
need information about which turnaround eforts are
on a path to success or failure. In any major change ef-
fort, there are early signs — leading indicators — that
an organization is on the right track, or is doomed to
become a statistic. These early signs matter particularly
in the turnaround context, where dramatic improve-
ments rely in large part on changes and activities that
take place in the frst few weeks and months of the
efort.11 In education, we can make much better use of
leading indicators to diferentiate which turnaround
eforts are going well, and which require redirection.
With more and better information about successes and
failures early in the efort, district leaders, state depart-
ments of education, and other partners will be able to
take action in turnaround schools to increase cumula-
tive success rates over time. Although some evidence
suggests it can take three to fve years to see the full
impact of a successful turnaround efort, leading indica-
tors allow us to gauge, far earlier, which schools will
end up succeeding and which are destined for failure.
In this way, leading indicators empower education of-
cials with a strong basis for intervening in turnarounds
without waiting several years to examine results.
Lessons from Other Sectors about
Leading Indicators in Education
Most education leaders are not accustomed to think-
ing about, collecting, or using leading indicators in
meaningful ways. Improvement eforts in education
are typically designed to permit extended periods of
failure before leaders intervene with major change
(such as with a new leader, charter operator, or diferent
governance structure), even in schools where very few
students meet learning standards. Indeed, the current
iteration of the Elementary and Secondary Education
Act codifes six years of continued failure without
major improvement as an acceptable timeframe.12
The current federal administration has begun to
use the concept of leading indicators to track major
change eforts in schools, by requiring states and dis-
tricts that receive School Improvement Grant funds to
report data annually about a number of early factors
that may afect learning gains, including student atten-
dance, behavior, and school learning environments.13
But the development, use, and refnement of leading
indicators as a tool for enhancing the success of school
turnarounds-in-progress remain largely uncharted ter-
ritory. Fortunately, other sectors ofer strong lessons
for education as we move forward with the design and
implementation of systems and decision-making pro-
cesses tied to leading indicators. In the private sector,
organizations use leading indicators to intervene early
and forcefully to maximize returns on invested dollars.
Shouldn’t schools act just as decisively when children’s
futures hang in the balance?
In this report, we summarize the research and expe-
rience from other settings in which leaders have long
relied on leading indicators to enhance the likelihood
of success. These settings include venture capital, fran-
chising, and research and development in industries
such as pharmaceuticals.14 In these settings, organiza-
With more and better informa-
tion about successes and
failures early in turnaround
eforts, district leaders, state
departments of education, and
other partners will be able to
take action to increase schools’
cumulative success rates over
time.
le adi ng i ndi cators of school tur narounds • 7
tions have developed systems to use leading indicators
for making decisions that preserve time and money
and improve fnancial and sofer outcomes. We look
to these settings because they resemble turnarounds
in key respects: with new initiatives operating under
intense pressure, low probabilities of success, and much
at stake. In addition, while there is a limited research
base on school turnarounds and the use of leading indi-
cators in education, vast literature exists on the design
and use of leading indicators to inform key decisions
and improve outcomes in other public (non-education),
business, and nonproft organizations. Although the
indicators themselves can generally not be cut and
pasted into the school turnaround context, the prin-
ciples and processes used in other sectors provide critical
guidance for designing and using a unique set of indica-
tors in education.
8 • le adi ng i ndi cators of school tur narounds
Designing Leading Indicator
Systems for Turnaround
Schools
H
ow can we meaningfully integrate
leading indicators into education turn-
arounds? In other sectors, three general
steps shape the design and implementa-
tion of efective systems.
1. First, leaders identify a set of starting leading
indicators based on known success factors in
the industry and the nature of the venture being
monitored.
2. Second, they zealously monitor these indicators
for signs of impending success or failure.
3. Finally, they act on what the indicators reveal,
using data to target assistance, modify invest-
ments, or redirect focus.
In the following sections, we discuss each of these
steps in turn. For each, we examine the methods used
in other sectors and ofer initial thoughts about how
they might apply to turnarounds in education.
What Principles Should Guide Selection
of Leading Indicators?
A core set of principles guides the selection of lead-
ing indicators in other sectors. These principles can
provide crucial guidance for district and state leaders
to choose leading indicators for school turnarounds.
Leading indicators should be:
• based on known success factors in similar settings;
• constantly evolving to predict success at each stage;
• tailored to specifc circumstances and settings; and
• based on specifc timetables.15
In Table 1 on page 13, we build on the following fac-
tors known to contribute to successful turnarounds in
education, to present suggestions for district, state, and
other education leaders to identify leading indicators
for their own turnaround schools.
Leading indicator principle #1: Based on known
success factors.
Across a variety of industries, investors and organiza-
tion leaders choose leading indicators based on factors
that have been shown to contribute to organizational
success in the past. These factors may be backed by
rigorous research, be generally accepted in the feld, or
arise from the leader’s own previous experiences. No
matter the source, leaders have good reason to believe
that certain early factors will contribute to the success
of a new venture — whether a new investment, fran-
chise, or research initiative — and watch them to track
early progress. State, district, and other education lead-
ers can use these same types of success factors to track
progress in turnaround schools.
In other settings, research, time, and experience
have shown three primary factors — the characteristics
of the leader, the makeup of the management team, and
the organization’s connections with key players and
resources — to consistently predict the success or failure
of a new venture (see “Identifying Success Factors in
Other Industries”).
The education sector still has a lot to learn about
which factors matter most for successful school turn-
arounds. But an emerging research base, drawing
from experience in other sectors as well as successful
turnaround schools, is beginning to clarify several key
le adi ng i ndi cators of school tur narounds • 9
factors that are necessary for success. These fndings
are not dissimilar to the known success factors in low-
probability events from other sectors. They include the
skills, habits, and behaviors of turnaround leaders criti-
cal to their ability to turn the school around; the series
of actions that education leaders should be able to ob-
serve in the school if the turnaround is truly on track;
and the support and fexibility that the school leader
receives from the external environment, including the
district and/or the state.
Turnaround leader competencies. Research suggests
that the competencies of successful turnaround leaders
difer from those of successful leaders in already high-
performing organizations. By examining these patterns
of thinking, feeling, acting, and speaking, district and
Identifying Success Factors in Other Industries
In other industries, leaders rely upon research, time, and experience to identify key characteristics and
behaviors that have been shown to predict success in a new venture. In franchising and venture capital, for
example, leaders keep a close eye on three major factors to learn whether their investments are on track:
Leader characteristics. Through research, time, and experience, venture capitalists have discovered that
certain qualities of entrepreneurs consistently predict the success or failure of new ventures. In their
initial selection of portfolios, venture investors typically pay close attention to these characteristics in
the leader — such as evidence of staying power, ambition, ability to handle risk, and attention to detail.16
Many also monitor the degree to which entrepreneurs engage in behaviors that demonstrate these quali-
ties, relying on these as leading indicators of success or failure for the venture.17
Makeup of the management team. Smart investors know that the completeness of a venture’s leadership
team and its combined experience will be crucial to the organization’s progress. Indeed, research in other
sectors has confrmed a crucial connection between the makeup of a new leadership team and the com-
pany’s success.18 In their initial investment decisions, they therefore pay attention to the size of the team,
any previous experience members may have working together, and the chemistry between entrepreneurs
and their teams.19 Afer making an investment, they will also continue to monitor team size, relationships,
and functioning as indicators of organizational health and progress.20
Connectedness with key players and resources. Research across sectors has shown that successful companies
establish close ties with external organizations, including actual and potential customers, partners, and
other allies.21 As they track the progress of their investments or franchisees, therefore, investors ofen
gather data about the organization’s ability to attract and maintain these ties as early evidence about
whether external alliances will help the venture succeed.22
Several key factors that are neces-
sary for turnaround success include:
• the skills, habits, and behaviors
of turnaround leaders;
• the series of actions that turn-
around leaders take; and
• the support and fexibility that
the school leader receives to do
things diferently.
10 • le adi ng i ndi cators of school tur narounds
state leaders can both identify and monitor principals
who will have the best chance of success. The compe-
tencies of a turnaround leader include:
• Driving for results — the leader’s strong desire to
achieve outstanding results and the task-oriented
actions required for success.
• Infuencing for results — motivating others and in-
fuencing their thinking and behavior to obtain
results. Turnaround leaders cannot accomplish
change alone, but instead must rely on the work
of others.
• Engaging in problem solving — including analysis
of data to inform decisions; making clear, logical
plans that people can follow; and ensuring a strong
connection between school learning goals and class-
room activity.
• Showing confdence to lead — staying visibly fo-
cused, committed, and self-assured despite the bar-
rage of personal and professional attacks common
during turnarounds.23
Turnaround leader actions. Research from across sec-
tors, including turnaround schools, suggests that suc-
cessful turnaround leaders also take a common set of
actions to dramatically improve organizations. These
actions include:
• Focusing on a few early wins — Successful turn-
around leaders choose a few high-priority goals
with visible payofs and use early success to gain
momentum, motivate staf, and disempower naysay-
ers. These wins must focus on high-priority, not pe-
ripheral, elements of organization performance. In
schools, examples might include achieving very high
attendance and low disciplinary rates in the frst two
months of the school year, or making huge leaps in
learning progress in a targeted academic area, such
as aiming by the end of the frst semester to have 90
percent of ffh-graders on track to make grade level
by year’s end.
• Breaking organization norms — In a failing organi-
zation, existing practices contribute to failure. Suc-
cessful turnaround leaders break rules and norms.
Deviating to achieve early wins shows that new ac-
tion gets new results.
• Pushing rapid-fre experimentation — Turnaround
leaders press a fast cycle of trying new tactics, dis-
carding failed tactics, and investing more in what
works. They resist touting mere progress as ultimate
success.
• Getting the right staf, righting the remainder —
Successful turnaround leaders typically do not
replace all or even most staf at the start, but they
ofen replace some key leaders who help organize
and drive change. For the remaining staf, change is
mandatory, not optional.
• Driving decisions with open-air data — Successful
turnaround leaders are focused, fearless data
hounds. They choose their initial goals based on
rigorous analysis. They report key staf results
openly and ofen. They require all staf who partici-
pate in decision-making to share periodic results in
open-air sessions, shifing discussions from excuse-
making and blaming to problem-solving.
• Leading a turnaround campaign — Leaders use a
consistent combination of motivating and maneu-
vering tactics that include communicating a positive
vision of success; helping staf personally feel the
problems customers feel; working through key infu-
encers; and silencing critics with speedy success.24
Evidence from early eforts suggests that some activ-
ities are common among school turnarounds regardless
of the specifc academic improvement goals the leader
identifes. Common focuses include improving the
school environment, student discipline, and staf be-
havior to create the conditions necessary for improved
learning outcomes.25 Specifc changes might include
making scheduling or policy adjustments that improve
student attendance; introducing and enforcing new be-
havior policies that dramatically reduce the number of
disciplinary incidents, enabling teachers and students
to focus on learning; or improving the school facility to
make better use of instructional space and facilitate or-
derly, efcient class transitions. These are not the “early
wins” described above, because by themselves they do
not dramatically improve student learning. But most
schools emerging from chronic failure need them to
enable improved learning outcomes for students in any
grade or subject. State and district leaders assessing a
le adi ng i ndi cators of school tur narounds • 11
turnaround’s likely success or failure will need to moni-
tor both the presence and success of these activities
very early on, along with any specifc steps required to
achieve the learning goals that the school leader identi-
fes (see Table 1 on page 13).
Support and fexibility. Evidence also demonstrates
that the district and state play an important role in
supporting turnaround eforts, by providing leaders
sufcient fexibility to do things diferently to dramati-
cally improve learning. Crucial district and/or state ac-
tions include granting turnaround leaders stafng and
operational autonomies up front. By giving the right
leaders the “big yes,” districts and states allow princi-
pals the freedom to hire and dismiss staf in accordance
with goals for the turnaround and what works for
the student population. Districts and states must also
provide support by monitoring and reporting on turn-
arounds — making sure that schools have access to the
right data, and building positive pressure through pub-
lic reporting of early results. In addition, district and
state leaders can aid turnaround eforts by proactively
engaging the community in radical change, in particu-
lar by providing a stark look at current failure, creating
a vision for the future, and publicizing early wins.26
Leading indicator principle #2: Constantly evolving
to better predict success.
Successful organizations in other sectors continually re-
assess and redefne the individual indicators they use to
track a venture’s success, to ensure that indicators can
predict success at each stage of the efort. Education
leaders can take the same approach by continually as-
sessing which indicators can predict success for school
turnarounds, and changing data collection in future
years accordingly.
In other settings, monitors and investors typically
begin the monitoring process by collecting and analyz-
ing mountains of data from a wide variety of sources,
and refning them over time. For example, research on
franchisors suggests that they collect both quantitative
and qualitative data franchise-wide, from franchisee
reports, site visits, inspections, and ratings.27 Similarly,
venture capitalists typically scrutinize a variety of data
on the entrepreneur and team, the product, its industry
and market, company fnancial performance and pro-
jections, business plans, and other factors.28
These large quantities of data enable leaders to
identify over time the indicators that can predict a ven-
ture, franchise, or new product’s prospects for success.
Experience with a particular entrepreneur or product
in development, as well as newly available research, in-
forms and limits the types of indicators leaders choose
to assess over time. For example, franchisors typically
refne their processes for selecting franchisees based on
previous franchisees’ successes and failures.29
Similarly, tests run to track the progress and ef-
fcacy of pharmaceutical products under development
evolve as the industry develops new tests and standards
based on past research and evolving standards.30 In
2006, drugmaker Pfzer lost more than a decade of re-
search and a billion dollars when it had to discontinue
research on a major new cardiovascular drug late in
the development process.31 Since then, and because of
Pfzer’s experience, new measures of product efective-
ness have been introduced earlier in the process to cut
12 • le adi ng i ndi cators of school tur narounds
of development of drugs in the same class that exhibit
similar characteristics.32
In education — particularly because the feld of
turnarounds is relatively new — ongoing assessment of
the connection between each indicator to schools’ ul-
timate success should inform data collection in future
years. For example, do the leader competencies outlined
above prepare school principals to more successfully
carry out a turnaround? Are some more important
than others? How important is it to establish precondi-
tions for learning gains, such as improvements to the
school facility, use of time, or student behavior? What
other factors predict success or failure? Is there a real
“implementation gap” before certain types of gains
will materialize? Only by beginning to track each of
these types of indicators and tie them to results will
the education feld be able to refne a consistent set
of leading indicators of school turnaround. Based on
that knowledge, district and state leaders will be able
to focus on some indicators, introduce some new ones,
and drop others in future years. As in other sectors, the
design and use of leading indicators in education will
evolve as more information becomes available about
implementation hurdles and the expected timing of
improvements.
Leading indicator principle #3: Tailored to specifc
circumstances and settings.
No one-size-fts-all set of leading indicators exists,
even within individual industries. Rather, indicators
are fnely tailored based on industry-, market-, and
situation-specifc predictors of success.33 In education,
state and district leaders can be similarly responsive to
individual schools by working with school leaders to
identify specifc benchmarks and goals for each school.
Initial indicators should be based on starting data, the
specifc goals for early wins, and the steps needed to
achieve those goals in light of the challenges at each
school.
In the venture capital setting, for example, investors
typically analyze potential investments carefully. This
initial analysis — which may include data about the po-
sitioning of a product in the target market, anticipated
competition, and foreseeable roadblocks — then serves
as a guide for evaluating the organization and forms the
basis of post-investment monitoring.34 In pharmaceuti-
cal R&D, companies also vary the indicators they use
to track the progress of an innovation based on the na-
ture of the product, including its chemical complexity,
how long it will take to develop, and the type of health
problem it is designed to address.35 The company’s own
tolerance for risk also determines to some extent what
indicators it tracks, with those with lower tolerance
requiring much more data about a product up front.36
In both settings, individual investors or monitors and
the organizations they oversee determine what is most
signifcant and how best to measure it.
Similarly, in school turnarounds, there are a num-
ber of indicators worth tracking in every turnaround
school, as well as indicators specifc to each school’s
plan for achieving early wins and later goals. Table 1
(page 13) proposes an initial set of common indicators,
based on the factors that research suggests contribute
to successful turnarounds, to inform the approach that
district and state leaders take in all of their turnaround
schools. Within these factors, however, specifc goals
and benchmarks will likely difer for each school, de-
pending on where their students are starting, early win
goals, and the specifc challenges they face.
For example, interim benchmarks on student
achievement are critical indicators of any school’s
progress. But midyear targets and steps to achieve them
for individual schools will depend on each school’s
baseline data. A school in which 5 percent of students
scored “profcient” in math in the previous year will
have a diferent target for midyear assessments than
a school in which 40 percent were profcient. It also
Research and experience suggest
several common indicators worth
tracking in every turnaround
school, as well as others specifc to
each school’s plan for achieving
early wins and later goals.
Success Factor Leading Indicator
Leaders exhibit turnaround competencies
Competency Cluster (each includes one to four
related competencies)40
•
Driving for results
•
Infuencing for results
•
Engaging in problem solving
•
Showing confdence to lead
•
School leader’s overall rating on each competency
•
Leader’s rating within each cluster of related competencies
Leaders take specific turnaround actions
•
Focusing on a limited set of high-priority short-
term goals
•
Signaling the magnitude and urgency of dramatic
change
•
Discarding failed rules and routines and deploying
new tactics for early wins
•
Releasing or redeploying staf not fully committed
to the turnaround; bringing in new staf who can
help organize and drive change
•
Infuencing stakeholders to support turnaround
actions
•
Quickly trying new tactics and discarding failed
ones, investing in what works
•
Driving decisions by openly reporting staf results
and sharing results in open-air sessions
•
Ratings on the degree to which the leader engages in each action
•
Teacher turnover rates (voluntary/involuntary)
Leaders make a turnaround plan to achieve early wins and later goals
•
Plan is based on review of data, addresses
implementation of turnaround success actions
•
Plan includes goals (early-win and later) and
detailed steps for all
•
Leader and all staf take steps according to plan
•
Existence of a plan including turnaround success actions
•
Level of clarity and detail in goals, steps, and timing for all staf
•
Ratings of timeliness of actions to implement steps in plan
•
Existence of systems to regularly collect, analyze, and use data
Schools achieve preconditions for learning gains
•
Improved instructional quality
•
Distribution of teacher quality
•
Percentage of students taught by highly efective teachers
•
Number of instructional minutes
•
Students in AP/IB/dual-enrollment classes
•
Increased participation in school
•
Student attendance
•
Teacher attendance
•
Truants
•
Student turnover rates
•
Dropout rate
•
Participation on state assessments
•
Improved school culture
•
Discipline incidents
•
Student waiting list (if applicable)
•
Student, teacher, and parent satisfaction
Schools achieve early wins related to high-priority goals41
•
State test results
•
Benchmark test results and short-cycle assessments
•
Other indicators based on school-specifc, early-win goals42
table 1. Initial Set of Leading Indicators for Turnaround Schools
14 • le adi ng i ndi cators of school tur narounds
might have diferent early-win goals, perhaps focus-
ing on achieving extreme gains in one gateway grade.
These diferences in goals and the steps needed to
achieve them would require diferent indicators, which
would be apparent from each school’s turnaround plan.
Even if district and state leaders set the same ultimate
expectations for both schools, they may rightly expect
diferent paths to those goals based on each school’s
starting point.
Research suggests that successful turnaround lead-
ers analyze a variety of data early on to develop detailed
plans that explain to every actor what actions are
needed, focusing frst on steps to achieve early wins.37
The specifc steps in these plans, as well as the existence
of the plan itself, produce one large category of lead-
ing indicators that are common for the earliest phase
of any turnaround. Afer a school achieves early wins,
the steps needed to broaden success to other grades
and subjects become indicators of success for the next
phase. The particular focus of those steps will likely
difer from school to school.
For example, an elementary principal may decide to
zero in on third-grade reading, or even on a particular
reading skill, as a frst priority, while another may focus
on ffh-grade math in year one. Both schools are likely
to set goals for all grades, but expect rapid, momentum-
building gains in a few strategically targeted grade
levels and subjects. Similarly, a high school may place
a special emphasis on reducing behavioral incidents in
the fall because of their prevalence in past years, while
another focuses on boosting attendance. Both schools
are likely to have goals for behavior and attendance,
but the expectations for improvement in one or the
other will vary based on the school’s specifc challenges.
Some principals may also set their own unique goals
that respond directly to special needs at the school,
using data to identify root causes of students’ struggles
and inform the most appropriate solutions. The bot-
le adi ng i ndi cators of school tur narounds • 15
tom row of Table 1 refects the importance of tailoring
these goals to specifc circumstances and student needs
rather than basing them on end-of-year data alone.
Leading indicator principle #4: Based on specifc
timetables.
In addition to measuring steps and milestones toward
outcomes, organization leaders in other sectors ofen
monitor when particular steps in the process occur.
Venture capitalists ofen want to know, for example,
that a new venture has sufcient time to actualize its
plans and enter the market in a position of strength,
and so will monitor whether the venture stays ahead of
others in the feld or needs to catch up.38
Venture capitalist Russ Siegelman explains how his
venture capital frm stages investments around mile-
stones, using the example of a medical device company.
“They had to build [a] device and show it could be
used in an animal study. …We put in one million up
front, another million to build the prototype, and the
third million for the animal study.” If the company
had shown signs of impending failure afer the initial
investment, Siegelman’s frm could have exited having
invested $1 million — no small loss — but being free
to direct the remaining $2 million to more promising
opportunities.39
Timetables are similarly relevant in turnaround
schools. In particular, the timing of some leader actions
is critical to their impact on the turnaround efort. For
example, achieving focused, early-win goals with vis-
ible payofs is most important early in the year. Early
victories will be more efective for building momentum
and disempowering naysayers if they occur in the frst
half of the year than in January or March. Likewise,
the steps in the plan leading toward achieving those
early-win goals must start very early in the school year.
Similarly, the common preconditions for learning
gains outlined above should improve dramatically in
the early months to set the stage for early wins. If those
preconditions come about only at the end of the frst
year, it is less likely that the school will achieve desired
learning gains. For all of these types of indicators,
therefore, district and state leaders must monitor not
only whether the steps and victories occur, but when.
How Should Schools and Districts Monitor
Leading Indicators?
Settling on a set of leading indicators is only the frst
step in forecasting the likely success or failure of a turn-
around efort. The second, equally crucial step is moni-
toring each individual indicator: setting guideposts and
using them to analyze indicators along the implementa-
tion path. Tracking progress and measuring interim
steps and outcomes enable midcourse corrections and
keep the spotlight on variables that predict long-term
performance. From other sectors, we learn that organi-
zations monitor leading indicators frequently, engage
in hands-on data-gathering, and tailor their monitor-
ing to individual circumstances.
Frequent. Rather than waiting for the end of a quar-
ter or a year to examine results, leaders in other settings
monitor progress frequently and on an ongoing basis.
Frequent oversight creates accountability for those
whose performance is being tracked, but also enables
monitors to determine how best to intervene. Monitor-
ing might reveal a need for greater oversight, bumped-
up reporting requirements, or more dramatic interven-
tions such as shifs in strategy or leader replacement.
In research and development, for example, many
companies establish monitoring timelines for new
products based on specifc stages of development,
which may occur in a matter of days, weeks, or months.
Arriving at each new stage triggers a new round of
monitoring to evaluate progress.43
Venture capitalists sometimes use “staged fnancing”
to condition continued funding on early success. Each
stage involves monitoring and reevaluating the venture
Experience fom other sectors
suggests that education leaders
should monitor indicators in
turnaround schools early and
ofen, on at least a monthly or
quarterly basis.
16 • le adi ng i ndi cators of school tur narounds
against preset expectations, as well as ongoing monitor-
ing during each stage to inform the next funding deci-
sion. For example, in the early days of Federal Express,
venture capitalists invested an initial $12.25 million in
the company. Just six months later, in early 1974, the
company was failing to achieve necessary progress on
several leading indicators, and so investors put in only
$6.4 million, much lower than FedEx leaders expected.
Afer another six months, investors intervened exten-
sively in company strategy and only then invested an
additional $3.88 million. The company turned around
and achieved success, going public in 1978.44 At each
stage, frequent, in-depth monitoring allowed venture
capitalists to base their recurring investments on the
company’s performance and progress.
In schools, one of the primary transitions from
traditional accountability eforts to tracking leading
indicators is to measure earlier and increase the fre-
quency of monitoring. Given the typical timetables
for intervention in state and federal policy, increasing
monitoring eforts to track leading indicators on even
an annual basis could be considered an improvement,
and would likely increase turnaround success rates
somewhat. But as illustrated in Table 1 on page 13, the
most powerful way to dramatically increase overall
success rates over time is by making decisions much
earlier in the turnaround efort. Experience from other
successful organizations suggests that to make these
types of decisions in education, state and district lead-
ers would need to monitor indicators in turnaround
schools much earlier and more frequently, such as on a
monthly or quarterly basis.
It may not be feasible or practical to monitor all
indicators this frequently — for example, dropout
rates and student results on state assessments may
be available only once a year, and results on interim
assessments may be available only once every six or
eight weeks. But other indicators, such as student and
teacher attendance, or a leader’s action toward early
high-priority goals, could be tracked earlier and much
more frequently. In addition, districts can aim to make
interim assessment data available to educators more
regularly, particularly for high-priority subjects.45
In Table 2 (page 17), we propose a timetable to
guide tracking of leading indicators in turnaround
schools. Most indicators are designed to be tracked on
a quarterly basis, with some once or twice each year.
Many districts may fnd that more frequent — even
weekly — collection of some types of data is crucial
to fully understanding a school’s progress. Education
leaders can tailor this timetable to the indicators they
select, the availability of data, and other factors in their
state or district.
It is worth noting that in other sectors, this type of
monitoring ofen involves substantial time and efort.
Venture capitalists, for example, spend up to 25 per-
cent of their time on monitoring.46 A typical venture
capitalist might visit the site of each investment once
a month for four to fve hours per visit.47 School turn-
around eforts likely need more frequent visits, and
state and district staf will need to spend more time
monitoring than most spend today.
Hands-on. While organization leaders in other
sectors ofen rely on some level of passive engagement
le adi ng i ndi cators of school tur narounds • 17
Success Factor Leading Indicator
Leaders exhibit turnaround
competencies
•
School leader’s overall rating on each
competency
•
Leader’s rating in each cluster of
competencies
•
Competency assessments that
rate leader on quantitative
scales (e.g., interview,
360-degree review)
•
At placement prior
to year 1
•
December/January
in year 1
•
Annually thereafer
Leaders take turnaround
success actions
•
Ratings on the degree to which the
leader engages in each action
•
School visits and interviews
•
Quarterly
•
Teacher turnover rates
•
School- or district-reported
data about voluntary and
involuntary turnover
Leaders make turnaround
plans to achieve early-win
and later goals
•
Existence of a plan including turnaround
success actions
•
Level of clarity and detail in goals, steps,
and timing for all staf
•
Ratings of timeliness of actions to
implement steps in plan
•
Existence of systems to regularly collect,
analyze, and use data
•
Structured assessment:
existence and content of
written plan and data systems
•
School visits, interviews, and
surveys to assess plan follow-
through
•
Written plan by
school opening
•
Action quarterly in
year 1; semiannually
thereafer
Schools achieve
preconditions for learning
gains
•
Distribution of teacher quality (SIG)
•
Percentage of students taught by highly
efective teachers
•
Ratings on LEA teacher
evaluation system
•
Student enrollment data
•
Annually
•
Number of instructional minutes (SIG)
•
Students in AP/IB/dual-enrollment
classes (SIG)
•
School- or district-reported
data
•
Student attendance (SIG)
•
Teacher attendance (SIG)
•
Truants (SIG)
•
Student turnover rates
•
School- or district-reported
data
•
Quarterly
•
Dropout rate (SIG)
•
Participation on state assessments (SIG)
•
Annually
•
Discipline incidents (SIG)
•
Student waiting list (if applicable)
•
School- or district-reported
data
•
Quarterly
•
Student, teacher, and parent satisfaction
•
Student, teacher, and parent
surveys
•
Survey response rates
Schools achieve early wins
related to high-priority
goals
•
Benchmark test results
•
School- or district-reported
data
•
Quarterly
•
Short-cycle assessments
•
Weekly, biweekly,
monthly
•
Other indicators based on school-
specifc goals
•
Quarterly
•
State test results
•
Annually
*(SIG) denotes indicators that are required to be reported annually under the federal School Improvement Grant program.
table 2. Monitoring Leading Indicators: Expected Measurement and Timetables
18 • le adi ng i ndi cators of school tur narounds
to track the progress of their investments — such as col-
lecting and reviewing fnancial reports and other data
of-site at regular intervals — they also tend to become
involved in the ventures they are monitoring.48 This
hands-on involvement generates various benefts, in-
cluding valuable, ongoing information about the orga-
nizations in which they have invested.
Venture capitalists in particular are ofen intimately
involved in their investment companies. In addition
to the monitoring activities and site visits noted above,
they ofen serve on boards, meet with customers and
suppliers, act as consultants, recruit management, and
assist with networking.49 Each of these roles takes time
and resources, but they enable venture capitalists to
gather valuable day-to-day information about the frm’s
progress on many fronts.50
In fact, venture capital frms
ofen take geographic proximity into account in select-
ing investments, to make frequent monitoring more
feasible. It is easier to drop in and talk with the leader
of a new venture if he is located right down the road,
rather than across the country.51
In education, monitoring should similarly involve
more than “desktop audits.” While quantitative data
that feeds automatically to district- or state-level
dashboards is a critical component of progress moni-
toring, qualitative data and information that results
only from on-site visits will ofer crucial insight into
how turnaround schools are progressing. District
and/or state monitoring staf should plan to conduct
regular site visits in turnaround schools, to conduct
interviews with the school leader and teachers, and to
visit with students and staf. In addition to providing
an opportunity for observation and data collection,
frequent visits will also allow district and/or state staf
to build relationships with school leaders and hold
them accountable for turnaround actions and expected
progress. Site visits will also enable district leaders to
see the reasons behind the data provided in desktop
audits, and respond accordingly. And site visits will
provide opportunities for district and state staf to pro-
vide active assistance, such as by connecting leaders to
potential partners and other resources, identifying and
helping to remove barriers, and ofering advice.
Surveys may also be a helpful way to gauge progress
and perceptions among the school’s staf, students, par-
ents, partners, and even members of the surrounding
community. We include a timetable for site visits, inter-
views, and surveys in Table 2 (page 17) to enable educa-
tion leaders to beneft from much more sophisticated
information than quantitative reports.
Tailored to needs and current circumstances.
Across industries, organization leaders and investors
tailor their monitoring approaches over time based on
information they receive about a venture’s status and
future prospects. In schools, as well, the frequency
and rigor of monitoring may best be tailored to the
degree of success the school shows in early stages of the
turnaround.
In early 2011, the frst-ever longitudinal study of de-
cision-making in venture capital investment found that
the processes investors used to evaluate their invest-
ments changed over time as a result of lessons learned
within the venture capital frm.52 As new ventures
mature and demonstrate their ability to succeed, inves-
tors typically increase the duration of their investments
and reduce the intensity of their monitoring eforts.53
Similarly, as companies show signs of failure, venture
capitalists ofen scale back the level or duration of in-
vestments and impose stricter controls or more intense
monitoring on their ventures, such as by increasing
contractual control over the venture or representation
on its board.54
Franchisors also typically increase the frequency of
their monitoring and data collection when problems
occur, allowing them to act more rapidly based upon
current information.55 And in R&D, when monitor-
ing reveals that early phases of a research efort are not
proceeding as planned, researchers rapidly modify re-
Site visits provide opportunities
to provide active assistance, such
as by connecting school leaders to
potential partners and other re-
sources, and by identifying and
helping to remove barriers.
le adi ng i ndi cators of school tur narounds • 19
search plans based on the early results, instead of stick-
ing to plans that have shown diminishing prospects of
success.56
The same principles apply to schools, where it may
not be necessary to monitor all indicators with the
same frequency in every school. If a school is on the
right track in year one, monitoring on several indica-
tors may decrease in year two. On the other hand, if
a leader encounters new challenges midway through
the year, district leaders should pay closer attention to
relevant indicators for several months thereafer. With
regular, hands-on monitoring, district and state lead-
ers will have better access to data that enable informed
decision-making about which indicators need more
close attention and which can reduce in intensity.
How Should Schools and Districts Put
Leading Indicators to Use?
Organizations in other sectors do more than just
develop and monitor leading indicators — they also
use what they learn to make strategic decisions that
alter operations and dramatically improve outcomes.
Empowered with more and better information about
progress in turnaround schools, education leaders will
be able to do the same.
Intervention or closure. Leaders use leading indica-
tors to inform and direct intervention in organizations
that are not on the right track. In education, district
and state leaders can dramatically increase the success
rate of school turnarounds by taking similar action
based on the information collected through leading
indicators.
In other sectors, indicators sometimes provide a
“red fag” that warns monitors or investors about the
need for serious changes in the organization or its
direction — for example in franchising, where low ini-
tial sales or high volatility may alone trigger action.57
At other times, multiple indicators must be viewed
together as a package — such as when sales are only
slightly lower than expected, but employee turnover
and customer complaints are high. In many cases,
though no single indicator alone mandates action, the
totality of available information can support interven-
tion.58 Venture capitalist Russ Siegelman highlighted
When leading indicators show
that a school turnaround is not on
the right track, state and district
leaders should provide additional
assistance or targeted interven-
tion to address specifc challenges,
or retry major change with a new
leader or new approach.
20 • le adi ng i ndi cators of school tur narounds
the importance of fexibility by leaders of new startups:
“[T]he best [leaders] are willing to reexamine their
assumptions and are willing to veer lef or right or
pivot all the way around when the data suggests they’re
headed in the wrong direction. They amble around
until they fnd something good. The bad ones typically
get overcommitted or wed to a particular idea.”59
When leading indicators show that a new venture’s
leadership is making poor decisions or the organiza-
tion is heading of track, venture capitalists will ofen
increase their involvement in key management deci-
sions, require that more of the key leaders’ compensa-
tion be tied to future performance, or step in to replace
the leader with a better candidate.60 In extreme cases,
failure to meet key targets may lead funders to establish
additional or more onerous requirements for subse-
quent rounds of funding, or to discontinue investment
entirely.61
Franchisors ofen use leading indicators to inform
similar decisions, identifying performance gaps and
targeting struggling franchisees for hands-on assistance
through visits or advice, or revocation of the franchise
license.62 In these situations, organizations and their
funders respond to leading indicators with action, not
waiting for crises to balloon into full-blown failures.
For education leaders, when leading indicators show
that a school turnaround is not on the right track, op-
tions include providing additional assistance or targeted
intervention to address specifc challenges, or retrying
major change with a new leader or new approach.
Targeted assistance responds directly to a specifc
challenge at the school, and might include deploy-
ing a community coordinator to work alongside the
principal in addressing parents’ or other community
members’ concerns about the turnaround; providing
additional fexibility to accommodate a longer school
day or school year; or helping to remove or reassign se-
lect members of the school staf who fail to contribute
to the turnaround.
When early indicators reveal difculties, more
dramatic change may be needed. Major retry eforts
should respond to specifc challenges at the school, and
may include replacing the school leader with a proven
change leader or one with the right competencies for
a turnaround; contracting school operations to an
external provider that has demonstrated previous suc-
cess in similar schools, such as a charter management
organization; or, when feasible, closing the school and
reassigning students to higher-performing schools.63
Decreased monitoring or increased reward. In
organizations where leading indicators show early,
dramatic success, investors or monitors ofen decrease
monitoring or trust that the organization will not
require major intervention or modifcation of exist-
ing plans. In education, district and state leaders can
similarly decrease monitoring or ofer rewards to
turnaround schools that demonstrate early, signifcant
success.
In many other sectors, rapid growth in the early
stages of development is a strong early sign of later suc-
cess: New ventures beneft from establishing positions
quickly, and strong early performance allows them to
rapidly generate large revenue streams.64 Franchises also
rely on early, rapid growth to achieve efciencies associ-
ated with larger scale.65 When franchisors and investors
see this type of growth, therefore, they ofen reduce
their frequency of monitoring or the degree of hands-
on involvement.
Positive results on leading indicators can also serve
as “green lights,” prompting continued development,
and, in some cases, increased fnancial investment. In
R&D, positive results at early stages allow products to
continue moving along development pipelines.66 For
venture capitalists, strong early results confrm pre-
investment judgments of promise and justify continued
investment.67
The same principles can apply to education. In turn-
around schools that are on track, quarterly monitoring
of some indicators might drop to once or twice a year,
reducing the reporting burden and level of scrutiny in
successful schools. District or state leaders could also
recognize a turnaround leader’s success with a perfor-
mance bonus, or extend the reach of highly capable
leaders by allowing them to oversee turnaround eforts
in more than one school.
Ultimately, this is where leading indicators become
most powerful: in empowering district and state lead-
ers with timely data to make decisions about how to
ensure greater turnaround success, faster and in more
schools.
le adi ng i ndi cators of school tur narounds • 21
Key Actions for State
and District Leaders
F
ederal, state, and local education
leaders across the country have become com-
mitted to dramatically improving outcomes
for students in chronically low-achieving
schools. But the odds are tough: Across sectors, major
change eforts have only about a 30 percent chance of
success.
To increase the odds for these students, education
leaders have a powerful tool: leading indicators that
predict the likely success or failure of turnaround ef-
forts. By collecting and acting upon more and better
information early in the efort, district leaders, state de-
partments of education, and other partners will be able
to take rapid actions that increase cumulative success
rates over time.
Research from other sectors that have broad experi-
ence with similar, low-probability events ofers several
key considerations to guide eforts in turnaround
schools. We summarize them here, and readers will
fnd more detail on each in the main body of this paper.
Start with known success factors. Develop sets of
leading indicators by examining factors with a demon-
strated impact on success. In turnaround schools, this
includes the competencies of the turnaround leader,
the leader’s actions, steps that all staf members take to
achieve goals according to the turnaround plan, and
common routines that must improve in any school
seeking learning gains.
Monitor schools frequently and intimately. Every
indicator may not need monitoring with the same
frequency, and not every school will require the same
intensity. But to gather and use leading indicators
meaningfully, most districts and states must monitor
turnaround schools much more ofen than they do
today, with monthly or quarterly data collection and
analysis. Monitoring should also be hands-on, involv-
ing site visits or other active engagement by district or
state staf.
Act on early indicators of success or failure. Lead-
ing indicators are most powerful when used to make
concrete decisions. When a turnaround is not on the
right track, leaders can use leading indicators to choose
the right assistance for addressing specifc challenges,
or to justify major change, such as replacing the leader,
contracting with an external provider, or closing the
school and reassigning students to higher-performing
schools nearby. Early and sustained success in turn-
around schools can lead to decreased monitoring,
performance rewards, and a greater reach for highly
capable leaders.
Collect mountains of data, and narrow to the
most predictive over time. Because the feld of school
turnarounds is so new and research is just emerging,
state and district leaders will need to begin collecting
data on a signifcant number of potential leading indi-
cators and narrow the list over time. By looking at root
causes and correlating an initial set of indicators with
student outcome data, researchers will be able to under-
stand which indicators are most useful. Over time, this
will allow a narrowing of leading indicators to those
most connected to success.
In addition, while the feld needs better informa-
tion about success and failure in school turnarounds
at the school level, leading indicators as a concept are
applicable at any level. The next generation of think-
ing about leading indicators should build on the same
lessons we outline here to identify and use indicators at
the district level, as well.
• 23
Notes
1. Based on National Assessment of Educational Progress
data presented in Editorial Projects in Education Research
Center (2009). Education Counts. Retrieved from http://
www.edcounts.org
2. Zuckerbrod, N. (2007, October 29). More than 1 in 10
high schools in America are “dropout factories.” Associated
Press. Retrieved fromhttp://www.usatoday.com/news/
nation/2007-10-29-1214322283_x.htm
3. Strong American Schools. (2008). Diploma to nowhere.
Washington, DC: Author. Retrieved fromhttp://www.
deltacostproject.org/resources/pdf/DiplomaToNowhere.pdf
4. Zuckerbrod, N. (2007, October 29); Balfanz, R.,
& Legters, N. (2004). Locating the dropout crisis: Which
high schools produce the nation’s dropouts? Where are they
located? Who attends them? Baltimore, MD: John Hopkins
University, Center for Social Organization of Schools;
Herman, R., Dawson, P., Dee, T., Greene, J., Maynard,
R., Redding, S., & Darwin, M. (2008). Turning around
chronically low-performing schools: A practice guide (NCEE
#2008-4020). Washington, DC: National Center for
Education Evaluation and Regional Assistance, Institute
of Education Sciences, U.S. Department of Education.
Retrieved fromhttp://ies.ed.gov/ncee/wwc/publications/
practiceguides
5. Balfanz, R., Bridgeland, J. M., Moore, L. A., & Fox, J.
H. (2010, November). Building a grad nation: Progress and
challenge in ending the high school dropout epidemic. Civic
Enterprises, Everyone Graduates Center at Johns Hopkins
University, and America’s Promise Alliance. Retrieved fromhttp://www.americaspromise.org/Our-Work/Grad-Nation/
Building-a-Grad-Nation.aspx
6. Maxwell, L. A. (2010, July 1). States, districts scramble
on turnaround deadline. Education Week. Retrieved fromhttp://www.edweek.org/ew/articles/2010/07/01/36sig.
h29.html?qs=turnaround; Aarons, D. (2010, May 10).
States, districts moving ahead on turnarounds (weblog
entry). Education Week. Retrieved fromhttp://blogs.
edweek.org/edweek/District_Dossier/2010/05/states_
districts_moving_ahead.html. Throughout this report, we
use the term “turnaround” not to refer specifcally to the
“turnaround” option under federal School Improvement
Grant and Race to the Top guidance, but rather the more
common usage in other sectors for a targeted strategy for
rapid, dramatic change.
7. Education Secretary Arne Duncan set a national goal of
turning around the 5,000 lowest-achieving schools as part of
an overall strategy for lowering the dropout rate, improving
high school graduation rates, and increasing college and
workforce readiness. See United States Department of
Education. (2009, August 29). Obama administration
announces historic opportunity to turn around nation’s
lowest-achieving public schools (press release). Washington,
DC: Author. Retrieved fromhttp://www.ed.gov/news/
press-releases/obama-administration-announces-historic-
opportunity-turn-around-nations-lowestac. Federal funding
that supports school closure and turnarounds includes:
Race to the Top funds ($4.35 billion in competitive grants
to states); School Improvement Grants ($3.55 billion
allocated to states according to a formula based on Title I
funding levels); and Investing in Innovation Fund (i3) ($0.65
billion in competitive grants awarded to nonprofts and
school districts to expand innovative and evidence-based
approaches that signifcantly improve student achievement).
8. Beer, M., & Nohria, N. (2000). Breaking the code of
change. Cambridge, MA: Harvard Business School Press.
9. Hassel, E. A., & Hassel, B. C. (2009). Try, try again:
How to triple the number of fxed failing schools without
getting any better at fxing schools. Chapel Hill, NC: Public
Impact. Retrieved fromhttp://www.publicimpact.com/
publications/Public_Impact_Try_Try_Again_Slide_
August_2009.pdf
10. Hassel & Hassel, Try, try again.
11. Hassel, E. A., & Hassel, B. C. (2009, Winter). The big
U-turn: How to bring schools from the brink of doom to
stellar success. Education Next, 9(1). Retrieved from http://
educationnext.org/the-big-uturn/; Rhim, L. M., Kowal,
J. M., Hassel, B. C., & Hassel, E. A. (Public Impact). (2007).
School turnarounds: A review of the cross-sector evidence on
dramatic organizational improvement. Lincoln, IL: Center
on Innovation & Improvement. Retrieved from http://
www.centerii.org/survey/downloads/Turnarounds-Color.
pdf
12. No Child Lef Behind Act of 2001, Pub. L. No.
107-110.
13. In 2009, the federal School Improvement Grant
program required grantees to report annually on several
indicators of school performance, including the distribution
of teachers by performance level on the LEA’s evaluation
system, dropout rate, participation rate on state assessments,
student attendance, teacher attendance, disciplinary
incidents, truancy rates, the number of instructional
minutes, and students enrolled in AP/IB/dual-enrollment
classes. U.S.Department of Education, Ofce of Elementary
and Secondary Education. (revised 2010, June 29).
Guidance on School Improvement Grants under Section
1003(g) of the Elementary and Secondary Education Act of
1965. Retrieved fromhttp://www2.ed.gov/programs/sif/
sigguidance05242010.pdf
24 • notes
14. There are a few notable diferences between these
industry settings and school turnarounds worth mentioning
here. While these do not diminish the utility of lessons
learned in other sectors, they do inform our careful analysis
of how they might apply in education. Most notable, of
course, is the option to abandon an investment that is
not showing success — although venture capitalists and
franchisors can cut ties with a venture that is not successful,
education leaders maintain an obligation to students no
matter the success of their school. They may abandon
a particular reform strategy or replace an individual
turnaround leader, but cannot simply pull students out of
low-performing schools and leave them on the sidelines
until new options present themselves. Organizations
in other sectors also typically have fexibilities available
that enable them to quickly redirect that schools ofen
do not have. We would argue, however, that where these
fexibilities are necessary to keep a change efort on track,
states and districts should grant similar autonomies to
schools where possible. Finally, the specifc measures used
as leading indicators in other sectors will ofen not translate
precisely, if at all, to schools — students cannot be evaluated
through the types of go/no-go tests used in research and
development, for example, and franchise success is more
likely to be linked to inputs and less likely to be tied to
process variables than success in schools. But as we explain
in our fndings, the principles that inform the selection
of leading indicators in other sectors apply directly to
the education setting as well, and can provide signifcant
guidance about the types of indicators we should be tracking
in schools.
15. For another set of proposed factors to guide the
selection of leading indicators, see Mass Insight Education,
Evaluating school turnaround: Establishing benchmarks
and metrics to assess school turnaround (Boston, MA:
author, 2010). Retrieved fromhttp://www.massinsight.org/
publications/stg-resources/117/
16. MacMillan, I. C., Siegel, R., & SubbaNarasimha,
P. N. (1985). Criteria used by venture capitalists to evaluate
new venture proposals. Journal of Business Venturing, 1(1),
119–128; Sykes, H. B. (1986). The anatomy of a corporate
venturing program: Factors infuencing success. Journal of
Business Venturing, 1(3), 275–293; Dubini, P. (1989). Which
venture capital backed entrepreneurs have the best chances
of succeeding? Journal of Business Venturing, 4(2), 123–132;
Baum, J. A. C., & Silverman, B. S. (2004). Picking winners
or building them? Alliance, intellectual, and human capital
as selection criteria in venture fnancing and performance
of biotechnology startups. Journal of Business Venturing,
19(3), 411–436, citing Byrne, J. A. (2000, July 24). How a
VC does it; Bob Davoli is a hands-on investor, and so far he
hasn’t picked a loser. Can he keep it up? Business Week. Also
see Zacharakis, A. L., & Meyer, G. D. (2000). The potential
of actuarial decision models: Can they improve the venture
capital investment decision? Journal of Business Venturing,
15(4), 323–346.
17. MacMillan, Siegel, & SubbaNarasimha, Criteria used
by venture capitalists.
18. Roure, J. B., & Keeley, R. H. (1990). Predictors
of success in new technology based ventures. Journal of
Business Venturing, 5(4), 201–220.
19. Roure & Keeley, Predictors of success, citing
Hackman, J. R., & Oldham, G. R. (1980). Work Redesign.
Reading, MA: Addison-Wesley.
20. Hall, J., & Hofer, C. W. (1993). Venture capitalists’
decision criteria in new venture evaluation. Journal of
Business Venturing, 8(1), 25–42.
21. Baum & Silverman, Picking winners or building
them?; Roure & Keeley, Predictors of success.
22. Baum & Silverman, Picking winners or building
them?; Roure & Keeley, Predictors of success.
23. Steiner, L. M., Hassel, E. A., & Hassel, B. C. (Public
Impact). (2008). School turnaround leaders: Competencies
for success. Chicago: The Chicago Public Education
Fund. Retrieved fromhttp://www.publicimpact.com/
turnaroundcompetencies.php
24. Hassel & Hassel, The big U-turn.
25. Herman, Dawson, Dee, Greene, Maynard, Redding,
& Darwin, Turning around chronically low-performing
schools; Public Impact. (2008). Chicago school turnarounds:
Final report. Chicago: Chicago Public Education Fund.
26. Kowal, J., Hassel, E. A., & Hassel, B. C. (Public
Impact). (2009, September 15). Successful school turnarounds:
Seven steps for district leaders. Washington, DC: The Center
for Comprehensive School Reform and Improvement, and
Learning Point Associates. Retrieved fromhttp://www.
centerforcsri.org/fles/CenterIssueBriefSept09.pdf
27. Chittley-Young, R. (2009, February). Analyze
this: Franchise performance indicators for tough times.
FranchiseVoice; Nigrini, M. J., & Johnson, A. J. (2008).
Using key performance indicators and risk measures in
continuous monitoring. Journal of Emerging Technologies in
Accounting, 5, 65–80.
28. Roure & Keeley, Predictors of success; Dubini, Which
venture capital backed entrepreneurs have the best chances
of succeeding?
29. Frazer, L., & Winzar, H. (2005). Exits and
expectations: Why disappointed franchisees leave. Journal of
Business Research, 58(11), 1534–1542.
30. Neuer, A. (2010). Optimizing value in clinical data
as standards evolve. Oracle Health Sciences. Retrieved
fromhttps://microsite.accenture.com/rdtransformation/
Documents/Accenture_Oracle_Clinical_Standards.pdf
31. Berenson, A. (2006, December 3). Pfzer ends studies
on drug for heart disease. The New York Times. Retrieved
fromhttp://www.nytimes.com/2006/12/03/health/03pfzer.
notes • 25
html?fa=y; Cortez, M. F., & Randall, T. (2010, November
10). Merck restarts cholesterol race four years afer Pfzer
failure. Bloomberg News. Retrieved fromhttp://www.
bloomberg.com/news/2010-11-10/merck-restarts-cholesterol-
race-four-years-afer-pfzer-failure.html
32. Interview with Julie Fields Liu, director, Research
Management, CoNCERT Pharmaceuticals, Inc., conducted
January 5, 2011; Cortez & Randall, Merck Restarts
Cholesterol Race.
33. For discussion of product characteristics that
predict success, see Roure & Keeley, Predictors of success;
MacMillan, Siegel, & SubbaNarasimha, Criteria used by
venture capitalists; Baum & Silverman, Picking winners
or building them?; and Roberts, M. J., & Barley, L.
(2004). How venture capitalists evaluate potential venture
opportunities (Harvard Business School Case Study #9-805-
019). For discussion of market characteristics that predict
success, see MacMillan, Siegel, & SubbaNarasimha, Criteria
used by venture capitalists; Kaplan, S. N., & Stromberg, P.
(2004). Characteristics, contracts, and actions: Evidence
from venture capitalist analyses. The Journal of Finance,
59(5), 2177–2210; Zider, B. (1998, November-December).
How venture capital works. Harvard Business Review,
76(6), 131–139; Roberts & Barley, How venture capitalists
evaluate; Roure & Keeley, Predictors of success; Gartner,
W. B., Starr, J. A., & Bhat, S. (1998). Predicting new venture
survival: An analysis of “Anatomy of a start-up.” Cases from
Inc. magazine. Journal of Business Venturing, 14(2), 215–232;
MacMillan, I. C., Zemann, L., & SubbaNarasimha, P. N.
(1987). Criteria distinguishing successful from unsuccessful
ventures in the venture screening process. Journal of Business
Venturing, 2(2), 123–137; Shepherd, D. A. (1999). Venture
capitalists’ assessment of new venture survival. Management
Science, 45(5), 621–632.
34. Kaplan, S. N., & Stromberg, P. (2000, September).
How do venture capitalists choose and manage their
investments? Working paper, University of Chicago.
35. Bremser, W. G., & Barsky, N. P. (2004). Utilizing the
balanced scorecard for R&D performance measurement.
R&D Management, 34(3), 229–238; Ding, M., & Eliashberg,
J. (2002). Structuring the new product development
pipeline. Management Science, 48(3), 343–363; Kaplan &
Stromberg, How Do Venture Capitalists Choose?; interview
with Julie Fields Liu.
36. Interview with Julie Fields Liu; Chan, T., Nickerson,
J. A., & Owan, H. (2007). Strategic management of R&D
pipelines with cospecialized investments and technology
markets. Management Science, 53(4), 667–682; Kaplan &
Stromberg, How Do Venture Capitalists Choose?; Blau, G.,
Mehta, B., Bose, S., Pekny, J., Sinclair, G., Keunker, K., &
Bunch, P. (2000). Risk management in the development of
new products in highly regulated industries. Computers and
Chemical Engineering, 24(2-7), 659–664.
37. Rhim, Kowal, Hassel, & Hassel, School turnarounds.
38. Roberts & Barley, How venture capitalists evaluate.
39. Roberts & Barley, How venture capitalists evaluate.
40. For a full list of competencies within each cluster, see
Steiner, Hassel, & Hassel, School turnaround leaders.
41. For example, increasing third-grade reading
profciency rates by 35 points in the frst year.
42. For example, individual student-level progress over
time; percentage of students performing below grade
level, on track to reach grade level, at or above grade level;
acceleration of student progress; number of course failures.
43. Bremser & Barsky, Utilizing the balanced scorecard.
44. Gompers, P. A. (1995). Optimal investment,
monitoring, and the staging of venture capital. The Journal
of Finance, 50(5), 1461–1489.
45. See Bambrick-Santoyo, P. (2010). Driven by data:
A practical guide to improve instruction. San Francisco:
Jossey-Bass. Also see successful i3 application submitted by
Achievement Network (2010). Narrative retrieved from:http://www2.ed.gov/programs/innovation/2010/narratives/
u396c100771.pdf
46. Zider, How venture capital works.
47. Gompers, Optimal investment, citing Gorman, M., &
Sahlman, W. (1989). What do venture capitalists do? Journal
of Business Venturing, 4(4), 231–248.
48. Schwienbacher, A. (2005, January). An empirical
analysis of venture capital exits in Europe and the United
States. EFA 2002 Berlin Meetings Discussion Paper. Also
see Hellman, T. (1998). The allocation of control rights in
venture capital contracts. Rand Journal of Economics, 29(1),
57–76; Hellman, T., & Puri, M. (2000). The interaction
between product market and fnancing strategy: The role of
venture capital. Review of Financial Studies, 13(4), 959–984;
Hellman, T., & Puri, M. (2002). Venture capital and the
professionalization of start-up Firms: empirical evidence.
The Journal of Finance, 57(1), 169–197.
49. Schwienbacher, An empirical analysis of venture
capital exits; Davila, A., Foster, G., & Gupta, M. (2003).
Staging venture capital: Empirical evidence on the diferential
roles of early versus late rounds. Working paper. Retrieved
fromhttp://apps.olin.wustl.edu/workingpapers/pdf/2003-
07-003.pdf; Kaplan & Stromberg, How do venture capitalists
choose? Also see Hellman, The allocation of control rights;
Hellman & Puri, Interaction between product market and
fnancing strategy; Hellman & Puri, Venture capital and the
professionalization of start-up frms.
50. Gompers, Optimal investment.
51. Lerner, J. (1995). Venture capitalists and the oversight
of private frms. The Journal of Finance, 50(1), 301–319.
52. Petty, J. S., & Gruber, M. (2011). ‘In pursuit of the real
deal’: A longitudinal study of VC decision making. Journal
of Business Venturing, 26, 172–188.
53. Gompers, P. A., & Lerner, J. (2001). The venture
26 • notes
capital revolution. The Journal of Economic Perspectives,
15(2), 145–168.
54. Gompers, Optimal investment; Lerner, Venture
capitalists and the oversight of private frms.
55. Nigrini, M. J., & Johnson, A. J. (2008). Using key
performance indicators and risk measures in continuous
monitoring. Journal of Emerging Technologies in Accounting,
5, 65–80; Chittley-Young, Analyze this.
56. SAS Institute Inc. (2007). Managed innovation,
assured compliance: Developing, executing and managing the
transformation, analysis and submission of clinical research
data with SAS drug development (white paper). Retrieved
fromhttp://www.sas.com/resources/whitepaper/wp_3581.
pdf; Miller, E. R. (2006). Implementation of adaptive
randomizations for clinical trials. Interactive Clinical
Technologies Incorporated. Retrieved fromhttp://www.
almacgroup.com/papers/papers/implementation_of_
adaptive_rands.pdf
57. Nigrini & Johnson, Using key performance indicators;
MacMillan, Siegel, & SubbaNarasimha, Criteria used by
venture capitalists.
58. Gompers, Optimal investment; MacMillan, Siegel, &
SubbaNarasimha, Criteria used by venture capitalists.
59. Roberts & Barley, How venture capitalists evaluate.
60. Davila, Foster, & Gupta, Staging venture capital;
Kaplan & Stromberg, Characteristics, contracts, and
actions; Schwienbacher, An empirical analysis of venture
capital exits; Gompers, Optimal investment; Kaplan &
Stromberg, How do venture capitalists choose?; Gompers &
Lerner, The venture capital revolution.
61. See Gompers, Optimal investment. However, a
number of factors encourage multiple rounds of investment,
even when it may not appear to be a sound business decision.
Emotional factors, politics within the venture capital
frm and any investment syndicates of which it is a part,
contractual pressures, and industry norms may all push
the default of “stand by your ventures.” Guler, I. (2007).
Throwing good money afer bad? Political and institutional
infuences on sequential decision making in the venture
capital industry. Administrative Science Quarterly, 52, 248–
285; Roberts & Barley, How venture capitalists evaluate.
62. Chittley-Young, Analyze this.
63. Hassel, E. A., Hassel, B. C., Arkin, M. D., Kowal,
J. M., & Steiner, L. M. (Public Impact). (2010). School
restructuring: What works when, A guide for education
leaders. Naperville, IL: Learning Point Associates.
64. Roure & Keeley, Predictors of success; Roberts &
Barley, How venture capitalists evaluate.
65. Shane, S., & Spell, C. (1998, Spring). Factors for New
Franchise Success. Sloan Management Review, 43-50.
66. See Bremser & Barsky, Utilizing the balanced
scorecard for R&D performance measurement, discussing
the Stage-Gate framework, adapted from Cooper, R. G.
(1993). Winning at new products: Accelerating the process fom
idea to launch. Reading, MA: Addison-Wesley.
67. Gompers, Optimal investment; Guler, Throwing
good money afer bad?; Roberts & Barley, How venture
capitalists evaluate.
doc_756886695.pdf
This presentation explain leading indicators of school turnarounds.
How to Know When
Dramatic Change
Is On Track
leading indicators of
school turnarounds
by Julie Kowal and
Joe Ableidinger
About the Authors
Julie Kowal is a senior consultant with Public Impact.
She consults and leads teams to ofer research-based guid-
ance on several challenging policy and management issues
in education, including teacher quality, evaluation, reten-
tion, and compensation; and dramatic change in persis-
tently underperforming schools. Ms. Kowal recently led
Public Impact’s involvement in several applications for the
federal Race to the Top and Investing in Innovation com-
petitions. An alumna of AmeriCorps NCCC and Public
Allies DC, Ms. Kowal earned her law degree with honors
from the University of North Carolina at Chapel Hill.
Joe Ableidinger is a consultant with Public Impact.
His work focuses on a variety of education policy issues,
including emerging technologies in education, teacher and
leader policy, and charter schools. Before joining Public
Impact, Mr. Ableidinger taught high school English with
the Fulbright Program in Korea and started a family re-
source center at an underperforming elementary school
as an AmeriCorps VISTA Volunteer. Mr. Ableidinger
received his B.A. with highest honors from Duke Univer-
sity, his master’s in public administration from the John
F. Kennedy School of Government at Harvard University,
and his law degree with honors from Harvard Law School.
Acknowledgements
This report was made possible by the support of the
University of Virginia’s Darden/Curry Partnership for
Leaders in Education and its School Turnaround Special-
ist Program. The authors are grateful to Jef Kutash of
FSG, Emily Pallin of Mass Insight Education, and Eileen
Reed of ERS Consulting for their thoughtful reviews
and insights. We are also indebted to Bryan Hassel and
Emily Ayscue Hassel for their editing, and to Jacob Rosch
of Public Impact for his research assistance. Finally, we
would like to thank Sharon Kebschull Barrett for careful
editing, and April Leidig-Higgins for the design of the
report.
Leading Indicators of School Turnarounds: How to Know
When Dramatic Change Is On Track was made possible by
the support of
© 2011 Public Impact, Chapel Hill, NC
© 2011 University of Virginia’s Darden/Curry Partnership
for Leaders in Education, Charlottesville, VA
Public Impact is a national education policy and manage-
ment consulting frm based in Chapel Hill, NC. We are a
team of researchers, thought leaders, tool-builders, and on-
the-ground consultants who help education leaders and
policymakers improve student learning in K–12 education.
For more on Public Impact and our research, please visit:
www.publicimpact.com.
Public Impact encourages the free use, reproduction, and
distribution of this working paper for noncommercial use.
We require attribution for all use. For more information
and instructions on the commercial use of our materials,
please contact us at www.publicimpact.com.
Please cite this report as:
Kowal, J., & Ableidinger, J. (Public Impact). (2011). Lead-
ing indicators of school turnarounds: How to know when
dramatic change is on track. Charlottesville: University
of Virginia’s Darden/Curry Partnership for Leaders in
Education. Retrieved from www.DardenCurry.org
• 1
Executive Summary
I
n recent years, national policymakers have
placed new emphasis on “school turnarounds”
as a strategy for rapid, dramatic improvement
in chronically failing schools, calling on educa-
tion leaders to turn around performance in the 5,000
lowest-achieving schools nationwide. This goal may
seem daunting, given the dismal success rates of school
improvement eforts of past years. Indeed, even outside
education — in for-proft businesses, nonproft organi-
zations and government agencies — bad-to-great turn-
around and “major change” eforts succeed only about
30 percent of the time.
Given these odds, the success of the turnaround
strategy in education will depend largely on the speed
with which districts and leaders spot schools that are
of-track and quickly redirect major change. Leading
indicators are the early signs that leaders outside edu-
cation use regularly to determine whether an organiza-
tion is on the right track or destined to fail. In school
turnarounds, leading indicators can provide early evi-
dence about whether a school is on track — and if not,
how to intervene to increase the odds of success.
In this report, we summarize the research and
experience from other settings — including venture
capital, franchising, and research and development in
industries such as pharmaceuticals — in which leaders
have long relied on leading indicators to enhance the
likelihood of success. From these lessons, we identify
key principles and processes to guide the design and use
of leading indicators in education. By critically examin-
ing systems in other sectors, and analyzing potential
lessons for school turnarounds, education leaders can
bring the benefts of leading indicators to bear where it
is not simply dollars but students’ futures at stake.
In other sectors, organization leaders identify a set
of starting leading indicators based on known success
factors in the industry and the nature of the venture
being monitored; zealously monitor those indicators
for signs of impending success or failure; and then act
on what the indicators reveal, using data to target as-
sistance, modify investments, or redirect their focus.
What Principles Should Guide Selection
of Leading Indicators?
A group of core principles guides the selection of lead-
ing indicators in other sectors, where indicators are:
• Based on known success factors in similar set-
tings. Investors and organization leaders choose
indicators based on factors that have been shown
to contribute to organizational success in the past.
2 • le adi ng i ndi cators of school tur narounds
Indicators may be grounded in rigorous research,
specifc past experiences, or standard practice in a
given feld.
• Constantly evolving to predict success at each
stage. Successful organizations continually reassess
and redefne individual indicators at each stage of an
efort, and over time across all eforts, ensuring that
each indicator they use can predict success.
• Tailored to specifc circumstances and settings.
Leading indicators are fnely tailored based on in-
dustry-, market-, and situation-specifc predictors
of success. Initial sets of indicators, ofen selected
before an efort begins, form the basis for ongoing
monitoring and evaluation.
• Based on specifc timetables. Organization lead-
ers in other sectors pay careful attention to when
progress is made. Timing is especially crucial for
achieving progress on certain key indicators, which
may have a domino efect on progress on other key
indicators and long-term outcomes.
How Should Schools and Districts Monitor
Leading Indicators?
Afer selecting a set of leading indicators, organizations
in other sectors monitor progress rigorously, setting
guideposts and using indicators to analyze prospects
for long-term performance. In these other sectors,
monitoring is:
• Frequent and ongoing. Monitors — including
venture capitalists, franchisors, and R&D manag-
ers — examine progress in their ventures frequently
and on an ongoing basis. While some indicators may
be designed for only annual or semiannual review,
several are designed to allow much more frequent
monitoring, such as quarterly, monthly, weekly, or
even daily in some cases.
• Hands-on. Monitors are typically intimately in-
volved in the operations of the organizations they
monitor, such as by consulting with leaders on key
decisions, conducting frequent site visits, engaging
in regular communications, serving on boards, and
recruiting members of the management team.
• Tailored to needs and current circumstances.
Monitors tailor their approaches over time based
on information they receive about an organization’s
success and future prospects. They ofen increase
or decrease their monitoring or their level of invest-
ment over time in response to what leading indica-
tors reveal.
How Should Schools and Districts Put
Leading Indicators to Use?
Organizations in other sectors use what they learn
through leading indicators to make strategic decisions
that alter operations and dramatically improve out-
comes. Their actions take many forms, but generally
fall into one of two broad categories:
• Intervention, from targeted assistance to major
change. Signs of impending failure may trigger in-
tense assistance, increased involvement by investors
and monitors in key decisions, or a release of the
investment entirely.
• Increased autonomy or other reward. Early, dra-
matic success as shown by leading indicators may
prompt organizations to decrease the intensity of
their oversight. Positive initial results may also serve
as “green lights,” allowing projects to continue or
even triggering increased investment.
Key Actions for State and District Leaders
The principles and strategies that other sectors use in
developing, monitoring, and acting upon leading indica-
tors provide important guidance for district leaders, state
departments of education, and other partners as they
embark on and monitor school turnarounds. By collect-
ing and acting upon the information provided by lead-
ing indicators, education leaders will be able to intervene
rapidly to increase cumulative success rates over time.
On page 13 (Table 1), we present suggestions for district,
state, and other education leaders to identify leading
indicators for their own turnaround schools. Table 2 on
page 17 sets out a proposed timetable to guide tracking
of leading indicators in turnaround schools.
le adi ng i ndi cators of school tur narounds • 3
As they consider these recommendations and design
and implement their own systems of leading indicators
in turnaround schools, education leaders can build on
the experience base in other sectors by:
1. Starting with known success factors. In turn-
around schools, this includes the competencies of
the turnaround leader, the leader’s actions, steps
that all staf members take to achieve goals ac-
cording to plan, and common routines that must
improve in any school seeking learning gains.
2. Monitoring turnaround schools frequently
and intimately. Most districts and states need to
monitor turnaround schools much more ofen
than they do, collecting and analyzing data on a
monthly or quarterly basis. Monitoring should
also involve hands-on, active engagement such
as weekly site visits and collaboration by district,
state, or partner staf.
3. Acting on early indicators of success or failure.
Where leading indicators show that an efort is
not on track, states and districts must be will-
ing to provide targeted intervention and, if that
fails, pursue dramatic change. Early indicators
of success in turnaround schools might prompt
decreased monitoring, performance rewards, or
opportunities for highly capable leaders to extend
their reach to more students. Early indicators of
failure, on the other hand, should lead to targeted
assistance or a new attempt at major change.
4. Collecting mountains of data, and narrowing
to the most predictive over time. Because success
factors in school turnarounds are just beginning
to be understood, district and state leaders should
begin with expansive data collection on numer-
ous possible leading indicators, and narrow the
list over time to those indicators that have the
strongest and most persistent connections to stu-
dent success.
• 5
Introduction
I
n too many schools across the country, we
fail to equip our students with the skills they need
to succeed in college, work, and life. In elementary
and middle school, far too few students receive
the basic foundation necessary to prepare them for
the demands of high school. Nationwide, profciency
rates among elementary and middle school students in
reading and math hover between 20 and 50 percent.1
Of the students who make it to high school, too many
fail to graduate: one in 10 American high schools lose
more than 40 percent of their students between ninth
and 12th grades.2 Students who do graduate from high
school ofen leave without the necessary skills to thrive
in college or the workforce: more than one-third of all
college students require remedial courses to acquire
basic skills, and minority and low-income students are
even more likely to need remediation.3
These national and state averages mask signifcant
diferences in the quality of education provided to stu-
dents in individual districts and schools. An enormous
number of students are trapped in persistently low-
achieving elementary and middle schools and “dropout
factory” high schools, which serve high proportions of
students failing to meet state standards year afer year.4
Even though the number of such schools has decreased
in recent years, the rate of progress is far too slow to
meet national goals for high school graduation and
postsecondary education.5
Our nation has struggled for decades to solve the
intractable problem of dramatically improving these
chronically failing schools. Although there are noted
exceptions, the vast majority of the lowest performing
schools have not changed course, either because they
have received insufcient support or they have tried
weak or only piecemeal interventions.
In response to a heightened awareness nationally
about the consequences of our persistently low-achiev-
ing schools, policymakers have increasingly focused
their eforts on “turnarounds,” one strategy for rapid,
dramatic improvement typically led by a new principal
with a new or newly empowered staf.6 Today, this ap-
proach is central to federal education policy and to
reform eforts in many states and districts, with specifc
calls to turn around the 5,000 lowest achieving schools
nationwide.7
This goal may seem daunting, given the dismal suc-
cess rates of school improvement eforts of past years.
Even outside education — in for-proft businesses, non-
proft organizations and government agencies — bad-to-
great turnaround and “major change” eforts succeed
only about 30 percent of the time. If turnarounds are
more difcult in public education due to restrictive pol-
icies, talent shortages, and other constraints, the success
rate of school turnarounds may well be even lower, and
perhaps signifcantly lower.8
Does this mean the situation is hopeless? Are we
doomed to a success rate no better than 20 or 30
percent?
The answer depends on a critical variable: the speed
with which we “retry” change when our initial attempts
fall short.9 If we allow unsuccessful schools to languish
in improvement for fve years or more, our cumulative
success rate in turnarounds will indeed hover around
Policymakers are increasingly
focusing on “turnarounds” as a
strategy for rapid, dramatic
improvement in persistently
low-achieving schools.
6 • le adi ng i ndi cators of school tur narounds
20 or 30 percent, if that. But if we spot schools that are
of-track early and quickly redirect major change ef-
forts, we can do much better over time.
Even if only 30 percent of individual turnaround
attempts succeed, by redirecting turnaround eforts
in schools that are not on the right track we could
increase the cumulative success rate dramatically over
time.10
To retry major change more rapidly, though, leaders
need information about which turnaround eforts are
on a path to success or failure. In any major change ef-
fort, there are early signs — leading indicators — that
an organization is on the right track, or is doomed to
become a statistic. These early signs matter particularly
in the turnaround context, where dramatic improve-
ments rely in large part on changes and activities that
take place in the frst few weeks and months of the
efort.11 In education, we can make much better use of
leading indicators to diferentiate which turnaround
eforts are going well, and which require redirection.
With more and better information about successes and
failures early in the efort, district leaders, state depart-
ments of education, and other partners will be able to
take action in turnaround schools to increase cumula-
tive success rates over time. Although some evidence
suggests it can take three to fve years to see the full
impact of a successful turnaround efort, leading indica-
tors allow us to gauge, far earlier, which schools will
end up succeeding and which are destined for failure.
In this way, leading indicators empower education of-
cials with a strong basis for intervening in turnarounds
without waiting several years to examine results.
Lessons from Other Sectors about
Leading Indicators in Education
Most education leaders are not accustomed to think-
ing about, collecting, or using leading indicators in
meaningful ways. Improvement eforts in education
are typically designed to permit extended periods of
failure before leaders intervene with major change
(such as with a new leader, charter operator, or diferent
governance structure), even in schools where very few
students meet learning standards. Indeed, the current
iteration of the Elementary and Secondary Education
Act codifes six years of continued failure without
major improvement as an acceptable timeframe.12
The current federal administration has begun to
use the concept of leading indicators to track major
change eforts in schools, by requiring states and dis-
tricts that receive School Improvement Grant funds to
report data annually about a number of early factors
that may afect learning gains, including student atten-
dance, behavior, and school learning environments.13
But the development, use, and refnement of leading
indicators as a tool for enhancing the success of school
turnarounds-in-progress remain largely uncharted ter-
ritory. Fortunately, other sectors ofer strong lessons
for education as we move forward with the design and
implementation of systems and decision-making pro-
cesses tied to leading indicators. In the private sector,
organizations use leading indicators to intervene early
and forcefully to maximize returns on invested dollars.
Shouldn’t schools act just as decisively when children’s
futures hang in the balance?
In this report, we summarize the research and expe-
rience from other settings in which leaders have long
relied on leading indicators to enhance the likelihood
of success. These settings include venture capital, fran-
chising, and research and development in industries
such as pharmaceuticals.14 In these settings, organiza-
With more and better informa-
tion about successes and
failures early in turnaround
eforts, district leaders, state
departments of education, and
other partners will be able to
take action to increase schools’
cumulative success rates over
time.
le adi ng i ndi cators of school tur narounds • 7
tions have developed systems to use leading indicators
for making decisions that preserve time and money
and improve fnancial and sofer outcomes. We look
to these settings because they resemble turnarounds
in key respects: with new initiatives operating under
intense pressure, low probabilities of success, and much
at stake. In addition, while there is a limited research
base on school turnarounds and the use of leading indi-
cators in education, vast literature exists on the design
and use of leading indicators to inform key decisions
and improve outcomes in other public (non-education),
business, and nonproft organizations. Although the
indicators themselves can generally not be cut and
pasted into the school turnaround context, the prin-
ciples and processes used in other sectors provide critical
guidance for designing and using a unique set of indica-
tors in education.
8 • le adi ng i ndi cators of school tur narounds
Designing Leading Indicator
Systems for Turnaround
Schools
H
ow can we meaningfully integrate
leading indicators into education turn-
arounds? In other sectors, three general
steps shape the design and implementa-
tion of efective systems.
1. First, leaders identify a set of starting leading
indicators based on known success factors in
the industry and the nature of the venture being
monitored.
2. Second, they zealously monitor these indicators
for signs of impending success or failure.
3. Finally, they act on what the indicators reveal,
using data to target assistance, modify invest-
ments, or redirect focus.
In the following sections, we discuss each of these
steps in turn. For each, we examine the methods used
in other sectors and ofer initial thoughts about how
they might apply to turnarounds in education.
What Principles Should Guide Selection
of Leading Indicators?
A core set of principles guides the selection of lead-
ing indicators in other sectors. These principles can
provide crucial guidance for district and state leaders
to choose leading indicators for school turnarounds.
Leading indicators should be:
• based on known success factors in similar settings;
• constantly evolving to predict success at each stage;
• tailored to specifc circumstances and settings; and
• based on specifc timetables.15
In Table 1 on page 13, we build on the following fac-
tors known to contribute to successful turnarounds in
education, to present suggestions for district, state, and
other education leaders to identify leading indicators
for their own turnaround schools.
Leading indicator principle #1: Based on known
success factors.
Across a variety of industries, investors and organiza-
tion leaders choose leading indicators based on factors
that have been shown to contribute to organizational
success in the past. These factors may be backed by
rigorous research, be generally accepted in the feld, or
arise from the leader’s own previous experiences. No
matter the source, leaders have good reason to believe
that certain early factors will contribute to the success
of a new venture — whether a new investment, fran-
chise, or research initiative — and watch them to track
early progress. State, district, and other education lead-
ers can use these same types of success factors to track
progress in turnaround schools.
In other settings, research, time, and experience
have shown three primary factors — the characteristics
of the leader, the makeup of the management team, and
the organization’s connections with key players and
resources — to consistently predict the success or failure
of a new venture (see “Identifying Success Factors in
Other Industries”).
The education sector still has a lot to learn about
which factors matter most for successful school turn-
arounds. But an emerging research base, drawing
from experience in other sectors as well as successful
turnaround schools, is beginning to clarify several key
le adi ng i ndi cators of school tur narounds • 9
factors that are necessary for success. These fndings
are not dissimilar to the known success factors in low-
probability events from other sectors. They include the
skills, habits, and behaviors of turnaround leaders criti-
cal to their ability to turn the school around; the series
of actions that education leaders should be able to ob-
serve in the school if the turnaround is truly on track;
and the support and fexibility that the school leader
receives from the external environment, including the
district and/or the state.
Turnaround leader competencies. Research suggests
that the competencies of successful turnaround leaders
difer from those of successful leaders in already high-
performing organizations. By examining these patterns
of thinking, feeling, acting, and speaking, district and
Identifying Success Factors in Other Industries
In other industries, leaders rely upon research, time, and experience to identify key characteristics and
behaviors that have been shown to predict success in a new venture. In franchising and venture capital, for
example, leaders keep a close eye on three major factors to learn whether their investments are on track:
Leader characteristics. Through research, time, and experience, venture capitalists have discovered that
certain qualities of entrepreneurs consistently predict the success or failure of new ventures. In their
initial selection of portfolios, venture investors typically pay close attention to these characteristics in
the leader — such as evidence of staying power, ambition, ability to handle risk, and attention to detail.16
Many also monitor the degree to which entrepreneurs engage in behaviors that demonstrate these quali-
ties, relying on these as leading indicators of success or failure for the venture.17
Makeup of the management team. Smart investors know that the completeness of a venture’s leadership
team and its combined experience will be crucial to the organization’s progress. Indeed, research in other
sectors has confrmed a crucial connection between the makeup of a new leadership team and the com-
pany’s success.18 In their initial investment decisions, they therefore pay attention to the size of the team,
any previous experience members may have working together, and the chemistry between entrepreneurs
and their teams.19 Afer making an investment, they will also continue to monitor team size, relationships,
and functioning as indicators of organizational health and progress.20
Connectedness with key players and resources. Research across sectors has shown that successful companies
establish close ties with external organizations, including actual and potential customers, partners, and
other allies.21 As they track the progress of their investments or franchisees, therefore, investors ofen
gather data about the organization’s ability to attract and maintain these ties as early evidence about
whether external alliances will help the venture succeed.22
Several key factors that are neces-
sary for turnaround success include:
• the skills, habits, and behaviors
of turnaround leaders;
• the series of actions that turn-
around leaders take; and
• the support and fexibility that
the school leader receives to do
things diferently.
10 • le adi ng i ndi cators of school tur narounds
state leaders can both identify and monitor principals
who will have the best chance of success. The compe-
tencies of a turnaround leader include:
• Driving for results — the leader’s strong desire to
achieve outstanding results and the task-oriented
actions required for success.
• Infuencing for results — motivating others and in-
fuencing their thinking and behavior to obtain
results. Turnaround leaders cannot accomplish
change alone, but instead must rely on the work
of others.
• Engaging in problem solving — including analysis
of data to inform decisions; making clear, logical
plans that people can follow; and ensuring a strong
connection between school learning goals and class-
room activity.
• Showing confdence to lead — staying visibly fo-
cused, committed, and self-assured despite the bar-
rage of personal and professional attacks common
during turnarounds.23
Turnaround leader actions. Research from across sec-
tors, including turnaround schools, suggests that suc-
cessful turnaround leaders also take a common set of
actions to dramatically improve organizations. These
actions include:
• Focusing on a few early wins — Successful turn-
around leaders choose a few high-priority goals
with visible payofs and use early success to gain
momentum, motivate staf, and disempower naysay-
ers. These wins must focus on high-priority, not pe-
ripheral, elements of organization performance. In
schools, examples might include achieving very high
attendance and low disciplinary rates in the frst two
months of the school year, or making huge leaps in
learning progress in a targeted academic area, such
as aiming by the end of the frst semester to have 90
percent of ffh-graders on track to make grade level
by year’s end.
• Breaking organization norms — In a failing organi-
zation, existing practices contribute to failure. Suc-
cessful turnaround leaders break rules and norms.
Deviating to achieve early wins shows that new ac-
tion gets new results.
• Pushing rapid-fre experimentation — Turnaround
leaders press a fast cycle of trying new tactics, dis-
carding failed tactics, and investing more in what
works. They resist touting mere progress as ultimate
success.
• Getting the right staf, righting the remainder —
Successful turnaround leaders typically do not
replace all or even most staf at the start, but they
ofen replace some key leaders who help organize
and drive change. For the remaining staf, change is
mandatory, not optional.
• Driving decisions with open-air data — Successful
turnaround leaders are focused, fearless data
hounds. They choose their initial goals based on
rigorous analysis. They report key staf results
openly and ofen. They require all staf who partici-
pate in decision-making to share periodic results in
open-air sessions, shifing discussions from excuse-
making and blaming to problem-solving.
• Leading a turnaround campaign — Leaders use a
consistent combination of motivating and maneu-
vering tactics that include communicating a positive
vision of success; helping staf personally feel the
problems customers feel; working through key infu-
encers; and silencing critics with speedy success.24
Evidence from early eforts suggests that some activ-
ities are common among school turnarounds regardless
of the specifc academic improvement goals the leader
identifes. Common focuses include improving the
school environment, student discipline, and staf be-
havior to create the conditions necessary for improved
learning outcomes.25 Specifc changes might include
making scheduling or policy adjustments that improve
student attendance; introducing and enforcing new be-
havior policies that dramatically reduce the number of
disciplinary incidents, enabling teachers and students
to focus on learning; or improving the school facility to
make better use of instructional space and facilitate or-
derly, efcient class transitions. These are not the “early
wins” described above, because by themselves they do
not dramatically improve student learning. But most
schools emerging from chronic failure need them to
enable improved learning outcomes for students in any
grade or subject. State and district leaders assessing a
le adi ng i ndi cators of school tur narounds • 11
turnaround’s likely success or failure will need to moni-
tor both the presence and success of these activities
very early on, along with any specifc steps required to
achieve the learning goals that the school leader identi-
fes (see Table 1 on page 13).
Support and fexibility. Evidence also demonstrates
that the district and state play an important role in
supporting turnaround eforts, by providing leaders
sufcient fexibility to do things diferently to dramati-
cally improve learning. Crucial district and/or state ac-
tions include granting turnaround leaders stafng and
operational autonomies up front. By giving the right
leaders the “big yes,” districts and states allow princi-
pals the freedom to hire and dismiss staf in accordance
with goals for the turnaround and what works for
the student population. Districts and states must also
provide support by monitoring and reporting on turn-
arounds — making sure that schools have access to the
right data, and building positive pressure through pub-
lic reporting of early results. In addition, district and
state leaders can aid turnaround eforts by proactively
engaging the community in radical change, in particu-
lar by providing a stark look at current failure, creating
a vision for the future, and publicizing early wins.26
Leading indicator principle #2: Constantly evolving
to better predict success.
Successful organizations in other sectors continually re-
assess and redefne the individual indicators they use to
track a venture’s success, to ensure that indicators can
predict success at each stage of the efort. Education
leaders can take the same approach by continually as-
sessing which indicators can predict success for school
turnarounds, and changing data collection in future
years accordingly.
In other settings, monitors and investors typically
begin the monitoring process by collecting and analyz-
ing mountains of data from a wide variety of sources,
and refning them over time. For example, research on
franchisors suggests that they collect both quantitative
and qualitative data franchise-wide, from franchisee
reports, site visits, inspections, and ratings.27 Similarly,
venture capitalists typically scrutinize a variety of data
on the entrepreneur and team, the product, its industry
and market, company fnancial performance and pro-
jections, business plans, and other factors.28
These large quantities of data enable leaders to
identify over time the indicators that can predict a ven-
ture, franchise, or new product’s prospects for success.
Experience with a particular entrepreneur or product
in development, as well as newly available research, in-
forms and limits the types of indicators leaders choose
to assess over time. For example, franchisors typically
refne their processes for selecting franchisees based on
previous franchisees’ successes and failures.29
Similarly, tests run to track the progress and ef-
fcacy of pharmaceutical products under development
evolve as the industry develops new tests and standards
based on past research and evolving standards.30 In
2006, drugmaker Pfzer lost more than a decade of re-
search and a billion dollars when it had to discontinue
research on a major new cardiovascular drug late in
the development process.31 Since then, and because of
Pfzer’s experience, new measures of product efective-
ness have been introduced earlier in the process to cut
12 • le adi ng i ndi cators of school tur narounds
of development of drugs in the same class that exhibit
similar characteristics.32
In education — particularly because the feld of
turnarounds is relatively new — ongoing assessment of
the connection between each indicator to schools’ ul-
timate success should inform data collection in future
years. For example, do the leader competencies outlined
above prepare school principals to more successfully
carry out a turnaround? Are some more important
than others? How important is it to establish precondi-
tions for learning gains, such as improvements to the
school facility, use of time, or student behavior? What
other factors predict success or failure? Is there a real
“implementation gap” before certain types of gains
will materialize? Only by beginning to track each of
these types of indicators and tie them to results will
the education feld be able to refne a consistent set
of leading indicators of school turnaround. Based on
that knowledge, district and state leaders will be able
to focus on some indicators, introduce some new ones,
and drop others in future years. As in other sectors, the
design and use of leading indicators in education will
evolve as more information becomes available about
implementation hurdles and the expected timing of
improvements.
Leading indicator principle #3: Tailored to specifc
circumstances and settings.
No one-size-fts-all set of leading indicators exists,
even within individual industries. Rather, indicators
are fnely tailored based on industry-, market-, and
situation-specifc predictors of success.33 In education,
state and district leaders can be similarly responsive to
individual schools by working with school leaders to
identify specifc benchmarks and goals for each school.
Initial indicators should be based on starting data, the
specifc goals for early wins, and the steps needed to
achieve those goals in light of the challenges at each
school.
In the venture capital setting, for example, investors
typically analyze potential investments carefully. This
initial analysis — which may include data about the po-
sitioning of a product in the target market, anticipated
competition, and foreseeable roadblocks — then serves
as a guide for evaluating the organization and forms the
basis of post-investment monitoring.34 In pharmaceuti-
cal R&D, companies also vary the indicators they use
to track the progress of an innovation based on the na-
ture of the product, including its chemical complexity,
how long it will take to develop, and the type of health
problem it is designed to address.35 The company’s own
tolerance for risk also determines to some extent what
indicators it tracks, with those with lower tolerance
requiring much more data about a product up front.36
In both settings, individual investors or monitors and
the organizations they oversee determine what is most
signifcant and how best to measure it.
Similarly, in school turnarounds, there are a num-
ber of indicators worth tracking in every turnaround
school, as well as indicators specifc to each school’s
plan for achieving early wins and later goals. Table 1
(page 13) proposes an initial set of common indicators,
based on the factors that research suggests contribute
to successful turnarounds, to inform the approach that
district and state leaders take in all of their turnaround
schools. Within these factors, however, specifc goals
and benchmarks will likely difer for each school, de-
pending on where their students are starting, early win
goals, and the specifc challenges they face.
For example, interim benchmarks on student
achievement are critical indicators of any school’s
progress. But midyear targets and steps to achieve them
for individual schools will depend on each school’s
baseline data. A school in which 5 percent of students
scored “profcient” in math in the previous year will
have a diferent target for midyear assessments than
a school in which 40 percent were profcient. It also
Research and experience suggest
several common indicators worth
tracking in every turnaround
school, as well as others specifc to
each school’s plan for achieving
early wins and later goals.
Success Factor Leading Indicator
Leaders exhibit turnaround competencies
Competency Cluster (each includes one to four
related competencies)40
•
Driving for results
•
Infuencing for results
•
Engaging in problem solving
•
Showing confdence to lead
•
School leader’s overall rating on each competency
•
Leader’s rating within each cluster of related competencies
Leaders take specific turnaround actions
•
Focusing on a limited set of high-priority short-
term goals
•
Signaling the magnitude and urgency of dramatic
change
•
Discarding failed rules and routines and deploying
new tactics for early wins
•
Releasing or redeploying staf not fully committed
to the turnaround; bringing in new staf who can
help organize and drive change
•
Infuencing stakeholders to support turnaround
actions
•
Quickly trying new tactics and discarding failed
ones, investing in what works
•
Driving decisions by openly reporting staf results
and sharing results in open-air sessions
•
Ratings on the degree to which the leader engages in each action
•
Teacher turnover rates (voluntary/involuntary)
Leaders make a turnaround plan to achieve early wins and later goals
•
Plan is based on review of data, addresses
implementation of turnaround success actions
•
Plan includes goals (early-win and later) and
detailed steps for all
•
Leader and all staf take steps according to plan
•
Existence of a plan including turnaround success actions
•
Level of clarity and detail in goals, steps, and timing for all staf
•
Ratings of timeliness of actions to implement steps in plan
•
Existence of systems to regularly collect, analyze, and use data
Schools achieve preconditions for learning gains
•
Improved instructional quality
•
Distribution of teacher quality
•
Percentage of students taught by highly efective teachers
•
Number of instructional minutes
•
Students in AP/IB/dual-enrollment classes
•
Increased participation in school
•
Student attendance
•
Teacher attendance
•
Truants
•
Student turnover rates
•
Dropout rate
•
Participation on state assessments
•
Improved school culture
•
Discipline incidents
•
Student waiting list (if applicable)
•
Student, teacher, and parent satisfaction
Schools achieve early wins related to high-priority goals41
•
State test results
•
Benchmark test results and short-cycle assessments
•
Other indicators based on school-specifc, early-win goals42
table 1. Initial Set of Leading Indicators for Turnaround Schools
14 • le adi ng i ndi cators of school tur narounds
might have diferent early-win goals, perhaps focus-
ing on achieving extreme gains in one gateway grade.
These diferences in goals and the steps needed to
achieve them would require diferent indicators, which
would be apparent from each school’s turnaround plan.
Even if district and state leaders set the same ultimate
expectations for both schools, they may rightly expect
diferent paths to those goals based on each school’s
starting point.
Research suggests that successful turnaround lead-
ers analyze a variety of data early on to develop detailed
plans that explain to every actor what actions are
needed, focusing frst on steps to achieve early wins.37
The specifc steps in these plans, as well as the existence
of the plan itself, produce one large category of lead-
ing indicators that are common for the earliest phase
of any turnaround. Afer a school achieves early wins,
the steps needed to broaden success to other grades
and subjects become indicators of success for the next
phase. The particular focus of those steps will likely
difer from school to school.
For example, an elementary principal may decide to
zero in on third-grade reading, or even on a particular
reading skill, as a frst priority, while another may focus
on ffh-grade math in year one. Both schools are likely
to set goals for all grades, but expect rapid, momentum-
building gains in a few strategically targeted grade
levels and subjects. Similarly, a high school may place
a special emphasis on reducing behavioral incidents in
the fall because of their prevalence in past years, while
another focuses on boosting attendance. Both schools
are likely to have goals for behavior and attendance,
but the expectations for improvement in one or the
other will vary based on the school’s specifc challenges.
Some principals may also set their own unique goals
that respond directly to special needs at the school,
using data to identify root causes of students’ struggles
and inform the most appropriate solutions. The bot-
le adi ng i ndi cators of school tur narounds • 15
tom row of Table 1 refects the importance of tailoring
these goals to specifc circumstances and student needs
rather than basing them on end-of-year data alone.
Leading indicator principle #4: Based on specifc
timetables.
In addition to measuring steps and milestones toward
outcomes, organization leaders in other sectors ofen
monitor when particular steps in the process occur.
Venture capitalists ofen want to know, for example,
that a new venture has sufcient time to actualize its
plans and enter the market in a position of strength,
and so will monitor whether the venture stays ahead of
others in the feld or needs to catch up.38
Venture capitalist Russ Siegelman explains how his
venture capital frm stages investments around mile-
stones, using the example of a medical device company.
“They had to build [a] device and show it could be
used in an animal study. …We put in one million up
front, another million to build the prototype, and the
third million for the animal study.” If the company
had shown signs of impending failure afer the initial
investment, Siegelman’s frm could have exited having
invested $1 million — no small loss — but being free
to direct the remaining $2 million to more promising
opportunities.39
Timetables are similarly relevant in turnaround
schools. In particular, the timing of some leader actions
is critical to their impact on the turnaround efort. For
example, achieving focused, early-win goals with vis-
ible payofs is most important early in the year. Early
victories will be more efective for building momentum
and disempowering naysayers if they occur in the frst
half of the year than in January or March. Likewise,
the steps in the plan leading toward achieving those
early-win goals must start very early in the school year.
Similarly, the common preconditions for learning
gains outlined above should improve dramatically in
the early months to set the stage for early wins. If those
preconditions come about only at the end of the frst
year, it is less likely that the school will achieve desired
learning gains. For all of these types of indicators,
therefore, district and state leaders must monitor not
only whether the steps and victories occur, but when.
How Should Schools and Districts Monitor
Leading Indicators?
Settling on a set of leading indicators is only the frst
step in forecasting the likely success or failure of a turn-
around efort. The second, equally crucial step is moni-
toring each individual indicator: setting guideposts and
using them to analyze indicators along the implementa-
tion path. Tracking progress and measuring interim
steps and outcomes enable midcourse corrections and
keep the spotlight on variables that predict long-term
performance. From other sectors, we learn that organi-
zations monitor leading indicators frequently, engage
in hands-on data-gathering, and tailor their monitor-
ing to individual circumstances.
Frequent. Rather than waiting for the end of a quar-
ter or a year to examine results, leaders in other settings
monitor progress frequently and on an ongoing basis.
Frequent oversight creates accountability for those
whose performance is being tracked, but also enables
monitors to determine how best to intervene. Monitor-
ing might reveal a need for greater oversight, bumped-
up reporting requirements, or more dramatic interven-
tions such as shifs in strategy or leader replacement.
In research and development, for example, many
companies establish monitoring timelines for new
products based on specifc stages of development,
which may occur in a matter of days, weeks, or months.
Arriving at each new stage triggers a new round of
monitoring to evaluate progress.43
Venture capitalists sometimes use “staged fnancing”
to condition continued funding on early success. Each
stage involves monitoring and reevaluating the venture
Experience fom other sectors
suggests that education leaders
should monitor indicators in
turnaround schools early and
ofen, on at least a monthly or
quarterly basis.
16 • le adi ng i ndi cators of school tur narounds
against preset expectations, as well as ongoing monitor-
ing during each stage to inform the next funding deci-
sion. For example, in the early days of Federal Express,
venture capitalists invested an initial $12.25 million in
the company. Just six months later, in early 1974, the
company was failing to achieve necessary progress on
several leading indicators, and so investors put in only
$6.4 million, much lower than FedEx leaders expected.
Afer another six months, investors intervened exten-
sively in company strategy and only then invested an
additional $3.88 million. The company turned around
and achieved success, going public in 1978.44 At each
stage, frequent, in-depth monitoring allowed venture
capitalists to base their recurring investments on the
company’s performance and progress.
In schools, one of the primary transitions from
traditional accountability eforts to tracking leading
indicators is to measure earlier and increase the fre-
quency of monitoring. Given the typical timetables
for intervention in state and federal policy, increasing
monitoring eforts to track leading indicators on even
an annual basis could be considered an improvement,
and would likely increase turnaround success rates
somewhat. But as illustrated in Table 1 on page 13, the
most powerful way to dramatically increase overall
success rates over time is by making decisions much
earlier in the turnaround efort. Experience from other
successful organizations suggests that to make these
types of decisions in education, state and district lead-
ers would need to monitor indicators in turnaround
schools much earlier and more frequently, such as on a
monthly or quarterly basis.
It may not be feasible or practical to monitor all
indicators this frequently — for example, dropout
rates and student results on state assessments may
be available only once a year, and results on interim
assessments may be available only once every six or
eight weeks. But other indicators, such as student and
teacher attendance, or a leader’s action toward early
high-priority goals, could be tracked earlier and much
more frequently. In addition, districts can aim to make
interim assessment data available to educators more
regularly, particularly for high-priority subjects.45
In Table 2 (page 17), we propose a timetable to
guide tracking of leading indicators in turnaround
schools. Most indicators are designed to be tracked on
a quarterly basis, with some once or twice each year.
Many districts may fnd that more frequent — even
weekly — collection of some types of data is crucial
to fully understanding a school’s progress. Education
leaders can tailor this timetable to the indicators they
select, the availability of data, and other factors in their
state or district.
It is worth noting that in other sectors, this type of
monitoring ofen involves substantial time and efort.
Venture capitalists, for example, spend up to 25 per-
cent of their time on monitoring.46 A typical venture
capitalist might visit the site of each investment once
a month for four to fve hours per visit.47 School turn-
around eforts likely need more frequent visits, and
state and district staf will need to spend more time
monitoring than most spend today.
Hands-on. While organization leaders in other
sectors ofen rely on some level of passive engagement
le adi ng i ndi cators of school tur narounds • 17
Success Factor Leading Indicator
Leaders exhibit turnaround
competencies
•
School leader’s overall rating on each
competency
•
Leader’s rating in each cluster of
competencies
•
Competency assessments that
rate leader on quantitative
scales (e.g., interview,
360-degree review)
•
At placement prior
to year 1
•
December/January
in year 1
•
Annually thereafer
Leaders take turnaround
success actions
•
Ratings on the degree to which the
leader engages in each action
•
School visits and interviews
•
Quarterly
•
Teacher turnover rates
•
School- or district-reported
data about voluntary and
involuntary turnover
Leaders make turnaround
plans to achieve early-win
and later goals
•
Existence of a plan including turnaround
success actions
•
Level of clarity and detail in goals, steps,
and timing for all staf
•
Ratings of timeliness of actions to
implement steps in plan
•
Existence of systems to regularly collect,
analyze, and use data
•
Structured assessment:
existence and content of
written plan and data systems
•
School visits, interviews, and
surveys to assess plan follow-
through
•
Written plan by
school opening
•
Action quarterly in
year 1; semiannually
thereafer
Schools achieve
preconditions for learning
gains
•
Distribution of teacher quality (SIG)
•
Percentage of students taught by highly
efective teachers
•
Ratings on LEA teacher
evaluation system
•
Student enrollment data
•
Annually
•
Number of instructional minutes (SIG)
•
Students in AP/IB/dual-enrollment
classes (SIG)
•
School- or district-reported
data
•
Student attendance (SIG)
•
Teacher attendance (SIG)
•
Truants (SIG)
•
Student turnover rates
•
School- or district-reported
data
•
Quarterly
•
Dropout rate (SIG)
•
Participation on state assessments (SIG)
•
Annually
•
Discipline incidents (SIG)
•
Student waiting list (if applicable)
•
School- or district-reported
data
•
Quarterly
•
Student, teacher, and parent satisfaction
•
Student, teacher, and parent
surveys
•
Survey response rates
Schools achieve early wins
related to high-priority
goals
•
Benchmark test results
•
School- or district-reported
data
•
Quarterly
•
Short-cycle assessments
•
Weekly, biweekly,
monthly
•
Other indicators based on school-
specifc goals
•
Quarterly
•
State test results
•
Annually
*(SIG) denotes indicators that are required to be reported annually under the federal School Improvement Grant program.
table 2. Monitoring Leading Indicators: Expected Measurement and Timetables
18 • le adi ng i ndi cators of school tur narounds
to track the progress of their investments — such as col-
lecting and reviewing fnancial reports and other data
of-site at regular intervals — they also tend to become
involved in the ventures they are monitoring.48 This
hands-on involvement generates various benefts, in-
cluding valuable, ongoing information about the orga-
nizations in which they have invested.
Venture capitalists in particular are ofen intimately
involved in their investment companies. In addition
to the monitoring activities and site visits noted above,
they ofen serve on boards, meet with customers and
suppliers, act as consultants, recruit management, and
assist with networking.49 Each of these roles takes time
and resources, but they enable venture capitalists to
gather valuable day-to-day information about the frm’s
progress on many fronts.50
In fact, venture capital frms
ofen take geographic proximity into account in select-
ing investments, to make frequent monitoring more
feasible. It is easier to drop in and talk with the leader
of a new venture if he is located right down the road,
rather than across the country.51
In education, monitoring should similarly involve
more than “desktop audits.” While quantitative data
that feeds automatically to district- or state-level
dashboards is a critical component of progress moni-
toring, qualitative data and information that results
only from on-site visits will ofer crucial insight into
how turnaround schools are progressing. District
and/or state monitoring staf should plan to conduct
regular site visits in turnaround schools, to conduct
interviews with the school leader and teachers, and to
visit with students and staf. In addition to providing
an opportunity for observation and data collection,
frequent visits will also allow district and/or state staf
to build relationships with school leaders and hold
them accountable for turnaround actions and expected
progress. Site visits will also enable district leaders to
see the reasons behind the data provided in desktop
audits, and respond accordingly. And site visits will
provide opportunities for district and state staf to pro-
vide active assistance, such as by connecting leaders to
potential partners and other resources, identifying and
helping to remove barriers, and ofering advice.
Surveys may also be a helpful way to gauge progress
and perceptions among the school’s staf, students, par-
ents, partners, and even members of the surrounding
community. We include a timetable for site visits, inter-
views, and surveys in Table 2 (page 17) to enable educa-
tion leaders to beneft from much more sophisticated
information than quantitative reports.
Tailored to needs and current circumstances.
Across industries, organization leaders and investors
tailor their monitoring approaches over time based on
information they receive about a venture’s status and
future prospects. In schools, as well, the frequency
and rigor of monitoring may best be tailored to the
degree of success the school shows in early stages of the
turnaround.
In early 2011, the frst-ever longitudinal study of de-
cision-making in venture capital investment found that
the processes investors used to evaluate their invest-
ments changed over time as a result of lessons learned
within the venture capital frm.52 As new ventures
mature and demonstrate their ability to succeed, inves-
tors typically increase the duration of their investments
and reduce the intensity of their monitoring eforts.53
Similarly, as companies show signs of failure, venture
capitalists ofen scale back the level or duration of in-
vestments and impose stricter controls or more intense
monitoring on their ventures, such as by increasing
contractual control over the venture or representation
on its board.54
Franchisors also typically increase the frequency of
their monitoring and data collection when problems
occur, allowing them to act more rapidly based upon
current information.55 And in R&D, when monitor-
ing reveals that early phases of a research efort are not
proceeding as planned, researchers rapidly modify re-
Site visits provide opportunities
to provide active assistance, such
as by connecting school leaders to
potential partners and other re-
sources, and by identifying and
helping to remove barriers.
le adi ng i ndi cators of school tur narounds • 19
search plans based on the early results, instead of stick-
ing to plans that have shown diminishing prospects of
success.56
The same principles apply to schools, where it may
not be necessary to monitor all indicators with the
same frequency in every school. If a school is on the
right track in year one, monitoring on several indica-
tors may decrease in year two. On the other hand, if
a leader encounters new challenges midway through
the year, district leaders should pay closer attention to
relevant indicators for several months thereafer. With
regular, hands-on monitoring, district and state lead-
ers will have better access to data that enable informed
decision-making about which indicators need more
close attention and which can reduce in intensity.
How Should Schools and Districts Put
Leading Indicators to Use?
Organizations in other sectors do more than just
develop and monitor leading indicators — they also
use what they learn to make strategic decisions that
alter operations and dramatically improve outcomes.
Empowered with more and better information about
progress in turnaround schools, education leaders will
be able to do the same.
Intervention or closure. Leaders use leading indica-
tors to inform and direct intervention in organizations
that are not on the right track. In education, district
and state leaders can dramatically increase the success
rate of school turnarounds by taking similar action
based on the information collected through leading
indicators.
In other sectors, indicators sometimes provide a
“red fag” that warns monitors or investors about the
need for serious changes in the organization or its
direction — for example in franchising, where low ini-
tial sales or high volatility may alone trigger action.57
At other times, multiple indicators must be viewed
together as a package — such as when sales are only
slightly lower than expected, but employee turnover
and customer complaints are high. In many cases,
though no single indicator alone mandates action, the
totality of available information can support interven-
tion.58 Venture capitalist Russ Siegelman highlighted
When leading indicators show
that a school turnaround is not on
the right track, state and district
leaders should provide additional
assistance or targeted interven-
tion to address specifc challenges,
or retry major change with a new
leader or new approach.
20 • le adi ng i ndi cators of school tur narounds
the importance of fexibility by leaders of new startups:
“[T]he best [leaders] are willing to reexamine their
assumptions and are willing to veer lef or right or
pivot all the way around when the data suggests they’re
headed in the wrong direction. They amble around
until they fnd something good. The bad ones typically
get overcommitted or wed to a particular idea.”59
When leading indicators show that a new venture’s
leadership is making poor decisions or the organiza-
tion is heading of track, venture capitalists will ofen
increase their involvement in key management deci-
sions, require that more of the key leaders’ compensa-
tion be tied to future performance, or step in to replace
the leader with a better candidate.60 In extreme cases,
failure to meet key targets may lead funders to establish
additional or more onerous requirements for subse-
quent rounds of funding, or to discontinue investment
entirely.61
Franchisors ofen use leading indicators to inform
similar decisions, identifying performance gaps and
targeting struggling franchisees for hands-on assistance
through visits or advice, or revocation of the franchise
license.62 In these situations, organizations and their
funders respond to leading indicators with action, not
waiting for crises to balloon into full-blown failures.
For education leaders, when leading indicators show
that a school turnaround is not on the right track, op-
tions include providing additional assistance or targeted
intervention to address specifc challenges, or retrying
major change with a new leader or new approach.
Targeted assistance responds directly to a specifc
challenge at the school, and might include deploy-
ing a community coordinator to work alongside the
principal in addressing parents’ or other community
members’ concerns about the turnaround; providing
additional fexibility to accommodate a longer school
day or school year; or helping to remove or reassign se-
lect members of the school staf who fail to contribute
to the turnaround.
When early indicators reveal difculties, more
dramatic change may be needed. Major retry eforts
should respond to specifc challenges at the school, and
may include replacing the school leader with a proven
change leader or one with the right competencies for
a turnaround; contracting school operations to an
external provider that has demonstrated previous suc-
cess in similar schools, such as a charter management
organization; or, when feasible, closing the school and
reassigning students to higher-performing schools.63
Decreased monitoring or increased reward. In
organizations where leading indicators show early,
dramatic success, investors or monitors ofen decrease
monitoring or trust that the organization will not
require major intervention or modifcation of exist-
ing plans. In education, district and state leaders can
similarly decrease monitoring or ofer rewards to
turnaround schools that demonstrate early, signifcant
success.
In many other sectors, rapid growth in the early
stages of development is a strong early sign of later suc-
cess: New ventures beneft from establishing positions
quickly, and strong early performance allows them to
rapidly generate large revenue streams.64 Franchises also
rely on early, rapid growth to achieve efciencies associ-
ated with larger scale.65 When franchisors and investors
see this type of growth, therefore, they ofen reduce
their frequency of monitoring or the degree of hands-
on involvement.
Positive results on leading indicators can also serve
as “green lights,” prompting continued development,
and, in some cases, increased fnancial investment. In
R&D, positive results at early stages allow products to
continue moving along development pipelines.66 For
venture capitalists, strong early results confrm pre-
investment judgments of promise and justify continued
investment.67
The same principles can apply to education. In turn-
around schools that are on track, quarterly monitoring
of some indicators might drop to once or twice a year,
reducing the reporting burden and level of scrutiny in
successful schools. District or state leaders could also
recognize a turnaround leader’s success with a perfor-
mance bonus, or extend the reach of highly capable
leaders by allowing them to oversee turnaround eforts
in more than one school.
Ultimately, this is where leading indicators become
most powerful: in empowering district and state lead-
ers with timely data to make decisions about how to
ensure greater turnaround success, faster and in more
schools.
le adi ng i ndi cators of school tur narounds • 21
Key Actions for State
and District Leaders
F
ederal, state, and local education
leaders across the country have become com-
mitted to dramatically improving outcomes
for students in chronically low-achieving
schools. But the odds are tough: Across sectors, major
change eforts have only about a 30 percent chance of
success.
To increase the odds for these students, education
leaders have a powerful tool: leading indicators that
predict the likely success or failure of turnaround ef-
forts. By collecting and acting upon more and better
information early in the efort, district leaders, state de-
partments of education, and other partners will be able
to take rapid actions that increase cumulative success
rates over time.
Research from other sectors that have broad experi-
ence with similar, low-probability events ofers several
key considerations to guide eforts in turnaround
schools. We summarize them here, and readers will
fnd more detail on each in the main body of this paper.
Start with known success factors. Develop sets of
leading indicators by examining factors with a demon-
strated impact on success. In turnaround schools, this
includes the competencies of the turnaround leader,
the leader’s actions, steps that all staf members take to
achieve goals according to the turnaround plan, and
common routines that must improve in any school
seeking learning gains.
Monitor schools frequently and intimately. Every
indicator may not need monitoring with the same
frequency, and not every school will require the same
intensity. But to gather and use leading indicators
meaningfully, most districts and states must monitor
turnaround schools much more ofen than they do
today, with monthly or quarterly data collection and
analysis. Monitoring should also be hands-on, involv-
ing site visits or other active engagement by district or
state staf.
Act on early indicators of success or failure. Lead-
ing indicators are most powerful when used to make
concrete decisions. When a turnaround is not on the
right track, leaders can use leading indicators to choose
the right assistance for addressing specifc challenges,
or to justify major change, such as replacing the leader,
contracting with an external provider, or closing the
school and reassigning students to higher-performing
schools nearby. Early and sustained success in turn-
around schools can lead to decreased monitoring,
performance rewards, and a greater reach for highly
capable leaders.
Collect mountains of data, and narrow to the
most predictive over time. Because the feld of school
turnarounds is so new and research is just emerging,
state and district leaders will need to begin collecting
data on a signifcant number of potential leading indi-
cators and narrow the list over time. By looking at root
causes and correlating an initial set of indicators with
student outcome data, researchers will be able to under-
stand which indicators are most useful. Over time, this
will allow a narrowing of leading indicators to those
most connected to success.
In addition, while the feld needs better informa-
tion about success and failure in school turnarounds
at the school level, leading indicators as a concept are
applicable at any level. The next generation of think-
ing about leading indicators should build on the same
lessons we outline here to identify and use indicators at
the district level, as well.
• 23
Notes
1. Based on National Assessment of Educational Progress
data presented in Editorial Projects in Education Research
Center (2009). Education Counts. Retrieved from http://
www.edcounts.org
2. Zuckerbrod, N. (2007, October 29). More than 1 in 10
high schools in America are “dropout factories.” Associated
Press. Retrieved fromhttp://www.usatoday.com/news/
nation/2007-10-29-1214322283_x.htm
3. Strong American Schools. (2008). Diploma to nowhere.
Washington, DC: Author. Retrieved fromhttp://www.
deltacostproject.org/resources/pdf/DiplomaToNowhere.pdf
4. Zuckerbrod, N. (2007, October 29); Balfanz, R.,
& Legters, N. (2004). Locating the dropout crisis: Which
high schools produce the nation’s dropouts? Where are they
located? Who attends them? Baltimore, MD: John Hopkins
University, Center for Social Organization of Schools;
Herman, R., Dawson, P., Dee, T., Greene, J., Maynard,
R., Redding, S., & Darwin, M. (2008). Turning around
chronically low-performing schools: A practice guide (NCEE
#2008-4020). Washington, DC: National Center for
Education Evaluation and Regional Assistance, Institute
of Education Sciences, U.S. Department of Education.
Retrieved fromhttp://ies.ed.gov/ncee/wwc/publications/
practiceguides
5. Balfanz, R., Bridgeland, J. M., Moore, L. A., & Fox, J.
H. (2010, November). Building a grad nation: Progress and
challenge in ending the high school dropout epidemic. Civic
Enterprises, Everyone Graduates Center at Johns Hopkins
University, and America’s Promise Alliance. Retrieved fromhttp://www.americaspromise.org/Our-Work/Grad-Nation/
Building-a-Grad-Nation.aspx
6. Maxwell, L. A. (2010, July 1). States, districts scramble
on turnaround deadline. Education Week. Retrieved fromhttp://www.edweek.org/ew/articles/2010/07/01/36sig.
h29.html?qs=turnaround; Aarons, D. (2010, May 10).
States, districts moving ahead on turnarounds (weblog
entry). Education Week. Retrieved fromhttp://blogs.
edweek.org/edweek/District_Dossier/2010/05/states_
districts_moving_ahead.html. Throughout this report, we
use the term “turnaround” not to refer specifcally to the
“turnaround” option under federal School Improvement
Grant and Race to the Top guidance, but rather the more
common usage in other sectors for a targeted strategy for
rapid, dramatic change.
7. Education Secretary Arne Duncan set a national goal of
turning around the 5,000 lowest-achieving schools as part of
an overall strategy for lowering the dropout rate, improving
high school graduation rates, and increasing college and
workforce readiness. See United States Department of
Education. (2009, August 29). Obama administration
announces historic opportunity to turn around nation’s
lowest-achieving public schools (press release). Washington,
DC: Author. Retrieved fromhttp://www.ed.gov/news/
press-releases/obama-administration-announces-historic-
opportunity-turn-around-nations-lowestac. Federal funding
that supports school closure and turnarounds includes:
Race to the Top funds ($4.35 billion in competitive grants
to states); School Improvement Grants ($3.55 billion
allocated to states according to a formula based on Title I
funding levels); and Investing in Innovation Fund (i3) ($0.65
billion in competitive grants awarded to nonprofts and
school districts to expand innovative and evidence-based
approaches that signifcantly improve student achievement).
8. Beer, M., & Nohria, N. (2000). Breaking the code of
change. Cambridge, MA: Harvard Business School Press.
9. Hassel, E. A., & Hassel, B. C. (2009). Try, try again:
How to triple the number of fxed failing schools without
getting any better at fxing schools. Chapel Hill, NC: Public
Impact. Retrieved fromhttp://www.publicimpact.com/
publications/Public_Impact_Try_Try_Again_Slide_
August_2009.pdf
10. Hassel & Hassel, Try, try again.
11. Hassel, E. A., & Hassel, B. C. (2009, Winter). The big
U-turn: How to bring schools from the brink of doom to
stellar success. Education Next, 9(1). Retrieved from http://
educationnext.org/the-big-uturn/; Rhim, L. M., Kowal,
J. M., Hassel, B. C., & Hassel, E. A. (Public Impact). (2007).
School turnarounds: A review of the cross-sector evidence on
dramatic organizational improvement. Lincoln, IL: Center
on Innovation & Improvement. Retrieved from http://
www.centerii.org/survey/downloads/Turnarounds-Color.
12. No Child Lef Behind Act of 2001, Pub. L. No.
107-110.
13. In 2009, the federal School Improvement Grant
program required grantees to report annually on several
indicators of school performance, including the distribution
of teachers by performance level on the LEA’s evaluation
system, dropout rate, participation rate on state assessments,
student attendance, teacher attendance, disciplinary
incidents, truancy rates, the number of instructional
minutes, and students enrolled in AP/IB/dual-enrollment
classes. U.S.Department of Education, Ofce of Elementary
and Secondary Education. (revised 2010, June 29).
Guidance on School Improvement Grants under Section
1003(g) of the Elementary and Secondary Education Act of
1965. Retrieved fromhttp://www2.ed.gov/programs/sif/
sigguidance05242010.pdf
24 • notes
14. There are a few notable diferences between these
industry settings and school turnarounds worth mentioning
here. While these do not diminish the utility of lessons
learned in other sectors, they do inform our careful analysis
of how they might apply in education. Most notable, of
course, is the option to abandon an investment that is
not showing success — although venture capitalists and
franchisors can cut ties with a venture that is not successful,
education leaders maintain an obligation to students no
matter the success of their school. They may abandon
a particular reform strategy or replace an individual
turnaround leader, but cannot simply pull students out of
low-performing schools and leave them on the sidelines
until new options present themselves. Organizations
in other sectors also typically have fexibilities available
that enable them to quickly redirect that schools ofen
do not have. We would argue, however, that where these
fexibilities are necessary to keep a change efort on track,
states and districts should grant similar autonomies to
schools where possible. Finally, the specifc measures used
as leading indicators in other sectors will ofen not translate
precisely, if at all, to schools — students cannot be evaluated
through the types of go/no-go tests used in research and
development, for example, and franchise success is more
likely to be linked to inputs and less likely to be tied to
process variables than success in schools. But as we explain
in our fndings, the principles that inform the selection
of leading indicators in other sectors apply directly to
the education setting as well, and can provide signifcant
guidance about the types of indicators we should be tracking
in schools.
15. For another set of proposed factors to guide the
selection of leading indicators, see Mass Insight Education,
Evaluating school turnaround: Establishing benchmarks
and metrics to assess school turnaround (Boston, MA:
author, 2010). Retrieved fromhttp://www.massinsight.org/
publications/stg-resources/117/
16. MacMillan, I. C., Siegel, R., & SubbaNarasimha,
P. N. (1985). Criteria used by venture capitalists to evaluate
new venture proposals. Journal of Business Venturing, 1(1),
119–128; Sykes, H. B. (1986). The anatomy of a corporate
venturing program: Factors infuencing success. Journal of
Business Venturing, 1(3), 275–293; Dubini, P. (1989). Which
venture capital backed entrepreneurs have the best chances
of succeeding? Journal of Business Venturing, 4(2), 123–132;
Baum, J. A. C., & Silverman, B. S. (2004). Picking winners
or building them? Alliance, intellectual, and human capital
as selection criteria in venture fnancing and performance
of biotechnology startups. Journal of Business Venturing,
19(3), 411–436, citing Byrne, J. A. (2000, July 24). How a
VC does it; Bob Davoli is a hands-on investor, and so far he
hasn’t picked a loser. Can he keep it up? Business Week. Also
see Zacharakis, A. L., & Meyer, G. D. (2000). The potential
of actuarial decision models: Can they improve the venture
capital investment decision? Journal of Business Venturing,
15(4), 323–346.
17. MacMillan, Siegel, & SubbaNarasimha, Criteria used
by venture capitalists.
18. Roure, J. B., & Keeley, R. H. (1990). Predictors
of success in new technology based ventures. Journal of
Business Venturing, 5(4), 201–220.
19. Roure & Keeley, Predictors of success, citing
Hackman, J. R., & Oldham, G. R. (1980). Work Redesign.
Reading, MA: Addison-Wesley.
20. Hall, J., & Hofer, C. W. (1993). Venture capitalists’
decision criteria in new venture evaluation. Journal of
Business Venturing, 8(1), 25–42.
21. Baum & Silverman, Picking winners or building
them?; Roure & Keeley, Predictors of success.
22. Baum & Silverman, Picking winners or building
them?; Roure & Keeley, Predictors of success.
23. Steiner, L. M., Hassel, E. A., & Hassel, B. C. (Public
Impact). (2008). School turnaround leaders: Competencies
for success. Chicago: The Chicago Public Education
Fund. Retrieved fromhttp://www.publicimpact.com/
turnaroundcompetencies.php
24. Hassel & Hassel, The big U-turn.
25. Herman, Dawson, Dee, Greene, Maynard, Redding,
& Darwin, Turning around chronically low-performing
schools; Public Impact. (2008). Chicago school turnarounds:
Final report. Chicago: Chicago Public Education Fund.
26. Kowal, J., Hassel, E. A., & Hassel, B. C. (Public
Impact). (2009, September 15). Successful school turnarounds:
Seven steps for district leaders. Washington, DC: The Center
for Comprehensive School Reform and Improvement, and
Learning Point Associates. Retrieved fromhttp://www.
centerforcsri.org/fles/CenterIssueBriefSept09.pdf
27. Chittley-Young, R. (2009, February). Analyze
this: Franchise performance indicators for tough times.
FranchiseVoice; Nigrini, M. J., & Johnson, A. J. (2008).
Using key performance indicators and risk measures in
continuous monitoring. Journal of Emerging Technologies in
Accounting, 5, 65–80.
28. Roure & Keeley, Predictors of success; Dubini, Which
venture capital backed entrepreneurs have the best chances
of succeeding?
29. Frazer, L., & Winzar, H. (2005). Exits and
expectations: Why disappointed franchisees leave. Journal of
Business Research, 58(11), 1534–1542.
30. Neuer, A. (2010). Optimizing value in clinical data
as standards evolve. Oracle Health Sciences. Retrieved
fromhttps://microsite.accenture.com/rdtransformation/
Documents/Accenture_Oracle_Clinical_Standards.pdf
31. Berenson, A. (2006, December 3). Pfzer ends studies
on drug for heart disease. The New York Times. Retrieved
fromhttp://www.nytimes.com/2006/12/03/health/03pfzer.
notes • 25
html?fa=y; Cortez, M. F., & Randall, T. (2010, November
10). Merck restarts cholesterol race four years afer Pfzer
failure. Bloomberg News. Retrieved fromhttp://www.
bloomberg.com/news/2010-11-10/merck-restarts-cholesterol-
race-four-years-afer-pfzer-failure.html
32. Interview with Julie Fields Liu, director, Research
Management, CoNCERT Pharmaceuticals, Inc., conducted
January 5, 2011; Cortez & Randall, Merck Restarts
Cholesterol Race.
33. For discussion of product characteristics that
predict success, see Roure & Keeley, Predictors of success;
MacMillan, Siegel, & SubbaNarasimha, Criteria used by
venture capitalists; Baum & Silverman, Picking winners
or building them?; and Roberts, M. J., & Barley, L.
(2004). How venture capitalists evaluate potential venture
opportunities (Harvard Business School Case Study #9-805-
019). For discussion of market characteristics that predict
success, see MacMillan, Siegel, & SubbaNarasimha, Criteria
used by venture capitalists; Kaplan, S. N., & Stromberg, P.
(2004). Characteristics, contracts, and actions: Evidence
from venture capitalist analyses. The Journal of Finance,
59(5), 2177–2210; Zider, B. (1998, November-December).
How venture capital works. Harvard Business Review,
76(6), 131–139; Roberts & Barley, How venture capitalists
evaluate; Roure & Keeley, Predictors of success; Gartner,
W. B., Starr, J. A., & Bhat, S. (1998). Predicting new venture
survival: An analysis of “Anatomy of a start-up.” Cases from
Inc. magazine. Journal of Business Venturing, 14(2), 215–232;
MacMillan, I. C., Zemann, L., & SubbaNarasimha, P. N.
(1987). Criteria distinguishing successful from unsuccessful
ventures in the venture screening process. Journal of Business
Venturing, 2(2), 123–137; Shepherd, D. A. (1999). Venture
capitalists’ assessment of new venture survival. Management
Science, 45(5), 621–632.
34. Kaplan, S. N., & Stromberg, P. (2000, September).
How do venture capitalists choose and manage their
investments? Working paper, University of Chicago.
35. Bremser, W. G., & Barsky, N. P. (2004). Utilizing the
balanced scorecard for R&D performance measurement.
R&D Management, 34(3), 229–238; Ding, M., & Eliashberg,
J. (2002). Structuring the new product development
pipeline. Management Science, 48(3), 343–363; Kaplan &
Stromberg, How Do Venture Capitalists Choose?; interview
with Julie Fields Liu.
36. Interview with Julie Fields Liu; Chan, T., Nickerson,
J. A., & Owan, H. (2007). Strategic management of R&D
pipelines with cospecialized investments and technology
markets. Management Science, 53(4), 667–682; Kaplan &
Stromberg, How Do Venture Capitalists Choose?; Blau, G.,
Mehta, B., Bose, S., Pekny, J., Sinclair, G., Keunker, K., &
Bunch, P. (2000). Risk management in the development of
new products in highly regulated industries. Computers and
Chemical Engineering, 24(2-7), 659–664.
37. Rhim, Kowal, Hassel, & Hassel, School turnarounds.
38. Roberts & Barley, How venture capitalists evaluate.
39. Roberts & Barley, How venture capitalists evaluate.
40. For a full list of competencies within each cluster, see
Steiner, Hassel, & Hassel, School turnaround leaders.
41. For example, increasing third-grade reading
profciency rates by 35 points in the frst year.
42. For example, individual student-level progress over
time; percentage of students performing below grade
level, on track to reach grade level, at or above grade level;
acceleration of student progress; number of course failures.
43. Bremser & Barsky, Utilizing the balanced scorecard.
44. Gompers, P. A. (1995). Optimal investment,
monitoring, and the staging of venture capital. The Journal
of Finance, 50(5), 1461–1489.
45. See Bambrick-Santoyo, P. (2010). Driven by data:
A practical guide to improve instruction. San Francisco:
Jossey-Bass. Also see successful i3 application submitted by
Achievement Network (2010). Narrative retrieved from:http://www2.ed.gov/programs/innovation/2010/narratives/
u396c100771.pdf
46. Zider, How venture capital works.
47. Gompers, Optimal investment, citing Gorman, M., &
Sahlman, W. (1989). What do venture capitalists do? Journal
of Business Venturing, 4(4), 231–248.
48. Schwienbacher, A. (2005, January). An empirical
analysis of venture capital exits in Europe and the United
States. EFA 2002 Berlin Meetings Discussion Paper. Also
see Hellman, T. (1998). The allocation of control rights in
venture capital contracts. Rand Journal of Economics, 29(1),
57–76; Hellman, T., & Puri, M. (2000). The interaction
between product market and fnancing strategy: The role of
venture capital. Review of Financial Studies, 13(4), 959–984;
Hellman, T., & Puri, M. (2002). Venture capital and the
professionalization of start-up Firms: empirical evidence.
The Journal of Finance, 57(1), 169–197.
49. Schwienbacher, An empirical analysis of venture
capital exits; Davila, A., Foster, G., & Gupta, M. (2003).
Staging venture capital: Empirical evidence on the diferential
roles of early versus late rounds. Working paper. Retrieved
fromhttp://apps.olin.wustl.edu/workingpapers/pdf/2003-
07-003.pdf; Kaplan & Stromberg, How do venture capitalists
choose? Also see Hellman, The allocation of control rights;
Hellman & Puri, Interaction between product market and
fnancing strategy; Hellman & Puri, Venture capital and the
professionalization of start-up frms.
50. Gompers, Optimal investment.
51. Lerner, J. (1995). Venture capitalists and the oversight
of private frms. The Journal of Finance, 50(1), 301–319.
52. Petty, J. S., & Gruber, M. (2011). ‘In pursuit of the real
deal’: A longitudinal study of VC decision making. Journal
of Business Venturing, 26, 172–188.
53. Gompers, P. A., & Lerner, J. (2001). The venture
26 • notes
capital revolution. The Journal of Economic Perspectives,
15(2), 145–168.
54. Gompers, Optimal investment; Lerner, Venture
capitalists and the oversight of private frms.
55. Nigrini, M. J., & Johnson, A. J. (2008). Using key
performance indicators and risk measures in continuous
monitoring. Journal of Emerging Technologies in Accounting,
5, 65–80; Chittley-Young, Analyze this.
56. SAS Institute Inc. (2007). Managed innovation,
assured compliance: Developing, executing and managing the
transformation, analysis and submission of clinical research
data with SAS drug development (white paper). Retrieved
fromhttp://www.sas.com/resources/whitepaper/wp_3581.
pdf; Miller, E. R. (2006). Implementation of adaptive
randomizations for clinical trials. Interactive Clinical
Technologies Incorporated. Retrieved fromhttp://www.
almacgroup.com/papers/papers/implementation_of_
adaptive_rands.pdf
57. Nigrini & Johnson, Using key performance indicators;
MacMillan, Siegel, & SubbaNarasimha, Criteria used by
venture capitalists.
58. Gompers, Optimal investment; MacMillan, Siegel, &
SubbaNarasimha, Criteria used by venture capitalists.
59. Roberts & Barley, How venture capitalists evaluate.
60. Davila, Foster, & Gupta, Staging venture capital;
Kaplan & Stromberg, Characteristics, contracts, and
actions; Schwienbacher, An empirical analysis of venture
capital exits; Gompers, Optimal investment; Kaplan &
Stromberg, How do venture capitalists choose?; Gompers &
Lerner, The venture capital revolution.
61. See Gompers, Optimal investment. However, a
number of factors encourage multiple rounds of investment,
even when it may not appear to be a sound business decision.
Emotional factors, politics within the venture capital
frm and any investment syndicates of which it is a part,
contractual pressures, and industry norms may all push
the default of “stand by your ventures.” Guler, I. (2007).
Throwing good money afer bad? Political and institutional
infuences on sequential decision making in the venture
capital industry. Administrative Science Quarterly, 52, 248–
285; Roberts & Barley, How venture capitalists evaluate.
62. Chittley-Young, Analyze this.
63. Hassel, E. A., Hassel, B. C., Arkin, M. D., Kowal,
J. M., & Steiner, L. M. (Public Impact). (2010). School
restructuring: What works when, A guide for education
leaders. Naperville, IL: Learning Point Associates.
64. Roure & Keeley, Predictors of success; Roberts &
Barley, How venture capitalists evaluate.
65. Shane, S., & Spell, C. (1998, Spring). Factors for New
Franchise Success. Sloan Management Review, 43-50.
66. See Bremser & Barsky, Utilizing the balanced
scorecard for R&D performance measurement, discussing
the Stage-Gate framework, adapted from Cooper, R. G.
(1993). Winning at new products: Accelerating the process fom
idea to launch. Reading, MA: Addison-Wesley.
67. Gompers, Optimal investment; Guler, Throwing
good money afer bad?; Roberts & Barley, How venture
capitalists evaluate.
doc_756886695.pdf