Proposed Priorities, Requirements, Definitions, and Selection Criteria-Investing in Innovation Fund, 74407-74421 [2012-30199]
Download as PDF
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
Strong theory means a rationale for
the proposed process, product, strategy,
or practice that includes a logic model.
[FR Doc. 2012–29897 Filed 12–13–12; 8:45 am]
BILLING CODE 4000–01–P
DEPARTMENT OF EDUCATION
34 CFR Subtitle A
Privacy Note: The Department’s policy is
to make all comments received from
members of the public available for public
viewing in their entirety on the Federal
eRulemaking Portal at www.regulations.gov.
Therefore, commenters should be careful to
include in their comments only information
that they wish to make publicly available.
RIN 1855–AA09
[Docket No. ED 2012–OII–0027]
Proposed Priorities, Requirements,
Definitions, and Selection Criteria—
Investing in Innovation Fund
Catalog of Federal Domestic Assistance
(CFDA) Numbers: 84.411A, 84.411B, and
84.411C
Office of Innovation and
Improvement, Department of Education.
ACTION: Proposed priorities,
requirements, definitions, and selection
criteria.
AGENCY:
SUMMARY: The Assistant Deputy
Secretary for Innovation and
Improvement proposes priorities,
requirements, definitions, and selection
criteria under the Investing in
Innovation Fund (i3). The Assistant
Deputy Secretary may use these
priorities, requirements, definitions, and
selection criteria for competitions in
fiscal year (FY) 2013 and later years.
The U.S. Department of Education
(Department) has conducted three
competitions under the i3 program and
awarded 92 i3 grants since the program
was established under the American
Recovery and Reinvestment Act of 2009
(ARRA). These proposed priorities,
requirements, definitions, and selection
criteria maintain the overall purpose
and structure of the i3 program, which
is discussed later in this document, and
incorporate changes based on specific
lessons learned from the first three
competitions.
We must receive your comments
on or before January 14, 2013.
ADDRESSES: Submit your comments
through the Federal eRulemaking Portal
or via postal mail, commercial delivery,
or hand delivery. We will not accept
comments by fax or by email. To ensure
that we do not receive duplicate copies,
please submit your comments only
once. In addition, please include the
Docket ID at the top of your comments.
• Federal eRulemaking Portal: Go to
www.regulations.gov to submit your
comments electronically. Information
on using Regulations.gov, including
instructions for accessing agency
documents, submitting comments, and
mstockstill on DSK4VPTVN1PROD with
DATES:
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
viewing the docket, is available on the
site under ‘‘How to Use This Site.’’
• Postal Mail, Commercial Delivery,
or Hand Delivery: If you mail or deliver
your comments about these proposed
regulations, address them to Carol
Lyons, U.S. Department of Education,
400 Maryland Avenue SW., room
4W203, LBJ, Washington, DC 20202–
5930.
FOR FURTHER INFORMATION CONTACT:
Carol Lyons. Telephone: (202) 453–
7122. Or by email: i3@ed.gov. If you use
a telecommunications device for the
deaf (TDD) or text telephone (TTY), call
the Federal Relay Service (FRS), toll
free, at 1–800–877–8339.
SUPPLEMENTARY INFORMATION: Invitation
to Comment: We invite you to submit
comments regarding this notice. To
ensure that your comments have
maximum effect in developing the
notice of final priorities, requirements,
definitions, and selection criteria, we
urge you to identify clearly the specific
proposed priority, requirement,
definition, or selection criterion that
each comment addresses. We make
additional, specific requests for
comment in the sections setting out the
proposed priorities, requirements,
definitions, and selection criteria
elsewhere in this notice.
We invite you to assist us in
complying with the specific
requirements of Executive Orders 12866
and 13563 and their overall requirement
of reducing regulatory burden that
might result from these proposed
priorities, requirements, definitions, and
selection criteria. Please let us know of
any further ways we could reduce
potential costs or increase potential
benefits while preserving the effective
and efficient administration of the
program.
During and after the comment period,
you may inspect all public comments
about this notice by accessing
Regulations.gov. You may also inspect
the comments in person in room
4W335, LBJ, 400 Maryland Avenue SW.,
Washington, DC, between the hours of
8:30 a.m. and 4:00 p.m., Washington,
DC time, Monday through Friday of
each week except Federal holidays.
Please contact the person listed under
FOR FURTHER INFORMATION CONTACT.
Assistance to Individuals with
Disabilities in Reviewing the
PO 00000
Frm 00016
Fmt 4702
Sfmt 4702
74407
Rulemaking Record: On request we will
provide an appropriate accommodation
or auxiliary aid to an individual with a
disability who needs assistance to
review the comments or other
documents in the public rulemaking
record for this notice. If you want to
schedule an appointment for this type of
accommodation or auxiliary aid, please
contact the person listed under FOR
FURTHER INFORMATION CONTACT.
Purpose of Program: The i3 program
addresses two related challenges. First,
there are too few practices in education
supported by rigorous evidence of
effectiveness, despite national attention
paid to finding practices that are
effective at improving education
outcomes in the decade since the
establishment of the Department’s
Institute of Education Sciences (IES).
Second, there are limited incentives to
expand effective practices substantially
and to use those practices to serve more
students across schools, districts, and
States. Student achievement suffers as a
result.
The central innovation of the i3
program, and how it addresses these
two challenges, is its multi-tier structure
that links the amount of funding that an
applicant may receive to the quality of
the evidence supporting the efficacy of
the proposed project. Applicants
proposing practices supported by
limited evidence can receive small
grants that support the development and
initial evaluation of promising practices
and help to identify new solutions to
pressing challenges; applicants
proposing practices supported by
evidence from rigorous evaluations,
such as large randomized controlled
trials, can receive sizable grants to
support expansion across the Nation.
This structure provides incentives for
applicants to build evidence of
effectiveness of their proposed projects
and to address the barriers to serving
more students across schools, districts,
and States so that applicants can
compete for more sizeable grants.
As importantly, all i3 projects are
required to generate additional evidence
of effectiveness. All i3 grantees must use
part of their budgets to conduct
independent evaluations (as defined in
this notice) of their projects. This
ensures that projects funded under the
i3 program contribute significantly to
improving the information available to
practitioners and policymakers about
which practices work, for which types
of students, and in which contexts.
Program Authority: American Recovery
and Reinvestment Act of 2009 (ARRA),
Division A, Section 14007, Pub. L. 111–5.
E:\FR\FM\14DEP1.SGM
14DEP1
74408
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
Background
mstockstill on DSK4VPTVN1PROD with
The Statutory Context
The ARRA established the i3 program
to provide competitive grants to local
educational agencies (LEAs) and
nonprofit organizations with a record of
improving student achievement in order
to expand the implementation of, and
investment in, innovative practices that
are demonstrated to improve student
achievement (as defined in this notice)
or student growth (as defined in this
notice), close achievement gaps,
decrease dropout rates, increase high
school graduation rates (as defined in
this notice), or increase college
enrollment and completion rates. The
ARRA provided funding for the i3
program’s first competition carried out
during FY 2010; the FY 2011 and FY
2012 competitions were funded under
the Department’s annual appropriations.
The Administration’s reauthorization
proposal for the Elementary and
Secondary Education Act of 1965, as
amended (20 U.S.C. 6301 et seq.) (ESEA)
would authorize the i3 program under
that act.
Overview of the Investing in Innovation
Fund (i3)
As the Department’s primary
evidence-based grantmaking program,
the i3 program is designed to generate
and validate solutions to persistent
educational challenges and support the
expansion of effective solutions across
the country to serve substantially larger
numbers of students.
There are a number of features that
make the i3 program different from
many other Federal grant programs in
education.
First, the i3 program builds a portfolio
of different practices in critical priority
areas. As the Proposed Priorities section
of this document makes clear, the i3
program supports projects in a broad
range of areas, from increasing teacher
and principal effectiveness to turning
around low-performing schools. We
anticipate that after a number of i3
competitions, practices will emerge that
can address challenges in each of these
areas that are effective in improving
student outcomes across the Nation.
Second, the i3 program links funding
to the quality and extent of existing
evidence showing the likelihood of a
proposed practice improving student
outcomes. Different tiers of grants, with
increasing funding available at each tier,
are linked to different levels of
evidence.
Third, the i3 program supports the
expansion (scaling) of effective
programs by providing sufficient
funding to build organizational capacity
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
and to overcome barriers to reaching
additional students. The different tiers
of i3 grants comprise a funding
continuum for effective programs that
spans initial, localized development to
implementation on a national scale, in
the hope that more effective practices
will displace less effective ones and
lead to increases in student achievement
and improvements in other student
outcomes.
Fourth, the i3 program both requires
and provides funding for an
independent evaluation of each project
to build understanding of ‘‘what works’’
in critical priority areas. An
independent evaluation addresses
issues such as for which populations or
student subgroups particular practices
are most effective and whether practices
maintain their effectiveness as they
expand to serve more students in more
diverse contexts. An independent
evaluation also provides an opportunity
for grantees to generate the evidence
needed to compete for funds at the next
level of i3 funding (e.g., from a
Development grant to a Validation grant;
see description of the three types of
grants that follows) if their projects are
successful.
As in prior i3 competitions, in FY
2013 we intend to award three types of
grants under this program:
‘‘Development’’ grants, ‘‘Validation’’
grants, and ‘‘Scale-up’’ grants. These
grants differ in terms of the level of
prior evidence of effectiveness required
for consideration of funding, the level of
scale the funded project should reach,
and consequently the amount of funding
available to support the project. We
provide an overview to clarify the
expectations for each grant type:
1. Development grants provide
funding to support the development or
testing of practices that are supported by
evidence of promise (as defined in this
notice) or strong theory (as defined in
this notice) and whose efficacy should
be systematically studied. We intend
Development grants to support new or
substantially more effective practices for
addressing widely shared challenges.
Development projects should be novel
and significant nationally, not projects
that simply implement existing
practices in additional locations or
support needs that are primarily local in
nature.
All Development grantees must
evaluate the effectiveness of the project
at the level of scale proposed in the
application. Development grant
evaluations should assess whether the
i3-supported practice is better than
other approaches at increasing student
achievement (as defined in this notice)
or student growth (as defined in this
PO 00000
Frm 00017
Fmt 4702
Sfmt 4702
notice), closing achievement gaps,
decreasing dropout rates, increasing
high school graduation rates (as defined
in this notice), or increasing college
enrollment and completion rates.
2. Validation grants provide funding
to support expansion of projects
supported by moderate evidence of
effectiveness (as defined in this notice)
to the national or regional level (as
defined in this notice). Validation
projects must further assess the
effectiveness of the i3-supported
practice through a rigorous evaluation,
with particular focus on the populations
for and the contexts in which the
practice is most effective.
The outcomes of the first three i3
competitions have demonstrated that
Validation grantees vary widely in their
organizational maturity and capacity to
expand significantly, far more than have
Scale-up grantees. Given this history,
we expect and consider it appropriate
that each applicant would propose to
use the Validation funding to build its
capacity to deliver the i3-supported
practice, particularly early in the
funding period, to successfully reach
the level of scale proposed in its
application. The applicant would need
to address any specific barriers to the
growth or scaling of the organization or
practice (including barriers related to
cost-effectiveness) in order to deliver
the i3-supported practice at the
proposed level of scale and provide
strategies to address these barriers as
part of its proposed scaling plan.
All Validation grantees must evaluate
the effectiveness of the practice that the
supported project implements and
expands. We expect that these
evaluations will be conducted in a
variety of contexts and for a variety of
students, will identify the core elements
of the practice, and will codify the
practices to support adoption or
replication by the applicant and other
entities.
3. Scale-up grants provide funding to
support expansion of projects supported
by strong evidence of effectiveness (as
defined in this notice) to the national
level (as defined in this notice). In
addition to improving outcomes for an
increasing number of high-need
students, we expect that Scale-up
projects will generate information about
the students and contexts for which a
practice is most effective. We expect
that Scale-up projects will increase
understanding of strategies that allow
organizations or practices to expand
quickly and efficiently while
maintaining their effectiveness.
A Scale-up grant may support the
expansion of practices that have
demonstrated through prior experience
E:\FR\FM\14DEP1.SGM
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
and rigorous evaluation that they are
effective at improving student
achievement. An entity applying for a
Scale-up grant should use the grant
funding, at least in part, to address
specific barriers to the growth or scaling
up of an organization or practice
(including barriers related to costeffectiveness) in order to deliver the i3supported practice at the proposed level
of scale so that the entity is wellpositioned to continue expansion
following the expiration of Federal
funding.
Similar to Validation grants, all Scaleup grantees must evaluate the
effectiveness of the i3-supported
practice that the project implements and
expands; this is particularly important
in instances in which the proposed
project includes changing the i3supported practice in order to more
efficiently reach the proposed level of
scale (for example, by developing
technology-enabled training tools). We
expect that these evaluations would be
conducted in a variety of contexts and
for a variety of students in order to
determine the context(s) and
population(s) for which the i3supported practice is most effective.
Regardless, the evaluation of a Scale-up
grant must identify core elements of and
codify the i3-supported practice that the
project implements to support adoption
or replication by other entities.
Proposed Priorities
This notice contains 10 proposed
priorities. In addition, in any i3
competition we may include priorities
from the notice of final supplemental
priorities and definitions for
discretionary grant programs, published
in the Federal Register on December 15,
2010 (75 FR 78486), and corrected on
May 12, 2011 (76 FR 27637)
(Supplemental Priorities). We are not
proposing in this notice priorities in
such areas as early learning or standards
and assessments, which are already
included in the Supplemental Priorities,
because the language in the
Supplemental Priorities adequately
addresses those areas for the purposes of
the i3 program.
Proposed Priorities
mstockstill on DSK4VPTVN1PROD with
Background
The original set of four absolute
priorities that the Department used for
the FY 2010 i3 competition focused on
the four assurances (or education reform
areas) the Department used in
implementing multiple programs
funded under ARRA. We continue to
consider these reform areas important
and, thus, either include them in these
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
proposed priorities or may include them
in future competitions through the
Supplemental Priorities.
The original i3 priorities were written
broadly and generated a wide range of
projects in the first three competitions.
Now we are interested in supporting a
more focused set of projects within
areas of acute need and in more directly
addressing particular challenges. Thus,
we propose to modify our approach to
the structure of the priorities so that
each priority area includes the
particular needs that the Secretary may
address when establishing the priorities
for a particular i3 competition. Our
intent is to establish the flexibility to
select from a variety of possible project
focus areas within a given priority
rather than using broad priorities as we
have in the past; however, we expect to
use only a subset of the priorities and
the project focus areas within them in
any particular future notice inviting
applications. The Department will
consider several factors when selecting
the priorities to use in a given year,
including the Administration’s policy
priorities, the need for new solutions in
a particular priority area, other available
funding for a particular priority area,
and the results and lessons learned from
prior i3 competitions. Further, the
Department will consider the level of
evidence or research available across the
different priorities when determining
which of the priorities would be most
appropriate for the different types of
grants under the i3 program. In a given
year, the notice inviting applications
will provide a concise list of the
priorities that will be used for that
year’s i3 competition.
We propose that the Secretary may
use any of the priorities established in
the notice of final priorities,
requirements, definitions, and selection
criteria when establishing the priorities
for each particular type of grant
(Development, Validation, and Scaleup) in an i3 competition in FY 2013 and
in subsequent years.
Proposed Priority 1—Improving the
Effectiveness of Teachers or Principals
Background: Research indicates that
teachers and principals are the most
critical in-school factors in improving
student achievement.1 Proposed priority
1 Wright, S.P., Horn, S.P., Sanders, W.L. (1997).
Teacher and classroom context effects on student
achievement: Implications for teacher evaluation.
Journal of Personnel Evaluation in Education
11:57–67; Rivkin, S.G., Hanushek, E.A., Kain, J.F.
(2005). Teachers, schools, and academic
achievement. Economerica, 73(2):417–458.
Leithwood, K., Louis, K.S., Anderson, S., and
Wahlstrom, K. (2004). Review of research: How
leadership influences student learning. University
of Minnesota, Center for Applied Research and
PO 00000
Frm 00018
Fmt 4702
Sfmt 4702
74409
1, therefore, focuses on improving the
effectiveness of teachers and principals.
Specifically, the proposed priority
focuses on all dimensions of the teacher
and principal career path and seeks to
identify effective methods for recruiting,
preparing, supporting, evaluating, and
retaining effective principals and
teachers, particularly at schools that
serve high-needs students.
The proposed priority highlights the
need for schools and districts to
consider how to recruit effective
teachers and principals, create distinct
career pathways based on the strengths
of its teachers and principals and the
needs of its schools, and develop
evaluation systems that provide
information that can be used to provide
timely and useful feedback for teachers
and principals. Schools and districts
can use these evaluation data to identify
and provide necessary resources and
tailored professional development in
order to support the teachers and
principals currently in the schools and
to improve the processes for recruiting
new talent. Providing teachers with
tailored development and supports is
important for improving teacher
effectiveness and retaining teachers to
ensure all schools have highly effective
teachers and principals. Thus, the
priority includes developing
professional development supports and
tools for teachers, including creating
and implementing models that help
teachers utilize time and resources more
efficiently while maintaining or
improving outcomes.
Finally, to ensure that all schools,
especially those serving high-need
students, benefit from projects funded
under this priority, the priority also
supports efforts to equitably distribute
effective teachers and principals among
schools.
Proposed Priority 1—Improving the
Effectiveness of Teachers or Principals
Under this proposed priority, we
would provide funding to projects that
address one or more of the following
priority areas:
(a) Developing new methods and
sources for recruiting:
(1) Highly effective teachers (as
defined in this notice);
(2) Highly effective principals (as
defined in this notice); or
(3) Highly effective teachers and
principals (as defined in this notice).
(b) Developing models for teacher
preparation that deepen pedagogical
knowledge and skills, such as
Educational Improvement. Found at
www.cehd.umn.edu/carei/Leadership/
ReviewofResearch.pdf.
E:\FR\FM\14DEP1.SGM
14DEP1
74410
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
knowledge of instructional practices or
knowledge and skills in classroom
management, or that deepen
pedagogical content knowledge, that
have been demonstrated to improve
student achievement.
(c) Developing models of induction
and support for improving the
knowledge and skills of novice teachers
to increase teacher retention, improve
teaching effectiveness, and accelerate
student performance.
(d) Creating career pathways with
differentiated opportunities and roles
for teachers or principals, which may
include differentiated compensation.
(e) Designing and implementing
teacher or principal evaluation systems
that provide clear, timely, and useful
feedback, including feedback that
identifies areas for improvement and
that guides professional development
for teachers and principals.
(f) Developing supports for ongoing
development and improvement of
teachers, principals, or instructional
leaders, such as local and virtual
communities, tools, training, and other
mechanisms.
(g) Increasing the equitable
distribution of effective teachers or
principals across schools.
(h) Extending the reach of highly
effective teachers to more students such
as through developing and
implementing school models that
improve conditions for teaching and
learning; or offering new opportunities
for teachers to collaborate to accelerate
student performance.
(i) Other projects addressing pressing
needs related to improving teacher or
principal effectiveness.
Proposed Priority 2—Improving LowPerforming Schools
mstockstill on DSK4VPTVN1PROD with
Background: Approximately 10
percent of all high schools produce
nearly half of the Nation’s dropouts.2
Proposed priority 2 addresses the
pressing need to ensure all students
receive a quality K–12 education by
providing funding for activities that are
designed to accelerate the performance
of severely low-performing schools and
the schools that feed students into them.
Given the range of schools that this
proposed priority aims to address, we
are designing this priority to identify
and support multiple approaches that
can successfully turn around low2 Balfanz, R., Bridgeland, J.M., Horning Fox, J.,
Moore, L.A. (2010). Building a Grad nation:
Progress and Challenge in Ending the High School
Dropout Epidemic 2010–2011 Annual Update. See
www.americaspromise.org/Our-Work/Grad-Nation/
Building-a-Grad-Nation.aspx.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
performing schools and improve
outcomes for students in them.
Providing a combination of reform
strategies, including effective teachers,
strong school leadership, embedded
professional development, greater use of
data to inform instruction, increased
learning time, and collaboration among
teachers, can improve instruction and
student outcomes in low-performing
schools. Additionally, whole-school and
‘‘wraparound’’ reform strategies also can
be used to improve the school
environment and address other nonacademic factors that affect student
achievement. Thus, this proposed
priority supports projects that would
implement these strategies in lowperforming schools.
Community engagement also is
crucial to successfully turning around
low-performing schools, so the
proposed priority provides for
enhancing the capacity of external
partners to support these schools.
Finally, to support States and districts
specifically in their ongoing school
reform efforts, the proposed priority
supports projects designed to expand
State and district capacity to turn
around low-performing schools.
Proposed Priority 2—Improving LowPerforming Schools
Under this proposed priority, we
would provide funding to projects that
address one or more of the following
priority areas:
(a) Designing whole-school models
that incorporate such strategies as
providing strong school leadership;
strengthening the instructional program;
embedding professional development
that provides teachers with frequent
feedback to increase the rigor and
effectiveness of their instructional
practice; redesigning the school day,
week, or year; using data to inform
instruction and improvement;
establishing a school environment that
promotes a culture of high expectations
and addresses non-academic factors that
affect student achievement; and
providing ongoing mechanisms for
parent and family engagement.
(b) Changing selected elements of the
school’s organizational design, such as
by differentiating staff roles, changing
student groupings, or enhancing
instructional time.
(c) Recruiting, developing, or
retaining highly effective staff,
specifically teachers, principals, or
instructional leaders, to work in lowperforming schools.
(d) Implementing ‘‘wraparound’’ and
social supports for students that address
non-academic factors that impede
student learning.
PO 00000
Frm 00019
Fmt 4702
Sfmt 4702
(e) Developing and enhancing the
capacity of external partners to support
efforts to turn around low-performing
schools or districts.
(f) Expanding district- or State-level
capacity to turn around low-performing
schools by developing systems and
processes to improve State and district
support and oversight.
(g) Other projects addressing pressing
needs related to improving lowperforming schools.
Other Proposed Requirements Related to
Proposed Priority 2
To meet this priority, a project must
serve schools among (1) The lowestperforming schools in the State on
academic performance measures; (2)
schools in the State with the largest
within-school performance gaps
between student subgroups described in
section 1111(b)(2) of the ESEA; or (3)
secondary schools in the State with the
lowest graduation rate over a number of
years or the largest within-school gaps
in graduation rates between student
subgroups described in section
1111(b)(2) of the ESEA.
Proposed Priority 3—Improving
Science, Technology, Engineering, and
Mathematics (STEM) Education
Background: Ensuring that all
students can access and excel in STEM
fields is essential to our Nation’s
innovation economy and future
prosperity. An increasing number of
careers require an understanding of
STEM concepts and the application of
the skills and techniques of science,
technology, engineering and
mathematics; this proposed priority
addresses this growing need.
The President’s Council of Advisors
on Science and Technology (PCAST) 3
has produced reports on K–12 and
undergraduate STEM education that
provided recommendations on
increasing achievement and
postsecondary enrollment in STEM
fields. The recommendations include
cultivating and recruiting STEM
teachers, creating STEM-related
experiences to inspire and engage
students, and encouraging partnerships
among stakeholders in order to diversify
pathways to STEM careers. Proposed
priority 3 supports projects that would
address these recommendations by
revising STEM courses, making STEM
learning more engaging to a wider range
of students, increasing the number of
effective STEM teachers, and expanding
STEM education and career
opportunities for groups traditionally
3 See www.whitehouse.gov/administration/eop/
ostp/pcast/docsreports.
E:\FR\FM\14DEP1.SGM
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
underrepresented in the STEM fields,
including minorities, individuals with
disabilities, and women and girls.
mstockstill on DSK4VPTVN1PROD with
Proposed Priority 3—Improving
Science, Technology, Engineering, and
Mathematics (STEM) Education
Under this proposed priority, we
would provide funding to projects that
address one or more of the following
priority areas:
(a) Providing students with increased
access to rigorous and engaging
coursework in STEM.
(b) Redesigning STEM course content
and instructional practices to engage
students and increase student academic
success.
(c) Developing new methods and
resources for recruiting individuals with
content expertise in STEM subject areas
into teaching.
(d) Increasing the opportunities for
high-quality preparation of, or
professional development for, teachers
or other educators in STEM subjects,
through activities that include building
content and pedagogical content
knowledge.
(e) Expanding opportunities for highquality out-of-school and extended-day
activities that provide students with
opportunities for deliberate practice that
increase STEM learning, engagement,
and expertise.
(f) Increasing the number of
individuals from groups traditionally
underrepresented in STEM, including
minorities, individuals with disabilities,
and women and girls, who are provided
with access to rigorous and engaging
coursework in STEM and are prepared
for postsecondary study in STEM.
(g) Increasing the number of
individuals from groups traditionally
underrepresented in STEM, including
minorities, individuals with disabilities,
and women, who are teachers or
educators of STEM subjects and have
increased opportunities for high-quality
preparation or professional
development.
(h) Other projects addressing pressing
needs for improving STEM education.
Proposed Priority 4—Improving
Academic Outcomes for Students With
Disabilities
Background: One of the primary goals
of the ESEA is to improve the quality of
education for all students, including
students with disabilities, and ensuring
the provision of an appropriate
education to students with disabilities is
the primary objective of the Individuals
with Disabilities Education Act.
Proposed priority 4 would support
activities focused on improving the
instruction for and assessment of
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
students with disabilities from early
learning through postsecondary
education. Thus, the proposed priority
would support projects that coordinate
technical assistance across programs
serving infants, toddlers, or
preschoolers with disabilities to ensure
the operation of coherent systems
supporting these children and their
families. And, at the postsecondary
level, the priority would support
projects that collect data on academic
and other outcomes for students with
disabilities to better understand their
transition into postsecondary education
and how their secondary school
education prepares them for higher
education.
Consistent with our approach under
proposed priority 1 and recognizing the
critical importance of evaluating teacher
effectiveness, this proposed priority also
would support projects to design and
implement teacher evaluation systems
that measure the performance of special
education teachers and related service
providers.
Finally, because we know that
students with differing abilities can
learn and excel at high levels, provided
they receive appropriate academic and
non-academic supports, this priority
would support projects designed to
improve academic outcomes for
students with disabilities in inclusive
settings.
Proposed Priority 4—Improving
Academic Outcomes for Students With
Disabilities
Under this proposed priority, we
would provide funding to projects that
address one or more of the following
priority areas:
(a) Coordinating technical assistance
across programs that address the needs
of infants, toddlers, or preschoolers with
disabilities, in order to ensure the
operation of coherent systems of
support for those children and their
families.
(b) Designing and implementing
teacher evaluation systems that define
and measure effectiveness of special
education teachers and related service
providers.
(c) Improving academic outcomes for
students with disabilities in inclusive
settings.
(d) Improving postsecondary data
collection and tracking of academic and
related outcomes for students with
disabilities to understand their
transition into postsecondary education
and how their secondary school
education prepared them for higher
education.
PO 00000
Frm 00020
Fmt 4702
Sfmt 4702
74411
(e) Other projects addressing pressing
needs related to improving academic
outcomes for students with disabilities.
Proposed Priority 5—Improving
Academic Outcomes for English
Learners (ELs)
Background: School districts across
the country have experienced a
substantial increase in the enrollment of
students who cannot speak, read, or
write English well enough to participate
meaningfully in educational programs
without appropriate support services.
Proposed priority 5 would support
activities that are designed to address
the language-related limitations that can
impede student learning.
A student’s ability to master core
academic subjects depends on the
student’s ability to understand academic
language, including discipline-specific
vocabulary. Therefore, proposed priority
5 aims to increase opportunities for ELs
to develop their academic and literacy
skills and for ELs to build their skills in
using and understanding English
language oral discourse, varying and
complex text types, and disciplinespecific vocabulary that are typical of
core academic courses.
Consistent with our approach under
Proposed Priorities 1 and 4 and
recognizing the critical importance of
evaluating teacher effectiveness, this
proposed priority also would support
projects to design and implement
teacher evaluation systems that measure
the performance of teachers of ELs.
The proposed priority also aims to
improve the high school graduation
rates and college-readiness of ELs by
supporting projects that would align the
curriculum used in the language
development and content courses in
which they enroll with college- and
career-ready standards as well as
projects that would provide robust and
targeted professional development to
teachers, administrators, and other
school personnel serving EL students.
Proposed Priority 5—Improving
Academic Outcomes for English
Learners (ELs)
Under this proposed priority, we
would provide funding to projects that
address one or more of the following
priority areas:
(a) Increasing the number and
proportion of ELs successfully
completing courses in core academic
subjects by developing, implementing,
and evaluating new instructional
approaches and tools that are sensitive
to the language demands necessary to
access challenging content, including
technology-based tools.
E:\FR\FM\14DEP1.SGM
14DEP1
74412
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
(b) Aligning and implementing the
curriculum and instruction used in
grades 6–12 for language development
and content courses to provide the
academic vocabuarly and discourse
skills necessary for preparing ELs to be
college- and career-ready.
(c) Preparing young ELs to be on track
to be college- and career-ready when
they graduate from high school by
developing comprehensive,
developmentally appropriate, early
learning programs (birth-grade 3) that
are aligned with the State’s high-quality
early learning standards, designed to
improve readiness for kindergarten, and
support development of literacy and
academic skills in English or in English
and another language.
(d) Developing and implementing
school-wide professional development
for teachers, administrators, and other
personnel in schools in which a
significant percentage of students are
ELs.
(e) Designing and implementing
teacher evaluation systems that define
and measure effectiveness of teachers of
ELs.
(f) Other projects addressing pressing
needs related to improving academic
outcomes for ELs.
mstockstill on DSK4VPTVN1PROD with
Proposed Priority 6—Improving Parent
and Family Engagement
Background: Parents and families are
instrumental in helping children
improve their academic performance.
Proposed priority 6 addresses the need
for building parents’ and families’
awareness of their role in improving
their children’s educational outcomes
and enhancing their ability to support
student learning and school
improvement through training.
Additionally, the proposed priority
addresses the corresponding need to
provide professional development to
school staff so that they have the skills
needed to support and cultivate
environments that are welcoming to
parents and families and to build
relationships that increase their capacity
to support their children’s educational
needs.
Finally, to ensure that parents and
families have the information they need
to be full partners in their children’s
education, this proposed priority would
support the development of tools and
initiatives that provide them with
ongoing access to data about their
children’s progress and performance.
Proposed Priority 6—Improving Parent
and Family Engagement
Under this proposed priority, we
would provide funding to projects that
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
address one or more of the following
priority areas:
(a) Developing and implementing
initiatives that provide training for
parents and families to learn skills and
strategies that will support their
students in improving academic
outcomes.
(b) Implementing initiatives that are
designed to enhance the skills and
competencies of school and other
administrative staff in building
relationships and collaborating with
families, particularly those who have
been underengaged with the school(s) in
the past, in order to support student
achievement and school improvement.
(c) Implementing initiatives that
cultivate sustainable partnerships and
increase connections between parents
and school staff in order to support
student achievement and school
improvement.
(d) Developing tools or practices that
provide students and parents with
improved, ongoing access to data and
other information about the students’
progress and performance.
(e) Other projects addressing pressing
needs related to improving student
outcomes by improving parent and
family engagement.
Proposed Priority 7—Improving CostEffectiveness and Productivity
Background: It is essential for schools
and LEAs to closely examine their
spending practices and reallocate
resources toward more efficient and
more cost-effective strategies.
Accordingly, through proposed priority
7, the Department continues to
emphasize the importance of costeffectiveness and productivity.
Improvements in operational,
organizational, and instruction
processes and structures will allow
organizations to achieve the best
possible results in the most efficient
manner.
With proposed priority 7, we continue
and strengthen this focus by including
specific requirements that applicants
must address. These additional details
clarify important elements to ensure
that an applicant’s proposed plan to
improve productivity would provide
sufficient detail about how the applicant
aims to modify its processes and
structures and how the applicant would
evaluate whether the proposed project
was cost-effective when implemented. A
detailed budget, an examination of
different types of costs, and a plan to
monitor and evaluate the cost savings
are essential to any reasoned attempt at
improving productivity.
PO 00000
Frm 00021
Fmt 4702
Sfmt 4702
Proposed Priority 7—Improving CostEffectiveness and Productivity
Under this proposed priority, we
would provide funding to projects that
address one of the following areas:
(a) Substantially improving student
outcomes without commensurately
increasing per-student costs.
(b) Maintaining student outcomes
while substantially decreasing perstudent costs.
(c) Substantially improving student
outcomes while substantially decreasing
per-student costs.
Other Proposed Requirements Related to
Proposed Priority 7
An application proposing to address
this priority must provide—
(1) A clear and coherent budget that
identifies expected student outcomes
before and after the practice, the cost
per student for the practice, and a clear
calculation of the cost per student
served;
(2) A compelling discussion of the
expected cost-effectiveness of the
practice compared with alternative
practices;
(3) A clear delineation of one-time
costs versus ongoing costs and a plan for
sustaining the project, particularly
ongoing costs, after the expiration of i3
funding;
(4) Identification of specific activities
designed to increase substantially the
cost-effectiveness of the practice, such
as re-designing costly components of the
practice (while maintaining efficacy) or
testing multiple versions of the practice
in order to identify the most costeffective approach; and
(5) A project evaluation that addresses
the cost-effectiveness of the proposed
practice.
Proposed Priority 8—Effective Use of
Technology
Background: Technology can improve
student academic outcomes, often
rapidly and in unprecedented ways.
While there have been significant
advances in the use of technology, the
core operations of most schools and
LEAs remain untouched. The
Department’s National Education
Technology Plan 2010 4 highlighted the
potential of ‘‘connected teaching’’ to
extend the reach of the most effective
teachers by using online tools, and it
also highlighted the need for highquality learning resources that can reach
learners wherever and whenever they
are needed. Thus, proposed priority 8
supports strategies that address these
needs.
4 See
E:\FR\FM\14DEP1.SGM
www.ed.gov/edblogs/technology/netp-2010/.
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
Technological solutions also can be
used effectively to assess the learning
progress of individual students and to
provide appropriate feedback to
students and teachers. Proposed priority
8 would therefore support projects using
instructional platforms that provide
customized instruction for different
learners, including integrated
assessments and continuous feedback.
mstockstill on DSK4VPTVN1PROD with
Proposed Priority 8—Effective Use of
Technology
Under this proposed priority, we
would provide funding to projects that
use technology to address one or more
of the following priority areas:
(a) Providing real-time access to
learning experiences that are adaptive
and self-improving in order to optimize
the delivery of instruction to learners
with a variety of learning needs.
(b) Providing students and teachers
with ‘‘anytime, anywhere’’ access to
academic content and learning
experiences that they otherwise would
not have access to, such as rigorous
coursework that is not offered in a
particular school, or effective
professional development activities or
learning communities enabled by
technology.
(c) Developing new methods and
resources for teacher preparation or
professional development that increase
a teacher’s ability to utilize technology
in the classroom to improve student
outcomes.
(d) Assessing student proficiencies in
complex skills, such as critical thinking
and collaboration across academic
disciplines.
(e) Developing and implementing
technology-enabled strategies for
teaching and learning, such as models
and simulations, collaborative virtual
environments, or ‘‘serious games,’’
especially for teaching concepts and
content (e.g., systems thinking) that are
difficult to teach using traditional
approaches.
(f) Integrating technology with the
implementation of rigorous college- and
career-ready standards.
(g) Other projects that increase the use
of technology for effective teaching and
learning.
Proposed Priority 9—Formalizing and
Codifying Effective Practices
Background: A primary goal of the i3
program is to identify and support the
expansion of effective practices. The
education field’s knowledge
management systems and dissemination
of effective practices, particularly in
instances where an effective practice
could displace a less effective or
ineffective practice, is underdeveloped.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
Proposed priority 9 aims to address
these challenges and improve student
outcomes by supporting strategies that
identify key elements of effective
practices and capturing lessons learned
about the implementation of the
practices. An applicant meeting this
priority must commit to sharing
knowledge about the practice broadly
and supporting the implementation of
the practice in other settings and
locations in order to assess whether the
practice can be successfully replicated.
Proposed Priority 9—Formalizing and
Codifying Effective Practices
Under this proposed priority, we
would provide funding to projects that
formalize and codify effective practices.
An application proposing to address
this priority must, as part of its
application:
(a) Identify the practice or practices
that the application proposes to
formalize (i.e., establish and define key
elements of the practice) and codify
(i.e., develop a guide or tools to support
the dissemination of information on key
elements of the practice) and explain
why there is a need for formalization
and codification.
(b) Evaluate different forms of the
practice to identify the critical
components of the practice that are
crucial to its success and sustainability,
including the adaptability of critical
components to different teaching and
learning environments.
(c) Provide a coherent and
comprehensive plan for developing
materials, training, toolkits, or other
supports that other entities would need
in order to implement the practice
effectively and with fidelity.
(d) Commit to assessing the
replicability and adaptability of the
practice by supporting the
implementation of the practice in a
variety of locations during the project
period using the materials, training,
toolkits, or other supports that were
developed for the i3-supported practice.
Proposed Priority 10—Serving Rural
Communities
Background: Educational challenges
and the corresponding solutions
frequently are different in rural areas
from those in urban or suburban areas.
Proposed priority 10 recognizes this and
would support projects that serve
students from rural areas. In so doing,
proposed priority 10 would help
ensures that rural areas have access to
and benefit from innovative education
reforms that specifically address their
needs.
PO 00000
Frm 00022
Fmt 4702
Sfmt 4702
74413
Proposed Priority 10—Serving Rural
Communities
Under this proposed priority, we
would provide funding to projects that
address one of the absolute priorities
established for a particular i3
competition and under which the
majority of students to be served are
enrolled in rural local educational
agencies (as defined in this notice).
Specific Requests for Comment
In addition to our general interest in
receiving comment on the priorities
proposed in this notice, we are
particularly interested in comments
related to proposed priority 7,
Improving Cost-Effectiveness and
Productivity, and proposed priority 5,
Improving Academic Outcomes for ELs.
We seek comments on whether the
language of proposed priority 7 should
establish a specific numeric target or
threshold of cost-effectiveness or
productivity improvement and, if we
were to establish such a target,
suggestions for what that target or
threshold should be and how we should
require that applicants or grantees
measure progress toward and attainment
of it. With regards to (c) of proposed
priority 5, we seek comments on
whether the Department should allow
applicants to meet the priority by
proposing processes, products,
strategies, or practices that address
instruction in English or in English and
a language other than English.
We also recognize that the goals of
supporting practices that are both
innovative and evidence-based has the
potential to limit the universe of
applicants. Therefore, we are interested
in receiving comments on whether we
should establish a priority for applicants
that have never received or partnered
with an entity that has received a grant
under the i3 program.
Types of Priorities
When inviting applications for a
competition using one or more
priorities, we designate the type of each
priority as absolute, competitive
preference, or invitational through a
notice in the Federal Register. The
effect of each type of priority follows:
Absolute priority: Under an absolute
priority, we consider only applications
that meet the priority (34 CFR
75.105(c)(3)). In the i3 competition, each
application must choose to address one
of the absolute priorities and projects
are grouped by that absolute priority for
the purposes of peer review and funding
determinations.
Competitive preference priority:
Under a competitive preference priority,
E:\FR\FM\14DEP1.SGM
14DEP1
74414
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
we give competitive preference to an
application by (1) awarding additional
points, depending on the extent to
which the application meets the priority
(34 CFR 75.105(c)(2)(i)); or (2) selecting
an application that meets the priority
over an application of comparable merit
that does not meet the priority (34 CFR
75.105(c)(2)(ii)).
Invitational priority: Under an
invitational priority, we are particularly
interested in applications that meet the
priority. However, we do not give an
application that meets the priority a
preference over other applications (34
CFR 75.105(c)(1)).
Proposed Requirements
Background
We propose to revise some of the
nonstatutory i3 program requirements
that the Department has previously
established based on our experiences
with the three i3 competitions the
Department has held to date. For
example, many existing, widespread
practices in the field currently lack the
evidence base to compete for Scale-up
or Validation grants because of limited
prior investments in rigorous, highquality evaluations and limited internal
capacity to conduct these evaluations.
One of the primary goals of the i3
program is to increase knowledge of
what works in education for i3 grantees
and non-grantees alike. As such, we
propose to strengthen the project
evaluation requirement so that i3
grantees will produce high-quality
evaluations that estimate the impact of
the i3-supported practice (as
implemented at the proposed level of
scale) on a relevant outcome (as defined
in this notice).
Evaluations might consider whether
the i3-supported practice is more
effective than other approaches or its
effect on improving student
achievement (as defined in this notice)
or student growth (as defined in this
notice), closing achievement gaps,
decreasing dropout rates, increasing
high school graduation rates (as defined
in this notice), or increasing college
enrollment and completion rates.
mstockstill on DSK4VPTVN1PROD with
Proposed Requirements
The Assistant Deputy Secretary
proposes the following requirements for
this program. We may apply one or
more of these requirements in any year
in which this program is in effect.
1. Innovations that Improve
Achievement for High-Need Students:
All grantees must implement practices
that are designed to improve student
achievement (as defined in this notice)
or student growth (as defined in this
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
notice), close achievement gaps,
decrease dropout rates, increase high
school graduation rates (as defined in
this notice), or increase college
enrollment and completion rates for
high-need students (as defined in this
notice).
2. Innovations that Serve
Kindergarten-through-Grade-12 (K–12)
Students: All grantees must implement
practices that serve students who are in
grades K–12 at some point during the
funding period. To meet this
requirement, projects that serve early
learners (i.e., infants, toddlers, or
preschoolers) must provide services or
supports that extend into kindergarten
or later years, and projects that serve
postsecondary students must provide
services or supports during the
secondary grades or earlier.
3. Eligible Applicants: Entities eligible
to apply for i3 grants include either of
the following:
(a) An LEA.
(b) A partnership between a nonprofit
organization and—
(1) One or more LEAs; or
(2) A consortium of schools.
Statutory Eligibility Requirements:
Except as specifically set forth in the
Note about Eligibility for an Eligible
Applicant that Includes a Nonprofit
Organization that follows, to be eligible
for an award, an eligible applicant
must—
(a)(1) Have significantly closed the
achievement gaps between groups of
students described in section 1111(b)(2)
of the ESEA (economically
disadvantaged students, students from
major racial and ethnic groups, students
with limited English proficiency,
students with disabilities); or
(2) Have demonstrated success in
significantly increasing student
academic achievement for all groups of
students described in that section;
(b) Have made significant
improvements in other areas, such as
high school graduation rates (as defined
in this notice) or increased recruitment
and placement of high-quality teachers
and principals, as demonstrated with
meaningful data;
(c) Demonstrate that it has established
one or more partnerships with the
private sector, which may include
philanthropic organizations, and that
organizations in the private sector will
provide matching funds in order to help
bring results to scale; and
(d) In the case of an eligible applicant
that includes a nonprofit organization,
provide in the application the names of
the LEAs with which the nonprofit
organization will partner, or the names
of the schools in the consortium with
which it will partner. If an eligible
PO 00000
Frm 00023
Fmt 4702
Sfmt 4702
applicant that includes a nonprofit
organization intends to partner with
additional LEAs or schools that are not
named in the application, it must
describe in the application the
demographic and other characteristics
of these LEAs and schools and the
process it will use to select them.
Note about LEA Eligibility: For purposes of
this program, an LEA is an LEA located
within one of the 50 States, the District of
Columbia, or the Commonwealth of Puerto
Rico.
Note about Eligibility for an Eligible
Applicant that Includes a Nonprofit
Organization: The authorizing statute
specifies that an eligible applicant that
includes a nonprofit organization meets the
requirements in paragraphs (a) and (b) of the
eligibility requirements for this program if
the nonprofit organization has a record of
significantly improving student achievement,
attainment, or retention. For an eligible
applicant that includes a nonprofit
organization, the nonprofit organization must
demonstrate that it has a record of
significantly improving student achievement,
attainment, or retention through its record of
work with an LEA or schools. Therefore, an
eligible applicant that includes a nonprofit
organization does not necessarily need to
include as a partner for its i3 grant an LEA
or a consortium of schools that meets the
requirements in paragraphs (a) and (b) of the
eligibility requirements in this notice.
In addition, the authorizing statute
specifies that an eligible applicant that
includes a nonprofit organization meets the
requirements of paragraph (c) of the
eligibility requirements in this notice if the
eligible applicant demonstrates that it will
meet the requirement for private-sector
matching.
4. Cost-Sharing or Matching Funds:
To be eligible for an award, an applicant
must demonstrate that one or more
private sector organizations, which may
include philanthropic organizations,
will provide matching funds in order to
help bring project results to scale. An
eligible applicant must obtain matching
funds or in-kind donations equal to an
amount that the Secretary will specify
in the notice inviting applications for
the specific i3 competition. The
Secretary will announce in the notice
inviting applications when and how
selected eligible applicants must submit
evidence of the private-sector matching
funds.
The Secretary may consider
decreasing the matching requirement in
the most exceptional circumstances.
The Secretary will provide instructions
for how to request a reduction of the
matching requirement in the notice
inviting applications.
5. Evidence Standards: To be eligible
for an award, an application for a
Development grant must be supported
by one of the following:
E:\FR\FM\14DEP1.SGM
14DEP1
mstockstill on DSK4VPTVN1PROD with
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
(a) Evidence of promise (as defined in
this notice);
(b) Strong theory (as defined in this
notice); or
(c) Evidence of promise (as defined in
this notice) or strong theory (as defined
in this notice).
The Secretary will announce in the
notice inviting applications which
options will be used as the evidence
standard for a Development grant in a
given competition. Note that under (c),
applicants must identify whether the
application is supported by evidence of
promise (as defined in this notice) or
strong theory (as defined in this notice).
To be eligible for an award, an
application for a Validation grant must
be supported by moderate evidence of
effectiveness (as defined in this notice);
To be eligible for an award, an
application for a Scale-up grant must be
supported by strong evidence of
effectiveness (as defined in this notice).
6. Funding Categories: An applicant
will be considered for an award only for
the type of i3 grant (Development,
Validation, or Scale-up grant) for which
it applies. An applicant may not submit
an application for the same proposed
project under more than one type of
grant.
7. Limit on Grant Awards: (a) No
grantee may receive more than two new
grant awards of any type under the i3
program in a single year; (b) In any twoyear period, no grantee may receive
more than one new Scale-up or
Validation grant; and (c) No grantee may
receive in a single year new i3 grant
awards that total an amount greater than
the sum of the maximum amount of
funds for a Scale-up grant and the
maximum amount of funds for a
Development grant for that year. For
example, in a year when the maximum
award value for a Scale-up grant is $25
million and the maximum award value
for a Development grant is $5 million,
no grantee may receive in a single year
new grants totaling more than $30
million.
8. Subgrants: In the case of an eligible
applicant that is a partnership between
a nonprofit organization and (1) one or
more LEAs or (2) a consortium of
schools, the partner serving as the
applicant and, if funded, as the grantee,
may make subgrants to one or more
entities in the partnership.
9. Evaluation: The grantee must
conduct an independent evaluation (as
defined in this notice) of its project.
This evaluation must estimate the
impact of the i3-supported practice (as
implemented at the proposed level of
scale) on a relevant outcome (as defined
in this notice). The grantee must make
broadly available digitally and free of
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
charge, through formal (e.g., peerreviewed journals) or informal (e.g.,
newsletters) mechanisms, the results of
any evaluations it conducts of its
funded activities. For Scale-up and
Validation grants, the grantee must also
ensure that the data from its evaluation
are made available to third-party
researchers consistent with applicable
privacy requirements.
In addition, the grantee and its
independent evaluator must agree to
cooperate with any technical assistance
provided by the Department or its
contractor and comply with the
requirements of any evaluation of the
program conducted by the Department.
This includes providing to the
Department, within 100 days of a grant
award, an updated comprehensive
evaluation plan in a format and using
such tools as the Department may
require. Grantees must update this
evaluation plan at least annually to
reflect any changes to the evaluation.
All these updates must be consistent
with the scope and objectives of the
approved application.
10. Communities of Practice: Grantees
must participate in, organize, or
facilitate, as appropriate, communities
of practice for the i3 program. A
community of practice is a group of
grantees that agrees to interact regularly
to solve a persistent problem or improve
practice in an area that is important to
them.
11. Management Plan: Within 100
days of a grant award, the grantee must
provide an updated comprehensive
management plan for the approved
project in a format and using such tools
as the Department may require. This
management plan must include detailed
information about implementation of
the first year of the grant, including key
milestones, staffing details, and other
information that the Department may
require. It must also include a complete
list of performance metrics, including
baseline measures and annual targets.
The grantee must update this
management plan at least annually to
reflect implementation of subsequent
years of the project.
Proposed Definitions
Background: To ensure that terms
used in the i3 program have clear and
commonly understood meanings and
are aligned with other Department
programs, we propose the following
definitions. The majority of these
definitions are the same as, or
substantially similar to, those we have
established and used in prior i3
competitions. However, we are
proposing some changes to those
definitions related to evidence of
PO 00000
Frm 00024
Fmt 4702
Sfmt 4702
74415
effectiveness. In that regard, we are
particularly interested in comments on
the level of rigor required under the
proposed definitions for ‘‘strong
evidence of effectiveness,’’ ‘‘moderate
evidence of effectiveness,’’ ‘‘evidence of
promise,’’ and ‘‘strong theory.’’ We have
attempted to clarify the definitions so
that applicants can better understand
what is required to meet each level of
evidence. We have also narrowed the
allowable evaluation methodologies at
the strong and moderate evidence of
effectiveness levels so that the allowable
evaluation methodologies are those that
are most likely to support causal
conclusions. We welcome comments
about whether the updated definitions
are too restrictive or not restrictive
enough and whether there are particular
parts of the definitions that remain
unclear or undefined.
Proposed Definitions
The Assistant Deputy Secretary
proposes the following definitions for
this program. We may apply one or
more of these definitions in any year in
which this program is in effect.
Consortium of schools means two or
more public elementary or secondary
schools acting collaboratively for the
purpose of applying for and
implementing an i3 grant jointly with an
eligible nonprofit organization.
Evidence of promise means there is
empirical evidence to support the
theoretical linkage between at least one
critical component and at least one
relevant outcome presented in the logic
model (as defined in this notice) for the
proposed process, product, strategy, or
practice. Specifically, evidence of
promise means the following conditions
are met:
(a) There is at least one study that is
either a—
(1) Correlational study with statistical
controls for selection bias;
(2) Quasi-experimental study (as
defined in this notice) that meets the
What Works Clearinghouse Evidence
Standards with reservations; 5 or
(3) Randomized controlled trial (as
defined in this notice) that meets the
What Works Clearinghouse Evidence
Standards with or without
reservations; 6 and
(b) Such a study found a statistically
significant or substantively important
5 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
6 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
E:\FR\FM\14DEP1.SGM
14DEP1
mstockstill on DSK4VPTVN1PROD with
74416
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
(defined as a difference of 0.25 standard
deviations or larger), favorable
association between at least one critical
component and one relevant outcome
presented in the logic model for the
proposed process, product, strategy, or
practice.
High-need student means a student at
risk of educational failure or otherwise
in need of special assistance and
support, such as students who are living
in poverty, who attend high-minority
schools (as defined in this notice), who
are far below grade level, who have left
school before receiving a regular high
school diploma, who are at risk of not
graduating with a diploma on time, who
are homeless, who are in foster care,
who have been incarcerated, who have
disabilities, or who are English learners.
High-minority school is defined by a
school’s LEA in a manner consistent
with the corresponding State’s Teacher
Equity Plan, as required by section
1111(b)(8)(C) of the ESEA. The
applicant must provide, in its i3
application, the definition(s) used.
High school graduation rate means a
four-year adjusted cohort graduation
rate consistent with 34 CFR 200.19(b)(1)
and may also include an extended-year
adjusted cohort graduation rate
consistent with 34 CFR 200.19(b)(1)(v) if
the State in which the proposed project
is implemented has been approved by
the Secretary to use such a rate under
Title I of the ESEA.
Highly effective principal means a
principal whose students, overall and
for each subgroup as described in
section 1111(b)(3)(C)(xiii) of the ESEA
(economically disadvantaged students,
students from major racial and ethnic
groups, migrant students, students with
disabilities, students with limited
English proficiency, and students of
each gender), achieve high rates (e.g.,
one and one-half grade levels in an
academic year) of student growth.
Eligible applicants may include
multiple measures, provided that
principal effectiveness is evaluated, in
significant part, based on student
growth. Supplemental measures may
include, for example, high school
graduation rates; college enrollment
rates; evidence of providing supportive
teaching and learning conditions,
support for ensuring effective
instruction across subject areas for a
well-rounded education, strong
instructional leadership, and positive
family and community engagement; or
evidence of attracting, developing, and
retaining high numbers of effective
teachers.
Highly effective teacher means a
teacher whose students achieve high
rates (e.g., one and one-half grade levels
VerDate Mar<15>2010
16:27 Dec 13, 2012
Jkt 229001
in an academic year) of student growth.
Eligible applicants may include
multiple measures, provided that
teacher effectiveness is evaluated, in
significant part, based on student
academic growth. Supplemental
measures may include, for example,
multiple observation-based assessments
of teacher performance or evidence of
leadership roles (which may include
mentoring or leading professional
learning communities) that increase the
effectiveness of other teachers in the
school or LEA.
Independent evaluation means that
the evaluation is designed and carried
out independent of, but in coordination
with, any employees of the entities who
develop a process, product, strategy, or
practice and are implementing it.
Innovation means a process, product,
strategy, or practice that improves (or is
expected to improve) significantly upon
the outcomes reached with status quo
options and that can ultimately reach
widespread effective usage.
Large sample means a sample of 350
or more students (or other single
analysis units) who were randomly
assigned to a treatment or control group,
or 50 or more groups (such as
classrooms or schools) that contain 10
or more students (or other single
analysis units) and that were randomly
assigned to a treatment or control group.
Logic model (also referred to as theory
of action) means a well-specified
conceptual framework that identifies
key components of the proposed
process, product, strategy, or practice
(i.e., the active ‘‘ingredients’’ that are
hypothesized to be critical to achieving
the relevant outcomes) and describes
the relationships among the key
components and outcomes, theoretically
and operationally.
Moderate evidence of effectiveness
means one of the following conditions
is met:
(a) There is at least one study of the
effectiveness of the process, product,
strategy, or practice being proposed that
meets the What Works Clearinghouse
Evidence Standards without
reservations; 7 found a statistically
significant favorable impact on a
relevant outcome (as defined in this
notice) (with no statistically significant
unfavorable impacts on that outcome for
relevant populations in the study or in
other studies of the intervention
reviewed by and reported on by the
What Works Clearinghouse); and
includes a sample that overlaps with the
7 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
PO 00000
Frm 00025
Fmt 4702
Sfmt 4702
populations or settings proposed to
receive the process, product, strategy, or
practice.
(b) There is at least one study of the
effectiveness of the process, product,
strategy, or practice being proposed that
meets the What Works Clearinghouse
Evidence Standards with reservations,8
found a statistically significant favorable
impact on a relevant outcome (as
defined in this notice) (with no
statistically significant unfavorable
impacts on that outcome for relevant
populations in the study or in other
studies of the intervention reviewed by
and reported on by the What Works
Clearinghouse), includes a sample that
overlaps with the populations or
settings proposed to receive the process,
product, strategy, or practice, and
includes a large sample (as defined in
this notice) and a multi-site sample (as
defined in this notice) (Note: multiple
studies can cumulatively meet the large
and multi-site sample requirements as
long as each study meets the other
requirements in this paragraph).
Multi-site sample means more than
one site, where site can be defined as an
LEA, locality, or State.
National level describes the level of
scope or effectiveness of a process,
product, strategy, or practice that is able
to be effective in a wide variety of
communities, including rural and urban
areas, as well as with different groups
(e.g., economically disadvantaged, racial
and ethnic groups, migrant populations,
individuals with disabilities, English
learners, and individuals of each
gender).
Quasi-experimental design study
means a study using a design that
attempts to approximate an
experimental design by identifying a
comparison group that is similar to the
treatment group in important respects.
These studies, depending on design and
implementation, can meet What Works
Clearinghouse Evidence Standards with
reservations 9 (they cannot meet What
Works Clearinghouse Evidence
Standards without reservations).
Randomized controlled trial means a
study that employs random assignment
of, for example, students, teachers,
classrooms, schools, or districts to
receive the intervention being evaluated
(the treatment group) or not to receive
the intervention (the control group). The
8 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
9 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
E:\FR\FM\14DEP1.SGM
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
mstockstill on DSK4VPTVN1PROD with
estimated effectiveness of the
intervention is the difference between
the average outcome for the treatment
group and for the control group. These
studies, depending on design and
implementation, can meet What Works
Clearinghouse Evidence Standards
without reservations.10
Regional level describes the level of
scope or effectiveness of a process,
product, strategy, or practice that is able
to serve a variety of communities within
a State or multiple States, including
rural and urban areas, as well as with
different groups (e.g., economically
disadvantaged, racial and ethnic groups,
migrant populations, individuals with
disabilities, English learners, and
individuals of each gender). For an LEAbased project to be considered a
regional-level project, a process,
product, strategy, or practice must serve
students in more than one LEA, unless
the process, product, strategy, or
practice is implemented in a State in
which the State educational agency is
the sole educational agency for all
schools.
Relevant outcome means the student
outcome or outcomes (or the ultimate
outcome if not related to students) that
the proposed project is designed to
improve, consistent with the specific
goals of the project and the i3 program.
Rural local educational agency means
a local educational agency (LEA) that is
eligible under the Small Rural School
Achievement (SRSA) program or the
Rural and Low-Income School (RLIS)
program authorized under Title VI, Part
B of the ESEA. Eligible applicants may
determine whether a particular LEA is
eligible for these programs by referring
to information on the Department’s Web
site at www2.ed.gov/nclb/freedom/local/
reap.html.
Strong evidence of effectiveness
means that one of the following
conditions is met:
(a) There is at least one study of the
effectiveness of the process, product,
strategy, or practice being proposed that
meets the What Works Clearinghouse
Evidence Standards without
reservations; 11 found a statistically
significant favorable impact on a
relevant outcome (as defined in this
notice) (with no statistically significant
unfavorable impacts on that outcome for
relevant populations in the study or in
10 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
11 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
other studies of the intervention
reviewed by and reported on by the
What Works Clearinghouse); includes a
sample that overlaps with the
populations and settings proposed to
receive the process, product, strategy, or
practice; and includes a large sample (as
defined in this notice) and a multi-site
sample (as defined in this notice) (Note:
multiple studies can cumulatively meet
the large and multi-site sample
requirements as long as each study
meets the other requirements in this
paragraph).
(b) There are at least two studies of
the effectiveness of the process, product,
strategy, or practice being proposed,
each of which meets the What Works
Clearinghouse Evidence Standards with
reservations,12 found a statistically
significant favorable impact on a
relevant outcome (as defined in this
notice) (with no statistically significant
unfavorable impacts on that outcome for
relevant populations in the studies or in
other studies of the intervention
reviewed by and reported on by the
What Works Clearinghouse), includes a
sample that overlaps with the
populations and settings proposed to
receive the process, product, strategy, or
practice, and includes a large sample (as
defined in this notice) and a multi-site
sample (as defined in this notice).
Strong theory means a rationale for
the proposed process, product, strategy,
or practice that includes a logic model
(as defined in this notice).
Student achievement means—
(a) For grades and subjects in which
assessments are required under ESEA
section 1111(b)(3): (1) A student’s score
on such assessments and may include
(2) other measures of student learning,
such as those described in paragraph
(b), provided they are rigorous and
comparable across schools within an
LEA.
(b) For grades and subjects in which
assessments are not required under
ESEA section 1111(b)(3): Alternative
measures of student learning and
performance such as student results on
pre-tests, end-of-course tests, and
objective performance-based
assessments; student learning
objectives; student performance on
English language proficiency
assessments; and other measures of
student achievement that are rigorous
and comparable across schools within
an LEA.
Student growth means the change in
student achievement (as defined in this
12 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
PO 00000
Frm 00026
Fmt 4702
Sfmt 4702
74417
notice) for an individual student
between two or more points in time. An
applicant may also include other
measures that are rigorous and
comparable across classrooms.
Proposed Selection Criteria
Background
The proposed selection criteria are
designed to ensure that applications
selected for funding have the potential
to generate substantial improvements in
student achievement and other key
outcomes and include well-articulated
plans for the implementation and
evaluation of the proposed project. Peer
reviewers will use these criteria to
determine how well an applicant’s
proposed project aligns with our
expectations for the Development,
Validation, or Scale-up grant the
applicant seeks. As such, although we
are proposing these criteria as a single
list, the criteria selected and the number
of points that each may be worth would
vary by the type of i3 grant
(Development, Validation, or Scale-up
grant).
The proposed selection criteria are
similar to those used in prior i3
competitions; the revisions reflect our
experiences with their use. In particular,
the selection criteria used in prior
competitions did not articulate as
clearly as intended our expectations for
scaling up projects and what peer
reviewers should assess to determine
whether a project could feasibly achieve
its proposed scale. In the proposed
selection criteria, we include several
factors that address whether there is
unmet demand for the services that a
grantee would provide and whether an
applicant has identified and will
address barriers that prevent the
applicant from reaching that scale at the
time of its application.
Proposed Selection Criteria
The Secretary proposes the following
selection criteria for evaluating an
application under this program. We may
apply one or more of these criteria in
any year in which this program is in
effect. We propose that the Secretary
may use:
• One or more of the selection criteria
established in the notice of final
priorities, requirements, definitions, and
selection criteria;
• Any of the selection criteria in 34
CFR 75.210; criteria based on the
statutory requirements for the i3
program in accordance with 34 CFR
75.209; or
• Any combination of these when
establishing selection criteria for each
particular type of grant (Development,
E:\FR\FM\14DEP1.SGM
14DEP1
74418
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
mstockstill on DSK4VPTVN1PROD with
Validation, and Scale-up) in any i3
competition. We propose that the
Secretary may further define each
criterion by selecting specific factors for
it. The Secretary may select these factors
from any selection criterion in the list
above. In the notice inviting
applications, the application package, or
both we will announce the specific
selection criteria that apply to a
competition and the maximum possible
points assigned to each criterion.
(a) Significance
In determining the significance of the
proposed project, the Secretary proposes
to consider one or more of the following
factors:
(1) The extent to which the proposed
project addresses a national need.
(2) The extent to which the proposed
project addresses a challenge for which
there is a national need for solutions
that are better than the solutions
currently available.
(3) The extent to which the proposed
project would implement a novel
approach as compared with what has
been previously attempted nationally.
(4) The extent of the expected impact
of the project on relevant outcomes (as
defined in this notice), including the
estimated impact of the project on
student outcomes (particularly those
related to student achievement (as
defined in this notice)) and the breadth
of the project’s impact, compared with
alternative practices or methods of
addressing similar needs.
(5) The extent to which the proposed
project demonstrates that it is likely to
have a meaningful impact on relevant
outcomes (as defined in this notice),
particularly those related to student
achievement (as defined in this notice),
if it were implemented and evaluated in
a variety of settings.
(6) The extent to which the proposed
project will substantially improve on
the outcomes achieved by other
practices, such as through better student
outcomes, lower cost, or accelerated
results.
(7) The importance and magnitude of
the proposed project’s expected impact
on a relevant outcome (as defined in
this notice), particularly one related to
student achievement (as defined in this
notice).
(8) The likelihood that the project will
have the estimated impact, including
the extent to which the applicant
demonstrates that unmet demand for the
proposed project or the proposed
services will enable the applicant to
reach the proposed level of scale.
(9) The feasibility of national
expansion if favorable outcomes are
achieved.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
(b) Quality of the Project Design
In determining the quality of the
project design, the Secretary proposes to
consider one or more of the following
factors:
(1) The extent to which the proposed
project addresses the national need and
priorities the applicant is seeking to
meet.
(2) The extent to which the proposed
project addresses the absolute priority
the applicant is seeking to meet.
(3) The clarity and coherence of the
project goals, including the extent to
which the proposed project articulates
an explicit plan or actions to achieve its
goals (e.g., a fully developed logic
model of the proposed project).
(4) The extent to which the proposed
project has a clear set of goals and an
explicit plan or actions to achieve the
goals, including identification of any
elements of the project logic model that
require further testing or development.
(5) The extent to which the proposed
project will produce a fully codified
practice, including a fully articulated
logic model of the project by the end of
the project period.
(6) The clarity, completeness, and
coherence of the project goals and
whether the application includes a
description of project activities that
constitute a complete plan for achieving
those goals, including the identification
of potential risks to project success and
strategies to mitigate those risks.
(7) The extent to which the applicant
addresses potential risks to project
success and strategies to mitigate those
risks.
(8) The extent to which the applicant
will use grant funds to address a
particular barrier or barriers that
prevented the applicant, in the past,
from reaching the level of scale
proposed in the application.
(9) The extent to which the project
would build the capacity of the
applicant to scale up and sustain the
project or would create an organization
capable of expanding if successful
outcomes are achieved.
(10) The sufficiency of the resources
to support effective project
implementation, including the project’s
plan for ensuring funding after the
period of the Federal grant.
(11) The sufficiency of the resources
to support effective project
implementation.
(c) Quality of the Management Plan
In determining the quality of the
management plan, the Secretary
proposes to consider one or more of the
following factors:
(1) The extent to which the
management plan articulates key
PO 00000
Frm 00027
Fmt 4702
Sfmt 4702
responsibilities and well-defined
objectives, including the timelines and
milestones for completion of major
project activities, the metrics that will
be used to assess progress on an ongoing
basis, and annual performance targets
the applicant will use to monitor
whether the project is achieving its
goals.
(2) The clarity and coherence of the
applicant’s multi-year financial and
operating model and accompanying
plan to operate the project at a national
level (as defined in this notice) during
the project period.
(3) The clarity and coherence of the
applicant’s multi-year financial and
operating model and accompanying
plan to operate the project at a national
or regional level (as defined in this
notice) during the project period.
(4) The extent to which the applicant
demonstrates that it will have the
resources to operate the project at the
proposed level of scale during the
project period and beyond the length of
the grant, including the demonstrated
commitment of any partners and
evidence of broad support from
stakeholders critical to the project’s
long-term success (e.g., State
educational agencies, teachers’ unions).
(5) The extent of the demonstrated
commitment of any key partners or
evidence of broad support from
stakeholders whose participation is
critical to the project’s long-term
success.
(d) Personnel
When evaluating the personnel of the
proposed project, the Secretary proposes
to consider one or more of the following
factors:
(1) The adequacy of the project’s
staffing plan, particularly for the first
year of the project, including the
identification of the project director
and, in the case of projects with unfilled
key personnel positions at the beginning
of the project, that the staffing plan
identifies how critical work will
proceed.
(2) The qualifications and experience
of the project director and other key
project personnel and the extent to
which they have the expertise to
accomplish the proposed tasks.
(3) The extent to which the project
director has experience managing large,
complex, and rapidly growing projects.
(4) The extent to which the project
director has experience managing large,
complex projects.
(5) The extent to which the project
director has experience managing
projects of similar size and scope as the
proposed project.
E:\FR\FM\14DEP1.SGM
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
mstockstill on DSK4VPTVN1PROD with
(e) Quality of the Project Evaluation
In determining the quality of the
project evaluation, the Secretary
proposes to consider one or more of the
following factors:
(1) The clarity and importance of the
key questions to be addressed by the
project evaluation, and the
appropriateness of the methods for how
each question will be addressed.
(2) The extent to which the methods
of evaluation will, if well implemented,
produce evidence about the project’s
effectiveness that would meet the What
Works Clearinghouse Evidence
Standards without reservations.13
(3) The extent to which the methods
of evaluation will, if well implemented,
produce evidence about the project’s
effectiveness that would meet the What
Works Clearinghouse Evidence
Standards with or without
reservations.14
(4) The extent to which the methods
of evaluation will provide valid and
reliable performance data on relevant
outcomes, particularly student
achievement outcomes.
(5) The extent to which the evaluation
will study the project at the proposed
level of scale, including, where
appropriate, generating information
about potential differential effectiveness
of the project in diverse settings and for
diverse student population groups.
(6) The extent to which the evaluation
will study the project at the proposed
level of scale, including in diverse
settings.
(7) The extent to which the evaluation
plan includes a clear and credible
analysis plan, including a proposed
sample size and minimum detectable
effect size that aligns with the expected
project impact, and an analytic
approach for addressing the research
questions.
(8) The extent to which the evaluation
plan includes a clear, well-documented,
and rigorous method for measuring
implementation of the critical features
of the project, as well as the intended
outcomes.
(9) The extent to which the evaluation
plan clearly articulates the key
components and outcomes of the
project, as well as a measurable
threshold for acceptable
implementation.
13 See What Works Clearinghouse Procedures and
Standards Handbook. (Version 2.1, September
2011), which can currently be found at the
following link: https://ies.ed.gov/ncee/wwc/
DocumentSum.aspx?sid=19.
14 See What Works Clearinghouse Procedures and
Standards Handbook (Version 2.1, September 2011),
which can currently be found at the following link:
https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?
sid=19.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
(10) The extent to which the
evaluation plan will provide sufficient
information on the project’s effect as
compared to alternative practices
addressing similar need.
(11) The extent to which the proposed
project plan includes sufficient
resources to carry out the project
evaluation effectively.
Specific Requests for Comment
We are particularly interested in
comments about whether there are
important aspects of identifying
promising projects or assessing the
likelihood of project success that the
proposed selection criteria and factors
do not address. In addition, we are
interested in feedback about whether
there is ambiguity in the language of
specific criteria or factors that will make
it difficult for applicants to respond to
the criteria and peer reviewers to
evaluate the applications with respect to
the selection criteria.
Final Priorities, Requirements,
Definitions, and Selection Criteria
We will announce the final priorities,
requirements, definitions, and selection
criteria in a notice in the Federal
Register. We will determine the final
priorities, requirements, definitions, and
selection criteria after considering
responses to this notice and other
information available to the Department.
This notice does not preclude us from
proposing additional priorities,
requirements, definitions, or selection
criteria, subject to meeting applicable
rulemaking requirements.
Note: This notice does not solicit
applications. In any year in which we choose
to use one or more of these priorities,
requirements, definitions, and selection
criteria, we invite applications through a
notice in the Federal Register.
Executive Orders 12866 and 13563
Regulatory Impact Analysis
Under Executive Order 12866, the
Secretary must determine whether a
regulatory action is ‘‘significant’’ and,
therefore, subject to the requirements of
the Executive order and subject to
review by the Office of Management and
Budget (OMB). Section 3(f) of Executive
Order 12866 defines a ‘‘significant
regulatory action’’ as an action likely to
result in a rule that may—
(1) Have an annual effect on the
economy of $100 million or more, or
adversely affect a sector of the economy,
productivity, competition, jobs, the
environment, public health or safety, or
State, local or Tribal governments or
communities in a material way (also
PO 00000
Frm 00028
Fmt 4702
Sfmt 4702
74419
referred to as an ‘‘economically
significant’’ rule);
(2) Create serious inconsistency or
otherwise interfere with an action taken
or planned by another agency;
(3) Materially alter the budgetary
impacts of entitlement grants, user fees,
or local programs or the rights and
obligations of recipients thereof; or
(4) Raise novel legal or policy issues
arising out of legal mandates, the
President’s priorities, or the principles
stated in the Executive order.
This proposed regulatory action
would have an annual effect on the
economy of more than $100 million
because Department anticipates more
than that amount will be appropriated
for i3 and awarded as grants. Therefore,
this proposed action is ‘‘economically
significant’’ and subject to review by
OMB under section 3(f)(1) of Executive
Order 12866. Notwithstanding this
determination, we have assessed the
potential costs and benefits, both
quantitative and qualitative, of this
proposed regulatory action and have
determined that the benefits would
justify the costs.
The Department has also reviewed
these proposed requirements under
Executive Order 13563, which
supplements and explicitly reaffirms the
principles, structures, and definitions
governing regulatory review established
in Executive Order 12866. To the extent
permitted by law, Executive Order
13563 requires that an agency—
(1) Propose or adopt regulations only
upon a reasoned determination that
their benefits justify their costs
(recognizing that some benefits and
costs are difficult to quantify);
(2) Tailor its regulations to impose the
least burden on society, consistent with
obtaining regulatory objectives, taking
into account—among other things, and
to the extent practicable—the costs of
cumulative regulations;
(3) In choosing among alternative
regulatory approaches, select those
approaches that maximize net benefits
(including potential economic,
environmental, public health and safety,
and other advantages; distributive
impacts; and equity);
(4) To the extent feasible, specify
performance objectives, rather than
specifying the behavior or manner of
compliance a regulated entity must
adopt; and
(5) Identify and assess available
alternatives to direct regulation,
including providing economic
incentives—such as user fees or
marketable permits—to encourage the
desired behavior, or provide
information that enables the public to
make choices.
E:\FR\FM\14DEP1.SGM
14DEP1
74420
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
mstockstill on DSK4VPTVN1PROD with
Executive Order 13563 also requires
an agency ‘‘to use the best available
techniques to quantify anticipated
present and future benefits and costs as
accurately as possible.’’ The Office of
Information and Regulatory Affairs of
OMB has emphasized that these
techniques may include ‘‘identifying
changing future compliance costs that
might result from technological
innovation or anticipated behavioral
changes.’’
We are issuing these proposed
priorities, requirements, definitions, and
selection criteria only on a reasoned
determination that their benefits justify
their costs. In choosing among
alternative regulatory approaches, we
selected those approaches that would
maximize net benefits. Based on the
analysis that follows, the Department
believes these proposed regulations are
consistent with the principles in
Executive Order 13563.
We have also determined that this
regulatory action would not unduly
interfere with State, local, and Tribal
governments in the exercise of their
governmental functions.
Discussion of Costs and Benefits
The Secretary believes that the
proposed priorities, requirements,
definitions, and selection criteria would
not impose significant costs on eligible
LEAs, nonprofit organizations, or other
entities that would receive assistance
through the i3 program. The Secretary
also believes that the benefits of
implementing the proposals contained
in this notice outweigh any associated
costs.
The Secretary believes that the
proposed priorities, requirements,
definitions, and selection criteria would
result in selection of high-quality
applications to implement activities that
are most likely to have a significant
national impact on educational reform
and improvement. The proposed
priorities, requirements, definitions, and
selection criteria in this notice clarify
the scope of activities the Secretary
expects to support with program funds
and the expected burden of work
involved in preparing an application
and implementing a project under the
program. The pool of possible
applicants is very large, and there is
great interest in the program. During the
first 3 years of implementation the
Department received over 3,000
applications. Potential applicants, both
LEAs and nonprofit organizations, need
to consider carefully the effort that will
be required to prepare a strong
application, their capacity to implement
a project successfully, and their chances
of submitting a successful application.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
Program participation is voluntary.
The Secretary believes that the costs
imposed on applicants by the proposed
priorities, requirements, definitions, and
selection criteria would be limited to
paperwork burden related to preparing
an application and that the benefits of
implementing these proposals would
outweigh any costs incurred by
applicants. The costs of carrying out
activities would be paid for with
program funds and with matching funds
provided by private-sector partners.
Thus, the costs of implementation
would not be a burden for any eligible
applicants, including small entities.
However, under the proposed selection
criteria the Secretary would assess the
extent to which an applicant would be
able to sustain a project once Federal
funding through the i3 program is no
longer available. Thus, eligible
applicants should propose activities that
they will be able to sustain without
funding from the program and, thus, in
essence, should include in their project
plans the specific steps they will take
for sustained implementation of the
proposed project. The continued
proposal for the three types of grants
under i3—Development, Validation, or
Scale-up grants—would allow potential
applicants to determine which type of
grant they are best suited to apply for,
based on their own priorities, resources,
and capacity to implement grant
activities.
Regulatory Flexibility Act Certification
The Secretary certifies that this
proposed regulatory action will not have
a significant economic impact on a
substantial number of small entities.
The small entities that this proposed
regulatory action will affect are small
LEAs or nonprofit organizations
applying for and receiving funds under
this program. The Secretary believes
that the costs imposed on applicants by
the proposed priorities, requirements,
definitions, and selection criteria would
be limited to paperwork burden related
to preparing an application and that the
benefits of implementing these
proposals would outweigh any costs
incurred by applicants.
Participation in this program is
voluntary. For this reason, the proposed
priorities, requirements, definitions, and
selection criteria would impose no
burden on small entities in general.
Eligible applicants would determine
whether to apply for funds, and have
the opportunity to weigh the
requirements for preparing applications,
and any associated costs, against the
likelihood of receiving funding and the
requirements for implementing projects
under the program. Eligible applicants
PO 00000
Frm 00029
Fmt 4702
Sfmt 4702
most likely would apply only if they
determine that the likely benefits exceed
the costs of preparing an application.
The likely benefits include the potential
receipt of a grant as well as other
benefits that may accrue to an entity
through its development of an
application, such as the use of that
application to spur educational reforms
and improvements without additional
Federal funding.
The U.S. Small Business
Administration Size Standards defines
as ‘‘small entities’’ for-profit or
nonprofit institutions with total annual
revenue below $7,000,000 or, if they are
institutions controlled by small
governmental jurisdictions (that are
comprised of cities, counties, towns,
townships, villages, school districts, or
special districts), with a population of
less than 50,000. The Urban Institute’s
National Center for Charitable Statistics
reported that of 196,663 nonprofit
organizations that had an educational
mission and reported revenue to the IRS
by March of 2012, 168,784 (or about 86
percent) had revenues of less than $5
million. In addition, there are
approximately 16,000 LEAs in the
country that meet the definition of small
entity. However, the Secretary believes
that only a small number of these
entities would be interested in applying
for funds under this program, thus
reducing the likelihood that the
proposals contained in this notice
would have a significant economic
impact on small entities. As discussed
earlier, the number of applications
received during the last 3 competitions
from any type of applicant is
approximately 3,000.
In addition, the Secretary believes
that the proposed priorities,
requirements, definitions, and selection
criteria discussed in this notice do not
impose any additional burden on small
entities applying for a grant than they
would face in the absence of the
proposed action. That is, the length of
the applications those entities would
submit in the absence of the regulatory
action and the time needed to prepare
an application would likely be the same.
Further, the proposed action may help
small entities determine whether they
have the interest, need, or capacity to
implement activities under the program
and, thus, prevent small entities that do
not have such an interest, need, and
capacity from absorbing the burden of
applying, or assist those entities in
determining whether they should seek a
capable partner to pursue the
application process.
This proposed regulatory action
would not have a significant economic
impact on small entities once they
E:\FR\FM\14DEP1.SGM
14DEP1
Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules
Intergovernmental Review: This
program is subject to Executive Order
12372 and the regulations in 34 CFR
part 79. One of the objectives of the
Executive order is to foster an
intergovernmental partnership and a
strengthened federalism. The Executive
order relies on processes developed by
State and local governments for
coordination and review of proposed
Federal financial assistance.
This document provides early
notification of our specific plans and
Accounting Statement
actions for this program.
Accessible Format: Individuals with
As required by OMB Circular A–4
(available at www.whitehouse.gov/sites/ disabilities can obtain this document in
default/files/omb/assets/omb/circulars/ an accessible format (e.g., braille, large
a004/a-4.pdf), in the following table we print, audiotape, or compact disc) on
request to the program contact person
have prepared an accounting statement
listed under FOR FURTHER INFORMATION
showing the classification of the
CONTACT.
expenditures associated with the
Electronic Access to This Document:
provisions of this regulatory action. This
The official version of this document is
table provides our best estimate of the
the document published in the Federal
changes in annual monetized transfers
Register. Free Internet access to the
as a result of this regulatory action.
official edition of the Federal Register
Expenditures are classified as transfers
and the Code of Federal Regulations is
from the Federal Government to LEAs
available via the Federal Digital System
and nonprofit organizations.
at: www.gpo.gov/fdsys. At this site you
ACCOUNTING STATEMENT CLASSIFICA- can view this document, as well as all
other documents of this Department
TION OF ESTIMATED EXPENDITURES
published in the Federal Register, in
[In millions]
text or Adobe Portable Document
Format (PDF). To use PDF you must
Category
Transfers
have Adobe Acrobat Reader, which is
available free at the site.
Annualized Monetized $140.9 million.
You may also access documents of the
Transfers.
From Whom To
From the Federal
Department published in the Federal
Whom?
Government to
Register by using the article search
LEAs and nonprofit feature at: www.federalregister.gov.
organizations.
Specifically, through the advanced
feature at this site, you can limit your
Paperwork Reduction Act of 1995
search to documents published by the
Department.
The requirements and selection
criteria proposed in this notice will
Dated: December 11, 2012.
require the collection of information
James H. Shelton, III,
that is subject to review by the Office of Assistant Deputy Secretary for Innovation and
Management and Budget (OMB) under
Improvement.
the Paperwork Reduction Act of 1995
[FR Doc. 2012–30199 Filed 12–13–12; 8:45 am]
(44 U.S.C. 3501–3520). The burden
BILLING CODE 4000–01–P
associated with the i3 program was
approved by OMB under OMB Control
Number 1855–0021, which expires on
ENVIRONMENTAL PROTECTION
October 31, 2013. These proposed
AGENCY
priorities, requirements, definitions, and
selection criteria would allow the
40 CFR Part 52
Department to improve the design of the
i3 program to better achieve its purposes [EPA–R02–OAR–2010–0482; [FRL–9762–2]]
and goals. However, the revisions do not
Approval and Promulgation of Air
change the number of applications an
Quality Implementation Plans for
organization may submit or the burden
PM2.5; New Jersey; Attainment
that an applicant would otherwise incur
Demonstration, Reasonably Available
in the development and submission of
Control Measures; Base and Projection
a grant application under the i3
Year Emission Inventories, and Motor
program. Therefore, the Department
Vehicle Emissions Budgets
expects that this proposed regulatory
action will not affect the total burden of AGENCY: Environmental Protection
hours.
Agency (EPA).
mstockstill on DSK4VPTVN1PROD with
receive a grant because they would be
able to meet the costs of compliance
using the funds provided under this
program and with any matching funds
provided by private-sector partners.
The Secretary invites comments from
small nonprofit organizations and small
LEAs as to whether they believe this
proposed regulatory action would have
a significant economic impact on them
and, if so, requests evidence to support
that belief.
VerDate Mar<15>2010
16:21 Dec 13, 2012
Jkt 229001
PO 00000
Frm 00030
Fmt 4702
Sfmt 4702
ACTION:
74421
Proposed rule.
SUMMARY: The Environmental Protection
Agency (EPA) is proposing action on
New Jersey’s State Implementation Plan
(SIP) revision for attaining the 1997 fine
particle (PM2.5) national ambient air
quality standards (NAAQS), which was
submitted to EPA on April 1, 2009. EPA
is proposing to fully approve elements
of the New Jersey SIP for the New Jersey
portion of two nonattainment areas in
the State: The New York-N. New JerseyLong Island, NY-NJ-CT, PM2.5
nonattainment area, and the
Philadelphia-Wilmington, PA-NJ-DE,
PM2.5 nonattainment area.
EPA is taking action on several
elements of the SIP, including proposed
approval of New Jersey’s attainment
demonstration and motor-vehicle
emissions budgets used for
transportation conformity purposes, as
well as the Reasonably Available
Control Technology and Reasonably
Available Control Measures (RACT/
RACM) analysis, and base-year and
projection-year modeling emission
inventories.
This action is being taken in
accordance with the Clean Air Act and
the Clean Air Fine Particle
Implementation Rule issued by EPA.
DATES: Written comments must be
received on or before January 14, 2013.
ADDRESSES: Submit your comments,
identified by Docket ID Number EPA–
R02–OAR–2010–0482 by one of the
following methods:
1. www.regulations.gov: Follow the
on-line instructions for submitting
comments.
2. Email: Werner.Raymond@epa.gov.
3. Fax: 212–637–3901.
4. Mail: Raymond Werner, Chief, Air
Programs Branch, Environmental
Protection Agency, Region 2 Office, 290
Broadway, 25th Floor, New York, New
York 10007–1866.
5. Hand Delivery or Courier. Deliver
your comments to: Raymond Werner,
Chief, Air Programs Branch,
Environmental Protection Agency,
Region 2 Office, 290 Broadway, 25th
Floor, New York, New York 10007–
1866. Such deliveries are only accepted
during the Regional Office’s normal
hours of operation. The Regional
Office’s official business hours is
Monday through Friday, 8:30 a.m. to
4:30 p.m., excluding Federal holidays.
Instructions: Direct your comments to
Docket ID No. EPA–R02–OAR–2010–
0482. EPA’s policy is that all comments
received will be included in the public
docket without change and may be
made available online at
www.regulations.gov, including any
personal information provided, unless
E:\FR\FM\14DEP1.SGM
14DEP1
Agencies
[Federal Register Volume 77, Number 241 (Friday, December 14, 2012)]
[Proposed Rules]
[Pages 74407-74421]
From the Federal Register Online via the Government Printing Office [www.gpo.gov]
[FR Doc No: 2012-30199]
-----------------------------------------------------------------------
DEPARTMENT OF EDUCATION
34 CFR Subtitle A
RIN 1855-AA09
[Docket No. ED 2012-OII-0027]
Proposed Priorities, Requirements, Definitions, and Selection
Criteria--Investing in Innovation Fund
Catalog of Federal Domestic Assistance (CFDA) Numbers: 84.411A,
84.411B, and 84.411C
AGENCY: Office of Innovation and Improvement, Department of Education.
ACTION: Proposed priorities, requirements, definitions, and selection
criteria.
-----------------------------------------------------------------------
SUMMARY: The Assistant Deputy Secretary for Innovation and Improvement
proposes priorities, requirements, definitions, and selection criteria
under the Investing in Innovation Fund (i3). The Assistant Deputy
Secretary may use these priorities, requirements, definitions, and
selection criteria for competitions in fiscal year (FY) 2013 and later
years.
The U.S. Department of Education (Department) has conducted three
competitions under the i3 program and awarded 92 i3 grants since the
program was established under the American Recovery and Reinvestment
Act of 2009 (ARRA). These proposed priorities, requirements,
definitions, and selection criteria maintain the overall purpose and
structure of the i3 program, which is discussed later in this document,
and incorporate changes based on specific lessons learned from the
first three competitions.
DATES: We must receive your comments on or before January 14, 2013.
ADDRESSES: Submit your comments through the Federal eRulemaking Portal
or via postal mail, commercial delivery, or hand delivery. We will not
accept comments by fax or by email. To ensure that we do not receive
duplicate copies, please submit your comments only once. In addition,
please include the Docket ID at the top of your comments.
Federal eRulemaking Portal: Go to www.regulations.gov to
submit your comments electronically. Information on using
Regulations.gov, including instructions for accessing agency documents,
submitting comments, and viewing the docket, is available on the site
under ``How to Use This Site.''
Postal Mail, Commercial Delivery, or Hand Delivery: If you
mail or deliver your comments about these proposed regulations, address
them to Carol Lyons, U.S. Department of Education, 400 Maryland Avenue
SW., room 4W203, LBJ, Washington, DC 20202-5930.
Privacy Note: The Department's policy is to make all comments
received from members of the public available for public viewing in
their entirety on the Federal eRulemaking Portal at
www.regulations.gov. Therefore, commenters should be careful to
include in their comments only information that they wish to make
publicly available.
FOR FURTHER INFORMATION CONTACT: Carol Lyons. Telephone: (202) 453-
7122. Or by email: i3@ed.gov. If you use a telecommunications device
for the deaf (TDD) or text telephone (TTY), call the Federal Relay
Service (FRS), toll free, at 1-800-877-8339.
SUPPLEMENTARY INFORMATION: Invitation to Comment: We invite you to
submit comments regarding this notice. To ensure that your comments
have maximum effect in developing the notice of final priorities,
requirements, definitions, and selection criteria, we urge you to
identify clearly the specific proposed priority, requirement,
definition, or selection criterion that each comment addresses. We make
additional, specific requests for comment in the sections setting out
the proposed priorities, requirements, definitions, and selection
criteria elsewhere in this notice.
We invite you to assist us in complying with the specific
requirements of Executive Orders 12866 and 13563 and their overall
requirement of reducing regulatory burden that might result from these
proposed priorities, requirements, definitions, and selection criteria.
Please let us know of any further ways we could reduce potential costs
or increase potential benefits while preserving the effective and
efficient administration of the program.
During and after the comment period, you may inspect all public
comments about this notice by accessing Regulations.gov. You may also
inspect the comments in person in room 4W335, LBJ, 400 Maryland Avenue
SW., Washington, DC, between the hours of 8:30 a.m. and 4:00 p.m.,
Washington, DC time, Monday through Friday of each week except Federal
holidays. Please contact the person listed under FOR FURTHER
INFORMATION CONTACT.
Assistance to Individuals with Disabilities in Reviewing the
Rulemaking Record: On request we will provide an appropriate
accommodation or auxiliary aid to an individual with a disability who
needs assistance to review the comments or other documents in the
public rulemaking record for this notice. If you want to schedule an
appointment for this type of accommodation or auxiliary aid, please
contact the person listed under FOR FURTHER INFORMATION CONTACT.
Purpose of Program: The i3 program addresses two related
challenges. First, there are too few practices in education supported
by rigorous evidence of effectiveness, despite national attention paid
to finding practices that are effective at improving education outcomes
in the decade since the establishment of the Department's Institute of
Education Sciences (IES). Second, there are limited incentives to
expand effective practices substantially and to use those practices to
serve more students across schools, districts, and States. Student
achievement suffers as a result.
The central innovation of the i3 program, and how it addresses
these two challenges, is its multi-tier structure that links the amount
of funding that an applicant may receive to the quality of the evidence
supporting the efficacy of the proposed project. Applicants proposing
practices supported by limited evidence can receive small grants that
support the development and initial evaluation of promising practices
and help to identify new solutions to pressing challenges; applicants
proposing practices supported by evidence from rigorous evaluations,
such as large randomized controlled trials, can receive sizable grants
to support expansion across the Nation. This structure provides
incentives for applicants to build evidence of effectiveness of their
proposed projects and to address the barriers to serving more students
across schools, districts, and States so that applicants can compete
for more sizeable grants.
As importantly, all i3 projects are required to generate additional
evidence of effectiveness. All i3 grantees must use part of their
budgets to conduct independent evaluations (as defined in this notice)
of their projects. This ensures that projects funded under the i3
program contribute significantly to improving the information available
to practitioners and policymakers about which practices work, for which
types of students, and in which contexts.
Program Authority: American Recovery and Reinvestment Act of
2009 (ARRA), Division A, Section 14007, Pub. L. 111-5.
[[Page 74408]]
Background
The Statutory Context
The ARRA established the i3 program to provide competitive grants
to local educational agencies (LEAs) and nonprofit organizations with a
record of improving student achievement in order to expand the
implementation of, and investment in, innovative practices that are
demonstrated to improve student achievement (as defined in this notice)
or student growth (as defined in this notice), close achievement gaps,
decrease dropout rates, increase high school graduation rates (as
defined in this notice), or increase college enrollment and completion
rates. The ARRA provided funding for the i3 program's first competition
carried out during FY 2010; the FY 2011 and FY 2012 competitions were
funded under the Department's annual appropriations. The
Administration's reauthorization proposal for the Elementary and
Secondary Education Act of 1965, as amended (20 U.S.C. 6301 et seq.)
(ESEA) would authorize the i3 program under that act.
Overview of the Investing in Innovation Fund (i3)
As the Department's primary evidence-based grantmaking program, the
i3 program is designed to generate and validate solutions to persistent
educational challenges and support the expansion of effective solutions
across the country to serve substantially larger numbers of students.
There are a number of features that make the i3 program different
from many other Federal grant programs in education.
First, the i3 program builds a portfolio of different practices in
critical priority areas. As the Proposed Priorities section of this
document makes clear, the i3 program supports projects in a broad range
of areas, from increasing teacher and principal effectiveness to
turning around low-performing schools. We anticipate that after a
number of i3 competitions, practices will emerge that can address
challenges in each of these areas that are effective in improving
student outcomes across the Nation.
Second, the i3 program links funding to the quality and extent of
existing evidence showing the likelihood of a proposed practice
improving student outcomes. Different tiers of grants, with increasing
funding available at each tier, are linked to different levels of
evidence.
Third, the i3 program supports the expansion (scaling) of effective
programs by providing sufficient funding to build organizational
capacity and to overcome barriers to reaching additional students. The
different tiers of i3 grants comprise a funding continuum for effective
programs that spans initial, localized development to implementation on
a national scale, in the hope that more effective practices will
displace less effective ones and lead to increases in student
achievement and improvements in other student outcomes.
Fourth, the i3 program both requires and provides funding for an
independent evaluation of each project to build understanding of ``what
works'' in critical priority areas. An independent evaluation addresses
issues such as for which populations or student subgroups particular
practices are most effective and whether practices maintain their
effectiveness as they expand to serve more students in more diverse
contexts. An independent evaluation also provides an opportunity for
grantees to generate the evidence needed to compete for funds at the
next level of i3 funding (e.g., from a Development grant to a
Validation grant; see description of the three types of grants that
follows) if their projects are successful.
As in prior i3 competitions, in FY 2013 we intend to award three
types of grants under this program: ``Development'' grants,
``Validation'' grants, and ``Scale-up'' grants. These grants differ in
terms of the level of prior evidence of effectiveness required for
consideration of funding, the level of scale the funded project should
reach, and consequently the amount of funding available to support the
project. We provide an overview to clarify the expectations for each
grant type:
1. Development grants provide funding to support the development or
testing of practices that are supported by evidence of promise (as
defined in this notice) or strong theory (as defined in this notice)
and whose efficacy should be systematically studied. We intend
Development grants to support new or substantially more effective
practices for addressing widely shared challenges. Development projects
should be novel and significant nationally, not projects that simply
implement existing practices in additional locations or support needs
that are primarily local in nature.
All Development grantees must evaluate the effectiveness of the
project at the level of scale proposed in the application. Development
grant evaluations should assess whether the i3-supported practice is
better than other approaches at increasing student achievement (as
defined in this notice) or student growth (as defined in this notice),
closing achievement gaps, decreasing dropout rates, increasing high
school graduation rates (as defined in this notice), or increasing
college enrollment and completion rates.
2. Validation grants provide funding to support expansion of
projects supported by moderate evidence of effectiveness (as defined in
this notice) to the national or regional level (as defined in this
notice). Validation projects must further assess the effectiveness of
the i3-supported practice through a rigorous evaluation, with
particular focus on the populations for and the contexts in which the
practice is most effective.
The outcomes of the first three i3 competitions have demonstrated
that Validation grantees vary widely in their organizational maturity
and capacity to expand significantly, far more than have Scale-up
grantees. Given this history, we expect and consider it appropriate
that each applicant would propose to use the Validation funding to
build its capacity to deliver the i3-supported practice, particularly
early in the funding period, to successfully reach the level of scale
proposed in its application. The applicant would need to address any
specific barriers to the growth or scaling of the organization or
practice (including barriers related to cost-effectiveness) in order to
deliver the i3-supported practice at the proposed level of scale and
provide strategies to address these barriers as part of its proposed
scaling plan.
All Validation grantees must evaluate the effectiveness of the
practice that the supported project implements and expands. We expect
that these evaluations will be conducted in a variety of contexts and
for a variety of students, will identify the core elements of the
practice, and will codify the practices to support adoption or
replication by the applicant and other entities.
3. Scale-up grants provide funding to support expansion of projects
supported by strong evidence of effectiveness (as defined in this
notice) to the national level (as defined in this notice). In addition
to improving outcomes for an increasing number of high-need students,
we expect that Scale-up projects will generate information about the
students and contexts for which a practice is most effective. We expect
that Scale-up projects will increase understanding of strategies that
allow organizations or practices to expand quickly and efficiently
while maintaining their effectiveness.
A Scale-up grant may support the expansion of practices that have
demonstrated through prior experience
[[Page 74409]]
and rigorous evaluation that they are effective at improving student
achievement. An entity applying for a Scale-up grant should use the
grant funding, at least in part, to address specific barriers to the
growth or scaling up of an organization or practice (including barriers
related to cost-effectiveness) in order to deliver the i3-supported
practice at the proposed level of scale so that the entity is well-
positioned to continue expansion following the expiration of Federal
funding.
Similar to Validation grants, all Scale-up grantees must evaluate
the effectiveness of the i3-supported practice that the project
implements and expands; this is particularly important in instances in
which the proposed project includes changing the i3-supported practice
in order to more efficiently reach the proposed level of scale (for
example, by developing technology-enabled training tools). We expect
that these evaluations would be conducted in a variety of contexts and
for a variety of students in order to determine the context(s) and
population(s) for which the i3-supported practice is most effective.
Regardless, the evaluation of a Scale-up grant must identify core
elements of and codify the i3-supported practice that the project
implements to support adoption or replication by other entities.
Proposed Priorities
This notice contains 10 proposed priorities. In addition, in any i3
competition we may include priorities from the notice of final
supplemental priorities and definitions for discretionary grant
programs, published in the Federal Register on December 15, 2010 (75 FR
78486), and corrected on May 12, 2011 (76 FR 27637) (Supplemental
Priorities). We are not proposing in this notice priorities in such
areas as early learning or standards and assessments, which are already
included in the Supplemental Priorities, because the language in the
Supplemental Priorities adequately addresses those areas for the
purposes of the i3 program.
Proposed Priorities
Background
The original set of four absolute priorities that the Department
used for the FY 2010 i3 competition focused on the four assurances (or
education reform areas) the Department used in implementing multiple
programs funded under ARRA. We continue to consider these reform areas
important and, thus, either include them in these proposed priorities
or may include them in future competitions through the Supplemental
Priorities.
The original i3 priorities were written broadly and generated a
wide range of projects in the first three competitions. Now we are
interested in supporting a more focused set of projects within areas of
acute need and in more directly addressing particular challenges. Thus,
we propose to modify our approach to the structure of the priorities so
that each priority area includes the particular needs that the
Secretary may address when establishing the priorities for a particular
i3 competition. Our intent is to establish the flexibility to select
from a variety of possible project focus areas within a given priority
rather than using broad priorities as we have in the past; however, we
expect to use only a subset of the priorities and the project focus
areas within them in any particular future notice inviting
applications. The Department will consider several factors when
selecting the priorities to use in a given year, including the
Administration's policy priorities, the need for new solutions in a
particular priority area, other available funding for a particular
priority area, and the results and lessons learned from prior i3
competitions. Further, the Department will consider the level of
evidence or research available across the different priorities when
determining which of the priorities would be most appropriate for the
different types of grants under the i3 program. In a given year, the
notice inviting applications will provide a concise list of the
priorities that will be used for that year's i3 competition.
We propose that the Secretary may use any of the priorities
established in the notice of final priorities, requirements,
definitions, and selection criteria when establishing the priorities
for each particular type of grant (Development, Validation, and Scale-
up) in an i3 competition in FY 2013 and in subsequent years.
Proposed Priority 1--Improving the Effectiveness of Teachers or
Principals
Background: Research indicates that teachers and principals are the
most critical in-school factors in improving student achievement.\1\
Proposed priority 1, therefore, focuses on improving the effectiveness
of teachers and principals. Specifically, the proposed priority focuses
on all dimensions of the teacher and principal career path and seeks to
identify effective methods for recruiting, preparing, supporting,
evaluating, and retaining effective principals and teachers,
particularly at schools that serve high-needs students.
---------------------------------------------------------------------------
\1\ Wright, S.P., Horn, S.P., Sanders, W.L. (1997). Teacher and
classroom context effects on student achievement: Implications for
teacher evaluation. Journal of Personnel Evaluation in Education
11:57-67; Rivkin, S.G., Hanushek, E.A., Kain, J.F. (2005). Teachers,
schools, and academic achievement. Economerica, 73(2):417-458.
Leithwood, K., Louis, K.S., Anderson, S., and Wahlstrom, K.
(2004). Review of research: How leadership influences student
learning. University of Minnesota, Center for Applied Research and
Educational Improvement. Found at www.cehd.umn.edu/carei/Leadership/ReviewofResearch.pdf.
---------------------------------------------------------------------------
The proposed priority highlights the need for schools and districts
to consider how to recruit effective teachers and principals, create
distinct career pathways based on the strengths of its teachers and
principals and the needs of its schools, and develop evaluation systems
that provide information that can be used to provide timely and useful
feedback for teachers and principals. Schools and districts can use
these evaluation data to identify and provide necessary resources and
tailored professional development in order to support the teachers and
principals currently in the schools and to improve the processes for
recruiting new talent. Providing teachers with tailored development and
supports is important for improving teacher effectiveness and retaining
teachers to ensure all schools have highly effective teachers and
principals. Thus, the priority includes developing professional
development supports and tools for teachers, including creating and
implementing models that help teachers utilize time and resources more
efficiently while maintaining or improving outcomes.
Finally, to ensure that all schools, especially those serving high-
need students, benefit from projects funded under this priority, the
priority also supports efforts to equitably distribute effective
teachers and principals among schools.
Proposed Priority 1--Improving the Effectiveness of Teachers or
Principals
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Developing new methods and sources for recruiting:
(1) Highly effective teachers (as defined in this notice);
(2) Highly effective principals (as defined in this notice); or
(3) Highly effective teachers and principals (as defined in this
notice).
(b) Developing models for teacher preparation that deepen
pedagogical knowledge and skills, such as
[[Page 74410]]
knowledge of instructional practices or knowledge and skills in
classroom management, or that deepen pedagogical content knowledge,
that have been demonstrated to improve student achievement.
(c) Developing models of induction and support for improving the
knowledge and skills of novice teachers to increase teacher retention,
improve teaching effectiveness, and accelerate student performance.
(d) Creating career pathways with differentiated opportunities and
roles for teachers or principals, which may include differentiated
compensation.
(e) Designing and implementing teacher or principal evaluation
systems that provide clear, timely, and useful feedback, including
feedback that identifies areas for improvement and that guides
professional development for teachers and principals.
(f) Developing supports for ongoing development and improvement of
teachers, principals, or instructional leaders, such as local and
virtual communities, tools, training, and other mechanisms.
(g) Increasing the equitable distribution of effective teachers or
principals across schools.
(h) Extending the reach of highly effective teachers to more
students such as through developing and implementing school models that
improve conditions for teaching and learning; or offering new
opportunities for teachers to collaborate to accelerate student
performance.
(i) Other projects addressing pressing needs related to improving
teacher or principal effectiveness.
Proposed Priority 2--Improving Low-Performing Schools
Background: Approximately 10 percent of all high schools produce
nearly half of the Nation's dropouts.\2\ Proposed priority 2 addresses
the pressing need to ensure all students receive a quality K-12
education by providing funding for activities that are designed to
accelerate the performance of severely low-performing schools and the
schools that feed students into them. Given the range of schools that
this proposed priority aims to address, we are designing this priority
to identify and support multiple approaches that can successfully turn
around low-performing schools and improve outcomes for students in
them.
---------------------------------------------------------------------------
\2\ Balfanz, R., Bridgeland, J.M., Horning Fox, J., Moore, L.A.
(2010). Building a Grad nation: Progress and Challenge in Ending the
High School Dropout Epidemic 2010-2011 Annual Update. See
www.americaspromise.org/Our-Work/Grad-Nation/Building-a-Grad-Nation.aspx.
---------------------------------------------------------------------------
Providing a combination of reform strategies, including effective
teachers, strong school leadership, embedded professional development,
greater use of data to inform instruction, increased learning time, and
collaboration among teachers, can improve instruction and student
outcomes in low-performing schools. Additionally, whole-school and
``wraparound'' reform strategies also can be used to improve the school
environment and address other non-academic factors that affect student
achievement. Thus, this proposed priority supports projects that would
implement these strategies in low-performing schools.
Community engagement also is crucial to successfully turning around
low-performing schools, so the proposed priority provides for enhancing
the capacity of external partners to support these schools. Finally, to
support States and districts specifically in their ongoing school
reform efforts, the proposed priority supports projects designed to
expand State and district capacity to turn around low-performing
schools.
Proposed Priority 2--Improving Low-Performing Schools
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Designing whole-school models that incorporate such strategies
as providing strong school leadership; strengthening the instructional
program; embedding professional development that provides teachers with
frequent feedback to increase the rigor and effectiveness of their
instructional practice; redesigning the school day, week, or year;
using data to inform instruction and improvement; establishing a school
environment that promotes a culture of high expectations and addresses
non-academic factors that affect student achievement; and providing
ongoing mechanisms for parent and family engagement.
(b) Changing selected elements of the school's organizational
design, such as by differentiating staff roles, changing student
groupings, or enhancing instructional time.
(c) Recruiting, developing, or retaining highly effective staff,
specifically teachers, principals, or instructional leaders, to work in
low-performing schools.
(d) Implementing ``wraparound'' and social supports for students
that address non-academic factors that impede student learning.
(e) Developing and enhancing the capacity of external partners to
support efforts to turn around low-performing schools or districts.
(f) Expanding district- or State-level capacity to turn around low-
performing schools by developing systems and processes to improve State
and district support and oversight.
(g) Other projects addressing pressing needs related to improving
low-performing schools.
Other Proposed Requirements Related to Proposed Priority 2
To meet this priority, a project must serve schools among (1) The
lowest-performing schools in the State on academic performance
measures; (2) schools in the State with the largest within-school
performance gaps between student subgroups described in section
1111(b)(2) of the ESEA; or (3) secondary schools in the State with the
lowest graduation rate over a number of years or the largest within-
school gaps in graduation rates between student subgroups described in
section 1111(b)(2) of the ESEA.
Proposed Priority 3--Improving Science, Technology, Engineering, and
Mathematics (STEM) Education
Background: Ensuring that all students can access and excel in STEM
fields is essential to our Nation's innovation economy and future
prosperity. An increasing number of careers require an understanding of
STEM concepts and the application of the skills and techniques of
science, technology, engineering and mathematics; this proposed
priority addresses this growing need.
The President's Council of Advisors on Science and Technology
(PCAST) \3\ has produced reports on K-12 and undergraduate STEM
education that provided recommendations on increasing achievement and
postsecondary enrollment in STEM fields. The recommendations include
cultivating and recruiting STEM teachers, creating STEM-related
experiences to inspire and engage students, and encouraging
partnerships among stakeholders in order to diversify pathways to STEM
careers. Proposed priority 3 supports projects that would address these
recommendations by revising STEM courses, making STEM learning more
engaging to a wider range of students, increasing the number of
effective STEM teachers, and expanding STEM education and career
opportunities for groups traditionally
[[Page 74411]]
underrepresented in the STEM fields, including minorities, individuals
with disabilities, and women and girls.
---------------------------------------------------------------------------
\3\ See www.whitehouse.gov/administration/eop/ostp/pcast/docsreports.
---------------------------------------------------------------------------
Proposed Priority 3--Improving Science, Technology, Engineering, and
Mathematics (STEM) Education
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Providing students with increased access to rigorous and
engaging coursework in STEM.
(b) Redesigning STEM course content and instructional practices to
engage students and increase student academic success.
(c) Developing new methods and resources for recruiting individuals
with content expertise in STEM subject areas into teaching.
(d) Increasing the opportunities for high-quality preparation of,
or professional development for, teachers or other educators in STEM
subjects, through activities that include building content and
pedagogical content knowledge.
(e) Expanding opportunities for high-quality out-of-school and
extended-day activities that provide students with opportunities for
deliberate practice that increase STEM learning, engagement, and
expertise.
(f) Increasing the number of individuals from groups traditionally
underrepresented in STEM, including minorities, individuals with
disabilities, and women and girls, who are provided with access to
rigorous and engaging coursework in STEM and are prepared for
postsecondary study in STEM.
(g) Increasing the number of individuals from groups traditionally
underrepresented in STEM, including minorities, individuals with
disabilities, and women, who are teachers or educators of STEM subjects
and have increased opportunities for high-quality preparation or
professional development.
(h) Other projects addressing pressing needs for improving STEM
education.
Proposed Priority 4--Improving Academic Outcomes for Students With
Disabilities
Background: One of the primary goals of the ESEA is to improve the
quality of education for all students, including students with
disabilities, and ensuring the provision of an appropriate education to
students with disabilities is the primary objective of the Individuals
with Disabilities Education Act. Proposed priority 4 would support
activities focused on improving the instruction for and assessment of
students with disabilities from early learning through postsecondary
education. Thus, the proposed priority would support projects that
coordinate technical assistance across programs serving infants,
toddlers, or preschoolers with disabilities to ensure the operation of
coherent systems supporting these children and their families. And, at
the postsecondary level, the priority would support projects that
collect data on academic and other outcomes for students with
disabilities to better understand their transition into postsecondary
education and how their secondary school education prepares them for
higher education.
Consistent with our approach under proposed priority 1 and
recognizing the critical importance of evaluating teacher
effectiveness, this proposed priority also would support projects to
design and implement teacher evaluation systems that measure the
performance of special education teachers and related service
providers.
Finally, because we know that students with differing abilities can
learn and excel at high levels, provided they receive appropriate
academic and non-academic supports, this priority would support
projects designed to improve academic outcomes for students with
disabilities in inclusive settings.
Proposed Priority 4--Improving Academic Outcomes for Students With
Disabilities
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Coordinating technical assistance across programs that address
the needs of infants, toddlers, or preschoolers with disabilities, in
order to ensure the operation of coherent systems of support for those
children and their families.
(b) Designing and implementing teacher evaluation systems that
define and measure effectiveness of special education teachers and
related service providers.
(c) Improving academic outcomes for students with disabilities in
inclusive settings.
(d) Improving postsecondary data collection and tracking of
academic and related outcomes for students with disabilities to
understand their transition into postsecondary education and how their
secondary school education prepared them for higher education.
(e) Other projects addressing pressing needs related to improving
academic outcomes for students with disabilities.
Proposed Priority 5--Improving Academic Outcomes for English Learners
(ELs)
Background: School districts across the country have experienced a
substantial increase in the enrollment of students who cannot speak,
read, or write English well enough to participate meaningfully in
educational programs without appropriate support services. Proposed
priority 5 would support activities that are designed to address the
language-related limitations that can impede student learning.
A student's ability to master core academic subjects depends on the
student's ability to understand academic language, including
discipline-specific vocabulary. Therefore, proposed priority 5 aims to
increase opportunities for ELs to develop their academic and literacy
skills and for ELs to build their skills in using and understanding
English language oral discourse, varying and complex text types, and
discipline-specific vocabulary that are typical of core academic
courses.
Consistent with our approach under Proposed Priorities 1 and 4 and
recognizing the critical importance of evaluating teacher
effectiveness, this proposed priority also would support projects to
design and implement teacher evaluation systems that measure the
performance of teachers of ELs.
The proposed priority also aims to improve the high school
graduation rates and college-readiness of ELs by supporting projects
that would align the curriculum used in the language development and
content courses in which they enroll with college- and career-ready
standards as well as projects that would provide robust and targeted
professional development to teachers, administrators, and other school
personnel serving EL students.
Proposed Priority 5--Improving Academic Outcomes for English Learners
(ELs)
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Increasing the number and proportion of ELs successfully
completing courses in core academic subjects by developing,
implementing, and evaluating new instructional approaches and tools
that are sensitive to the language demands necessary to access
challenging content, including technology-based tools.
[[Page 74412]]
(b) Aligning and implementing the curriculum and instruction used
in grades 6-12 for language development and content courses to provide
the academic vocabuarly and discourse skills necessary for preparing
ELs to be college- and career-ready.
(c) Preparing young ELs to be on track to be college- and career-
ready when they graduate from high school by developing comprehensive,
developmentally appropriate, early learning programs (birth-grade 3)
that are aligned with the State's high-quality early learning
standards, designed to improve readiness for kindergarten, and support
development of literacy and academic skills in English or in English
and another language.
(d) Developing and implementing school-wide professional
development for teachers, administrators, and other personnel in
schools in which a significant percentage of students are ELs.
(e) Designing and implementing teacher evaluation systems that
define and measure effectiveness of teachers of ELs.
(f) Other projects addressing pressing needs related to improving
academic outcomes for ELs.
Proposed Priority 6--Improving Parent and Family Engagement
Background: Parents and families are instrumental in helping
children improve their academic performance. Proposed priority 6
addresses the need for building parents' and families' awareness of
their role in improving their children's educational outcomes and
enhancing their ability to support student learning and school
improvement through training. Additionally, the proposed priority
addresses the corresponding need to provide professional development to
school staff so that they have the skills needed to support and
cultivate environments that are welcoming to parents and families and
to build relationships that increase their capacity to support their
children's educational needs.
Finally, to ensure that parents and families have the information
they need to be full partners in their children's education, this
proposed priority would support the development of tools and
initiatives that provide them with ongoing access to data about their
children's progress and performance.
Proposed Priority 6--Improving Parent and Family Engagement
Under this proposed priority, we would provide funding to projects
that address one or more of the following priority areas:
(a) Developing and implementing initiatives that provide training
for parents and families to learn skills and strategies that will
support their students in improving academic outcomes.
(b) Implementing initiatives that are designed to enhance the
skills and competencies of school and other administrative staff in
building relationships and collaborating with families, particularly
those who have been underengaged with the school(s) in the past, in
order to support student achievement and school improvement.
(c) Implementing initiatives that cultivate sustainable
partnerships and increase connections between parents and school staff
in order to support student achievement and school improvement.
(d) Developing tools or practices that provide students and parents
with improved, ongoing access to data and other information about the
students' progress and performance.
(e) Other projects addressing pressing needs related to improving
student outcomes by improving parent and family engagement.
Proposed Priority 7--Improving Cost-Effectiveness and Productivity
Background: It is essential for schools and LEAs to closely examine
their spending practices and reallocate resources toward more efficient
and more cost-effective strategies. Accordingly, through proposed
priority 7, the Department continues to emphasize the importance of
cost-effectiveness and productivity. Improvements in operational,
organizational, and instruction processes and structures will allow
organizations to achieve the best possible results in the most
efficient manner.
With proposed priority 7, we continue and strengthen this focus by
including specific requirements that applicants must address. These
additional details clarify important elements to ensure that an
applicant's proposed plan to improve productivity would provide
sufficient detail about how the applicant aims to modify its processes
and structures and how the applicant would evaluate whether the
proposed project was cost-effective when implemented. A detailed
budget, an examination of different types of costs, and a plan to
monitor and evaluate the cost savings are essential to any reasoned
attempt at improving productivity.
Proposed Priority 7--Improving Cost-Effectiveness and Productivity
Under this proposed priority, we would provide funding to projects
that address one of the following areas:
(a) Substantially improving student outcomes without commensurately
increasing per-student costs.
(b) Maintaining student outcomes while substantially decreasing
per-student costs.
(c) Substantially improving student outcomes while substantially
decreasing per-student costs.
Other Proposed Requirements Related to Proposed Priority 7
An application proposing to address this priority must provide--
(1) A clear and coherent budget that identifies expected student
outcomes before and after the practice, the cost per student for the
practice, and a clear calculation of the cost per student served;
(2) A compelling discussion of the expected cost-effectiveness of
the practice compared with alternative practices;
(3) A clear delineation of one-time costs versus ongoing costs and
a plan for sustaining the project, particularly ongoing costs, after
the expiration of i3 funding;
(4) Identification of specific activities designed to increase
substantially the cost-effectiveness of the practice, such as re-
designing costly components of the practice (while maintaining
efficacy) or testing multiple versions of the practice in order to
identify the most cost-effective approach; and
(5) A project evaluation that addresses the cost-effectiveness of
the proposed practice.
Proposed Priority 8--Effective Use of Technology
Background: Technology can improve student academic outcomes, often
rapidly and in unprecedented ways. While there have been significant
advances in the use of technology, the core operations of most schools
and LEAs remain untouched. The Department's National Education
Technology Plan 2010 \4\ highlighted the potential of ``connected
teaching'' to extend the reach of the most effective teachers by using
online tools, and it also highlighted the need for high-quality
learning resources that can reach learners wherever and whenever they
are needed. Thus, proposed priority 8 supports strategies that address
these needs.
---------------------------------------------------------------------------
\4\ See www.ed.gov/edblogs/technology/netp-2010/.
---------------------------------------------------------------------------
[[Page 74413]]
Technological solutions also can be used effectively to assess the
learning progress of individual students and to provide appropriate
feedback to students and teachers. Proposed priority 8 would therefore
support projects using instructional platforms that provide customized
instruction for different learners, including integrated assessments
and continuous feedback.
Proposed Priority 8--Effective Use of Technology
Under this proposed priority, we would provide funding to projects
that use technology to address one or more of the following priority
areas:
(a) Providing real-time access to learning experiences that are
adaptive and self-improving in order to optimize the delivery of
instruction to learners with a variety of learning needs.
(b) Providing students and teachers with ``anytime, anywhere''
access to academic content and learning experiences that they otherwise
would not have access to, such as rigorous coursework that is not
offered in a particular school, or effective professional development
activities or learning communities enabled by technology.
(c) Developing new methods and resources for teacher preparation or
professional development that increase a teacher's ability to utilize
technology in the classroom to improve student outcomes.
(d) Assessing student proficiencies in complex skills, such as
critical thinking and collaboration across academic disciplines.
(e) Developing and implementing technology-enabled strategies for
teaching and learning, such as models and simulations, collaborative
virtual environments, or ``serious games,'' especially for teaching
concepts and content (e.g., systems thinking) that are difficult to
teach using traditional approaches.
(f) Integrating technology with the implementation of rigorous
college- and career-ready standards.
(g) Other projects that increase the use of technology for
effective teaching and learning.
Proposed Priority 9--Formalizing and Codifying Effective Practices
Background: A primary goal of the i3 program is to identify and
support the expansion of effective practices. The education field's
knowledge management systems and dissemination of effective practices,
particularly in instances where an effective practice could displace a
less effective or ineffective practice, is underdeveloped. Proposed
priority 9 aims to address these challenges and improve student
outcomes by supporting strategies that identify key elements of
effective practices and capturing lessons learned about the
implementation of the practices. An applicant meeting this priority
must commit to sharing knowledge about the practice broadly and
supporting the implementation of the practice in other settings and
locations in order to assess whether the practice can be successfully
replicated.
Proposed Priority 9--Formalizing and Codifying Effective Practices
Under this proposed priority, we would provide funding to projects
that formalize and codify effective practices. An application proposing
to address this priority must, as part of its application:
(a) Identify the practice or practices that the application
proposes to formalize (i.e., establish and define key elements of the
practice) and codify (i.e., develop a guide or tools to support the
dissemination of information on key elements of the practice) and
explain why there is a need for formalization and codification.
(b) Evaluate different forms of the practice to identify the
critical components of the practice that are crucial to its success and
sustainability, including the adaptability of critical components to
different teaching and learning environments.
(c) Provide a coherent and comprehensive plan for developing
materials, training, toolkits, or other supports that other entities
would need in order to implement the practice effectively and with
fidelity.
(d) Commit to assessing the replicability and adaptability of the
practice by supporting the implementation of the practice in a variety
of locations during the project period using the materials, training,
toolkits, or other supports that were developed for the i3-supported
practice.
Proposed Priority 10--Serving Rural Communities
Background: Educational challenges and the corresponding solutions
frequently are different in rural areas from those in urban or suburban
areas. Proposed priority 10 recognizes this and would support projects
that serve students from rural areas. In so doing, proposed priority 10
would help ensures that rural areas have access to and benefit from
innovative education reforms that specifically address their needs.
Proposed Priority 10--Serving Rural Communities
Under this proposed priority, we would provide funding to projects
that address one of the absolute priorities established for a
particular i3 competition and under which the majority of students to
be served are enrolled in rural local educational agencies (as defined
in this notice).
Specific Requests for Comment
In addition to our general interest in receiving comment on the
priorities proposed in this notice, we are particularly interested in
comments related to proposed priority 7, Improving Cost-Effectiveness
and Productivity, and proposed priority 5, Improving Academic Outcomes
for ELs. We seek comments on whether the language of proposed priority
7 should establish a specific numeric target or threshold of cost-
effectiveness or productivity improvement and, if we were to establish
such a target, suggestions for what that target or threshold should be
and how we should require that applicants or grantees measure progress
toward and attainment of it. With regards to (c) of proposed priority
5, we seek comments on whether the Department should allow applicants
to meet the priority by proposing processes, products, strategies, or
practices that address instruction in English or in English and a
language other than English.
We also recognize that the goals of supporting practices that are
both innovative and evidence-based has the potential to limit the
universe of applicants. Therefore, we are interested in receiving
comments on whether we should establish a priority for applicants that
have never received or partnered with an entity that has received a
grant under the i3 program.
Types of Priorities
When inviting applications for a competition using one or more
priorities, we designate the type of each priority as absolute,
competitive preference, or invitational through a notice in the Federal
Register. The effect of each type of priority follows:
Absolute priority: Under an absolute priority, we consider only
applications that meet the priority (34 CFR 75.105(c)(3)). In the i3
competition, each application must choose to address one of the
absolute priorities and projects are grouped by that absolute priority
for the purposes of peer review and funding determinations.
Competitive preference priority: Under a competitive preference
priority,
[[Page 74414]]
we give competitive preference to an application by (1) awarding
additional points, depending on the extent to which the application
meets the priority (34 CFR 75.105(c)(2)(i)); or (2) selecting an
application that meets the priority over an application of comparable
merit that does not meet the priority (34 CFR 75.105(c)(2)(ii)).
Invitational priority: Under an invitational priority, we are
particularly interested in applications that meet the priority.
However, we do not give an application that meets the priority a
preference over other applications (34 CFR 75.105(c)(1)).
Proposed Requirements
Background
We propose to revise some of the nonstatutory i3 program
requirements that the Department has previously established based on
our experiences with the three i3 competitions the Department has held
to date. For example, many existing, widespread practices in the field
currently lack the evidence base to compete for Scale-up or Validation
grants because of limited prior investments in rigorous, high-quality
evaluations and limited internal capacity to conduct these evaluations.
One of the primary goals of the i3 program is to increase knowledge of
what works in education for i3 grantees and non-grantees alike. As
such, we propose to strengthen the project evaluation requirement so
that i3 grantees will produce high-quality evaluations that estimate
the impact of the i3-supported practice (as implemented at the proposed
level of scale) on a relevant outcome (as defined in this notice).
Evaluations might consider whether the i3-supported practice is
more effective than other approaches or its effect on improving student
achievement (as defined in this notice) or student growth (as defined
in this notice), closing achievement gaps, decreasing dropout rates,
increasing high school graduation rates (as defined in this notice), or
increasing college enrollment and completion rates.
Proposed Requirements
The Assistant Deputy Secretary proposes the following requirements
for this program. We may apply one or more of these requirements in any
year in which this program is in effect.
1. Innovations that Improve Achievement for High-Need Students: All
grantees must implement practices that are designed to improve student
achievement (as defined in this notice) or student growth (as defined
in this notice), close achievement gaps, decrease dropout rates,
increase high school graduation rates (as defined in this notice), or
increase college enrollment and completion rates for high-need students
(as defined in this notice).
2. Innovations that Serve Kindergarten-through-Grade-12 (K-12)
Students: All grantees must implement practices that serve students who
are in grades K-12 at some point during the funding period. To meet
this requirement, projects that serve early learners (i.e., infants,
toddlers, or preschoolers) must provide services or supports that
extend into kindergarten or later years, and projects that serve
postsecondary students must provide services or supports during the
secondary grades or earlier.
3. Eligible Applicants: Entities eligible to apply for i3 grants
include either of the following:
(a) An LEA.
(b) A partnership between a nonprofit organization and--
(1) One or more LEAs; or
(2) A consortium of schools.
Statutory Eligibility Requirements: Except as specifically set
forth in the Note about Eligibility for an Eligible Applicant that
Includes a Nonprofit Organization that follows, to be eligible for an
award, an eligible applicant must--
(a)(1) Have significantly closed the achievement gaps between
groups of students described in section 1111(b)(2) of the ESEA
(economically disadvantaged students, students from major racial and
ethnic groups, students with limited English proficiency, students with
disabilities); or
(2) Have demonstrated success in significantly increasing student
academic achievement for all groups of students described in that
section;
(b) Have made significant improvements in other areas, such as high
school graduation rates (as defined in this notice) or increased
recruitment and placement of high-quality teachers and principals, as
demonstrated with meaningful data;
(c) Demonstrate that it has established one or more partnerships
with the private sector, which may include philanthropic organizations,
and that organizations in the private sector will provide matching
funds in order to help bring results to scale; and
(d) In the case of an eligible applicant that includes a nonprofit
organization, provide in the application the names of the LEAs with
which the nonprofit organization will partner, or the names of the
schools in the consortium with which it will partner. If an eligible
applicant that includes a nonprofit organization intends to partner
with additional LEAs or schools that are not named in the application,
it must describe in the application the demographic and other
characteristics of these LEAs and schools and the process it will use
to select them.
Note about LEA Eligibility: For purposes of this program, an
LEA is an LEA located within one of the 50 States, the District of
Columbia, or the Commonwealth of Puerto Rico.
Note about Eligibility for an Eligible Applicant that Includes a
Nonprofit Organization: The authorizing statute specifies that an
eligible applicant that includes a nonprofit organization meets the
requirements in paragraphs (a) and (b) of the eligibility
requirements for this program if the nonprofit organization has a
record of significantly improving student achievement, attainment,
or retention. For an eligible applicant that includes a nonprofit
organization, the nonprofit organization must demonstrate that it
has a record of significantly improving student achievement,
attainment, or retention through its record of work with an LEA or
schools. Therefore, an eligible applicant that includes a nonprofit
organization does not necessarily need to include as a partner for
its i3 grant an LEA or a consortium of schools that meets the
requirements in paragraphs (a) and (b) of the eligibility
requirements in this notice.
In addition, the authorizing statute specifies that an eligible
applicant that includes a nonprofit organization meets the
requirements of paragraph (c) of the eligibility requirements in
this notice if the eligible applicant demonstrates that it will meet
the requirement for private-sector matching.
4. Cost-Sharing or Matching Funds: To be eligible for an award, an
applicant must demonstrate that one or more private sector
organizations, which may include philanthropic organizations, will
provide matching funds in order to help bring project results to scale.
An eligible applicant must obtain matching funds or in-kind donations
equal to an amount that the Secretary will specify in the notice
inviting applications for the specific i3 competition. The Secretary
will announce in the notice inviting applications when and how selected
eligible applicants must submit evidence of the private-sector matching
funds.
The Secretary may consider decreasing the matching requirement in
the most exceptional circumstances. The Secretary will provide
instructions for how to request a reduction of the matching requirement
in the notice inviting applications.
5. Evidence Standards: To be eligible for an award, an application
for a Development grant must be supported by one of the following:
[[Page 74415]]
(a) Evidence of promise (as defined in this notice);
(b) Strong theory (as defined in this notice); or
(c) Evidence of promise (as defined in this notice) or strong
theory (as defined in this notice).
The Secretary will announce in the notice inviting applications
which options will be used as the evidence standard for a Development
grant in a given competition. Note that under (c), applicants must
identify whether the application is supported by evidence of promise
(as defined in this notice) or strong theory (as defined in this
notice).
To be eligible for an award, an application for a Validation grant
must be supported by moderate evidence of effectiveness (as defined in
this notice);
To be eligible for an award, an application for a Scale-up grant
must be supported by strong evidence of effectiveness (as defined in
this notice).
6. Funding Categories: An applicant will be considered for an award
only for the type of i3 grant (Development, Validation, or Scale-up
grant) for which it applies. An applicant may not submit an application
for the same proposed project under more than one type of grant.
7. Limit on Grant Awards: (a) No grantee may receive more than two
new grant awards of any type under the i3 program in a single year; (b)
In any two-year period, no grantee may receive more than one new Scale-
up or Validation grant; and (c) No grantee may receive in a single year
new i3 grant awards that total an amount greater than the sum of the
maximum amount of funds for a Scale-up grant and the maximum amount of
funds for a Development grant for that year. For example, in a year
when the maximum award value for a Scale-up grant is $25 million and
the maximum award value for a Development grant is $5 million, no
grantee may receive in a single year new grants totaling more than $30
million.
8. Subgrants: In the case of an eligible applicant that is a
partnership between a nonprofit organization and (1) one or more LEAs
or (2) a consortium of schools, the partner serving as the applicant
and, if funded, as the grantee, may make subgrants to one or more
entities in the partnership.
9. Evaluation: The grantee must conduct an independent evaluation
(as defined in this notice) of its project. This evaluation must
estimate the impact of the i3-supported practice (as implemented at the
proposed level of scale) on a relevant outcome (as defined in this
notice). The grantee must make broadly available digitally and free of
charge, through formal (e.g., peer-reviewed journals) or informal
(e.g., newsletters) mechanisms, the results of any evaluations it
conducts of its funded activities. For Scale-up and Validation grants,
the grantee must also ensure that the data from its evaluation are made
available to third-party researchers consistent with applicable privacy
requirements.
In addition, the grantee and its independent evaluator must agree
to cooperate with any technical assistance provided by the Department
or its contractor and comply with the requirements of any evaluation of
the program conducted by the Department. This includes providing to the
Department, within 100 days of a grant award, an updated comprehensive
evaluation plan in a format and using such tools as the Department may
require. Grantees must update this evaluation plan at least annually to
reflect any changes to the evaluation. All these updates must be
consistent with the scope and objectives of the approved application.
10. Communities of Practice: Grantees must participate in,
organize, or facilitate, as appropriate, communities of practice for
the i3 program. A community of practice is a group of grantees that
agrees to interact regularly to solve a persistent problem or improve
practice in an area that is important to them.
11. Management Plan: Within 100 days of a grant award, the grantee
must provide an updated comprehensive management plan for the approved
project in a format and using such tools as the Department may require.
This management plan must include detailed information about
implementation of the first year of the grant, including key
milestones, staffing details, and other information that the Department
may require. It must also include a complete list of performance
metrics, including baseline measures and annual targets. The grantee
must update this management plan at least annually to reflect
implementation of subsequent years of the project.
Proposed Definitions
Background: To ensure that terms used in the i3 program have clear
and commonly understood meanings and are aligned with other Department
programs, we propose the following definitions. The majority of these
definitions are the same as, or substantially similar to, those we have
established and used in prior i3 competitions. However, we are
proposing some changes to those definitions related to evidence of
effectiveness. In that regard, we are particularly interested in
comments on the level of rigor required under the proposed definitions
for ``strong evidence of effectiveness,'' ``moderate evidence of
effectiveness,'' ``evidence of promise,'' and ``strong theory.'' We
have attempted to clarify the definitions so that applicants can better
understand what is required to meet each level of evidence. We have
also narrowed the allowable evaluation methodologies at the strong and
moderate evidence of effectiveness levels so that the allowable
evaluation methodologies are those that are most likely to support
causal conclusions. We welcome comments about whether the updated
definitions are too restrictive or not restrictive enough and whether
there are particular parts of the definitions that remain unclear or
undefined.
Proposed Definitions
The Assistant Deputy Secretary proposes the following definitions
for this program. We may apply one or more of these definitions in any
year in which this program is in effect.
Consortium of schools means two or more public elementary or
secondary schools acting collaboratively for the purpose of applying
for and implementing an i3 grant jointly with an eligible nonprofit
organization.
Evidence of promise means there is empirical evidence to support
the theoretical linkage between at least one critical component and at
least one relevant outcome presented in the logic model (as defined in
this notice) for the proposed process, product, strategy, or practice.
Specifically, evidence of promise means the following conditions are
met:
(a) There is at least one study that is either a--
(1) Correlational study with statistical controls for selection
bias;
(2) Quasi-experimental study (as defined in this notice) that meets
the What Works Clearinghouse Evidence Standards with reservations; \5\
or
---------------------------------------------------------------------------
\5\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(3) Randomized controlled trial (as defined in this notice) that
meets the What Works Clearinghouse Evidence Standards with or without
reservations; \6\ and
---------------------------------------------------------------------------
\6\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(b) Such a study found a statistically significant or substantively
important
[[Page 74416]]
(defined as a difference of 0.25 standard deviations or larger),
favorable association between at least one critical component and one
relevant outcome presented in the logic model for the proposed process,
product, strategy, or practice.
High-need student means a student at risk of educational failure or
otherwise in need of special assistance and support, such as students
who are living in poverty, who attend high-minority schools (as defined
in this notice), who are far below grade level, who have left school
before receiving a regular high school diploma, who are at risk of not
graduating with a diploma on time, who are homeless, who are in foster
care, who have been incarcerated, who have disabilities, or who are
English learners.
High-minority school is defined by a school's LEA in a manner
consistent with the corresponding State's Teacher Equity Plan, as
required by section 1111(b)(8)(C) of the ESEA. The applicant must
provide, in its i3 application, the definition(s) used.
High school graduation rate means a four-year adjusted cohort
graduation rate consistent with 34 CFR 200.19(b)(1) and may also
include an extended-year adjusted cohort graduation rate consistent
with 34 CFR 200.19(b)(1)(v) if the State in which the proposed project
is implemented has been approved by the Secretary to use such a rate
under Title I of the ESEA.
Highly effective principal means a principal whose students,
overall and for each subgroup as described in section
1111(b)(3)(C)(xiii) of the ESEA (economically disadvantaged students,
students from major racial and ethnic groups, migrant students,
students with disabilities, students with limited English proficiency,
and students of each gender), achieve high rates (e.g., one and one-
half grade levels in an academic year) of student growth. Eligible
applicants may include multiple measures, provided that principal
effectiveness is evaluated, in significant part, based on student
growth. Supplemental measures may include, for example, high school
graduation rates; college enrollment rates; evidence of providing
supportive teaching and learning conditions, support for ensuring
effective instruction across subject areas for a well-rounded
education, strong instructional leadership, and positive family and
community engagement; or evidence of attracting, developing, and
retaining high numbers of effective teachers.
Highly effective teacher means a teacher whose students achieve
high rates (e.g., one and one-half grade levels in an academic year) of
student growth. Eligible applicants may include multiple measures,
provided that teacher effectiveness is evaluated, in significant part,
based on student academic growth. Supplemental measures may include,
for example, multiple observation-based assessments of teacher
performance or evidence of leadership roles (which may include
mentoring or leading professional learning communities) that increase
the effectiveness of other teachers in the school or LEA.
Independent evaluation means that the evaluation is designed and
carried out independent of, but in coordination with, any employees of
the entities who develop a process, product, strategy, or practice and
are implementing it.
Innovation means a process, product, strategy, or practice that
improves (or is expected to improve) significantly upon the outcomes
reached with status quo options and that can ultimately reach
widespread effective usage.
Large sample means a sample of 350 or more students (or other
single analysis units) who were randomly assigned to a treatment or
control group, or 50 or more groups (such as classrooms or schools)
that contain 10 or more students (or other single analysis units) and
that were randomly assigned to a treatment or control group.
Logic model (also referred to as theory of action) means a well-
specified conceptual framework that identifies key components of the
proposed process, product, strategy, or practice (i.e., the active
``ingredients'' that are hypothesized to be critical to achieving the
relevant outcomes) and describes the relationships among the key
components and outcomes, theoretically and operationally.
Moderate evidence of effectiveness means one of the following
conditions is met:
(a) There is at least one study of the effectiveness of the
process, product, strategy, or practice being proposed that meets the
What Works Clearinghouse Evidence Standards without reservations; \7\
found a statistically significant favorable impact on a relevant
outcome (as defined in this notice) (with no statistically significant
unfavorable impacts on that outcome for relevant populations in the
study or in other studies of the intervention reviewed by and reported
on by the What Works Clearinghouse); and includes a sample that
overlaps with the populations or settings proposed to receive the
process, product, strategy, or practice.
---------------------------------------------------------------------------
\7\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(b) There is at least one study of the effectiveness of the
process, product, strategy, or practice being proposed that meets the
What Works Clearinghouse Evidence Standards with reservations,\8\ found
a statistically significant favorable impact on a relevant outcome (as
defined in this notice) (with no statistically significant unfavorable
impacts on that outcome for relevant populations in the study or in
other studies of the intervention reviewed by and reported on by the
What Works Clearinghouse), includes a sample that overlaps with the
populations or settings proposed to receive the process, product,
strategy, or practice, and includes a large sample (as defined in this
notice) and a multi-site sample (as defined in this notice) (Note:
multiple studies can cumulatively meet the large and multi-site sample
requirements as long as each study meets the other requirements in this
paragraph).
---------------------------------------------------------------------------
\8\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
Multi-site sample means more than one site, where site can be
defined as an LEA, locality, or State.
National level describes the level of scope or effectiveness of a
process, product, strategy, or practice that is able to be effective in
a wide variety of communities, including rural and urban areas, as well
as with different groups (e.g., economically disadvantaged, racial and
ethnic groups, migrant populations, individuals with disabilities,
English learners, and individuals of each gender).
Quasi-experimental design study means a study using a design that
attempts to approximate an experimental design by identifying a
comparison group that is similar to the treatment group in important
respects. These studies, depending on design and implementation, can
meet What Works Clearinghouse Evidence Standards with reservations \9\
(they cannot meet What Works Clearinghouse Evidence Standards without
reservations).
---------------------------------------------------------------------------
\9\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
Randomized controlled trial means a study that employs random
assignment of, for example, students, teachers, classrooms, schools, or
districts to receive the intervention being evaluated (the treatment
group) or not to receive the intervention (the control group). The
[[Page 74417]]
estimated effectiveness of the intervention is the difference between
the average outcome for the treatment group and for the control group.
These studies, depending on design and implementation, can meet What
Works Clearinghouse Evidence Standards without reservations.\10\
---------------------------------------------------------------------------
\10\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
Regional level describes the level of scope or effectiveness of a
process, product, strategy, or practice that is able to serve a variety
of communities within a State or multiple States, including rural and
urban areas, as well as with different groups (e.g., economically
disadvantaged, racial and ethnic groups, migrant populations,
individuals with disabilities, English learners, and individuals of
each gender). For an LEA-based project to be considered a regional-
level project, a process, product, strategy, or practice must serve
students in more than one LEA, unless the process, product, strategy,
or practice is implemented in a State in which the State educational
agency is the sole educational agency for all schools.
Relevant outcome means the student outcome or outcomes (or the
ultimate outcome if not related to students) that the proposed project
is designed to improve, consistent with the specific goals of the
project and the i3 program.
Rural local educational agency means a local educational agency
(LEA) that is eligible under the Small Rural School Achievement (SRSA)
program or the Rural and Low-Income School (RLIS) program authorized
under Title VI, Part B of the ESEA. Eligible applicants may determine
whether a particular LEA is eligible for these programs by referring to
information on the Department's Web site at www2.ed.gov/nclb/freedom/local/reap.html.
Strong evidence of effectiveness means that one of the following
conditions is met:
(a) There is at least one study of the effectiveness of the
process, product, strategy, or practice being proposed that meets the
What Works Clearinghouse Evidence Standards without reservations; \11\
found a statistically significant favorable impact on a relevant
outcome (as defined in this notice) (with no statistically significant
unfavorable impacts on that outcome for relevant populations in the
study or in other studies of the intervention reviewed by and reported
on by the What Works Clearinghouse); includes a sample that overlaps
with the populations and settings proposed to receive the process,
product, strategy, or practice; and includes a large sample (as defined
in this notice) and a multi-site sample (as defined in this notice)
(Note: multiple studies can cumulatively meet the large and multi-site
sample requirements as long as each study meets the other requirements
in this paragraph).
---------------------------------------------------------------------------
\11\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(b) There are at least two studies of the effectiveness of the
process, product, strategy, or practice being proposed, each of which
meets the What Works Clearinghouse Evidence Standards with
reservations,\12\ found a statistically significant favorable impact on
a relevant outcome (as defined in this notice) (with no statistically
significant unfavorable impacts on that outcome for relevant
populations in the studies or in other studies of the intervention
reviewed by and reported on by the What Works Clearinghouse), includes
a sample that overlaps with the populations and settings proposed to
receive the process, product, strategy, or practice, and includes a
large sample (as defined in this notice) and a multi-site sample (as
defined in this notice).
---------------------------------------------------------------------------
\12\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
Strong theory means a rationale for the proposed process, product,
strategy, or practice that includes a logic model (as defined in this
notice).
Student achievement means--
(a) For grades and subjects in which assessments are required under
ESEA section 1111(b)(3): (1) A student's score on such assessments and
may include (2) other measures of student learning, such as those
described in paragraph (b), provided they are rigorous and comparable
across schools within an LEA.
(b) For grades and subjects in which assessments are not required
under ESEA section 1111(b)(3): Alternative measures of student learning
and performance such as student results on pre-tests, end-of-course
tests, and objective performance-based assessments; student learning
objectives; student performance on English language proficiency
assessments; and other measures of student achievement that are
rigorous and comparable across schools within an LEA.
Student growth means the change in student achievement (as defined
in this notice) for an individual student between two or more points in
time. An applicant may also include other measures that are rigorous
and comparable across classrooms.
Proposed Selection Criteria
Background
The proposed selection criteria are designed to ensure that
applications selected for funding have the potential to generate
substantial improvements in student achievement and other key outcomes
and include well-articulated plans for the implementation and
evaluation of the proposed project. Peer reviewers will use these
criteria to determine how well an applicant's proposed project aligns
with our expectations for the Development, Validation, or Scale-up
grant the applicant seeks. As such, although we are proposing these
criteria as a single list, the criteria selected and the number of
points that each may be worth would vary by the type of i3 grant
(Development, Validation, or Scale-up grant).
The proposed selection criteria are similar to those used in prior
i3 competitions; the revisions reflect our experiences with their use.
In particular, the selection criteria used in prior competitions did
not articulate as clearly as intended our expectations for scaling up
projects and what peer reviewers should assess to determine whether a
project could feasibly achieve its proposed scale. In the proposed
selection criteria, we include several factors that address whether
there is unmet demand for the services that a grantee would provide and
whether an applicant has identified and will address barriers that
prevent the applicant from reaching that scale at the time of its
application.
Proposed Selection Criteria
The Secretary proposes the following selection criteria for
evaluating an application under this program. We may apply one or more
of these criteria in any year in which this program is in effect. We
propose that the Secretary may use:
One or more of the selection criteria established in the
notice of final priorities, requirements, definitions, and selection
criteria;
Any of the selection criteria in 34 CFR 75.210; criteria
based on the statutory requirements for the i3 program in accordance
with 34 CFR 75.209; or
Any combination of these when establishing selection
criteria for each particular type of grant (Development,
[[Page 74418]]
Validation, and Scale-up) in any i3 competition. We propose that the
Secretary may further define each criterion by selecting specific
factors for it. The Secretary may select these factors from any
selection criterion in the list above. In the notice inviting
applications, the application package, or both we will announce the
specific selection criteria that apply to a competition and the maximum
possible points assigned to each criterion.
(a) Significance
In determining the significance of the proposed project, the
Secretary proposes to consider one or more of the following factors:
(1) The extent to which the proposed project addresses a national
need.
(2) The extent to which the proposed project addresses a challenge
for which there is a national need for solutions that are better than
the solutions currently available.
(3) The extent to which the proposed project would implement a
novel approach as compared with what has been previously attempted
nationally.
(4) The extent of the expected impact of the project on relevant
outcomes (as defined in this notice), including the estimated impact of
the project on student outcomes (particularly those related to student
achievement (as defined in this notice)) and the breadth of the
project's impact, compared with alternative practices or methods of
addressing similar needs.
(5) The extent to which the proposed project demonstrates that it
is likely to have a meaningful impact on relevant outcomes (as defined
in this notice), particularly those related to student achievement (as
defined in this notice), if it were implemented and evaluated in a
variety of settings.
(6) The extent to which the proposed project will substantially
improve on the outcomes achieved by other practices, such as through
better student outcomes, lower cost, or accelerated results.
(7) The importance and magnitude of the proposed project's expected
impact on a relevant outcome (as defined in this notice), particularly
one related to student achievement (as defined in this notice).
(8) The likelihood that the project will have the estimated impact,
including the extent to which the applicant demonstrates that unmet
demand for the proposed project or the proposed services will enable
the applicant to reach the proposed level of scale.
(9) The feasibility of national expansion if favorable outcomes are
achieved.
(b) Quality of the Project Design
In determining the quality of the project design, the Secretary
proposes to consider one or more of the following factors:
(1) The extent to which the proposed project addresses the national
need and priorities the applicant is seeking to meet.
(2) The extent to which the proposed project addresses the absolute
priority the applicant is seeking to meet.
(3) The clarity and coherence of the project goals, including the
extent to which the proposed project articulates an explicit plan or
actions to achieve its goals (e.g., a fully developed logic model of
the proposed project).
(4) The extent to which the proposed project has a clear set of
goals and an explicit plan or actions to achieve the goals, including
identification of any elements of the project logic model that require
further testing or development.
(5) The extent to which the proposed project will produce a fully
codified practice, including a fully articulated logic model of the
project by the end of the project period.
(6) The clarity, completeness, and coherence of the project goals
and whether the application includes a description of project
activities that constitute a complete plan for achieving those goals,
including the identification of potential risks to project success and
strategies to mitigate those risks.
(7) The extent to which the applicant addresses potential risks to
project success and strategies to mitigate those risks.
(8) The extent to which the applicant will use grant funds to
address a particular barrier or barriers that prevented the applicant,
in the past, from reaching the level of scale proposed in the
application.
(9) The extent to which the project would build the capacity of the
applicant to scale up and sustain the project or would create an
organization capable of expanding if successful outcomes are achieved.
(10) The sufficiency of the resources to support effective project
implementation, including the project's plan for ensuring funding after
the period of the Federal grant.
(11) The sufficiency of the resources to support effective project
implementation.
(c) Quality of the Management Plan
In determining the quality of the management plan, the Secretary
proposes to consider one or more of the following factors:
(1) The extent to which the management plan articulates key
responsibilities and well-defined objectives, including the timelines
and milestones for completion of major project activities, the metrics
that will be used to assess progress on an ongoing basis, and annual
performance targets the applicant will use to monitor whether the
project is achieving its goals.
(2) The clarity and coherence of the applicant's multi-year
financial and operating model and accompanying plan to operate the
project at a national level (as defined in this notice) during the
project period.
(3) The clarity and coherence of the applicant's multi-year
financial and operating model and accompanying plan to operate the
project at a national or regional level (as defined in this notice)
during the project period.
(4) The extent to which the applicant demonstrates that it will
have the resources to operate the project at the proposed level of
scale during the project period and beyond the length of the grant,
including the demonstrated commitment of any partners and evidence of
broad support from stakeholders critical to the project's long-term
success (e.g., State educational agencies, teachers' unions).
(5) The extent of the demonstrated commitment of any key partners
or evidence of broad support from stakeholders whose participation is
critical to the project's long-term success.
(d) Personnel
When evaluating the personnel of the proposed project, the
Secretary proposes to consider one or more of the following factors:
(1) The adequacy of the project's staffing plan, particularly for
the first year of the project, including the identification of the
project director and, in the case of projects with unfilled key
personnel positions at the beginning of the project, that the staffing
plan identifies how critical work will proceed.
(2) The qualifications and experience of the project director and
other key project personnel and the extent to which they have the
expertise to accomplish the proposed tasks.
(3) The extent to which the project director has experience
managing large, complex, and rapidly growing projects.
(4) The extent to which the project director has experience
managing large, complex projects.
(5) The extent to which the project director has experience
managing projects of similar size and scope as the proposed project.
[[Page 74419]]
(e) Quality of the Project Evaluation
In determining the quality of the project evaluation, the Secretary
proposes to consider one or more of the following factors:
(1) The clarity and importance of the key questions to be addressed
by the project evaluation, and the appropriateness of the methods for
how each question will be addressed.
(2) The extent to which the methods of evaluation will, if well
implemented, produce evidence about the project's effectiveness that
would meet the What Works Clearinghouse Evidence Standards without
reservations.\13\
---------------------------------------------------------------------------
\13\ See What Works Clearinghouse Procedures and Standards
Handbook. (Version 2.1, September 2011), which can currently be
found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(3) The extent to which the methods of evaluation will, if well
implemented, produce evidence about the project's effectiveness that
would meet the What Works Clearinghouse Evidence Standards with or
without reservations.\14\
---------------------------------------------------------------------------
\14\ See What Works Clearinghouse Procedures and Standards
Handbook (Version 2.1, September 2011), which can currently be found
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------
(4) The extent to which the methods of evaluation will provide
valid and reliable performance data on relevant outcomes, particularly
student achievement outcomes.
(5) The extent to which the evaluation will study the project at
the proposed level of scale, including, where appropriate, generating
information about potential differential effectiveness of the project
in diverse settings and for diverse student population groups.
(6) The extent to which the evaluation will study the project at
the proposed level of scale, including in diverse settings.
(7) The extent to which the evaluation plan includes a clear and
credible analysis plan, including a proposed sample size and minimum
detectable effect size that aligns with the expected project impact,
and an analytic approach for addressing the research questions.
(8) The extent to which the evaluation plan includes a clear, well-
documented, and rigorous method for measuring implementation of the
critical features of the project, as well as the intended outcomes.
(9) The extent to which the evaluation plan clearly articulates the
key components and outcomes of the project, as well as a measurable
threshold for acceptable implementation.
(10) The extent to which the evaluation plan will provide
sufficient information on the project's effect as compared to
alternative practices addressing similar need.
(11) The extent to which the proposed project plan includes
sufficient resources to carry out the project evaluation effectively.
Specific Requests for Comment
We are particularly interested in comments about whether there are
important aspects of identifying promising projects or assessing the
likelihood of project success that the proposed selection criteria and
factors do not address. In addition, we are interested in feedback
about whether there is ambiguity in the language of specific criteria
or factors that will make it difficult for applicants to respond to the
criteria and peer reviewers to evaluate the applications with respect
to the selection criteria.
Final Priorities, Requirements, Definitions, and Selection Criteria
We will announce the final priorities, requirements, definitions,
and selection criteria in a notice in the Federal Register. We will
determine the final priorities, requirements, definitions, and
selection criteria after considering responses to this notice and other
information available to the Department. This notice does not preclude
us from proposing additional priorities, requirements, definitions, or
selection criteria, subject to meeting applicable rulemaking
requirements.
Note: This notice does not solicit applications. In any year in
which we choose to use one or more of these priorities,
requirements, definitions, and selection criteria, we invite
applications through a notice in the Federal Register.
Executive Orders 12866 and 13563
Regulatory Impact Analysis
Under Executive Order 12866, the Secretary must determine whether a
regulatory action is ``significant'' and, therefore, subject to the
requirements of the Executive order and subject to review by the Office
of Management and Budget (OMB). Section 3(f) of Executive Order 12866
defines a ``significant regulatory action'' as an action likely to
result in a rule that may--
(1) Have an annual effect on the economy of $100 million or more,
or adversely affect a sector of the economy, productivity, competition,
jobs, the environment, public health or safety, or State, local or
Tribal governments or communities in a material way (also referred to
as an ``economically significant'' rule);
(2) Create serious inconsistency or otherwise interfere with an
action taken or planned by another agency;
(3) Materially alter the budgetary impacts of entitlement grants,
user fees, or local programs or the rights and obligations of
recipients thereof; or
(4) Raise novel legal or policy issues arising out of legal
mandates, the President's priorities, or the principles stated in the
Executive order.
This proposed regulatory action would have an annual effect on the
economy of more than $100 million because Department anticipates more
than that amount will be appropriated for i3 and awarded as grants.
Therefore, this proposed action is ``economically significant'' and
subject to review by OMB under section 3(f)(1) of Executive Order
12866. Notwithstanding this determination, we have assessed the
potential costs and benefits, both quantitative and qualitative, of
this proposed regulatory action and have determined that the benefits
would justify the costs.
The Department has also reviewed these proposed requirements under
Executive Order 13563, which supplements and explicitly reaffirms the
principles, structures, and definitions governing regulatory review
established in Executive Order 12866. To the extent permitted by law,
Executive Order 13563 requires that an agency--
(1) Propose or adopt regulations only upon a reasoned determination
that their benefits justify their costs (recognizing that some benefits
and costs are difficult to quantify);
(2) Tailor its regulations to impose the least burden on society,
consistent with obtaining regulatory objectives, taking into account--
among other things, and to the extent practicable--the costs of
cumulative regulations;
(3) In choosing among alternative regulatory approaches, select
those approaches that maximize net benefits (including potential
economic, environmental, public health and safety, and other
advantages; distributive impacts; and equity);
(4) To the extent feasible, specify performance objectives, rather
than specifying the behavior or manner of compliance a regulated entity
must adopt; and
(5) Identify and assess available alternatives to direct
regulation, including providing economic incentives--such as user fees
or marketable permits--to encourage the desired behavior, or provide
information that enables the public to make choices.
[[Page 74420]]
Executive Order 13563 also requires an agency ``to use the best
available techniques to quantify anticipated present and future
benefits and costs as accurately as possible.'' The Office of
Information and Regulatory Affairs of OMB has emphasized that these
techniques may include ``identifying changing future compliance costs
that might result from technological innovation or anticipated
behavioral changes.''
We are issuing these proposed priorities, requirements,
definitions, and selection criteria only on a reasoned determination
that their benefits justify their costs. In choosing among alternative
regulatory approaches, we selected those approaches that would maximize
net benefits. Based on the analysis that follows, the Department
believes these proposed regulations are consistent with the principles
in Executive Order 13563.
We have also determined that this regulatory action would not
unduly interfere with State, local, and Tribal governments in the
exercise of their governmental functions.
Discussion of Costs and Benefits
The Secretary believes that the proposed priorities, requirements,
definitions, and selection criteria would not impose significant costs
on eligible LEAs, nonprofit organizations, or other entities that would
receive assistance through the i3 program. The Secretary also believes
that the benefits of implementing the proposals contained in this
notice outweigh any associated costs.
The Secretary believes that the proposed priorities, requirements,
definitions, and selection criteria would result in selection of high-
quality applications to implement activities that are most likely to
have a significant national impact on educational reform and
improvement. The proposed priorities, requirements, definitions, and
selection criteria in this notice clarify the scope of activities the
Secretary expects to support with program funds and the expected burden
of work involved in preparing an application and implementing a project
under the program. The pool of possible applicants is very large, and
there is great interest in the program. During the first 3 years of
implementation the Department received over 3,000 applications.
Potential applicants, both LEAs and nonprofit organizations, need to
consider carefully the effort that will be required to prepare a strong
application, their capacity to implement a project successfully, and
their chances of submitting a successful application.
Program participation is voluntary. The Secretary believes that the
costs imposed on applicants by the proposed priorities, requirements,
definitions, and selection criteria would be limited to paperwork
burden related to preparing an application and that the benefits of
implementing these proposals would outweigh any costs incurred by
applicants. The costs of carrying out activities would be paid for with
program funds and with matching funds provided by private-sector
partners. Thus, the costs of implementation would not be a burden for
any eligible applicants, including small entities. However, under the
proposed selection criteria the Secretary would assess the extent to
which an applicant would be able to sustain a project once Federal
funding through the i3 program is no longer available. Thus, eligible
applicants should propose activities that they will be able to sustain
without funding from the program and, thus, in essence, should include
in their project plans the specific steps they will take for sustained
implementation of the proposed project. The continued proposal for the
three types of grants under i3--Development, Validation, or Scale-up
grants--would allow potential applicants to determine which type of
grant they are best suited to apply for, based on their own priorities,
resources, and capacity to implement grant activities.
Regulatory Flexibility Act Certification
The Secretary certifies that this proposed regulatory action will
not have a significant economic impact on a substantial number of small
entities. The small entities that this proposed regulatory action will
affect are small LEAs or nonprofit organizations applying for and
receiving funds under this program. The Secretary believes that the
costs imposed on applicants by the proposed priorities, requirements,
definitions, and selection criteria would be limited to paperwork
burden related to preparing an application and that the benefits of
implementing these proposals would outweigh any costs incurred by
applicants.
Participation in this program is voluntary. For this reason, the
proposed priorities, requirements, definitions, and selection criteria
would impose no burden on small entities in general. Eligible
applicants would determine whether to apply for funds, and have the
opportunity to weigh the requirements for preparing applications, and
any associated costs, against the likelihood of receiving funding and
the requirements for implementing projects under the program. Eligible
applicants most likely would apply only if they determine that the
likely benefits exceed the costs of preparing an application. The
likely benefits include the potential receipt of a grant as well as
other benefits that may accrue to an entity through its development of
an application, such as the use of that application to spur educational
reforms and improvements without additional Federal funding.
The U.S. Small Business Administration Size Standards defines as
``small entities'' for-profit or nonprofit institutions with total
annual revenue below $7,000,000 or, if they are institutions controlled
by small governmental jurisdictions (that are comprised of cities,
counties, towns, townships, villages, school districts, or special
districts), with a population of less than 50,000. The Urban
Institute's National Center for Charitable Statistics reported that of
196,663 nonprofit organizations that had an educational mission and
reported revenue to the IRS by March of 2012, 168,784 (or about 86
percent) had revenues of less than $5 million. In addition, there are
approximately 16,000 LEAs in the country that meet the definition of
small entity. However, the Secretary believes that only a small number
of these entities would be interested in applying for funds under this
program, thus reducing the likelihood that the proposals contained in
this notice would have a significant economic impact on small entities.
As discussed earlier, the number of applications received during the
last 3 competitions from any type of applicant is approximately 3,000.
In addition, the Secretary believes that the proposed priorities,
requirements, definitions, and selection criteria discussed in this
notice do not impose any additional burden on small entities applying
for a grant than they would face in the absence of the proposed action.
That is, the length of the applications those entities would submit in
the absence of the regulatory action and the time needed to prepare an
application would likely be the same.
Further, the proposed action may help small entities determine
whether they have the interest, need, or capacity to implement
activities under the program and, thus, prevent small entities that do
not have such an interest, need, and capacity from absorbing the burden
of applying, or assist those entities in determining whether they
should seek a capable partner to pursue the application process.
This proposed regulatory action would not have a significant
economic impact on small entities once they
[[Page 74421]]
receive a grant because they would be able to meet the costs of
compliance using the funds provided under this program and with any
matching funds provided by private-sector partners.
The Secretary invites comments from small nonprofit organizations
and small LEAs as to whether they believe this proposed regulatory
action would have a significant economic impact on them and, if so,
requests evidence to support that belief.
Accounting Statement
As required by OMB Circular A-4 (available at www.whitehouse.gov/sites/default/files/omb/assets/omb/circulars/a004/a-4.pdf), in the
following table we have prepared an accounting statement showing the
classification of the expenditures associated with the provisions of
this regulatory action. This table provides our best estimate of the
changes in annual monetized transfers as a result of this regulatory
action. Expenditures are classified as transfers from the Federal
Government to LEAs and nonprofit organizations.
Accounting Statement Classification of Estimated Expenditures
[In millions]
------------------------------------------------------------------------
Category Transfers
------------------------------------------------------------------------
Annualized Monetized Transfers............ $140.9 million.
From Whom To Whom? From the Federal Government
to LEAs and nonprofit
organizations.
------------------------------------------------------------------------
Paperwork Reduction Act of 1995
The requirements and selection criteria proposed in this notice
will require the collection of information that is subject to review by
the Office of Management and Budget (OMB) under the Paperwork Reduction
Act of 1995 (44 U.S.C. 3501-3520). The burden associated with the i3
program was approved by OMB under OMB Control Number 1855-0021, which
expires on October 31, 2013. These proposed priorities, requirements,
definitions, and selection criteria would allow the Department to
improve the design of the i3 program to better achieve its purposes and
goals. However, the revisions do not change the number of applications
an organization may submit or the burden that an applicant would
otherwise incur in the development and submission of a grant
application under the i3 program. Therefore, the Department expects
that this proposed regulatory action will not affect the total burden
of hours.
Intergovernmental Review: This program is subject to Executive
Order 12372 and the regulations in 34 CFR part 79. One of the
objectives of the Executive order is to foster an intergovernmental
partnership and a strengthened federalism. The Executive order relies
on processes developed by State and local governments for coordination
and review of proposed Federal financial assistance.
This document provides early notification of our specific plans and
actions for this program.
Accessible Format: Individuals with disabilities can obtain this
document in an accessible format (e.g., braille, large print,
audiotape, or compact disc) on request to the program contact person
listed under FOR FURTHER INFORMATION CONTACT.
Electronic Access to This Document: The official version of this
document is the document published in the Federal Register. Free
Internet access to the official edition of the Federal Register and the
Code of Federal Regulations is available via the Federal Digital System
at: www.gpo.gov/fdsys. At this site you can view this document, as well
as all other documents of this Department published in the Federal
Register, in text or Adobe Portable Document Format (PDF). To use PDF
you must have Adobe Acrobat Reader, which is available free at the
site.
You may also access documents of the Department published in the
Federal Register by using the article search feature at:
www.federalregister.gov. Specifically, through the advanced feature at
this site, you can limit your search to documents published by the
Department.
Dated: December 11, 2012.
James H. Shelton, III,
Assistant Deputy Secretary for Innovation and Improvement.
[FR Doc. 2012-30199 Filed 12-13-12; 8:45 am]
BILLING CODE 4000-01-P