Direct Grant Programs and Definitions That Apply to Department Regulations, 74392-74407 [2012-29897]

Download as PDF 74392 Proposed Rules Federal Register Vol. 77, No. 241 Friday, December 14, 2012 This section of the FEDERAL REGISTER contains notices to the public of the proposed issuance of rules and regulations. The purpose of these notices is to give interested persons an opportunity to participate in the rule making prior to the adoption of the final rules. DEPARTMENT OF EDUCATION 34 CFR Parts 75 and 77 RIN 1890–AA14 [Docket ID ED–2012–OII–0026] Direct Grant Programs and Definitions That Apply to Department Regulations Department of Education. Notice of proposed rulemaking. AGENCY: mstockstill on DSK4VPTVN1PROD with ACTION: SUMMARY: The Secretary proposes to amend the regulations in 34 CFR parts 75 and 77 of the Education Department General Administrative Regulations (EDGAR) in order to improve the Department’s ability to promote projects supported by evidence; evaluate the performance of discretionary grant programs and grantee projects; review grant applications using selection factors that promote reform objectives related to project evaluation, sustainability, productivity, and capacity to scale; and reduce burden on grantees in selecting implementation sites, implementation partners, or evaluation service providers for their proposed projects. These proposed changes would allow the Department to be more effective and efficient when selecting discretionary grantees, provide higher-quality data to Congress and the public, and better focus applicants on the particular goals and objectives of the programs to which they apply for grants. DATES: We must receive your comments on or before February 12, 2013. ADDRESSES: Submit your comments through the Federal eRulemaking Portal or via postal mail, commercial delivery, or hand delivery. We will not accept comments by fax or by email. Please submit your comments only one time, in order to ensure that we do not receive duplicate copies. In addition, please include the Docket ID at the top of your comments. • Federal eRulemaking Portal: Go to https://www.regulations.gov to submit your comments electronically. Information on using Regulations.gov, including instructions for accessing VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 agency documents, submitting comments, and viewing the docket, is available on the site under ‘‘How To Use This Site.’’ • Postal Mail, Commercial Delivery, or Hand Delivery. If you mail or deliver your comments about these proposed regulations, address them to Margo Anderson, U.S. Department of Education, 400 Maryland Avenue SW., Room 4W313, Washington, DC 20202– 5900. Privacy Note: The Department’s policy for comments received from members of the public is to make these submissions available for public viewing in their entirety on the Federal eRulemaking Portal at www.regulations.gov. Therefore, commenters should be careful to include in their comments only information that they wish to make publicly available. Erin McHugh, U.S. Department of Education, 400 Maryland Avenue SW., Room 4W319, Washington, DC 20202. Telephone: (202) 401–1304 or by email: erin.mchugh@ed.gov. If you use a telecommunications device for the deaf (TDD) or text telephone (TTY), call the Federal Relay Service (FRS) toll free at 1–800–877– 8339. SUPPLEMENTARY INFORMATION: FOR FURTHER INFORMATION CONTACT: Invitation to Comment on Proposed Regulations We invite you to submit comments regarding these proposed regulations. To ensure that your comments have maximum effect in developing the final regulations, we urge you to identify clearly the specific section or sections of the proposed regulations that each of your comments addresses and to arrange your comments in the same order as the proposed regulations. We invite you to assist us in complying with the specific requirements of Executive Order 12866 and 13563 and their overall requirement of reducing regulatory burden that might result from these proposed regulations. Please let us know of any ways we could reduce potential costs or increase potential benefits while preserving the effective and efficient administration of the Department’s programs and activities. Because Executive Order 12866 and the presidential memorandum on ‘‘Plain Language in Government Writing’’ require each agency to write regulations PO 00000 Frm 00001 Fmt 4702 Sfmt 4702 that are easy to understand, we invite you to comment on how to make these proposed regulations easier to understand, including answers to questions such as the following: • Are the requirements in the proposed regulations clearly stated? • Do the proposed regulations contain technical terms or other wording that interferes with their clarity? • Does the format of the proposed regulations (grouping and order of sections, use of headings, paragraphing, etc.) aid or reduce their clarity? • Would the proposed regulations be easier to understand if we divided them into more (but shorter) sections? (A ‘‘section’’ is preceded by the symbol ‘‘§ ’’ and a numbered heading; for example, § 75.210 General selection criteria. • Could the description of the proposed regulations in this preamble be more helpful in making the proposed regulations easier to understand? If so, how? • What else could we do to make the proposed regulations easier to understand? Retrospective Review of EDGAR On January 21, 2011, President Obama issued Executive Order 13563, ‘‘Improving Regulation and Regulatory Review’’ (76 FR 3821). The order requires all Federal agencies to ‘‘consider how best to promote retrospective analysis of rules that may be outmoded, ineffective, insufficient, or excessively burdensome, and to modify, streamline, expand, or repeal them in accordance with what has been learned.’’ Accordingly, on August 22, 2011, the Department issued its Plan for Retrospective Analysis of Existing Regulations. (See ed.gov/policy/gen/reg/ retrospective-analysis/). Our plan identified a number of regulatory initiatives for retrospective review and analysis. One of those initiatives, already begun in 2010, was a review of the Department’s discretionary grants process. Part of that initiative was a close retrospective review of the Education Department General Administrative Regulations (EDGAR), which govern discretionary grantmaking and administration. As part of this retrospective review of EDGAR, we identified key provisions that required substantive changes to improve transparency and the efficiency and effectiveness of our grant-making E:\FR\FM\14DEP1.SGM 14DEP1 mstockstill on DSK4VPTVN1PROD with Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules functions. These included our regulations on establishing and collecting data on measures of grantee performance, the selection criteria that peer reviewers use to evaluate applications, and the procedures grantees must use to select research sites and evaluators. This notice is the result of the Department’s regulatory review of those provisions. On May 10, 2012, President Obama issued Executive Order 13610, ‘‘Identifying and Reducing Regulatory Burdens.’’ (77 FR 28469). Among other things and as part of their retrospective review, this order requires Federal agencies to invite ‘‘public suggestions about regulations in need of retrospective review and about appropriate modifications to such regulations.’’ Therefore, in addition to your comments on the specific regulations proposed in this notice, we seek input on other regulations within EDGAR that may be in need of modification and amendments to those regulations that you would suggest. We are particularly interested in your feedback on the following questions: • Are the regulations achieving their intended outcomes, e.g., do they establish a fair and equitable process for selecting applications for funding while ensuring transparency in the selection process and enhancing accountability for funding decisions? • Have changes in the economy or other external factors led to an increase or decrease in costs imposed on applicants for, and recipients of, discretionary grants? • Are any of the regulations outmoded, unnecessary, or out of date? • Do the regulations cause confusion or create other questions? If so, how could we amend the regulations to address this problem? • What do relevant data show about the effectiveness and benefits of the regulations in comparison to their costs? Although the Department may or may not respond to comments that we receive on the retrospective review of these other provisions of EDGAR, we will use that feedback to further inform and plan our retrospective review efforts. During and after the comment period, you may inspect all public comments about these proposed regulations by accessing Regulations.gov. You may also inspect the comments, in person, in Room 4W335, 400 Maryland Avenue SW., Washington, DC, between the hours of 8:30 a.m. and 4:00 p.m., Washington, DC time, Monday through Friday of each week except Federal holidays. Please contact the person VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 listed under FOR FURTHER INFORMATION CONTACT. Assistance to Individuals With Disabilities in Reviewing the Rulemaking Record On request, we will provide an appropriate accommodation or auxiliary aid to an individual with a disability who needs assistance to review the comments or other documents in the public rulemaking record for these proposed regulations. If you want to schedule an appointment for this type of aid, please contact the person listed under FOR FURTHER INFORMATION CONTACT. Summary of Proposed Changes In this notice, the Secretary proposes amendments that would: 1. Allow the Secretary, in an application notice for a competition, to establish performance measurement requirements; 2. Revise requirements regarding project evaluations submitted to the Department by grantees; 3. Authorize applicants to use simplified procurement procedures to select implementation sites and procure services from implementation and evaluation service providers, but only if the site or service provider is named in the grant application; 4. Allow the Secretary, through an announcement in the Federal Register, to authorize grantees under particular programs to award subgrants to directly carry out programmatic activities. The subgrantees and programmatic activities must be identified and described in the grantees’ applications; 5. Add one new selection criterion and revise two existing criteria that the Department could choose to use to evaluate applications. The new criterion would be used to assess the extent to which a proposed project could be brought to scale. We would add five new factors to the criterion ‘‘Quality of the Project Evaluation’’ that could be used to assess how well a proposed project evaluation would produce evidence about the project’s effectiveness. Finally, we would revise one factor and add five new factors to the criterion ‘‘Quality of the Project Design’’; 6. Authorize program offices to consider the effectiveness of proposed projects under a new priority that could be used as either an absolute, competitive preference, or invitational priority; and 7. Allow the Secretary to fund data collection periods after the end of the substantive work of a project so that project outcomes could be assessed PO 00000 Frm 00002 Fmt 4702 Sfmt 4702 74393 using data from the entire project period. As discussed in more detail later in this notice, the proposed changes would strengthen the Secretary’s authority to: (a) Evaluate grantee performance; (b) provide applicants and grantees with greater flexibility in selecting implementation sites, implementation partners, and evaluation service providers; (c) allow the Secretary to authorize subgrants for particular programs; (d) improve the targeting of selection criteria and factors so that applicants are better informed and able to focus their application narratives on specific program objectives; and (e) allow consideration of the strength of evidence supporting the proposed project when evaluating grant applications. Significant Proposed Regulations We group major issues according to subject, with appropriate sections of the proposed regulations referenced in parentheses. We discuss other substantive issues under the sections of the proposed regulations to which they pertain. Generally, we do not address proposed regulatory provisions that are technical or otherwise minor in effect. I. Performance Measurement Background Congress passed the Government Performance and Results Act of 1993 (GPRA) (Pub. L. 103–62) in order to hold Federal agencies accountable for achieving program results. Under GPRA, agencies are required to report to Congress on the effectiveness of the programs they administer, based on performance measures established for those programs. The purposes of GPRA are to improve Federal program effectiveness and accountability to the public by: Focusing on results, service quality, and customer satisfaction; giving Federal program managers information about program results and service quality; and providing objective information to Congress and the public on the relative effectiveness and efficiency of Federal programs and spending. The GPRA Modernization Act of 2010 (Pub. L. 111– 352) supports additional improvements in Federal agencies’ performance planning and reporting. Federal agencies are required to make their strategic and annual plans publicly available and post quarterly updates via a central, Government-wide Web site. The goal of the GPRA Modernization Act is to improve the use of data in E:\FR\FM\14DEP1.SGM 14DEP1 74394 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules policy, budget, and management decision-making. GPRA requires Federal agencies to establish performance measures and targets for programs they administer and to report annually to the Office of Management and Budget (OMB) on the extent to which those programs are meeting their targets. For discretionary (non-formula) grant programs, the Department establishes performance measures to address the extent to which the program as a whole is effective in achieving its goals through the projects it funds. However, we have found that grantees’ performance data do not consistently correspond to overall program performance measures because grantees typically only report on and measure data related to project-specific outcomes. The Secretary therefore proposes the following amendments to improve the Department’s ability to collect reliable, valid, and meaningful data for evaluating the outcomes of Department programs and the performance of individual grantees. Proposed Regulatory Changes mstockstill on DSK4VPTVN1PROD with 34 CFR Part 75 Section 75.110 Information Regarding Performance Measurement Current Regulations: None. Proposed Regulations: Proposed § 75.110 would allow the Secretary to establish performance measurement requirements in an application notice for a competition. These requirements could include performance measures, baseline data, performance targets, and performance data. This proposed section would also allow the Secretary to establish in an application notice a requirement that applicants propose performance measures for their projects, as well as the baseline data and performance targets for each proposed measure. Reasons: To improve the likelihood that grantees collect and report data that effectively measure the outcomes of each grant, the proposed amendments would allow the Secretary to require discretionary grant applicants to include program-level and project-specific performance measures, baseline data, and targets in their applications. Requiring this information improves the ability of the Department to measure program effectiveness under GPRA performance measures, clarifies that grantees will be required to report on their project-specific performance measures, and stresses that the extent to which grantees meet performance targets will be considered in making continuation grants. VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 II. Procurement and Subgrant Processes for Entities Named in Applications Proposed Regulatory Changes 34 CFR Part 75 Background: From our experience, many applicants find it useful to describe elements of their proposed evaluations in their applications, including implementation sites or the provider that would conduct the project evaluation should the proposed project be funded. This information is often an important factor in the Department’s peer review of discretionary grant applications, particularly in instances when the quality of the project evaluation is a selection criterion. The Department’s procurement regulations in 34 CFR 74.43 and 34 CFR 80.36(c) provide that a grantee must conduct its procurement transactions in a manner that provides, to the maximum extent practical, full and open competition. This requirement is intended to ensure that grantees consider contractor performance objectively and offer an opportunity for providers to compete for the contract. While the Department values full and open competition, the Department also recognizes that this requirement presents challenges for applicants whose applications would be strengthened by including details about the implementation sites and the evaluation service provider. The Secretary proposes to reduce this burden by simplifying the procurement process used to select implementation sites, implementation partners, and evaluation service providers. Section 75.135 Competition Exception for Implementation Sites, Implementation Partners, or Evaluation Service Providers Current Regulations: There is no current § 75.135. The Department’s procurement regulations in 34 CFR 74.43 and 34 CFR 80.36(c) provide that a grantee must conduct its procurement transactions in a manner that provides full and open competition. In many cases, grantees must use formal competition procedures to select contractors. Under these current provisions, an applicant for a grant requiring an evaluation would need, in many cases, to conduct a formal bidding process to select implementation sites, implementation partners, or evaluation service providers before submitting its application to the Department or following award of the grant. These types of procurement requirements can be very costly and time consuming at a PO 00000 Frm 00003 Fmt 4702 Sfmt 4702 time when the applicant cannot be sure it will be selected for a grant. Because the selection of implementation sites or partners and evaluation service providers is often an important factor in designing a project and submitting a high-quality application, we propose an exception to the Department’s procurement regulations for entities named in a grant application. Proposed Regulations: The Secretary proposes to add a new § 75.135 that would exempt certain applicants from the full competitive contracting requirements in 34 CFR 74.43 and 80.36(c). Specifically, an applicant for a grant that must be conducted at multiple sites or that requires an external evaluation would not be required to comply with the applicable formal competition requirements in 34 CFR 74.43 and 80.36(c) when entering into a contract if— (1) The contract is with an entity that agrees to provide a site or sites where the applicant would conduct the project activities under the grant or the contract is with the evaluation service provider that would conduct the project evaluation; (2) The implementation sites, implementation partners, or evaluation service providers are identified in the application for the grant; and (3) The implementation sites, implementation partners, or evaluation service providers are included in the application in order to meet a regulatory, statutory, or priority requirement related to the competition. A successful applicant would need to certify that any employee, officer, or agent participating in the selection, award, or administration of a contract is free of any real or apparent conflict of interest. In the case of a contract for a provider to conduct the project evaluation, the proposed amendment would permit the applicant or grantee to use the informal competition requirements for small purchases that are currently applicable only to governments under 34 CFR 80.36(d)(1), regardless of whether the applicant or grantee is a government entity and regardless of whether the purchase meets the small purchase threshold. During the course of the grant, a successful applicant would be required to obtain the Department’s permission to change any implementation site, implementation partner, or evaluation service provider that the applicant specified in the application and selected under proposed § 75.135. The exception also would not relieve an applicant of the obligation to conduct an informal review of evaluation service providers E:\FR\FM\14DEP1.SGM 14DEP1 mstockstill on DSK4VPTVN1PROD with Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules in order to determine the best available provider or from its obligations under the Department’s other procurement requirements. A successful applicant that does not meet the three criteria above would not be exempt from complying with the applicable formal competition requirements in 34 CFR 74.43 and 80.36(c) when entering into a contract. For example, an applicant that does not identify its implementation sites, implementation partners, or evaluation service provider in its application would be required to comply with the applicable formal competition requirements in 34 CFR 74.43 and 80.36(c). Reasons: This proposed new section addresses a difficulty many applicants face when selecting implementation sites, partners, and evaluation service providers prior to submitting their applications. Requiring grantees to use formal competitive procedures to select implementation sites and partners could significantly diminish both the ability of many applicants to compete for grants and the quality of project evaluations. For example, without this proposed regulation, a successful applicant would be limited in its ability to select implementation sites that include specific populations that it proposed to serve through the project or to work with the evaluation service provider that assisted in designing the applicant’s evaluation plan. Formal competition requirements also inhibit the ability of many applicants to select evaluators who would work with the applicants to design project evaluation plans. Some of the best evaluations of projects may be conducted by evaluation service providers that are involved in the initial design of a project. Such work generally takes place during the development of an application, before the applicant knows whether it will receive a grant. Thus, requiring an applicant to hold a formal competition involving sealed bids or competitive proposals in order to select an evaluation service provider (either before or after it receives a grant) can have major negative consequences. For example, an evaluation service provider would be excluded from the competition to select the project evaluator under the procurement requirements in parts 74 and 80 if it helped prepare an application and helped the applicant set up the standards used to select an evaluation service provider or contractor (see 34 CFR 74.42, 74.43, and 80.36). Highquality evaluation of a project funded by the Department may be hindered if an evaluation service provider that VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 designed the evaluation strategy for an application is excluded from the evaluation procurement competition for that project. Given the uncertainty of the competitive process, the Secretary also believes that applicants should not be required to use formal competition procedures to select an evaluation service provider at the time they prepare their applications. While the Secretary proposes to remove the competition requirement for selecting sites and implementation partners and thus permit applicants and grantees to use informal procedures instead, the Secretary would continue to require all applicants to comply with the other procurement requirements in parts CFR 74 and 80, including the requirements for cost price analysis, standards of conduct, conflicts of interest, and the prohibition of contingent payment for services. Additionally, the proposed amendment does not supersede any State laws regarding procurement. Finally, based on the other procurement requirements in CFR parts 74 and 80, these exceptions would not relieve an applicant of its responsibility to document that it made genuine efforts to select the best implementation sites, implementation partners, or evaluation service providers for the project, considering qualifications, capabilities, availability, price, and other important factors. § 75.708 Prohibition on Subgrants. Current Regulations: Section 75.708(a) prohibits grantees from awarding subgrants unless specifically authorized by statute. Proposed Regulations: The Secretary proposes to revise the prohibition on subgrants in § 75.708(a) to allow subgrants when authorized by statute or as provided for by a new § 75.708(b). Under this proposed new § 75.708(b), the Secretary could, through an announcement in the Federal Register, authorize subgrants when necessary to meet the purposes of a particular program. In addition, the Federal Register announcement would identify the types of entities (e.g., State or local educational agencies, institutions of higher education, or non-profit organizations) that could receive subgrants under the program. We would add § 75.708(c) to provide that subgrants, if authorized under § 75.708(b), could be awarded to entities identified in a grantee’s application. The subgrant must be used to directly carry out activities described in the application. We would add a new § 75.708(d), which would establish requirements PO 00000 Frm 00004 Fmt 4702 Sfmt 4702 74395 grantees would have to follow in awarding subgrants authorized under § 75.708(b). We would re-designate the current § 75.708(b) as § 75.708(e). Reasons: The revision of § 75.708(a) is necessary to provide grantees with flexibility to work with partners or other entities to carry out project activities. The prohibition on subgrants, in conjunction with the requirement on full and open competition for procurement transactions in 34 CFR 74.43 and 34 CFR 80.36(c), unduly restricts grantees from working with partners or other entities identified in their applications as being directly responsible for carrying out projectrelated activities. In order to ensure appropriate subgranting by Department grantees, our proposed revision authorizes subgrants only when approved by the Secretary for a particular program and only to the types of entities (e.g., State or local educational agencies, institutions of higher education, or non-profit organizations) designated by the Secretary. In addition the proposed revision would limit the entities that may receive subgrants to those that: (1) Are identified in a grantee’s application, or (2) are competitively selected using the grantee’s procedures for selecting subgrants and, (3) will use the subgrant directly to carry out project activities described in the grantee’s application. In all cases where a grantee is working with an organization or entity that is not identified in its application, not selected through a competitive process, or not an organization or entity directly responsible for carrying out an activity or activities described in the grantee’s application, the grantee would be required to follow the procurement procedures set out in 34 CFR Parts 74 and 80. Additionally, the grantee—as the fiscal agent—would remain responsible to the Department for the proper use of all grant funds, including those subgranted to another entity. In addition, we would add a new § 75.708(d) requiring grantees to ensure that: (1) Subgrants are awarded on the basis of an approved budget that is consistent with the grantee’s approved application and all applicable Federal statutory, regulatory, and other requirements; (2) subgrants include all conditions required by Federal law; and (3) subgrantees are aware of requirements imposed upon them by Federal law, including the Federal antidiscrimination laws enforced by the Department. This revision provides grantees, in programs and to entities designated by the Secretary, with the flexibility to award subgrants in specific E:\FR\FM\14DEP1.SGM 14DEP1 74396 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules circumstances where necessary to ensure proper implementation of an approved project without diminishing accountability for Federal funds or project outcomes. mstockstill on DSK4VPTVN1PROD with III. Selection Criteria Background The regulations in subpart D of 34 CFR part 75 set forth the general requirements that govern the Department’s selection of grantees for direct grant awards. For those direct grant programs that make discretionary grant awards, the Secretary uses selection criteria to evaluate applications submitted under those programs. The regulations specify certain selection criteria from which the Secretary may choose (general EDGAR criteria). They allow the Secretary to use program-specific selection criteria and the general EDGAR selection criteria, as well as to develop other criteria based on the statutory provisions for the funding program. However, some program regulations currently do not provide that the Secretary may use program-specific selection criteria in conjunction with EDGAR and statutory criteria. The regulations also describe how the Secretary determines which criteria and which factors within those criteria are used in a particular competition and how the Secretary may weight the criteria and factors. As we have managed competitions under the general regulations governing selection criteria, we have found that some of the regulations on the selection of grantees do not provide the Department the discretion it needs, absent a lengthy rulemaking process, to conduct grant competitions closely aligned with Department, legislative, and program objectives and priorities that can change from year to year in response to new and unanticipated circumstances. These proposed regulations, therefore, would provide the Department additional flexibility to establish criteria based on program regulations, in addition to the current authority to base criteria on statutory provisions. The proposed regulations would also specifically authorize program offices to establish additional selection criteria in § 75.210 based on statutory and regulatory provisions. These proposed regulations would also add new selection factors under the ‘‘Quality of Project Design’’ criterion on organizational and programmatic sustainability and organizational productivity. The proposed regulations would also add to the ‘‘Quality of the Project Evaluation’’ criterion five new selection factors on the types of VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 evidence the evaluation designs would produce on the performance and implementation of the project. Finally, the proposed regulations would establish a new criterion to evaluate the extent to which an applicant proposes a project that could be brought to scale. The addition of these selection factors would ensure that the Department’s discretionary grant programs would more effectively promote the development and implementation of effective and sustainable practices, and support adoption and implementation of necessary reforms. These proposed regulations would not change the way the Secretary uses the current and new selection criteria and factors. The Secretary would continue to use those selection criteria and factors that are consistent with the purpose of the program and permitted under the applicable statutes and regulations. Proposed Regulatory Changes 34 CFR Part 75 Section 75.209 Selection Criteria Based on Statutory or Regulatory Provisions Current Regulations: Current § 75.209 provides that the Secretary may evaluate applications by establishing selection criteria based on the statutory provisions for the authorized program. These provisions include, but are not limited to, those related to specific statutory selection criteria, allowable activities, application content requirements, and other pre-award and post-award conditions. Proposed Regulations: We propose to revise § 75.209 to allow the Secretary to use selection criteria, the factors in program regulations, and those based on program statute, along with the selection criteria in § 75.210 (often referred to as the EDGAR selection criteria) to produce more focused selection criteria. Thus, § 75.209 would allow the Secretary to establish selection criteria, and factors for considering those criteria, based on statutory or regulatory provisions that apply to the authorized program, which may include, but are not limited to, criteria and factors that reflect: • Criteria contained in the program statute or regulations; • Criteria in § 75.210; • Allowable activities specified in the program statute or regulations; • Application content requirements specified in the program statute or regulations; • Program purposes, as described in the program statute or regulations; or PO 00000 Frm 00005 Fmt 4702 Sfmt 4702 • Other pre-award and post-award conditions specified in the program statute or regulations. Reasons: The Secretary proposes amending this section so that the Department can establish selection criteria based both on a program’s statute and regulations. Program regulations are used to help clarify and fill in the gaps of more general statutory requirements and provide further detail about authorized activities for a program. Under this proposed amendment, the Secretary would be able to use the more specific regulatory provisions to establish selection criteria that are focused more closely on the intended outcomes of the competition and, thereby, help applicants to structure their applications so as to more accurately and concisely describe how they will achieve those outcomes. In addition to providing for establishment of criteria based on program regulations, this amendment would allow the Secretary to use a combination of criteria from the program statute, its established regulations, or the general selection criteria in § 75.210. § 75.210 General Selection Criteria Current Regulations: Current § 75.210 contains a list of eight selection criteria: ‘‘Need for Project’’ in paragraph (a); ‘‘Significance’’ in paragraph (b); ‘‘Quality of the Project Design’’ in paragraph (c); ‘‘Quality of Project Services’’ in paragraph (d); ‘‘Quality of Project Personnel’’ in paragraph (e); ‘‘Adequacy of Resources’’ in paragraph (f); ‘‘Quality of the Management Plan’’ in paragraph (g); and ‘‘Quality of the Project Evaluation’’ in paragraph (h). Under each of these selection criteria, the Secretary may select from a number of factors to focus each criterion. Proposed Regulations: The Secretary proposes to revise the introductory paragraph of § 75.210, add selection factors to the criteria in § 75.210(c) and (h), and add a new criterion as paragraph (i) to address the ability of an applicant to bring a project to scale. Introductory Text: We propose to amend the introductory paragraph of § 75.210 so that the Secretary may select factors that could be considered under a criterion both from the factors listed under that criterion and factors listed under other criteria. For example, the proposed amendment would allow the Secretary to establish ‘‘Quality of the Project Design’’ as a selection criterion and include selection factors from ‘‘Need for Project’’ (§ 75.210(a)) or ‘‘Significance’’ (§ 75.210(b)) in the factors that will be considered under the ‘‘Quality of the Project Design’’ E:\FR\FM\14DEP1.SGM 14DEP1 mstockstill on DSK4VPTVN1PROD with Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules criterion. Currently, to use a single selection factor under the ‘‘Need for Project’’ criterion, the Department, in most cases, would need to include the ‘‘Need for Project’’ criterion, even if the factor in question could be appropriately grouped with factors from another selection criterion, such as ‘‘Significance.’’ Reasons: The purpose of this amendment is to provide the Secretary with the flexibility to choose and combine selection factors established in § 75.210 under various selection criteria. This would enable the Department to align the selection criteria and factors with the goals and objectives of a particular discretionary grant competition in a more coherent and effective fashion than is currently permitted. Selection criteria and factors that are concise and are aligned as closely as possible with the goals and objectives of a particular grant competition would more effectively guide applicants in preparing clearer and more focused applications that in turn can be more effectively evaluated and rated by peer reviewers. The current regulations, by contrast, do not allow this close focus. Including a greater number of selection criteria in application notices, solely to include particular selection factors, makes it more likely that applications will be less focused and more difficult for peer reviewers to accurately evaluate and score. Current Regulations: Section 75.210(c) establishes the selection criterion ‘‘Quality of the Project Design.’’ The Secretary may consider one or more of the 23 factors listed under this criterion in determining the quality of the project design, including the extent to which the project design will build capacity that extends beyond the project period and establish linkages to services provided by other programs. Proposed Regulations: The Secretary proposes to add new factors to the criterion in paragraph (c), (xxiv and xxv) relating to the sustainability of the proposed project after the end of the project period. Reasons: Adding these selection factors would help ensure that the Department’s discretionary grant programs effectively promote the development and implementation of effective and sustainable practices and support adoption and implementation of necessary reforms. By promoting the development of a multi-year plan for incorporation into the applicant’s ongoing work, the proposed factors would better encourage applicants to develop sustainability plans than do the related selection factors in current VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 § 75.210(c). The proposed factors also would allow the Secretary to consider a proposed project’s potential for sustainability over time, including the extent to which the project has the support of various stakeholders and adequate resources to continue the project after the grant period ends. Proposed Regulations: The Secretary proposes to revise § 75.210(c) to add a new selection factor (xxvi) regarding the extent to which the proposed project will increase efficiency in the use of time, staff, money, or other resources in order to improve results and increase productivity. Reasons: Current § 75.210(c) does not include a factor that promotes increased productivity. Considering the budget challenges that State and local educational agencies, institutions of higher education, non-profit organizations, and other entities working in education face during economic downturns, and given the potential for new knowledge and capabilities to improve efficiency, the Department believes that it is appropriate to consider the potential for increasing productivity, i.e., the extent to which a proposed project includes a strategy to make more efficient use of time, money, and staff, when assessing an application. Proposed Regulations: The Secretary proposes to revise § 75.210(c)(xvi) to read ‘‘The extent to which the proposed project will integrate with or build on similar or related efforts to improve relevant outcomes, using existing funding streams from other programs or policies supported by community, State, and Federal resources.’’ In addition, the Secretary proposes to add a new selection factor (xxvii) regarding the extent to which the proposed project will integrate with or build on similar or related efforts in order to improve relevant outcomes, using nonpublic funds or resources. Reasons: Given the budget challenges facing State and local educational agencies, institutions of higher education, and other entities working in education, there is a need for strategies and practices to improve relevant outcomes while controlling costs. Moreover, ‘‘silos’’ within and between agencies at the local, State, and Federal levels often impede program integration and result in less efficient and effective efforts. The purpose of revising this selection factor and adding a factor focused on nonpublic investments is to improve levels of program integration, to facilitate shared agendas for actions focused on common outcomes, and to leverage public and private sector investments in education. In addition, PO 00000 Frm 00006 Fmt 4702 Sfmt 4702 74397 the Department believes that leveraging existing programs and policies that are supported by other funds, including other Federal, State, local, or private funds, increases the likelihood that selected projects will be sustained beyond the grant period. Proposed Regulations: The Secretary proposes to add two new selection factors (xxviii and xxix) regarding the extent to which the proposed project is supported by evidence of promise or strong theory. Later in this notice, we propose adding definitions to Part 77, including evidence of promise, strong theory, and other terms to ensure consistent understanding of the selection factors we propose in this notice. Reasons: The Department recognizes that at the various stages of a proposed project’s development, different types of evidence are available to assess the effectiveness of a project. The proposed selection factors would permit the Secretary to use strength of evidence as a selection factor in determining the projects the Department will fund while maintaining the flexibility to consider a wider variety of studies or data an applicant might present that is appropriate to the goals of the project. The flexibility provided by the proposed selection factor would be particularly beneficial for innovative areas where strong or moderate evidence of effectiveness is not yet available because it would allow the Secretary to consider strength of evidence appropriate to a project’s stage of development. Current Regulations: Section 75.210(h) establishes the selection criterion ‘‘Quality of the Project Evaluation.’’ The Secretary may consider one or more of the seven factors listed under this criterion in determining the quality of the project evaluation design, such as the extent to which the project proposes feasible and appropriate evaluation methods, uses objective performance measures, and permits periodic assessment. Proposed Regulations: The Secretary proposes to revise § 75.210(h) to add five new selection factors. Two of the new selection factors address the extent to which the methods of evaluation will, if well-implemented, produce evidence about the project’s effectiveness that would meet the What Works Clearinghouse Evidence Standards.1 The other three proposed selection factors address the extent to which the methods of evaluation will produce 1 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx? sid=19. E:\FR\FM\14DEP1.SGM 14DEP1 mstockstill on DSK4VPTVN1PROD with 74398 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules evidence of promise about the grantsupported intervention, valid and reliable performance data on relevant outcomes of the project, and the extent to which the evaluation plan articulates key components as well as measureable thresholds for acceptable implementation of the project. Reasons: Although current § 75.210(h) includes selection factors regarding proposed evaluation methods, it does not include a selection factor that promotes use of the strongest possible study designs for estimating a program’s effect or a selection factor that assesses the extent to which the proposed evaluation will articulate information that can be used to assess whether the project was implemented with fidelity. Linking two of the proposed new selection factors to the What Works Clearinghouse Evidence Standards 2 reflects the predominant view among research experts that the randomized controlled trial (also referred to as an experimental design study) is the most rigorous and defensible method for producing unbiased evidence of project effectiveness. Random assignment of entities (students, teachers, schools, or other units of analysis) to a treatment or control group is the most effective way to eliminate plausible competing explanations for observed differences between treated and non-treated individuals or groups (i.e., the estimated treatment effect). Adding these selection factors will allow the Secretary to consider the extent to which applicants propose evaluations that will contribute to a strong body of evidence on the effectiveness of the proposed project. Additionally, the other three proposed selection factors allow the Secretary to consider evaluation methods that will produce data on a project’s evidence of promise, performance on relevant outcomes, and fidelity of implementation. Each of these factors would improve the Department’s ability to assess evaluation plans for projects at various stages of their development. Current Regulations: None. Proposed Regulations: The Secretary proposes to add selection criterion § 75.210(i), ‘‘Strategy to Scale.’’ ‘‘Scale’’ refers to expanding the use or implementation of a proposed practice, strategy, or program to provide services at a State, regional, or national level while maintaining the demonstrated effectiveness of the approach. Under the proposed new criterion, the Secretary 2 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx? sid=19. VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 would consider the applicant’s strategy to scale the proposed project. In determining the applicant’s strategy to scale the proposed project, the Secretary would consider one or more factors, including the extent to which the applicant’s strategy to scale addresses a particular barrier or barriers that prevented the applicant, in the past, from reaching the level of scale that is proposed in the application; the applicant’s capacity (e.g., in terms of qualified personnel, financial resources, or management capacity) to bring the proposed project to scale; and the extent to which the applicant demonstrates there is unmet demand for the proposed project that will enable the applicant to reach the level of scale that is projected in the application. In addition, the Secretary could consider the feasibility of replicating the project and the mechanisms for broadly disseminating information on the project so as to support further development or replication. Reasons: It is important that successful best practices be shared and implemented more broadly. The addition of this selection criterion would allow the Secretary to consider the proposed scaling methodology and the feasibility of successfully replicating the proposed project in a variety of settings and with other populations. The proposed selection criterion would allow the Department to consider whether applicants have the potential to serve more groups in a variety of settings, which would be important in estimating the likelihood of a proposed project’s success at scale and in considering applications for activities that include broad sharing of best practices. Additionally, Department programs could use the proposed criterion, in conjunction with the proposed priority regarding evidence of effectiveness, to encourage the field to focus its attention and resources on projects that are effective. IV. Evidence of Effectiveness Background To support effective projects and provide incentives to the field for building an evidence base on the effectiveness of interventions, the Secretary proposes a priority for projects that can cite and build upon an existing base of strong or moderate evidence of effectiveness. This priority would be a critical part of the Department’s efforts to fund and increase the use of programs with evidence of effectiveness. PO 00000 Frm 00007 Fmt 4702 Sfmt 4702 Section 75.226 Consideration of Applications Supported by Strong or Moderate Evidence of Effectiveness Current Regulations: None. Proposed Regulations: The Secretary proposes to establish procedures for giving special consideration to applications supported by strong or moderate evidence of effectiveness. Proposed § 75.226 would establish that if the Secretary determines to give special consideration to applications supported by strong or moderate evidence of effectiveness for a particular grant competition, the Secretary could either establish a separate competition or give a competitive preference to applications supported by strong or moderate evidence of effectiveness under the procedures in 34 CFR 75.105(c)(2). Reasons: By expanding the number of Department programs awarding grants to those projects supported by strong or moderate evidence of effectiveness, the Department could better ensure that discretionary grant funds are used to support effective interventions and activities. V. Program Budgets Background So that the Department can learn as much as possible from successful discretionary grants and its programs as a whole, we propose amendments regarding budget periods. We would: • Establish that a project may receive an extension of the funding period for the purpose of collecting, analyzing, and reporting performance data; • Clarify that a multi-year data collection may be funded through separate budget periods; and • Clarify that any information relevant to the grantee’s performance during the project period should be considered when determining whether a grantee receives a continuation award. Proposed Regulatory Changes 34 CFR Part 75 Section 75.250 Maximum Funding Period Current Regulations: Current § 75.250 is titled ‘‘Project period can be up to 60 months.’’ This section provides that the Secretary may approve a project period of up to 60 months, but it does not specifically authorize funding grants for periods longer than 60 months. Other regulations in part 75 prohibit the use of Federal funds for projects extending past 60 months. See current § 75.261, which addresses the circumstances under which a grantee may request a nocost extension of a project period. E:\FR\FM\14DEP1.SGM 14DEP1 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules Proposed Regulations: We propose to amend § 75.250 to provide that the Secretary may approve a data collection period of up to 72 months—if not inconsistent with any statutory limits on the grant award period—after the end of the project period and provide funding during this period for the sole purpose of collecting, analyzing, and reporting data regarding project performance. During a data collection period, a grantee could use the funds only for data collection, analysis, and reporting purposes. Section 75.250(b)(2) would give the Secretary discretion to notify applicants in the notice inviting applications for a competition or later, after grantees have started their projects of the intent to fund data collection periods. Given these proposed changes, the Secretary also proposes to change the title of this section to ‘‘Maximum funding period.’’ Reasons: It is the Department’s experience that the effectiveness of a project cannot always be determined on the date that the substantive work of the project is complete. For example, a fouryear project designed to increase the ability of certain high school students to successfully complete college may require data collection for up to six years after the date the substantive work of the project ends. With the discretion to approve a data collection period after the end of a project period and offer continued funding for data collection, the Department could ensure that performance data are collected and are used to evaluate both the project and program performance. The Secretary would expect to fund any data collection period of a grant at a much lower level than the original substantive work of the grant. mstockstill on DSK4VPTVN1PROD with Section 75.251 The Budget Period Current Regulations: Current § 75.251 describes how the Secretary may fund multi-year projects through separate budget periods, generally of 12 months each. Proposed Regulations: The Secretary proposes to add a new paragraph (c) to this section to clarify that multi-year data collection periods may be funded through budget periods in the same manner as project periods are funded. Reasons: We are proposing to revise § 75.251 to correspond to the proposed revisions to § 75.250. Section 75.253 Continuation of a Multi-Year Project After the First Budget Period Current Regulations: Under current § 75.253(a), a grantee may only receive a continuation award if the grantee has VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 met certain requirements, including the requirement that the grantee make substantial progress toward the objectives of the grant. If a grantee does not make substantial progress, it must obtain permission from the Department to make changes to the project that would help the grantee make substantial progress during the remainder of the project period. Proposed Regulations: The Secretary proposes to amend § 75.253 by adding a new paragraph (b) to clarify that in deciding whether to make a continuation grant, the Secretary could consider any information relevant to the grantee’s performance during the project period. This could include information relevant to the authorizing statute, a criterion, a priority, or a performance measure, or any financial or other requirement that applied to the selection of applications for new awards. While this proposed standard for granting continuation awards is implicit under the current regulations, the Secretary believes that this standard should be explicit so that grantees have a clearer understanding of how the Department decides to make a continuation award. In addition, we propose to amend paragraph (a)(2) so that in making continuation awards, the Secretary could consider not only the extent to which a grantee has made substantial progress in achieving the goals and objectives of the project, but also whether a grantee met the performance targets in the approved application, if the Secretary established performance measurement requirements for the grant in the application notice. If a grantee fails to meet these targets, proposed paragraph (a)(2) would require the grantee to obtain the Secretary’s approval for changes to the project that enable the grantee to achieve the project’s goals, objectives, and performance targets, if any, without changing the project scope or objectives. The Secretary would retain the requirement in the current regulation that any such changes may not increase the amount of funds obligated to the project by the Department. Reasons: Current § 75.253 does not describe the standards used to determine whether a grantee has made substantial progress on its grant. Therefore, we propose these amendments to clarify the standards that the Department considers when determining whether a grant will receive a continuation award. The proposed amendments would establish that the Secretary may also consider whether a grantee has met the performance targets in its approved PO 00000 Frm 00008 Fmt 4702 Sfmt 4702 74399 application when making continuation awards. Section 75.590 Grantee Evaluation by the Current Regulation: Current § 75.590 requires a grantee to submit performance reports to the Department that evaluate at least annually the grantee’s progress in achieving the objectives in its approved application, the effectiveness of the project in meeting the purposes of the program, and the effect of the project on participants being served by the project. This provision does not currently provide any standards for evaluating the progress in achieving performance targets. Proposed Regulation: The Secretary proposes to revise § 75.590 to add a new paragraph (a) to provide that if an application notice for a competition requires applicants to describe how they would evaluate their projects, any evaluation must meet the standards set in the approved application for the project. The performance measurement data collected by the grantee and used in the evaluation must meet the performance measurement requirements in the approved application. We also propose to designate the current regulatory text in § 75.590 as new paragraph (b) and revise that text to conform to the other changes we are proposing regarding performance measurement. Specifically, we propose that if the application notice for a competition did not require an applicant to submit an evaluation plan, the grantee must provide information in its performance report to the Department demonstrating (1) The progress made by the grantee in the most recent budget period; (2) the effectiveness of the project; and (3) the effect of the project on the participants served by the project. If the application notice required applicants to propose how they would meet performance requirements, the performance report would also need to address the extent to which the grantee met the project’s performance targets and other performance measurement requirements for the budget period addressed by the performance report. Reasons: The proposed revisions to § 75.590 strengthen the Department’s authority to monitor the quality of grantees’ project evaluations. Additionally, these revisions complement other proposed regulations in this notice regarding performance measurement requirements. E:\FR\FM\14DEP1.SGM 14DEP1 74400 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules VI. Definitions Background These proposed regulations include references to terms that are not currently defined in EDGAR. To ensure a common understanding of these terms, we propose establishing the following definitions. Proposed Regulatory Changes 34 CFR Part 77 Section 77.1 Definitions That Apply to All Department Programs Current Regulations: Section 77.1(c) establishes definitions that unless a statute or regulation provides otherwise, apply to parts 34 CFR 74 and 80. Proposed Regulations: The Secretary proposes to incorporate the definitions for the following terms into § 77.1(c): ‘‘ambitious,’’ ‘‘baseline data,’’ ‘‘evidence of promise,’’ ‘‘large sample,’’ ‘‘logic model,’’ ‘‘moderate evidence of effectiveness,’’ ‘‘multi-site sample,’’ ‘‘national level,’’ ‘‘performance measure,’’ ‘‘performance target,’’ ‘‘randomized controlled trial,’’ ‘‘regional level,’’ ‘‘relevant outcome,’’ ‘‘quasiexperimental study,’’ ‘‘strong evidence of effectiveness,’’ and ‘‘strong theory.’’ Reasons: The Secretary proposes establishing these definitions to ensure consistent understanding of the selection factors and priority we propose in this notice. Executive Orders 12866 and 13563 mstockstill on DSK4VPTVN1PROD with Regulatory Impact Analysis Under Executive Order 12866, the Secretary must determine whether this regulatory action is ‘‘significant’’ and, therefore, subject to the requirements of the Executive order and subject to review by the Office of Management and Budget (OMB). Section 3(f) of Executive Order 12866 defines a ‘‘significant regulatory action’’ as an action likely to result in a rule that may— (1) Have an annual effect on the economy of $100 million or more, or adversely affect a sector of the economy, productivity, competition, jobs, the environment, public health or safety, or State, local, or tribal governments or communities in a material way (also referred to as an ‘‘economically significant’’ rule); (2) Create serious inconsistency or otherwise interfere with an action taken or planned by another agency; (3) Materially alter the budgetary impacts of entitlement grants, user fees, or loan programs or the rights and obligations of recipients thereof; or (4) Raise novel legal or policy issues arising out of legal mandates, the VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 President’s priorities, or the principles stated in the Executive Order. This proposed regulatory action is a significant regulatory action subject to review by OMB under section 3(f) of Executive Order 12866. We have also reviewed these regulations under Executive Order 13563, which supplements and explicitly reaffirms the principles, structures, and definitions governing regulatory review established in Executive Order 12866. To the extent permitted by law, Executive Order 13563 requires that an agency— (1) Propose or adopt regulations only upon a reasoned determination that their benefits justify their costs (recognizing that some benefits and costs are difficult to quantify); (2) Tailor its regulations to impose the least burden on society, consistent with obtaining regulatory objectives and taking into account—among other things and to the extent practicable—the costs of cumulative regulations; (3) In choosing among alternative regulatory approaches, select those approaches that maximize net benefits (including potential economic, environmental, public health and safety, and other advantages; distributive impacts; and equity); (4) To the extent feasible, specify performance objectives, rather than the behavior or manner of compliance a regulated entity must adopt; and (5) Identify and assess available alternatives to direct regulation, including economic incentives—such as user fees or marketable permits—to encourage the desired behavior, or provide information that enables the public to make choices. Executive Order 13563 also requires an agency ‘‘to use the best available techniques to quantify anticipated present and future benefits and costs as accurately as possible.’’ The Office of Information and Regulatory Affairs of OMB has emphasized that these techniques may include ‘‘identifying changing future compliance costs that might result from technological innovation or anticipated behavioral changes.’’ We are issuing these regulations only on a reasoned determination that their benefits justify their costs. In choosing among alternative regulatory approaches, we selected those approaches that maximize net benefits. Based on the analysis that follows, the Department believes that these regulations are consistent with the principles in Executive Order 13563. We also have determined that this regulatory action would not unduly interfere with State, local, and tribal PO 00000 Frm 00009 Fmt 4702 Sfmt 4702 governments in the exercise of their governmental functions. In accordance with both Executive orders, the Department has assessed the potential costs and benefits of this regulatory action. The potential costs associated with this regulatory action are those resulting from statutory requirements and those we have determined as necessary for administering the Department’s programs and activities. Summary of Potential Costs and Benefits Under the proposed regulations, applicants would have to use performance measures, baseline data, and performance targets established by the Department or establish their own performance measures, and determine baseline data performance targets for each performance measure. Although these proposed regulations would explicitly require such determinations and data collections, these requirements are implicit under the current regulations and grantees are already required to report on the extent to which they are meeting performance targets under the performance report ED 524B, which is approved under OMB control number 1894–0003. Therefore, we do not expect an increase in reporting burden on grantees under the proposed amendments. The benefits of the proposed regulations would be that the Department would have explicit authority to collect meaningful data that we could use to assess the success of individual projects and report to Congress and OMB about the success of Department programs in achieving their legislative objectives. The ability to determine the success of Department programs could help improve the effectiveness of Department programs, without imposing additional costs on grantees or other parties. The proposed regulations would also permit the Department to provide an exception for certain applicants from the full competitive contracting requirements in 34 CFR 74.43 and 80.36(c) for a grant that requires an external evaluation. Additionally, the proposed regulations would remove the prohibition on subgrants and allow for subgrants to any entity that is identified in a grantee’s application and uses the subgrant directly to carry out activities described in the application. This action would reduce costs and increase benefits. The benefits are that the proposed rule would remove a barrier for these grantees to contracting with the same evaluator both in the grant application E:\FR\FM\14DEP1.SGM 14DEP1 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules mstockstill on DSK4VPTVN1PROD with stage and after receiving a grant award (and similarly, to selecting evaluation sites and implementation partners both pre-grant award and post-award), and thereby potentially enhance the quality of these projects. At the same time the proposed regulations would relieve grantees of the costs of administering competitions without reducing accountability or increasing the risk of improper use of or accounting for grant expenditures. Additionally, under the proposed regulations, the Department would have greater flexibility in conducting grant competitions to use selection criteria that (1) are closely aligned with program objectives and priorities, and (2) promote reform objectives related to project evaluation, sustainability, productivity, and capacity to scale. This change would benefit applicants as well as the Department because it allows the Secretary to establish selection criteria that are concise and closely aligned with the goals and objectives of a particular grant competition and are focused more closely and coherently on the intended outcomes of the competition. The regulations would generate these benefits without increasing the costs for applicants, grantees, or the Department that already exist for creating and reviewing grant applications. Elsewhere in this section under the heading Paperwork Reduction Act of 1995, we identify and explain burdens specifically associated with information collection requirements. Clarity of the Regulations Executive Order 12866 and the Presidential memorandum on ‘‘Plain Language in Government Writing’’ require each agency to write regulations that are easy to understand. The Secretary invites comments on how to make these proposed regulations easier to understand, including answers to questions such as the following: • Are the requirements in the proposed regulations clearly stated? • Do the proposed regulations contain technical terms or other wording that interferes with their clarity? • Does the format of the proposed regulations (grouping and order of sections, use of headings, paragraphing, etc.) aid or reduce their clarity? • Would the proposed regulations be easier to understand if we divided them into more (but shorter) sections? (A ‘‘section’’ is preceded by the symbol ‘‘§ ’’ and a numbered heading; for example, § 75.210 General selection criteria.) • Could the description of the proposed regulations in the VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 SUPPLEMENTARY INFORMATION section of this preamble be more helpful in making the proposed regulations easier to understand? If so, how? • What else could we do to make the proposed regulations easier to understand? To send any comments that concern how the Department could make these proposed regulations easier to understand, see the instructions in the ADDRESSES section of this preamble. Regulatory Flexibility Act Certification Paperwork Reduction Act of 1995 The Secretary certifies that these proposed regulations would not have a significant economic impact on a substantial number of small entities because the proposed regulations would affect only slightly the overall burden on applicants and grantees, as explained in the Paperwork Reduction Act of 1995 discussion in this SUPPLEMENTARY INFORMATION. Paperwork Reduction Act of 1995 As part of its continuing effort to reduce paperwork and respondent burden, the Department conducts a preclearance consultation program to provide the general public and Federal agencies with an opportunity to comment on proposed and continuing collections of information in accordance with the Paperwork Reduction Act of 1995 (PRA) (44 U.S.C. 3506(c)(2)(A)). This helps ensure that: The public understands the Department’s collection instructions, respondents can provide the requested data in the desired format, reporting burden (time and financial resources) is minimized, collection instruments are clearly understood, and the Department can properly assess the impact of collection requirements on respondents. Section 75.110 contains an information collection requirement. Under the PRA the Department has submitted a copy of this section to OMB for its review. A Federal agency may not conduct or sponsor a collection of information unless OMB approves the collection under the PRA and the corresponding information collection instrument displays a currently valid OMB control number. Notwithstanding any other provision of law, no person is required to comply with, or is subject to penalty for failure to comply with, a collection of information if the collection instrument does not display a currently valid OMB control number. In the final regulations we will display the control number assigned by OMB to any information collection PO 00000 Frm 00010 Fmt 4702 Sfmt 4702 74401 requirement proposed in this NPRM and adopted in the final regulations. Collection of Information: The proposed regulations would affect applicants and grantees of the Department’s discretionary grant programs, including State, local, and tribal governments and non-profit organizations, such as institutions of higher education. Applications: OMB has approved the Department’s Generic Application Package under OMB Control number 1894–0006, which applies to those competitions that use the current EDGAR selection criteria in § 75.210 and statutory criteria that have been developed under the EDGAR procedures in § 75.209. Regarding the burden imposed by the Generic Application Package, the Department proposes to add proposed § 75.110 to the other sections already identified as creating burden related to that package. While § 75.110 is new, it would not impose any new data collection requirements for the Generic Application Package because performance measurement burden for that package has already been calculated under the selection criteria in § 75.210. The amendments proposed in this NPRM would not increase the existing paperwork burdens under the Generic Application Package. The Secretary also proposes to cover the burden associated with the EDGAR selection criteria from § 75.209 and § 75.210 under § 75.200, which fully details the sources that program offices can use to establish selection criteria under EDGAR. Each fiscal year, the Department receives over XX,000 applications under competitions covered by the Generic Application Package. Applicants that apply to programs that use the EDGAR criteria would be affected by the proposed changes to the selection criteria that would require applications to address evaluation and performance measurement more specifically. The Department already has selection criteria that ask applicants to describe the evaluation plans for their projects; the burden associated with the proposed regulations is currently covered under § 75.210(h). However, an applicant for a discretionary grant would only have to respond once to provide the following information regarding the project: The performance baselines; the performance measures; the performance targets; and the methodology for collecting performance data. Thus, we do not expect greater burden under these proposed regulations and the Generic Application Package because that burden is already covered under existing criteria. Instead, we expect that E:\FR\FM\14DEP1.SGM 14DEP1 mstockstill on DSK4VPTVN1PROD with 74402 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules as a result of these proposed regulations, applicants would provide greater clarity on the methodologies they would use to collect and report data. Because these proposed regulations would expand the number of programs that could use proposed § 75.209 to create criteria based on statutory and regulatory requirements, there is a potential under the proposed regulations that more program offices would use the EDGAR process to establish criteria for their competitions. If more competitions use the Generic Application Package, the overall hours of burden under the Generic Application Package and OMB Control number 1894–0006 would grow. However, any ‘‘new’’ burden covered by the Generic Application Package would result from fewer programs using program-specific application packages, so the total burden covered by programspecific application packages would be reduced in an amount equivalent to the burden increase associated with the Generic Application Package. If the amendments to the sections regarding the selection criteria become final, we would work closely with OMB to monitor the extent to which burden currently covered by separate programspecific application packages would shift to the Generic Application Package and request appropriate changes in the total burden covered by the Generic Application Package. The current Generic Application Package was approved by OMB based on an estimate of 9,861 responses over three years and an estimate of 447,089 total hours required to prepare applications. Performance reports: OMB has also approved the U.S. Department of Education Grant Performance Report (ED 524B) under OMB Control number 1894–0003. Over three years, the Department receives ED 524B performance reports from approximately 5,900 discretionary grantees. A grantee would have to respond on an annual basis to prepare performance reports throughout the course of the project period, including any no-cost extensions of the grant or funded data collection extensions, and respond once to prepare a final performance and financial report. These burdens have already been accounted for under the ED 524B. The number of reports estimated annually under the ED 524B is 5,900 and the estimated reporting burdenhours for that report is 132,200. We do not expect any change in burden under these proposed regulations. However, there is some potential that more programs might be able to use the ED VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 524B performance report as a result of more programs using the EDGAR selection criteria. We will monitor that potential and work with OMB to determine if the Department needs to revisit the total burden covered by the ED 524B performance report. List of Subjects Intergovernmental Review Dated: December 6, 2012. Arne Duncan, Secretary of Education. These proposed regulations affect Direct Grant programs of the Department that are subject to Executive Order 12372 and the regulations in 34 CFR part 79. One of the objectives of the Executive order is to foster an intergovernmental partnership and a strengthened federalism. The Executive order relies on processes developed by State and local governments for coordination and review of proposed Federal financial assistance. This document provides early notification of our specific plans and actions for these programs. 34 CFR Part 75 Accounting, Copyright, Education, Grant programs-education. 34 CFR Part 77 Education, Grant programs-education. For the reasons discussed in the preamble, the Secretary proposes to amend parts 75 and 77 of title 34 of the Code of Federal Regulations as follows: PART 75—DIRECT GRANT PROGRAMS 1. The authority citation for part 75 continues to read as follows: Authority: 20 U.S.C. 1221e–3 and 3474, unless otherwise noted. 2. Add a new § 75.110 to read as follows: Assessment of Educational Impact § 75.110 Information regarding performance measurement. In accordance with section 411 of the General Education Provisions Act, 20 U.S.C. 1221e–4, the Secretary particularly requests comments on whether these proposed regulations would require transmission of information that any other agency or authority of the United States gathers or makes available. Accessible Format: Individuals with disabilities can obtain this document in an accessible format (e.g., braille, large print, audiotape, or compact disc) on request to the program contact person listed under FOR FURTHER INFORMATION CONTACT. Electronic Access to This Document: The official version of this document is the document published in the Federal Register. Free Internet access to the official edition of the Federal Register and the Code of Federal Regulations is available via the Federal Digital System at: www.gpo.gov/fdsys. At this site you can view this document, as well as all other documents of this Department published in the Federal Register, in text or Adobe Portable Document Format (PDF). To use PDF you must have Adobe Acrobat Reader, which is available free at the site. You may also access documents of the Department published in the Federal Register by using the article search feature at: www.federalregister.gov. Specifically, through the advanced search feature at this site, you can limit your search to documents published by the Department. (a) The Secretary may establish in an application notice for a competition one or more performance measurement requirements, including requirements for performance measures, baseline data, or performance targets, and a requirement that applicants propose in their applications one or more of their own performance measures, baseline data, or performance targets. (b) If an application notice requires applicants to propose project-specific performance measures, baseline data, or performance targets, the application must include the following, as required by the application notice: (1) Performance measures. How each proposed performance measure would accurately measure the performance of the project and how the proposed performance measure would be consistent with the performance measures established for the program funding the competition. (2) Baseline data. (i) Why each proposed baseline is valid; or (ii) If the applicant has determined that there are no established baseline data for a particular performance measure, an explanation of why there is no established baseline and of how and when, during the project period, the applicant would establish a valid baseline for the performance measure. (3) Performance targets. Why each proposed performance target is ambitious yet achievable compared to the baseline for the performance measure and when, during the project period, the applicant would meet the performance target. PO 00000 Frm 00011 Fmt 4702 Sfmt 4702 E:\FR\FM\14DEP1.SGM 14DEP1 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules (c) If the application notice establishes performance measurement requirements, the applicant must also describe in the application— (1)(i) The data collection and reporting methods the applicant would use and why those methods are likely to yield reliable, valid, and meaningful performance data; and (ii) If the Secretary requires applicants to collect data after the substantive work of a project is complete regarding the attainment of certain performance targets, the data collection and reporting methods the applicant would use during the post-performance period and why those methods are likely to yield reliable, valid, and meaningful performance data. (2) The applicant’s capacity to collect and report reliable, valid, and meaningful performance data, as evidenced by high-quality data collection, analysis, and reporting in other projects or research. (Authority: 20 U.S.C. 1221e–3 and 3474) 3. Add a new undesignated center heading ‘‘Competition Exceptions’’ in subpart C immediately before the undesignated center heading ‘‘State Comment Procedures’’. 4. Add a new § 75.135 to subpart C under the undesignated center heading ‘‘Competition Exceptions’’ to read as follows: mstockstill on DSK4VPTVN1PROD with S75.135 Competition exception for proposed implementation sites, implementation partners, or evaluation service providers. 16:21 Dec 13, 2012 Jkt 229001 (Authority: 20 U.S.C. 1221e–3 and 3474) 5. Revise § 75.209 to read as follows: § 75.209 Selection criteria based on statutory or regulatory provisions. (a) When entering into a contract with implementation sites or partners, an applicant is not required to comply with the competition requirements in 34 CFR 74.43 or 80.36(c), as applicable, if— (1) The contract is with an entity that agrees to provide a site or sites where the applicant would conduct the project activities under the grant; (2) The implementation sites or partner entities that the applicant proposes to use are identified in the application for the grant; and (3) The implementation sites or partner entities are included in the application in order to meet a regulatory, statutory, or priority requirement related to the competition. (b) When entering into a contract for data collection, data analysis, or evaluation services, an applicant may select a provider using the informal, small-purchase procurement procedures in 34 CFR 80.36(d)(1), regardless of whether that applicant would otherwise be subject to that part or whether the evaluation contract would meet the standards for a small purchase order, if— VerDate Mar<15>2010 (1) The contract is with the data collection, data analysis, or evaluation service provider that would conduct the project services; (2) The evaluation service provider that the applicant proposes to use is identified in the application for the grant; and (3) The evaluation service provider is included in the application in order to meet a statutory, regulatory, or priority requirement related to the competition. (c) If the grantee relied on the exceptions under paragraph (a) or (b) of this section, the grantee must certify that any employee, officer, or agent participating in the selection, award, or administration of a contract is free of any real or apparent conflict of interest. (d) A grantee must obtain the Secretary’s prior approval for any change to an implementation site, implementation partner, or evaluation service provider, if the grantee relied on the exceptions under paragraph (a) or (b) of this section to select the entity or evaluator. (e) The exceptions in paragraphs (a) and (b) of this section do not extend to the other procurement requirements in 34 CFR part 74 and 34 CFR part 80 regarding contracting by grantees and subgrantees. The Secretary may establish selection criteria and factors based on statutory or regulatory provisions that apply to the authorized program, which may include, but are not limited to criteria and factors that reflect— (a) Criteria contained in the program statute or regulations; (b) Criteria in § 75.210; (c) Allowable activities specified in the program statute or regulations; (d) Application content requirements specified in the program statute or regulations; (e) Program purposes, as described in the program statute or regulations; or (f) Other pre-award and post-award conditions specified in the program statute or regulations. (Authority: 20 U.S.C. 1221e–3 and 3474) 6. Amend § 75.210 by: A. Revising the introductory text. B. Revising paragraph (c)(2)(xvi). C. Adding paragraphs (c)(2)(xxiv) through (xxix). D. Adding paragraphs (h)(2)(viii) through (xii). And E. Adding a new paragraph (i). PO 00000 Frm 00012 Fmt 4702 Sfmt 4702 74403 The revisions and additions read as follows. § 75.210 General selection criteria. In determining the selection criteria to evaluate applications submitted in a grant competition, the Secretary may select one or more of the following criteria and may select from among the list of optional factors under each criterion. The Secretary may define a selection criterion by selecting one or more specific factors within a criterion or assigning factors from one criterion to another criterion. * * * * * (c) * * * (2) * * * (xvi) The extent to which the proposed project will integrate with or build on similar or related efforts to improve relevant outcomes (as defined in 34 CFR 77.1(c)), using existing funding streams from other programs or policies supported by community, State, and Federal resources. * * * (xxiv) The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant, including a multi-year financial and operating model and accompanying plan; the demonstrated commitment of any partners; evidence of broad support from stakeholders (e.g., State educational agencies, teachers’ unions) critical to the project’s long-term success; or more than one of these types of evidence. (xxv) The potential and planning for the incorporation of project purposes, activities, or benefits into the ongoing work of the applicant beyond the end of the grant. (xxvi) The extent to which the proposed project will increase efficiency in the use of time, staff, money, or other resources in order to improve results and increase productivity. (xxvii) The extent to which the proposed project will integrate with or build on similar or related efforts in order to improve relevant outcomes (as defined in 34 CFR 77.1(c)), using nonpublic funds or resources. (xxviii) The extent to which the proposed project is supported by evidence of promise (as defined in 34 CFR 77.1(c)). (xxix) The extent to which the proposed project is supported by strong theory (as defined in 34 CFR 77.1(c)). * * * * * (h) * * * (2) * * * (viii) The extent to which the methods of evaluation will, if well-implemented, E:\FR\FM\14DEP1.SGM 14DEP1 74404 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules produce evidence about the project’s effectiveness that would meet the What Works Clearinghouse Evidence Standards without reservations.3 (ix) The extent to which the methods of evaluation will, if well-implemented, produce evidence about the project’s effectiveness that would meet the What Works Clearinghouse Evidence Standards with reservations.4 (x) The extent to which the methods of evaluation will, if well-implemented, produce evidence of promise (as defined in 34 CFR 77.1(c)). (xi) The extent to which the methods of evaluation will provide valid and reliable performance data on relevant outcomes. (xii) The extent to which the evaluation plan clearly articulates the key components, mediators, and outcomes of the grant-supported intervention, as well as a measurable threshold for acceptable implementation. mstockstill on DSK4VPTVN1PROD with (i) Strategy to Scale (1) The Secretary considers the applicant’s strategy to scale the proposed project. (2) In determining the applicant’s capacity to scale the proposed project, the Secretary considers one or more of the following factors: (i) The applicant’s capacity (e.g., in terms of qualified personnel, financial resources, or management capacity) to bring the proposed project to scale on a national or regional level (as defined in 34 CFR 77.1(c)) working directly, or through partners, during the grant period. (ii) The applicant’s capacity (e.g., in terms of qualified personnel, financial resources, or management capacity) to further develop and bring to scale the proposed process, product, strategy, or practice, or to work with others to ensure that the proposed process, product, strategy, or practice can be further developed and brought to scale, based on the findings of the proposed project. (iii) The feasibility of successful replication of the proposed project, if favorable results are obtained, in a variety of settings and with a variety of populations. (iv) The mechanisms the applicant will use to broadly disseminate 3 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 4 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 information on its project so as to support further development or replication. (v) The extent to which the applicant demonstrates there is unmet demand for the process, product, strategy, or practice that will enable the applicant to reach the level of scale that is proposed in the application. (vi) The extent to which the applicant identifies a specific strategy or strategies that address a particular barrier or barriers that prevented the applicant, in the past, from reaching the level of scale that is proposed in the application. 7. Add § 75.266 to subpart D to read as follows: § 75.266 What procedures does the Secretary use if the Secretary decides to give special consideration to applications supported by strong or moderate evidence of effectiveness? (a) As used in this section, ‘‘strong evidence of effectiveness’’ is defined in 34 CFR 77.1(c); (b) As used in this section, ‘‘moderate evidence of effectiveness’’ is defined in 34 CFR 77.1(c); and (c) If the Secretary determines that special consideration of applications supported by strong or moderate evidence of effectiveness is appropriate, the Secretary may establish a separate competition under the procedures in 34 CFR 75.105(c)(3), or provide competitive preference under the procedures in 34 CFR 75.105(c)(2), for applications supported by: (1) Evidence of effectiveness that meets the conditions set out in paragraph (a) of the definition of ‘‘strong evidence of effectiveness’’ in 34 CFR 77.1; (2) Evidence of effectiveness that meets the conditions set out in either paragraph (a) or (b) of the definition of ‘‘strong evidence of effectiveness’’ in 34 CFR 77.1; or (3) Evidence of effectiveness that meets the conditions set out in the definition of ‘‘moderate evidence of effectiveness.’’ (Authority: 20 U.S.C. 1221e–3 and 3474) 8. Revise § 75.250 to read as follows: § 75.250 Maximum funding period. (a) The Secretary may approve a project period to fund the substantive work of a grant and a data collection period to fund data collection, analysis, and reporting related to a grant after the end of the project period. (b) The Secretary may approve a project period of up to 60 months to perform the substantive work of a grant. (1) The Secretary may approve a data collection period for a grant for a period of up to 72 months after the end of the PO 00000 Frm 00013 Fmt 4702 Sfmt 4702 project period and provide funding for the data collection period for the sole purpose of collecting, analyzing, and reporting performance measurement data regarding the project. (2) The Secretary may inform applicants of the Secretary’s intent to approve data collection periods in the application notice published for a competition or may decide to fund data collection periods after grantees have started their project periods. (Authority: 20 U.S.C. 1221e–3 and 3474) 9. Amend § 75.251 by adding a new paragraph (c) to read as follows: § 75.251 Budget Periods. * * * * * (c) If the Secretary funds a multi-year data collection period, the Secretary may fund the data collection period through separate budget periods and fund those budget periods in the same manner as those periods are funded during the project period. 10. Amend § 75.253 by— A. Revising paragraph (a)(2). B. Adding a new paragraph (a)(5). C. Re-designating paragraphs (b) through (e) as paragraphs (c) through (f). D. Adding a new paragraph (b). And E. Revising newly re-designated paragraph (f). The revisions and additions read as follows: § 75.253 Continuation of a multi-year project after the first budget period. (a) * * * (2) The grantee has either— (i) Made substantial progress in achieving— (A) The goals and objectives of the project; and (B) If the Secretary established performance measurement requirements for the grant in the application notice, the performance targets in the grantee’s approved application; or (ii) Obtained the Secretary’s approval for changes to the project that— (A) Do not increase the amount of funds obligated to the project by the Secretary; and (B) Enable the grantee to achieve the goals and objectives of the project and meet the performance targets of the project, if any, without changing the scope or objectives of the project. * * * (5) The grantee has maintained financial and administrative management systems that meet the requirements in 34 CFR 74.21 or 80.20, as appropriate. (b) In deciding whether a grantee has made substantial progress, the Secretary E:\FR\FM\14DEP1.SGM 14DEP1 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules may consider any information relevant to the authorizing statute, a criterion, a priority, or a performance measure, or to a financial or other requirement that applies to the selection of applications for new grants. * * * * * (f) Unless prohibited by the program statute or regulations, a grantee that is in the final budget period of its project period may seek continued assistance for the project as required under the procedures for selecting new projects for grants. 11. Revise § 75.590 to read as follows. § 75.590 Evaluation by the grantee. (a) If the application notice for a competition required applicants to describe how they would evaluate their projects, each grantee under that competition must demonstrate to the Department that— (1) The evaluation meets the standards of the evaluation in the approved application for the project; and (2) The performance measurement data collected by the grantee and used in the evaluation meet the performance measurement requirements of the approved application. (b) If the application notice for a competition did not require applicants to describe how they would evaluate their projects, each grantee must provide information in its performance report demonstrating— (1) The progress made by the grantee in the most recent budget period, including progress based on the performance measurement requirements for the grant, if any; (2) The effectiveness of the grant, including fulfilling the performance measurement requirements of the approved application, if any; and (3) The effect of the project on the participants served by the project, if any. (Authority: 20 U.S.C. 1221e–3 and 3474) 12. Amend § 75.708 by: A. Revising paragraph (a). B. Re-designating paragraph (b) as paragraph (e); and C. Adding new paragraphs (b), (c) and (d). The revision and additions read as follows. mstockstill on DSK4VPTVN1PROD with § 75.708 Subgrants. (a) A grantee may not make a subgrant under a program covered by this part unless authorized by statute or by paragraph (b) of this section. (b) The Secretary may, through an announcement in the Federal Register, authorize subgrants when necessary to VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 meet the purposes of a program. In this announcement, the Secretary will— (1) Designate the types of entities, e.g., State educational agencies, local educational agencies, institutions of higher education, and non-profit organizations, to which subgrants can be awarded; and (2) Indicate whether subgrants can be made to entities identified in an approved application or, without regard to whether the entity is identified in an approved application, have to be selected through a competitive process set out in subgranting procedures established by the grantee. (c) If authorized under paragraph (b) of this section, a subgrant is allowed if it will be used by that entity to directly carry out project activities described in that application. (d) The grantee, in awarding subgrants under paragraph (b) of this section, must— (1) Ensure that subgrants are awarded on the basis of an approved budget that is consistent with the grantee’s approved application and all applicable Federal statutory, regulatory, and other requirements; (2) Ensure that every subgrant includes any conditions required by Federal statute and executive orders and their implementing regulations; and (3) Ensure that subgrantees are aware of requirements imposed upon them by Federal statute and regulation, including the Federal antidiscrimination laws enforced by the Department; and * * * * * PART 77—DEFINITIONS THAT APPLY TO DEPARTMENT REGULATIONS 13. The authority citation for part 77 continues to read as follows: Authority: 20 U.S.C. 1221e–3 and 3474, unless otherwise noted. 14. Amend § 77.1(c) by adding the following definitions in alphabetical order: § 77.1 Definitions that apply to all Department programs. * * * * * (c) * * * Ambitious means promoting continued, meaningful improvement for program participants or for other individuals or entities affected by the grant, or representing a significant advancement in the field of education research, practices, or methodologies. When used to describe a performance target, whether a performance target is ambitious depends upon the context of PO 00000 Frm 00014 Fmt 4702 Sfmt 4702 74405 the relevant performance measure and the baseline for that measure. * * * * * Baseline means the starting point from which performance is measured and targets are set. * * * * * Evidence of promise means there is empirical evidence to support the theoretical linkage(s) between at least one critical component and at least one relevant outcome presented in the logic model for the proposed process, product, strategy, or practice. Specifically, evidence of promise means the conditions in paragraphs (a) and (b) are met: (a) There is at least one study that is a— (1) Correlational study with statistical controls for selection bias; (2) Quasi-experimental study that meets the What Works Clearinghouse Evidence Standards with reservations; 1 or (3) Randomized controlled trial that meets the What Works Clearinghouse Evidence Standards with or without reservations.2 (b) The study referenced in paragraph (a) found a statistically significant or substantively important (defined as a difference of 0.25 standard deviations or larger), favorable association between at least one critical component and one relevant outcome presented in the logic model for the proposed process, product, strategy, or practice. * * * * * Large sample means an analytic sample of 350 or more students (or other single analysis units) who were randomly assigned to a treatment or control group or 50 or more groups (such as classrooms or schools) that contain 10 or more students (or other single analysis units) and that were randomly assigned to a treatment or control group. * * * * * Logic model (also referred to as theory of action) means a well-specified conceptual framework that identifies key components of the proposed process, product, strategy, or practice (i.e., the active ‘‘ingredients’’ that are hypothesized to be critical to achieving the relevant outcomes) and describes the relationships among the key 1 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 2 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid =19. E:\FR\FM\14DEP1.SGM 14DEP1 74406 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules mstockstill on DSK4VPTVN1PROD with components and outcomes, theoretically and operationally. * * * * * Moderate evidence of effectiveness means one of the following conditions is met: (a) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards without reservations,3 found a statistically significant favorable impact on a relevant outcome (with no statistically significant unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), and includes a sample that overlaps with the populations or settings proposed to receive the process, product, strategy, or practice. (b) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards with reservations,4 found a statistically significant favorable impact on a relevant outcome (with no statistically significant unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations or settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample (Note: multiple studies can cumulatively meet the large and multisite sample requirements as long as each study meets the other requirements in this paragraph). * * * * * Multi-site sample means more than one site, where site can be defined as an LEA, locality, or State. * * * * * National level describes the level of scope or effectiveness of a process, product, strategy, or practice that is able to be effective in a wide variety of communities, including rural and urban areas, as well as with different groups (e.g., economically disadvantaged, racial and ethnic groups, migrant populations, individuals with disabilities, English learners, and individuals of each gender). * * * * * Performance measure means any quantitative indicator, statistic, or metric used to gauge program or project performance. * * * * * Performance target means a level of performance that an applicant would seek to meet during the course of a project or as a result of a project. * * * * * Quasi-experimental design study means a study using a design that attempts to approximate an experimental design by identifying a comparison group that is similar to the treatment group in important respects. These studies, depending on design and implementation, can meet What Works Clearinghouse Evidence Standards with reservations 5 (they cannot meet What Works Clearinghouse Evidence Standards without reservations). * * * * * Randomized controlled trial means a study that employs random assignment of, for example, students, teachers, classrooms, schools, or districts to receive the intervention being evaluated (the treatment group) or not to receive the intervention (the control group). The estimated effectiveness of the intervention is the difference between the average outcome for the treatment group and for the control group. These studies, depending on design and implementation, can meet What Works Clearinghouse Evidence Standards without reservations.6 * * * * * Regional level describes the level of scope or effectiveness of a process, product, strategy, or practice that is able to serve a variety of communities within a State or multiple States, including rural and urban areas, as well as with different groups (e.g., economically disadvantaged, racial and ethnic groups, migrant populations, individuals with disabilities, English learners, and individuals of each gender). For an LEAbased project, to be considered a regional-level project, a process, product, strategy, or practice must serve students in more than one LEA, unless the process, product, strategy, or practice is implemented in a State in which the State educational agency is the sole educational agency for all schools. * * * * * Relevant outcome means the student outcome(s) (or the ultimate outcome if not related to students) the proposed process, product, strategy, or practice is designed to improve; consistent with the specific goals of a program. * * * * * Strong evidence of effectiveness means one of the following conditions is met: (a) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards without reservations,7 found a statistically significant favorable impact on a relevant outcome (with no statistically significant unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations and settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample (Note: multiple studies can cumulatively meet the large and multi-site sample requirements as long as each study meets the other requirements in this paragraph). (b) There are at least two studies of the effectiveness of the process, product, strategy, or practice being proposed, each of which: Meets the What Works Clearinghouse Evidence Standards with reservations,8 found a statistically significant favorable impact on a relevant outcome (with no statistically significant unfavorable impacts on that outcome for relevant populations in the studies or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations and settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample. * * * * * 3 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 4 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 5 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 6 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum. aspx?sid=19. 7 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx? sid=19. 8 See What Works Clearinghouse Procedures and Standards Handbook (Version 2.1, September 2011), which can currently be found at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx? sid=19. VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 PO 00000 Frm 00015 Fmt 4702 Sfmt 4702 E:\FR\FM\14DEP1.SGM 14DEP1 Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / Proposed Rules Strong theory means a rationale for the proposed process, product, strategy, or practice that includes a logic model. [FR Doc. 2012–29897 Filed 12–13–12; 8:45 am] BILLING CODE 4000–01–P DEPARTMENT OF EDUCATION 34 CFR Subtitle A Privacy Note: The Department’s policy is to make all comments received from members of the public available for public viewing in their entirety on the Federal eRulemaking Portal at www.regulations.gov. Therefore, commenters should be careful to include in their comments only information that they wish to make publicly available. RIN 1855–AA09 [Docket No. ED 2012–OII–0027] Proposed Priorities, Requirements, Definitions, and Selection Criteria— Investing in Innovation Fund Catalog of Federal Domestic Assistance (CFDA) Numbers: 84.411A, 84.411B, and 84.411C Office of Innovation and Improvement, Department of Education. ACTION: Proposed priorities, requirements, definitions, and selection criteria. AGENCY: SUMMARY: The Assistant Deputy Secretary for Innovation and Improvement proposes priorities, requirements, definitions, and selection criteria under the Investing in Innovation Fund (i3). The Assistant Deputy Secretary may use these priorities, requirements, definitions, and selection criteria for competitions in fiscal year (FY) 2013 and later years. The U.S. Department of Education (Department) has conducted three competitions under the i3 program and awarded 92 i3 grants since the program was established under the American Recovery and Reinvestment Act of 2009 (ARRA). These proposed priorities, requirements, definitions, and selection criteria maintain the overall purpose and structure of the i3 program, which is discussed later in this document, and incorporate changes based on specific lessons learned from the first three competitions. We must receive your comments on or before January 14, 2013. ADDRESSES: Submit your comments through the Federal eRulemaking Portal or via postal mail, commercial delivery, or hand delivery. We will not accept comments by fax or by email. To ensure that we do not receive duplicate copies, please submit your comments only once. In addition, please include the Docket ID at the top of your comments. • Federal eRulemaking Portal: Go to www.regulations.gov to submit your comments electronically. Information on using Regulations.gov, including instructions for accessing agency documents, submitting comments, and mstockstill on DSK4VPTVN1PROD with DATES: VerDate Mar<15>2010 16:21 Dec 13, 2012 Jkt 229001 viewing the docket, is available on the site under ‘‘How to Use This Site.’’ • Postal Mail, Commercial Delivery, or Hand Delivery: If you mail or deliver your comments about these proposed regulations, address them to Carol Lyons, U.S. Department of Education, 400 Maryland Avenue SW., room 4W203, LBJ, Washington, DC 20202– 5930. FOR FURTHER INFORMATION CONTACT: Carol Lyons. Telephone: (202) 453– 7122. Or by email: i3@ed.gov. If you use a telecommunications device for the deaf (TDD) or text telephone (TTY), call the Federal Relay Service (FRS), toll free, at 1–800–877–8339. SUPPLEMENTARY INFORMATION: Invitation to Comment: We invite you to submit comments regarding this notice. To ensure that your comments have maximum effect in developing the notice of final priorities, requirements, definitions, and selection criteria, we urge you to identify clearly the specific proposed priority, requirement, definition, or selection criterion that each comment addresses. We make additional, specific requests for comment in the sections setting out the proposed priorities, requirements, definitions, and selection criteria elsewhere in this notice. We invite you to assist us in complying with the specific requirements of Executive Orders 12866 and 13563 and their overall requirement of reducing regulatory burden that might result from these proposed priorities, requirements, definitions, and selection criteria. Please let us know of any further ways we could reduce potential costs or increase potential benefits while preserving the effective and efficient administration of the program. During and after the comment period, you may inspect all public comments about this notice by accessing Regulations.gov. You may also inspect the comments in person in room 4W335, LBJ, 400 Maryland Avenue SW., Washington, DC, between the hours of 8:30 a.m. and 4:00 p.m., Washington, DC time, Monday through Friday of each week except Federal holidays. Please contact the person listed under FOR FURTHER INFORMATION CONTACT. Assistance to Individuals with Disabilities in Reviewing the PO 00000 Frm 00016 Fmt 4702 Sfmt 4702 74407 Rulemaking Record: On request we will provide an appropriate accommodation or auxiliary aid to an individual with a disability who needs assistance to review the comments or other documents in the public rulemaking record for this notice. If you want to schedule an appointment for this type of accommodation or auxiliary aid, please contact the person listed under FOR FURTHER INFORMATION CONTACT. Purpose of Program: The i3 program addresses two related challenges. First, there are too few practices in education supported by rigorous evidence of effectiveness, despite national attention paid to finding practices that are effective at improving education outcomes in the decade since the establishment of the Department’s Institute of Education Sciences (IES). Second, there are limited incentives to expand effective practices substantially and to use those practices to serve more students across schools, districts, and States. Student achievement suffers as a result. The central innovation of the i3 program, and how it addresses these two challenges, is its multi-tier structure that links the amount of funding that an applicant may receive to the quality of the evidence supporting the efficacy of the proposed project. Applicants proposing practices supported by limited evidence can receive small grants that support the development and initial evaluation of promising practices and help to identify new solutions to pressing challenges; applicants proposing practices supported by evidence from rigorous evaluations, such as large randomized controlled trials, can receive sizable grants to support expansion across the Nation. This structure provides incentives for applicants to build evidence of effectiveness of their proposed projects and to address the barriers to serving more students across schools, districts, and States so that applicants can compete for more sizeable grants. As importantly, all i3 projects are required to generate additional evidence of effectiveness. All i3 grantees must use part of their budgets to conduct independent evaluations (as defined in this notice) of their projects. This ensures that projects funded under the i3 program contribute significantly to improving the information available to practitioners and policymakers about which practices work, for which types of students, and in which contexts. Program Authority: American Recovery and Reinvestment Act of 2009 (ARRA), Division A, Section 14007, Pub. L. 111–5. E:\FR\FM\14DEP1.SGM 14DEP1

Agencies

[Federal Register Volume 77, Number 241 (Friday, December 14, 2012)]
[Proposed Rules]
[Pages 74392-74407]
From the Federal Register Online via the Government Printing Office [www.gpo.gov]
[FR Doc No: 2012-29897]


========================================================================
Proposed Rules
                                                Federal Register
________________________________________________________________________

This section of the FEDERAL REGISTER contains notices to the public of 
the proposed issuance of rules and regulations. The purpose of these 
notices is to give interested persons an opportunity to participate in 
the rule making prior to the adoption of the final rules.

========================================================================


Federal Register / Vol. 77, No. 241 / Friday, December 14, 2012 / 
Proposed Rules

[[Page 74392]]



DEPARTMENT OF EDUCATION

34 CFR Parts 75 and 77

RIN 1890-AA14
[Docket ID ED-2012-OII-0026]


Direct Grant Programs and Definitions That Apply to Department 
Regulations

AGENCY: Department of Education.

ACTION: Notice of proposed rulemaking.

-----------------------------------------------------------------------

SUMMARY: The Secretary proposes to amend the regulations in 34 CFR 
parts 75 and 77 of the Education Department General Administrative 
Regulations (EDGAR) in order to improve the Department's ability to 
promote projects supported by evidence; evaluate the performance of 
discretionary grant programs and grantee projects; review grant 
applications using selection factors that promote reform objectives 
related to project evaluation, sustainability, productivity, and 
capacity to scale; and reduce burden on grantees in selecting 
implementation sites, implementation partners, or evaluation service 
providers for their proposed projects. These proposed changes would 
allow the Department to be more effective and efficient when selecting 
discretionary grantees, provide higher-quality data to Congress and the 
public, and better focus applicants on the particular goals and 
objectives of the programs to which they apply for grants.

DATES: We must receive your comments on or before February 12, 2013.

ADDRESSES: Submit your comments through the Federal eRulemaking Portal 
or via postal mail, commercial delivery, or hand delivery. We will not 
accept comments by fax or by email. Please submit your comments only 
one time, in order to ensure that we do not receive duplicate copies. 
In addition, please include the Docket ID at the top of your comments.
     Federal eRulemaking Portal: Go to https://www.regulations.gov to submit your comments electronically. Information 
on using Regulations.gov, including instructions for accessing agency 
documents, submitting comments, and viewing the docket, is available on 
the site under ``How To Use This Site.''
     Postal Mail, Commercial Delivery, or Hand Delivery. If you 
mail or deliver your comments about these proposed regulations, address 
them to Margo Anderson, U.S. Department of Education, 400 Maryland 
Avenue SW., Room 4W313, Washington, DC 20202-5900.

    Privacy Note: The Department's policy for comments received from 
members of the public is to make these submissions available for 
public viewing in their entirety on the Federal eRulemaking Portal 
at www.regulations.gov. Therefore, commenters should be careful to 
include in their comments only information that they wish to make 
publicly available.


FOR FURTHER INFORMATION CONTACT: Erin McHugh, U.S. Department of 
Education, 400 Maryland Avenue SW., Room 4W319, Washington, DC 20202. 
Telephone: (202) 401-1304 or by email: erin.mchugh@ed.gov.
    If you use a telecommunications device for the deaf (TDD) or text 
telephone (TTY), call the Federal Relay Service (FRS) toll free at 1-
800-877-8339.

SUPPLEMENTARY INFORMATION:

Invitation to Comment on Proposed Regulations

    We invite you to submit comments regarding these proposed 
regulations. To ensure that your comments have maximum effect in 
developing the final regulations, we urge you to identify clearly the 
specific section or sections of the proposed regulations that each of 
your comments addresses and to arrange your comments in the same order 
as the proposed regulations.
    We invite you to assist us in complying with the specific 
requirements of Executive Order 12866 and 13563 and their overall 
requirement of reducing regulatory burden that might result from these 
proposed regulations. Please let us know of any ways we could reduce 
potential costs or increase potential benefits while preserving the 
effective and efficient administration of the Department's programs and 
activities.
    Because Executive Order 12866 and the presidential memorandum on 
``Plain Language in Government Writing'' require each agency to write 
regulations that are easy to understand, we invite you to comment on 
how to make these proposed regulations easier to understand, including 
answers to questions such as the following:
     Are the requirements in the proposed regulations clearly 
stated?
     Do the proposed regulations contain technical terms or 
other wording that interferes with their clarity?
     Does the format of the proposed regulations (grouping and 
order of sections, use of headings, paragraphing, etc.) aid or reduce 
their clarity?
     Would the proposed regulations be easier to understand if 
we divided them into more (but shorter) sections? (A ``section'' is 
preceded by the symbol ``Sec.  '' and a numbered heading; for example, 
Sec.  75.210 General selection criteria.
     Could the description of the proposed regulations in this 
preamble be more helpful in making the proposed regulations easier to 
understand? If so, how?
     What else could we do to make the proposed regulations 
easier to understand?

Retrospective Review of EDGAR

    On January 21, 2011, President Obama issued Executive Order 13563, 
``Improving Regulation and Regulatory Review'' (76 FR 3821). The order 
requires all Federal agencies to ``consider how best to promote 
retrospective analysis of rules that may be outmoded, ineffective, 
insufficient, or excessively burdensome, and to modify, streamline, 
expand, or repeal them in accordance with what has been learned.'' 
Accordingly, on August 22, 2011, the Department issued its Plan for 
Retrospective Analysis of Existing Regulations. (See ed.gov/policy/gen/reg/retrospective-analysis/).
    Our plan identified a number of regulatory initiatives for 
retrospective review and analysis. One of those initiatives, already 
begun in 2010, was a review of the Department's discretionary grants 
process. Part of that initiative was a close retrospective review of 
the Education Department General Administrative Regulations (EDGAR), 
which govern discretionary grantmaking and administration.
    As part of this retrospective review of EDGAR, we identified key 
provisions that required substantive changes to improve transparency 
and the efficiency and effectiveness of our grant-making

[[Page 74393]]

functions. These included our regulations on establishing and 
collecting data on measures of grantee performance, the selection 
criteria that peer reviewers use to evaluate applications, and the 
procedures grantees must use to select research sites and evaluators. 
This notice is the result of the Department's regulatory review of 
those provisions.
    On May 10, 2012, President Obama issued Executive Order 13610, 
``Identifying and Reducing Regulatory Burdens.'' (77 FR 28469). Among 
other things and as part of their retrospective review, this order 
requires Federal agencies to invite ``public suggestions about 
regulations in need of retrospective review and about appropriate 
modifications to such regulations.''
    Therefore, in addition to your comments on the specific regulations 
proposed in this notice, we seek input on other regulations within 
EDGAR that may be in need of modification and amendments to those 
regulations that you would suggest. We are particularly interested in 
your feedback on the following questions:
     Are the regulations achieving their intended outcomes, 
e.g., do they establish a fair and equitable process for selecting 
applications for funding while ensuring transparency in the selection 
process and enhancing accountability for funding decisions?
     Have changes in the economy or other external factors led 
to an increase or decrease in costs imposed on applicants for, and 
recipients of, discretionary grants?
     Are any of the regulations outmoded, unnecessary, or out 
of date?
     Do the regulations cause confusion or create other 
questions? If so, how could we amend the regulations to address this 
problem?
     What do relevant data show about the effectiveness and 
benefits of the regulations in comparison to their costs?
    Although the Department may or may not respond to comments that we 
receive on the retrospective review of these other provisions of EDGAR, 
we will use that feedback to further inform and plan our retrospective 
review efforts.
    During and after the comment period, you may inspect all public 
comments about these proposed regulations by accessing Regulations.gov. 
You may also inspect the comments, in person, in Room 4W335, 400 
Maryland Avenue SW., Washington, DC, between the hours of 8:30 a.m. and 
4:00 p.m., Washington, DC time, Monday through Friday of each week 
except Federal holidays. Please contact the person listed under FOR 
FURTHER INFORMATION CONTACT.

Assistance to Individuals With Disabilities in Reviewing the Rulemaking 
Record

    On request, we will provide an appropriate accommodation or 
auxiliary aid to an individual with a disability who needs assistance 
to review the comments or other documents in the public rulemaking 
record for these proposed regulations. If you want to schedule an 
appointment for this type of aid, please contact the person listed 
under FOR FURTHER INFORMATION CONTACT.

Summary of Proposed Changes

    In this notice, the Secretary proposes amendments that would:
    1. Allow the Secretary, in an application notice for a competition, 
to establish performance measurement requirements;
    2. Revise requirements regarding project evaluations submitted to 
the Department by grantees;
    3. Authorize applicants to use simplified procurement procedures to 
select implementation sites and procure services from implementation 
and evaluation service providers, but only if the site or service 
provider is named in the grant application;
    4. Allow the Secretary, through an announcement in the Federal 
Register, to authorize grantees under particular programs to award 
subgrants to directly carry out programmatic activities. The 
subgrantees and programmatic activities must be identified and 
described in the grantees' applications;
    5. Add one new selection criterion and revise two existing criteria 
that the Department could choose to use to evaluate applications. The 
new criterion would be used to assess the extent to which a proposed 
project could be brought to scale. We would add five new factors to the 
criterion ``Quality of the Project Evaluation'' that could be used to 
assess how well a proposed project evaluation would produce evidence 
about the project's effectiveness. Finally, we would revise one factor 
and add five new factors to the criterion ``Quality of the Project 
Design'';
    6. Authorize program offices to consider the effectiveness of 
proposed projects under a new priority that could be used as either an 
absolute, competitive preference, or invitational priority; and
    7. Allow the Secretary to fund data collection periods after the 
end of the substantive work of a project so that project outcomes could 
be assessed using data from the entire project period.
    As discussed in more detail later in this notice, the proposed 
changes would strengthen the Secretary's authority to: (a) Evaluate 
grantee performance; (b) provide applicants and grantees with greater 
flexibility in selecting implementation sites, implementation partners, 
and evaluation service providers; (c) allow the Secretary to authorize 
subgrants for particular programs; (d) improve the targeting of 
selection criteria and factors so that applicants are better informed 
and able to focus their application narratives on specific program 
objectives; and (e) allow consideration of the strength of evidence 
supporting the proposed project when evaluating grant applications.

Significant Proposed Regulations

    We group major issues according to subject, with appropriate 
sections of the proposed regulations referenced in parentheses. We 
discuss other substantive issues under the sections of the proposed 
regulations to which they pertain.
    Generally, we do not address proposed regulatory provisions that 
are technical or otherwise minor in effect.

I. Performance Measurement

Background

    Congress passed the Government Performance and Results Act of 1993 
(GPRA) (Pub. L. 103-62) in order to hold Federal agencies accountable 
for achieving program results. Under GPRA, agencies are required to 
report to Congress on the effectiveness of the programs they 
administer, based on performance measures established for those 
programs.
    The purposes of GPRA are to improve Federal program effectiveness 
and accountability to the public by: Focusing on results, service 
quality, and customer satisfaction; giving Federal program managers 
information about program results and service quality; and providing 
objective information to Congress and the public on the relative 
effectiveness and efficiency of Federal programs and spending. The GPRA 
Modernization Act of 2010 (Pub. L. 111-352) supports additional 
improvements in Federal agencies' performance planning and reporting. 
Federal agencies are required to make their strategic and annual plans 
publicly available and post quarterly updates via a central, 
Government-wide Web site. The goal of the GPRA Modernization Act is to 
improve the use of data in

[[Page 74394]]

policy, budget, and management decision-making.
    GPRA requires Federal agencies to establish performance measures 
and targets for programs they administer and to report annually to the 
Office of Management and Budget (OMB) on the extent to which those 
programs are meeting their targets. For discretionary (non-formula) 
grant programs, the Department establishes performance measures to 
address the extent to which the program as a whole is effective in 
achieving its goals through the projects it funds. However, we have 
found that grantees' performance data do not consistently correspond to 
overall program performance measures because grantees typically only 
report on and measure data related to project-specific outcomes.
    The Secretary therefore proposes the following amendments to 
improve the Department's ability to collect reliable, valid, and 
meaningful data for evaluating the outcomes of Department programs and 
the performance of individual grantees.

Proposed Regulatory Changes

34 CFR Part 75

Section 75.110 Information Regarding Performance Measurement
    Current Regulations: None.
    Proposed Regulations: Proposed Sec.  75.110 would allow the 
Secretary to establish performance measurement requirements in an 
application notice for a competition. These requirements could include 
performance measures, baseline data, performance targets, and 
performance data. This proposed section would also allow the Secretary 
to establish in an application notice a requirement that applicants 
propose performance measures for their projects, as well as the 
baseline data and performance targets for each proposed measure.
    Reasons: To improve the likelihood that grantees collect and report 
data that effectively measure the outcomes of each grant, the proposed 
amendments would allow the Secretary to require discretionary grant 
applicants to include program-level and project-specific performance 
measures, baseline data, and targets in their applications. Requiring 
this information improves the ability of the Department to measure 
program effectiveness under GPRA performance measures, clarifies that 
grantees will be required to report on their project-specific 
performance measures, and stresses that the extent to which grantees 
meet performance targets will be considered in making continuation 
grants.

II. Procurement and Subgrant Processes for Entities Named in 
Applications

Proposed Regulatory Changes

34 CFR Part 75
    Background:
    From our experience, many applicants find it useful to describe 
elements of their proposed evaluations in their applications, including 
implementation sites or the provider that would conduct the project 
evaluation should the proposed project be funded. This information is 
often an important factor in the Department's peer review of 
discretionary grant applications, particularly in instances when the 
quality of the project evaluation is a selection criterion.
    The Department's procurement regulations in 34 CFR 74.43 and 34 CFR 
80.36(c) provide that a grantee must conduct its procurement 
transactions in a manner that provides, to the maximum extent 
practical, full and open competition. This requirement is intended to 
ensure that grantees consider contractor performance objectively and 
offer an opportunity for providers to compete for the contract. While 
the Department values full and open competition, the Department also 
recognizes that this requirement presents challenges for applicants 
whose applications would be strengthened by including details about the 
implementation sites and the evaluation service provider. The Secretary 
proposes to reduce this burden by simplifying the procurement process 
used to select implementation sites, implementation partners, and 
evaluation service providers.
Section 75.135 Competition Exception for Implementation Sites, 
Implementation Partners, or Evaluation Service Providers
    Current Regulations: There is no current Sec.  75.135. The 
Department's procurement regulations in 34 CFR 74.43 and 34 CFR 
80.36(c) provide that a grantee must conduct its procurement 
transactions in a manner that provides full and open competition. In 
many cases, grantees must use formal competition procedures to select 
contractors. Under these current provisions, an applicant for a grant 
requiring an evaluation would need, in many cases, to conduct a formal 
bidding process to select implementation sites, implementation 
partners, or evaluation service providers before submitting its 
application to the Department or following award of the grant. These 
types of procurement requirements can be very costly and time consuming 
at a time when the applicant cannot be sure it will be selected for a 
grant. Because the selection of implementation sites or partners and 
evaluation service providers is often an important factor in designing 
a project and submitting a high-quality application, we propose an 
exception to the Department's procurement regulations for entities 
named in a grant application.
    Proposed Regulations: The Secretary proposes to add a new Sec.  
75.135 that would exempt certain applicants from the full competitive 
contracting requirements in 34 CFR 74.43 and 80.36(c). Specifically, an 
applicant for a grant that must be conducted at multiple sites or that 
requires an external evaluation would not be required to comply with 
the applicable formal competition requirements in 34 CFR 74.43 and 
80.36(c) when entering into a contract if--
    (1) The contract is with an entity that agrees to provide a site or 
sites where the applicant would conduct the project activities under 
the grant or the contract is with the evaluation service provider that 
would conduct the project evaluation;
    (2) The implementation sites, implementation partners, or 
evaluation service providers are identified in the application for the 
grant; and
    (3) The implementation sites, implementation partners, or 
evaluation service providers are included in the application in order 
to meet a regulatory, statutory, or priority requirement related to the 
competition.
    A successful applicant would need to certify that any employee, 
officer, or agent participating in the selection, award, or 
administration of a contract is free of any real or apparent conflict 
of interest.
    In the case of a contract for a provider to conduct the project 
evaluation, the proposed amendment would permit the applicant or 
grantee to use the informal competition requirements for small 
purchases that are currently applicable only to governments under 34 
CFR 80.36(d)(1), regardless of whether the applicant or grantee is a 
government entity and regardless of whether the purchase meets the 
small purchase threshold.
    During the course of the grant, a successful applicant would be 
required to obtain the Department's permission to change any 
implementation site, implementation partner, or evaluation service 
provider that the applicant specified in the application and selected 
under proposed Sec.  75.135. The exception also would not relieve an 
applicant of the obligation to conduct an informal review of evaluation 
service providers

[[Page 74395]]

in order to determine the best available provider or from its 
obligations under the Department's other procurement requirements.
    A successful applicant that does not meet the three criteria above 
would not be exempt from complying with the applicable formal 
competition requirements in 34 CFR 74.43 and 80.36(c) when entering 
into a contract. For example, an applicant that does not identify its 
implementation sites, implementation partners, or evaluation service 
provider in its application would be required to comply with the 
applicable formal competition requirements in 34 CFR 74.43 and 
80.36(c).
    Reasons: This proposed new section addresses a difficulty many 
applicants face when selecting implementation sites, partners, and 
evaluation service providers prior to submitting their applications. 
Requiring grantees to use formal competitive procedures to select 
implementation sites and partners could significantly diminish both the 
ability of many applicants to compete for grants and the quality of 
project evaluations. For example, without this proposed regulation, a 
successful applicant would be limited in its ability to select 
implementation sites that include specific populations that it proposed 
to serve through the project or to work with the evaluation service 
provider that assisted in designing the applicant's evaluation plan.
    Formal competition requirements also inhibit the ability of many 
applicants to select evaluators who would work with the applicants to 
design project evaluation plans. Some of the best evaluations of 
projects may be conducted by evaluation service providers that are 
involved in the initial design of a project. Such work generally takes 
place during the development of an application, before the applicant 
knows whether it will receive a grant. Thus, requiring an applicant to 
hold a formal competition involving sealed bids or competitive 
proposals in order to select an evaluation service provider (either 
before or after it receives a grant) can have major negative 
consequences. For example, an evaluation service provider would be 
excluded from the competition to select the project evaluator under the 
procurement requirements in parts 74 and 80 if it helped prepare an 
application and helped the applicant set up the standards used to 
select an evaluation service provider or contractor (see 34 CFR 74.42, 
74.43, and 80.36). High-quality evaluation of a project funded by the 
Department may be hindered if an evaluation service provider that 
designed the evaluation strategy for an application is excluded from 
the evaluation procurement competition for that project. Given the 
uncertainty of the competitive process, the Secretary also believes 
that applicants should not be required to use formal competition 
procedures to select an evaluation service provider at the time they 
prepare their applications.
    While the Secretary proposes to remove the competition requirement 
for selecting sites and implementation partners and thus permit 
applicants and grantees to use informal procedures instead, the 
Secretary would continue to require all applicants to comply with the 
other procurement requirements in parts CFR 74 and 80, including the 
requirements for cost price analysis, standards of conduct, conflicts 
of interest, and the prohibition of contingent payment for services. 
Additionally, the proposed amendment does not supersede any State laws 
regarding procurement.
    Finally, based on the other procurement requirements in CFR parts 
74 and 80, these exceptions would not relieve an applicant of its 
responsibility to document that it made genuine efforts to select the 
best implementation sites, implementation partners, or evaluation 
service providers for the project, considering qualifications, 
capabilities, availability, price, and other important factors.
Sec.  75.708 Prohibition on Subgrants.
    Current Regulations: Section 75.708(a) prohibits grantees from 
awarding subgrants unless specifically authorized by statute.
    Proposed Regulations: The Secretary proposes to revise the 
prohibition on subgrants in Sec.  75.708(a) to allow subgrants when 
authorized by statute or as provided for by a new Sec.  75.708(b). 
Under this proposed new Sec.  75.708(b), the Secretary could, through 
an announcement in the Federal Register, authorize subgrants when 
necessary to meet the purposes of a particular program. In addition, 
the Federal Register announcement would identify the types of entities 
(e.g., State or local educational agencies, institutions of higher 
education, or non-profit organizations) that could receive subgrants 
under the program.
    We would add Sec.  75.708(c) to provide that subgrants, if 
authorized under Sec.  75.708(b), could be awarded to entities 
identified in a grantee's application. The subgrant must be used to 
directly carry out activities described in the application.
    We would add a new Sec.  75.708(d), which would establish 
requirements grantees would have to follow in awarding subgrants 
authorized under Sec.  75.708(b). We would re-designate the current 
Sec.  75.708(b) as Sec.  75.708(e).
    Reasons: The revision of Sec.  75.708(a) is necessary to provide 
grantees with flexibility to work with partners or other entities to 
carry out project activities. The prohibition on subgrants, in 
conjunction with the requirement on full and open competition for 
procurement transactions in 34 CFR 74.43 and 34 CFR 80.36(c), unduly 
restricts grantees from working with partners or other entities 
identified in their applications as being directly responsible for 
carrying out project-related activities.
    In order to ensure appropriate subgranting by Department grantees, 
our proposed revision authorizes subgrants only when approved by the 
Secretary for a particular program and only to the types of entities 
(e.g., State or local educational agencies, institutions of higher 
education, or non-profit organizations) designated by the Secretary. In 
addition the proposed revision would limit the entities that may 
receive subgrants to those that: (1) Are identified in a grantee's 
application, or (2) are competitively selected using the grantee's 
procedures for selecting subgrants and, (3) will use the subgrant 
directly to carry out project activities described in the grantee's 
application. In all cases where a grantee is working with an 
organization or entity that is not identified in its application, not 
selected through a competitive process, or not an organization or 
entity directly responsible for carrying out an activity or activities 
described in the grantee's application, the grantee would be required 
to follow the procurement procedures set out in 34 CFR Parts 74 and 80. 
Additionally, the grantee--as the fiscal agent--would remain 
responsible to the Department for the proper use of all grant funds, 
including those subgranted to another entity.
    In addition, we would add a new Sec.  75.708(d) requiring grantees 
to ensure that: (1) Subgrants are awarded on the basis of an approved 
budget that is consistent with the grantee's approved application and 
all applicable Federal statutory, regulatory, and other requirements; 
(2) subgrants include all conditions required by Federal law; and (3) 
subgrantees are aware of requirements imposed upon them by Federal law, 
including the Federal anti-discrimination laws enforced by the 
Department.
    This revision provides grantees, in programs and to entities 
designated by the Secretary, with the flexibility to award subgrants in 
specific

[[Page 74396]]

circumstances where necessary to ensure proper implementation of an 
approved project without diminishing accountability for Federal funds 
or project outcomes.

III. Selection Criteria

Background

    The regulations in subpart D of 34 CFR part 75 set forth the 
general requirements that govern the Department's selection of grantees 
for direct grant awards. For those direct grant programs that make 
discretionary grant awards, the Secretary uses selection criteria to 
evaluate applications submitted under those programs. The regulations 
specify certain selection criteria from which the Secretary may choose 
(general EDGAR criteria). They allow the Secretary to use program-
specific selection criteria and the general EDGAR selection criteria, 
as well as to develop other criteria based on the statutory provisions 
for the funding program. However, some program regulations currently do 
not provide that the Secretary may use program-specific selection 
criteria in conjunction with EDGAR and statutory criteria. The 
regulations also describe how the Secretary determines which criteria 
and which factors within those criteria are used in a particular 
competition and how the Secretary may weight the criteria and factors.
    As we have managed competitions under the general regulations 
governing selection criteria, we have found that some of the 
regulations on the selection of grantees do not provide the Department 
the discretion it needs, absent a lengthy rulemaking process, to 
conduct grant competitions closely aligned with Department, 
legislative, and program objectives and priorities that can change from 
year to year in response to new and unanticipated circumstances. These 
proposed regulations, therefore, would provide the Department 
additional flexibility to establish criteria based on program 
regulations, in addition to the current authority to base criteria on 
statutory provisions. The proposed regulations would also specifically 
authorize program offices to establish additional selection criteria in 
Sec.  75.210 based on statutory and regulatory provisions.
    These proposed regulations would also add new selection factors 
under the ``Quality of Project Design'' criterion on organizational and 
programmatic sustainability and organizational productivity. The 
proposed regulations would also add to the ``Quality of the Project 
Evaluation'' criterion five new selection factors on the types of 
evidence the evaluation designs would produce on the performance and 
implementation of the project. Finally, the proposed regulations would 
establish a new criterion to evaluate the extent to which an applicant 
proposes a project that could be brought to scale.
    The addition of these selection factors would ensure that the 
Department's discretionary grant programs would more effectively 
promote the development and implementation of effective and sustainable 
practices, and support adoption and implementation of necessary 
reforms. These proposed regulations would not change the way the 
Secretary uses the current and new selection criteria and factors. The 
Secretary would continue to use those selection criteria and factors 
that are consistent with the purpose of the program and permitted under 
the applicable statutes and regulations.

Proposed Regulatory Changes

34 CFR Part 75

Section 75.209 Selection Criteria Based on Statutory or Regulatory 
Provisions
    Current Regulations: Current Sec.  75.209 provides that the 
Secretary may evaluate applications by establishing selection criteria 
based on the statutory provisions for the authorized program. These 
provisions include, but are not limited to, those related to specific 
statutory selection criteria, allowable activities, application content 
requirements, and other pre-award and post-award conditions.
    Proposed Regulations: We propose to revise Sec.  75.209 to allow 
the Secretary to use selection criteria, the factors in program 
regulations, and those based on program statute, along with the 
selection criteria in Sec.  75.210 (often referred to as the EDGAR 
selection criteria) to produce more focused selection criteria. Thus, 
Sec.  75.209 would allow the Secretary to establish selection criteria, 
and factors for considering those criteria, based on statutory or 
regulatory provisions that apply to the authorized program, which may 
include, but are not limited to, criteria and factors that reflect:
     Criteria contained in the program statute or regulations;
     Criteria in Sec.  75.210;
     Allowable activities specified in the program statute or 
regulations;
     Application content requirements specified in the program 
statute or regulations;
     Program purposes, as described in the program statute or 
regulations; or
     Other pre-award and post-award conditions specified in the 
program statute or regulations.
    Reasons: The Secretary proposes amending this section so that the 
Department can establish selection criteria based both on a program's 
statute and regulations. Program regulations are used to help clarify 
and fill in the gaps of more general statutory requirements and provide 
further detail about authorized activities for a program.
    Under this proposed amendment, the Secretary would be able to use 
the more specific regulatory provisions to establish selection criteria 
that are focused more closely on the intended outcomes of the 
competition and, thereby, help applicants to structure their 
applications so as to more accurately and concisely describe how they 
will achieve those outcomes. In addition to providing for establishment 
of criteria based on program regulations, this amendment would allow 
the Secretary to use a combination of criteria from the program 
statute, its established regulations, or the general selection criteria 
in Sec.  75.210.


Sec.  75.210  General Selection Criteria

    Current Regulations: Current Sec.  75.210 contains a list of eight 
selection criteria: ``Need for Project'' in paragraph (a); 
``Significance'' in paragraph (b); ``Quality of the Project Design'' in 
paragraph (c); ``Quality of Project Services'' in paragraph (d); 
``Quality of Project Personnel'' in paragraph (e); ``Adequacy of 
Resources'' in paragraph (f); ``Quality of the Management Plan'' in 
paragraph (g); and ``Quality of the Project Evaluation'' in paragraph 
(h). Under each of these selection criteria, the Secretary may select 
from a number of factors to focus each criterion.
    Proposed Regulations: The Secretary proposes to revise the 
introductory paragraph of Sec.  75.210, add selection factors to the 
criteria in Sec.  75.210(c) and (h), and add a new criterion as 
paragraph (i) to address the ability of an applicant to bring a project 
to scale.
    Introductory Text: We propose to amend the introductory paragraph 
of Sec.  75.210 so that the Secretary may select factors that could be 
considered under a criterion both from the factors listed under that 
criterion and factors listed under other criteria. For example, the 
proposed amendment would allow the Secretary to establish ``Quality of 
the Project Design'' as a selection criterion and include selection 
factors from ``Need for Project'' (Sec.  75.210(a)) or ``Significance'' 
(Sec.  75.210(b)) in the factors that will be considered under the 
``Quality of the Project Design''

[[Page 74397]]

criterion. Currently, to use a single selection factor under the ``Need 
for Project'' criterion, the Department, in most cases, would need to 
include the ``Need for Project'' criterion, even if the factor in 
question could be appropriately grouped with factors from another 
selection criterion, such as ``Significance.''
    Reasons: The purpose of this amendment is to provide the Secretary 
with the flexibility to choose and combine selection factors 
established in Sec.  75.210 under various selection criteria. This 
would enable the Department to align the selection criteria and factors 
with the goals and objectives of a particular discretionary grant 
competition in a more coherent and effective fashion than is currently 
permitted. Selection criteria and factors that are concise and are 
aligned as closely as possible with the goals and objectives of a 
particular grant competition would more effectively guide applicants in 
preparing clearer and more focused applications that in turn can be 
more effectively evaluated and rated by peer reviewers. The current 
regulations, by contrast, do not allow this close focus. Including a 
greater number of selection criteria in application notices, solely to 
include particular selection factors, makes it more likely that 
applications will be less focused and more difficult for peer reviewers 
to accurately evaluate and score.
    Current Regulations: Section 75.210(c) establishes the selection 
criterion ``Quality of the Project Design.'' The Secretary may consider 
one or more of the 23 factors listed under this criterion in 
determining the quality of the project design, including the extent to 
which the project design will build capacity that extends beyond the 
project period and establish linkages to services provided by other 
programs.
    Proposed Regulations: The Secretary proposes to add new factors to 
the criterion in paragraph (c), (xxiv and xxv) relating to the 
sustainability of the proposed project after the end of the project 
period.
    Reasons: Adding these selection factors would help ensure that the 
Department's discretionary grant programs effectively promote the 
development and implementation of effective and sustainable practices 
and support adoption and implementation of necessary reforms. By 
promoting the development of a multi-year plan for incorporation into 
the applicant's ongoing work, the proposed factors would better 
encourage applicants to develop sustainability plans than do the 
related selection factors in current Sec.  75.210(c). The proposed 
factors also would allow the Secretary to consider a proposed project's 
potential for sustainability over time, including the extent to which 
the project has the support of various stakeholders and adequate 
resources to continue the project after the grant period ends.
    Proposed Regulations: The Secretary proposes to revise Sec.  
75.210(c) to add a new selection factor (xxvi) regarding the extent to 
which the proposed project will increase efficiency in the use of time, 
staff, money, or other resources in order to improve results and 
increase productivity.
    Reasons: Current Sec.  75.210(c) does not include a factor that 
promotes increased productivity. Considering the budget challenges that 
State and local educational agencies, institutions of higher education, 
non-profit organizations, and other entities working in education face 
during economic downturns, and given the potential for new knowledge 
and capabilities to improve efficiency, the Department believes that it 
is appropriate to consider the potential for increasing productivity, 
i.e., the extent to which a proposed project includes a strategy to 
make more efficient use of time, money, and staff, when assessing an 
application.
    Proposed Regulations: The Secretary proposes to revise Sec.  
75.210(c)(xvi) to read ``The extent to which the proposed project will 
integrate with or build on similar or related efforts to improve 
relevant outcomes, using existing funding streams from other programs 
or policies supported by community, State, and Federal resources.''
    In addition, the Secretary proposes to add a new selection factor 
(xxvii) regarding the extent to which the proposed project will 
integrate with or build on similar or related efforts in order to 
improve relevant outcomes, using nonpublic funds or resources.
    Reasons: Given the budget challenges facing State and local 
educational agencies, institutions of higher education, and other 
entities working in education, there is a need for strategies and 
practices to improve relevant outcomes while controlling costs. 
Moreover, ``silos'' within and between agencies at the local, State, 
and Federal levels often impede program integration and result in less 
efficient and effective efforts. The purpose of revising this selection 
factor and adding a factor focused on nonpublic investments is to 
improve levels of program integration, to facilitate shared agendas for 
actions focused on common outcomes, and to leverage public and private 
sector investments in education. In addition, the Department believes 
that leveraging existing programs and policies that are supported by 
other funds, including other Federal, State, local, or private funds, 
increases the likelihood that selected projects will be sustained 
beyond the grant period.
    Proposed Regulations: The Secretary proposes to add two new 
selection factors (xxviii and xxix) regarding the extent to which the 
proposed project is supported by evidence of promise or strong theory. 
Later in this notice, we propose adding definitions to Part 77, 
including evidence of promise, strong theory, and other terms to ensure 
consistent understanding of the selection factors we propose in this 
notice.
    Reasons: The Department recognizes that at the various stages of a 
proposed project's development, different types of evidence are 
available to assess the effectiveness of a project. The proposed 
selection factors would permit the Secretary to use strength of 
evidence as a selection factor in determining the projects the 
Department will fund while maintaining the flexibility to consider a 
wider variety of studies or data an applicant might present that is 
appropriate to the goals of the project. The flexibility provided by 
the proposed selection factor would be particularly beneficial for 
innovative areas where strong or moderate evidence of effectiveness is 
not yet available because it would allow the Secretary to consider 
strength of evidence appropriate to a project's stage of development.
    Current Regulations: Section 75.210(h) establishes the selection 
criterion ``Quality of the Project Evaluation.'' The Secretary may 
consider one or more of the seven factors listed under this criterion 
in determining the quality of the project evaluation design, such as 
the extent to which the project proposes feasible and appropriate 
evaluation methods, uses objective performance measures, and permits 
periodic assessment.
    Proposed Regulations: The Secretary proposes to revise Sec.  
75.210(h) to add five new selection factors. Two of the new selection 
factors address the extent to which the methods of evaluation will, if 
well-implemented, produce evidence about the project's effectiveness 
that would meet the What Works Clearinghouse Evidence Standards.\1\ The 
other three proposed selection factors address the extent to which the 
methods of evaluation will produce

[[Page 74398]]

evidence of promise about the grant-supported intervention, valid and 
reliable performance data on relevant outcomes of the project, and the 
extent to which the evaluation plan articulates key components as well 
as measureable thresholds for acceptable implementation of the project.
---------------------------------------------------------------------------

    \1\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    Reasons: Although current Sec.  75.210(h) includes selection 
factors regarding proposed evaluation methods, it does not include a 
selection factor that promotes use of the strongest possible study 
designs for estimating a program's effect or a selection factor that 
assesses the extent to which the proposed evaluation will articulate 
information that can be used to assess whether the project was 
implemented with fidelity.
    Linking two of the proposed new selection factors to the What Works 
Clearinghouse Evidence Standards \2\ reflects the predominant view 
among research experts that the randomized controlled trial (also 
referred to as an experimental design study) is the most rigorous and 
defensible method for producing unbiased evidence of project 
effectiveness. Random assignment of entities (students, teachers, 
schools, or other units of analysis) to a treatment or control group is 
the most effective way to eliminate plausible competing explanations 
for observed differences between treated and non-treated individuals or 
groups (i.e., the estimated treatment effect). Adding these selection 
factors will allow the Secretary to consider the extent to which 
applicants propose evaluations that will contribute to a strong body of 
evidence on the effectiveness of the proposed project.
---------------------------------------------------------------------------

    \2\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    Additionally, the other three proposed selection factors allow the 
Secretary to consider evaluation methods that will produce data on a 
project's evidence of promise, performance on relevant outcomes, and 
fidelity of implementation. Each of these factors would improve the 
Department's ability to assess evaluation plans for projects at various 
stages of their development.
    Current Regulations: None.
    Proposed Regulations: The Secretary proposes to add selection 
criterion Sec.  75.210(i), ``Strategy to Scale.'' ``Scale'' refers to 
expanding the use or implementation of a proposed practice, strategy, 
or program to provide services at a State, regional, or national level 
while maintaining the demonstrated effectiveness of the approach. Under 
the proposed new criterion, the Secretary would consider the 
applicant's strategy to scale the proposed project. In determining the 
applicant's strategy to scale the proposed project, the Secretary would 
consider one or more factors, including the extent to which the 
applicant's strategy to scale addresses a particular barrier or 
barriers that prevented the applicant, in the past, from reaching the 
level of scale that is proposed in the application; the applicant's 
capacity (e.g., in terms of qualified personnel, financial resources, 
or management capacity) to bring the proposed project to scale; and the 
extent to which the applicant demonstrates there is unmet demand for 
the proposed project that will enable the applicant to reach the level 
of scale that is projected in the application. In addition, the 
Secretary could consider the feasibility of replicating the project and 
the mechanisms for broadly disseminating information on the project so 
as to support further development or replication.
    Reasons: It is important that successful best practices be shared 
and implemented more broadly. The addition of this selection criterion 
would allow the Secretary to consider the proposed scaling methodology 
and the feasibility of successfully replicating the proposed project in 
a variety of settings and with other populations. The proposed 
selection criterion would allow the Department to consider whether 
applicants have the potential to serve more groups in a variety of 
settings, which would be important in estimating the likelihood of a 
proposed project's success at scale and in considering applications for 
activities that include broad sharing of best practices. Additionally, 
Department programs could use the proposed criterion, in conjunction 
with the proposed priority regarding evidence of effectiveness, to 
encourage the field to focus its attention and resources on projects 
that are effective.

IV. Evidence of Effectiveness

Background

    To support effective projects and provide incentives to the field 
for building an evidence base on the effectiveness of interventions, 
the Secretary proposes a priority for projects that can cite and build 
upon an existing base of strong or moderate evidence of effectiveness. 
This priority would be a critical part of the Department's efforts to 
fund and increase the use of programs with evidence of effectiveness.
Section 75.226 Consideration of Applications Supported by Strong or 
Moderate Evidence of Effectiveness
    Current Regulations: None.
    Proposed Regulations: The Secretary proposes to establish 
procedures for giving special consideration to applications supported 
by strong or moderate evidence of effectiveness. Proposed Sec.  75.226 
would establish that if the Secretary determines to give special 
consideration to applications supported by strong or moderate evidence 
of effectiveness for a particular grant competition, the Secretary 
could either establish a separate competition or give a competitive 
preference to applications supported by strong or moderate evidence of 
effectiveness under the procedures in 34 CFR 75.105(c)(2).
    Reasons: By expanding the number of Department programs awarding 
grants to those projects supported by strong or moderate evidence of 
effectiveness, the Department could better ensure that discretionary 
grant funds are used to support effective interventions and activities.

V. Program Budgets

Background

    So that the Department can learn as much as possible from 
successful discretionary grants and its programs as a whole, we propose 
amendments regarding budget periods. We would:
     Establish that a project may receive an extension of the 
funding period for the purpose of collecting, analyzing, and reporting 
performance data;
     Clarify that a multi-year data collection may be funded 
through separate budget periods; and
     Clarify that any information relevant to the grantee's 
performance during the project period should be considered when 
determining whether a grantee receives a continuation award.

Proposed Regulatory Changes

34 CFR Part 75

Section 75.250 Maximum Funding Period
    Current Regulations: Current Sec.  75.250 is titled ``Project 
period can be up to 60 months.'' This section provides that the 
Secretary may approve a project period of up to 60 months, but it does 
not specifically authorize funding grants for periods longer than 60 
months. Other regulations in part 75 prohibit the use of Federal funds 
for projects extending past 60 months. See current Sec.  75.261, which 
addresses the circumstances under which a grantee may request a no-cost 
extension of a project period.

[[Page 74399]]

    Proposed Regulations: We propose to amend Sec.  75.250 to provide 
that the Secretary may approve a data collection period of up to 72 
months--if not inconsistent with any statutory limits on the grant 
award period--after the end of the project period and provide funding 
during this period for the sole purpose of collecting, analyzing, and 
reporting data regarding project performance. During a data collection 
period, a grantee could use the funds only for data collection, 
analysis, and reporting purposes. Section 75.250(b)(2) would give the 
Secretary discretion to notify applicants in the notice inviting 
applications for a competition or later, after grantees have started 
their projects of the intent to fund data collection periods.
    Given these proposed changes, the Secretary also proposes to change 
the title of this section to ``Maximum funding period.''
    Reasons: It is the Department's experience that the effectiveness 
of a project cannot always be determined on the date that the 
substantive work of the project is complete. For example, a four-year 
project designed to increase the ability of certain high school 
students to successfully complete college may require data collection 
for up to six years after the date the substantive work of the project 
ends. With the discretion to approve a data collection period after the 
end of a project period and offer continued funding for data 
collection, the Department could ensure that performance data are 
collected and are used to evaluate both the project and program 
performance. The Secretary would expect to fund any data collection 
period of a grant at a much lower level than the original substantive 
work of the grant.
Section 75.251 The Budget Period
    Current Regulations: Current Sec.  75.251 describes how the 
Secretary may fund multi-year projects through separate budget periods, 
generally of 12 months each.
    Proposed Regulations: The Secretary proposes to add a new paragraph 
(c) to this section to clarify that multi-year data collection periods 
may be funded through budget periods in the same manner as project 
periods are funded.
    Reasons: We are proposing to revise Sec.  75.251 to correspond to 
the proposed revisions to Sec.  75.250.
Section 75.253 Continuation of a Multi-Year Project After the First 
Budget Period
    Current Regulations: Under current Sec.  75.253(a), a grantee may 
only receive a continuation award if the grantee has met certain 
requirements, including the requirement that the grantee make 
substantial progress toward the objectives of the grant. If a grantee 
does not make substantial progress, it must obtain permission from the 
Department to make changes to the project that would help the grantee 
make substantial progress during the remainder of the project period.
    Proposed Regulations: The Secretary proposes to amend Sec.  75.253 
by adding a new paragraph (b) to clarify that in deciding whether to 
make a continuation grant, the Secretary could consider any information 
relevant to the grantee's performance during the project period. This 
could include information relevant to the authorizing statute, a 
criterion, a priority, or a performance measure, or any financial or 
other requirement that applied to the selection of applications for new 
awards. While this proposed standard for granting continuation awards 
is implicit under the current regulations, the Secretary believes that 
this standard should be explicit so that grantees have a clearer 
understanding of how the Department decides to make a continuation 
award.
    In addition, we propose to amend paragraph (a)(2) so that in making 
continuation awards, the Secretary could consider not only the extent 
to which a grantee has made substantial progress in achieving the goals 
and objectives of the project, but also whether a grantee met the 
performance targets in the approved application, if the Secretary 
established performance measurement requirements for the grant in the 
application notice. If a grantee fails to meet these targets, proposed 
paragraph (a)(2) would require the grantee to obtain the Secretary's 
approval for changes to the project that enable the grantee to achieve 
the project's goals, objectives, and performance targets, if any, 
without changing the project scope or objectives. The Secretary would 
retain the requirement in the current regulation that any such changes 
may not increase the amount of funds obligated to the project by the 
Department.
    Reasons: Current Sec.  75.253 does not describe the standards used 
to determine whether a grantee has made substantial progress on its 
grant. Therefore, we propose these amendments to clarify the standards 
that the Department considers when determining whether a grant will 
receive a continuation award. The proposed amendments would establish 
that the Secretary may also consider whether a grantee has met the 
performance targets in its approved application when making 
continuation awards.
Section 75.590 Evaluation by the Grantee
    Current Regulation: Current Sec.  75.590 requires a grantee to 
submit performance reports to the Department that evaluate at least 
annually the grantee's progress in achieving the objectives in its 
approved application, the effectiveness of the project in meeting the 
purposes of the program, and the effect of the project on participants 
being served by the project. This provision does not currently provide 
any standards for evaluating the progress in achieving performance 
targets.
    Proposed Regulation: The Secretary proposes to revise Sec.  75.590 
to add a new paragraph (a) to provide that if an application notice for 
a competition requires applicants to describe how they would evaluate 
their projects, any evaluation must meet the standards set in the 
approved application for the project. The performance measurement data 
collected by the grantee and used in the evaluation must meet the 
performance measurement requirements in the approved application.
    We also propose to designate the current regulatory text in Sec.  
75.590 as new paragraph (b) and revise that text to conform to the 
other changes we are proposing regarding performance measurement. 
Specifically, we propose that if the application notice for a 
competition did not require an applicant to submit an evaluation plan, 
the grantee must provide information in its performance report to the 
Department demonstrating (1) The progress made by the grantee in the 
most recent budget period; (2) the effectiveness of the project; and 
(3) the effect of the project on the participants served by the 
project. If the application notice required applicants to propose how 
they would meet performance requirements, the performance report would 
also need to address the extent to which the grantee met the project's 
performance targets and other performance measurement requirements for 
the budget period addressed by the performance report.
    Reasons: The proposed revisions to Sec.  75.590 strengthen the 
Department's authority to monitor the quality of grantees' project 
evaluations. Additionally, these revisions complement other proposed 
regulations in this notice regarding performance measurement 
requirements.

[[Page 74400]]

VI. Definitions

Background

    These proposed regulations include references to terms that are not 
currently defined in EDGAR. To ensure a common understanding of these 
terms, we propose establishing the following definitions.

Proposed Regulatory Changes

34 CFR Part 77

Section 77.1 Definitions That Apply to All Department Programs
    Current Regulations: Section 77.1(c) establishes definitions that 
unless a statute or regulation provides otherwise, apply to parts 34 
CFR 74 and 80.
    Proposed Regulations: The Secretary proposes to incorporate the 
definitions for the following terms into Sec.  77.1(c): ``ambitious,'' 
``baseline data,'' ``evidence of promise,'' ``large sample,'' ``logic 
model,'' ``moderate evidence of effectiveness,'' ``multi-site sample,'' 
``national level,'' ``performance measure,'' ``performance target,'' 
``randomized controlled trial,'' ``regional level,'' ``relevant 
outcome,'' ``quasi-experimental study,'' ``strong evidence of 
effectiveness,'' and ``strong theory.''
    Reasons: The Secretary proposes establishing these definitions to 
ensure consistent understanding of the selection factors and priority 
we propose in this notice.

Executive Orders 12866 and 13563

Regulatory Impact Analysis

    Under Executive Order 12866, the Secretary must determine whether 
this regulatory action is ``significant'' and, therefore, subject to 
the requirements of the Executive order and subject to review by the 
Office of Management and Budget (OMB). Section 3(f) of Executive Order 
12866 defines a ``significant regulatory action'' as an action likely 
to result in a rule that may--
    (1) Have an annual effect on the economy of $100 million or more, 
or adversely affect a sector of the economy, productivity, competition, 
jobs, the environment, public health or safety, or State, local, or 
tribal governments or communities in a material way (also referred to 
as an ``economically significant'' rule);
    (2) Create serious inconsistency or otherwise interfere with an 
action taken or planned by another agency;
    (3) Materially alter the budgetary impacts of entitlement grants, 
user fees, or loan programs or the rights and obligations of recipients 
thereof; or
    (4) Raise novel legal or policy issues arising out of legal 
mandates, the President's priorities, or the principles stated in the 
Executive Order.
    This proposed regulatory action is a significant regulatory action 
subject to review by OMB under section 3(f) of Executive Order 12866.
    We have also reviewed these regulations under Executive Order 
13563, which supplements and explicitly reaffirms the principles, 
structures, and definitions governing regulatory review established in 
Executive Order 12866. To the extent permitted by law, Executive Order 
13563 requires that an agency--
    (1) Propose or adopt regulations only upon a reasoned determination 
that their benefits justify their costs (recognizing that some benefits 
and costs are difficult to quantify);
    (2) Tailor its regulations to impose the least burden on society, 
consistent with obtaining regulatory objectives and taking into 
account--among other things and to the extent practicable--the costs of 
cumulative regulations;
    (3) In choosing among alternative regulatory approaches, select 
those approaches that maximize net benefits (including potential 
economic, environmental, public health and safety, and other 
advantages; distributive impacts; and equity);
    (4) To the extent feasible, specify performance objectives, rather 
than the behavior or manner of compliance a regulated entity must 
adopt; and
    (5) Identify and assess available alternatives to direct 
regulation, including economic incentives--such as user fees or 
marketable permits--to encourage the desired behavior, or provide 
information that enables the public to make choices.
    Executive Order 13563 also requires an agency ``to use the best 
available techniques to quantify anticipated present and future 
benefits and costs as accurately as possible.'' The Office of 
Information and Regulatory Affairs of OMB has emphasized that these 
techniques may include ``identifying changing future compliance costs 
that might result from technological innovation or anticipated 
behavioral changes.''
    We are issuing these regulations only on a reasoned determination 
that their benefits justify their costs. In choosing among alternative 
regulatory approaches, we selected those approaches that maximize net 
benefits. Based on the analysis that follows, the Department believes 
that these regulations are consistent with the principles in Executive 
Order 13563.
    We also have determined that this regulatory action would not 
unduly interfere with State, local, and tribal governments in the 
exercise of their governmental functions.
    In accordance with both Executive orders, the Department has 
assessed the potential costs and benefits of this regulatory action. 
The potential costs associated with this regulatory action are those 
resulting from statutory requirements and those we have determined as 
necessary for administering the Department's programs and activities.

Summary of Potential Costs and Benefits

    Under the proposed regulations, applicants would have to use 
performance measures, baseline data, and performance targets 
established by the Department or establish their own performance 
measures, and determine baseline data performance targets for each 
performance measure. Although these proposed regulations would 
explicitly require such determinations and data collections, these 
requirements are implicit under the current regulations and grantees 
are already required to report on the extent to which they are meeting 
performance targets under the performance report ED 524B, which is 
approved under OMB control number 1894-0003. Therefore, we do not 
expect an increase in reporting burden on grantees under the proposed 
amendments.
    The benefits of the proposed regulations would be that the 
Department would have explicit authority to collect meaningful data 
that we could use to assess the success of individual projects and 
report to Congress and OMB about the success of Department programs in 
achieving their legislative objectives. The ability to determine the 
success of Department programs could help improve the effectiveness of 
Department programs, without imposing additional costs on grantees or 
other parties.
    The proposed regulations would also permit the Department to 
provide an exception for certain applicants from the full competitive 
contracting requirements in 34 CFR 74.43 and 80.36(c) for a grant that 
requires an external evaluation. Additionally, the proposed regulations 
would remove the prohibition on subgrants and allow for subgrants to 
any entity that is identified in a grantee's application and uses the 
subgrant directly to carry out activities described in the application. 
This action would reduce costs and increase benefits.
    The benefits are that the proposed rule would remove a barrier for 
these grantees to contracting with the same evaluator both in the grant 
application

[[Page 74401]]

stage and after receiving a grant award (and similarly, to selecting 
evaluation sites and implementation partners both pre-grant award and 
post-award), and thereby potentially enhance the quality of these 
projects. At the same time the proposed regulations would relieve 
grantees of the costs of administering competitions without reducing 
accountability or increasing the risk of improper use of or accounting 
for grant expenditures.
    Additionally, under the proposed regulations, the Department would 
have greater flexibility in conducting grant competitions to use 
selection criteria that (1) are closely aligned with program objectives 
and priorities, and (2) promote reform objectives related to project 
evaluation, sustainability, productivity, and capacity to scale. This 
change would benefit applicants as well as the Department because it 
allows the Secretary to establish selection criteria that are concise 
and closely aligned with the goals and objectives of a particular grant 
competition and are focused more closely and coherently on the intended 
outcomes of the competition. The regulations would generate these 
benefits without increasing the costs for applicants, grantees, or the 
Department that already exist for creating and reviewing grant 
applications.
    Elsewhere in this section under the heading Paperwork Reduction Act 
of 1995, we identify and explain burdens specifically associated with 
information collection requirements.

Clarity of the Regulations

    Executive Order 12866 and the Presidential memorandum on ``Plain 
Language in Government Writing'' require each agency to write 
regulations that are easy to understand.
    The Secretary invites comments on how to make these proposed 
regulations easier to understand, including answers to questions such 
as the following:
     Are the requirements in the proposed regulations clearly 
stated?
     Do the proposed regulations contain technical terms or 
other wording that interferes with their clarity?
     Does the format of the proposed regulations (grouping and 
order of sections, use of headings, paragraphing, etc.) aid or reduce 
their clarity?
     Would the proposed regulations be easier to understand if 
we divided them into more (but shorter) sections? (A ``section'' is 
preceded by the symbol ``Sec.  '' and a numbered heading; for example, 
Sec.  75.210 General selection criteria.)
     Could the description of the proposed regulations in the 
SUPPLEMENTARY INFORMATION section of this preamble be more helpful in 
making the proposed regulations easier to understand? If so, how?
     What else could we do to make the proposed regulations 
easier to understand?
    To send any comments that concern how the Department could make 
these proposed regulations easier to understand, see the instructions 
in the ADDRESSES section of this preamble.

Regulatory Flexibility Act Certification

Paperwork Reduction Act of 1995

    The Secretary certifies that these proposed regulations would not 
have a significant economic impact on a substantial number of small 
entities because the proposed regulations would affect only slightly 
the overall burden on applicants and grantees, as explained in the 
Paperwork Reduction Act of 1995 discussion in this SUPPLEMENTARY 
INFORMATION.

Paperwork Reduction Act of 1995

    As part of its continuing effort to reduce paperwork and respondent 
burden, the Department conducts a preclearance consultation program to 
provide the general public and Federal agencies with an opportunity to 
comment on proposed and continuing collections of information in 
accordance with the Paperwork Reduction Act of 1995 (PRA) (44 U.S.C. 
3506(c)(2)(A)). This helps ensure that: The public understands the 
Department's collection instructions, respondents can provide the 
requested data in the desired format, reporting burden (time and 
financial resources) is minimized, collection instruments are clearly 
understood, and the Department can properly assess the impact of 
collection requirements on respondents.
    Section 75.110 contains an information collection requirement. 
Under the PRA the Department has submitted a copy of this section to 
OMB for its review.
    A Federal agency may not conduct or sponsor a collection of 
information unless OMB approves the collection under the PRA and the 
corresponding information collection instrument displays a currently 
valid OMB control number. Notwithstanding any other provision of law, 
no person is required to comply with, or is subject to penalty for 
failure to comply with, a collection of information if the collection 
instrument does not display a currently valid OMB control number.
    In the final regulations we will display the control number 
assigned by OMB to any information collection requirement proposed in 
this NPRM and adopted in the final regulations.
    Collection of Information: The proposed regulations would affect 
applicants and grantees of the Department's discretionary grant 
programs, including State, local, and tribal governments and non-profit 
organizations, such as institutions of higher education.
    Applications: OMB has approved the Department's Generic Application 
Package under OMB Control number 1894-0006, which applies to those 
competitions that use the current EDGAR selection criteria in Sec.  
75.210 and statutory criteria that have been developed under the EDGAR 
procedures in Sec.  75.209.
    Regarding the burden imposed by the Generic Application Package, 
the Department proposes to add proposed Sec.  75.110 to the other 
sections already identified as creating burden related to that package. 
While Sec.  75.110 is new, it would not impose any new data collection 
requirements for the Generic Application Package because performance 
measurement burden for that package has already been calculated under 
the selection criteria in Sec.  75.210. The amendments proposed in this 
NPRM would not increase the existing paperwork burdens under the 
Generic Application Package. The Secretary also proposes to cover the 
burden associated with the EDGAR selection criteria from Sec.  75.209 
and Sec.  75.210 under Sec.  75.200, which fully details the sources 
that program offices can use to establish selection criteria under 
EDGAR.
    Each fiscal year, the Department receives over XX,000 applications 
under competitions covered by the Generic Application Package. 
Applicants that apply to programs that use the EDGAR criteria would be 
affected by the proposed changes to the selection criteria that would 
require applications to address evaluation and performance measurement 
more specifically.
    The Department already has selection criteria that ask applicants 
to describe the evaluation plans for their projects; the burden 
associated with the proposed regulations is currently covered under 
Sec.  75.210(h). However, an applicant for a discretionary grant would 
only have to respond once to provide the following information 
regarding the project: The performance baselines; the performance 
measures; the performance targets; and the methodology for collecting 
performance data. Thus, we do not expect greater burden under these 
proposed regulations and the Generic Application Package because that 
burden is already covered under existing criteria. Instead, we expect 
that

[[Page 74402]]

as a result of these proposed regulations, applicants would provide 
greater clarity on the methodologies they would use to collect and 
report data.
    Because these proposed regulations would expand the number of 
programs that could use proposed Sec.  75.209 to create criteria based 
on statutory and regulatory requirements, there is a potential under 
the proposed regulations that more program offices would use the EDGAR 
process to establish criteria for their competitions. If more 
competitions use the Generic Application Package, the overall hours of 
burden under the Generic Application Package and OMB Control number 
1894-0006 would grow. However, any ``new'' burden covered by the 
Generic Application Package would result from fewer programs using 
program-specific application packages, so the total burden covered by 
program-specific application packages would be reduced in an amount 
equivalent to the burden increase associated with the Generic 
Application Package. If the amendments to the sections regarding the 
selection criteria become final, we would work closely with OMB to 
monitor the extent to which burden currently covered by separate 
program-specific application packages would shift to the Generic 
Application Package and request appropriate changes in the total burden 
covered by the Generic Application Package.
    The current Generic Application Package was approved by OMB based 
on an estimate of 9,861 responses over three years and an estimate of 
447,089 total hours required to prepare applications.
    Performance reports: OMB has also approved the U.S. Department of 
Education Grant Performance Report (ED 524B) under OMB Control number 
1894-0003.
    Over three years, the Department receives ED 524B performance 
reports from approximately 5,900 discretionary grantees. A grantee 
would have to respond on an annual basis to prepare performance reports 
throughout the course of the project period, including any no-cost 
extensions of the grant or funded data collection extensions, and 
respond once to prepare a final performance and financial report. These 
burdens have already been accounted for under the ED 524B.
    The number of reports estimated annually under the ED 524B is 5,900 
and the estimated reporting burden-hours for that report is 132,200. We 
do not expect any change in burden under these proposed regulations. 
However, there is some potential that more programs might be able to 
use the ED 524B performance report as a result of more programs using 
the EDGAR selection criteria. We will monitor that potential and work 
with OMB to determine if the Department needs to revisit the total 
burden covered by the ED 524B performance report.

Intergovernmental Review

    These proposed regulations affect Direct Grant programs of the 
Department that are subject to Executive Order 12372 and the 
regulations in 34 CFR part 79. One of the objectives of the Executive 
order is to foster an intergovernmental partnership and a strengthened 
federalism. The Executive order relies on processes developed by State 
and local governments for coordination and review of proposed Federal 
financial assistance.
    This document provides early notification of our specific plans and 
actions for these programs.

Assessment of Educational Impact

    In accordance with section 411 of the General Education Provisions 
Act, 20 U.S.C. 1221e-4, the Secretary particularly requests comments on 
whether these proposed regulations would require transmission of 
information that any other agency or authority of the United States 
gathers or makes available.
    Accessible Format: Individuals with disabilities can obtain this 
document in an accessible format (e.g., braille, large print, 
audiotape, or compact disc) on request to the program contact person 
listed under FOR FURTHER INFORMATION CONTACT.
    Electronic Access to This Document: The official version of this 
document is the document published in the Federal Register. Free 
Internet access to the official edition of the Federal Register and the 
Code of Federal Regulations is available via the Federal Digital System 
at: www.gpo.gov/fdsys. At this site you can view this document, as well 
as all other documents of this Department published in the Federal 
Register, in text or Adobe Portable Document Format (PDF). To use PDF 
you must have Adobe Acrobat Reader, which is available free at the 
site.
    You may also access documents of the Department published in the 
Federal Register by using the article search feature at: 
www.federalregister.gov. Specifically, through the advanced search 
feature at this site, you can limit your search to documents published 
by the Department.

List of Subjects

34 CFR Part 75

    Accounting, Copyright, Education, Grant programs-education.

34 CFR Part 77

    Education, Grant programs-education.

    Dated: December 6, 2012.
Arne Duncan,
Secretary of Education.
    For the reasons discussed in the preamble, the Secretary proposes 
to amend parts 75 and 77 of title 34 of the Code of Federal Regulations 
as follows:

PART 75--DIRECT GRANT PROGRAMS

    1. The authority citation for part 75 continues to read as follows:

    Authority:  20 U.S.C. 1221e-3 and 3474, unless otherwise noted.

    2. Add a new Sec.  75.110 to read as follows:


Sec.  75.110  Information regarding performance measurement.

    (a) The Secretary may establish in an application notice for a 
competition one or more performance measurement requirements, including 
requirements for performance measures, baseline data, or performance 
targets, and a requirement that applicants propose in their 
applications one or more of their own performance measures, baseline 
data, or performance targets.
    (b) If an application notice requires applicants to propose 
project-specific performance measures, baseline data, or performance 
targets, the application must include the following, as required by the 
application notice:
    (1) Performance measures. How each proposed performance measure 
would accurately measure the performance of the project and how the 
proposed performance measure would be consistent with the performance 
measures established for the program funding the competition.
    (2) Baseline data. (i) Why each proposed baseline is valid; or
    (ii) If the applicant has determined that there are no established 
baseline data for a particular performance measure, an explanation of 
why there is no established baseline and of how and when, during the 
project period, the applicant would establish a valid baseline for the 
performance measure.
    (3) Performance targets. Why each proposed performance target is 
ambitious yet achievable compared to the baseline for the performance 
measure and when, during the project period, the applicant would meet 
the performance target.

[[Page 74403]]

    (c) If the application notice establishes performance measurement 
requirements, the applicant must also describe in the application--
    (1)(i) The data collection and reporting methods the applicant 
would use and why those methods are likely to yield reliable, valid, 
and meaningful performance data; and
    (ii) If the Secretary requires applicants to collect data after the 
substantive work of a project is complete regarding the attainment of 
certain performance targets, the data collection and reporting methods 
the applicant would use during the post-performance period and why 
those methods are likely to yield reliable, valid, and meaningful 
performance data.
    (2) The applicant's capacity to collect and report reliable, valid, 
and meaningful performance data, as evidenced by high-quality data 
collection, analysis, and reporting in other projects or research.

(Authority: 20 U.S.C. 1221e-3 and 3474)


    3. Add a new undesignated center heading ``Competition Exceptions'' 
in subpart C immediately before the undesignated center heading ``State 
Comment Procedures''.
    4. Add a new Sec.  75.135 to subpart C under the undesignated 
center heading ``Competition Exceptions'' to read as follows:


S75.135   Competition exception for proposed implementation sites, 
implementation partners, or evaluation service providers.

    (a) When entering into a contract with implementation sites or 
partners, an applicant is not required to comply with the competition 
requirements in 34 CFR 74.43 or 80.36(c), as applicable, if--
    (1) The contract is with an entity that agrees to provide a site or 
sites where the applicant would conduct the project activities under 
the grant;
    (2) The implementation sites or partner entities that the applicant 
proposes to use are identified in the application for the grant; and
    (3) The implementation sites or partner entities are included in 
the application in order to meet a regulatory, statutory, or priority 
requirement related to the competition.
    (b) When entering into a contract for data collection, data 
analysis, or evaluation services, an applicant may select a provider 
using the informal, small-purchase procurement procedures in 34 CFR 
80.36(d)(1), regardless of whether that applicant would otherwise be 
subject to that part or whether the evaluation contract would meet the 
standards for a small purchase order, if--
    (1) The contract is with the data collection, data analysis, or 
evaluation service provider that would conduct the project services;
    (2) The evaluation service provider that the applicant proposes to 
use is identified in the application for the grant; and
    (3) The evaluation service provider is included in the application 
in order to meet a statutory, regulatory, or priority requirement 
related to the competition.
    (c) If the grantee relied on the exceptions under paragraph (a) or 
(b) of this section, the grantee must certify that any employee, 
officer, or agent participating in the selection, award, or 
administration of a contract is free of any real or apparent conflict 
of interest.
    (d) A grantee must obtain the Secretary's prior approval for any 
change to an implementation site, implementation partner, or evaluation 
service provider, if the grantee relied on the exceptions under 
paragraph (a) or (b) of this section to select the entity or evaluator.
    (e) The exceptions in paragraphs (a) and (b) of this section do not 
extend to the other procurement requirements in 34 CFR part 74 and 34 
CFR part 80 regarding contracting by grantees and subgrantees.

(Authority: 20 U.S.C. 1221e-3 and 3474)

    5. Revise Sec.  75.209 to read as follows:


Sec.  75.209  Selection criteria based on statutory or regulatory 
provisions.

    The Secretary may establish selection criteria and factors based on 
statutory or regulatory provisions that apply to the authorized 
program, which may include, but are not limited to criteria and factors 
that reflect--
    (a) Criteria contained in the program statute or regulations;
    (b) Criteria in Sec.  75.210;
    (c) Allowable activities specified in the program statute or 
regulations;
    (d) Application content requirements specified in the program 
statute or regulations;
    (e) Program purposes, as described in the program statute or 
regulations; or
    (f) Other pre-award and post-award conditions specified in the 
program statute or regulations.

(Authority: 20 U.S.C. 1221e-3 and 3474)


    6. Amend Sec.  75.210 by:
    A. Revising the introductory text.
    B. Revising paragraph (c)(2)(xvi).
    C. Adding paragraphs (c)(2)(xxiv) through (xxix).
    D. Adding paragraphs (h)(2)(viii) through (xii).


And

    E. Adding a new paragraph (i).
    The revisions and additions read as follows.


Sec.  75.210  General selection criteria.

    In determining the selection criteria to evaluate applications 
submitted in a grant competition, the Secretary may select one or more 
of the following criteria and may select from among the list of 
optional factors under each criterion. The Secretary may define a 
selection criterion by selecting one or more specific factors within a 
criterion or assigning factors from one criterion to another criterion.
* * * * *
    (c) * * *
    (2) * * *
    (xvi) The extent to which the proposed project will integrate with 
or build on similar or related efforts to improve relevant outcomes (as 
defined in 34 CFR 77.1(c)), using existing funding streams from other 
programs or policies supported by community, State, and Federal 
resources.
    * * *
    (xxiv) The extent to which the applicant demonstrates that it has 
the resources to operate the project beyond the length of the grant, 
including a multi-year financial and operating model and accompanying 
plan; the demonstrated commitment of any partners; evidence of broad 
support from stakeholders (e.g., State educational agencies, teachers' 
unions) critical to the project's long-term success; or more than one 
of these types of evidence.
    (xxv) The potential and planning for the incorporation of project 
purposes, activities, or benefits into the ongoing work of the 
applicant beyond the end of the grant.
    (xxvi) The extent to which the proposed project will increase 
efficiency in the use of time, staff, money, or other resources in 
order to improve results and increase productivity.
    (xxvii) The extent to which the proposed project will integrate 
with or build on similar or related efforts in order to improve 
relevant outcomes (as defined in 34 CFR 77.1(c)), using nonpublic funds 
or resources.
    (xxviii) The extent to which the proposed project is supported by 
evidence of promise (as defined in 34 CFR 77.1(c)).
    (xxix) The extent to which the proposed project is supported by 
strong theory (as defined in 34 CFR 77.1(c)).
* * * * *
    (h) * * *
    (2) * * *
    (viii) The extent to which the methods of evaluation will, if well-
implemented,

[[Page 74404]]

produce evidence about the project's effectiveness that would meet the 
What Works Clearinghouse Evidence Standards without reservations.\3\
---------------------------------------------------------------------------

    \3\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (ix) The extent to which the methods of evaluation will, if well-
implemented, produce evidence about the project's effectiveness that 
would meet the What Works Clearinghouse Evidence Standards with 
reservations.\4\
---------------------------------------------------------------------------

    \4\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (x) The extent to which the methods of evaluation will, if well-
implemented, produce evidence of promise (as defined in 34 CFR 
77.1(c)).
    (xi) The extent to which the methods of evaluation will provide 
valid and reliable performance data on relevant outcomes.
    (xii) The extent to which the evaluation plan clearly articulates 
the key components, mediators, and outcomes of the grant-supported 
intervention, as well as a measurable threshold for acceptable 
implementation.
(i) Strategy to Scale
    (1) The Secretary considers the applicant's strategy to scale the 
proposed project.
    (2) In determining the applicant's capacity to scale the proposed 
project, the Secretary considers one or more of the following factors:
    (i) The applicant's capacity (e.g., in terms of qualified 
personnel, financial resources, or management capacity) to bring the 
proposed project to scale on a national or regional level (as defined 
in 34 CFR 77.1(c)) working directly, or through partners, during the 
grant period.
    (ii) The applicant's capacity (e.g., in terms of qualified 
personnel, financial resources, or management capacity) to further 
develop and bring to scale the proposed process, product, strategy, or 
practice, or to work with others to ensure that the proposed process, 
product, strategy, or practice can be further developed and brought to 
scale, based on the findings of the proposed project.
    (iii) The feasibility of successful replication of the proposed 
project, if favorable results are obtained, in a variety of settings 
and with a variety of populations.
    (iv) The mechanisms the applicant will use to broadly disseminate 
information on its project so as to support further development or 
replication.
    (v) The extent to which the applicant demonstrates there is unmet 
demand for the process, product, strategy, or practice that will enable 
the applicant to reach the level of scale that is proposed in the 
application.
    (vi) The extent to which the applicant identifies a specific 
strategy or strategies that address a particular barrier or barriers 
that prevented the applicant, in the past, from reaching the level of 
scale that is proposed in the application.
    7. Add Sec.  75.266 to subpart D to read as follows:


Sec.  75.266  What procedures does the Secretary use if the Secretary 
decides to give special consideration to applications supported by 
strong or moderate evidence of effectiveness?

    (a) As used in this section, ``strong evidence of effectiveness'' 
is defined in 34 CFR 77.1(c);
    (b) As used in this section, ``moderate evidence of effectiveness'' 
is defined in 34 CFR 77.1(c); and
    (c) If the Secretary determines that special consideration of 
applications supported by strong or moderate evidence of effectiveness 
is appropriate, the Secretary may establish a separate competition 
under the procedures in 34 CFR 75.105(c)(3), or provide competitive 
preference under the procedures in 34 CFR 75.105(c)(2), for 
applications supported by:
    (1) Evidence of effectiveness that meets the conditions set out in 
paragraph (a) of the definition of ``strong evidence of effectiveness'' 
in 34 CFR 77.1;
    (2) Evidence of effectiveness that meets the conditions set out in 
either paragraph (a) or (b) of the definition of ``strong evidence of 
effectiveness'' in 34 CFR 77.1; or
    (3) Evidence of effectiveness that meets the conditions set out in 
the definition of ``moderate evidence of effectiveness.''

(Authority: 20 U.S.C. 1221e-3 and 3474)


    8. Revise Sec.  75.250 to read as follows:


Sec.  75.250  Maximum funding period.

    (a) The Secretary may approve a project period to fund the 
substantive work of a grant and a data collection period to fund data 
collection, analysis, and reporting related to a grant after the end of 
the project period.
    (b) The Secretary may approve a project period of up to 60 months 
to perform the substantive work of a grant.
    (1) The Secretary may approve a data collection period for a grant 
for a period of up to 72 months after the end of the project period and 
provide funding for the data collection period for the sole purpose of 
collecting, analyzing, and reporting performance measurement data 
regarding the project.
    (2) The Secretary may inform applicants of the Secretary's intent 
to approve data collection periods in the application notice published 
for a competition or may decide to fund data collection periods after 
grantees have started their project periods.

(Authority: 20 U.S.C. 1221e-3 and 3474)


    9. Amend Sec.  75.251 by adding a new paragraph (c) to read as 
follows:


Sec.  75.251  Budget Periods.

* * * * *
    (c) If the Secretary funds a multi-year data collection period, the 
Secretary may fund the data collection period through separate budget 
periods and fund those budget periods in the same manner as those 
periods are funded during the project period.
    10. Amend Sec.  75.253 by--
    A. Revising paragraph (a)(2).
    B. Adding a new paragraph (a)(5).
    C. Re-designating paragraphs (b) through (e) as paragraphs (c) 
through (f).
    D. Adding a new paragraph (b).
    And
    E. Revising newly re-designated paragraph (f).
    The revisions and additions read as follows:


Sec.  75.253  Continuation of a multi-year project after the first 
budget period.

    (a) * * *
    (2) The grantee has either--
    (i) Made substantial progress in achieving--
    (A) The goals and objectives of the project; and
    (B) If the Secretary established performance measurement 
requirements for the grant in the application notice, the performance 
targets in the grantee's approved application; or
    (ii) Obtained the Secretary's approval for changes to the project 
that--
    (A) Do not increase the amount of funds obligated to the project by 
the Secretary; and
    (B) Enable the grantee to achieve the goals and objectives of the 
project and meet the performance targets of the project, if any, 
without changing the scope or objectives of the project.
    * * *
    (5) The grantee has maintained financial and administrative 
management systems that meet the requirements in 34 CFR 74.21 or 80.20, 
as appropriate.
    (b) In deciding whether a grantee has made substantial progress, 
the Secretary

[[Page 74405]]

may consider any information relevant to the authorizing statute, a 
criterion, a priority, or a performance measure, or to a financial or 
other requirement that applies to the selection of applications for new 
grants.
* * * * *
    (f) Unless prohibited by the program statute or regulations, a 
grantee that is in the final budget period of its project period may 
seek continued assistance for the project as required under the 
procedures for selecting new projects for grants.
    11. Revise Sec.  75.590 to read as follows.


Sec.  75.590  Evaluation by the grantee.

    (a) If the application notice for a competition required applicants 
to describe how they would evaluate their projects, each grantee under 
that competition must demonstrate to the Department that--
    (1) The evaluation meets the standards of the evaluation in the 
approved application for the project; and
    (2) The performance measurement data collected by the grantee and 
used in the evaluation meet the performance measurement requirements of 
the approved application.
    (b) If the application notice for a competition did not require 
applicants to describe how they would evaluate their projects, each 
grantee must provide information in its performance report 
demonstrating--
    (1) The progress made by the grantee in the most recent budget 
period, including progress based on the performance measurement 
requirements for the grant, if any;
    (2) The effectiveness of the grant, including fulfilling the 
performance measurement requirements of the approved application, if 
any; and
    (3) The effect of the project on the participants served by the 
project, if any.

(Authority: 20 U.S.C. 1221e-3 and 3474)


    12. Amend Sec.  75.708 by:
    A. Revising paragraph (a).
    B. Re-designating paragraph (b) as paragraph (e); and
    C. Adding new paragraphs (b), (c) and (d).
    The revision and additions read as follows.


Sec.  75.708  Subgrants.

    (a) A grantee may not make a subgrant under a program covered by 
this part unless authorized by statute or by paragraph (b) of this 
section.
    (b) The Secretary may, through an announcement in the Federal 
Register, authorize subgrants when necessary to meet the purposes of a 
program. In this announcement, the Secretary will--
    (1) Designate the types of entities, e.g., State educational 
agencies, local educational agencies, institutions of higher education, 
and non-profit organizations, to which subgrants can be awarded; and
    (2) Indicate whether subgrants can be made to entities identified 
in an approved application or, without regard to whether the entity is 
identified in an approved application, have to be selected through a 
competitive process set out in subgranting procedures established by 
the grantee.
    (c) If authorized under paragraph (b) of this section, a subgrant 
is allowed if it will be used by that entity to directly carry out 
project activities described in that application.
    (d) The grantee, in awarding subgrants under paragraph (b) of this 
section, must--
    (1) Ensure that subgrants are awarded on the basis of an approved 
budget that is consistent with the grantee's approved application and 
all applicable Federal statutory, regulatory, and other requirements;
    (2) Ensure that every subgrant includes any conditions required by 
Federal statute and executive orders and their implementing 
regulations; and
    (3) Ensure that subgrantees are aware of requirements imposed upon 
them by Federal statute and regulation, including the Federal anti-
discrimination laws enforced by the Department; and
* * * * *

PART 77--DEFINITIONS THAT APPLY TO DEPARTMENT REGULATIONS

    13. The authority citation for part 77 continues to read as 
follows:

    Authority: 20 U.S.C. 1221e-3 and 3474, unless otherwise noted.

    14. Amend Sec.  77.1(c) by adding the following definitions in 
alphabetical order:


Sec.  77.1  Definitions that apply to all Department programs.

* * * * *
    (c) * * *
    Ambitious means promoting continued, meaningful improvement for 
program participants or for other individuals or entities affected by 
the grant, or representing a significant advancement in the field of 
education research, practices, or methodologies. When used to describe 
a performance target, whether a performance target is ambitious depends 
upon the context of the relevant performance measure and the baseline 
for that measure.
* * * * *
    Baseline means the starting point from which performance is 
measured and targets are set.
* * * * *
    Evidence of promise means there is empirical evidence to support 
the theoretical linkage(s) between at least one critical component and 
at least one relevant outcome presented in the logic model for the 
proposed process, product, strategy, or practice. Specifically, 
evidence of promise means the conditions in paragraphs (a) and (b) are 
met:
    (a) There is at least one study that is a--
    (1) Correlational study with statistical controls for selection 
bias;
    (2) Quasi-experimental study that meets the What Works 
Clearinghouse Evidence Standards with reservations; \1\ or
---------------------------------------------------------------------------

    \1\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (3) Randomized controlled trial that meets the What Works 
Clearinghouse Evidence Standards with or without reservations.\2\
---------------------------------------------------------------------------

    \2\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (b) The study referenced in paragraph (a) found a statistically 
significant or substantively important (defined as a difference of 0.25 
standard deviations or larger), favorable association between at least 
one critical component and one relevant outcome presented in the logic 
model for the proposed process, product, strategy, or practice.
* * * * *
    Large sample means an analytic sample of 350 or more students (or 
other single analysis units) who were randomly assigned to a treatment 
or control group or 50 or more groups (such as classrooms or schools) 
that contain 10 or more students (or other single analysis units) and 
that were randomly assigned to a treatment or control group.
* * * * *
    Logic model (also referred to as theory of action) means a well-
specified conceptual framework that identifies key components of the 
proposed process, product, strategy, or practice (i.e., the active 
``ingredients'' that are hypothesized to be critical to achieving the 
relevant outcomes) and describes the relationships among the key

[[Page 74406]]

components and outcomes, theoretically and operationally.
* * * * *
    Moderate evidence of effectiveness means one of the following 
conditions is met:
    (a) There is at least one study of the effectiveness of the 
process, product, strategy, or practice being proposed that meets the 
What Works Clearinghouse Evidence Standards without reservations,\3\ 
found a statistically significant favorable impact on a relevant 
outcome (with no statistically significant unfavorable impacts on that 
outcome for relevant populations in the study or in other studies of 
the intervention reviewed by and reported on by the What Works 
Clearinghouse), and includes a sample that overlaps with the 
populations or settings proposed to receive the process, product, 
strategy, or practice.
---------------------------------------------------------------------------

    \3\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (b) There is at least one study of the effectiveness of the 
process, product, strategy, or practice being proposed that meets the 
What Works Clearinghouse Evidence Standards with reservations,\4\ found 
a statistically significant favorable impact on a relevant outcome 
(with no statistically significant unfavorable impacts on that outcome 
for relevant populations in the study or in other studies of the 
intervention reviewed by and reported on by the What Works 
Clearinghouse), includes a sample that overlaps with the populations or 
settings proposed to receive the process, product, strategy, or 
practice, and includes a large sample and a multi-site sample (Note: 
multiple studies can cumulatively meet the large and multi-site sample 
requirements as long as each study meets the other requirements in this 
paragraph).
---------------------------------------------------------------------------

    \4\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

* * * * *
    Multi-site sample means more than one site, where site can be 
defined as an LEA, locality, or State.
* * * * *
    National level describes the level of scope or effectiveness of a 
process, product, strategy, or practice that is able to be effective in 
a wide variety of communities, including rural and urban areas, as well 
as with different groups (e.g., economically disadvantaged, racial and 
ethnic groups, migrant populations, individuals with disabilities, 
English learners, and individuals of each gender).
* * * * *
    Performance measure means any quantitative indicator, statistic, or 
metric used to gauge program or project performance.
* * * * *
    Performance target means a level of performance that an applicant 
would seek to meet during the course of a project or as a result of a 
project.
* * * * *
    Quasi-experimental design study means a study using a design that 
attempts to approximate an experimental design by identifying a 
comparison group that is similar to the treatment group in important 
respects. These studies, depending on design and implementation, can 
meet What Works Clearinghouse Evidence Standards with reservations \5\ 
(they cannot meet What Works Clearinghouse Evidence Standards without 
reservations).
---------------------------------------------------------------------------

    \5\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

* * * * *
    Randomized controlled trial means a study that employs random 
assignment of, for example, students, teachers, classrooms, schools, or 
districts to receive the intervention being evaluated (the treatment 
group) or not to receive the intervention (the control group). The 
estimated effectiveness of the intervention is the difference between 
the average outcome for the treatment group and for the control group. 
These studies, depending on design and implementation, can meet What 
Works Clearinghouse Evidence Standards without reservations.\6\
---------------------------------------------------------------------------

    \6\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

* * * * *
    Regional level describes the level of scope or effectiveness of a 
process, product, strategy, or practice that is able to serve a variety 
of communities within a State or multiple States, including rural and 
urban areas, as well as with different groups (e.g., economically 
disadvantaged, racial and ethnic groups, migrant populations, 
individuals with disabilities, English learners, and individuals of 
each gender). For an LEA-based project, to be considered a regional-
level project, a process, product, strategy, or practice must serve 
students in more than one LEA, unless the process, product, strategy, 
or practice is implemented in a State in which the State educational 
agency is the sole educational agency for all schools.
* * * * *
    Relevant outcome means the student outcome(s) (or the ultimate 
outcome if not related to students) the proposed process, product, 
strategy, or practice is designed to improve; consistent with the 
specific goals of a program.
* * * * *
    Strong evidence of effectiveness means one of the following 
conditions is met:
    (a) There is at least one study of the effectiveness of the 
process, product, strategy, or practice being proposed that meets the 
What Works Clearinghouse Evidence Standards without reservations,\7\ 
found a statistically significant favorable impact on a relevant 
outcome (with no statistically significant unfavorable impacts on that 
outcome for relevant populations in the study or in other studies of 
the intervention reviewed by and reported on by the What Works 
Clearinghouse), includes a sample that overlaps with the populations 
and settings proposed to receive the process, product, strategy, or 
practice, and includes a large sample and a multi-site sample (Note: 
multiple studies can cumulatively meet the large and multi-site sample 
requirements as long as each study meets the other requirements in this 
paragraph).
---------------------------------------------------------------------------

    \7\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

    (b) There are at least two studies of the effectiveness of the 
process, product, strategy, or practice being proposed, each of which: 
Meets the What Works Clearinghouse Evidence Standards with 
reservations,\8\ found a statistically significant favorable impact on 
a relevant outcome (with no statistically significant unfavorable 
impacts on that outcome for relevant populations in the studies or in 
other studies of the intervention reviewed by and reported on by the 
What Works Clearinghouse), includes a sample that overlaps with the 
populations and settings proposed to receive the process, product, 
strategy, or practice, and includes a large sample and a multi-site 
sample.
---------------------------------------------------------------------------

    \8\ See What Works Clearinghouse Procedures and Standards 
Handbook (Version 2.1, September 2011), which can currently be found 
at the following link: https://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
---------------------------------------------------------------------------

* * * * *

[[Page 74407]]

    Strong theory means a rationale for the proposed process, product, 
strategy, or practice that includes a logic model.

[FR Doc. 2012-29897 Filed 12-13-12; 8:45 am]
BILLING CODE 4000-01-P
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.