USAID Acquisition Regulation: Planning, Collection, and Submission of Digital Information; Submission of Activity Monitoring, Evaluation, and Learning Plan to USAID, 37948-37964 [2024-09373]
Download as PDF
37948
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
AGENCY FOR INTERNATIONAL
DEVELOPMENT
48 CFR Parts 727, 742, and 752
RIN 0412–AA90
USAID Acquisition Regulation:
Planning, Collection, and Submission
of Digital Information; Submission of
Activity Monitoring, Evaluation, and
Learning Plan to USAID
U.S. Agency for International
Development.
ACTION: Final rule.
AGENCY:
The United States Agency for
International Development (USAID)
issuing a final rule amending USAID
Acquisition Regulation (AIDAR) that
implements USAID requirements for
managing digital information as a
strategic asset to inform the planning,
design, implementation, monitoring,
and evaluation of the Agency’s foreign
assistance programs. This final rule
incorporates a new policy on Digital
Information Planning, Collection, and
Submission Requirements and the
corresponding clause as well as a new
clause entitled ‘‘Activity Monitoring,
Evaluation, and Learning Plan
Requirements’’ into the (AIDAR). This
final rule is intended to reduce the
burden on contractors, increase
efficiency, and improve the use of data
and other forms of digital information
across the Agency’s programs and
operations.
SUMMARY:
DATES:
Effective June 5, 2024.
FOR FURTHER INFORMATION CONTACT:
Kelly Miskowski, USAID M/OAA/P, at
202–256–7378 or policymailbox@
usaid.gov for clarification of content or
information pertaining to status or
publication schedules. All
communications regarding this rule
must cite AIDAR RIN No. 0412–AA90.
SUPPLEMENTARY INFORMATION:
ddrumheller on DSK120RN23PROD with RULES7
A. Background
USAID published a proposed rule in
the Federal Register at 86 FR 71216 on
December 15, 2021, to implement
USAID requirements for managing
digital information as a strategic asset to
inform the planning, design,
implementation, monitoring, and
evaluation of the Agency’s foreign
assistance programs as outlined in 48
CFR parts 727, 742, and 752. USAID
also published a notice of availability of
supplemental document containing data
standards in the Federal Register at 88
FR 22990 on April 14, 2023, and
solicited comments. A response to
comments received as well as a revised
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
copy of the supplemental document is
included with this rulemaking.
On August 25, 2022, the Office of
Science and Technology Policy (OSTP)
published a Memorandum (viewable at
this address: https://www.whitehouse.
gov/wp-content/uploads/2022/08/082022-OSTP-Public-Access-Memo.pdf).
In this memorandum, OSTP provided
policy guidance to ensure that
publications and their supporting data
resulting from federally funded research
are publicly accessible without an
embargo on their free and public
release. This memo was released after
publication of the proposed rule.
USAID’s language around embargoes
within this rule is intentionally flexible,
granting embargoes on the release of
digital objects only in limited
circumstances, such as in the interest of
international development and foreign
policy objectives, consistent with both
USAID and OSTP policy and guidance,
and no changes have been made to the
language of the rule as a result. In
implementation, any approval of
embargoes will be consistent with OSTP
guidance.
B. Discussion and Analysis
Response to Comments on the Proposed
Rule
Seventeen respondents submitted
public comments in response to the
proposed rule. USAID assessed the
public comments in the development of
the final rule. The full text of the
comments is available at the Federal
Rulemaking Portal,
www.regulations.gov. A discussion of
the comments and the changes made to
the rule as a result of those comments
are provided as follows:
1. Summary of Significant Changes
The following significant changes
from the proposed rule are made in the
final rule:
a. Added definitions for data
inventory, digital, and digital method.
b. Revised applicability of 752.227–71
from the micro purchase threshold to
the simplified acquisition threshold.
Similarly, USAID has added an
Alternate clause exempting certain
contracts from the requirement to
provide a data management plan.
Specifically, contracts are exempted
that: contain no data; are for emergency
food assistance; are for disaster
assistance, and transition-assistance
activities managed by the Bureau for
Humanitarian Assistance (BHA); or are
for activities managed by the Bureau for
Conflict Prevention and Stabilization’s
Office of Transition Initiatives (CPS/
OTI).
PO 00000
Frm 00002
Fmt 4701
Sfmt 4700
c. The burden and cost estimates have
been updated to reflect the changes
outlined in paragraph b above, and the
comments received related to this
estimate are addressed in the revised
Regulatory Impact Analysis.
Additionally, comments regarding the
number of respondents and whether the
cost of design, testing, launch, and
management of the Digital Front Door
(DFD) website was subtracted are
addressed as well.
d. Clarified the timeline for
submission as outlined in AIDAR
752.227–71(f)(3)(i).
e. Various administrative
amendments and clarifications have
been added, such as revising references
throughout the rule to indicate that the
contracting officer, or contracting
officer’s representative if delegated, has
authority to approve on behalf of USAID
and renumbering of the AIDAR clause
sections to conform with USAID
numbering conventions.
2. Analysis of Public Comments
Below are the Agency’s responses to
comments on the changes proposed to
United States Agency for International
Development (USAID) Acquisition
Regulation (AIDAR): Planning,
Collection, and Submission of Digital
Information as Well as Submission of
Activity Monitoring, Evaluation, and
Learning Plan to USAID. The Agency
did not address comments unrelated to,
or outside the scope of, the revisions of
the proposed rule from the existing rule:
a. General Support for the Rule
1. Comment: Five respondents (7, 8, 9,
11, and 15) indicated general support
for the rule. Some commenters noted
that the rule will simplify reporting,
reduce redundant data calls, and reduce
the burden on contractors.
Response: USAID acknowledges the
respondent’s support for the rule.
b. Does Not Support the Rule
1. Comment: One respondent (16) did
not support the rule, indicating that it
will make it harder for contractors to act
responsibly with data management of
affected populations. Other commenters
(11, 15) did not indicate a lack of
support for the rule as a whole but did
note that complex submission
requirements may negatively impact
local partners, small business, and
potential market entrants due to
potential cost and needed technical
expertise.
Response: USAID acknowledges this
feedback to the rule.
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
c. Data Rights and Protection
Several commenters (6, 7, 8, 11, 13,
14, 15, and 16) brought up issues
around privacy, PII, publication, and
informed consent, which are addressed
in sub-categories as outlined below.
ddrumheller on DSK120RN23PROD with RULES7
1. Access to Data and Data Rights—
A. Comment: Several commenters (6,
11, 13) inquired about whether the DFD
will be public and available to other
partners like the Development
Experience Clearinghouse (DEC) and
Development Data Library (DDL).
Response: The DFD is not its own
system and is not intended to replace
other systems. It is a public facing web
page with centralized authentication
that will direct users to the appropriate
USAID systems for which they have
authorized access. This includes but is
not necessarily limited to the
Development Information Solution
(DIS), DEC, and DDL.
B. Comment: Commenter #8
specifically asked whether information
that is exempt from the DFD (like PII)
be submitted to USAID first as a
restricted version before being scrubbed
and sent to the DFD?
Response: The rule states that the
contractor must not submit information
to the DFD that contains personally
identifiable information. And that to the
maximum extent possible, the
contractor must remove the association
between the set of identifying data and
the individual to which it applies unless
retaining such information is essential
to comply with the terms of the contract
and upon written approval from the
contracting officer or contracting
officer’s representative as delegated to
submit this information. Otherwise, the
‘‘Submission Requirements’’ section
states that contractors must ‘‘submit
digital information created or obtained
in performance of this contract to
USAID at the finest level of granularity
at which it was collected.’’
C. Comment: Commenter #16
questioned whether the contractor
would be able to effectively restrict
access to sensitive data without fear of
losing funding.
Response: Some data might be
exempted from submission under
subsection (f)(4) of the clause, including
as determined by the contracting officer
or contracting officer’s representative as
delegated in (f)(4)(ii). The rule provides
for categories of information not to
submit to USAID. It further states that
if the Contractor believes there is a
compelling reason not to submit specific
digital information that does not fall
under an exemption in this section,
including circumstances where
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
submission may jeopardize the personal
safety of any individual or group, the
Contractor must obtain written approval
not to submit the digital information
from the contracting officer. Further
specifics under an individual award
may be discussed with a contracting
officer.
D. Comment: Some commenters (11,
13) noted that they did not believe it
was necessary (or questioned when
circumstances would require) to provide
copies of license agreements for digital
information or media releases.
Response: USAID believes it is critical
for USAID to have documentation
regarding the licenses for the digital
information submitted to the DFD so
that USAID understands the license
parameters for use of the data. As such,
data licenses are a submission
requirement in this rule.
2. Informed Consent
A. Comment: Commenter #16 noted
that the rule appears to contemplate
large collections of data for purposes
that cannot be fully known, which will
negate the ability for truly informed
consent to be given.
Response: The contract itself will
mandate the required information to be
collected and requirements relating to
human subjects research and USAID’s
data rights. The rule does not mandate
new digital information collections but
provides guidance on the management
of the specific digital information
collected under the contract. To the
extent the contractually required
collection triggers informed consent
requirements under Human Subjects
Research, this is governed by AIDAR
752.7012 (the Federal Policy for the
Protection of Human Subjects (the
‘‘Common Rule’’).
B. Comment: Commenter #8 indicated
if providing personal information is a
requirement for participation in an
activity (such as attending a training),
then providing such information can no
longer be considered ‘‘voluntary.’’ This
commenter recommended that the rule
explicitly address the rights of
respondents/human subjects to
voluntarily provide (or not provide) this
data/PII or to otherwise restrict sharing
of personal information.
Response: This rule does not address
the provision of personal information as
a precondition to receiving services.
Existing informed consent requirements
already address the voluntary provision
of information when respondents elect
to participate in human subjects
research. Explicitly addressing the
rights of respondents/human subjects is
outside the scope of this rule. Please
also refer to USAID’s responses in C.4
PO 00000
Frm 00003
Fmt 4701
Sfmt 4700
37949
of this section covering Protection of
Information.
C. Comment: Two commenters (11,
13) noted that Ref (f)(1)(v) refers to
AIDAR 752.7012; however, this only
pertains to the protection of the
individual as a research subject, which
is not applicable to every contract.
Response: USAID has updated the
rule to clarify that this requirement
applies only when AIDAR 752.7012 is
included in the contract. (See
corresponding edits to 752.227–
71(f)(1)(v)).
D. Comment: Commenter #14
requested clarity on 727.7002 Policy
(b)(3) noting that it is unclear if USAID
is requiring that the submission contain
every signed consent form, an
indication that each individual
submitted consent, or just a blank copy
of the form itself. They recommended
adding clarifying language in 752.227–
71.
Response: Paragraph (f)(1)(v) of this
clause already instructs contractors to
provide a ‘‘blank copy’’ so no further
edits are needed.
3. Preparation of Data
A. Comment: Commenter #8
expressed concerns that as written
proposed clause 752.227–71 requires
submission of data scrubbed of PII. They
indicate that scrubbing qualitative data
such as speech patterns and other
audio/video information is extremely
costly and time consuming without
sufficient guidance. As such, they
recommend providing guidance on
identifying high informational value
qualitative data and the process for deidentifying these data. Additionally,
they recommend: (1) clarifying the
definition of ‘‘machine readable’’ to
exclude unstructured qualitative data
like audio/video recordings, interview/
focus group notes and transcripts, and
(2) revising submission requirement (i)
to state, ‘‘Submit machine readable
digital information created or obtained
in performance of this contract to
USAID at the finest level of granularity
at which it was collected.’’
Response: Since audio or visual files
may contain PII, contractors should
work with their contracting officer
representative to determine whether the
information is necessary to submit, if an
alternative such as a transcript or
summary is acceptable, or an exemption
from submission is appropriate. The
contractor should address
considerations for specific media
formats and content during the
development of the Data Management
Plan. In addition, the draft rule allows
flexibility for specific circumstances
noting, ‘‘If the Contractor believes there
E:\FR\FM\06MYR7.SGM
06MYR7
37950
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
ddrumheller on DSK120RN23PROD with RULES7
is a compelling reason not to submit
specific digital information that does
not fall under an exemption in this
section, including circumstances where
submission may jeopardize the personal
safety of any individual or group, the
Contractor must obtain written approval
not to submit the digital information
from the contracting officer.’’ (See
752.227–71(f)(4)(ii) of the Proposed
Rule). No revisions to the rule are
necessary.
To the commenter’s follow-up
regarding ‘‘machine readable’’, USAID
has revised the final rule to indicate that
the machine-readability requirement
applies only to digital data and datasets,
thus excluding digital objects like audio
and video files (See edits to 752.227–
71(f)(1)(ii)). With regard to the
recommendation on submitting digital
information at the ‘‘finest level of
granularity at which it was collected,’’
there already exists a requirement in
752.227–71(f)(1)(i) to ‘‘Submit digital
information created or obtained in
performance of this contract to USAID
at the finest level of granularity at which
it was collected.’’ No further revisions
are necessary. (See also response to
c(4)(A) of this section below)
B. Comment: Commenter #7
questioned whether there would be
analog options, noting that print outs of
documents limit digital functionality
(i.e., a printed hyperlink cannot provide
the additional information that someone
may access in a digital copy).
Response: 752.227–71(f)(1)(i) states:
‘‘Use only digital methods and USAIDapproved standards to the extent
practicable . . .’’ This allows for analog
options in the event that digital methods
are not available or practicable.
4. Protection of Data
A. Comment: Some commenters (14,
16) expressed concerns about the
broadness of ‘‘finest level of
granularity’’ and requested that
guidance be given as to how granular
the data must be.
Response: Regarding the ‘‘finest level
of granularity’’, some, but not all,
USAID contracts will provide technical
details regarding the level of granularity
required. In the absence of such
technical guidance, contractors must
collect digital information at a level of
granularity that allows them to comply
with the terms of their award. Barring
specific exceptions outlined in the rule,
contractors must submit this digital
information at the same level of
granularity at which it was obtained,
rather than aggregating or otherwise
generalizing the information. USAID
will not necessarily publish or
otherwise share data at the same level
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
of granularity as submitted by the
contractor.
B. Comment: Commenter #16 noted
that some international standards
reference ‘personal data’ rather than PII,
which protects broader categories of
information to prevent re-identification
particularly in areas with humanitarian
concerns. Further, they noted that
USAID requirements may be contrary to
local rules and regulations regarding
data protection and asked if partners
will be given adequate support in these
situations.
Response: USAID adheres to
definitions and standards set forth by
the Office of Management and Budget
(OMB), including those in OMB Circular
A–130, which defines personally
identifiable information. USAID has
processes in place to manage reidentification risks concerning
personally identifiable information. In
the event a USAID partner identifies a
potential concern under local law that
could impact their ability to plan for
and adhere to the requirements of this
clause, they should identify that
concern during the Digital Information
Planning process and contact their
contracting officer representative for
additional guidance.
C. Comment: Commenter #11
questioned whether USAID would limit
methods, applications, or systems used
for data collection; how USAID will
define when digital data collection
methods are impractical; and what
process there is for Contractors to justify
withholding data information.
Response: This rule does not provide
specific requirements regarding
applications and systems that
contractors must use for data collection.
Whether certain methods are
impractical will be fact specific and
should be addressed with the
contracting officer representative. As to
the process for contractors to justify
withholding ‘‘data information’’ [sic],
the rule states, ‘‘(ii) If the Contractor
believes there is a compelling reason not
to submit specific digital information
that does not fall under an exemption in
this section, including circumstances
where submission may jeopardize the
personal safety of any individual or
group, the Contractor must obtain
written approval not to submit the
digital information from the contracting
officer.’’
d. Clarity on Language and
Requirements
1. Background, Authority, Timeline, and
Editorial
A. Comment: Several commenters (8,
11, 13) requested clarity on when to
PO 00000
Frm 00004
Fmt 4701
Sfmt 4700
submit digital information noting that
the clause says 30 calendar days but
also has an option to submit when the
information meets the requirements of
quality digital information or 30 days
after closeout. Some specifically noted
that allowing submission after closeout
could allow the incumbent access to
data which competitors for a follow-on
would not. Finally, one commenter (8)
asked that USAID consider providing
additional time (rather than 30 days
after contract end) and resources
(including funding) for data submission.
Response: With regard to clarification
on the submission timeline, USAID has
updated the rule to emphasize that the
contractor must adhere to the ‘‘schedule
of the contract.’’ Should a timeline for
a specific digital information not be
specified in the award schedule, the
language as written requires the
contractor to submit the information
‘‘once it meets the requirements of
quality digital information,’’ regardless
of when this criterion is met during the
award period. This is stated as a
requirement, not as an option. This is
intentional since USAID often requires
access to finalized (i.e., ‘‘quality’’)
information well before the end of a
typical five year contract. As the
contract draws to a close, USAID also
recognizes that valuable information
funded by the Agency may remain in
the contractor’s possession, whether in
draft or final ‘‘quality’’ form. For this
reason, there is an additional, nonoptional requirement to submit any
‘‘draft’’ and ‘‘quality’’ digital
information not previously submitted,
no later than 30-days after contract
completion. The fact that the incumbent
may still have access to this information
during the 30-day period after contract
completion does not in itself create a
conflict of interest for the incumbent.
The clause already allows the contractor
to obtain approval from the contracting
officer for variations to the 30 day
submission period. Any costs associated
with such submissions should be
anticipated and planned for during
proposal submission.
B. Comment: Commenter #11
recommended adding ‘‘as approved by
USAID’s Chief Information Officer’’ as
in Section (f)(1)(vi)(D)(2) throughout the
rest of the section.
Response: USAID believes the
language is sufficiently clear as written.
C. Comment: Two commenters (11,
13) requested clarity on which parts of
the mandates listed in the section
727.7000 of the proposed AIDAR text
will be implemented in the Rule.
Response: By implementing this rule,
USAID intends to enhance compliance
with several mandates which include
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
ddrumheller on DSK120RN23PROD with RULES7
but are not necessarily limited to the
following: (1) Broad sections of OMB
Circular A–130, with a particular focus
on Section 5 e. which outlines policy on
‘‘Information Management and Access;’’
(2) Foundations for Evidence-Based
Policymaking Act, with a focus on Title
II, ‘‘Open Government Data Act;’’ (3)
The 21st Century IDEA Act, with a focus
on Section 3, ‘‘Website Modernization;’’
and Section 4, ‘‘Digitization of
Government Services and Forms;’’ (4)
Foreign Aid Transparency and
Accountability Act, including Section 3
(c) ‘‘Objectives of Guidelines;’’ and (5)
the Geospatial Data Act, with a focus on
Section 2806, ‘‘Geospatial data
standards.’’
D. Comment: Commenter #8 noted
that the benefit of supporting
institutional learning and public
understanding of USAID program
impact should be more explicit in the
introduction.
Response: USAID appreciates this
comment but believes that the preamble
is sufficiently clear as written.
E. Comment: Commenter #11 asked
whether digital information requested
includes only information obtained for
the purpose of implementing
programmatic activities.
Response: USAID refers the
respondent to ‘‘727.7003 Contract
clause.’’ This section specifies the
insertion of the clause into ‘‘contracts
fully or partially funded with program
funds. . . .’’ Therefore, the primary
focus of this clause is on activities
resourced with program funds.
However, to limit burden, and per the
definitions of ‘‘data’’ and ‘‘digital
information’’ in the clause, there would
be no requirement to submit
‘‘information incidental to contract
administration, such as financial,
administrative, cost or pricing, or
management information.’’ Please see
also USAID’s response to the comment
in (4)(B) of this section.
F. Comment: Commenter #13
indicated that 752.227–71(f) makes a
reference to (f)(4) which, the respondent
suggests, does not exist.
Response: Section (f)(4) of 752.227–71
is entitled ‘‘Exemptions.’’
2. Digital Information, Methods, Objects,
and Inventory
A. Comment: Two commenters (8, 12)
requested a definition of ‘‘digital
methods’’ per 752.227–71 and noted
that as structured, the proposed rule
requires submission of digital data that
cannot comply with the machinereadable requirement (i.e., audio
recordings, transcripts).
Response: USAID has added a
definition for ‘‘digital methods’’ to
VerDate Sep<11>2014
23:50 May 03, 2024
Jkt 262001
Section 727.7001 and the clause
752.227–71(a). USAID appreciates the
comment highlighting the challenges
with submitting audiovisual files in
machine readable format. In light of this
issue, USAID has revised the final rule
to indicate that the machine-readability
requirement applies only to digital data
and datasets. (See 752.227–71(f)(1)(ii)).
B. Comment: Commenter #11
requested a definition of both ‘‘data
inventory’’ and ‘‘any digital object’’.
Response: USAID appreciates these
comments and has added definitions for
‘‘digital’’ and ‘‘data inventory’’ to
Section 727.7001 and the clause
752.227–71(a). USAID notes that
‘‘digital object’’ is already defined in the
clause.
3. Beneficiary Feedback
A. Comment: Commenter #8
requested clarity on how ‘‘beneficiary’’
is defined, and who will define the term
(i.e., do Contractors identify
beneficiaries to elicit feedback from).
Response: This aspect of the rule is
intended to implement a recurring
requirement of recent appropriations
acts. Most recently, in the FY 2022
Consolidated Appropriations Act
Congress directed that Development
Assistance (DA) funds shall be made
available for the regular and systematic
collection of feedback obtained directly
from beneficiaries to enhance the
quality and relevance of such assistance.
The term ‘‘beneficiary’’ is not defined in
this statute; its use herein is intended to
be consistent with its use in the AIDAR,
agency internal policies (Automated
Directives Systems), and other agency
policy and procedural documents. At
times the individuals who may be
considered as ‘‘beneficiaries’’ for a
particular contract may depend on the
specific nature of the contract and the
implementation context. USAID
believes it is not necessary to create a
unique definition of ‘‘beneficiary’’ for
the purpose of this rule, no changes to
the AIDAR text are made. Specific
concerns regarding identification of
beneficiaries for an award may be
discussed with a contracting officer.
B. Comment: Commenter #11
requested more clarity on what USAID
means by ‘‘feedback’’ noting that there
may be an appearance of coercion as
beneficiaries receive benefits from the
program. Given that potential conflict,
will USAID use this feedback to assess
contractor performance or USAID’s
performance? Will questions be drafted
and solicited through USAID or the
contractor?
Response: While USAID does not
define the term ‘‘feedback’’ per se, the
AIDAR clause 752.242–71 contains the
PO 00000
Frm 00005
Fmt 4701
Sfmt 4700
37951
definition of ‘‘feedback from
beneficiaries’’, which emphasizes the
voluntary nature of these
communications. As with any other data
collection process managed by USAID
contractors, beneficiary feedback must
not be collected through coercion.
Contractors must not withhold benefits
based on whether a beneficiary provides
feedback or the nature of the feedback
about the benefits received.
Contracting officers may rely on
information obtained from beneficiary
feedback, or any other sources, as
appropriate in evaluating past
performance of offerors as permitted in
the FAR. (For examples see FAR
15.305(a)(2)(ii), 13.106–2(b)(3)(ii)) and
FAR 12.206). Managers and decisionmakers within USAID operating units
will determine if beneficiary feedback
will also be used to assess USAID’s
performance. As to whether questions
for soliciting feedback from
beneficiaries will be drafted by USAID
or the contractor, this will depend on
the specific contract and the final
Activity MEL Plan which should
include the contractor’s plans for
collecting, responding to, and reporting
on feedback from beneficiaries, if
required by the contract. USAID may
consult with contractors as necessary in
developing the Activity MEL Plan to
ensure the proposed methods of
collecting, responding to, and reporting
beneficiary feedback is appropriate
under the particular contract and
activity.
C. Comment: Commenter #8 requested
clarity on how the information will be
used and recommended verification via
third party or further guidance to
prevent bias.
Response: USAID expects that
contractors will review the feedback
they receive and use it in their
management decision-making as noted
in the Federal Register notice to
enhance the quality and relevance of
USAID programs and to maximize the
cost-effectiveness and utility of these
programs for beneficiaries. We
appreciate the recommendation that
USAID verify beneficiary feedback
information via a third party; if
applicable, appropriate means of
verifying contract compliance with this
rule will be determined for each
contract by the contract officer and
contract officer’s representative.
D. Comment: Commenter #12
requested clarity on the term ‘‘costeffectiveness’’—specifically whether
contractors will be expected to use
feedback generally to over-all cost
effectiveness or whether they will
perform a formal cost effectiveness
analysis.
E:\FR\FM\06MYR7.SGM
06MYR7
37952
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
ddrumheller on DSK120RN23PROD with RULES7
Response: USAID contractors will not
generally be expected to perform a
formal cost effectiveness analysis solely
based on beneficiary feedback. Rather,
USAID expects that feedback from
beneficiaries will be generally useful to
the management decision-making of the
contractor, particularly regarding
adaptations a contractor might make to
their implementation processes that
could improve cost-effectiveness and
utility of the assistance provided to
beneficiaries.
E. Comment: Commenter #10
requested clarity on whether the
definition of ‘‘regularly’’ collected
feedback that is ‘‘appropriate’’ and
‘‘feasible’’ will be determined by the
contractor and USAID during AMELP
development.
Response: Rather than establishing
the definition of ‘‘regularly’’, USAID
expects that a determination of
‘‘regular’’ feedback collection will
depend on the size and scope of the
activity and will be determined by the
contractor and USAID during AMELP
development, unless the frequency of
beneficiary feedback collection is
specified in the contract.
F. Comment: Commenter #14
requested clarity on if beneficiary
feedback data collection could be
combined with other collections.
Response: Unless mandated to be
collected and reported separately by the
award terms, beneficiary feedback may
be combined with other data collection
efforts.
4. Finest Level of Granularity
A. Comment: Several commenters (9,
10, 11, 13, 15) requested clarity on the
term ‘‘finest level of granularity’’ with
several requesting that each contract
should specify the level of detail (or
allow for flexibility to ensure protection
of data) noting concerns that a strict
interpretation may result in turning over
unnecessary, sensitive data. One (10)
commenter inquired whether the
contractor will use their own definitions
of granularity or if there will be a
USAID-defined standard or template (or
process to determine this level of
granularity) and questioned if the DFD
submission would include any raw data
in digital form.
Response: Some, but not all, USAID
contracts will provide technical details
regarding the level of granularity
required. However, it is not practical to
pre-specify levels of data granularity in
all contracts, as the Agency may need to
allow some contractor discretion in this
area. Therefore, during ‘‘Digital
information planning requirements’’ as
specified in paragraph (b) of the clause
752.227–71, contractors should propose
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
a level of granularity that allows them
to comply with the terms of their award.
Barring specific exceptions outlined in
the clause 752.227–71, contractors must
submit this digital information at the
same level of granularity at which it was
obtained, rather than aggregating or
otherwise generalizing the information.
Depending on the requirements of the
contract, the DFD submission process
may include the submission of raw data
in digital form, to include entering raw
data in online DFD templates or the
upload of entire datasets.
B. Comment: Some commenters (11,
12) requested further information on
how the granular data would be used
and submitted—specifically asking if it
will only be for the purpose of
implementing programmatic activities.
Response: USAID’s usage of the data
will be determined by the data rights
clause in the contract.
C. Comment: Commenter #16
recommended removing the
requirement to share data at the finest
level of granularity. Barring that, they
requested guidance for exemptions to
prevent potential re-identification of
parties due to transmission of PII and
potential data leaks.
Response: USAID cannot remove the
‘‘finest level of granularity’’ requirement
without jeopardizing its ability to
accomplish its mission. USAID is aware
that re-identification risk increases with
granularity and appreciates that
commenters are aware of this. To this
end, USAID has included exemptions
from submission (See 752.227–71(f)(4))
and indicated that PII submitted should
be limited to the maximum extent
practicable (See 752.227–71(d)(2)).
Moreover, USAID will not necessarily
publish or otherwise share data at the
same level of granularity as submitted
by the contractor, especially if the
contractor submits sensitive data.
Regarding the request for additional
guidance, this is outside the scope of
this rule.
5. Digital Standards, Repositories, and
Alternate Technologies
A. Comment: Some commenters (11,
13) requested a definition of alternate
technology and information on how to
know if the Chief Information Officer
(CIO) has approved it.
Response: Technologies that are
approved for USAID use fluctuate
frequently, given the rapidly changing
nature of technology itself. This makes
it impracticable to provide a list or
definition of USAID’s approved
technologies in a static document.
Contractors must seek approval to use
alternate technologies by contacting
their Contracting Officer. The
PO 00000
Frm 00006
Fmt 4701
Sfmt 4700
Contracting Officer will seek approval
in consultation with USAID’s Office of
the Chief Information Officer and
USAID policy.
B. Comment: Some commenters (11,
13) noted that the hyperlink provided in
(h) (data.usaid.gov/guidelines) was
inoperable and requested access to the
information for review.
Response: USAID will update the
hyperlink to indicate data.usaid.gov/
standards (see revised text in 752.227–
71(h)). On April 14, 2023 USAID
published a Notice of availability of a
supplemental document in the Federal
Register (88 FR 22990) specifically
noting that USAID received requests
under the comment period for this rule
to provide access to the standards. The
supplemental document entitled
‘‘USAID Digital Collection and
Submission Standards’’ was available
for comment. USAID collected those
comments and provided a response to
them in this document.
C. Comment: Several commenters (11,
13, 14) requested information on what
the USAID approved standards are and
if they will be provided to contractors.
Response: USAID published the
‘‘USAID Digital Collection and
Submission Standards’’ in the Federal
Register (88 FR 22990) on April 14,
2023 and provided a comment period
for the public.
D. Comment: Some commenters (11,
13) requested a definition of USAIDapproved by digital repository.
Response: USAID is not including a
definition of a ‘‘USAID-approved digital
repository’’ in the rule as this
determination is an internal policy
decision. USAID’s policies on
acceptable digital repositories will be
informed, in part, by the standards for
digital repositories developed by the
interagency Subcommittee on Open
Science of the National Science and
Technology Council (NSTC). This
includes those found in the document
Desirable Characteristics of Data
Repositories for Federally Funded
Research, released by OSTP in May
2022 (available at: https://
www.whitehouse.gov/wp-content/
uploads/2022/05/05-2022-DesirableCharacteristics-of-DataRepositories.pdf).
E. Comment: Commenter #9
recommended using or aligning with the
International Aid Transparency
Initiative rather than a USAID-approved
standard.
Response: Since the U.S. Government
as a whole is a signatory to IATI (see:
https://iatistandard.org/en/news/unitedstates-marks-10-years-since-becomingan-iati-signatory/), USAID has included
IATI as a recommended standard.
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
ddrumheller on DSK120RN23PROD with RULES7
Should a data standard for a specific
subject area not be available at
data.usaid.gov/standards, the standard
will be indicated in the contract itself or
provided to the contractor upon
consultation with the Contracting
Officer.
F. Comment: Commenter #11 asked
how USAID will define data
standards—in the contract or agreed
upon in the data management plan.
Response: USAID published the
‘‘USAID Digital Collection and
Submission Standards’’ in the Federal
Register (88 FR 22990) on April 14,
2023, and provided a comment period
for the public.
6. Data Management Plan
A. Comment: Some commenters (11,
13) requested clarity on the
requirements of a Data Management
Plan with one noting that if DMP
requirements are outlined in ADS 579,
they should be directly in the rule as the
ADS is USAID internal guidance.
Response: The preamble to the rule
contains references to ADS 579 as
background information only. However,
the specific Data Management Plan
(DMP) requirements are outlined in the
proposed clause in 752.227–71(c)(2)
What to submit.
B. Comment: Commenter #9 requested
that contractors be allowed to identify
which data they cannot share with
USAID along with an appropriate
justification.
Response: AIDAR 752.227–71(f)(4)(ii)
indicates that ‘‘[i]f the Contractor
believes there is a compelling reason not
to submit specific digital information
that does not fall under an exemption in
this section, including circumstances
where submission may jeopardize the
personal safety of any individual or
group, the Contractor must obtain
written approval not to submit the
digital information from the contracting
officer.’’
C. Comment: Commenter #8 requested
clarity on which types of data and/or
contracts will require a DMP.
Response: The rule, as revised, states
that the clause applies to ‘‘solicitations
and contracts fully or partially funded
with program funds exceeding the
simplified acquisition threshold.’’ (See
727.7003 and 752.227–71) Paragraph (c)
of this clause includes the DMP
requirements. As outlined in 727.7003,
this paragraph is ‘‘[reserved]’’ and DMP
requirements not applicable when the
anticipated contract: (1) does not collect
data; (2) implements emergency food
assistance under the Food for Peace Act
or section 491 of the Foreign Assistance
Act of 1961, including for the
procurement, transportation, storage,
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
handling and/or distribution of such
assistance; (3) implements international
disaster assistance under section 491 of
the Foreign Assistance Act of 1961 or
other authorities administered by the
Bureau for Humanitarian Assistance; or
(4) implements activities managed by
the Bureau for Conflict Prevention and
Stabilization’s Office of Transition
Initiatives, or fully or partially funded
with the Complex Crises Fund.
D. Comment: Commenter #13 noted
that not allowing digital information
collection until the DMP is approved
may delay implementation.
Response: The contractor must begin
award implementation upon formal
approval of the award. However, digital
information collection must not begin
prior to approval of the data inventory
and submission of any remaining
components of the DMP unless
authorized in writing by the contracting
officer. Based on multiple lessons
learned, USAID believes the value of
requiring a DMP to far outweigh
potential delays in submissions.
E. Comment: Several commenters (8,
10, 11, 14) requested clarity on the
timeline, processes, and standards for
DMPs—specifically information on
what the documentation will look like;
how standards will be defined that the
contractor may be audited against; who
will review/approve DMPs and
standards for such approval; how
approval officials will be trained as well
as the timeline for review with a
recommendation that they be reviewed
annually; whether USAID will provide
a template.
Response: This rule does not provide
specific requirements on DMP
standards, review, approval, templates,
or training of USAID officials. Awards
will have varying requirements on these
matters, and partners must consult the
terms of their award for specific details.
These issues will be further addressed
by USAID policy which USAID staff
must consult in providing direction to
implementing partners. For additional
information, please consult ADS 579—
USAID Development Data (available at:
https://www.usaid.gov/about-us/agencypolicy/series-500/579).
F. Comment: Commenter #14
requested that the DMP be part of the
AMELP given that many of the
requirements overlap (with another (11)
asking for clarity on if they are separate
requirements.
Response: The requirement to submit
a DMP is distinct from the requirement
to submit an Activity MEL plan. Both
plans serve distinct purposes, as
described in the rule, and some
activities that do not require an Activity
MEL plan may still require a DMP.
PO 00000
Frm 00007
Fmt 4701
Sfmt 4700
37953
Unless otherwise precluded by the
terms and conditions of their contract,
contractors required to submit both a
DMP and an Activity MEL plan may
submit a DMP as a section of an Activity
MEL plan or as a separate stand-alone
plan.
7. Activity Monitoring Evaluation and
Learning Plan
A. Comment: Commenter #13 noted
that the clause cites ADS 200/201 which
is internal policy and requested that the
clause itself address plan requirements.
Response: The only reference to ADS
201 in the proposed AIDAR text is
included in section 742.1170–5, as a
source of additional information on
USAID program cycle activity
monitoring, evaluation and learning.
The clause at 752.242–71 fully
addresses the requirements for the
Activity Monitoring, Evaluation, and
Learning Plan.
B. Comment: Commenter #11
requested adoption of a longer timeline
to develop the Activity MEL Plan
(currently 90 days) citing UK agencies
which use a six- to 12-month timeframe.
Response: Regarding the
recommendation to adopt a longer
timeline to develop the Activity MEL
Plan, USAID, after consideration of the
public comment, has determined to
maintain the 90-day timeline, unless
otherwise specified in the contract
schedule. OMB guidance M–18–04
regarding Monitoring and Evaluation
Guidelines for Federal Departments and
Agencies that Administer United States
Foreign Assistance recommends that
monitoring and evaluation be planned
early. USAID’s experience has shown
that adherence to a 90-day timeline has
provided sufficient time to generate an
actionable AMELP without resulting in
significant programmatic delays.
Without obtaining an AMELP from the
contractor in the early stages of activity
implementation, USAID faces decreased
ability to determine that U.S. Foreign
Assistance goals are being met. Notably,
AMELPs may be revised and updated,
in coordination with USAID, as
additional information becomes
available.
8. Risk
A. Comment: Commenter #16
requested that a limited purpose for the
collection be set out as well as time
limits of data retention and clear
requirements for data security and
literacy.
Response: The scope of the contract
itself will provide clarity on the purpose
of the collection. USAID adheres to the
requirements of the Federal Records Act
for the retention of records and any
E:\FR\FM\06MYR7.SGM
06MYR7
ddrumheller on DSK120RN23PROD with RULES7
37954
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
retention requirements on contractors
will be outlined in the award. USAID
requirements on data literacy and
security are determined by the Agency’s
internal policies. USAID requirements
for the contractor on data literacy and
security would be outlined in the
award.
B. Comment: Commenter #13
requested that paragraph (g)(2) be
amended to indicate that the
government may direct an embargo for
one year when the contractor submits
digital objects as mandating it may
result in ineligibility to bid for followon contracts.
Response: The rule as currently
written indicates that the ‘‘Contractor
may request . . an embargo. . . .’’ and
that the ‘‘contracting officer or delegated
contracting officer’s representative may
approve an embargo. . . .’’ (See
752.227–71(g)(2), emphasis added) This
is intentionally permissive language. Per
the August 25, 2022, memo from the
White House Office of Science and
Technology Policy entitled, ‘‘Ensuring
Free, Immediate, and Equitable Access
to Federally Funded Research,’’ USAID
may approve embargoes, including
those that support foreign policy and
international development objectives
but currently has no reason to mandate
embargoes.
C. Comment: Commenter #13
requested that the rule allow for the
implementer to add a disclaimer of
liability of information per section
(f)(vi)(B).
Response: Please note that contractors
are already allowed under 752.227–
71(f)(1)(vi) of the rule to ‘‘provide
additional details or metadata’’
regarding the ‘‘quality of submissions of
draft digital information.’’ This
additional information would alert
USAID, as well as other potential users
of the data, to any potential drawbacks
of using the submitted information to
draw definitive conclusions.
D. Comment: Some commenters (11,
13) requested information on who will
perform the ‘‘rigorous risk assessment of
digital information submitted to
USAID’’ and whether there will be
guidance or a timeline provided; they
additionally asked about permissions
and restrictions to digital information to
the DFD and whether the public will
have access.
Response: USAID’s risk assessment
process will begin after submission of
information via the DFD and will
involve multiple experts spanning
several parts of the Agency. For
additional information, ADS 579
outlines the existing implementation of
this process. USAID will apply
permissions and restrictions to digital
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
information submitted via the DFD as
consistent with its existing information
technology policies as outlined in the
ADS 500 series. Information submitted
via the DFD may be entirely restricted
from public view, made available to
bona fide research institutions, made
partially available to the public, or made
entirely available to the public, in
accordance with existing U.S.
government mandates, depending on
the sensitivity of the information or
other legal considerations.
e. USAID Systems and Processes
1. Digital Portals
A. Comment: Several commenters (6,
11, 12, 13, 17) asked whether this rule
will retire existing digital portals such
as the DEC, DDL, DIS, FTFMS, and
other Mission level systems and if so,
that a list of portals, processes, and
protocols eliminated be provided with a
timeline to ease transition.
Response: The DFD is not its own
system and is not intended to replace
other systems. It is a public facing web
page with centralized authentication
that will direct users to the appropriate
USAID systems for which they have
authorized access. This includes but is
not necessarily limited to the
Development Information Solution
(DIS), Development Experience
Clearinghouse (DEC), and Development
Data Library (DDL). Upon publication of
this rule, contractor requirements in
AIDAR Clause (DEC) 752.7005 will be
eliminated.
B. Comment: Some commenters (6, 8,
13) wondered if legacy documents from
existing portals (DEC/DDL) will be
available or if these portals can be
maintained during the transitional
period (and if maintained, how would
they change)?
Response: Digital objects that are
publicly available via the DEC, DDL,
and other public-facing data portals will
continue to be available as the DFD
requirement is implemented.
C. Comment: Some commenters (11,
13, 17) asked that in the event that other
portals are not retired, under what
circumstances would contractors be
required to submit to these other portals
(i.e. the DIS; or whether draft digital
information goes to the DFD or another
digital repository).
Response: While the DEC and other
submission clauses will be retired upon
implementation of this rule, the systems
will continue to exist in their current
form. However, submission workflows
into those systems will take place via
the DFD, reducing the total number of
URLs required to meet contractual
requirements.
PO 00000
Frm 00008
Fmt 4701
Sfmt 4700
D. Comment: Some commenters (11,
13) noted that the link to dfd.usaid.gov
is not live and requested access to
review.
Response: The link to the DFD will be
active upon publication of the final rule.
E. Comment: Commenter #11 asked
whether contractors will maintain
unique registrations on the DFD for each
contract.
Response: The contractor can choose
whether to assign a single individual to
submit information on behalf of
multiple contracts or to assign a single
individual to submit information for
each individual contract. However,
contractors must ensure compliance
with the requirements in the clause for
each individual award.
F. Comment: Commenter #17
requested standard reporting templates
for submissions to the DFD and asked
about integration of existing monitoring
tools. They (17) further asked about
USAID’s plan to address technical
challenges and limitations for global
systems implementation and learning
curves/technical deficiencies
internationally.
Response: Rather than providing
standard USAID templates, the user
interface for each system will guide
partners in entering the information
required. To address the learning curve
associated with these changes, USAID
will continue to provide training,
communications, and instructional
guides to facilitate the transition.
G. Comment: Commenter #8 noted
that the current DDL platform has a 500variable maximum for .csv submission
resulting in large datasets needing to be
broken up into parts.
Response: The Agency is aware of
technical limitations in submitting
datasets to the DDL and continues to
work to make ongoing enhancements to
these technologies.
2. Revisions to Existing Policy
Comment: Two commenters (11, 13)
asked whether ADS 302.3.5.21
(Submissions of Datasets to the
Development Data Library (DDL)
(October 2014)) will be removed or
revised as the proposed rule removes
AIDAR 752.7005 and the anticipated
timeline for removal.
Response: Yes. USAID’s internal
policy guidance will be amended to
reflect the change to the AIDAR. The
rule currently removes and reserves
AIDAR 752.7005.
3. Contracting Officer’s Representative
Approvals
A.Comment: Some commenters (11,
13) noted that language giving
Contracting Officer’s Representative
E:\FR\FM\06MYR7.SGM
06MYR7
ddrumheller on DSK120RN23PROD with RULES7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
discretion to change submission
requirements may lead to confusion,
and commenter #11 recommended that
COR discretion to tell a contractor
where to submit information should be
on a mission basis instead. Commenter
#11 noted that requiring COR approval
each time an exception is necessary is
prohibitively costly in politically
insecure or otherwise challenging
environments.
Response: USAID believes that
allowing COR discretion on submission
requirements is essential given that
submission questions are often fact
specific. In addition, USAID is
developing guidance for CORs and
USAID staff on how to handle such
requests in order to ensure a consistent
approach to the greatest extent possible.
This guidance will also outline alternate
technologies and USAID-approved
repositories for the submission of digital
information. USAID does not agree that
COR involvement in granting
exemptions is unreasonable in
challenging operational environments.
To the maximum extent practicable, the
contractor should address these
challenges during the digital
information planning process in order to
mitigate unforeseen costs and to obtain
necessary approvals should such
circumstances arise.
B. Comment: Some commenters (11,
13) requested more information on
processes for the approval of digital
information, to include whether
approvals of digital information are
granted within or outside the DFD.
These commenters also requested
information on the submission
exemption process.
Response: The means of granting
approval will vary based on the type of
digital information submitted. USAID
has updated the AIDAR requirements in
752.227–71(f)(3)(i) to clarify that with
the exception of datasets, the Contractor
must submit all other digital objects
within 30 days of obtaining the
contracting officer or delegated
contracting officer representative’s
approval. This pre-submission approval
process will generally take place via
email. The direct submission of digital
data (e.g. indicator data) and datasets
via the DFD will trigger a semiautomated approval process that will
take place directly within USAID
information systems. This process will
take place via a combination of systemgenerated messages and email
exchanges with USAID personnel.
Exemptions are already addressed in
AIDAR 752.227–71(f)(4) and will be
granted on a case-by-case basis.
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
4. Exceptions and Oversight
A. Comment: Commenter #11
requested information on the process to
exempt data submission when the
personal safety of an individual or
group is jeopardized.
Response: Circumstances that
jeopardize the safety of an individual or
group can vary widely, and USAID will
address these on a case-by-case basis. To
enable USAID to make an informed
decision tailored to the specific
circumstance, AIDAR 752.227–
71(f)(1)(vi)(A) requires that the
contractor furnish details and/or
metadata regarding known sensitivities
within digital information that may
jeopardize the personal safety of any
individual or group. In addition,
contractors should use the digital
information planning process to identify
any potential security or safety concerns
early in the activity to the greatest
extent possible.
B. Comment: Commenter #7 asked
whether there would be USAID/
Washington oversight of the
recommended contractual requirements.
Response: Contract Officers will
monitor individual contracts for
compliance with submission
requirements. In addition, USAID/
Washington will periodically monitor
information systems to help ensure that
submissions received are consistent
with planned submissions identified by
the contractor during the digital
information planning process. Members
of the public who observe that
documents or other digital artifacts are
missing from USAID’s public websites
are encouraged to contact USAID
directly. In some cases, these documents
may be awaiting further curation by staff
or exempted from public disclosure due
to sensitivities or other legal
considerations.
f. Applicability
1. Acquisition vs. Assistance
Comment: Several commenters (5, 6,
8) inquired about whether these
provisions would be for contracts
only—specifically asking about the use
of the word ‘contractor’ rather than
‘implementing partner’.
Response: This rulemaking action is
to amend the AIDAR which is USAID’s
supplement to the FAR. As such, this
only pertains to contracts.
2. Existing Contracts
Comment: Some commenters (8, 12)
asked whether existing contracts would
be amended resulting in revisions to
already approved AMELPs or the need
to develop DMPs and whether
PO 00000
Frm 00009
Fmt 4701
Sfmt 4700
37955
additional funding would be provided
for these actions.
Response: The requirements
established by this rule will apply to all
new contracts that meet the
applicability criteria defined in this
rule. However, USAID may modify, in
accordance with FAR 1.108(d): 1)
existing indefinite delivery contracts to
include the new AIDAR clauses for
future orders, and 2) existing contract or
task or delivery order when exercising
an option or modifying a contract or
order to extend the period of
performance.
3. Burden on Small Entities
A. Comment: Some commenters (11,
13) inquired as to the need to apply
these clauses to any contract above the
micro-purchase threshold noting the
increased burden on small entities.
They requested it to be changed to the
Simplified Acquisition Threshold.
Response: USAID accepts the
recommendation to revise applicability
to contracts above the Simplified
Acquisition Threshold. The
corresponding changes are made to
sections 727.7003 and 752.227–71.
B. Comment: Commenter #11 noted
that the requirement to submit media
release templates is particularly onerous
to small business and requested that
images be allowed to be credited/
captioned by source.
Response: In order to use photos
submitted by contractors which contain
images of individuals, USAID must
establish that the individuals provided
consent to appear in the photos. USAID
therefore requires media releases for
these photos, which cannot be
accomplished via photo captioning.
C. Comment: Two commenters (10,
15) noted that requiring only digital
methods will carry substantial burden
and cost which may disadvantage local
and new contractors. They recommend
allowing a broader range of approaches,
from digital to manual (with digital
being preferred and used as appropriate
and practical) and asked whether
USAID approval would be necessary.
Response: Should the contractor
encounter obstacles adhering to digital
collection methods, the contractor must
first identify these in the Data
Management Plan. USAID may allow for
an alternative collection method on a
case-by-case basis per the exception in
Section 752.227–71(d)(1)(i). This
exception may apply, for instance, to
situations where availability of or access
to digital technologies is limited; where
the knowledge and capacity to use them
may be limited; or circumstances where
their use may prove overly burdensome.
E:\FR\FM\06MYR7.SGM
06MYR7
37956
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
4. Other Applicability Questions
A. Comment: Commenter #6 asked
whether this rule covers GIS data
projects that are submitted to Missions.
Response: The draft rule applies to
‘‘digital information produced,
furnished, acquired, or collected in
performance of a USAID contract,’’ and
therefore also applies to GIS data
projects that may be submitted to
missions.
B. Comment: Commenter #15 asked if
the rule is applicable only for US
Government standard indicators or
custom indicators as well.
Response: The rule applies to both
standard and custom indicator data
under the broader definition of ‘‘digital
information.’’
ddrumheller on DSK120RN23PROD with RULES7
g. Out of Scope
A. Comment: Several commenters (1,
2, 3, and 4) included comments which
were not within the scope of the rule
including topics such as Presidential
visits, criticism of the agency broadly,
questions about registration, and
concerns related to COVID vaccination.
Response: USAID acknowledges
receipt of these out-of-scope comments.
B. Comment: Commenter #13
inquired about USAID’s response to the
Paperwork Reduction Act request for
comments on the DIS Pilot.
Response: The DIS Pilot comments
are addressed separately alongside this
rule.
C. Comment: Commenter #13
questioned the cost analysis—
specifically about the determination of
respondents; whether the DIS costs were
included in the Rule; whether
decommissioning of certain portals was
included; and whether the cost of
design, testing, launch, and
management of the DFD system was
considered.
Response: Please see the Regulatory
Impact Analysis (RIA) for more detail
regarding respondents. Because DIS is
intended to be an Agency-wide portfolio
management system covering the entire
program cycle, internal costs unrelated
to this rulemaking effort were not
included in the RIA. Costs related to
partner submission of information via
the Digital Front Door have been added
to the revised RIA. USAID’s long-term
vision is to combine the Development
Experience Clearinghouse (DEC) and
Development Data Library (DDL) into a
single digital repository. As this
repository is still in planning stages and
is outside the scope of this rulemaking,
costs are not available, and USAID did
not take them into account in the RIA
for this rulemaking. Please see the
revised RIA for detail on the estimated
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
cost of establishing the Digital Front
Door.
D. Comment: Commenter #15
requested suggested language for
informed consent forms noting that in
order to obtain informed consent, the
contractor will need to clearly describe
how the data submitted to the DFD will
be accessed and used.
Response: Suggested language for
informed consent is outside the scope of
this rule.
E. Comment: Commenter #8 noted
that local partners under assistance may
lack the data management capacity to
implement this rule.
Response: USAID’s assistance awards
are outside the scope of this rule.
F. Comment: Commenter #11
requested a definition of forms of
informed consent, guidance on
collection, and what forms of collection
are appropriate to document informed
consent.
Response: USAID requirements
relative to informed consent for human
subjects research are found in 22 CFR
part 225 and are thus not covered under
the scope of this rule.
G. Comment: Commenter #15
requested that the rule include language
regarding coordination of contractors
with in-country review boards and other
governing bodies.
Response: This is outside the scope of
this rule which deals with digital
information planning, collection, and
submission.
H. Comment: Two commenters (11,
13) questioned how USAID will protect
proprietary data if contractors submit
such data in accordance with (f)(1)(ii)
from competitors; how USAID will
share data security issues with partners;
and how USAID and the contractor will
share data security responsibility.
Response: These comments regarding
USAID’s security responsibilities are
beyond the scope of this rule. USAID is
subject to legal and policy requirements
on implementing adequate safeguards
for handling business confidential and
proprietary information. Contractors
must follow the terms of their award
regarding security and privacy
requirements.
I. Comment: Commenter #16
indicated concern about the length of
time of data retention by USAID, data
security for certain local organizations
who may lack expertise
Response: USAID retains and
disposes of electronic records in
accordance with National Archives and
Records Administration rules and
policies. Regarding concerns that local
partners may lack data security
expertise and the need for support, this
is outside the scope of the rule.
PO 00000
Frm 00010
Fmt 4701
Sfmt 4700
J. Comment: Commenter #7 asked if
the DMP requirements will relate in any
way to the USAID Digital Strategy
requirements of a Digital Learning Plan
and the regular requirement of a
Learning Agenda; and if so, whether
USAID will manage and communicate
evolving guidance to contractors on
these various mandates.
Response: Specifics on how DMPs
relate to internal USAID guidance are
outside the scope of this rule.
Summary of Changes and Response to
Comments on the Notice of Availability
of Supplemental Document, Published
in the Federal Register at 88 FR 22990
on April 14, 2023
Three respondents submitted public
comments in response to the Notice.
USAID reviewed the public comments
in the development of the final rule.
Based on the comments, the
supplemental document has been
revised as outlined in (i) below.
Additionally, changes to the
‘‘geospatial’’ language have been made
to align with USAID policy. Note that
the text is provided without hyperlinks
in this document, but they are available
at data.usaid.gov/standards. Below are
the Agency’s responses to comments
and the changes made to the rule as a
result of those comments are provided
as follows:
h. Comment #1: requested
information on how to access an
account.
Response: This is outside the scope of
this rulemaking.
i. Comment #2: noted that the
inclusion of ‘‘Metadata Creation Tools’’
may be inappropriate. They indicated
that including specific tools may give an
appearance of preference or
endorsement of such tools as they may
not be the best for the job and that
updating the AIDAR will take a long
time potentially locking in the use of
outdated tools.
Response: USAID has updated the
standards to cite a non-exhaustive list of
potential metadata tools, rather than to
explicitly list them under
‘‘Recommended Digital Information
Technical Standards.’’
j. Comment #3: indicated general
support for rule and moving to digital
information. The respondent requested
that there be policies to standardize
information collection in the Data
Management Plan and noted that USAID
may be able to provide standardized
templates for data collection.
Response: This comment is outside
the scope of the rulemaking. USAID
solicited comments as to the standards,
including the text of AIDAR 752.227–
71(h) that refers to the standards. USAID
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
received comments on the Data
Management Plan during the comment
period for the proposed rulemaking, and
responses to those comments are
available in Section d.6 above.
Response to Comments on DIS Pilot
Seventeen respondents submitted
public comments in response to the DIS
Pilot. USAID reviewed the public
comments in the development of the
final rule. Below are the Agency’s
responses to comments on the DIS Pilot.
Some of the comments received will not
be addressed as RIN 0412–AA90 makes
a response unnecessary. Those
comments are summarized in the
section below. Additionally, some
comments have already been addressed
in responses to comments received
under the proposed rule which are also
summarized below. The Agency did not
address comments unrelated to, or
outside the scope of, the 30-day
Information Collection Notice:
ddrumheller on DSK120RN23PROD with RULES7
k. General Support for the Collection
1. Comment: Commenter #17
indicated general support for the
collection. They noted that the rule will
simplify reporting, reduce redundant
data calls, and reduce the burden on
contractors.
Response: USAID acknowledges the
support for the collection.
1. Comments That Are Superseded by
the Rule
Comment: Two commenters (14, 17)
requested information on the burden
estimate. Commenter #14 questioned
the benefit of the system. Commenter
#10 questioned which countries had to
implement the pilot. Two commenters
(3, 17) questioned the length of the
pilot, if the pilot results would be made
public, how data migration will occur
after the pilot, what language should be
included in contracts, and whether RIN
0412–AA90 would be published for
comment. Several commenters (3, 12,
13, 14, 16, 17) asked about API and
connections to other data systems,
standardizing requirements and
guidance, concern regarding
reidentification and other security risks,
what data would need to be submitted,
cost allowability, information about
approvals and how data will be used,
reporting frequency, data aggregation,
what indicator information would be
used as well as if they can be
customized, and other process questions
about the pilot. Commenter #3 asked
about an OIG Audit and its impact on
the pilot. Commenter #8 indicated that
on Item 20, Sec 2 (‘‘login.gov
username’’), the instructions on the
access form do not clarify what the
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
username is or if IPs already have one.
Commenter #8 also requested clarity on
what IPs are expected to do in DIS.
Response: The pilot, applicable to
several missions, ended with
publication of RIN 0412–AA90.
Questions around benefits, API
connections, adding contract language,
standardization, security, submission
requirements, reporting, access forms
and other items related to the pilot are
superseded by the text of the Rule. The
rule also clarifies what contractors must
do when submitting digital information
to USAID.
m. Comments That Have Been
Answered Through Comment Responses
to the Rule
Comment: Commenter #13 asked
about whether staff will be able to
access more than one project or see
across a variety of projects. Commenter
#2 requested that the system be aligned
to build upon the Common Data Model
for Nonprofits. Commenter #13 asked
about what the Development Experience
Clearinghouse is. Commenter #14 asked
about integration of various USAID
platforms (the Development Data
Library, for example).
Response: USAID has provided robust
responses to these questions in response
to comments received under the
rulemaking. Specifically, see sections
B.2)(e)(1)(E); B.2)(d)(5); and
B.2)(e)(1)(A)–(C) of the Federal Register
Notice for RIN 0412–AA90 which
includes the text of relevant comments
and responses.
n. Access to Data
1. Comment: Commenter #4
questioned whether a prime contractor
will have to enter data for
subcontractors or whether the subs will
have separate access to enter their data
directly.
Response: The clause requires the
contractor to submit all digital
information produced, furnished,
acquired or collected in performance of
this contract by its subcontractors at any
tier. While some USAID systems may
allow delegation of the submission role,
it remains the responsibility of the
prime contractor to ensure the
submission of the digital information
per the requirements of the rule.
2. Comment: Several commenters (8,
13, 15) asked about system access.
Specifically, whether the system will
have a place to specify roles in the
‘‘implementing partner user
information’’ section; how IPs can
manage employees offboarding from the
system when they leave the IP or award;
and whether the system will be open to
PO 00000
Frm 00011
Fmt 4701
Sfmt 4700
37957
allow all users to see information or be
limited by award.
Response: The system will have a
place to specify user roles. The COR
will assign the contractor a user role
within the system. Once assigned a user
role, the contractor will manage further
access to the award, including during
offboarding. Submitters will only be
able to see data for awards with which
they are associated in the system; data
access is not open to all users.
3. Comment: Commenter 16 asked
whether the public will be able to access
the data in the DIS system.
Response: USAID will release data to
the public from its internal systems in
keeping with its internal policies as
informed by US Government and
international transparency
commitments. USAID will not provide
direct public access to the DIS system.
o. System Design Information
1.Comment: Commenter #3) asked if
USAID had a help center for DIS and
requested a FAQ page.
Response: Contractors can email
AskDIS@usaid.gov for help center
assistance. The DIS Frequently Asked
Questions (FAQ) document for
contractors is found on the USAID
public website (available at: https://
www.usaid.gov/partner-with-us/
resources-for-partners/developmentinformation-solution/faqs).
2.Comment: Commenter #13 asked if
the DIS will be the place where they
enter information about indicators or
just view them once reports are
submitted.
Response: Per the Rule, USAID
contractors will submit all digital
information to one centralized portal,
the USAID Digital Front Door (DFD).
The DFD is intended as a submission
mechanism, whereas viewing will take
place via established USAID systems
and websites.
3. Comment: Commenter #13 asked
who is responsible for setting up the
website for each respective project in
DIS (if there are specific indicators
being reported for each of the projects).
Response: USAID operating units are
responsible for establishing activities in
DIS within a contract. The person with
the COR role in DIS is responsible for
establishing the indicators associated
with the activity.
4. Comment: Commenter #13 asked if
the system will allow for central level
viewing of an IP portfolio.
Response: The system currently does
not allow for linkages among multiple
activities to provide a central portfolio
view for an implementing partner.
E:\FR\FM\06MYR7.SGM
06MYR7
37958
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
p. USAID Approval and Oversight
Comment: Commenter #16 requested
comment on when comprehensive
information about the structure and
operation of the DIS system will be
available.
Response: USAID will continue to
provide information on the Agency’s
public DIS website (available at: https://
www.usaid.gov/partner-with-us/
resources-for-partners/developmentinformation-solution) as it becomes
available.
q. Outside the Scope
Comment: Many commenters (1, 5, 6,
7, 9, and 11) submitted comments that
were outside the scope of the DIS Pilot.
Response: USAID acknowledges
receipt of these out-of-scope comments.
USAID Digital Collection and
Submission Standards
We are publishing the revised
Collection & Submission Standards in
this final rule. As noted in the
regulatory text, the standards can also
be found at data.usaid.gov/standards
with hyperlinks:
USAID’s Digital Collection and
Submission Standards are a
compendium of standards for USAID
staff and contractors to use in support
of USAID programs and operations. The
standards in Section A are required.
Section B contains recommended
standards that represent industry best
practices.
Section A: Required Digital Information
Technical Standards
I. File Format Standards
ddrumheller on DSK120RN23PROD with RULES7
A. Acceptable Non-Proprietary Formats
1. Text and Documents
(a) Portable Document Format (PDF/A
is preferred, however .pdf is
acceptable)
(b) Plain text (.txt)
(c) LaTeX documents (.tex)
(d) Hypertext Markup Language
(.html)
(e) Open Document Format (.odt)
(f) Extensible Markup Language (.xml)
(g) JavaScript Object Notation (.json)
2. Tables, Spreadsheets, and Databases
(a) Comma-Separated Values (.csv)
(b) Tab-separated tables (.txt—
sometimes .tsv)
(c) Comma-separated tables (.csv or
.txt)
(d) Other standard delimiter (e.g.
colon, pipe)
(e) Fixed-width
(f) OpenDocument Spreadsheet (.ods)
3. Audio Files
(a) WAVE (.wav)
(b) FLAC (.flac)
(c) MPEG–3
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
(d) MP3
4. Image Files
(a) JPEG (.jpg or .jp2)
(b) Portable Network Graphics (.png)
(c) TIFF (.tiff or .tif)
(d) Portable Document Format (.pdf)
5. Video Files
(a) Video File (.mov)
(b) MPEG–4 (mp4)
(c) JPEG2 2000 (mj2)
6. Geospatial Files
(a) QGIS Project (.qgs)
(b) ESRI Shapefile (.shp, .shx, .dbf)
(c) Annotated TIFF Raster Files (.tif)
(d) Keyhole Mark Language (.kml)
(e) Geographic Data Format based on
JSON (.geojson)
(f) Google Earth GIS Format (.kml,
.kmz)
(g) Well Known Text for Spatial
Objects (.wkt)
(h) Raster GIS File Format
(i) Unidata Scientific Data Format
II. Subject Area Standards
A. Narrative Text
1. Digital narrative text that is written
in the English language, including
narrative about USAID programs and
operations, must comply with the Plain
Writing Act of 2010 and associated
guidelines and resources found on the
federal plain language website. Because
USAID may publish a narrative in
keeping with the U.S. Government
legislative requirements (e.g. the Foreign
Aid Transparency and Accountability
Act of 2016) and other transparency
commitments (e.g. International Aid
Transparency Initiative; Open
Government Partnership) or Freedom of
Information Act requests, the narrative
must be clear, thorough, and descriptive
to facilitate public understanding.
B. Geospatial
1. The location(s) where an activity is
implemented must be collected at the
Exact Site Location. Exact Site Location
is defined as a populated place, an
actual exact site location, or an exact
area or line feature. The location(s) of
the activity’s intended beneficiaries
must be collected at least at the first
level administrative boundary. When
the location of the activity’s intended
beneficiaries is considered nationwide,
it must be collected at the country/
territory level. USAID follows the
Geopolitical Entities, Names, and Codes
(GENC) Standard and additional
geospatial data standards as outlined in
ADS 579saa ‘‘Geographic Data
Collection and Submission Standards’’
and ADS 579mab ‘‘Activity Location
Data.’’
C. Date
1. YYYY–MM–DD.
PO 00000
Frm 00012
Fmt 4701
Sfmt 4700
Section B: Recommended Digital
Information Technical Standards
USAID recommends the following
standards that have not been formally
adopted as a requirement by the
Agency, but encouraged and
recommended for use to improve the
management, quality and usefulness of
the data. USAID recommends the use of
the following standards when
appropriate and practicable:
I. Code, Algorithm, and Analytical
Files.
A. Javascript (.js)
B. Java
C. .NET
D. Python (.py)
E. Ruby (.rb)
F. R (.r)
G. SQL
II. GS1 Standards—USAID-funded
programs beyond Global Health are
strongly recommended to adopt GS1
Standards for the supply chain to
facilitate product identification, location
identification, and product master data
of Agency-funded commodities.
Additional guidance for implementation
of GS1 Standards can be found here.
III. Statistical Data and Metadata
eXchange (SDMX) for statistical data.
IV. CGIAR Ontologies for crop and
agronomy ontology.
V. FHIR for healthcare data exchange.
VI. ISO 8601 for Date, Time, and Time
Zone.
VII. Open Geospatial Consortium
(OGC) Standards for geospatial data.
The Open Geospatial Consortium (OGC)
is an international consortium of more
than 500 businesses, government
agencies, research organizations, and
universities driven to make geospatial
(location) information and services
FAIR—Findable, Accessible,
Interoperable, and Reusable..
VIII. International Aid Transparency
Initiative (IATI).
IX. FAIR Data Principles—To the
extent possible, USAID-funded data and
metadata must align with data
principles which are Findable,
Accessible, Interoperable, and Reusable.
Resources for creating metadata to
meet these standards include, but are
not limited to, the following:
I. Content Standard for Digital
Geospatial Metadata (CSDGM) Tools.
II. USGS TKME—A Windows
platform tool for creating FGDC–
CSDGM which can be configured for
Biological Data Profile and other
extensions. The software program is
closely aligned with the Metadata
Parser, and can be configured for French
and Spanish.
III. mdEditor—Create ISO and FGDC–
CSDGM metadata with this web-based
tool.
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
IV. Data dictionary conversion
service—Convert a data dictionary table
to/from metadata format (instructions).
V. USDA Metavist—A desktop
metadata editor for creating FGDC–
CSDGM for geospatial metadata.
Includes the Biological Data Profile
(version 1.6). Produced and maintained
by the USDA Forest Service. Download
the USGS Alaska Science Center (ASC)
Metavist User Guide [PDF] to learn more
about the tool and ASC best practices
for authors.
VI. Microsoft XML Notepad—A
simple intuitive user interface for
browsing and editing XML files. Does
not automatically produce FGDC–
CSDGM records but allows easy editing
and validation of existing metadata
records. See Advanced Users to learn
how to configure this tool.
C. Regulatory Considerations and
Determinations
(1) Executive Orders 12866 and 13563
This final rule was drafted in
accordance with Executive Order (E.O.)
12866, as amended by E.O. 14094, and
E.O. 13563. OMB has determined that
this rule is a ‘‘significant regulatory
action,’’ as defined in section 3(f) of E.O.
12866, as amended, and is therefore
subject to review by OMB. This rule is
not a major rule under 5 U.S.C. 804.
(2) Expected Cost Impact on the Public
USAID remains committed to
reducing the burden on its contractors
while maximizing taxpayer value. By
launching the USAID Digital Front Door
(DFD) as outlined in this clause, USAID
intends to reduce the total number of
portals through which its contractors
must submit information to USAID,
thereby reducing time and effort and
improving operational efficiency.
The following is a summary of the
impact on contractors awarded contracts
that include the new AIDAR clause. The
cost estimates were developed by
subject matter experts based on USAID’s
experience collecting reports and
information products through the
Development Experience Clearinghouse
(DEC) (see AIDAR 752.7005) and
piloting digital data collection through
the Development Data Library (DDL)
and the Development Information
Solution (DIS).
This rule results in a total annualized
(7% discount) public net cost of $2.5
million. This annual burden takes into
account the current baseline that
contractors already prepare, maintain,
and submit AMELPs, already remove PII
from data prior to submission, already
collect standard indicator data, and
already request embargoes and data
submission exemptions from
Contracting officer’s Representative on a
case-by-case basis. Further, since
contractors already submit documents
and data to the DEC and DDL, these
costs were removed from the overall
estimated cost. The following is a
summary of the annual public costs over
a 20-year time horizon.
Year
Public
1 ...............................................................................................................................................................................
2 ...............................................................................................................................................................................
3 ...............................................................................................................................................................................
. . . ..........................................................................................................................................................................
20 .............................................................................................................................................................................
ddrumheller on DSK120RN23PROD with RULES7
37959
Total
$1,867,000
2,650,000
2,703,000
2,756,000
2,756,000
$1,867,000
2,650,000
2,703,000
2,756,000
2,756,000
Total undiscounted costs ..............................................................................................................................................................
Present Value (PV) of Costs Discounted at 7% ..........................................................................................................................
Annualized Costs Discounted at 7% ............................................................................................................................................
65,988,000
54,072,000
2,514,000
This rule has extensive benefits for
the public, contractors, the research
community, the private sector, and the
USG, though many of these benefits are
challenging to quantify. Overarchingly,
this rule will increase efficiency for
contractors, minimize data errors, and
improve the privacy and security of
data. Further, this rule will help
contractors to produce data assets that
are trustworthy, high-quality, and
usable by the general public and the
research community for accountability,
research, communication, and learning.
For the public, there is an immense
richness in the data collected by USAID
and its partners around the world, and
this data holds the potential to improve
the lives of some of the world’s most
vulnerable people. When a development
project ends, the data can yield new
insights for years or decades into the
future. It is the responsibility of the
Agency and those representing the
government to ensure that data is
accessible, standardized, and secure.
Finally, these estimates have been
downwardly adjusted since the
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
publication of the proposed rule to
reflect USAID’s responses to comments
from the public.
In addition, under current protocols,
USAID contractors are required to
submit digital information to USAID
under multiple award requirements
using several different information
management portals. The maintenance
of these separate portals has made it
challenging for USAID to integrate this
information strategically to render a
more holistic and detailed view of its
global portfolio. By implementing these
changes, USAID intends to reduce
administrative burden on contractors
and USG staff.
(3) Regulatory Flexibility Act
USAID does not expect this rule to
have a significant economic impact on
a substantial number of small entities
within the meaning of the Regulatory
Flexibility Act, 5 U.S.C. 601, et seq.
USAID has therefore not performed an
Initial Regulatory Flexibility Analysis
(IRFA).
PO 00000
Frm 00013
Fmt 4701
Sfmt 4700
(4) Paperwork Reduction Act
This rule contains information
collection requirements that have been
submitted to the Office of Management
and Budget under the Paperwork
Reduction Act (44 U.S.C. chapter 35).
This information collection requirement
has been assigned OMB Control Number
0412–0620, entitled ‘‘AIDAR: Planning,
Collection and Submission of Digital
Information and Activity Monitoring,
Evaluation, and Learning Plans to
USAID’’. Following receipt of
comments, USAID has made several
revisions to this collection to
downwardly adjust the burden.
Specifically, USAID revised the
applicability of 752.227–71 from the
micro purchase threshold to the
simplified acquisition threshold.
Similarly, USAID has added an
Alternate clause exempting certain
contracts from the requirement to
provide a data management plan.
Specifically, contracts are exempted
that: contain no data; are for emergency
food assistance; are for disaster
assistance, and transition-assistance
E:\FR\FM\06MYR7.SGM
06MYR7
37960
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
activities managed by the Bureau for
Humanitarian Assistance (BHA); or are
for activities managed by the Bureau for
Conflict Prevention and Stabilization’s
Office of Transition Initiatives (CPS/
OTI). For additional detail, please see
the Regulatory Impact Assessment as
well as responses to comments in
sections B. 2)(g)(C) and B. 2)(f)(3)(A)
above.
Additionally, USAID posted a 60-Day
Notice of Information Collection:
Proposals, Submissions, and Approvals
(the ‘‘DIS Pilot’’) in the Federal Register
at 85 FR 83027 on December 21, 2020.
USAID published a 30-Day Notice
including a response to comments
received on May 25, 2021 and solicited
additional comments (See 86 FR 28053).
Following receipt of additional
comments, USAID, with approval from
OMB, is providing a response to
comments received to the 30-day
Collection Notice with this Rulemaking.
As the ‘‘DIS Pilot’’ collection has been
discontinued due to this rulemaking
action, this separate information
collection approval request has been
canceled.
List of Subjects in 48 CFR Parts 727,
742, and 752
Government procurement.
For the reasons discussed in the
preamble, USAID amends 48 CFR
chapter 7 as set forth below:
■ 1. The authority citation for 48 CFR
parts 727, 742, and 752 continues to
read as follows:
Authority: Sec. 621, Pub. L. 87–195, 75
Stat. 445, (22 U.S.C. 2381) as amended; E.O.
12163, Sept. 29, 1979, 44 FR 56673; and 3
CFR 1979 Comp., p. 435.
SUBCHAPTER E—GENERAL
CONTRACTING REQUIREMENTS
PART 727—PATENTS, DATA, AND
COPYRIGHTS
2. Add subpart 727.70 to read as
follows:
■
ddrumheller on DSK120RN23PROD with RULES7
Subpart 727.70—Digital Information
Planning, Collection, and Submission
Requirements
Sec.
727.7000 Scope of subpart
727.7001 Definitions
727.7002 Policy
727.7003 Contract clause.
Subpart 727.70—Digital Information
Planning, Collection, and Submission
Requirements
727.7000
Scope of subpart.
(a) This part prescribes the policies,
procedures, and a contract clause
pertaining to data and digital
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
information management. It implements
the following requirements:
(1) Digital Accountability and
Transparency (DATA) Act of 2014;
(2) Foundations for Evidence-Based
Policymaking Act (‘‘Evidence Act’’) of
2018;
(3) 21st Century Integrated Digital
Experience Act (21st Century IDEA Act);
(4) Foreign Aid Transparency and
Accountability (FATAA) Act of 2016;
(5) Geospatial Data Act of 2018;
(6) OMB Circular A–130.
(b) [Reserved]
727.7001
Definitions.
As used in this subpart—
Data means recorded information,
regardless of form or the media on
which it may be recorded. The term
includes technical data and computer
software. The term does not include
information incidental to contract
administration, such as financial,
administrative, cost or pricing, or
management information.
Data asset is a collection of data
elements or data sets that may be
grouped together.
Data inventory is the first component
of a Data Management Plan (DMP). The
data inventory is a list of high-value
data assets that the contractor
anticipates producing during the period
of award performance.
Data management plan (DMP) is a
tool that guides the identification of
anticipated data assets and outlines
tasks needed to manage these assets
across a full data lifecycle.
Data set is an organized collection of
structured data, including data
contained in spreadsheets, whether
presented in tabular or non-tabular
form. For example, a data set may
represent a single spreadsheet, an
extensible mark-up language (XML) file,
a geospatial data file, or an organized
collection of these. A data set does not
include unstructured data, such as
email or instant messages, PDF files,
PowerPoint presentations, word
processing documents, images, audio
files, or collaboration software.
Digital means the coding scheme
generally used in computer technology
to represent data.
Digital data means quantitative and
qualitative programmatic measurements
that are entered directly into a
computer. Examples include numeric
targets established during activity
design or implementation; baseline,
mid-line, or final measurements created
or obtained via field assessments;
surveys or interviews; performance
monitoring indicators as specified in the
Contractor’s approved Activity
Monitoring, Evaluation, and Learning
PO 00000
Frm 00014
Fmt 4701
Sfmt 4700
(AMELP) (see 752.242–71); evaluation
results; or perception metrics collected
from beneficiaries on the quality and
relevance of International Disaster
Assistance and Development
Assistance.
Digital information is a subset of data
and means:
(1) Digital text;
(2) Digital data;
(3) Digital objects; and
(4) Metadata created or obtained with
USAID funding supported by this award
that are represented, stored, or
transmitted in such a way that they are
available to a computer program.
Digital method is a means of using
computer technology to gather, process,
analyze, transmit, store, or otherwise
use data and other forms of information.
Digital object includes digital or
computer files that are available to a
computer program. Examples include
digital word processing or PDF
documents or forms related to activity
design, assessment reports, periodic
progress and performance reports,
academic research documents,
publication manuscripts, evaluations,
technical documentation and reports,
and other reports, articles and papers
prepared by the contractor, whether
published or not. Other examples
include data sets, spreadsheets,
presentations, publication-quality
images, audio and video files,
communication materials, information
products, extensible mark-up language
(XML) files, and software, scripts,
source code, and algorithms that can be
processed by a computer program.
Digital text includes text-based
descriptions of programmatic efforts
that are entered directly into a
computer, rather than submitted as a
digital object.
727.7002
Policy.
(a) It is the policy of USAID to manage
data as a strategic asset to inform the
planning, design, implementation,
monitoring, and evaluation of the
Agency’s foreign assistance programs.
To achieve this, it is also USAID’s
policy to manage data and digital
information across a full life cycle. This
life cycle includes the following stages:
Govern, Plan, Acquire, Process,
Analyze, Curate, and Publish/Share. For
more information about the USAID
Development Data policy, see ADS
Chapter 579 at https://www.usaid.gov/
about-us/agency-policy/series-500/579.
For more information about USAID’s
Program Cycle policy, see ADS Chapter
201 at https://www.usaid.gov/about-us/
agency-policy/series-200/201.
(b) In furtherance of this policy,
USAID requires that contractors:
E:\FR\FM\06MYR7.SGM
06MYR7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
(1) Engage in digital information
planning, including creating a Data
Management Plan (DMP) to identify and
plan for the management of data assets
that will be produced, furnished,
acquired, or collected in a USAIDfunded activity.
(2) Use only digital methods and
USAID-approved standards, to the
extent practicable, to produce, furnish,
acquire, or collect information necessary
to implement the contract requirements.
(3) Provide documentation of
informed consent the contractor
receives when obtaining information on
individuals.
(4) Submit to USAID digital
information produced, furnished,
acquired, or collected in performance of
a USAID contract at the finest level of
granularity employed during contract
implementation.
(c) As specified in ADS Chapter 579,
USAID implements appropriate controls
to restrict data access in a way that
balances the potential benefits with any
underlying risks to its beneficiaries and
contractors.
ddrumheller on DSK120RN23PROD with RULES7
727.7003
Contract clause.
(a) Insert the clause 752.227–71 to
USAID in Section H of solicitations and
contracts fully or partially funded with
program funds exceeding the simplified
acquisition threshold. The contracting
officer may insert this clause in other
USAID contracts if the contracting
officer, in consultation with the
requiring office, determines that doing
so is in the best interest of the Agency.
(b) Insert the clause at 752.227–71,
with its Alternate I when the anticipated
contract:
(1) Does not collect data;
(2) Implements emergency food
assistance under the Food for Peace Act
or section 491 of the Foreign Assistance
Act of 1961, including for the
procurement, transportation, storage,
handling and/or distribution of such
assistance;
(3) Implements international disaster
assistance under section 491 of the
Foreign Assistance Act of 1961 or other
authorities administered by the Bureau
for Humanitarian Assistance; or
(4) Implements activities managed by
the Bureau for Conflict Prevention and
Stabilization’s Office of Transition
Initiatives, or is fully or partially funded
with the Complex Crises Fund.
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
SUBCHAPTER G—CONTRACT
MANAGEMENT
PART 742—CONTRACT
ADMINISTRATION
Subpart 742.11—Production,
Surveillance, and Reporting
3. Amend 742.1170–3, by
redesignating paragraphs (b)(2) through
(7) as paragraphs (b)(3) through (8) and
adding a new paragraph (b)(2).
The addition reads as follows:
■
742.1170–3
Policy.
*
*
*
*
*
(b) * * *
(2) The contract requirements for an
activity monitoring, evaluation, and
learning plan, as applicable;
*
*
*
*
*
■ 4. Add 742.1170–5 to read as follows:
742.1170–5 Activity Monitoring,
Evaluation, and Learning Plan requirement
and contract clause.
(a) When the requiring office needs
information on how the contractor
expects to monitor implementation
performance and context, conduct or
collaborate on an evaluation, and
generate evidence to inform learning
and adaptive management, the
contracting officer may require the
contractor to submit an Activity
Monitoring, Evaluation, and Learning
Plan (AMELP) tailored to specific
contract requirements. For more
information on monitoring, evaluation,
and learning during the design and
implementation of activities, see ADS
Chapter 201 at https://www.usaid.gov/
about-us/agency-policy/series-200/201.
(b) Unless instructed otherwise in
writing by the requiring office, the
contracting officer must insert the
clause at 752.242–71 in section F of
solicitations and contracts exceeding the
simplified acquisition threshold, except
as specified in paragraph (c) of this
section. The contracting officer may
insert this clause in other USAID
contracts if the contracting officer, in
consultation with the requiring office,
determines that an Activity Monitoring,
Evaluation, and Learning Plan is
necessary, as provided in paragraph (a)
of this section.
(c) The clause is not required to be
included in contracts for:
(1) Supplies and services that USAID
acquires for its own direct use or
benefit;
(2) Emergency food assistance under
the Food for Peace Act or section 491 of
the Foreign Assistance Act of 1961,
including for the procurement,
transportation, storage, handling and/or
distribution of such assistance;
PO 00000
Frm 00015
Fmt 4701
Sfmt 4700
37961
(3) International disaster assistance
under section 491 of the Foreign
Assistance Act of 1961 or other
authorities administered by the Bureau
for Humanitarian Assistance; or
(4) Activities managed by the Bureau
for Conflict Prevention and
Stabilization’s Office of Transition
Initiatives, or fully or partially funded
with the Complex Crises Fund.
SUBCHAPTER H—CLAUSES AND FORMS
PART 752—SOLICITATION
PROVISIONS AND CONTRACT
CLAUSES
■
5. Add 752.227–71 to read as follows:
752.227–71. Planning, Collection, and
Submission of Digital Information to USAID.
As prescribed in AIDAR 727.7003,
insert the following clause in Section H
of solicitations and contracts:
Planning, Collection, and Submission of
Digital Information to USAID (JUN 2024)
(a) Definitions. As used in this clause—
Computer is a fixed or mobile device that
accepts digital data and manipulates the
information based on a program or sequence
of instructions for how data is to be
processed.
Data means recorded information,
regardless of form or the media on which it
may be recorded. The term includes
technical data and computer software. The
term does not include information incidental
to contract administration, such as financial,
administrative, cost or pricing, or
management information.
Data asset is a collection of data elements
or data sets that may be grouped together.
Data inventory is the first component of a
Data Management Plan (DMP). The data
inventory is a list of high-value data assets
that the contractor anticipates producing
during the period of award performance.
Data management plan (DMP) is a tool that
guides the identification of anticipated data
assets and outlines tasks needed to manage
these assets across a full data lifecycle.
Data set is an organized collection of
structured data, including data contained in
spreadsheets, whether presented in tabular or
non-tabular form. For example, a data set
may represent a single spreadsheet, an
extensible mark-up language (XML) file, a
geospatial data file, or an organized
collection of these. A data set does not
include unstructured data, such as email or
instant messages, PDF files, PowerPoint
presentations, word processing documents,
images, audio files, or collaboration software.
Digital means the coding scheme generally
used in computer technology to represent
data.
Digital data means quantitative and
qualitative programmatic measurements that
are entered directly into a computer.
Examples include numeric targets
established during activity design or
implementation; baseline, mid-line, or final
measurements created or obtained via field
assessments; surveys or interviews;
E:\FR\FM\06MYR7.SGM
06MYR7
ddrumheller on DSK120RN23PROD with RULES7
37962
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
performance monitoring indicators as
specified in the Contractor’s approved
AMELP; evaluation results; or perception
metrics collected from beneficiaries on the
quality and relevance of International
Disaster Assistance and Development
Assistance.
Digital information is a subset of data and
means:
(i) Digital text;
(ii) Digital data;
(iii) Digital objects; and
(iv) Metadata created or obtained with
USAID funding regarding international
development or humanitarian assistance
activities supported by this award that are
represented, stored, or transmitted in such a
way that they are available to a computer
program.
Digital method is a means of using
computer technology to gather, process,
analyze, transmit, store, or otherwise use data
and other forms of information.
Digital object includes digital or computer
files that are available to a computer
program. Examples include digital word
processing or PDF documents or forms
related to activity design, assessment reports,
periodic progress and performance reports,
academic research documents, publication
manuscripts, evaluations, technical
documentation and reports, and other
reports, articles and papers prepared by the
Contractor under this contract, whether
published or not. Other examples include
data sets, spreadsheets, presentations,
publication-quality images, audio and video
files, communication materials, information
products, extensible mark-up language (XML)
files, and software, scripts, source code, and
algorithms that can be processed by a
computer program.
Digital repository refers to information
systems that ingest, store, manage, preserve,
and provide access to digital content.
Digital text includes text-based
descriptions of programmatic efforts that are
entered directly into a computer, rather than
submitted as a digital object.
Draft digital information refers to digital
information that, in the professional opinion
of the Contractor, does not adhere to the
information quality standards such that it
presents preliminary, unverified, incomplete,
or deliberative findings, claims, analysis, or
results that may lead the consumer of such
material to draw erroneous conclusions.
Granularity refers to the extent to which
digital content or objects provide access to
detailed, distinct data points. Coarse
granularity generally means that distinct data
points reflect larger, representational units or
have been joined together or aggregated, thus
providing less detail. A fine level of
granularity generally means that distinct data
points reflect smaller, individualized units
that have not been aggregated, thus providing
a higher level of detail. For example, a data
set containing a list of every activity
conducted by week would generally exhibit
a finer level of granularity than a data set
listing the various categories of activities
conducted by month. The degree of
granularity can be relative to the contents of
a specific data set and can be geographic,
temporal, or across other dimensions.
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
Information quality standards means the
elements of utility, objectivity, and integrity
collectively.
Integrity is an element of the information
quality standards that means information has
been protected from unauthorized access or
revision, to ensure that the information is not
compromised through corruption or
falsification.
Machine readable means data in a format
that can be easily processed by a computer
without human intervention while ensuring
that no semantic meaning is lost.
Metadata includes structural or descriptive
information about digital data or digital
objects such as content, format, source,
rights, accuracy, provenance, frequency,
periodicity, granularity, publisher or
responsible party, contact information,
method of collection, and other descriptions.
Objectivity is an element of the information
quality standards that means whether
information is accurate, reliable, and
unbiased as a matter of presentation and
substance.
Personally identifiable information (PII)
means information that can be used to
distinguish or trace an individual’s identity,
either alone or when combined with other
information that is linked or linkable to a
specific individual. [See Office of
Management and Budget (OMB) Circular No.
A–130, Managing Federal Information as a
Strategic Resource.] PII can include both
direct identifiers (such as name, health
identification numbers, etc.), and indirect
identifiers (geographic location, age) that
when linked with other information can
result in the identification of an individual.
Publication object is a digital object that
has been accepted for publication prior to the
end date of this contract and whose content
is based on or includes any other digital
information created or obtained in
performance of this contract. In the research
community, a publication object is often
synonymous with a quality research
manuscript that has been accepted by an
academic journal for publication. However,
publication objects can also consist of other
digital objects (e.g., photos, videos, etc.)
published via news media, the internet, or
other venues.
Quality digital information means digital
information that, in the professional opinion
of the Contractor, adheres to the information
quality standards and presents reasonably
sound and substantiated findings, claims,
analysis, or results regarding activities.
Registered with the USAID Digital Front
Door (DFD) means: that—
(i) The Contractor entered all mandatory
information required to obtain access to the
DFD.
(ii) The Contractor agrees to abide by the
DFD terms and conditions of use.
(iii) The Government has validated the
Contractor’s registration by providing access
to the DFD.
USAID Digital Front Door (DFD), located at
dfd.usaid.gov is a website where the
Contractor transacts business with USAID,
such as submitting digital information.
Utility is an element of the information
quality standards that means whether
information is useful to its intended users,
PO 00000
Frm 00016
Fmt 4701
Sfmt 4700
including the general public, and for its
intended purpose.
(b) Digital information planning
requirements. The Contractor must engage in
digital information planning to ensure
compliance with the collection and
submission of all digital information, as
required under this award.
(c) Data Management Plan (DMP)—(1)
What is required. The Contractor must
prepare and maintain a Data Management
Plan (DMP) that reflects the digital
information planning requirements outlined
in paragraph (b) of this clause.
(2) What to submit. The DMP must be
appropriate to the programmatic scope and
context of the contract, and to the nature and
complexity of the data to be collected or
acquired in the course of the contract. The
DMP must address, at a minimum, the
following:
(i) Data inventory; and
(ii) If requested in writing by the
Contracting Officer,
(A) Protocols for data collection,
management and storage;
(B) Protocols for maintaining adequate
safeguards that include the privacy and
security of digital information collected
under the award;
(C) Documentation that ensures other users
can understand and use the data;
(D) Protocols for preserving digital
information and facilitating access by other
stakeholders; and
(E) Terms of use on data usage,
publication, curation, or other dissemination
plans.
(3) When to submit. The Contractor must
develop and submit, at a minimum, the data
inventory component of the DMP to the
contracting officer for approval within ninety
(90) days after contract award, unless the
contracting officer establishes a different time
period. The Contractor must submit the
remaining components of the DMP to the
contracting officer for approval, as soon as
they become available. The contractor must
not begin digital information collection prior
to approval of the data inventory and
submission of any remaining components of
the DMP unless authorized in writing by the
contracting officer.
(4) When to revise. The Contractor must
revise the DMP as necessary throughout the
period of performance of this contract. Any
revisions to the plan must be approved by the
contracting officer or contracting officer’s
representative as delegated.
(d) Digital information production and
collection requirements. (1) The Contractor
must:
(i) Use only digital methods to the extent
practicable to produce, furnish, acquire, or
collect information in performance of this
contract. If the Contractor is unable to
consistently collect data using digital
methods, the Contractor must obtain the
contracting officer or delegated contracting
officer’s representative’s approval for any
alternative collection method.
(ii) Collect digital information at the finest
level of granularity that enables the
Contractor to comply with the terms of this
contract.
(2) To the extent practicable, the Contractor
must limit the collection of PII to only that
E:\FR\FM\06MYR7.SGM
06MYR7
ddrumheller on DSK120RN23PROD with RULES7
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
which is necessary to comply with the
requirements of the contract.
(e) Registration requirements. The
Contractor must:
(1) Be registered with the USAID Digital
Front Door (DFD) within ninety (90) days
after award of this contract; and
(2) Maintain access to the DFD during the
period of performance of this contract.
(f) Submission requirements—(1) What to
submit. Unless an exemption in paragraph
(f)(4) of this section applies, the Contractor
must:
(i) Submit digital information created or
obtained in performance of this contract to
USAID at the finest level of granularity at
which it was collected.
(ii) Submit digital information in
nonproprietary formats and digital data and
data sets in machine readable formats. The
Contractor may also submit proprietary
formats in addition to a nonproprietary
format.
(iii) Submit a copy of any usage license
agreement that the Contractor obtained from
any third party who granted usage rights for
the digital information.
(iv) Submit a copy of any photo or media
release template that the Contractor used to
obtain permission from any third party for
the use of the photo or media.
(v) When the contract includes AIDAR
clause 752.7012, Protection of the Individual
as a Research Subject, provide a blank copy
of the form, document, instructions, or other
instruments used to obtain informed consent
from persons whose individual information
is contained in the original version of the
digital object.
(vi) If applicable, provide additional details
or metadata regarding:
(A) Where and how to access digital
information that the Contractor submits to a
USAID-approved digital repository or via
alternate technology as approved by USAID’s
Chief Information Officer;
(B) The quality of submissions of draft
digital information;
(C) Known sensitivities within digital
information that may jeopardize the personal
safety of any individual or group, whether
the Contractor has submitted the information
or has received a submission exemption;
(D) Digital information for which the
Contractor was unable to obtain third party
usage rights, a media release, or informed
consent or which has other proprietary
restrictions.
(2) Where to submit. The Contractor must
submit digital information through the DFD,
unless specifically authorized by the
contracting officer in writing to submit to a
USAID-approved digital repository instead or
via alternate technology as approved by
USAID’s Chief Information Officer.
(3) When to submit. (i) With the exception
of data sets, the Contractor must submit all
other Digital Objects within 30 days of
obtaining the contracting officer or delegated
contracting officer representative’s approval.
Unless otherwise specified in the schedule of
the contract or otherwise instructed by the
contracting officer or delegated contracting
officer’s representative, the Contractor must
submit data sets and all other digital
information created or obtained in
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
performance of this contract to USAID once
it meets the requirements of quality digital
information. Unless otherwise approved by
the contracting officer in writing, within
thirty (30) days after the contract completion
date, the Contractor must submit all digital
information not previously submitted,
including both draft digital information and
quality digital information required under
this contract.
(ii) Upon written approval of the
contracting officer or delegated contracting
officer’s representative, the Contractor must
submit draft digital information to USAID
when the ‘‘best available’’ information is
required in order to meet time constraints or
other programmatic or operational
exigencies.
(4) Exemptions. (i) The Contractor must not
submit digital information through the DFD
that contains:
(A) Classified information.
(B) Personally identifiable information.
The Contractor must, to the maximum extent
possible, remove the association between the
set of identifying data and the individual to
which it applies unless retaining such
information is essential to comply with the
terms of this contract and upon written
approval from the contracting officer or
delegated contracting officer’s representative
to submit this information.
(ii) If the Contractor believes there is a
compelling reason not to submit specific
digital information that does not fall under
an exemption in this section, including
circumstances where submission may
jeopardize the personal safety of any
individual or group, the Contractor must
obtain written approval not to submit the
digital information from the contracting
officer.
(5) Approval requirements. Upon receipt of
digital information submitted by the
Contractor, the contracting officer or
delegated contracting officer’s representative
will either approve or reject the submission.
When a submission is rejected, the
Contractor must make corrections and
resubmit the required information. USAID
does not consider the submission accepted
until the contracting officer or delegated
contracting officer’s representative provides
written approval to the Contractor.
(g) Publication considerations. (1) If the
Contractor produces a publication object, the
Contractor must submit via the DFD a copy
of the publication object, the publication
acceptance notification, along with a link at
which the final published object may be
accessed.
(2) For any digital object the Contractor
submits in compliance with the terms of this
contract, the Contractor may request from the
contracting officer or delegated contracting
officer’s representative an embargo on the
public release of the digital object. The
contracting officer or delegated contracting
officer’s representative may approve an
embargo request that is for no more than 12
months at a time, with additional scrutiny for
digital objects relied upon for journal
publication. A determination on this request
will be provided to the Contractor in writing.
(3) If the Contractor used a digital object
previously submitted via the DFD to generate
PO 00000
Frm 00017
Fmt 4701
Sfmt 4700
37963
the publication object, and that digital object
is governed by a pre-existing embargo, that
embargo will expire on the day the
publication object is scheduled for
publication. USAID may elect to publish
digital information on which the publication
object is based as early as the date the
publication object is scheduled for
publication.
(h) USAID digital collection and
submission standards. The Contractor must
comply with the version of USAID’s Digital
Collection and Submission Standards in
effect on the date of award as outlined at
data.usaid.gov/standards. If the Contractor is
unable to adhere to USAID’s Digital
Collection and Submission Standards, the
Contractor must obtain USAID’s written
approval for an alternative approach.
(i) Access to the digital information.
USAID will conduct a rigorous risk
assessment of digital information that the
Contractor submits to USAID to determine
the appropriate permissions and restrictions
on access to the digital information. USAID
may release the data publicly in full, redact
or otherwise protect aspects of the
information prior to public release, or hold
the information in a non-public status.
(j) Obligations regarding subcontractors. (1)
The Contractor must furnish, acquire, or
collect information and submit to USAID, in
accordance with paragraph (f) of this clause,
all digital information produced, furnished,
acquired, or collected in performance of this
contract by its subcontractors at any tier.
(2) The Contractor must insert the terms of
this clause, except paragraph (e) of this
clause, in all subcontracts.
(End of clause)
Alternate I (JUN 2024). As prescribed
in AIDAR 727.7003, substitute the
following paragraph (c) for paragraph (c)
of the basic clause:
(c) [Reserved]
■ 6. Add 752.242–71 to read as follows:
752.242–71 Activity Monitoring,
Evaluation, and Learning Plan
As prescribed in AIDAR 742.1170–5,
insert the following clause in section F
of solicitations and contracts.
Activity Monitoring, Evaluation, and
Learning Plan (JUN 2024)
(a) Definitions. As used in this clause—
Activity Monitoring, Evaluation, and
Learning Plan (AMELP) means a plan for
monitoring, evaluating, and collaborating,
learning, and adapting during
implementation of a USAID contract. Some
USAID documentation may refer to ‘‘MEL
Plan’’ or ‘‘Activity MEL Plan’’. These terms
are synonymous.
Contract will be interpreted as ‘‘task order’’
or ‘‘delivery order’’ when this clause is used
in an indefinite-delivery contract.
Evaluation means the systematic collection
and analysis of data and information about
the characteristics and outcomes of the
programming carried out through a contract,
conducted as a basis for judgments, to
understand and improve effectiveness and
efficiency, and timed to inform decisions
about current and future programming.
E:\FR\FM\06MYR7.SGM
06MYR7
37964
Federal Register / Vol. 89, No. 88 / Monday, May 6, 2024 / Rules and Regulations
ddrumheller on DSK120RN23PROD with RULES7
Feedback from beneficiaries means
perceptions or reactions voluntarily
communicated by a beneficiary of USAID
assistance about the USAID assistance
received.
Indicator means a quantifiable measure of
a characteristic or condition of people,
institutions, systems, or processes that might
change over time.
Learning activity means efforts for the
purpose of generating, synthesizing, sharing,
and applying evidence and knowledge.
Monitoring context means the systematic
collection of information about conditions
and external factors relevant to
implementation and performance of the
contract.
Output means the tangible, immediate, and
intended products or consequences of
contract implementation within the
Contractor’s control or influence.
Outcome means the conditions of people,
systems, or institutions that indicate progress
or lack of progress toward the achievement
of the goals and objectives of the contract.
Performance indicator means an indicator
that measures expected outputs and/or
outcomes of the contract implementation.
Target means a specific, planned level of
results to achieve within a specific timeframe
with a given level of resources.
(b) Requirements. (1) Unless otherwise
specified in the schedule of the contract, the
Contractor must develop and submit a
proposed AMELP to the contracting officer or
VerDate Sep<11>2014
22:08 May 03, 2024
Jkt 262001
delegated contracting officer’s representative
within ninety (90) days of contract award.
The contracting officer or delegated
contracting officer’s representative will
review and provide comments within thirty
(30) days after receiving the proposed
AMELP. The Contractor must submit a final
AMELP for contracting officer or delegated
contracting officer’s representative approval
no later than 15 days after receiving
comments.
(2) The Contractor must revise the AMELP
as necessary during the period of
performance of this contract. Any revisions
to the plan must be approved by the
contracting officer or delegated contracting
officer’s representative.
(c) Content. (1) The Contractor’s proposed
AMELP must include, at a minimum, the
following:
(i) The Contractor’s plan for monitoring,
including any existing systems or processes
for monitoring progress, any Standard
Foreign Assistance Indicators as agreed upon
by the contracting officer or delegated
contracting officer’s representative, any other
USAID required indicators, and other
relevant performance indicators of the
contract’s outputs and outcomes, their
baseline (or plan for collecting baseline), and
targets; and
(ii) The Contractor’s plan for regular and
systematic collection of feedback from
beneficiaries, responding to feedback
received, and reporting to USAID a summary
PO 00000
Frm 00018
Fmt 4701
Sfmt 9990
of feedback and actions taken in response to
the feedback received, or a rationale for why
collecting feedback from beneficiaries is not
applicable for this contract.
(2) The Contractor’s proposed AMELP
must be appropriate to the size and
complexity of the contract and address the
following, as applicable:
(i) Plans for monitoring context and
emerging risks that could affect the
achievement of the contract’s results;
(ii) Plans for any evaluations to be
conducted by the contractor, sub-contractor
or third-party, including collaboration with
an external evaluator;
(iii) Learning activities, including plans for
capturing knowledge at the close-out of the
contract;
(iv) Estimated resources for the AMELP
tasks that are a part of the contract’s budget;
and
(v) Roles and responsibilities for all
proposed AMELP tasks.
[End of clause]
752.7005
■
[Removed and Reserved]
7. Remove and Reserve 752.7005.
Jami J. Rodgers,
Chief Acquisition Officer.
[FR Doc. 2024–09373 Filed 5–3–24; 8:45 am]
BILLING CODE 6116–01–P
E:\FR\FM\06MYR7.SGM
06MYR7
Agencies
[Federal Register Volume 89, Number 88 (Monday, May 6, 2024)]
[Rules and Regulations]
[Pages 37948-37964]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2024-09373]
[[Page 37947]]
Vol. 89
Monday,
No. 88
May 6, 2024
Part VII
Agency for International Development
-----------------------------------------------------------------------
48 CFR Parts 727, 742, and 752
USAID Acquisition Regulation: Planning, Collection, and Submission of
Digital Information; Submission of Activity Monitoring, Evaluation, and
Learning Plan to USAID; Final Rule
Federal Register / Vol. 89 , No. 88 / Monday, May 6, 2024 / Rules and
Regulations
[[Page 37948]]
-----------------------------------------------------------------------
AGENCY FOR INTERNATIONAL DEVELOPMENT
48 CFR Parts 727, 742, and 752
RIN 0412-AA90
USAID Acquisition Regulation: Planning, Collection, and
Submission of Digital Information; Submission of Activity Monitoring,
Evaluation, and Learning Plan to USAID
AGENCY: U.S. Agency for International Development.
ACTION: Final rule.
-----------------------------------------------------------------------
SUMMARY: The United States Agency for International Development (USAID)
issuing a final rule amending USAID Acquisition Regulation (AIDAR) that
implements USAID requirements for managing digital information as a
strategic asset to inform the planning, design, implementation,
monitoring, and evaluation of the Agency's foreign assistance programs.
This final rule incorporates a new policy on Digital Information
Planning, Collection, and Submission Requirements and the corresponding
clause as well as a new clause entitled ``Activity Monitoring,
Evaluation, and Learning Plan Requirements'' into the (AIDAR). This
final rule is intended to reduce the burden on contractors, increase
efficiency, and improve the use of data and other forms of digital
information across the Agency's programs and operations.
DATES: Effective June 5, 2024.
FOR FURTHER INFORMATION CONTACT: Kelly Miskowski, USAID M/OAA/P, at
202-256-7378 or [email protected] for clarification of content or
information pertaining to status or publication schedules. All
communications regarding this rule must cite AIDAR RIN No. 0412-AA90.
SUPPLEMENTARY INFORMATION:
A. Background
USAID published a proposed rule in the Federal Register at 86 FR
71216 on December 15, 2021, to implement USAID requirements for
managing digital information as a strategic asset to inform the
planning, design, implementation, monitoring, and evaluation of the
Agency's foreign assistance programs as outlined in 48 CFR parts 727,
742, and 752. USAID also published a notice of availability of
supplemental document containing data standards in the Federal Register
at 88 FR 22990 on April 14, 2023, and solicited comments. A response to
comments received as well as a revised copy of the supplemental
document is included with this rulemaking.
On August 25, 2022, the Office of Science and Technology Policy
(OSTP) published a Memorandum (viewable at this address: https://www.whitehouse.gov/wp-content/uploads/2022/08/08-2022-OSTP-Public-Access-Memo.pdf). In this memorandum, OSTP provided policy guidance to
ensure that publications and their supporting data resulting from
federally funded research are publicly accessible without an embargo on
their free and public release. This memo was released after publication
of the proposed rule. USAID's language around embargoes within this
rule is intentionally flexible, granting embargoes on the release of
digital objects only in limited circumstances, such as in the interest
of international development and foreign policy objectives, consistent
with both USAID and OSTP policy and guidance, and no changes have been
made to the language of the rule as a result. In implementation, any
approval of embargoes will be consistent with OSTP guidance.
B. Discussion and Analysis
Response to Comments on the Proposed Rule
Seventeen respondents submitted public comments in response to the
proposed rule. USAID assessed the public comments in the development of
the final rule. The full text of the comments is available at the
Federal Rulemaking Portal, www.regulations.gov. A discussion of the
comments and the changes made to the rule as a result of those comments
are provided as follows:
1. Summary of Significant Changes
The following significant changes from the proposed rule are made
in the final rule:
a. Added definitions for data inventory, digital, and digital
method.
b. Revised applicability of 752.227-71 from the micro purchase
threshold to the simplified acquisition threshold. Similarly, USAID has
added an Alternate clause exempting certain contracts from the
requirement to provide a data management plan. Specifically, contracts
are exempted that: contain no data; are for emergency food assistance;
are for disaster assistance, and transition-assistance activities
managed by the Bureau for Humanitarian Assistance (BHA); or are for
activities managed by the Bureau for Conflict Prevention and
Stabilization's Office of Transition Initiatives (CPS/OTI).
c. The burden and cost estimates have been updated to reflect the
changes outlined in paragraph b above, and the comments received
related to this estimate are addressed in the revised Regulatory Impact
Analysis. Additionally, comments regarding the number of respondents
and whether the cost of design, testing, launch, and management of the
Digital Front Door (DFD) website was subtracted are addressed as well.
d. Clarified the timeline for submission as outlined in AIDAR
752.227-71(f)(3)(i).
e. Various administrative amendments and clarifications have been
added, such as revising references throughout the rule to indicate that
the contracting officer, or contracting officer's representative if
delegated, has authority to approve on behalf of USAID and renumbering
of the AIDAR clause sections to conform with USAID numbering
conventions.
2. Analysis of Public Comments
Below are the Agency's responses to comments on the changes
proposed to United States Agency for International Development (USAID)
Acquisition Regulation (AIDAR): Planning, Collection, and Submission of
Digital Information as Well as Submission of Activity Monitoring,
Evaluation, and Learning Plan to USAID. The Agency did not address
comments unrelated to, or outside the scope of, the revisions of the
proposed rule from the existing rule:
a. General Support for the Rule
1. Comment: Five respondents (7, 8, 9, 11, and 15) indicated
general support for the rule. Some commenters noted that the rule will
simplify reporting, reduce redundant data calls, and reduce the burden
on contractors.
Response: USAID acknowledges the respondent's support for the rule.
b. Does Not Support the Rule
1. Comment: One respondent (16) did not support the rule,
indicating that it will make it harder for contractors to act
responsibly with data management of affected populations. Other
commenters (11, 15) did not indicate a lack of support for the rule as
a whole but did note that complex submission requirements may
negatively impact local partners, small business, and potential market
entrants due to potential cost and needed technical expertise.
Response: USAID acknowledges this feedback to the rule.
[[Page 37949]]
c. Data Rights and Protection
Several commenters (6, 7, 8, 11, 13, 14, 15, and 16) brought up
issues around privacy, PII, publication, and informed consent, which
are addressed in sub-categories as outlined below.
1. Access to Data and Data Rights--
A. Comment: Several commenters (6, 11, 13) inquired about whether
the DFD will be public and available to other partners like the
Development Experience Clearinghouse (DEC) and Development Data Library
(DDL).
Response: The DFD is not its own system and is not intended to
replace other systems. It is a public facing web page with centralized
authentication that will direct users to the appropriate USAID systems
for which they have authorized access. This includes but is not
necessarily limited to the Development Information Solution (DIS), DEC,
and DDL.
B. Comment: Commenter #8 specifically asked whether information
that is exempt from the DFD (like PII) be submitted to USAID first as a
restricted version before being scrubbed and sent to the DFD?
Response: The rule states that the contractor must not submit
information to the DFD that contains personally identifiable
information. And that to the maximum extent possible, the contractor
must remove the association between the set of identifying data and the
individual to which it applies unless retaining such information is
essential to comply with the terms of the contract and upon written
approval from the contracting officer or contracting officer's
representative as delegated to submit this information. Otherwise, the
``Submission Requirements'' section states that contractors must
``submit digital information created or obtained in performance of this
contract to USAID at the finest level of granularity at which it was
collected.''
C. Comment: Commenter #16 questioned whether the contractor would
be able to effectively restrict access to sensitive data without fear
of losing funding.
Response: Some data might be exempted from submission under
subsection (f)(4) of the clause, including as determined by the
contracting officer or contracting officer's representative as
delegated in (f)(4)(ii). The rule provides for categories of
information not to submit to USAID. It further states that if the
Contractor believes there is a compelling reason not to submit specific
digital information that does not fall under an exemption in this
section, including circumstances where submission may jeopardize the
personal safety of any individual or group, the Contractor must obtain
written approval not to submit the digital information from the
contracting officer. Further specifics under an individual award may be
discussed with a contracting officer.
D. Comment: Some commenters (11, 13) noted that they did not
believe it was necessary (or questioned when circumstances would
require) to provide copies of license agreements for digital
information or media releases.
Response: USAID believes it is critical for USAID to have
documentation regarding the licenses for the digital information
submitted to the DFD so that USAID understands the license parameters
for use of the data. As such, data licenses are a submission
requirement in this rule.
2. Informed Consent
A. Comment: Commenter #16 noted that the rule appears to
contemplate large collections of data for purposes that cannot be fully
known, which will negate the ability for truly informed consent to be
given.
Response: The contract itself will mandate the required information
to be collected and requirements relating to human subjects research
and USAID's data rights. The rule does not mandate new digital
information collections but provides guidance on the management of the
specific digital information collected under the contract. To the
extent the contractually required collection triggers informed consent
requirements under Human Subjects Research, this is governed by AIDAR
752.7012 (the Federal Policy for the Protection of Human Subjects (the
``Common Rule'').
B. Comment: Commenter #8 indicated if providing personal
information is a requirement for participation in an activity (such as
attending a training), then providing such information can no longer be
considered ``voluntary.'' This commenter recommended that the rule
explicitly address the rights of respondents/human subjects to
voluntarily provide (or not provide) this data/PII or to otherwise
restrict sharing of personal information.
Response: This rule does not address the provision of personal
information as a precondition to receiving services. Existing informed
consent requirements already address the voluntary provision of
information when respondents elect to participate in human subjects
research. Explicitly addressing the rights of respondents/human
subjects is outside the scope of this rule. Please also refer to
USAID's responses in C.4 of this section covering Protection of
Information.
C. Comment: Two commenters (11, 13) noted that Ref (f)(1)(v) refers
to AIDAR 752.7012; however, this only pertains to the protection of the
individual as a research subject, which is not applicable to every
contract.
Response: USAID has updated the rule to clarify that this
requirement applies only when AIDAR 752.7012 is included in the
contract. (See corresponding edits to 752.227-71(f)(1)(v)).
D. Comment: Commenter #14 requested clarity on 727.7002 Policy
(b)(3) noting that it is unclear if USAID is requiring that the
submission contain every signed consent form, an indication that each
individual submitted consent, or just a blank copy of the form itself.
They recommended adding clarifying language in 752.227-71.
Response: Paragraph (f)(1)(v) of this clause already instructs
contractors to provide a ``blank copy'' so no further edits are needed.
3. Preparation of Data
A. Comment: Commenter #8 expressed concerns that as written
proposed clause 752.227-71 requires submission of data scrubbed of PII.
They indicate that scrubbing qualitative data such as speech patterns
and other audio/video information is extremely costly and time
consuming without sufficient guidance. As such, they recommend
providing guidance on identifying high informational value qualitative
data and the process for de-identifying these data. Additionally, they
recommend: (1) clarifying the definition of ``machine readable'' to
exclude unstructured qualitative data like audio/video recordings,
interview/focus group notes and transcripts, and (2) revising
submission requirement (i) to state, ``Submit machine readable digital
information created or obtained in performance of this contract to
USAID at the finest level of granularity at which it was collected.''
Response: Since audio or visual files may contain PII, contractors
should work with their contracting officer representative to determine
whether the information is necessary to submit, if an alternative such
as a transcript or summary is acceptable, or an exemption from
submission is appropriate. The contractor should address considerations
for specific media formats and content during the development of the
Data Management Plan. In addition, the draft rule allows flexibility
for specific circumstances noting, ``If the Contractor believes there
[[Page 37950]]
is a compelling reason not to submit specific digital information that
does not fall under an exemption in this section, including
circumstances where submission may jeopardize the personal safety of
any individual or group, the Contractor must obtain written approval
not to submit the digital information from the contracting officer.''
(See 752.227-71(f)(4)(ii) of the Proposed Rule). No revisions to the
rule are necessary.
To the commenter's follow-up regarding ``machine readable'', USAID
has revised the final rule to indicate that the machine-readability
requirement applies only to digital data and datasets, thus excluding
digital objects like audio and video files (See edits to 752.227-
71(f)(1)(ii)). With regard to the recommendation on submitting digital
information at the ``finest level of granularity at which it was
collected,'' there already exists a requirement in 752.227-71(f)(1)(i)
to ``Submit digital information created or obtained in performance of
this contract to USAID at the finest level of granularity at which it
was collected.'' No further revisions are necessary. (See also response
to c(4)(A) of this section below)
B. Comment: Commenter #7 questioned whether there would be analog
options, noting that print outs of documents limit digital
functionality (i.e., a printed hyperlink cannot provide the additional
information that someone may access in a digital copy).
Response: 752.227-71(f)(1)(i) states: ``Use only digital methods
and USAID-approved standards to the extent practicable . . .'' This
allows for analog options in the event that digital methods are not
available or practicable.
4. Protection of Data
A. Comment: Some commenters (14, 16) expressed concerns about the
broadness of ``finest level of granularity'' and requested that
guidance be given as to how granular the data must be.
Response: Regarding the ``finest level of granularity'', some, but
not all, USAID contracts will provide technical details regarding the
level of granularity required. In the absence of such technical
guidance, contractors must collect digital information at a level of
granularity that allows them to comply with the terms of their award.
Barring specific exceptions outlined in the rule, contractors must
submit this digital information at the same level of granularity at
which it was obtained, rather than aggregating or otherwise
generalizing the information. USAID will not necessarily publish or
otherwise share data at the same level of granularity as submitted by
the contractor.
B. Comment: Commenter #16 noted that some international standards
reference `personal data' rather than PII, which protects broader
categories of information to prevent re-identification particularly in
areas with humanitarian concerns. Further, they noted that USAID
requirements may be contrary to local rules and regulations regarding
data protection and asked if partners will be given adequate support in
these situations.
Response: USAID adheres to definitions and standards set forth by
the Office of Management and Budget (OMB), including those in OMB
Circular A-130, which defines personally identifiable information.
USAID has processes in place to manage re-identification risks
concerning personally identifiable information. In the event a USAID
partner identifies a potential concern under local law that could
impact their ability to plan for and adhere to the requirements of this
clause, they should identify that concern during the Digital
Information Planning process and contact their contracting officer
representative for additional guidance.
C. Comment: Commenter #11 questioned whether USAID would limit
methods, applications, or systems used for data collection; how USAID
will define when digital data collection methods are impractical; and
what process there is for Contractors to justify withholding data
information.
Response: This rule does not provide specific requirements
regarding applications and systems that contractors must use for data
collection. Whether certain methods are impractical will be fact
specific and should be addressed with the contracting officer
representative. As to the process for contractors to justify
withholding ``data information'' [sic], the rule states, ``(ii) If the
Contractor believes there is a compelling reason not to submit specific
digital information that does not fall under an exemption in this
section, including circumstances where submission may jeopardize the
personal safety of any individual or group, the Contractor must obtain
written approval not to submit the digital information from the
contracting officer.''
d. Clarity on Language and Requirements
1. Background, Authority, Timeline, and Editorial
A. Comment: Several commenters (8, 11, 13) requested clarity on
when to submit digital information noting that the clause says 30
calendar days but also has an option to submit when the information
meets the requirements of quality digital information or 30 days after
closeout. Some specifically noted that allowing submission after
closeout could allow the incumbent access to data which competitors for
a follow-on would not. Finally, one commenter (8) asked that USAID
consider providing additional time (rather than 30 days after contract
end) and resources (including funding) for data submission.
Response: With regard to clarification on the submission timeline,
USAID has updated the rule to emphasize that the contractor must adhere
to the ``schedule of the contract.'' Should a timeline for a specific
digital information not be specified in the award schedule, the
language as written requires the contractor to submit the information
``once it meets the requirements of quality digital information,''
regardless of when this criterion is met during the award period. This
is stated as a requirement, not as an option. This is intentional since
USAID often requires access to finalized (i.e., ``quality'')
information well before the end of a typical five year contract. As the
contract draws to a close, USAID also recognizes that valuable
information funded by the Agency may remain in the contractor's
possession, whether in draft or final ``quality'' form. For this
reason, there is an additional, non-optional requirement to submit any
``draft'' and ``quality'' digital information not previously submitted,
no later than 30-days after contract completion. The fact that the
incumbent may still have access to this information during the 30-day
period after contract completion does not in itself create a conflict
of interest for the incumbent. The clause already allows the contractor
to obtain approval from the contracting officer for variations to the
30 day submission period. Any costs associated with such submissions
should be anticipated and planned for during proposal submission.
B. Comment: Commenter #11 recommended adding ``as approved by
USAID's Chief Information Officer'' as in Section (f)(1)(vi)(D)(2)
throughout the rest of the section.
Response: USAID believes the language is sufficiently clear as
written.
C. Comment: Two commenters (11, 13) requested clarity on which
parts of the mandates listed in the section 727.7000 of the proposed
AIDAR text will be implemented in the Rule.
Response: By implementing this rule, USAID intends to enhance
compliance with several mandates which include
[[Page 37951]]
but are not necessarily limited to the following: (1) Broad sections of
OMB Circular A-130, with a particular focus on Section 5 e. which
outlines policy on ``Information Management and Access;'' (2)
Foundations for Evidence-Based Policymaking Act, with a focus on Title
II, ``Open Government Data Act;'' (3) The 21st Century IDEA Act, with a
focus on Section 3, ``Website Modernization;'' and Section 4,
``Digitization of Government Services and Forms;'' (4) Foreign Aid
Transparency and Accountability Act, including Section 3 (c)
``Objectives of Guidelines;'' and (5) the Geospatial Data Act, with a
focus on Section 2806, ``Geospatial data standards.''
D. Comment: Commenter #8 noted that the benefit of supporting
institutional learning and public understanding of USAID program impact
should be more explicit in the introduction.
Response: USAID appreciates this comment but believes that the
preamble is sufficiently clear as written.
E. Comment: Commenter #11 asked whether digital information
requested includes only information obtained for the purpose of
implementing programmatic activities.
Response: USAID refers the respondent to ``727.7003 Contract
clause.'' This section specifies the insertion of the clause into
``contracts fully or partially funded with program funds. . . .''
Therefore, the primary focus of this clause is on activities resourced
with program funds. However, to limit burden, and per the definitions
of ``data'' and ``digital information'' in the clause, there would be
no requirement to submit ``information incidental to contract
administration, such as financial, administrative, cost or pricing, or
management information.'' Please see also USAID's response to the
comment in (4)(B) of this section.
F. Comment: Commenter #13 indicated that 752.227-71(f) makes a
reference to (f)(4) which, the respondent suggests, does not exist.
Response: Section (f)(4) of 752.227-71 is entitled ``Exemptions.''
2. Digital Information, Methods, Objects, and Inventory
A. Comment: Two commenters (8, 12) requested a definition of
``digital methods'' per 752.227-71 and noted that as structured, the
proposed rule requires submission of digital data that cannot comply
with the machine-readable requirement (i.e., audio recordings,
transcripts).
Response: USAID has added a definition for ``digital methods'' to
Section 727.7001 and the clause 752.227-71(a). USAID appreciates the
comment highlighting the challenges with submitting audiovisual files
in machine readable format. In light of this issue, USAID has revised
the final rule to indicate that the machine-readability requirement
applies only to digital data and datasets. (See 752.227-71(f)(1)(ii)).
B. Comment: Commenter #11 requested a definition of both ``data
inventory'' and ``any digital object''.
Response: USAID appreciates these comments and has added
definitions for ``digital'' and ``data inventory'' to Section 727.7001
and the clause 752.227-71(a). USAID notes that ``digital object'' is
already defined in the clause.
3. Beneficiary Feedback
A. Comment: Commenter #8 requested clarity on how ``beneficiary''
is defined, and who will define the term (i.e., do Contractors identify
beneficiaries to elicit feedback from).
Response: This aspect of the rule is intended to implement a
recurring requirement of recent appropriations acts. Most recently, in
the FY 2022 Consolidated Appropriations Act Congress directed that
Development Assistance (DA) funds shall be made available for the
regular and systematic collection of feedback obtained directly from
beneficiaries to enhance the quality and relevance of such assistance.
The term ``beneficiary'' is not defined in this statute; its use herein
is intended to be consistent with its use in the AIDAR, agency internal
policies (Automated Directives Systems), and other agency policy and
procedural documents. At times the individuals who may be considered as
``beneficiaries'' for a particular contract may depend on the specific
nature of the contract and the implementation context. USAID believes
it is not necessary to create a unique definition of ``beneficiary''
for the purpose of this rule, no changes to the AIDAR text are made.
Specific concerns regarding identification of beneficiaries for an
award may be discussed with a contracting officer.
B. Comment: Commenter #11 requested more clarity on what USAID
means by ``feedback'' noting that there may be an appearance of
coercion as beneficiaries receive benefits from the program. Given that
potential conflict, will USAID use this feedback to assess contractor
performance or USAID's performance? Will questions be drafted and
solicited through USAID or the contractor?
Response: While USAID does not define the term ``feedback'' per se,
the AIDAR clause 752.242-71 contains the definition of ``feedback from
beneficiaries'', which emphasizes the voluntary nature of these
communications. As with any other data collection process managed by
USAID contractors, beneficiary feedback must not be collected through
coercion. Contractors must not withhold benefits based on whether a
beneficiary provides feedback or the nature of the feedback about the
benefits received.
Contracting officers may rely on information obtained from
beneficiary feedback, or any other sources, as appropriate in
evaluating past performance of offerors as permitted in the FAR. (For
examples see FAR 15.305(a)(2)(ii), 13.106-2(b)(3)(ii)) and FAR 12.206).
Managers and decision-makers within USAID operating units will
determine if beneficiary feedback will also be used to assess USAID's
performance. As to whether questions for soliciting feedback from
beneficiaries will be drafted by USAID or the contractor, this will
depend on the specific contract and the final Activity MEL Plan which
should include the contractor's plans for collecting, responding to,
and reporting on feedback from beneficiaries, if required by the
contract. USAID may consult with contractors as necessary in developing
the Activity MEL Plan to ensure the proposed methods of collecting,
responding to, and reporting beneficiary feedback is appropriate under
the particular contract and activity.
C. Comment: Commenter #8 requested clarity on how the information
will be used and recommended verification via third party or further
guidance to prevent bias.
Response: USAID expects that contractors will review the feedback
they receive and use it in their management decision-making as noted in
the Federal Register notice to enhance the quality and relevance of
USAID programs and to maximize the cost-effectiveness and utility of
these programs for beneficiaries. We appreciate the recommendation that
USAID verify beneficiary feedback information via a third party; if
applicable, appropriate means of verifying contract compliance with
this rule will be determined for each contract by the contract officer
and contract officer's representative.
D. Comment: Commenter #12 requested clarity on the term ``cost-
effectiveness''--specifically whether contractors will be expected to
use feedback generally to over-all cost effectiveness or whether they
will perform a formal cost effectiveness analysis.
[[Page 37952]]
Response: USAID contractors will not generally be expected to
perform a formal cost effectiveness analysis solely based on
beneficiary feedback. Rather, USAID expects that feedback from
beneficiaries will be generally useful to the management decision-
making of the contractor, particularly regarding adaptations a
contractor might make to their implementation processes that could
improve cost-effectiveness and utility of the assistance provided to
beneficiaries.
E. Comment: Commenter #10 requested clarity on whether the
definition of ``regularly'' collected feedback that is ``appropriate''
and ``feasible'' will be determined by the contractor and USAID during
AMELP development.
Response: Rather than establishing the definition of ``regularly'',
USAID expects that a determination of ``regular'' feedback collection
will depend on the size and scope of the activity and will be
determined by the contractor and USAID during AMELP development, unless
the frequency of beneficiary feedback collection is specified in the
contract.
F. Comment: Commenter #14 requested clarity on if beneficiary
feedback data collection could be combined with other collections.
Response: Unless mandated to be collected and reported separately
by the award terms, beneficiary feedback may be combined with other
data collection efforts.
4. Finest Level of Granularity
A. Comment: Several commenters (9, 10, 11, 13, 15) requested
clarity on the term ``finest level of granularity'' with several
requesting that each contract should specify the level of detail (or
allow for flexibility to ensure protection of data) noting concerns
that a strict interpretation may result in turning over unnecessary,
sensitive data. One (10) commenter inquired whether the contractor will
use their own definitions of granularity or if there will be a USAID-
defined standard or template (or process to determine this level of
granularity) and questioned if the DFD submission would include any raw
data in digital form.
Response: Some, but not all, USAID contracts will provide technical
details regarding the level of granularity required. However, it is not
practical to pre-specify levels of data granularity in all contracts,
as the Agency may need to allow some contractor discretion in this
area. Therefore, during ``Digital information planning requirements''
as specified in paragraph (b) of the clause 752.227-71, contractors
should propose a level of granularity that allows them to comply with
the terms of their award. Barring specific exceptions outlined in the
clause 752.227-71, contractors must submit this digital information at
the same level of granularity at which it was obtained, rather than
aggregating or otherwise generalizing the information. Depending on the
requirements of the contract, the DFD submission process may include
the submission of raw data in digital form, to include entering raw
data in online DFD templates or the upload of entire datasets.
B. Comment: Some commenters (11, 12) requested further information
on how the granular data would be used and submitted--specifically
asking if it will only be for the purpose of implementing programmatic
activities.
Response: USAID's usage of the data will be determined by the data
rights clause in the contract.
C. Comment: Commenter #16 recommended removing the requirement to
share data at the finest level of granularity. Barring that, they
requested guidance for exemptions to prevent potential re-
identification of parties due to transmission of PII and potential data
leaks.
Response: USAID cannot remove the ``finest level of granularity''
requirement without jeopardizing its ability to accomplish its mission.
USAID is aware that re-identification risk increases with granularity
and appreciates that commenters are aware of this. To this end, USAID
has included exemptions from submission (See 752.227-71(f)(4)) and
indicated that PII submitted should be limited to the maximum extent
practicable (See 752.227-71(d)(2)). Moreover, USAID will not
necessarily publish or otherwise share data at the same level of
granularity as submitted by the contractor, especially if the
contractor submits sensitive data. Regarding the request for additional
guidance, this is outside the scope of this rule.
5. Digital Standards, Repositories, and Alternate Technologies
A. Comment: Some commenters (11, 13) requested a definition of
alternate technology and information on how to know if the Chief
Information Officer (CIO) has approved it.
Response: Technologies that are approved for USAID use fluctuate
frequently, given the rapidly changing nature of technology itself.
This makes it impracticable to provide a list or definition of USAID's
approved technologies in a static document. Contractors must seek
approval to use alternate technologies by contacting their Contracting
Officer. The Contracting Officer will seek approval in consultation
with USAID's Office of the Chief Information Officer and USAID policy.
B. Comment: Some commenters (11, 13) noted that the hyperlink
provided in (h) (data.usaid.gov/guidelines) was inoperable and
requested access to the information for review.
Response: USAID will update the hyperlink to indicate
data.usaid.gov/standards (see revised text in 752.227-71(h)). On April
14, 2023 USAID published a Notice of availability of a supplemental
document in the Federal Register (88 FR 22990) specifically noting that
USAID received requests under the comment period for this rule to
provide access to the standards. The supplemental document entitled
``USAID Digital Collection and Submission Standards'' was available for
comment. USAID collected those comments and provided a response to them
in this document.
C. Comment: Several commenters (11, 13, 14) requested information
on what the USAID approved standards are and if they will be provided
to contractors.
Response: USAID published the ``USAID Digital Collection and
Submission Standards'' in the Federal Register (88 FR 22990) on April
14, 2023 and provided a comment period for the public.
D. Comment: Some commenters (11, 13) requested a definition of
USAID-approved by digital repository.
Response: USAID is not including a definition of a ``USAID-approved
digital repository'' in the rule as this determination is an internal
policy decision. USAID's policies on acceptable digital repositories
will be informed, in part, by the standards for digital repositories
developed by the interagency Subcommittee on Open Science of the
National Science and Technology Council (NSTC). This includes those
found in the document Desirable Characteristics of Data Repositories
for Federally Funded Research, released by OSTP in May 2022 (available
at: https://www.whitehouse.gov/wp-content/uploads/2022/05/05-2022-Desirable-Characteristics-of-Data-Repositories.pdf).
E. Comment: Commenter #9 recommended using or aligning with the
International Aid Transparency Initiative rather than a USAID-approved
standard.
Response: Since the U.S. Government as a whole is a signatory to
IATI (see: https://iatistandard.org/en/news/united-states-marks-10-years-since-becoming-an-iati-signatory/), USAID has included IATI as a
recommended standard.
[[Page 37953]]
Should a data standard for a specific subject area not be available at
data.usaid.gov/standards, the standard will be indicated in the
contract itself or provided to the contractor upon consultation with
the Contracting Officer.
F. Comment: Commenter #11 asked how USAID will define data
standards--in the contract or agreed upon in the data management plan.
Response: USAID published the ``USAID Digital Collection and
Submission Standards'' in the Federal Register (88 FR 22990) on April
14, 2023, and provided a comment period for the public.
6. Data Management Plan
A. Comment: Some commenters (11, 13) requested clarity on the
requirements of a Data Management Plan with one noting that if DMP
requirements are outlined in ADS 579, they should be directly in the
rule as the ADS is USAID internal guidance.
Response: The preamble to the rule contains references to ADS 579
as background information only. However, the specific Data Management
Plan (DMP) requirements are outlined in the proposed clause in 752.227-
71(c)(2) What to submit.
B. Comment: Commenter #9 requested that contractors be allowed to
identify which data they cannot share with USAID along with an
appropriate justification.
Response: AIDAR 752.227-71(f)(4)(ii) indicates that ``[i]f the
Contractor believes there is a compelling reason not to submit specific
digital information that does not fall under an exemption in this
section, including circumstances where submission may jeopardize the
personal safety of any individual or group, the Contractor must obtain
written approval not to submit the digital information from the
contracting officer.''
C. Comment: Commenter #8 requested clarity on which types of data
and/or contracts will require a DMP.
Response: The rule, as revised, states that the clause applies to
``solicitations and contracts fully or partially funded with program
funds exceeding the simplified acquisition threshold.'' (See 727.7003
and 752.227-71) Paragraph (c) of this clause includes the DMP
requirements. As outlined in 727.7003, this paragraph is ``[reserved]''
and DMP requirements not applicable when the anticipated contract: (1)
does not collect data; (2) implements emergency food assistance under
the Food for Peace Act or section 491 of the Foreign Assistance Act of
1961, including for the procurement, transportation, storage, handling
and/or distribution of such assistance; (3) implements international
disaster assistance under section 491 of the Foreign Assistance Act of
1961 or other authorities administered by the Bureau for Humanitarian
Assistance; or (4) implements activities managed by the Bureau for
Conflict Prevention and Stabilization's Office of Transition
Initiatives, or fully or partially funded with the Complex Crises Fund.
D. Comment: Commenter #13 noted that not allowing digital
information collection until the DMP is approved may delay
implementation.
Response: The contractor must begin award implementation upon
formal approval of the award. However, digital information collection
must not begin prior to approval of the data inventory and submission
of any remaining components of the DMP unless authorized in writing by
the contracting officer. Based on multiple lessons learned, USAID
believes the value of requiring a DMP to far outweigh potential delays
in submissions.
E. Comment: Several commenters (8, 10, 11, 14) requested clarity on
the timeline, processes, and standards for DMPs--specifically
information on what the documentation will look like; how standards
will be defined that the contractor may be audited against; who will
review/approve DMPs and standards for such approval; how approval
officials will be trained as well as the timeline for review with a
recommendation that they be reviewed annually; whether USAID will
provide a template.
Response: This rule does not provide specific requirements on DMP
standards, review, approval, templates, or training of USAID officials.
Awards will have varying requirements on these matters, and partners
must consult the terms of their award for specific details. These
issues will be further addressed by USAID policy which USAID staff must
consult in providing direction to implementing partners. For additional
information, please consult ADS 579--USAID Development Data (available
at: https://www.usaid.gov/about-us/agency-policy/series-500/579).
F. Comment: Commenter #14 requested that the DMP be part of the
AMELP given that many of the requirements overlap (with another (11)
asking for clarity on if they are separate requirements.
Response: The requirement to submit a DMP is distinct from the
requirement to submit an Activity MEL plan. Both plans serve distinct
purposes, as described in the rule, and some activities that do not
require an Activity MEL plan may still require a DMP. Unless otherwise
precluded by the terms and conditions of their contract, contractors
required to submit both a DMP and an Activity MEL plan may submit a DMP
as a section of an Activity MEL plan or as a separate stand-alone plan.
7. Activity Monitoring Evaluation and Learning Plan
A. Comment: Commenter #13 noted that the clause cites ADS 200/201
which is internal policy and requested that the clause itself address
plan requirements.
Response: The only reference to ADS 201 in the proposed AIDAR text
is included in section 742.1170-5, as a source of additional
information on USAID program cycle activity monitoring, evaluation and
learning. The clause at 752.242-71 fully addresses the requirements for
the Activity Monitoring, Evaluation, and Learning Plan.
B. Comment: Commenter #11 requested adoption of a longer timeline
to develop the Activity MEL Plan (currently 90 days) citing UK agencies
which use a six- to 12-month timeframe.
Response: Regarding the recommendation to adopt a longer timeline
to develop the Activity MEL Plan, USAID, after consideration of the
public comment, has determined to maintain the 90-day timeline, unless
otherwise specified in the contract schedule. OMB guidance M-18-04
regarding Monitoring and Evaluation Guidelines for Federal Departments
and Agencies that Administer United States Foreign Assistance
recommends that monitoring and evaluation be planned early. USAID's
experience has shown that adherence to a 90-day timeline has provided
sufficient time to generate an actionable AMELP without resulting in
significant programmatic delays. Without obtaining an AMELP from the
contractor in the early stages of activity implementation, USAID faces
decreased ability to determine that U.S. Foreign Assistance goals are
being met. Notably, AMELPs may be revised and updated, in coordination
with USAID, as additional information becomes available.
8. Risk
A. Comment: Commenter #16 requested that a limited purpose for the
collection be set out as well as time limits of data retention and
clear requirements for data security and literacy.
Response: The scope of the contract itself will provide clarity on
the purpose of the collection. USAID adheres to the requirements of the
Federal Records Act for the retention of records and any
[[Page 37954]]
retention requirements on contractors will be outlined in the award.
USAID requirements on data literacy and security are determined by the
Agency's internal policies. USAID requirements for the contractor on
data literacy and security would be outlined in the award.
B. Comment: Commenter #13 requested that paragraph (g)(2) be
amended to indicate that the government may direct an embargo for one
year when the contractor submits digital objects as mandating it may
result in ineligibility to bid for follow-on contracts.
Response: The rule as currently written indicates that the
``Contractor may request . . an embargo. . . .'' and that the
``contracting officer or delegated contracting officer's representative
may approve an embargo. . . .'' (See 752.227-71(g)(2), emphasis added)
This is intentionally permissive language. Per the August 25, 2022,
memo from the White House Office of Science and Technology Policy
entitled, ``Ensuring Free, Immediate, and Equitable Access to Federally
Funded Research,'' USAID may approve embargoes, including those that
support foreign policy and international development objectives but
currently has no reason to mandate embargoes.
C. Comment: Commenter #13 requested that the rule allow for the
implementer to add a disclaimer of liability of information per section
(f)(vi)(B).
Response: Please note that contractors are already allowed under
752.227-71(f)(1)(vi) of the rule to ``provide additional details or
metadata'' regarding the ``quality of submissions of draft digital
information.'' This additional information would alert USAID, as well
as other potential users of the data, to any potential drawbacks of
using the submitted information to draw definitive conclusions.
D. Comment: Some commenters (11, 13) requested information on who
will perform the ``rigorous risk assessment of digital information
submitted to USAID'' and whether there will be guidance or a timeline
provided; they additionally asked about permissions and restrictions to
digital information to the DFD and whether the public will have access.
Response: USAID's risk assessment process will begin after
submission of information via the DFD and will involve multiple experts
spanning several parts of the Agency. For additional information, ADS
579 outlines the existing implementation of this process. USAID will
apply permissions and restrictions to digital information submitted via
the DFD as consistent with its existing information technology policies
as outlined in the ADS 500 series. Information submitted via the DFD
may be entirely restricted from public view, made available to bona
fide research institutions, made partially available to the public, or
made entirely available to the public, in accordance with existing U.S.
government mandates, depending on the sensitivity of the information or
other legal considerations.
e. USAID Systems and Processes
1. Digital Portals
A. Comment: Several commenters (6, 11, 12, 13, 17) asked whether
this rule will retire existing digital portals such as the DEC, DDL,
DIS, FTFMS, and other Mission level systems and if so, that a list of
portals, processes, and protocols eliminated be provided with a
timeline to ease transition.
Response: The DFD is not its own system and is not intended to
replace other systems. It is a public facing web page with centralized
authentication that will direct users to the appropriate USAID systems
for which they have authorized access. This includes but is not
necessarily limited to the Development Information Solution (DIS),
Development Experience Clearinghouse (DEC), and Development Data
Library (DDL). Upon publication of this rule, contractor requirements
in AIDAR Clause (DEC) 752.7005 will be eliminated.
B. Comment: Some commenters (6, 8, 13) wondered if legacy documents
from existing portals (DEC/DDL) will be available or if these portals
can be maintained during the transitional period (and if maintained,
how would they change)?
Response: Digital objects that are publicly available via the DEC,
DDL, and other public-facing data portals will continue to be available
as the DFD requirement is implemented.
C. Comment: Some commenters (11, 13, 17) asked that in the event
that other portals are not retired, under what circumstances would
contractors be required to submit to these other portals (i.e. the DIS;
or whether draft digital information goes to the DFD or another digital
repository).
Response: While the DEC and other submission clauses will be
retired upon implementation of this rule, the systems will continue to
exist in their current form. However, submission workflows into those
systems will take place via the DFD, reducing the total number of URLs
required to meet contractual requirements.
D. Comment: Some commenters (11, 13) noted that the link to
dfd.usaid.gov is not live and requested access to review.
Response: The link to the DFD will be active upon publication of
the final rule.
E. Comment: Commenter #11 asked whether contractors will maintain
unique registrations on the DFD for each contract.
Response: The contractor can choose whether to assign a single
individual to submit information on behalf of multiple contracts or to
assign a single individual to submit information for each individual
contract. However, contractors must ensure compliance with the
requirements in the clause for each individual award.
F. Comment: Commenter #17 requested standard reporting templates
for submissions to the DFD and asked about integration of existing
monitoring tools. They (17) further asked about USAID's plan to address
technical challenges and limitations for global systems implementation
and learning curves/technical deficiencies internationally.
Response: Rather than providing standard USAID templates, the user
interface for each system will guide partners in entering the
information required. To address the learning curve associated with
these changes, USAID will continue to provide training, communications,
and instructional guides to facilitate the transition.
G. Comment: Commenter #8 noted that the current DDL platform has a
500-variable maximum for .csv submission resulting in large datasets
needing to be broken up into parts.
Response: The Agency is aware of technical limitations in
submitting datasets to the DDL and continues to work to make ongoing
enhancements to these technologies.
2. Revisions to Existing Policy
Comment: Two commenters (11, 13) asked whether ADS 302.3.5.21
(Submissions of Datasets to the Development Data Library (DDL) (October
2014)) will be removed or revised as the proposed rule removes AIDAR
752.7005 and the anticipated timeline for removal.
Response: Yes. USAID's internal policy guidance will be amended to
reflect the change to the AIDAR. The rule currently removes and
reserves AIDAR 752.7005.
3. Contracting Officer's Representative Approvals
A.Comment: Some commenters (11, 13) noted that language giving
Contracting Officer's Representative
[[Page 37955]]
discretion to change submission requirements may lead to confusion, and
commenter #11 recommended that COR discretion to tell a contractor
where to submit information should be on a mission basis instead.
Commenter #11 noted that requiring COR approval each time an exception
is necessary is prohibitively costly in politically insecure or
otherwise challenging environments.
Response: USAID believes that allowing COR discretion on submission
requirements is essential given that submission questions are often
fact specific. In addition, USAID is developing guidance for CORs and
USAID staff on how to handle such requests in order to ensure a
consistent approach to the greatest extent possible. This guidance will
also outline alternate technologies and USAID-approved repositories for
the submission of digital information. USAID does not agree that COR
involvement in granting exemptions is unreasonable in challenging
operational environments. To the maximum extent practicable, the
contractor should address these challenges during the digital
information planning process in order to mitigate unforeseen costs and
to obtain necessary approvals should such circumstances arise.
B. Comment: Some commenters (11, 13) requested more information on
processes for the approval of digital information, to include whether
approvals of digital information are granted within or outside the DFD.
These commenters also requested information on the submission exemption
process.
Response: The means of granting approval will vary based on the
type of digital information submitted. USAID has updated the AIDAR
requirements in 752.227-71(f)(3)(i) to clarify that with the exception
of datasets, the Contractor must submit all other digital objects
within 30 days of obtaining the contracting officer or delegated
contracting officer representative's approval. This pre-submission
approval process will generally take place via email. The direct
submission of digital data (e.g. indicator data) and datasets via the
DFD will trigger a semi-automated approval process that will take place
directly within USAID information systems. This process will take place
via a combination of system-generated messages and email exchanges with
USAID personnel. Exemptions are already addressed in AIDAR 752.227-
71(f)(4) and will be granted on a case-by-case basis.
4. Exceptions and Oversight
A. Comment: Commenter #11 requested information on the process to
exempt data submission when the personal safety of an individual or
group is jeopardized.
Response: Circumstances that jeopardize the safety of an individual
or group can vary widely, and USAID will address these on a case-by-
case basis. To enable USAID to make an informed decision tailored to
the specific circumstance, AIDAR 752.227-71(f)(1)(vi)(A) requires that
the contractor furnish details and/or metadata regarding known
sensitivities within digital information that may jeopardize the
personal safety of any individual or group. In addition, contractors
should use the digital information planning process to identify any
potential security or safety concerns early in the activity to the
greatest extent possible.
B. Comment: Commenter #7 asked whether there would be USAID/
Washington oversight of the recommended contractual requirements.
Response: Contract Officers will monitor individual contracts for
compliance with submission requirements. In addition, USAID/Washington
will periodically monitor information systems to help ensure that
submissions received are consistent with planned submissions identified
by the contractor during the digital information planning process.
Members of the public who observe that documents or other digital
artifacts are missing from USAID's public websites are encouraged to
contact USAID directly. In some cases, these documents may be awaiting
further curation by staff or exempted from public disclosure due to
sensitivities or other legal considerations.
f. Applicability
1. Acquisition vs. Assistance
Comment: Several commenters (5, 6, 8) inquired about whether these
provisions would be for contracts only--specifically asking about the
use of the word `contractor' rather than `implementing partner'.
Response: This rulemaking action is to amend the AIDAR which is
USAID's supplement to the FAR. As such, this only pertains to
contracts.
2. Existing Contracts
Comment: Some commenters (8, 12) asked whether existing contracts
would be amended resulting in revisions to already approved AMELPs or
the need to develop DMPs and whether additional funding would be
provided for these actions.
Response: The requirements established by this rule will apply to
all new contracts that meet the applicability criteria defined in this
rule. However, USAID may modify, in accordance with FAR 1.108(d): 1)
existing indefinite delivery contracts to include the new AIDAR clauses
for future orders, and 2) existing contract or task or delivery order
when exercising an option or modifying a contract or order to extend
the period of performance.
3. Burden on Small Entities
A. Comment: Some commenters (11, 13) inquired as to the need to
apply these clauses to any contract above the micro-purchase threshold
noting the increased burden on small entities. They requested it to be
changed to the Simplified Acquisition Threshold.
Response: USAID accepts the recommendation to revise applicability
to contracts above the Simplified Acquisition Threshold. The
corresponding changes are made to sections 727.7003 and 752.227-71.
B. Comment: Commenter #11 noted that the requirement to submit
media release templates is particularly onerous to small business and
requested that images be allowed to be credited/captioned by source.
Response: In order to use photos submitted by contractors which
contain images of individuals, USAID must establish that the
individuals provided consent to appear in the photos. USAID therefore
requires media releases for these photos, which cannot be accomplished
via photo captioning.
C. Comment: Two commenters (10, 15) noted that requiring only
digital methods will carry substantial burden and cost which may
disadvantage local and new contractors. They recommend allowing a
broader range of approaches, from digital to manual (with digital being
preferred and used as appropriate and practical) and asked whether
USAID approval would be necessary.
Response: Should the contractor encounter obstacles adhering to
digital collection methods, the contractor must first identify these in
the Data Management Plan. USAID may allow for an alternative collection
method on a case-by-case basis per the exception in Section 752.227-
71(d)(1)(i). This exception may apply, for instance, to situations
where availability of or access to digital technologies is limited;
where the knowledge and capacity to use them may be limited; or
circumstances where their use may prove overly burdensome.
[[Page 37956]]
4. Other Applicability Questions
A. Comment: Commenter #6 asked whether this rule covers GIS data
projects that are submitted to Missions.
Response: The draft rule applies to ``digital information produced,
furnished, acquired, or collected in performance of a USAID contract,''
and therefore also applies to GIS data projects that may be submitted
to missions.
B. Comment: Commenter #15 asked if the rule is applicable only for
US Government standard indicators or custom indicators as well.
Response: The rule applies to both standard and custom indicator
data under the broader definition of ``digital information.''
g. Out of Scope
A. Comment: Several commenters (1, 2, 3, and 4) included comments
which were not within the scope of the rule including topics such as
Presidential visits, criticism of the agency broadly, questions about
registration, and concerns related to COVID vaccination.
Response: USAID acknowledges receipt of these out-of-scope
comments.
B. Comment: Commenter #13 inquired about USAID's response to the
Paperwork Reduction Act request for comments on the DIS Pilot.
Response: The DIS Pilot comments are addressed separately alongside
this rule.
C. Comment: Commenter #13 questioned the cost analysis--
specifically about the determination of respondents; whether the DIS
costs were included in the Rule; whether decommissioning of certain
portals was included; and whether the cost of design, testing, launch,
and management of the DFD system was considered.
Response: Please see the Regulatory Impact Analysis (RIA) for more
detail regarding respondents. Because DIS is intended to be an Agency-
wide portfolio management system covering the entire program cycle,
internal costs unrelated to this rulemaking effort were not included in
the RIA. Costs related to partner submission of information via the
Digital Front Door have been added to the revised RIA. USAID's long-
term vision is to combine the Development Experience Clearinghouse
(DEC) and Development Data Library (DDL) into a single digital
repository. As this repository is still in planning stages and is
outside the scope of this rulemaking, costs are not available, and
USAID did not take them into account in the RIA for this rulemaking.
Please see the revised RIA for detail on the estimated cost of
establishing the Digital Front Door.
D. Comment: Commenter #15 requested suggested language for informed
consent forms noting that in order to obtain informed consent, the
contractor will need to clearly describe how the data submitted to the
DFD will be accessed and used.
Response: Suggested language for informed consent is outside the
scope of this rule.
E. Comment: Commenter #8 noted that local partners under assistance
may lack the data management capacity to implement this rule.
Response: USAID's assistance awards are outside the scope of this
rule.
F. Comment: Commenter #11 requested a definition of forms of
informed consent, guidance on collection, and what forms of collection
are appropriate to document informed consent.
Response: USAID requirements relative to informed consent for human
subjects research are found in 22 CFR part 225 and are thus not covered
under the scope of this rule.
G. Comment: Commenter #15 requested that the rule include language
regarding coordination of contractors with in-country review boards and
other governing bodies.
Response: This is outside the scope of this rule which deals with
digital information planning, collection, and submission.
H. Comment: Two commenters (11, 13) questioned how USAID will
protect proprietary data if contractors submit such data in accordance
with (f)(1)(ii) from competitors; how USAID will share data security
issues with partners; and how USAID and the contractor will share data
security responsibility.
Response: These comments regarding USAID's security
responsibilities are beyond the scope of this rule. USAID is subject to
legal and policy requirements on implementing adequate safeguards for
handling business confidential and proprietary information. Contractors
must follow the terms of their award regarding security and privacy
requirements.
I. Comment: Commenter #16 indicated concern about the length of
time of data retention by USAID, data security for certain local
organizations who may lack expertise
Response: USAID retains and disposes of electronic records in
accordance with National Archives and Records Administration rules and
policies. Regarding concerns that local partners may lack data security
expertise and the need for support, this is outside the scope of the
rule.
J. Comment: Commenter #7 asked if the DMP requirements will relate
in any way to the USAID Digital Strategy requirements of a Digital
Learning Plan and the regular requirement of a Learning Agenda; and if
so, whether USAID will manage and communicate evolving guidance to
contractors on these various mandates.
Response: Specifics on how DMPs relate to internal USAID guidance
are outside the scope of this rule.
Summary of Changes and Response to Comments on the Notice of
Availability of Supplemental Document, Published in the Federal
Register at 88 FR 22990 on April 14, 2023
Three respondents submitted public comments in response to the
Notice. USAID reviewed the public comments in the development of the
final rule. Based on the comments, the supplemental document has been
revised as outlined in (i) below. Additionally, changes to the
``geospatial'' language have been made to align with USAID policy. Note
that the text is provided without hyperlinks in this document, but they
are available at data.usaid.gov/standards. Below are the Agency's
responses to comments and the changes made to the rule as a result of
those comments are provided as follows:
h. Comment #1: requested information on how to access an account.
Response: This is outside the scope of this rulemaking.
i. Comment #2: noted that the inclusion of ``Metadata Creation
Tools'' may be inappropriate. They indicated that including specific
tools may give an appearance of preference or endorsement of such tools
as they may not be the best for the job and that updating the AIDAR
will take a long time potentially locking in the use of outdated tools.
Response: USAID has updated the standards to cite a non-exhaustive
list of potential metadata tools, rather than to explicitly list them
under ``Recommended Digital Information Technical Standards.''
j. Comment #3: indicated general support for rule and moving to
digital information. The respondent requested that there be policies to
standardize information collection in the Data Management Plan and
noted that USAID may be able to provide standardized templates for data
collection.
Response: This comment is outside the scope of the rulemaking.
USAID solicited comments as to the standards, including the text of
AIDAR 752.227-71(h) that refers to the standards. USAID
[[Page 37957]]
received comments on the Data Management Plan during the comment period
for the proposed rulemaking, and responses to those comments are
available in Section d.6 above.
Response to Comments on DIS Pilot
Seventeen respondents submitted public comments in response to the
DIS Pilot. USAID reviewed the public comments in the development of the
final rule. Below are the Agency's responses to comments on the DIS
Pilot. Some of the comments received will not be addressed as RIN 0412-
AA90 makes a response unnecessary. Those comments are summarized in the
section below. Additionally, some comments have already been addressed
in responses to comments received under the proposed rule which are
also summarized below. The Agency did not address comments unrelated
to, or outside the scope of, the 30-day Information Collection Notice:
k. General Support for the Collection
1. Comment: Commenter #17 indicated general support for the
collection. They noted that the rule will simplify reporting, reduce
redundant data calls, and reduce the burden on contractors.
Response: USAID acknowledges the support for the collection.
1. Comments That Are Superseded by the Rule
Comment: Two commenters (14, 17) requested information on the
burden estimate. Commenter #14 questioned the benefit of the system.
Commenter #10 questioned which countries had to implement the pilot.
Two commenters (3, 17) questioned the length of the pilot, if the pilot
results would be made public, how data migration will occur after the
pilot, what language should be included in contracts, and whether RIN
0412-AA90 would be published for comment. Several commenters (3, 12,
13, 14, 16, 17) asked about API and connections to other data systems,
standardizing requirements and guidance, concern regarding
reidentification and other security risks, what data would need to be
submitted, cost allowability, information about approvals and how data
will be used, reporting frequency, data aggregation, what indicator
information would be used as well as if they can be customized, and
other process questions about the pilot. Commenter #3 asked about an
OIG Audit and its impact on the pilot. Commenter #8 indicated that on
Item 20, Sec 2 (``login.gov username''), the instructions on the access
form do not clarify what the username is or if IPs already have one.
Commenter #8 also requested clarity on what IPs are expected to do in
DIS.
Response: The pilot, applicable to several missions, ended with
publication of RIN 0412-AA90. Questions around benefits, API
connections, adding contract language, standardization, security,
submission requirements, reporting, access forms and other items
related to the pilot are superseded by the text of the Rule. The rule
also clarifies what contractors must do when submitting digital
information to USAID.
m. Comments That Have Been Answered Through Comment Responses to the
Rule
Comment: Commenter #13 asked about whether staff will be able to
access more than one project or see across a variety of projects.
Commenter #2 requested that the system be aligned to build upon the
Common Data Model for Nonprofits. Commenter #13 asked about what the
Development Experience Clearinghouse is. Commenter #14 asked about
integration of various USAID platforms (the Development Data Library,
for example).
Response: USAID has provided robust responses to these questions in
response to comments received under the rulemaking. Specifically, see
sections B.2)(e)(1)(E); B.2)(d)(5); and B.2)(e)(1)(A)-(C) of the
Federal Register Notice for RIN 0412-AA90 which includes the text of
relevant comments and responses.
n. Access to Data
1. Comment: Commenter #4 questioned whether a prime contractor will
have to enter data for subcontractors or whether the subs will have
separate access to enter their data directly.
Response: The clause requires the contractor to submit all digital
information produced, furnished, acquired or collected in performance
of this contract by its subcontractors at any tier. While some USAID
systems may allow delegation of the submission role, it remains the
responsibility of the prime contractor to ensure the submission of the
digital information per the requirements of the rule.
2. Comment: Several commenters (8, 13, 15) asked about system
access. Specifically, whether the system will have a place to specify
roles in the ``implementing partner user information'' section; how IPs
can manage employees offboarding from the system when they leave the IP
or award; and whether the system will be open to allow all users to see
information or be limited by award.
Response: The system will have a place to specify user roles. The
COR will assign the contractor a user role within the system. Once
assigned a user role, the contractor will manage further access to the
award, including during offboarding. Submitters will only be able to
see data for awards with which they are associated in the system; data
access is not open to all users.
3. Comment: Commenter 16 asked whether the public will be able to
access the data in the DIS system.
Response: USAID will release data to the public from its internal
systems in keeping with its internal policies as informed by US
Government and international transparency commitments. USAID will not
provide direct public access to the DIS system.
o. System Design Information
1.Comment: Commenter #3) asked if USAID had a help center for DIS
and requested a FAQ page.
Response: Contractors can email [email protected] for help center
assistance. The DIS Frequently Asked Questions (FAQ) document for
contractors is found on the USAID public website (available at: https://www.usaid.gov/partner-with-us/resources-for-partners/development-information-solution/faqs).
2.Comment: Commenter #13 asked if the DIS will be the place where
they enter information about indicators or just view them once reports
are submitted.
Response: Per the Rule, USAID contractors will submit all digital
information to one centralized portal, the USAID Digital Front Door
(DFD). The DFD is intended as a submission mechanism, whereas viewing
will take place via established USAID systems and websites.
3. Comment: Commenter #13 asked who is responsible for setting up
the website for each respective project in DIS (if there are specific
indicators being reported for each of the projects).
Response: USAID operating units are responsible for establishing
activities in DIS within a contract. The person with the COR role in
DIS is responsible for establishing the indicators associated with the
activity.
4. Comment: Commenter #13 asked if the system will allow for
central level viewing of an IP portfolio.
Response: The system currently does not allow for linkages among
multiple activities to provide a central portfolio view for an
implementing partner.
[[Page 37958]]
p. USAID Approval and Oversight
Comment: Commenter #16 requested comment on when comprehensive
information about the structure and operation of the DIS system will be
available.
Response: USAID will continue to provide information on the
Agency's public DIS website (available at: https://www.usaid.gov/partner-with-us/resources-for-partners/development-information-solution) as it becomes available.
q. Outside the Scope
Comment: Many commenters (1, 5, 6, 7, 9, and 11) submitted comments
that were outside the scope of the DIS Pilot.
Response: USAID acknowledges receipt of these out-of-scope
comments.
USAID Digital Collection and Submission Standards
We are publishing the revised Collection & Submission Standards in
this final rule. As noted in the regulatory text, the standards can
also be found at data.usaid.gov/standards with hyperlinks:
USAID's Digital Collection and Submission Standards are a
compendium of standards for USAID staff and contractors to use in
support of USAID programs and operations. The standards in Section A
are required. Section B contains recommended standards that represent
industry best practices.
Section A: Required Digital Information Technical Standards
I. File Format Standards
A. Acceptable Non-Proprietary Formats
1. Text and Documents
(a) Portable Document Format (PDF/A is preferred, however .pdf is
acceptable)
(b) Plain text (.txt)
(c) LaTeX documents (.tex)
(d) Hypertext Markup Language (.html)
(e) Open Document Format (.odt)
(f) Extensible Markup Language (.xml)
(g) JavaScript Object Notation (.json)
2. Tables, Spreadsheets, and Databases
(a) Comma-Separated Values (.csv)
(b) Tab-separated tables (.txt--sometimes .tsv)
(c) Comma-separated tables (.csv or .txt)
(d) Other standard delimiter (e.g. colon, pipe)
(e) Fixed-width
(f) OpenDocument Spreadsheet (.ods)
3. Audio Files
(a) WAVE (.wav)
(b) FLAC (.flac)
(c) MPEG-3
(d) MP3
4. Image Files
(a) JPEG (.jpg or .jp2)
(b) Portable Network Graphics (.png)
(c) TIFF (.tiff or .tif)
(d) Portable Document Format (.pdf)
5. Video Files
(a) Video File (.mov)
(b) MPEG-4 (mp4)
(c) JPEG2 2000 (mj2)
6. Geospatial Files
(a) QGIS Project (.qgs)
(b) ESRI Shapefile (.shp, .shx, .dbf)
(c) Annotated TIFF Raster Files (.tif)
(d) Keyhole Mark Language (.kml)
(e) Geographic Data Format based on JSON (.geojson)
(f) Google Earth GIS Format (.kml, .kmz)
(g) Well Known Text for Spatial Objects (.wkt)
(h) Raster GIS File Format
(i) Unidata Scientific Data Format
II. Subject Area Standards
A. Narrative Text
1. Digital narrative text that is written in the English language,
including narrative about USAID programs and operations, must comply
with the Plain Writing Act of 2010 and associated guidelines and
resources found on the federal plain language website. Because USAID
may publish a narrative in keeping with the U.S. Government legislative
requirements (e.g. the Foreign Aid Transparency and Accountability Act
of 2016) and other transparency commitments (e.g. International Aid
Transparency Initiative; Open Government Partnership) or Freedom of
Information Act requests, the narrative must be clear, thorough, and
descriptive to facilitate public understanding.
B. Geospatial
1. The location(s) where an activity is implemented must be
collected at the Exact Site Location. Exact Site Location is defined as
a populated place, an actual exact site location, or an exact area or
line feature. The location(s) of the activity's intended beneficiaries
must be collected at least at the first level administrative boundary.
When the location of the activity's intended beneficiaries is
considered nationwide, it must be collected at the country/territory
level. USAID follows the Geopolitical Entities, Names, and Codes (GENC)
Standard and additional geospatial data standards as outlined in ADS
579saa ``Geographic Data Collection and Submission Standards'' and ADS
579mab ``Activity Location Data.''
C. Date
1. YYYY-MM-DD.
Section B: Recommended Digital Information Technical Standards
USAID recommends the following standards that have not been
formally adopted as a requirement by the Agency, but encouraged and
recommended for use to improve the management, quality and usefulness
of the data. USAID recommends the use of the following standards when
appropriate and practicable:
I. Code, Algorithm, and Analytical Files.
A. Javascript (.js)
B. Java
C. .NET
D. Python (.py)
E. Ruby (.rb)
F. R (.r)
G. SQL
II. GS1 Standards--USAID-funded programs beyond Global Health are
strongly recommended to adopt GS1 Standards for the supply chain to
facilitate product identification, location identification, and product
master data of Agency-funded commodities. Additional guidance for
implementation of GS1 Standards can be found here.
III. Statistical Data and Metadata eXchange (SDMX) for statistical
data.
IV. CGIAR Ontologies for crop and agronomy ontology.
V. FHIR for healthcare data exchange.
VI. ISO 8601 for Date, Time, and Time Zone.
VII. Open Geospatial Consortium (OGC) Standards for geospatial
data. The Open Geospatial Consortium (OGC) is an international
consortium of more than 500 businesses, government agencies, research
organizations, and universities driven to make geospatial (location)
information and services FAIR--Findable, Accessible, Interoperable, and
Reusable..
VIII. International Aid Transparency Initiative (IATI).
IX. FAIR Data Principles--To the extent possible, USAID-funded data
and metadata must align with data principles which are Findable,
Accessible, Interoperable, and Reusable.
Resources for creating metadata to meet these standards include,
but are not limited to, the following:
I. Content Standard for Digital Geospatial Metadata (CSDGM) Tools.
II. USGS TKME--A Windows platform tool for creating FGDC-CSDGM
which can be configured for Biological Data Profile and other
extensions. The software program is closely aligned with the Metadata
Parser, and can be configured for French and Spanish.
III. mdEditor--Create ISO and FGDC-CSDGM metadata with this web-
based tool.
[[Page 37959]]
IV. Data dictionary conversion service--Convert a data dictionary
table to/from metadata format (instructions).
V. USDA Metavist--A desktop metadata editor for creating FGDC-CSDGM
for geospatial metadata. Includes the Biological Data Profile (version
1.6). Produced and maintained by the USDA Forest Service. Download the
USGS Alaska Science Center (ASC) Metavist User Guide [PDF] to learn
more about the tool and ASC best practices for authors.
VI. Microsoft XML Notepad--A simple intuitive user interface for
browsing and editing XML files. Does not automatically produce FGDC-
CSDGM records but allows easy editing and validation of existing
metadata records. See Advanced Users to learn how to configure this
tool.
C. Regulatory Considerations and Determinations
(1) Executive Orders 12866 and 13563
This final rule was drafted in accordance with Executive Order
(E.O.) 12866, as amended by E.O. 14094, and E.O. 13563. OMB has
determined that this rule is a ``significant regulatory action,'' as
defined in section 3(f) of E.O. 12866, as amended, and is therefore
subject to review by OMB. This rule is not a major rule under 5 U.S.C.
804.
(2) Expected Cost Impact on the Public
USAID remains committed to reducing the burden on its contractors
while maximizing taxpayer value. By launching the USAID Digital Front
Door (DFD) as outlined in this clause, USAID intends to reduce the
total number of portals through which its contractors must submit
information to USAID, thereby reducing time and effort and improving
operational efficiency.
The following is a summary of the impact on contractors awarded
contracts that include the new AIDAR clause. The cost estimates were
developed by subject matter experts based on USAID's experience
collecting reports and information products through the Development
Experience Clearinghouse (DEC) (see AIDAR 752.7005) and piloting
digital data collection through the Development Data Library (DDL) and
the Development Information Solution (DIS).
This rule results in a total annualized (7% discount) public net
cost of $2.5 million. This annual burden takes into account the current
baseline that contractors already prepare, maintain, and submit AMELPs,
already remove PII from data prior to submission, already collect
standard indicator data, and already request embargoes and data
submission exemptions from Contracting officer's Representative on a
case-by-case basis. Further, since contractors already submit documents
and data to the DEC and DDL, these costs were removed from the overall
estimated cost. The following is a summary of the annual public costs
over a 20-year time horizon.
------------------------------------------------------------------------
Year Public Total
------------------------------------------------------------------------
1....................................... $1,867,000 $1,867,000
2....................................... 2,650,000 2,650,000
3....................................... 2,703,000 2,703,000
. . .................................... 2,756,000 2,756,000
20...................................... 2,756,000 2,756,000
------------------------------------------------------------------------
Total undiscounted costs............................ 65,988,000
Present Value (PV) of Costs Discounted at 7%........ 54,072,000
Annualized Costs Discounted at 7%................... 2,514,000
------------------------------------------------------------------------
This rule has extensive benefits for the public, contractors, the
research community, the private sector, and the USG, though many of
these benefits are challenging to quantify. Overarchingly, this rule
will increase efficiency for contractors, minimize data errors, and
improve the privacy and security of data. Further, this rule will help
contractors to produce data assets that are trustworthy, high-quality,
and usable by the general public and the research community for
accountability, research, communication, and learning. For the public,
there is an immense richness in the data collected by USAID and its
partners around the world, and this data holds the potential to improve
the lives of some of the world's most vulnerable people. When a
development project ends, the data can yield new insights for years or
decades into the future. It is the responsibility of the Agency and
those representing the government to ensure that data is accessible,
standardized, and secure. Finally, these estimates have been downwardly
adjusted since the publication of the proposed rule to reflect USAID's
responses to comments from the public.
In addition, under current protocols, USAID contractors are
required to submit digital information to USAID under multiple award
requirements using several different information management portals.
The maintenance of these separate portals has made it challenging for
USAID to integrate this information strategically to render a more
holistic and detailed view of its global portfolio. By implementing
these changes, USAID intends to reduce administrative burden on
contractors and USG staff.
(3) Regulatory Flexibility Act
USAID does not expect this rule to have a significant economic
impact on a substantial number of small entities within the meaning of
the Regulatory Flexibility Act, 5 U.S.C. 601, et seq. USAID has
therefore not performed an Initial Regulatory Flexibility Analysis
(IRFA).
(4) Paperwork Reduction Act
This rule contains information collection requirements that have
been submitted to the Office of Management and Budget under the
Paperwork Reduction Act (44 U.S.C. chapter 35). This information
collection requirement has been assigned OMB Control Number 0412-0620,
entitled ``AIDAR: Planning, Collection and Submission of Digital
Information and Activity Monitoring, Evaluation, and Learning Plans to
USAID''. Following receipt of comments, USAID has made several
revisions to this collection to downwardly adjust the burden.
Specifically, USAID revised the applicability of 752.227-71 from the
micro purchase threshold to the simplified acquisition threshold.
Similarly, USAID has added an Alternate clause exempting certain
contracts from the requirement to provide a data management plan.
Specifically, contracts are exempted that: contain no data; are for
emergency food assistance; are for disaster assistance, and transition-
assistance
[[Page 37960]]
activities managed by the Bureau for Humanitarian Assistance (BHA); or
are for activities managed by the Bureau for Conflict Prevention and
Stabilization's Office of Transition Initiatives (CPS/OTI). For
additional detail, please see the Regulatory Impact Assessment as well
as responses to comments in sections B. 2)(g)(C) and B. 2)(f)(3)(A)
above.
Additionally, USAID posted a 60-Day Notice of Information
Collection: Proposals, Submissions, and Approvals (the ``DIS Pilot'')
in the Federal Register at 85 FR 83027 on December 21, 2020. USAID
published a 30-Day Notice including a response to comments received on
May 25, 2021 and solicited additional comments (See 86 FR 28053).
Following receipt of additional comments, USAID, with approval from
OMB, is providing a response to comments received to the 30-day
Collection Notice with this Rulemaking. As the ``DIS Pilot'' collection
has been discontinued due to this rulemaking action, this separate
information collection approval request has been canceled.
List of Subjects in 48 CFR Parts 727, 742, and 752
Government procurement.
For the reasons discussed in the preamble, USAID amends 48 CFR
chapter 7 as set forth below:
0
1. The authority citation for 48 CFR parts 727, 742, and 752 continues
to read as follows:
Authority: Sec. 621, Pub. L. 87-195, 75 Stat. 445, (22 U.S.C.
2381) as amended; E.O. 12163, Sept. 29, 1979, 44 FR 56673; and 3 CFR
1979 Comp., p. 435.
SUBCHAPTER E--GENERAL CONTRACTING REQUIREMENTS
PART 727--PATENTS, DATA, AND COPYRIGHTS
0
2. Add subpart 727.70 to read as follows:
Subpart 727.70--Digital Information Planning, Collection, and
Submission Requirements
Sec.
727.7000 Scope of subpart
727.7001 Definitions
727.7002 Policy
727.7003 Contract clause.
Subpart 727.70--Digital Information Planning, Collection, and
Submission Requirements
727.7000 Scope of subpart.
(a) This part prescribes the policies, procedures, and a contract
clause pertaining to data and digital information management. It
implements the following requirements:
(1) Digital Accountability and Transparency (DATA) Act of 2014;
(2) Foundations for Evidence-Based Policymaking Act (``Evidence
Act'') of 2018;
(3) 21st Century Integrated Digital Experience Act (21st Century
IDEA Act);
(4) Foreign Aid Transparency and Accountability (FATAA) Act of
2016;
(5) Geospatial Data Act of 2018;
(6) OMB Circular A-130.
(b) [Reserved]
727.7001 Definitions.
As used in this subpart--
Data means recorded information, regardless of form or the media on
which it may be recorded. The term includes technical data and computer
software. The term does not include information incidental to contract
administration, such as financial, administrative, cost or pricing, or
management information.
Data asset is a collection of data elements or data sets that may
be grouped together.
Data inventory is the first component of a Data Management Plan
(DMP). The data inventory is a list of high-value data assets that the
contractor anticipates producing during the period of award
performance.
Data management plan (DMP) is a tool that guides the identification
of anticipated data assets and outlines tasks needed to manage these
assets across a full data lifecycle.
Data set is an organized collection of structured data, including
data contained in spreadsheets, whether presented in tabular or non-
tabular form. For example, a data set may represent a single
spreadsheet, an extensible mark-up language (XML) file, a geospatial
data file, or an organized collection of these. A data set does not
include unstructured data, such as email or instant messages, PDF
files, PowerPoint presentations, word processing documents, images,
audio files, or collaboration software.
Digital means the coding scheme generally used in computer
technology to represent data.
Digital data means quantitative and qualitative programmatic
measurements that are entered directly into a computer. Examples
include numeric targets established during activity design or
implementation; baseline, mid-line, or final measurements created or
obtained via field assessments; surveys or interviews; performance
monitoring indicators as specified in the Contractor's approved
Activity Monitoring, Evaluation, and Learning (AMELP) (see 752.242-71);
evaluation results; or perception metrics collected from beneficiaries
on the quality and relevance of International Disaster Assistance and
Development Assistance.
Digital information is a subset of data and means:
(1) Digital text;
(2) Digital data;
(3) Digital objects; and
(4) Metadata created or obtained with USAID funding supported by
this award that are represented, stored, or transmitted in such a way
that they are available to a computer program.
Digital method is a means of using computer technology to gather,
process, analyze, transmit, store, or otherwise use data and other
forms of information.
Digital object includes digital or computer files that are
available to a computer program. Examples include digital word
processing or PDF documents or forms related to activity design,
assessment reports, periodic progress and performance reports, academic
research documents, publication manuscripts, evaluations, technical
documentation and reports, and other reports, articles and papers
prepared by the contractor, whether published or not. Other examples
include data sets, spreadsheets, presentations, publication-quality
images, audio and video files, communication materials, information
products, extensible mark-up language (XML) files, and software,
scripts, source code, and algorithms that can be processed by a
computer program.
Digital text includes text-based descriptions of programmatic
efforts that are entered directly into a computer, rather than
submitted as a digital object.
727.7002 Policy.
(a) It is the policy of USAID to manage data as a strategic asset
to inform the planning, design, implementation, monitoring, and
evaluation of the Agency's foreign assistance programs. To achieve
this, it is also USAID's policy to manage data and digital information
across a full life cycle. This life cycle includes the following
stages: Govern, Plan, Acquire, Process, Analyze, Curate, and Publish/
Share. For more information about the USAID Development Data policy,
see ADS Chapter 579 at https://www.usaid.gov/about-us/agency-policy/series-500/579. For more information about USAID's Program Cycle
policy, see ADS Chapter 201 at https://www.usaid.gov/about-us/agency-policy/series-200/201.
(b) In furtherance of this policy, USAID requires that contractors:
[[Page 37961]]
(1) Engage in digital information planning, including creating a
Data Management Plan (DMP) to identify and plan for the management of
data assets that will be produced, furnished, acquired, or collected in
a USAID-funded activity.
(2) Use only digital methods and USAID-approved standards, to the
extent practicable, to produce, furnish, acquire, or collect
information necessary to implement the contract requirements.
(3) Provide documentation of informed consent the contractor
receives when obtaining information on individuals.
(4) Submit to USAID digital information produced, furnished,
acquired, or collected in performance of a USAID contract at the finest
level of granularity employed during contract implementation.
(c) As specified in ADS Chapter 579, USAID implements appropriate
controls to restrict data access in a way that balances the potential
benefits with any underlying risks to its beneficiaries and
contractors.
727.7003 Contract clause.
(a) Insert the clause 752.227-71 to USAID in Section H of
solicitations and contracts fully or partially funded with program
funds exceeding the simplified acquisition threshold. The contracting
officer may insert this clause in other USAID contracts if the
contracting officer, in consultation with the requiring office,
determines that doing so is in the best interest of the Agency.
(b) Insert the clause at 752.227-71, with its Alternate I when the
anticipated contract:
(1) Does not collect data;
(2) Implements emergency food assistance under the Food for Peace
Act or section 491 of the Foreign Assistance Act of 1961, including for
the procurement, transportation, storage, handling and/or distribution
of such assistance;
(3) Implements international disaster assistance under section 491
of the Foreign Assistance Act of 1961 or other authorities administered
by the Bureau for Humanitarian Assistance; or
(4) Implements activities managed by the Bureau for Conflict
Prevention and Stabilization's Office of Transition Initiatives, or is
fully or partially funded with the Complex Crises Fund.
SUBCHAPTER G--CONTRACT MANAGEMENT
PART 742--CONTRACT ADMINISTRATION
Subpart 742.11--Production, Surveillance, and Reporting
0
3. Amend 742.1170-3, by redesignating paragraphs (b)(2) through (7) as
paragraphs (b)(3) through (8) and adding a new paragraph (b)(2).
The addition reads as follows:
742.1170-3 Policy.
* * * * *
(b) * * *
(2) The contract requirements for an activity monitoring,
evaluation, and learning plan, as applicable;
* * * * *
0
4. Add 742.1170-5 to read as follows:
742.1170-5 Activity Monitoring, Evaluation, and Learning Plan
requirement and contract clause.
(a) When the requiring office needs information on how the
contractor expects to monitor implementation performance and context,
conduct or collaborate on an evaluation, and generate evidence to
inform learning and adaptive management, the contracting officer may
require the contractor to submit an Activity Monitoring, Evaluation,
and Learning Plan (AMELP) tailored to specific contract requirements.
For more information on monitoring, evaluation, and learning during the
design and implementation of activities, see ADS Chapter 201 at https://www.usaid.gov/about-us/agency-policy/series-200/201.
(b) Unless instructed otherwise in writing by the requiring office,
the contracting officer must insert the clause at 752.242-71 in section
F of solicitations and contracts exceeding the simplified acquisition
threshold, except as specified in paragraph (c) of this section. The
contracting officer may insert this clause in other USAID contracts if
the contracting officer, in consultation with the requiring office,
determines that an Activity Monitoring, Evaluation, and Learning Plan
is necessary, as provided in paragraph (a) of this section.
(c) The clause is not required to be included in contracts for:
(1) Supplies and services that USAID acquires for its own direct
use or benefit;
(2) Emergency food assistance under the Food for Peace Act or
section 491 of the Foreign Assistance Act of 1961, including for the
procurement, transportation, storage, handling and/or distribution of
such assistance;
(3) International disaster assistance under section 491 of the
Foreign Assistance Act of 1961 or other authorities administered by the
Bureau for Humanitarian Assistance; or
(4) Activities managed by the Bureau for Conflict Prevention and
Stabilization's Office of Transition Initiatives, or fully or partially
funded with the Complex Crises Fund.
SUBCHAPTER H--CLAUSES AND FORMS
PART 752--SOLICITATION PROVISIONS AND CONTRACT CLAUSES
0
5. Add 752.227-71 to read as follows:
752.227-71. Planning, Collection, and Submission of Digital
Information to USAID.
As prescribed in AIDAR 727.7003, insert the following clause in
Section H of solicitations and contracts:
Planning, Collection, and Submission of Digital Information to USAID
(JUN 2024)
(a) Definitions. As used in this clause--
Computer is a fixed or mobile device that accepts digital data
and manipulates the information based on a program or sequence of
instructions for how data is to be processed.
Data means recorded information, regardless of form or the media
on which it may be recorded. The term includes technical data and
computer software. The term does not include information incidental
to contract administration, such as financial, administrative, cost
or pricing, or management information.
Data asset is a collection of data elements or data sets that
may be grouped together.
Data inventory is the first component of a Data Management Plan
(DMP). The data inventory is a list of high-value data assets that
the contractor anticipates producing during the period of award
performance.
Data management plan (DMP) is a tool that guides the
identification of anticipated data assets and outlines tasks needed
to manage these assets across a full data lifecycle.
Data set is an organized collection of structured data,
including data contained in spreadsheets, whether presented in
tabular or non-tabular form. For example, a data set may represent a
single spreadsheet, an extensible mark-up language (XML) file, a
geospatial data file, or an organized collection of these. A data
set does not include unstructured data, such as email or instant
messages, PDF files, PowerPoint presentations, word processing
documents, images, audio files, or collaboration software.
Digital means the coding scheme generally used in computer
technology to represent data.
Digital data means quantitative and qualitative programmatic
measurements that are entered directly into a computer. Examples
include numeric targets established during activity design or
implementation; baseline, mid-line, or final measurements created or
obtained via field assessments; surveys or interviews;
[[Page 37962]]
performance monitoring indicators as specified in the Contractor's
approved AMELP; evaluation results; or perception metrics collected
from beneficiaries on the quality and relevance of International
Disaster Assistance and Development Assistance.
Digital information is a subset of data and means:
(i) Digital text;
(ii) Digital data;
(iii) Digital objects; and
(iv) Metadata created or obtained with USAID funding regarding
international development or humanitarian assistance activities
supported by this award that are represented, stored, or transmitted
in such a way that they are available to a computer program.
Digital method is a means of using computer technology to
gather, process, analyze, transmit, store, or otherwise use data and
other forms of information.
Digital object includes digital or computer files that are
available to a computer program. Examples include digital word
processing or PDF documents or forms related to activity design,
assessment reports, periodic progress and performance reports,
academic research documents, publication manuscripts, evaluations,
technical documentation and reports, and other reports, articles and
papers prepared by the Contractor under this contract, whether
published or not. Other examples include data sets, spreadsheets,
presentations, publication-quality images, audio and video files,
communication materials, information products, extensible mark-up
language (XML) files, and software, scripts, source code, and
algorithms that can be processed by a computer program.
Digital repository refers to information systems that ingest,
store, manage, preserve, and provide access to digital content.
Digital text includes text-based descriptions of programmatic
efforts that are entered directly into a computer, rather than
submitted as a digital object.
Draft digital information refers to digital information that, in
the professional opinion of the Contractor, does not adhere to the
information quality standards such that it presents preliminary,
unverified, incomplete, or deliberative findings, claims, analysis,
or results that may lead the consumer of such material to draw
erroneous conclusions.
Granularity refers to the extent to which digital content or
objects provide access to detailed, distinct data points. Coarse
granularity generally means that distinct data points reflect
larger, representational units or have been joined together or
aggregated, thus providing less detail. A fine level of granularity
generally means that distinct data points reflect smaller,
individualized units that have not been aggregated, thus providing a
higher level of detail. For example, a data set containing a list of
every activity conducted by week would generally exhibit a finer
level of granularity than a data set listing the various categories
of activities conducted by month. The degree of granularity can be
relative to the contents of a specific data set and can be
geographic, temporal, or across other dimensions.
Information quality standards means the elements of utility,
objectivity, and integrity collectively.
Integrity is an element of the information quality standards
that means information has been protected from unauthorized access
or revision, to ensure that the information is not compromised
through corruption or falsification.
Machine readable means data in a format that can be easily
processed by a computer without human intervention while ensuring
that no semantic meaning is lost.
Metadata includes structural or descriptive information about
digital data or digital objects such as content, format, source,
rights, accuracy, provenance, frequency, periodicity, granularity,
publisher or responsible party, contact information, method of
collection, and other descriptions.
Objectivity is an element of the information quality standards
that means whether information is accurate, reliable, and unbiased
as a matter of presentation and substance.
Personally identifiable information (PII) means information that
can be used to distinguish or trace an individual's identity, either
alone or when combined with other information that is linked or
linkable to a specific individual. [See Office of Management and
Budget (OMB) Circular No. A-130, Managing Federal Information as a
Strategic Resource.] PII can include both direct identifiers (such
as name, health identification numbers, etc.), and indirect
identifiers (geographic location, age) that when linked with other
information can result in the identification of an individual.
Publication object is a digital object that has been accepted
for publication prior to the end date of this contract and whose
content is based on or includes any other digital information
created or obtained in performance of this contract. In the research
community, a publication object is often synonymous with a quality
research manuscript that has been accepted by an academic journal
for publication. However, publication objects can also consist of
other digital objects (e.g., photos, videos, etc.) published via
news media, the internet, or other venues.
Quality digital information means digital information that, in
the professional opinion of the Contractor, adheres to the
information quality standards and presents reasonably sound and
substantiated findings, claims, analysis, or results regarding
activities.
Registered with the USAID Digital Front Door (DFD) means: that--
(i) The Contractor entered all mandatory information required to
obtain access to the DFD.
(ii) The Contractor agrees to abide by the DFD terms and
conditions of use.
(iii) The Government has validated the Contractor's registration
by providing access to the DFD.
USAID Digital Front Door (DFD), located at dfd.usaid.gov is a
website where the Contractor transacts business with USAID, such as
submitting digital information.
Utility is an element of the information quality standards that
means whether information is useful to its intended users, including
the general public, and for its intended purpose.
(b) Digital information planning requirements. The Contractor
must engage in digital information planning to ensure compliance
with the collection and submission of all digital information, as
required under this award.
(c) Data Management Plan (DMP)--(1) What is required. The
Contractor must prepare and maintain a Data Management Plan (DMP)
that reflects the digital information planning requirements outlined
in paragraph (b) of this clause.
(2) What to submit. The DMP must be appropriate to the
programmatic scope and context of the contract, and to the nature
and complexity of the data to be collected or acquired in the course
of the contract. The DMP must address, at a minimum, the following:
(i) Data inventory; and
(ii) If requested in writing by the Contracting Officer,
(A) Protocols for data collection, management and storage;
(B) Protocols for maintaining adequate safeguards that include
the privacy and security of digital information collected under the
award;
(C) Documentation that ensures other users can understand and
use the data;
(D) Protocols for preserving digital information and
facilitating access by other stakeholders; and
(E) Terms of use on data usage, publication, curation, or other
dissemination plans.
(3) When to submit. The Contractor must develop and submit, at a
minimum, the data inventory component of the DMP to the contracting
officer for approval within ninety (90) days after contract award,
unless the contracting officer establishes a different time period.
The Contractor must submit the remaining components of the DMP to
the contracting officer for approval, as soon as they become
available. The contractor must not begin digital information
collection prior to approval of the data inventory and submission of
any remaining components of the DMP unless authorized in writing by
the contracting officer.
(4) When to revise. The Contractor must revise the DMP as
necessary throughout the period of performance of this contract. Any
revisions to the plan must be approved by the contracting officer or
contracting officer's representative as delegated.
(d) Digital information production and collection requirements.
(1) The Contractor must:
(i) Use only digital methods to the extent practicable to
produce, furnish, acquire, or collect information in performance of
this contract. If the Contractor is unable to consistently collect
data using digital methods, the Contractor must obtain the
contracting officer or delegated contracting officer's
representative's approval for any alternative collection method.
(ii) Collect digital information at the finest level of
granularity that enables the Contractor to comply with the terms of
this contract.
(2) To the extent practicable, the Contractor must limit the
collection of PII to only that
[[Page 37963]]
which is necessary to comply with the requirements of the contract.
(e) Registration requirements. The Contractor must:
(1) Be registered with the USAID Digital Front Door (DFD) within
ninety (90) days after award of this contract; and
(2) Maintain access to the DFD during the period of performance
of this contract.
(f) Submission requirements--(1) What to submit. Unless an
exemption in paragraph (f)(4) of this section applies, the
Contractor must:
(i) Submit digital information created or obtained in
performance of this contract to USAID at the finest level of
granularity at which it was collected.
(ii) Submit digital information in nonproprietary formats and
digital data and data sets in machine readable formats. The
Contractor may also submit proprietary formats in addition to a
nonproprietary format.
(iii) Submit a copy of any usage license agreement that the
Contractor obtained from any third party who granted usage rights
for the digital information.
(iv) Submit a copy of any photo or media release template that
the Contractor used to obtain permission from any third party for
the use of the photo or media.
(v) When the contract includes AIDAR clause 752.7012, Protection
of the Individual as a Research Subject, provide a blank copy of the
form, document, instructions, or other instruments used to obtain
informed consent from persons whose individual information is
contained in the original version of the digital object.
(vi) If applicable, provide additional details or metadata
regarding:
(A) Where and how to access digital information that the
Contractor submits to a USAID-approved digital repository or via
alternate technology as approved by USAID's Chief Information
Officer;
(B) The quality of submissions of draft digital information;
(C) Known sensitivities within digital information that may
jeopardize the personal safety of any individual or group, whether
the Contractor has submitted the information or has received a
submission exemption;
(D) Digital information for which the Contractor was unable to
obtain third party usage rights, a media release, or informed
consent or which has other proprietary restrictions.
(2) Where to submit. The Contractor must submit digital
information through the DFD, unless specifically authorized by the
contracting officer in writing to submit to a USAID-approved digital
repository instead or via alternate technology as approved by
USAID's Chief Information Officer.
(3) When to submit. (i) With the exception of data sets, the
Contractor must submit all other Digital Objects within 30 days of
obtaining the contracting officer or delegated contracting officer
representative's approval. Unless otherwise specified in the
schedule of the contract or otherwise instructed by the contracting
officer or delegated contracting officer's representative, the
Contractor must submit data sets and all other digital information
created or obtained in performance of this contract to USAID once it
meets the requirements of quality digital information. Unless
otherwise approved by the contracting officer in writing, within
thirty (30) days after the contract completion date, the Contractor
must submit all digital information not previously submitted,
including both draft digital information and quality digital
information required under this contract.
(ii) Upon written approval of the contracting officer or
delegated contracting officer's representative, the Contractor must
submit draft digital information to USAID when the ``best
available'' information is required in order to meet time
constraints or other programmatic or operational exigencies.
(4) Exemptions. (i) The Contractor must not submit digital
information through the DFD that contains:
(A) Classified information.
(B) Personally identifiable information. The Contractor must, to
the maximum extent possible, remove the association between the set
of identifying data and the individual to which it applies unless
retaining such information is essential to comply with the terms of
this contract and upon written approval from the contracting officer
or delegated contracting officer's representative to submit this
information.
(ii) If the Contractor believes there is a compelling reason not
to submit specific digital information that does not fall under an
exemption in this section, including circumstances where submission
may jeopardize the personal safety of any individual or group, the
Contractor must obtain written approval not to submit the digital
information from the contracting officer.
(5) Approval requirements. Upon receipt of digital information
submitted by the Contractor, the contracting officer or delegated
contracting officer's representative will either approve or reject
the submission. When a submission is rejected, the Contractor must
make corrections and resubmit the required information. USAID does
not consider the submission accepted until the contracting officer
or delegated contracting officer's representative provides written
approval to the Contractor.
(g) Publication considerations. (1) If the Contractor produces a
publication object, the Contractor must submit via the DFD a copy of
the publication object, the publication acceptance notification,
along with a link at which the final published object may be
accessed.
(2) For any digital object the Contractor submits in compliance
with the terms of this contract, the Contractor may request from the
contracting officer or delegated contracting officer's
representative an embargo on the public release of the digital
object. The contracting officer or delegated contracting officer's
representative may approve an embargo request that is for no more
than 12 months at a time, with additional scrutiny for digital
objects relied upon for journal publication. A determination on this
request will be provided to the Contractor in writing.
(3) If the Contractor used a digital object previously submitted
via the DFD to generate the publication object, and that digital
object is governed by a pre-existing embargo, that embargo will
expire on the day the publication object is scheduled for
publication. USAID may elect to publish digital information on which
the publication object is based as early as the date the publication
object is scheduled for publication.
(h) USAID digital collection and submission standards. The
Contractor must comply with the version of USAID's Digital
Collection and Submission Standards in effect on the date of award
as outlined at data.usaid.gov/standards. If the Contractor is unable
to adhere to USAID's Digital Collection and Submission Standards,
the Contractor must obtain USAID's written approval for an
alternative approach.
(i) Access to the digital information. USAID will conduct a
rigorous risk assessment of digital information that the Contractor
submits to USAID to determine the appropriate permissions and
restrictions on access to the digital information. USAID may release
the data publicly in full, redact or otherwise protect aspects of
the information prior to public release, or hold the information in
a non-public status.
(j) Obligations regarding subcontractors. (1) The Contractor
must furnish, acquire, or collect information and submit to USAID,
in accordance with paragraph (f) of this clause, all digital
information produced, furnished, acquired, or collected in
performance of this contract by its subcontractors at any tier.
(2) The Contractor must insert the terms of this clause, except
paragraph (e) of this clause, in all subcontracts.
(End of clause)
Alternate I (JUN 2024). As prescribed in AIDAR 727.7003, substitute
the following paragraph (c) for paragraph (c) of the basic clause:
(c) [Reserved]
0
6. Add 752.242-71 to read as follows:
752.242-71 Activity Monitoring, Evaluation, and Learning Plan
As prescribed in AIDAR 742.1170-5, insert the following clause in
section F of solicitations and contracts.
Activity Monitoring, Evaluation, and Learning Plan (JUN 2024)
(a) Definitions. As used in this clause--
Activity Monitoring, Evaluation, and Learning Plan (AMELP) means
a plan for monitoring, evaluating, and collaborating, learning, and
adapting during implementation of a USAID contract. Some USAID
documentation may refer to ``MEL Plan'' or ``Activity MEL Plan''.
These terms are synonymous.
Contract will be interpreted as ``task order'' or ``delivery
order'' when this clause is used in an indefinite-delivery contract.
Evaluation means the systematic collection and analysis of data
and information about the characteristics and outcomes of the
programming carried out through a contract, conducted as a basis for
judgments, to understand and improve effectiveness and efficiency,
and timed to inform decisions about current and future programming.
[[Page 37964]]
Feedback from beneficiaries means perceptions or reactions
voluntarily communicated by a beneficiary of USAID assistance about
the USAID assistance received.
Indicator means a quantifiable measure of a characteristic or
condition of people, institutions, systems, or processes that might
change over time.
Learning activity means efforts for the purpose of generating,
synthesizing, sharing, and applying evidence and knowledge.
Monitoring context means the systematic collection of
information about conditions and external factors relevant to
implementation and performance of the contract.
Output means the tangible, immediate, and intended products or
consequences of contract implementation within the Contractor's
control or influence.
Outcome means the conditions of people, systems, or institutions
that indicate progress or lack of progress toward the achievement of
the goals and objectives of the contract.
Performance indicator means an indicator that measures expected
outputs and/or outcomes of the contract implementation.
Target means a specific, planned level of results to achieve
within a specific timeframe with a given level of resources.
(b) Requirements. (1) Unless otherwise specified in the schedule
of the contract, the Contractor must develop and submit a proposed
AMELP to the contracting officer or delegated contracting officer's
representative within ninety (90) days of contract award. The
contracting officer or delegated contracting officer's
representative will review and provide comments within thirty (30)
days after receiving the proposed AMELP. The Contractor must submit
a final AMELP for contracting officer or delegated contracting
officer's representative approval no later than 15 days after
receiving comments.
(2) The Contractor must revise the AMELP as necessary during the
period of performance of this contract. Any revisions to the plan
must be approved by the contracting officer or delegated contracting
officer's representative.
(c) Content. (1) The Contractor's proposed AMELP must include,
at a minimum, the following:
(i) The Contractor's plan for monitoring, including any existing
systems or processes for monitoring progress, any Standard Foreign
Assistance Indicators as agreed upon by the contracting officer or
delegated contracting officer's representative, any other USAID
required indicators, and other relevant performance indicators of
the contract's outputs and outcomes, their baseline (or plan for
collecting baseline), and targets; and
(ii) The Contractor's plan for regular and systematic collection
of feedback from beneficiaries, responding to feedback received, and
reporting to USAID a summary of feedback and actions taken in
response to the feedback received, or a rationale for why collecting
feedback from beneficiaries is not applicable for this contract.
(2) The Contractor's proposed AMELP must be appropriate to the
size and complexity of the contract and address the following, as
applicable:
(i) Plans for monitoring context and emerging risks that could
affect the achievement of the contract's results;
(ii) Plans for any evaluations to be conducted by the
contractor, sub-contractor or third-party, including collaboration
with an external evaluator;
(iii) Learning activities, including plans for capturing
knowledge at the close-out of the contract;
(iv) Estimated resources for the AMELP tasks that are a part of
the contract's budget; and
(v) Roles and responsibilities for all proposed AMELP tasks.
[End of clause]
752.7005 [Removed and Reserved]
0
7. Remove and Reserve 752.7005.
Jami J. Rodgers,
Chief Acquisition Officer.
[FR Doc. 2024-09373 Filed 5-3-24; 8:45 am]
BILLING CODE 6116-01-P