Identifying Priority Access or Quality Improvements for Federal Data and Models for Artificial Intelligence Research and Development (R&D), and Testing; Request for Information, 32962-32963 [2019-14618]

Download as PDF 32962 Federal Register / Vol. 84, No. 132 / Wednesday, July 10, 2019 / Notices OFFICE OF MANAGEMENT AND BUDGET Identifying Priority Access or Quality Improvements for Federal Data and Models for Artificial Intelligence Research and Development (R&D), and Testing; Request for Information Office of Management and Budget (OMB), Executive Office of the President. ACTION: Notice of request for information: Identifying Priority Access or Quality Improvements for Federal data and models for Artificial Intelligence Research and Development (R&D), and Testing. AGENCY: Under the Executive Order on Maintaining American Leadership in Artificial Intelligence (Section 5.a.i), https://www.whitehouse.gov/ presidential-actions/executive-ordermaintaining-american-leadershipartificial-intelligence/, the Office of Management and Budget is inviting the public to identify needs for additional access to, or improvements in the quality of, Federal data and models that would improve the Nation’s artificial intelligence (AI) research and development (R&D) and testing efforts. DATES: July 10, 2019. ADDRESSES: Submissions are due 30 days from publication of this notice through www.regulations.gov. SUPPLEMENTARY INFORMATION: The National Artificial Intelligence Research and Development Strategic Plan discusses fundamental challenges, novel ideas for human and AI collaboration, and creating AI that is more trustworthy (e.g., AI techniques that address challenges of bias and fairness, transparency and explainability, and robustness, security, and safety). Beyond fundamental advances in AI, open challenges also include the application of AI to key domains, such as those highlighted on ai.gov that include: • Transportation • Healthcare • Manufacturing • Financial Services • Agriculture • Weather Forecasting • National Security & Defense Depending on the R&D goal and application domain, different data sets and models may be needed to accelerate AI advances. Additionally, the use of these data sets and models could stimulate new developments that would enhance the transparency and explainability of the AI application, and illuminate ways to ensure the jspears on DSK30JT082PROD with NOTICES SUMMARY: VerDate Sep<11>2014 18:32 Jul 09, 2019 Jkt 247001 robustness, security and safety of AI applications. Over the years, a number of data sets have already been made available via data.gov. Some of these datasets are fully publically available, while others have restricted use (see restricted use data sets). However, these data sets may or may not be useful or suitable for AI R&D and testing. The following lists of topics cover the major areas for which information is sought. These lists are not intended to limit the topics that may be addressed by respondents, who may provide information about any topic that would inform the objective of this action. To developing requests for additional accesses for data and models to improve AI R&D and testing, input to the following questions is sought: • What Federal data and models are you seeking to use that are available to the public with no use restrictions, but which have technical issues inhibiting data access? Specifically, what are the technical issues (e.g., is it too big to be downloaded, is it not optimally formatted)? What types of AI R&D and testing would be accelerated with increased access to this data? • What Federal data and models are you seeking to use that are restricted to the public, i.e., the data asset is available under certain use restrictions? What types of AI R&D and testing would be accelerated with increased access to this data? • What Federal data and models are you seeking to use that are private and not at all available to the public? Describe the agency that has the data and what, if any, attempts you are aware of that have been made to increase access to the data or model. What types of AI R&D and testing would be accelerated with increased access to this data? • What are key gaps in data and model availability that are slowing progress in AI R&D and testing? Which areas of AI R&D and testing are most impacted? In developing requests for quality improvements to accessible data and models to improve AI R&D and testing, input to the following questions is sought: • As agencies review their data and models, what are the most important characteristics they should consider? Stated differently, what characteristics of data sets or models make them wellsuited for AI R&D? • Which models are most important for agencies to focus on, and why? • What characteristics should the Federal Government consider to increase a data set or model’s utility for PO 00000 Frm 00104 Fmt 4703 Sfmt 4703 AI R&D (e.g., documentation, provenance, metadata)? • What data ownership, intellectual property, or data sharing considerations should be included in federally-funded agreements (including, but not limited to, federal contracts and grants) that results in production of data for R&D? • What research questions and applications are you trying to solve with AI, that require specific types and/or quantities of Federal data and models, and how might the Federal Government reduce barriers to discovery and access? • Accelerating the application of AI can be enabled with pre-trained models (e.g., ResNet trained on ImageNet) that facilitate transfer learning. What research questions and applications would benefit most from the transfer learning? Respondents to this RFI may define ‘‘data’’, ‘‘data set’’, and ‘‘model’’ as they desire, indicating clearly what they mean when using the term. Instructions for Written Responses Interested parties should provide written responses to the questions outlined in the purpose of this Federal Register notice section. Submissions are due 30 days from publication of this notice through www.regulations.gov. Please include the below in your response, limiting this portion of your response to one page: • The name of the individual(s) and/ or organization responding. Anonymous responses will also be accepted. • A brief description of the responding individual(s) or organization’s mission and/or areas of expertise, if the responder feels appropriate. • A contact for questions or other follow-up on your response if desired. Comments submitted in response to this notice are subject to FOIA. OMB may also make all comments available to the public. For this reason, please do not include in your comments information of a confidential nature, such as sensitive personal information or proprietary information. If you send an email comment, your email address will be automatically captured and included as part of the comment that is placed in the public docket and made available on the internet. Please note that responses to this public comment request containing any routine notice about the confidentiality of the communication will be treated as public comments that may be made available to the public notwithstanding the inclusion of the routine notice. E:\FR\FM\10JYN1.SGM 10JYN1 Federal Register / Vol. 84, No. 132 / Wednesday, July 10, 2019 / Notices Next Steps For background information on the areas of AI activity in the Federal government, please visit: AI.gov. Russell T. Vought, Acting Director, OMB. [FR Doc. 2019–14618 Filed 7–9–19; 8:45 am] BILLING CODE 3110–05–P NATIONAL AERONAUTICS AND SPACE ADMINISTRATION [Notice: 19–140] Notification Requirements Regarding Findings of Discrimination, Sexual Harassment, Other Forms of Harassment, or Sexual Assault National Aeronautics and Space Administration. ACTION: New reporting requirement for discrimination, sexual or other forms of harassment, or sexual assault; request for comments. AGENCY: The National Aeronautics and Space Administration (NASA) is soliciting public comment on the agency’s proposed implementation of new reporting requirements regarding discrimination and harassment among recipients of NASA financial assistance. The many hundreds of U.S. institutions of higher education and other organizations that receive NASA funds are responsible for fully investigating complaints and for compliance with federal non-discrimination laws, regulations, and executive orders. The implementation of new reporting requirements is necessary as NASA seeks to help ensure research environments to which the Agency provides funding are free from discrimination, including harassment, sexual harassment, other forms of harassment, and sexual assault. Additionally, NASA is taking this action to bolster our policies, guidelines, and communications. The intended effect of this action is, first, to better ensure that organizations funded by NASA clearly understand expectations and requirements. In addition, NASA seeks to ensure that recipients of grants and cooperative agreements respond promptly and appropriately to instances of discrimination, sexual harassment, other forms of harassment, and sexual assault. DATES: Comments must be received by August 9, 2019. ADDRESSES: Comments should be addressed to National Space and Aeronautics Administration Headquarters, 300 E Street SW, Rm. jspears on DSK30JT082PROD with NOTICES SUMMARY: VerDate Sep<11>2014 18:32 Jul 09, 2019 Jkt 247001 6O87, Washington, DC 20546 or sent by email to civilrightsinfo@nasa.gov; Phone Number: 202–358–2180, Fax Number: 202–358–3336. We encourage respondents to submit comments electronically to ensure timely receipt. We cannot guarantee that comments mailed will be received before the comment closing date. Please include ‘‘Reporting Requirement Regarding Findings of Discrimination, Sexual Harassment, other Forms of Harassment, or Sexual Assault’’ in the subject line of the email message; please also include the full body of your comments in the text of the message and as an attachment. Include your name, title, organization, postal address, telephone number, and email address in your message. FOR FURTHER INFORMATION CONTACT: Richard N. Reback, email: civilrightsinfo@nasa.gov; telephone (202) 358–2180. As a U.S. funding agency of scientific research and development, and the primary funding agency for aeronautics and space research and technology, NASA is committed to promoting safe, productive research and education environments for current and future scientists and engineers. We consider the Principal Investigator (PI) and any Co-I(s) identified on a NASA award and all personnel supported by a NASA award must not engage in discriminatory or harassing behavior during the award period of performance whether at the awardee institution, online, or outside the organization, such as at field sites or facilities, or during conferences and workshops. Upon implementation, the new term and condition will require awardee organizations to notify NASA of any findings/determinations of discrimination, sexual harassment, other forms of harassment, or sexual assault regarding an NASA funded PI or Co-I. The new term and condition also will require the awardee to notify NASA if the PI or Co-I is placed on administrative leave or if the awardee has imposed any administrative action on the PI or any determination or an investigation of an alleged violation of awardee policies or codes of conduct, statutes, regulations, or executive orders relating to discrimination, sexual harassment, other forms of harassment, or sexual assault. Finally, the award term and condition specifies the procedures that will be followed by NASA upon receipt of a notification. The full text of the new term and condition is provided below: SUPPLEMENTARY INFORMATION: PO 00000 Frm 00105 Fmt 4703 Sfmt 4703 32963 Notification Requirements Regarding Sexual Harassment, Other Forms of Harassment, or Sexual Assault The Principal Investigator (PI) and any Co-I(s) identified on an NASA award are in a position of trust. These individuals must comport themselves in a responsible and accountable manner during the award period of performance, whether at the awardee institution, online, or at locales such as field sites, facilities, or conferences/workshops. Above all, NASA wishes to assure the safety, integrity, and excellence of the programs and activities it funds. For purposes of this term and condition, the following definitions apply: Administrative Leave/Administrative Action: Any temporary/interim suspension or permanent removal of the PI or Co-I, or any administrative action imposed on the PI or Co-I by the awardee under organizational policies or codes of conduct, statutes, regulations, or executive orders, relating to activities, including but not limited to the following: Teaching, advising, mentoring, research, management/ administrative duties, or presence on campus. Discrimination: Treating an individual differently or using methods of administration that have the effect of subjecting individuals to different treatment based on race, color, national origin, sex, disability or age. Finding/Determination: The final disposition of a matter involving sexual harassment or other form of harassment under organizational policies and processes, to include the exhaustion of permissible appeals exercised by the PI or Co-I, or a conviction of a sexual offense in a criminal court of law. Other Forms of Harassment: Nongender or non-sex-based harassment of individuals protected under federal civil rights laws, as set forth in organizational policies or codes of conduct, statutes, regulations, or executive orders. Sexual harassment: May include but is not limited to gender or sex-based harassment, unwelcome sexual attention, sexual coercion, or creating a hostile environment, as set forth in organizational policies or codes of conduct, statutes, regulations, or executive orders. The awardee is required to notify NASA of: (1) Any finding/determination regarding the PI or any Co-I 1 that 1 If a Co-I is affiliated with a subawardee organization, the Authorized Organizational Representative of the subawardee must provide the requisite information directly to NASA, as instructed in this paragraph. E:\FR\FM\10JYN1.SGM 10JYN1

Agencies

[Federal Register Volume 84, Number 132 (Wednesday, July 10, 2019)]
[Notices]
[Pages 32962-32963]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2019-14618]



[[Page 32962]]

=======================================================================
-----------------------------------------------------------------------

OFFICE OF MANAGEMENT AND BUDGET


Identifying Priority Access or Quality Improvements for Federal 
Data and Models for Artificial Intelligence Research and Development 
(R&D), and Testing; Request for Information

AGENCY: Office of Management and Budget (OMB), Executive Office of the 
President.

ACTION: Notice of request for information: Identifying Priority Access 
or Quality Improvements for Federal data and models for Artificial 
Intelligence Research and Development (R&D), and Testing.

-----------------------------------------------------------------------

SUMMARY: Under the Executive Order on Maintaining American Leadership 
in Artificial Intelligence (Section 5.a.i), https://www.whitehouse.gov/presidential-actions/executive-order-maintaining-american-leadership-artificial-intelligence/, the Office of Management and Budget is 
inviting the public to identify needs for additional access to, or 
improvements in the quality of, Federal data and models that would 
improve the Nation's artificial intelligence (AI) research and 
development (R&D) and testing efforts.

DATES: July 10, 2019.

ADDRESSES: Submissions are due 30 days from publication of this notice 
through www.regulations.gov.

SUPPLEMENTARY INFORMATION: The National Artificial Intelligence 
Research and Development Strategic Plan discusses fundamental 
challenges, novel ideas for human and AI collaboration, and creating AI 
that is more trustworthy (e.g., AI techniques that address challenges 
of bias and fairness, transparency and explainability, and robustness, 
security, and safety).
    Beyond fundamental advances in AI, open challenges also include the 
application of AI to key domains, such as those highlighted on ai.gov 
that include:

 Transportation
 Healthcare
 Manufacturing
 Financial Services
 Agriculture
 Weather Forecasting
 National Security & Defense

    Depending on the R&D goal and application domain, different data 
sets and models may be needed to accelerate AI advances. Additionally, 
the use of these data sets and models could stimulate new developments 
that would enhance the transparency and explainability of the AI 
application, and illuminate ways to ensure the robustness, security and 
safety of AI applications.
    Over the years, a number of data sets have already been made 
available via data.gov. Some of these datasets are fully publically 
available, while others have restricted use (see restricted use data 
sets). However, these data sets may or may not be useful or suitable 
for AI R&D and testing.
    The following lists of topics cover the major areas for which 
information is sought. These lists are not intended to limit the topics 
that may be addressed by respondents, who may provide information about 
any topic that would inform the objective of this action.
    To developing requests for additional accesses for data and models 
to improve AI R&D and testing, input to the following questions is 
sought:
     What Federal data and models are you seeking to use that 
are available to the public with no use restrictions, but which have 
technical issues inhibiting data access? Specifically, what are the 
technical issues (e.g., is it too big to be downloaded, is it not 
optimally formatted)? What types of AI R&D and testing would be 
accelerated with increased access to this data?
     What Federal data and models are you seeking to use that 
are restricted to the public, i.e., the data asset is available under 
certain use restrictions? What types of AI R&D and testing would be 
accelerated with increased access to this data?
     What Federal data and models are you seeking to use that 
are private and not at all available to the public? Describe the agency 
that has the data and what, if any, attempts you are aware of that have 
been made to increase access to the data or model. What types of AI R&D 
and testing would be accelerated with increased access to this data?
     What are key gaps in data and model availability that are 
slowing progress in AI R&D and testing? Which areas of AI R&D and 
testing are most impacted?
    In developing requests for quality improvements to accessible data 
and models to improve AI R&D and testing, input to the following 
questions is sought:
     As agencies review their data and models, what are the 
most important characteristics they should consider? Stated 
differently, what characteristics of data sets or models make them 
well-suited for AI R&D?
     Which models are most important for agencies to focus on, 
and why?
     What characteristics should the Federal Government 
consider to increase a data set or model's utility for AI R&D (e.g., 
documentation, provenance, metadata)?
     What data ownership, intellectual property, or data 
sharing considerations should be included in federally-funded 
agreements (including, but not limited to, federal contracts and 
grants) that results in production of data for R&D?
     What research questions and applications are you trying to 
solve with AI, that require specific types and/or quantities of Federal 
data and models, and how might the Federal Government reduce barriers 
to discovery and access?
     Accelerating the application of AI can be enabled with 
pre-trained models (e.g., ResNet trained on ImageNet) that facilitate 
transfer learning. What research questions and applications would 
benefit most from the transfer learning?
    Respondents to this RFI may define ``data'', ``data set'', and 
``model'' as they desire, indicating clearly what they mean when using 
the term.

Instructions for Written Responses

    Interested parties should provide written responses to the 
questions outlined in the purpose of this Federal Register notice 
section. Submissions are due 30 days from publication of this notice 
through www.regulations.gov.
    Please include the below in your response, limiting this portion of 
your response to one page:
     The name of the individual(s) and/or organization 
responding. Anonymous responses will also be accepted.
     A brief description of the responding individual(s) or 
organization's mission and/or areas of expertise, if the responder 
feels appropriate.
     A contact for questions or other follow-up on your 
response if desired.
    Comments submitted in response to this notice are subject to FOIA. 
OMB may also make all comments available to the public. For this 
reason, please do not include in your comments information of a 
confidential nature, such as sensitive personal information or 
proprietary information. If you send an email comment, your email 
address will be automatically captured and included as part of the 
comment that is placed in the public docket and made available on the 
internet. Please note that responses to this public comment request 
containing any routine notice about the confidentiality of the 
communication will be treated as public comments that may be made 
available to the public notwithstanding the inclusion of the routine 
notice.

[[Page 32963]]

Next Steps

    For background information on the areas of AI activity in the 
Federal government, please visit: AI.gov.

Russell T. Vought,
Acting Director, OMB.
[FR Doc. 2019-14618 Filed 7-9-19; 8:45 am]
 BILLING CODE 3110-05-P