Assisted Reproductive Technology (ART) Success Rates Reporting and Data Validation Procedures, 66566-66567 [2020-23188]
Download as PDF
66566
Federal Register / Vol. 85, No. 203 / Tuesday, October 20, 2020 / Notices
DEPARTMENT OF HEALTH AND
HUMAN SERVICES
Centers for Disease Control and
Prevention
[Docket No. CDC–2020–0112]
Assisted Reproductive Technology
(ART) Success Rates Reporting and
Data Validation Procedures
Centers for Disease Control and
Prevention (CDC), Department of Health
and Human Services (HHS).
ACTION: Request for comment.
AGENCY:
The Centers for Disease
Control and Prevention, within the
Department of Health and Human
Services, announces the opening of a
public docket to obtain public comment
on proposed changes in assisted
reproductive technology (ART) data
validation selection process; data
validation approach; and data
discrepancy reporting.
DATES: Written comments must be
received on or before December 21,
2020.
SUMMARY:
You may submit comments
identified by Docket No. CDC–2020–
0112 by any of the following methods:
• Federal eRulemaking Portal:
https://www.regulations.gov. Follow the
instructions for submitting comments.
• Mail: Division of Reproductive
Health, National Center for Chronic
Disease Prevention and Health
Promotion, Centers for Disease Control
and Prevention, 4770 Buford Highway
NE, Mailstop S107–2, Atlanta, Georgia
30341–3724. Attention: Assisted
Reproduction Technology Surveillance
and Research Team.
FOR FURTHER INFORMATION CONTACT:
Jeani Chang, Division of Reproductive
Health, National Center for Chronic
Disease Prevention and Health
Promotion, Centers for Disease Control
and Prevention, 4770 Buford Highway
NE, Mailstop S107–2, Atlanta, Georgia
30341–3724. Telephone: (770) 488–
5200. Email: ARTinfo@cdc.gov.
SUPPLEMENTARY INFORMATION:
ADDRESSES:
Public Participation
Interested persons or organizations
are invited to participate by submitting
written views, recommendations, and
data in response to the proposed
changes described in this notice. CDC
invites comments specifically on:
• Proposed changes in data validation
selection process;
• Data validation approach; and
• Process for identifying
discrepancies in reporting of pregnancy
success rates from ART programs.
VerDate Sep<11>2014
18:08 Oct 19, 2020
Jkt 253001
Please note that comments received,
including attachments and other
supporting materials, are part of the
public record and are subject to public
disclosure. Comments will be posted on
https://www.regulations.gov. Therefore,
do not include any information in your
comment or supporting materials that
you consider confidential or
inappropriate for public disclosure. If
you include your name, contact
information, or other information that
identifies you in the body of your
comments, that information will be on
public display. CDC will review all
submissions and may choose to redact
or withhold submissions containing
private or proprietary information such
as Social Security numbers, medical
information, inappropriate language, or
duplicate/near duplicate examples of a
mass-mail campaign. CDC will carefully
consider all comments submitted.
Background
On May 31, 2018, CDC requested
public comment on a plan to (1) revise
the definition and characterization of
Assisted Reproductive Technology
(ART) success rates and (2) introduce
clinic validation footnotes for the
annual ART Fertility Clinic Success
Rates Report (83 FR 25009). CDC
received three public comments, of
which one was non-substantive, one
was supportive of CDC’s planned
approach for revising the definition of
success rates and introducing clinic
validation footnotes without further
suggestions, and one contained
concerns about CDC’s planned clinic
validation footnotes for identified major
data discrepancies and approach to
clinic validation along with
recommended changes.
This comment expressed concern that
random selection of clinics during the
current CDC validation system is unable
to identify systematic reporting errors. It
was suggested that targeted selection of
clinics based on certain reporting
characteristics that predict erroneously
inflated ART success rates is a better
approach to identify systematic
reporting errors. There was also a
concern that discrepancies identified
during on-site data validation are not
corrected prior to publication of the
ART Fertility Clinic Success Rates
Report. It was suggested that instead of
including a footnote, identification of
erroneous data should result in
removing clinic success rates from ART
Fertility Clinic Success Rates Report,
and that erroneous data should not be
included with data from other clinics.
Finally, there was a concern that
validation footnotes and an appendix
PO 00000
Frm 00034
Fmt 4703
Sfmt 4703
will not be easily understood by the
patients.
Pursuant to the Fertility Clinic
Success Rate and Certification Act of
1992, 42 U.S.C. 263a–5, CDC publishes
pregnancy success rates reported to the
agency in accordance with section
263a–1(a)(1). The primary goal of public
reporting of clinical outcomes of ART is
to provide accurate data to current or
potential ART users. Therefore, multiple
mechanisms ensuring data accuracy are
employed by CDC: Conducting data
checks for logical errors and
inconsistencies during data entry stage,
verification of data accuracy by clinics’
medical directors, additional data
checks for logical errors and internal
inconsistencies after submission. If any
errors or inconsistencies are identified
during these stages, clinics are
contacted and data are immediately
corrected. In addition, CDC conducts
annual site visits by selecting 7–10% of
all reporting clinics and about 70–80
cycles per clinic for data validation.
This data validation process involves
comparing information of key variables
from patient’s medical record with the
data submitted to the National ART
Surveillance System (NASS), the CDC
data reporting system for ART
procedures, to calculate discrepancy
rates for these variables. Data validation
is another step to ensure that clinics
submit accurate data and to identify any
systematic problems that could cause
data collection to be inconsistent or
incomplete.
CDC is currently conducting data
validation using stratified random
sampling of reporting clinics to assess
discrepancy rates for key variables that
are generalizable for all reporting clinics
as described in ‘‘Reporting of Pregnancy
Success Rates from Assisted
Reproductive Technology (ART)
Programs’’ (80 FR 51811). CDC concurs
with comments on proposed changes to
data validation procedures (83 FR
25009) that targeted selection of clinics
based on certain reporting
characteristics is another mechanism to
identify systematic reporting errors.
CDC’s current targeted selection practice
includes revisiting a small number of
previously validated clinics to assess
whether previously identified reporting
errors have been corrected. Effective for
calendar year 2022, CDC proposes to
expand targeted selection of clinics to
better capture systematic reporting
errors by assessing certain reporting
characteristics that may predict
erroneously inflated ART success rates
(e.g. number of cancelled cycles,
inability to confirm reported live births,
etc.). Information gained from targeted
validation will not be used in
E:\FR\FM\20OCN1.SGM
20OCN1
Federal Register / Vol. 85, No. 203 / Tuesday, October 20, 2020 / Notices
calculating discrepancy rates since it
cannot be generalizable for all reporting
clinics.
Since information on potential data
errors is not available from nonvalidated clinics and CDC’s annual data
validation only represents a very small
proportion of clinics (7–10%) and
cycles (1% of total reported cycles),
correcting identified discrepancies in
the final dataset for a small subset of
cycles will not have any significant
effect on data quality or published
success rates. However, CDC took into
account comments that publishing
inaccurate data with known major
discrepancies can be misleading, even
in the presence of a footnote describing
data quality concerns. Therefore, if a
clinic is selected to participate in the
NASS data validation process (either
through stratified random sampling or
through targeted selection), does
participate, and major data
discrepancies are identified (e.g., lack of
supporting information for a significant
proportion of reported pregnancy
outcomes, inability to confirm a
significant proportion of reported live
births, underreporting a significant
proportion of cycles, etc.), a message
will be displayed in the ART Fertility
Clinic Success Rates Report for the
clinic as:
CDC conducts data validation of a sample
of reporting clinics to assess discrepancy
rates for key variables helping, in part, to
ensure clinics submit accurate data and to
identify any systematic problems. This clinic
was visited for validation of (insert: reporting
year) data and major data discrepancies were
identified. This clinic’s reported success rates
data are therefore not published in this
report and not included in aggregate national
data reports.
CDC may re-select this ART program
for data validation during the following
reporting year(s) to assess corrections of
identified data errors.
In addition, CDC will publish
information in the annual ART Fertility
Clinic Success Rates Report to identify
clinics that are selected by CDC to
participate in the NASS data validation
but decline to participate. (See 80 FR
51811 for further information
concerning external validation of clinic
data). If a clinic is selected to participate
in the NASS data validation process and
declines to participate, the following
message will be displayed in the ART
Fertility Clinic Success Rates Report for
the clinic as:
CDC conducts data validation of a sample
of reporting clinics to assess discrepancy
rates for key variables helping, in part, to
ensure clinics submit accurate data and to
identify any systematic problems. This clinic
was selected for validation of (insert:
VerDate Sep<11>2014
18:08 Oct 19, 2020
Jkt 253001
reporting year) data, but declined to
participate. This clinic’s reported data are
therefore not published in this report and not
included in aggregate national data reports.
CDC may re-select this ART program
for data validation during the following
reporting year(s). Participation in data
validation is integral to helping ensure
the accuracy of the required pregnancy
success rates reported to have been
achieved by clinics. Therefore,
displaying this message, as well as the
other messages outlined herein, is
important in providing the public with
the most accurate information.
For consistency, for all other clinics
that are selected to participate in the
NASS data validation and do
participate, the following footnote will
be added:
CDC conducts data validation of a sample
of reporting clinics to assess discrepancy
rates for key variables helping, in part, to
ensure clinics submit accurate data and to
identify any systematic problems. This clinic
was visited for validation of (insert: reporting
year) data and no systematic problems were
identified.
Any messages added to a clinic’s
success rates page in the ART Fertility
Clinic Success Rates Report will appear
only for the reporting year that the
clinic was selected for validation. These
enhanced processes and messages in the
annual ART Fertility Clinic Success
Rates Report will help to inform the
public if there are issues with data
quality, thereby increasing the
transparency and help ensure the
accuracy of the NASS data reporting.
For 2017 reporting year, CDC started
reporting cumulative success rates
which take into account successes over
all embryo transfers within 12-month
period from a single oocyte retrieval
and, therefore, span two reporting years
(83 FR 53253). Effective for data
validation conducted in calendar year
2021, data validation approach will be
aligned with ART reporting approach
and will also span two reporting years.
Data validation conducted in 2021 will
cover oocyte retrievals conducted in
reporting year 2018 and associated
embryo transfers that took place within
12-month period from oocyte retrievals
(reporting years 2018 and 2019). As a
result of this transition to a cumulative
approach in data validation and due to
impacts of the COVID–19 pandemic
(i.e., travel restrictions), no data
validations will be conducted in
calendar year 2020.
PO 00000
Frm 00035
Fmt 4703
Sfmt 4703
66567
Dated: October 15, 2020.
Sandra Cashman,
Executive Secretary, Centers for Disease
Control and Prevention.
[FR Doc. 2020–23188 Filed 10–19–20; 8:45 am]
BILLING CODE 4163–18–P
DEPARTMENT OF HEALTH AND
HUMAN SERVICES
Administration for Children and
Families
Submission for OMB Review;
Identifying and Addressing Human
Trafficking in Child Welfare Agencies
(New Collection)
Office of Planning, Research,
and Evaluation, Administration for
Children and Families, HHS.
ACTION: Request for public comment.
AGENCY:
The Administration for
Children and Families (ACF) within the
U.S. Department of Health and Human
Services (HHS) is proposing to collect
data on child welfare agencies’ efforts to
identify human trafficking and
subsequent service delivery. The goal of
the study is to better understand child
welfare practice in screening for human
trafficking, and the degree to which
screening is related to subsequent
referrals for, access to, and delivery of
specialized services for children
identified as trafficking victims or at
high risk of trafficking.
DATES: Comments due within 30 days of
publication. OMB must make a decision
about the collection of information
between 30 and 60 days after
publication of this document in the
Federal Register. Therefore, a comment
is best assured of having its full effect
if OMB receives it within 30 days of
publication.
ADDRESSES: Written comments and
recommendations for the proposed
information collection should be sent
within 30 days of publication of this
notice to www.reginfo.gov/public/do/
PRAMain. Find this particular
information collection by selecting
‘‘Currently under 30-day Review—Open
for Public Comments’’ or by using the
search function.
SUPPLEMENTARY INFORMATION:
Description: ACF is proposing data
collection as part of the study,
‘‘Identifying and Addressing Human
Trafficking in Child Welfare Agencies,’’
exploring child welfare practice in
screening for human trafficking, and the
relationship between screening and
specialized services.
Primary data collection includes
semi-structured qualitative interviews
SUMMARY:
E:\FR\FM\20OCN1.SGM
20OCN1
Agencies
[Federal Register Volume 85, Number 203 (Tuesday, October 20, 2020)]
[Notices]
[Pages 66566-66567]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2020-23188]
[[Page 66566]]
=======================================================================
-----------------------------------------------------------------------
DEPARTMENT OF HEALTH AND HUMAN SERVICES
Centers for Disease Control and Prevention
[Docket No. CDC-2020-0112]
Assisted Reproductive Technology (ART) Success Rates Reporting
and Data Validation Procedures
AGENCY: Centers for Disease Control and Prevention (CDC), Department of
Health and Human Services (HHS).
ACTION: Request for comment.
-----------------------------------------------------------------------
SUMMARY: The Centers for Disease Control and Prevention, within the
Department of Health and Human Services, announces the opening of a
public docket to obtain public comment on proposed changes in assisted
reproductive technology (ART) data validation selection process; data
validation approach; and data discrepancy reporting.
DATES: Written comments must be received on or before December 21,
2020.
ADDRESSES: You may submit comments identified by Docket No. CDC-2020-
0112 by any of the following methods:
Federal eRulemaking Portal: https://www.regulations.gov.
Follow the instructions for submitting comments.
Mail: Division of Reproductive Health, National Center for
Chronic Disease Prevention and Health Promotion, Centers for Disease
Control and Prevention, 4770 Buford Highway NE, Mailstop S107-2,
Atlanta, Georgia 30341-3724. Attention: Assisted Reproduction
Technology Surveillance and Research Team.
FOR FURTHER INFORMATION CONTACT: Jeani Chang, Division of Reproductive
Health, National Center for Chronic Disease Prevention and Health
Promotion, Centers for Disease Control and Prevention, 4770 Buford
Highway NE, Mailstop S107-2, Atlanta, Georgia 30341-3724. Telephone:
(770) 488-5200. Email: [email protected].
SUPPLEMENTARY INFORMATION:
Public Participation
Interested persons or organizations are invited to participate by
submitting written views, recommendations, and data in response to the
proposed changes described in this notice. CDC invites comments
specifically on:
Proposed changes in data validation selection process;
Data validation approach; and
Process for identifying discrepancies in reporting of
pregnancy success rates from ART programs.
Please note that comments received, including attachments and other
supporting materials, are part of the public record and are subject to
public disclosure. Comments will be posted on https://www.regulations.gov. Therefore, do not include any information in your
comment or supporting materials that you consider confidential or
inappropriate for public disclosure. If you include your name, contact
information, or other information that identifies you in the body of
your comments, that information will be on public display. CDC will
review all submissions and may choose to redact or withhold submissions
containing private or proprietary information such as Social Security
numbers, medical information, inappropriate language, or duplicate/near
duplicate examples of a mass-mail campaign. CDC will carefully consider
all comments submitted.
Background
On May 31, 2018, CDC requested public comment on a plan to (1)
revise the definition and characterization of Assisted Reproductive
Technology (ART) success rates and (2) introduce clinic validation
footnotes for the annual ART Fertility Clinic Success Rates Report (83
FR 25009). CDC received three public comments, of which one was non-
substantive, one was supportive of CDC's planned approach for revising
the definition of success rates and introducing clinic validation
footnotes without further suggestions, and one contained concerns about
CDC's planned clinic validation footnotes for identified major data
discrepancies and approach to clinic validation along with recommended
changes.
This comment expressed concern that random selection of clinics
during the current CDC validation system is unable to identify
systematic reporting errors. It was suggested that targeted selection
of clinics based on certain reporting characteristics that predict
erroneously inflated ART success rates is a better approach to identify
systematic reporting errors. There was also a concern that
discrepancies identified during on-site data validation are not
corrected prior to publication of the ART Fertility Clinic Success
Rates Report. It was suggested that instead of including a footnote,
identification of erroneous data should result in removing clinic
success rates from ART Fertility Clinic Success Rates Report, and that
erroneous data should not be included with data from other clinics.
Finally, there was a concern that validation footnotes and an appendix
will not be easily understood by the patients.
Pursuant to the Fertility Clinic Success Rate and Certification Act
of 1992, 42 U.S.C. 263a-5, CDC publishes pregnancy success rates
reported to the agency in accordance with section 263a-1(a)(1). The
primary goal of public reporting of clinical outcomes of ART is to
provide accurate data to current or potential ART users. Therefore,
multiple mechanisms ensuring data accuracy are employed by CDC:
Conducting data checks for logical errors and inconsistencies during
data entry stage, verification of data accuracy by clinics' medical
directors, additional data checks for logical errors and internal
inconsistencies after submission. If any errors or inconsistencies are
identified during these stages, clinics are contacted and data are
immediately corrected. In addition, CDC conducts annual site visits by
selecting 7-10% of all reporting clinics and about 70-80 cycles per
clinic for data validation. This data validation process involves
comparing information of key variables from patient's medical record
with the data submitted to the National ART Surveillance System (NASS),
the CDC data reporting system for ART procedures, to calculate
discrepancy rates for these variables. Data validation is another step
to ensure that clinics submit accurate data and to identify any
systematic problems that could cause data collection to be inconsistent
or incomplete.
CDC is currently conducting data validation using stratified random
sampling of reporting clinics to assess discrepancy rates for key
variables that are generalizable for all reporting clinics as described
in ``Reporting of Pregnancy Success Rates from Assisted Reproductive
Technology (ART) Programs'' (80 FR 51811). CDC concurs with comments on
proposed changes to data validation procedures (83 FR 25009) that
targeted selection of clinics based on certain reporting
characteristics is another mechanism to identify systematic reporting
errors. CDC's current targeted selection practice includes revisiting a
small number of previously validated clinics to assess whether
previously identified reporting errors have been corrected. Effective
for calendar year 2022, CDC proposes to expand targeted selection of
clinics to better capture systematic reporting errors by assessing
certain reporting characteristics that may predict erroneously inflated
ART success rates (e.g. number of cancelled cycles, inability to
confirm reported live births, etc.). Information gained from targeted
validation will not be used in
[[Page 66567]]
calculating discrepancy rates since it cannot be generalizable for all
reporting clinics.
Since information on potential data errors is not available from
non-validated clinics and CDC's annual data validation only represents
a very small proportion of clinics (7-10%) and cycles (1% of total
reported cycles), correcting identified discrepancies in the final
dataset for a small subset of cycles will not have any significant
effect on data quality or published success rates. However, CDC took
into account comments that publishing inaccurate data with known major
discrepancies can be misleading, even in the presence of a footnote
describing data quality concerns. Therefore, if a clinic is selected to
participate in the NASS data validation process (either through
stratified random sampling or through targeted selection), does
participate, and major data discrepancies are identified (e.g., lack of
supporting information for a significant proportion of reported
pregnancy outcomes, inability to confirm a significant proportion of
reported live births, underreporting a significant proportion of
cycles, etc.), a message will be displayed in the ART Fertility Clinic
Success Rates Report for the clinic as:
CDC conducts data validation of a sample of reporting clinics to
assess discrepancy rates for key variables helping, in part, to
ensure clinics submit accurate data and to identify any systematic
problems. This clinic was visited for validation of (insert:
reporting year) data and major data discrepancies were identified.
This clinic's reported success rates data are therefore not
published in this report and not included in aggregate national data
reports.
CDC may re-select this ART program for data validation during the
following reporting year(s) to assess corrections of identified data
errors.
In addition, CDC will publish information in the annual ART
Fertility Clinic Success Rates Report to identify clinics that are
selected by CDC to participate in the NASS data validation but decline
to participate. (See 80 FR 51811 for further information concerning
external validation of clinic data). If a clinic is selected to
participate in the NASS data validation process and declines to
participate, the following message will be displayed in the ART
Fertility Clinic Success Rates Report for the clinic as:
CDC conducts data validation of a sample of reporting clinics to
assess discrepancy rates for key variables helping, in part, to
ensure clinics submit accurate data and to identify any systematic
problems. This clinic was selected for validation of (insert:
reporting year) data, but declined to participate. This clinic's
reported data are therefore not published in this report and not
included in aggregate national data reports.
CDC may re-select this ART program for data validation during the
following reporting year(s). Participation in data validation is
integral to helping ensure the accuracy of the required pregnancy
success rates reported to have been achieved by clinics. Therefore,
displaying this message, as well as the other messages outlined herein,
is important in providing the public with the most accurate
information.
For consistency, for all other clinics that are selected to
participate in the NASS data validation and do participate, the
following footnote will be added:
CDC conducts data validation of a sample of reporting clinics to
assess discrepancy rates for key variables helping, in part, to
ensure clinics submit accurate data and to identify any systematic
problems. This clinic was visited for validation of (insert:
reporting year) data and no systematic problems were identified.
Any messages added to a clinic's success rates page in the ART
Fertility Clinic Success Rates Report will appear only for the
reporting year that the clinic was selected for validation. These
enhanced processes and messages in the annual ART Fertility Clinic
Success Rates Report will help to inform the public if there are issues
with data quality, thereby increasing the transparency and help ensure
the accuracy of the NASS data reporting.
For 2017 reporting year, CDC started reporting cumulative success
rates which take into account successes over all embryo transfers
within 12-month period from a single oocyte retrieval and, therefore,
span two reporting years (83 FR 53253). Effective for data validation
conducted in calendar year 2021, data validation approach will be
aligned with ART reporting approach and will also span two reporting
years. Data validation conducted in 2021 will cover oocyte retrievals
conducted in reporting year 2018 and associated embryo transfers that
took place within 12-month period from oocyte retrievals (reporting
years 2018 and 2019). As a result of this transition to a cumulative
approach in data validation and due to impacts of the COVID-19 pandemic
(i.e., travel restrictions), no data validations will be conducted in
calendar year 2020.
Dated: October 15, 2020.
Sandra Cashman,
Executive Secretary, Centers for Disease Control and Prevention.
[FR Doc. 2020-23188 Filed 10-19-20; 8:45 am]
BILLING CODE 4163-18-P