Proposed Data Collections Submitted for Public Comment and Recommendations, 8875-8876 [2018-04152]

Download as PDF Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices Law 92–463. The grant applications and the discussions could disclose confidential trade secrets or commercial property such as patentable material, and personal information concerning individuals associated with the grant applications, the disclosure of which would constitute a clearly unwarranted invasion of personal privacy. Name of Committee: Disease, Disability, and Injury Prevention and Control Special Emphasis Panel (SEP) IP18–002, Economic Studies of Immunization Policies and Practices. Date: April 3, 2018. Time: 10:00 a.m.–3:00 p.m., EDT. Place: Teleconference. Agenda: To review and evaluate grant applications. FOR FURTHER INFORMATION CONTACT: Gregory Anderson, MS, MPH, Scientific Review Officer, CDC, 1600 Clifton Road NE, Mailstop E60, Atlanta, Georgia 30333, (404) 718–8833, gca5@cdc.gov. The Director, Management Analysis and Services Office, has been delegated the authority to sign Federal Register notices pertaining to announcements of meetings and other committee management activities, for both the Centers for Disease Control and Prevention and the Agency for Toxic Substances and Disease Registry. Elaine L. Baker, Director, Management Analysis and Services Office, Centers for Disease Control and Prevention. [FR Doc. 2018–04134 Filed 2–28–18; 8:45 am] BILLING CODE 4163–18–P DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for Disease Control and Prevention [60Day–18–0222; Docket No. CDC–2018– 0014] Proposed Data Collections Submitted for Public Comment and Recommendations Centers for Disease Control and Prevention (CDC), Department of Health and Human Services (HHS). ACTION: Notice with comment period. AGENCY: The Centers for Disease Control and Prevention (CDC), as part of its continuing effort to reduce public burden and maximize the utility of government information, invites the general public and other Federal agencies the opportunity to comment on a proposed and/or continuing information collection, as required by the Paperwork Reduction Act of 1995. amozie on DSK30RV082PROD with NOTICES SUMMARY: VerDate Sep<11>2014 17:26 Feb 28, 2018 Jkt 244001 This notice invites comment on a proposed information collection project titled the Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER), formerly the Questionnaire Design Research Laboratory (QDRL), generic clearance request, which encompasses general questionnaire development, pre-testing, and measurement-error reduction activities to be carried out in 2018– 2020. CDC must receive written comments on or before April 30, 2018. ADDRESSES: You may submit comments, identified by Docket No. CDC–2018– 0014 by any of the following methods: • Federal eRulemaking Portal: Regulations.gov. Follow the instructions for submitting comments. • Mail: Leroy A. Richardson, Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, MS– D74, Atlanta, Georgia 30329. Instructions: All submissions received must include the agency name and Docket Number. CDC will post, without change, all relevant comments to Regulations.gov. Please note: Submit all comments through the Federal eRulemaking portal (regulations.gov) or by U.S. mail to the address listed above. FOR FURTHER INFORMATION CONTACT: To request more information on the proposed project or to obtain a copy of the information collection plan and instruments, contact Leroy A. Richardson, Information Collection Review Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, MS–D74, Atlanta, Georgia 30329; phone: 404–639–7570; Email: omb@cdc.gov. SUPPLEMENTARY INFORMATION: Under the Paperwork Reduction Act of 1995 (PRA) (44 U.S.C. 3501–3520), Federal agencies must obtain approval from the Office of Management and Budget (OMB) for each collection of information they conduct or sponsor. In addition, the PRA also requires Federal agencies to provide a 60-day notice in the Federal Register concerning each proposed collection of information, including each new proposed collection, each proposed extension of existing collection of information, and each reinstatement of previously approved information collection before submitting the collection to the OMB for approval. To comply with this requirement, we are publishing this notice of a proposed data collection as described below. The OMB is particularly interested in comments that will help: DATES: PO 00000 Frm 00046 Fmt 4703 Sfmt 4703 8875 1. Evaluate whether the proposed collection of information is necessary for the proper performance of the functions of the agency, including whether the information will have practical utility; 2. Evaluate the accuracy of the agency’s estimate of the burden of the proposed collection of information, including the validity of the methodology and assumptions used; 3. Enhance the quality, utility, and clarity of the information to be collected; and 4. Minimize the burden of the collection of information on those who are to respond, including through the use of appropriate automated, electronic, mechanical, or other technological collection techniques or other forms of information technology, e.g., permitting electronic submissions of responses. 5. Assess information collection costs. Proposed Project The Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER) (OMB Control Number 0920–0222, Expiration 07/31/ 2018)—Revision—National Center for Health Statistics (NCHS), Centers for Disease Control and Prevention (CDC). Background and Brief Description Section 306 of the Public Health Service (PHS) Act (42 U.S.C. 242k), as amended, authorizes that the Secretary of Health and Human Services (DHHS), acting through NCHS, shall undertake and support (by grant or contract) research, demonstrations, and evaluations respecting new or improved methods for obtaining current data to support statistical and epidemiological activities for the purpose of improving the effectiveness, efficiency, and quality of health services in the United States. The Collaborating Center for Questionnaire Design and Evaluation Research (CCQDER) is the focal point within NCHS for questionnaire and survey development, pre-testing, and evaluation activities for CDC surveys (such as the NCHS National Health Interview Survey, OMB No. 0920–0214) and other federally sponsored surveys. NCHS is requesting 3 years of OMB Clearance for this generic submission. The CCQDER and other NCHS programs conduct cognitive interviews, focus groups, in-depth or ethnographic interviews, usability tests, field tests/ pilot interviews, and experimental research in laboratory and field settings, both for applied questionnaire development and evaluation as well as more basic research on measurement errors and survey response. E:\FR\FM\01MRN1.SGM 01MRN1 8876 Federal Register / Vol. 83, No. 41 / Thursday, March 1, 2018 / Notices Various techniques to evaluate interviewer administered, selfadministered, telephone, Computer Assisted Personal Interviewing (CAPI), Computer Assisted Self-Interviewing (CASI), Audio Computer-Assisted SelfInterviewing (ACASI), and web-based questionnaires are used. The most common questionnaire evaluation method is the cognitive interview. These evaluations are conducted by the CCQDER. The interview structure consists of respondents first answering a draft survey question and then providing textual information to reveal the processes involved in answering the test question. Specifically, cognitive interview respondents are asked to describe how and why they answered the question as they did. Through the interviewing process, various types of question-response problems that would not normally be identified in a traditional survey interview, such as interpretive errors and recall accuracy, are uncovered. By conducting a comparative analysis of cognitive interviews, it is also possible to determine whether particular interpretive patterns occur within particular sub-groups of the population. Interviews are generally conducted in small rounds totaling 40–100 interviews; ideally, the questionnaire is re-worked between rounds, and revisions are tested iteratively until interviews yield relatively few new insights. Cognitive interviewing is inexpensive and provides useful data on questionnaire performance while Usability tests are typically one-on-one interviews that are used to determine how a given survey or information collection tool functions in the field, and how the mode and layout of the instrument itself may contribute to survey response error and the survey response process. In addition to these qualitative methods, NCHS also uses various tools to obtain quantitative data, which can be analyzed alone or analyzed alongside qualitative data to give a much fuller accounting of the survey response process. For instance, phone, internet, mail, and in-person follow-up interviews of previous NCHS survey respondents may be used to test the validity of survey questions and questionnaires and to obtain more detailed information that cannot be gathered on the original survey. Additionally, field or pilot tests may be conducted on both representative and non-representative samples, including those obtained from commercial survey and web panel vendors. Beyond looking at traditional measures of survey errors (such as item missing rates and nonresponse, and don’t know rates), these pilot tests can be used to run experimental designs in order to capture how different questions function in a field setting. Similar methodology has been adopted by other federal agencies, as well as by academic and commercial survey organizations. There are no costs to respondents other than their time. The total estimated annual burden hours are 23,350. minimizing respondent burden. Cognitive interviewing offers a detailed depiction of meanings and processes used by respondents to answer questions—processes that ultimately produce the survey data. As such, the method offers an insight that can transform understanding of question validity and response error. Documented findings from these studies represent tangible evidence of how the question performs. Such documentation also serves CDC data users, allowing them to be critical users in their approach and application of the data. In addition to cognitive interviewing, a number of other qualitative and quantitative methods are used to investigate and research measurement errors and the survey response process. These methods include conducting focus groups, usability tests, in-depth or ethnographic interviews, and the administration and analysis of questions in both representative and nonrepresentative field tests. Focus groups are conducted by the CCQDER. They are group interviews whose primary purpose is to elicit the basic sociocultural understandings and terminology that form the basis of questionnaire design. Each group typically consists of one moderator and 4 to 10 participants, depending on the research question. In-depth or ethnographic interviews are one-on-one interviews designed to elicit the understandings or terminology that are necessary for question design, as well as to gather detailed information that can contribute to the analysis of both qualitative and quantitative data. ESTIMATED ANNUALIZED BURDEN HOURS Type of respondents or or or or households households households households Average burden per response (in hours) Number of responses per respondent Total burden (in hours) ................. ................. ................. ................. Eligibility Screening .......................... Questionnaire Development Studies Respondent Data Collection Sheet .. Focus groups ................................... 4,000 7,300 7,300 100 1 1 1 1 5/60 55/60 5/60 1.5 333 6,692 608 150 Total ........................................... amozie on DSK30RV082PROD with NOTICES Individuals Individuals Individuals Individuals Number of respondents Form name ........................................................... ........................ ........................ ........................ 7,783 Leroy A. Richardson, Chief, Information Collection Review Office, Office of Scientific Integrity, Office of the Associate Director for Science, Office of the Director, Centers for Disease Control and Prevention. [FR Doc. 2018–04152 Filed 2–28–18; 8:45 am] BILLING CODE 4163–18–P VerDate Sep<11>2014 17:26 Feb 28, 2018 Jkt 244001 PO 00000 Frm 00047 Fmt 4703 Sfmt 9990 E:\FR\FM\01MRN1.SGM 01MRN1

Agencies

[Federal Register Volume 83, Number 41 (Thursday, March 1, 2018)]
[Notices]
[Pages 8875-8876]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2018-04152]


-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Centers for Disease Control and Prevention

[60Day-18-0222; Docket No. CDC-2018-0014]


Proposed Data Collections Submitted for Public Comment and 
Recommendations

AGENCY: Centers for Disease Control and Prevention (CDC), Department of 
Health and Human Services (HHS).

ACTION: Notice with comment period.

-----------------------------------------------------------------------

SUMMARY: The Centers for Disease Control and Prevention (CDC), as part 
of its continuing effort to reduce public burden and maximize the 
utility of government information, invites the general public and other 
Federal agencies the opportunity to comment on a proposed and/or 
continuing information collection, as required by the Paperwork 
Reduction Act of 1995. This notice invites comment on a proposed 
information collection project titled the Collaborating Center for 
Questionnaire Design and Evaluation Research (CCQDER), formerly the 
Questionnaire Design Research Laboratory (QDRL), generic clearance 
request, which encompasses general questionnaire development, pre-
testing, and measurement-error reduction activities to be carried out 
in 2018-2020.

DATES: CDC must receive written comments on or before April 30, 2018.

ADDRESSES: You may submit comments, identified by Docket No. CDC-2018-
0014 by any of the following methods:
     Federal eRulemaking Portal: Regulations.gov. Follow the 
instructions for submitting comments.
     Mail: Leroy A. Richardson, Information Collection Review 
Office, Centers for Disease Control and Prevention, 1600 Clifton Road 
NE, MS-D74, Atlanta, Georgia 30329.
    Instructions: All submissions received must include the agency name 
and Docket Number. CDC will post, without change, all relevant comments 
to Regulations.gov.
    Please note: Submit all comments through the Federal eRulemaking 
portal (regulations.gov) or by U.S. mail to the address listed above.

FOR FURTHER INFORMATION CONTACT: To request more information on the 
proposed project or to obtain a copy of the information collection plan 
and instruments, contact Leroy A. Richardson, Information Collection 
Review Office, Centers for Disease Control and Prevention, 1600 Clifton 
Road NE, MS-D74, Atlanta, Georgia 30329; phone: 404-639-7570; Email: 
[email protected].

SUPPLEMENTARY INFORMATION: Under the Paperwork Reduction Act of 1995 
(PRA) (44 U.S.C. 3501-3520), Federal agencies must obtain approval from 
the Office of Management and Budget (OMB) for each collection of 
information they conduct or sponsor. In addition, the PRA also requires 
Federal agencies to provide a 60-day notice in the Federal Register 
concerning each proposed collection of information, including each new 
proposed collection, each proposed extension of existing collection of 
information, and each reinstatement of previously approved information 
collection before submitting the collection to the OMB for approval. To 
comply with this requirement, we are publishing this notice of a 
proposed data collection as described below.
    The OMB is particularly interested in comments that will help:
    1. Evaluate whether the proposed collection of information is 
necessary for the proper performance of the functions of the agency, 
including whether the information will have practical utility;
    2. Evaluate the accuracy of the agency's estimate of the burden of 
the proposed collection of information, including the validity of the 
methodology and assumptions used;
    3. Enhance the quality, utility, and clarity of the information to 
be collected; and
    4. Minimize the burden of the collection of information on those 
who are to respond, including through the use of appropriate automated, 
electronic, mechanical, or other technological collection techniques or 
other forms of information technology, e.g., permitting electronic 
submissions of responses.
    5. Assess information collection costs.

Proposed Project

    The Collaborating Center for Questionnaire Design and Evaluation 
Research (CCQDER) (OMB Control Number 0920-0222, Expiration 07/31/
2018)--Revision--National Center for Health Statistics (NCHS), Centers 
for Disease Control and Prevention (CDC).

Background and Brief Description

    Section 306 of the Public Health Service (PHS) Act (42 U.S.C. 
242k), as amended, authorizes that the Secretary of Health and Human 
Services (DHHS), acting through NCHS, shall undertake and support (by 
grant or contract) research, demonstrations, and evaluations respecting 
new or improved methods for obtaining current data to support 
statistical and epidemiological activities for the purpose of improving 
the effectiveness, efficiency, and quality of health services in the 
United States.
    The Collaborating Center for Questionnaire Design and Evaluation 
Research (CCQDER) is the focal point within NCHS for questionnaire and 
survey development, pre-testing, and evaluation activities for CDC 
surveys (such as the NCHS National Health Interview Survey, OMB No. 
0920-0214) and other federally sponsored surveys. NCHS is requesting 3 
years of OMB Clearance for this generic submission.
    The CCQDER and other NCHS programs conduct cognitive interviews, 
focus groups, in-depth or ethnographic interviews, usability tests, 
field tests/pilot interviews, and experimental research in laboratory 
and field settings, both for applied questionnaire development and 
evaluation as well as more basic research on measurement errors and 
survey response.

[[Page 8876]]

    Various techniques to evaluate interviewer administered, self-
administered, telephone, Computer Assisted Personal Interviewing 
(CAPI), Computer Assisted Self-Interviewing (CASI), Audio Computer-
Assisted Self-Interviewing (ACASI), and web-based questionnaires are 
used.
    The most common questionnaire evaluation method is the cognitive 
interview. These evaluations are conducted by the CCQDER. The interview 
structure consists of respondents first answering a draft survey 
question and then providing textual information to reveal the processes 
involved in answering the test question. Specifically, cognitive 
interview respondents are asked to describe how and why they answered 
the question as they did. Through the interviewing process, various 
types of question-response problems that would not normally be 
identified in a traditional survey interview, such as interpretive 
errors and recall accuracy, are uncovered. By conducting a comparative 
analysis of cognitive interviews, it is also possible to determine 
whether particular interpretive patterns occur within particular sub-
groups of the population. Interviews are generally conducted in small 
rounds totaling 40-100 interviews; ideally, the questionnaire is re-
worked between rounds, and revisions are tested iteratively until 
interviews yield relatively few new insights.
    Cognitive interviewing is inexpensive and provides useful data on 
questionnaire performance while minimizing respondent burden. Cognitive 
interviewing offers a detailed depiction of meanings and processes used 
by respondents to answer questions--processes that ultimately produce 
the survey data. As such, the method offers an insight that can 
transform understanding of question validity and response error. 
Documented findings from these studies represent tangible evidence of 
how the question performs. Such documentation also serves CDC data 
users, allowing them to be critical users in their approach and 
application of the data.
    In addition to cognitive interviewing, a number of other 
qualitative and quantitative methods are used to investigate and 
research measurement errors and the survey response process. These 
methods include conducting focus groups, usability tests, in-depth or 
ethnographic interviews, and the administration and analysis of 
questions in both representative and non-representative field tests. 
Focus groups are conducted by the CCQDER. They are group interviews 
whose primary purpose is to elicit the basic sociocultural 
understandings and terminology that form the basis of questionnaire 
design. Each group typically consists of one moderator and 4 to 10 
participants, depending on the research question. In-depth or 
ethnographic interviews are one-on-one interviews designed to elicit 
the understandings or terminology that are necessary for question 
design, as well as to gather detailed information that can contribute 
to the analysis of both qualitative and quantitative data. Usability 
tests are typically one-on-one interviews that are used to determine 
how a given survey or information collection tool functions in the 
field, and how the mode and layout of the instrument itself may 
contribute to survey response error and the survey response process.
    In addition to these qualitative methods, NCHS also uses various 
tools to obtain quantitative data, which can be analyzed alone or 
analyzed alongside qualitative data to give a much fuller accounting of 
the survey response process. For instance, phone, internet, mail, and 
in-person follow-up interviews of previous NCHS survey respondents may 
be used to test the validity of survey questions and questionnaires and 
to obtain more detailed information that cannot be gathered on the 
original survey. Additionally, field or pilot tests may be conducted on 
both representative and non-representative samples, including those 
obtained from commercial survey and web panel vendors. Beyond looking 
at traditional measures of survey errors (such as item missing rates 
and non-response, and don't know rates), these pilot tests can be used 
to run experimental designs in order to capture how different questions 
function in a field setting.
    Similar methodology has been adopted by other federal agencies, as 
well as by academic and commercial survey organizations. There are no 
costs to respondents other than their time. The total estimated annual 
burden hours are 23,350.

                                        Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
                                                                     Number of    Average burden
      Type of respondents           Form name        Number of     responses per   per response    Total burden
                                                    respondents     respondent      (in hours)      (in hours)
----------------------------------------------------------------------------------------------------------------
Individuals or households.....  Eligibility                4,000               1            5/60             333
                                 Screening.
Individuals or households.....  Questionnaire              7,300               1           55/60           6,692
                                 Development
                                 Studies.
Individuals or households.....  Respondent Data            7,300               1            5/60             608
                                 Collection
                                 Sheet.
Individuals or households.....  Focus groups....             100               1             1.5             150
                                                 ---------------------------------------------------------------
    Total.....................  ................  ..............  ..............  ..............           7,783
----------------------------------------------------------------------------------------------------------------


Leroy A. Richardson,
Chief, Information Collection Review Office, Office of Scientific 
Integrity, Office of the Associate Director for Science, Office of the 
Director, Centers for Disease Control and Prevention.
[FR Doc. 2018-04152 Filed 2-28-18; 8:45 am]
 BILLING CODE 4163-18-P


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.