Agency Information Collection Activities; Submission for Office of Management and Budget Review; Comment Request; Healthcare Professional Survey of Professional Prescription Drug Promotion, 8721-8727 [2019-04307]

Download as PDF amozie on DSK9F9SC42PROD with NOTICES Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices Act, that the charter for the of the National Advisory Committee on the Sex Trafficking of Children and Youth in the United States (Committee) was renewed on January 18, 2019. The renewal is available at https:// www.acf.hhs.gov/otip/resource/ 2019naccharter. Notice is also given that a meeting of the National Advisory Committee on the Sex Trafficking of Children and Youth in the United States (Committee) will be held on May 28, 2019. The purpose of the meeting is for the Committee to discuss its work on its interim report on recommended best practices for States to follow in combating the sex trafficking of children and youth based on multidisciplinary research and promising, evidence-based models and programs. The members will remain in Phoenix on May 29 to conduct subcommittee meetings and a fact finding site visit. DATES: The meeting will be held on May 28, 2019. The members will remain in Phoenix on May 29 to conduct subcommittee meetings and a fact finding site visit. ADDRESSES: The meeting will be held in Phoenix, Arizona at the invitation of Governor Ducey. Space is limited. Identification will be required at the entrance of the facility (e.g., passport, state ID, or federal ID). To attend the meeting virtually, please register for this event online: https://www.acf.hhs.gov/otip/resource/ nacagenda0519. FOR FURTHER INFORMATION CONTACT: Katherine Chon (Designated Federal Officer) at EndTrafficking@acf.hhs.gov or (202) 205–4554 or 330 C Street SW, Washington, DC, 20201. Additional information is available at https:// www.acf.hhs.gov/otip/partnerships/thenational-advisory-committee. SUPPLEMENTARY INFORMATION: The formation and operation of the Committee are governed by the provisions of Public Law 92–463, as amended (5 U.S.C. App. 2), which sets forth standards for the formation and use of federal advisory committees. Purpose of the Committee: The purpose of the Committee is to advise the Secretary and the Attorney General on practical and general policies concerning improvements to the nation’s response to the sex trafficking of children and youth in the United States. HHS established the Committee pursuant to Section 121 of the Preventing Sex Trafficking and Strengthening Families Act of 2014 (Pub. L. 113–183). Tentative Agenda: The agenda can be found at https://www.acf.hhs.gov/otip/ VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 8721 partnerships/the-national-advisorycommittee. The Committee requests public comments in response to their first outline of recommendations available at https://www.acf.hhs.gov/ otip/resource/nacprelim. To submit written statements or RSVP to attend in-person or make verbal statements, email Ava.Donald@ acf.hhs.gov by May 10, 2019. Please include your name, organization, and phone number. More details on these options are below. Public Accessibility to the Meeting: Pursuant to 5 U.S.C. 552b and 41 CFR 102–3.140 through 102–3.165, and subject to the availability of space, this meeting is open to the public. Seating is on a first to arrive basis. Security screening and a photo ID are required. Space and parking is limited. The building is fully accessible to individuals with disabilities. Written Statements: Pursuant to 41 CFR 102–3.105(j) and 102–3.140 and section 10(a)(3) of the Federal Advisory Committee Act, the public may submit written statements in response to the stated agenda of the meeting or to the committee’s mission in general. Organizations with recommendations on best practices are encouraged to submit their comments or resources (hyperlinks preferred). Written comments or statements received after April 10, 2019 may not be provided to the Committee until its next meeting. Verbal Statements: Pursuant to 41 CFR 102–3.140d, the Committee is not obligated to allow a member of the public to speak or otherwise address the Committee during the meeting. Members of the public are invited to provide verbal statements during the Committee meeting only at the time and manner described in the agenda. The request to speak should include a brief statement of the subject matter to be addressed and should be relevant to the stated agenda of the meeting or the Committee’s mission in general. Minutes: The minutes of this meeting will be available for public review and copying within 90 days at: https:// www.acf.hhs.gov/otip/partnerships/thenational-advisory-committee. DEPARTMENT OF HEALTH AND HUMAN SERVICES Dated: March 4, 2019. Lynn A. Johnson, Assistant Secretary for Children and Families. I. Background Section 1701(a)(4) of the Public Health Service Act (42 U.S.C. 300u(a)(4)) authorizes FDA to conduct research relating to health information. Section 1003(d)(2)(C) of the Federal Food, Drug, and Cosmetic Act (FD&C Act) (21 U.S.C. 393(d)(2)(C)) authorizes [FR Doc. 2019–04403 Filed 3–8–19; 8:45 am] BILLING CODE 4184–40–P PO 00000 Frm 00061 Fmt 4703 Sfmt 4703 Food and Drug Administration [Docket No. FDA–2018–N–0215] Agency Information Collection Activities; Submission for Office of Management and Budget Review; Comment Request; Healthcare Professional Survey of Professional Prescription Drug Promotion AGENCY: Food and Drug Administration, HHS. ACTION: Notice. The Food and Drug Administration (FDA) is announcing that a proposed collection of information has been submitted to the Office of Management and Budget (OMB) for review and clearance under the Paperwork Reduction Act of 1995. DATES: Fax written comments on the collection of information by April 10, 2019. ADDRESSES: To ensure that comments on the information collection are received, OMB recommends that written comments be faxed to the Office of Information and Regulatory Affairs, OMB, Attn: FDA Desk Officer, Fax: 202– 395–7285, or emailed to oira_ submission@omb.eop.gov. All comments should be identified with the OMB control number 0910-New and title, ‘‘Healthcare Professional Survey of Professional Prescription Drug Promotion.’’ Also include the FDA docket number found in brackets in the heading of this document. FOR FURTHER INFORMATION CONTACT: Ila S. Mizrachi, Office of Operations, Food and Drug Administration, Three White Flint North, 10A–12M, 11601 Landsdown St., North Bethesda, MD 20852, 301–796–7726, PRAStaff@ fda.hhs.gov. SUPPLEMENTARY INFORMATION: In compliance with 44 U.S.C. 3507, FDA has submitted the following proposed collection of information to OMB for review and clearance. SUMMARY: Healthcare Professional Survey of Professional Prescription Drug Promotion OMB Control Number 0910–New E:\FR\FM\11MRN1.SGM 11MRN1 amozie on DSK9F9SC42PROD with NOTICES 8722 Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices FDA to conduct research relating to drugs and other FDA regulated products in carrying out the provisions of the FD&C Act. The FD&C Act prohibits the dissemination of false or misleading information about medications in consumer-directed and professional prescription drug promotion. As part of its Federal mandate, FDA regulates whether advertising of prescription drug products is truthful, balanced, and accurately communicated (see 21 U.S.C. 352(n)). FDA’s regulatory policies are aligned with the principles of free speech and due process in the U.S. Constitution. To inform current and future policies, and to seek to enhance audience comprehension, the Office of Prescription Drug Promotion conducts research focusing on (1) advertising features including content and format, (2) target populations, and (3) research quality. This proposed research focuses on healthcare professionals (HCPs). In 2002 (Ref. 1) and again in 2013 (Refs. 2 and 3), FDA surveyed HCPs about their attitudes toward direct-to-consumer (DTC) advertising and its role in their relationships with their patients. The 2013 survey included multiple types of HCPs: Primary care physicians and specialists, as well as nurse practitioners and physician assistants. Whereas the focus of both previous FDA surveys was on DTC advertising and promotion, the current study is designed to address issues related to professional prescription drug promotion. The goal is to query a representative sample of HCPs about their opinions of promotional materials and procedures targeted at HCPs, clinical trial design and knowledge, and FDA approval status. We will also take this opportunity to ask HCPs briefly about their knowledge of abusedeterrent formulations for opioid products. To educate themselves about prescription drugs, HCPs sometimes rely on professionally directed promotional information (Refs. 4–8). In 2012, pharmaceutical companies spent more than $24 billion on marketing to physicians (Ref. 9). The industry exposes healthcare professionals to promotional materials through a variety of mechanisms, including communication with pharmaceutical representatives, journal ads, prescribing software, presentations at sponsored meetings, and direct mail ads (Ref. 10). Several studies indicate that data presented in promotional materials may not be fully comprehended and may VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 even potentially be misleading due to a variety of causes, such as insufficient information, unsupported claims, or a failure to disclose limitations of the information presented (Refs. 11–15). Although HCPs are learned intermediaries, like most people, they may rely on heuristics, or rules of thumb, in making decisions and may have cognitive biases in the type of information they attend to at any given time. They may be persuaded by strong statements and may not have the time to ascertain accuracy of such information (Ref. 16). The proposed survey is designed to provide further insights about how professionally targeted prescription drug promotion might influence healthcare professionals’ decisionmaking processes and practices and how information may be communicated more accurately. It is important to note that FDA does not regulate the practice of medicine. However, as previously mentioned, FDA does regulate prescription drug promotion. This survey is designed to inform FDA of various responses to and impacts of prescription drug promotion. The general research questions in the survey are as follows: 1. What methods and/or channels are used to disseminate prescription drug promotional information to healthcare professionals/prescribers? 2. How knowledgeable and interested are HCPs in clinical trial data and design and its presence in prescription drug promotion? 3. How familiar are HCPs with the FDA approval of prescription drugs and how does this affect prescribing behavior? In addition, given the critical problem with opioid abuse and addiction in the United States at this time, we plan to ask several questions about prescription drug promotion of opioid products. HCPs who fall into one of four categories will be recruited online through WebMD’s Medscape subscriber network. We propose to complete 700 primary care physician, 600 specialist, 350 nurse practitioner, and 350 physician assistant surveys. HCPs will be included if they see patients at least 50 percent of the time. Both Doctors of Medicine and Doctors of Osteopathy will be included. Primary care physicians will include those who indicate they work in general, family, or internal medicine. Specialties were chosen based on prevalence in the United States and prescription drug promotional activity. Specialists will PO 00000 Frm 00062 Fmt 4703 Sfmt 4703 include cardiologists, dermatologists, endocrinologists, neurologists, obstetrician/gynecologists, oncologists, ophthalmologists, psychiatrists, rheumatologists, and urologists. The data will be weighted to adjust for differential coverage of select characteristics such as region and respondent age and gender. Pretesting with 25 respondents will take place before the main study to evaluate the procedures and measures used in the main study. In the Federal Register of March 15, 2018 (83 FR 11539), FDA published a 60-day notice requesting public comment on the proposed collection of information. Four comments were received. One comment was outside the scope of the research and is not addressed further. The remaining three comments are addressed below. For brevity, some public comments are paraphrased and therefore may not reflect the exact language used by the commenter. We assure commenters that the entirety of their comments was considered even if not fully captured by our paraphrasing in this document. The following acronyms are used here: DTC = direct-to-consumer; HCP = healthcare professional; FDA and ‘‘The Agency’’ = Food and Drug Administration; OPDP = FDA’s Office of Prescription Drug Promotion. The first public comment had 19 individual comments, to which we have responded. (Comment 1a) The exact reach of the WebMD Medscape subscriber network among medical professionals is unclear. With this in mind, the study design could introduce bias by self-selecting physicians who do not accurately reflect the broader physician population. For example, they may be more reliant on internet-based information, have seen more web-based pharmaceutical advertisements, and be demographically different than physicians outside the Medscape network. (Response 1a) It is true that Medscape is not an exhaustive listing of the entire universe of HCPs, but the evidence suggests that coverage is high. Table 1 below documents the number of providers subscribed to WebMD for the four major strata of HCPs included in the study and the estimated population totals. The coverage is particularly good for primary care physicians (over 80 percent), is reasonable for specialists and physicians assistants (between 60 and 70 percent), and not as good for nurse practitioners (about 45 percent). E:\FR\FM\11MRN1.SGM 11MRN1 8723 Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices TABLE 1—ESTIMATED COUNTS AND COVERAGE BY HEALTHCARE PROFESSIONAL GROUP WebMD 1 Healthcare professional group Primary care physicians (PCPs) .................................................................................................. Specialists (SPs) .......................................................................................................................... Physicians assistants ................................................................................................................... Nurse practitioners ....................................................................................................................... 197,980 465,020 62,874 102,552 Estimated population total 2 242,800 2 724,249 3 92,000 4 220,000 Estimated coverage % 81.5 64.2 68.3 46.6 1 WebMD estimated counts of Medscape subscribers by HCP group as of July 2017. Medical Association (https://www.mmslists.com/data/countspdf/AMA-SpecialtyByTOPS.pdf). Family Foundation (https://www.kff.org/other/state-indicator/total-physician-assistants/?currentTimeframe=0&sortModel=%7B%22colId %22:%22Location%22,%22sort%22:%22asc%22%7D). 4 American Association of Nurse Practitioners (https://www.aanp.org/all-about-nps/np-fact-sheet). 2 American amozie on DSK9F9SC42PROD with NOTICES 3 Kaiser The Medscape frame has a smaller frequency of out-of-scope records (retirees, for example, who have not been dropped from the list), and much better contact information (including email addresses), compared to other possible frames. Potential frame competitors, such as the American Medical Association list of providers, have higher coverage of PCPs and SPs, but also many out-of-scope records. Sampling these records would lead to ineligibles in data collection. Considering both coverage and ineligibility rates, Medscape is of better quality than the alternatives. We are planning to calibrate the weights for the sample providers who answer the questionnaire, using the National Ambulatory Medical Care Survey (NAMCS) estimates as benchmarks, based on gender, age, year of graduation, and practice size. Use of these calibrated weights will guarantee that the percentages across provider type, gender, age, year of graduation, and practice size match the NAMCS percentages, which are our best unbiased estimates of the true population percentages. Thus, the under-coverage from the use of the Medscape frame will not lead to significant imbalances in the distribution of these characteristics which could lead to bias. Calibration eliminates bias-producing imbalances for cells defined by the calibration characteristics, but does not eliminate imbalances within these cells. It may be the case that within the provider typegender-age-graduation year-practice size cells, the Medscape population differs from the universe because of their selfselection into Medscape. This will generate coverage biases of unknown magnitude, but we anticipate that the size of these biases will be small as a component of overall mean-squarederror in this study and will not materially affect the analyses. (Comment 1b) If specialties are planned to be analyzed individually, the VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 sample size should be at least 50 respondents from each specialty. (Response 1b) Our analysis plan does not include a separate full-scale analysis for each specialty, though specialty will be included in the analyses as a covariate along with other provider characteristics. Thus, the 50-respondent minimum per specialty is not necessary given the goals of this study. (Comment 1c) We did not have access to the full screening criteria and have several suggestions for the criteria: a mix of age, practice experience, practice setting, number of patients seen each month, and gender. (Response 1c) Our screening instrument captures the suggested items, including age, gender, race/ ethnicity, practice setting, percent of time seeing patients, and clinical specialty. The survey instrument collects information on the number of patients seen weekly and number of years in practice. (Comment 1d) Q[uestion]2 currently asks how often physicians visit commercial prescription drug websites. This is a broad question, and we suggest adding followup questions to understand why the physician went to the website (i.e., interested in getting specific product information, patient assistance program information, etc.), what specific information was sought (i.e., promotional information, educational resources, patient support services, prescribing information) and how helpful was the information. (Response 1d) Prescription drug websites are one of several information sources that are asked about in the survey. The primary goal of our questions about sources of information is to capture the amount of exposure or use of various information sources by HCPs. This may be a good avenue for further research. (Comment 1e) Responses to Q3 could skew towards more frequent use than the average prescriber since the sample is being recruited from a network of PO 00000 Frm 00063 Fmt 4703 Sfmt 4703 physicians subscribing to a reference website (WebMD Medscape). (Response 1e) We acknowledge there may be a coverage bias from the use of the WebMD Medscape as a frame, but do not know exactly the magnitudes of bias for particular items. We will document the nature of our frame and the potential implications of that. See response to comment 1a for more details on WebMD sample. (Comment 1f) Q7a asks respondents to gauge the influence of various information sources on their colleagues’ prescribing decisions. Q7b asks about the influence of various information sources on the respondent’s prescribing decisions. Influence is subjective and respondent answers to these questions are inherently unreliable. We suggest asking about behavior to help understand influence. If these questions are retained, we suggest reordering the questions. (Response 1f) We are interested in HCPs’ perceptions of relative influence of different information sources. An assessment of the actual influence of these sources through prescribing data is beyond the scope of this project. This is a valuable avenue for future research. Moreover, this question is designed to build on research literature which suggests that HCPs typically rate promotional materials as being more influential on colleagues than on themselves (Refs. 17 and 18). Thus, we ask about the influence of promotional information for both colleagues and the respondent. We will randomize the presentation order of these two questions in the survey. (Comment 1g) For Q9–Q10, questions and answer choices are overly broad to provide actionable insight. For example, respondents might define ‘‘information about clinical trial designs or clinical trial outcomes’’ differently, along with what ‘‘Some’’ versus ‘‘Lots’’ of information represent. We suggest revising Q9 to ‘‘Do you need more clinical trial design information in order to understand or interpret the clinical E:\FR\FM\11MRN1.SGM 11MRN1 amozie on DSK9F9SC42PROD with NOTICES 8724 Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices trial data and outcomes presented in promotional material?’’ We suggest revising Q10 to ‘‘Do you need more clinical trial outcomes information in order to make sound clinical decisions for your patients?’’ (Response 1g) We have made some changes to these questions as a result of cognitive testing. For example, we replaced ‘‘clinical trial design’’ with ‘‘clinical trial methodology’’ and included examples of what is meant by methodology in parenthesis (e.g., sample, study design). We also changed answer choices to make them more distinct. The choices are now: All information, a moderate amount, a minimal amount, and none. (Comment 1h) We suggest revising Q14 into two separate questions. One question about the type of training (e.g. formal school, continuing medical education, peers) and a separate question on how much training in different aspects of clinical trial design the respondent completed. (Response 1h) We are using the question about clinical trials training as a covariate to other questions in the survey about clinical trials. Training may influence the amount of clinical trials information HCPs want included in promotions or their level of comfort with clinical trials data. We have added the word ‘‘formal’’ to the question to indicate that we are referring to actual training rather than informal discussions with colleagues. (Comment 1i) Q18 assumes the physician knows whether the drugs prescribed are approved or not approved. We suggest including a selection of ‘‘Do not know.’’ (Response 1i) We will add ‘‘Do not know’’ as a response option to this question. (Comment 1j) We have concerns that Q21 fails to define what the Agency means by ‘‘promotion.’’ As a result, the question as phrased may suggest that the Agency has broader authority than delegated by Congress or as permitted under the First Amendment to regulate (i.e., ‘‘allow’’) protected manufacturer speech that is truthful and nonmisleading. We suggest revising Q21 to ask respondents if they value the ability of pharmaceutical companies to provide truthful and non-misleading information about their drugs for indications not approved by FDA. (Response 1j) Q21 has been deleted. (Comment 1k) We agree that having an option of ‘‘not sure’’ for Q22 is appropriate since many respondents might not be familiar with this approval pathway. However, this could reduce the amount of information this question could assess. We suggest modifying the VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 question to incorporate the definition of accelerated approval and then ask the respondent about his/her comfort level with prescribing. This approach would allow the survey to collect responses from the most respondents possible. We also suggest adding a question prior to Q22 to ask about familiarity or experience with an accelerated approval drug that could be used to assess prior behavior as well as understand how experience with accelerated approval impacts comfort to use. (Response 1k) We have purposefully not included a definition of accelerated approval, as we are interested in assessing comfort with accelerated approval based on their own understanding of the term. We have added an open-ended question prior to Q22 that asks respondents to describe what an accelerated approval drug is in their own words. (Comment 1l) We recommend modifying the open-ended question (Q23) about scientific exchange and offering respondent components for consideration (i.e., criteria for who is part of exchange of information, description for type of scientific information, description of context of scientific information, and the forum or setting where exchange of information occurs). We also recommend adding question(s) to understand how often respondents engage in settings where scientific exchange typically occurs, such as oral presentations/poster sessions at scientific congresses, review of articles in medical journals, data and clinical trial summaries on clinical trial registries. (Response 1l) The goal of this openended question is to assess general awareness/understanding of the term ‘‘scientific exchange.’’ In cognitive testing, we found that several HCPs had never heard this term before. Therefore, we need to get a broader sense of general awareness, which may be low, before following up with more specific questions. We have added the option to check ‘‘do not know’’ for this question. (Comment 1m) The open-ended question (Q24) seeking a description of biosimilars will likely result in an extremely wide range of answers with no ability to categorize responses based on the HCP’s true knowledge of the term. We suggest framing the question along the lines of how comfortable the HCP is with prescribing biosimilars, therefore, the responses may help correlate knowledge of the term with a greater comfort level in prescribing. (Response 1m) The goal of this openended question is to assess HCP general awareness/knowledge of biosimilars. We have added the option to check ‘‘do PO 00000 Frm 00064 Fmt 4703 Sfmt 4703 not know’’ for this question. We also plan to code open-ended responses to determine their level of closeness to the established definition: a biological product that is highly similar to and has no clinically meaningful differences from an existing FDA-approved reference product (42 U.S.C. 262(i)(2)). We have also added a close-ended question prior to Q24 to ask HCPs how comfortable they are prescribing biosimilars. (Comment 1n) For Q25–26, we recommend including ‘‘don’t know’’ or ‘‘it depends’’ as answer options for these two questions. (Response 1n) While some cognitive effort is required, we believe the scenarios included in these questions provide sufficient information to allow respondents to make ratings. We also note that during cognitive testing, respondents did not have difficulty answering these questions. (Comment 1o) For Q28, we recommend incorporating a description or definition of ‘‘REMS’’ materials. (Response 1o) We have revised the question to spell out the term, Risk Evaluation or Mitigation Strategy (REMS) materials. (Comment 1p) For Q28a, we recommend a small modification to the question in order to fully capture and connect to the list from the previous question. For example, How often do these materials or events mention abuse potential? (Response 1p) We will revise the question to include ‘‘events.’’ (Comment 1q) We suggest adding a followup question to Q27 and Q28 to understand the impact of education/ information about opioids on prescribing behaviors. For example, ‘‘Is the number of patients you prescribed opioids for chronic pain in the last 3 months relative to 12 months ago: (1) the same, (2) less or (3) more?’’ (Response 1q) We have added this question to the survey. (Comment 1r) We suggest an additional followup question to Q27 and Q28 to capture how the discussion and information on opioids and abuse potential has changed over recent years, rather than focusing only on the previous 12 months. Asking a retrospective question might capture how the type of information physicians receive has changed as the critical opioid situation has gained more widespread recognition. (Response 1r) The proposed followup question broadens the scope of the survey in a way that may prevent us from collecting the most relevant data. To capture the element of change in practice over time, as suggested, we E:\FR\FM\11MRN1.SGM 11MRN1 amozie on DSK9F9SC42PROD with NOTICES Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices have added a question to ask HCPs whether in the last year the content of promotional materials for opioid products have contained more or less information on abuse potential. The second public comment responder had 13 comments, to which we have responded. (Comment 2a) The public comment responder expressed concern that they had difficulty obtaining the proposed survey questionnaire via email, but acknowledged that they were able to obtain it promptly once they contacted the telephone number provided in the 60-day notice. Among other suggestions, the commenter recommended that FDA specify a contact that can directly provide the survey in future notices. (Response 2a) We appreciate the commenter bringing their experience to our attention. While other commenters that requested the survey did not report that they experienced difficulty promptly obtaining the survey, we take this concern very seriously. Moving forward, in addition to the contact information that has been provided, we will also include the email address of the research team, DTCResearch@ fda.hhs.gov, in all notices to facilitate obtaining information collection instruments directly from the research team. (Comment 2b) The proposed HCP survey is duplicative of other information already collected by FDA, such as the previous Healthcare Professional Survey of Prescription Drug Promotion (HCP I survey) and a project referenced on the OPDP website 1 entitled, ‘‘Clinical Trial Data in Professional Prescription Drug Promotion.’’ (Response 2b) The HCP I survey was conducted 5 years ago (summer 2013) and focused mainly on HCPs’ attitudes toward DTC advertising and its role in their relationship with patients (Refs. 2, 3). The current HCP II survey focuses on promotions directed at healthcare professionals. The existence of some overlapping questions does not constitute in itself a duplicative effort, as there is often a need to compare responses at multiple time points for comprehensive analysis of the issues at hand. Many federally funded national surveys ask the same or similar questions at multiple time points to detect changes and identify trends over time. We also note the study referenced on the OPDP website is qualitative research with a small non-representative sample, 1 https://www.fda.gov/AboutFDA/CentersOffices/ OfficeofMedicalProductsandTobacco/CDER/ ucm090276.htm VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 so the design differs considerably from this proposed study. Having multiple studies focusing on differing aspects of a phenomenon, using differing designs and modes, is in accordance with OMB standards to avoid unnecessary duplication of research efforts. (Comment 2c) The commenter recommends that FDA ask questions about non-opioid analgesic options, medication-assisted treatment for opioid deterrence, and opioid overdosereversal agents. By asking about this broader range of treatments, the survey would be consistent with the Administration’s emphasis on the whole range of medical advances that can help address the opioid crisis. (Response 2c) We have added a question to address references to these medical advances in prescription drug promotion. (Comment 2d) We recommend that FDA amend Q1b to ask how closely HCPs read different types of advertisements (e.g., advertisement for new products, or for products related to the HCPs practice). (Response 2d) We have replaced Q1b with two questions to capture how closely HCPs read the suggested types of advertisements. One will ask about advertisements for new products and one will ask about advertisements for products related to the HCP’s practice. (Comment 2e) We recommend that FDA reword Q2 to avoid the ambiguous term ‘‘commercial.’’ Specifically, we recommend FDA revise the question to read as follows: ‘‘How often do you visit product-specific or manufacturersponsored commercial prescription drug product websites, such as lipitor.com?’’ (Response 2e) In cognitive testing conducted to develop this survey, the word ‘‘commercial’’ was easily understood by respondents and is needed in this question to differentiate it from ‘‘reference’’ websites in the subsequent question. (Comment 2f) We recommend that FDA include a new question under Q2 (i.e., 2a) that is similar to 3b (i.e., that asks how closely the HCP usually reads the prescription drug websites it visits). (Response 2f) We have added this question. (Comment 2g) We recommend that FDA clarify whether Q5a applies only to in-person visits from pharmaceutical sales representatives. (Response 2g) During cognitive interviews, respondents had no difficulty understanding that question 5a was asking only about in-person visits. However, we have revised the question to read, ‘‘How often do pharmaceutical representatives bring promotional materials to your practice?’’ PO 00000 Frm 00065 Fmt 4703 Sfmt 4703 8725 to clarify that the question refers to inperson visits. (Comment 2h) We recommend that FDA delete responses 2 (‘‘Lunch for staff’’) and 7 (‘‘Personal use item’’) from Q5b. It is not clear how these topics relate to FDA’s jurisdiction. Other agencies of the Department of Health and Human Services, not FDA, regulate such practices. In addition, these responses do not seem to fall within the stated scope of the survey. (Response 2h) We have made a minor change to this question by replacing ‘‘lunch for staff’’ with ‘‘food and beverages.’’ The survey includes questions about the various types of prescription drug promotions and promotional practices that HCPs might be exposed to. To fully understand promotional practices, we also need to know what pharmaceutical representatives provide HCPs during an in-person visit. (Comment 2i) We recommend that FDA clarify what is meant by the term ‘‘conference’’ in Q6. (Response 2i) We have revised the survey to ask separate questions about ‘‘pharmaceutical dinner meetings’’ and ‘‘professional conferences.’’ This distinction should make the meaning of professional conference clear. (Comment 2j) We recommend deleting Q7, as it asks HCPs to speculate about colleagues’ perception of promotional materials. (Response 2j) This question is designed to build on research literature which suggests that HCPs typically rate promotional materials as being more influential on colleagues than on themselves (Refs. 17, 18). Thus, we ask about the influence of promotional information for both colleagues and the respondent. We will randomize the presentation order of these two questions in the survey. (Comment 2k) We recommend that response 3 for Q8 be amended to identify both the number and type of trials: ‘‘Number and type of trials conducted.’’ (Response 2k) Including number and type of trials conducted as one response option will be confusing for respondents and we believe that type of trial is captured by the second response option: ‘‘Study design (e.g., blinded or not, cohort study, length of trial, etc.).’’ (Comment 2l) We recommend adding the following language to Q18 to ensure consistent use throughout the survey: ‘‘How often do you prescribe a drug for conditions for which it is not approved (referred to as unapproved use below)?’’ We also recommend amending Q20 to use the term ‘‘unapproved use’’ instead of ‘‘off-label use,’’ to correspond with E:\FR\FM\11MRN1.SGM 11MRN1 8726 Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices question 19 and ensure consistent terminology throughout the survey. (Response 2l) We determined through cognitive testing that HCPs are familiar with and use the term off-label use. The questions have been revised to use ‘‘offlabel use’’ for all three questions. (Comment 2m) We recommend deleting Q21, as HCPs perspectives on whether promotion of unapproved uses should be allowed presumes that HCPs know the existing regulatory framework. Moreover, the relevancy of this question is unclear given the stated research goals. (Response 2m) We have deleted this question. (Comment 2n) Q31 asks about the respondent’s Secondary Specialty. However, it is not clear from the survey if and where Primary Specialty is recorded; we recommend amending the survey to clearly identify the respondent’s Primary Specialty. (Response 2n) Primary specialty is asked in the screener. We have removed the question about ‘‘secondary specialty’’ from the survey. The third public comment responder had one comment, to which we have responded. (Comment 3a) We suggest adding questions to the survey about how promotional materials and procedures address abuse deterrent formulations (ADF) for opioid products. Specifically, we suggest adding questions related to the following topic areas to assess HCPs’ knowledge and understanding of these areas: • That ADF products have not proven any less addictive than standard nonADF formulations. • That the potential for patient harm from dose-dependent misuse of ADF products (e.g., adverse effects resulting from patients taking higher doses of the product than prescribed) or for patients that switch to non-prescribed drugs (e.g., heroin) still remains. • That potential methods for defeating the ‘‘tamper-proof’’ formulation still exist. • That there are effective ways to protect against accidental ingestion of the drug or theft by others. (Response 3a) We address the first bullet in question 28c. Various aspects of the remaining bullets are addressed in question 28d. Although the specific points mentioned in this comment are important public health messages, we think these questions are more appropriate for an indepth study of the topic, which is beyond the scope of this project. Please also see our responses to Comments 1r and 2c. FDA estimates the burden of this collection of information as follows: TABLE 2—ESTIMATED ANNUAL REPORTING BURDEN 1 Number of respondents Activity Total annual responses Average burden per response Total hours Pretest Study: HCP screener ................................................... Informed Consent ............................................. HCP Survey ...................................................... Main Study: HCP screener ................................................... Informed Consent ............................................. HCP Survey ...................................................... 63 25 25 1 1 1 63 25 25 0.08 (5 minutes) ........ 0.08 (5 minutes) ........ 0.33 (20 minutes) ...... 5 2 8 5,037 2,000 2,000 1 1 1 5,037 2,000 2,000 0.08 (5 minutes) ........ 0.08 (5 minutes) ........ 0.33 (20 minutes) ...... 403 160 660 Total ........................................................... ........................ ........................ ........................ .................................... 1,238 1 There amozie on DSK9F9SC42PROD with NOTICES Number of responses per respondent are no capital costs and maintenance costs associated with this collection of information. II. References The following references marked with an asterisk (*) are on display at the Dockets Management Staff, OC/Office of Executive Secretariat, Food and Drug Administration, 5630 Fishers Lane, Rm. 1061, Rockville, MD 20857 and are available for viewing by interested persons between 9 a.m. and 4 p.m., Monday through Friday; they are also available electronically at https:// www.regulations.gov. References without asterisks are not on public display at https://www.regulations.gov because they have copyright restrictions. Some may be available at the website address, if listed. References without asterisks are available for viewing only at the Dockets Management Staff. FDA has verified the website addresses, as of the date this document publishes in the Federal Register, but websites are subject to change over time. *1. Available at: https://www.fda.gov/ AboutFDA/CentersOffices/Officeof VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 MedicalProductsandTobacco/CDER/ ucm090276.htm. Last accessed February 6, 2019. 2. Betts, K.R., A.C. O’Donoghue, K.J. Aikin, et al. (2016). ‘‘Healthcare Professional Social Media Membership and Participation: Findings From a Nationally Representative Sample,’’ Journal of the American Association of Nurse Practitioners. Doi: 10.1002/2327– 6924.12383. 3. O’Donoghue, A.C., V. Boudewyns, K.J. Aikin, et al. (2015). ‘‘Awareness of FDA’s Bad Ad Program and Education Regarding Pharmaceutical Advertising: A National Survey of Prescribers in Ambulatory Care Settings,’’ Journal of Health Communication, vol. 20(11), pp. 1330–1336. 4. Crigger, N.J. (2005). ‘‘Pharmaceutical Promotions and Conflict of Interest in Nurse Practitioner’s Decision Making: The Undiscovered Country,’’ Journal of the American Academy of Nurse Practitioners, vol. 17(6), pp. 207–212. 5. Fischer, M. ., M.E. Keough, J.L. Baril, et al. (2009). ‘‘Prescribers and Pharmaceutical Representatives: Why Are We Still Meeting?’’ Journal of General Internal Medicine, vol. 24(7), pp. 795–801. PO 00000 Frm 00066 Fmt 4703 Sfmt 4703 6. C. Robertson, S. Rose, and A.S. Kesselheim (2012). ‘‘Effect of Financial Relationships on the Behaviors of Health Care Professionals: A Review of the Evidence,’’ The Journal of Law, Medicine & Ethics, vol. 40(3), pp. 452–466. 7. Srivastava, V., M. Handa, and A. Vohra (2014). ‘‘Promotional Tools: Do Physicians Really Bite the Hook?’’ Drishtikon: A Management Journal, vol. 5(2). 8. Austad, K.E., J. Avorn, J.M. Franklin, et al. (2014). ‘‘Association of Marketing Interactions With Medical Trainees’ Knowledge About Evidence-Based Prescribing: Results From a National Survey,’’ JAMA Internal Medicine, vol. 174(8), pp. 1283–1290. *9. Cegedim Strategic Data (2013). ‘‘2012 U.S. Pharmaceutical Company Promotion Spending.’’ Available at: https:// www.skainfo.com/health_care_market_ reports/2012_promotional_spending.pdf. 10. Spurling, G.K., P.R. Mansfield, B.D. Montgomery, et al. (2010). ‘‘Information From Pharmaceutical Companies and the Quality, Quantity, and Cost of Physicians’ Prescribing: A Systematic Review,’’ PLoS Medicine, vol. 7(10), e1000352. doi: 10.1371/jounal.pmed. E:\FR\FM\11MRN1.SGM 11MRN1 Federal Register / Vol. 84, No. 47 / Monday, March 11, 2019 / Notices 1000352. 11. Villanueva, P., S. Peiro´, J. Librero, et al. (2003). ‘‘Accuracy of Pharmaceutical Advertisements in Medical Journals,’’ Lancet, vol. 361(9351), pp. 27–32. 12. Cooper, R.J. and D.L. Schriger (2005). ‘‘The Availability of References and the Sponsorship of Original Research Cited in Pharmaceutical Advertisements,’’ Canadian Medical Association Journal, vol. 172(4), pp. 487–491. 13. Jureidini, J.N., L.B. McHenry, and P.R. Mansfield (2008). ‘‘Clinical Trials and Drug Promotion: Selective Reporting of Study 329,’’ International Journal of Risk & Safety in Medicine, vol. 20(1–2), pp. 73–81. 14. Garcia-Retamero, R. and M. Galesic (2010). ‘‘Who Profits From Visual Aids: Overcoming Challenges in People’s Understanding of Risks,’’ Social Science & Medicine, vol. 70(7), pp. 1019–1025. 15. Cooper, R.J., D.L. Schriger, R.C. Wallace, et al. (2003). ‘‘The Quantity and Quality of Scientific Graphs in Pharmaceutical Advertisements,’’ Journal of General Internal Medicine, vol. 18(4), pp. 294– 297. 16. Sah, S. and A. Fugh-Berman (2013). ‘‘Physicians Under the Influence: Social Psychology and Industry Marketing Strategies,’’ The Journal of Law, Medicine & Ethics, vol. 41(3), pp. 665– 672. doi: 10.1111/jlme.12076. 17. Carroll, A.E., R.C. Vreeman, J. Buddenbaum, et al. (2007). ‘‘To What Extent Do Educational Interventions Impact Medical Trainees’ Attitudes and Behaviors Regarding Industry Trainee and Industry-Physician Relationships?’’ Pediatrics, 120, e1528-e1535. doi:10.1542/peds.2007–0363. 18. Crigger, N., K. Barnes, A. Junko, et al. (2009). ‘‘Nurse Practitioners’ Perceptions and Participation in Pharmaceutical Marketing,’’ Journal of Advanced Nursing, 65, 525–533. doi: 10.1111/ j.1365–2648.2008.04911.x. Dated: March 5, 2019. Lowell J. Schiller, Acting Associate Commissioner for Policy. [FR Doc. 2019–04307 Filed 3–8–19; 8:45 am] BILLING CODE 4164–01–P DEPARTMENT OF HEALTH AND HUMAN SERVICES Food and Drug Administration amozie on DSK9F9SC42PROD with NOTICES [Docket No. FDA–2013–N–0370] Agency Information Collection Activities; Proposed Collection; Comment Request; Agency Information Collection Activities; Submission for Office of Management and Budget Review; Comment Request; Export of Medical Devices; Foreign Letters of Approval AGENCY: Food and Drug Administration, HHS. ACTION: Notice. VerDate Sep<11>2014 18:41 Mar 08, 2019 Jkt 247001 8727 SUMMARY: Written/Paper Submissions Electronic Submissions Submit electronic comments in the following way: • Federal eRulemaking Portal: https://www.regulations.gov. Follow the instructions for submitting comments. Comments submitted electronically, including attachments, to https:// www.regulations.gov will be posted to the docket unchanged. Because your comment will be made public, you are solely responsible for ensuring that your comment does not include any confidential information that you or a third party may not wish to be posted, such as medical information, your or anyone else’s Social Security number, or confidential business information, such as a manufacturing process. Please note that if you include your name, contact information, or other information that identifies you in the body of your comments, that information will be posted on https://www.regulations.gov. • If you want to submit a comment with confidential information that you do not wish to be made available to the public, submit the comment as a written/paper submission and in the manner detailed (see ‘‘Written/Paper Submissions’’ and ‘‘Instructions’’). Submit written/paper submissions as follows: • Mail/Hand delivery/Courier (for written/paper submissions): Dockets Management Staff (HFA–305), Food and Drug Administration, 5630 Fishers Lane, Rm. 1061, Rockville, MD 20852. • For written/paper comments submitted to the Dockets Management Staff, FDA will post your comment, as well as any attachments, except for information submitted, marked and identified, as confidential, if submitted as detailed in ‘‘Instructions.’’ Instructions: All submissions received must include the Docket No. FDA– 2013–N–0370 for ‘‘Export of Medical Devices; Foreign Letters of Approval.’’ Received comments, those filed in a timely manner (see ADDRESSES), will be placed in the docket and, except for those submitted as ‘‘Confidential Submissions,’’ publicly viewable at https://www.regulations.gov or at the Dockets Management Staff between 9 a.m. and 4 p.m., Monday through Friday. • Confidential Submissions—To submit a comment with confidential information that you do not wish to be made publicly available, submit your comments only as a written/paper submission. You should submit two copies total. One copy will include the information you claim to be confidential with a heading or cover note that states ‘‘THIS DOCUMENT CONTAINS CONFIDENTIAL INFORMATION.’’ The Agency will review this copy, including the claimed confidential information, in its consideration of comments. The second copy, which will have the claimed confidential information redacted/blacked out, will be available for public viewing and posted on https://www.regulations.gov. Submit both copies to the Dockets Management Staff. If you do not wish your name and contact information to be made publicly available, you can provide this information on the cover sheet and not in the body of your comments and you must identify this information as ‘‘confidential.’’ Any information marked as ‘‘confidential’’ will not be disclosed except in accordance with 21 CFR 10.20 and other applicable disclosure law. For more information about FDA’s posting of comments to public dockets, see 80 FR 56469, September 18, 2015, or access the information at: https://www.gpo.gov/ fdsys/pkg/FR-2015-09-18/pdf/201523389.pdf. Docket: For access to the docket to read background documents or the electronic and written/paper comments received, go to https:// The Food and Drug Administration (FDA or Agency) is announcing an opportunity for public comment on the proposed collection of certain information by the Agency. Under the Paperwork Reduction Act of 1995 (PRA), Federal Agencies are required to publish notice in the Federal Register concerning each proposed collection of information, including each proposed extension of an existing collection of information, and to allow 60 days for public comment in response to the notice. This notice solicits comments on reporting requirements for firms that intend to export certain unapproved medical devices. DATES: Submit either electronic or written comments on the collection of information by May 10, 2019. ADDRESSES: You may submit comments as follows. Please note that late, untimely filed comments will not be considered. Electronic comments must be submitted on or before May 10, 2019. The https://www.regulations.gov electronic filing system will accept comments until 11:59 p.m. Eastern Time at the end of May 10, 2019. Comments received by mail/hand delivery/courier (for written/paper submissions) will be considered timely if they are postmarked or the delivery service acceptance receipt is on or before that date. PO 00000 Frm 00067 Fmt 4703 Sfmt 4703 E:\FR\FM\11MRN1.SGM 11MRN1

Agencies

[Federal Register Volume 84, Number 47 (Monday, March 11, 2019)]
[Notices]
[Pages 8721-8727]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2019-04307]


-----------------------------------------------------------------------

DEPARTMENT OF HEALTH AND HUMAN SERVICES

Food and Drug Administration

[Docket No. FDA-2018-N-0215]


Agency Information Collection Activities; Submission for Office 
of Management and Budget Review; Comment Request; Healthcare 
Professional Survey of Professional Prescription Drug Promotion

AGENCY: Food and Drug Administration, HHS.

ACTION: Notice.

-----------------------------------------------------------------------

SUMMARY: The Food and Drug Administration (FDA) is announcing that a 
proposed collection of information has been submitted to the Office of 
Management and Budget (OMB) for review and clearance under the 
Paperwork Reduction Act of 1995.

DATES: Fax written comments on the collection of information by April 
10, 2019.

ADDRESSES: To ensure that comments on the information collection are 
received, OMB recommends that written comments be faxed to the Office 
of Information and Regulatory Affairs, OMB, Attn: FDA Desk Officer, 
Fax: 202-395-7285, or emailed to oira_submission@omb.eop.gov. All 
comments should be identified with the OMB control number 0910-New and 
title, ``Healthcare Professional Survey of Professional Prescription 
Drug Promotion.'' Also include the FDA docket number found in brackets 
in the heading of this document.

FOR FURTHER INFORMATION CONTACT: Ila S. Mizrachi, Office of Operations, 
Food and Drug Administration, Three White Flint North, 10A-12M, 11601 
Landsdown St., North Bethesda, MD 20852, 301-796-7726, 
PRAStaff@fda.hhs.gov.

SUPPLEMENTARY INFORMATION: In compliance with 44 U.S.C. 3507, FDA has 
submitted the following proposed collection of information to OMB for 
review and clearance.

Healthcare Professional Survey of Professional Prescription Drug 
Promotion

OMB Control Number 0910-New

I. Background

    Section 1701(a)(4) of the Public Health Service Act (42 U.S.C. 
300u(a)(4)) authorizes FDA to conduct research relating to health 
information. Section 1003(d)(2)(C) of the Federal Food, Drug, and 
Cosmetic Act (FD&C Act) (21 U.S.C. 393(d)(2)(C)) authorizes

[[Page 8722]]

FDA to conduct research relating to drugs and other FDA regulated 
products in carrying out the provisions of the FD&C Act.
    The FD&C Act prohibits the dissemination of false or misleading 
information about medications in consumer-directed and professional 
prescription drug promotion. As part of its Federal mandate, FDA 
regulates whether advertising of prescription drug products is 
truthful, balanced, and accurately communicated (see 21 U.S.C. 352(n)). 
FDA's regulatory policies are aligned with the principles of free 
speech and due process in the U.S. Constitution. To inform current and 
future policies, and to seek to enhance audience comprehension, the 
Office of Prescription Drug Promotion conducts research focusing on (1) 
advertising features including content and format, (2) target 
populations, and (3) research quality. This proposed research focuses 
on healthcare professionals (HCPs). In 2002 (Ref. 1) and again in 2013 
(Refs. 2 and 3), FDA surveyed HCPs about their attitudes toward direct-
to-consumer (DTC) advertising and its role in their relationships with 
their patients. The 2013 survey included multiple types of HCPs: 
Primary care physicians and specialists, as well as nurse practitioners 
and physician assistants. Whereas the focus of both previous FDA 
surveys was on DTC advertising and promotion, the current study is 
designed to address issues related to professional prescription drug 
promotion. The goal is to query a representative sample of HCPs about 
their opinions of promotional materials and procedures targeted at 
HCPs, clinical trial design and knowledge, and FDA approval status. We 
will also take this opportunity to ask HCPs briefly about their 
knowledge of abuse-deterrent formulations for opioid products.
    To educate themselves about prescription drugs, HCPs sometimes rely 
on professionally directed promotional information (Refs. 4-8). In 
2012, pharmaceutical companies spent more than $24 billion on marketing 
to physicians (Ref. 9). The industry exposes healthcare professionals 
to promotional materials through a variety of mechanisms, including 
communication with pharmaceutical representatives, journal ads, 
prescribing software, presentations at sponsored meetings, and direct 
mail ads (Ref. 10). Several studies indicate that data presented in 
promotional materials may not be fully comprehended and may even 
potentially be misleading due to a variety of causes, such as 
insufficient information, unsupported claims, or a failure to disclose 
limitations of the information presented (Refs. 11-15).
    Although HCPs are learned intermediaries, like most people, they 
may rely on heuristics, or rules of thumb, in making decisions and may 
have cognitive biases in the type of information they attend to at any 
given time. They may be persuaded by strong statements and may not have 
the time to ascertain accuracy of such information (Ref. 16).
    The proposed survey is designed to provide further insights about 
how professionally targeted prescription drug promotion might influence 
healthcare professionals' decision-making processes and practices and 
how information may be communicated more accurately. It is important to 
note that FDA does not regulate the practice of medicine. However, as 
previously mentioned, FDA does regulate prescription drug promotion. 
This survey is designed to inform FDA of various responses to and 
impacts of prescription drug promotion.
    The general research questions in the survey are as follows:
    1. What methods and/or channels are used to disseminate 
prescription drug promotional information to healthcare professionals/
prescribers?
    2. How knowledgeable and interested are HCPs in clinical trial data 
and design and its presence in prescription drug promotion?
    3. How familiar are HCPs with the FDA approval of prescription 
drugs and how does this affect prescribing behavior?
    In addition, given the critical problem with opioid abuse and 
addiction in the United States at this time, we plan to ask several 
questions about prescription drug promotion of opioid products.
    HCPs who fall into one of four categories will be recruited online 
through WebMD's Medscape subscriber network. We propose to complete 700 
primary care physician, 600 specialist, 350 nurse practitioner, and 350 
physician assistant surveys. HCPs will be included if they see patients 
at least 50 percent of the time. Both Doctors of Medicine and Doctors 
of Osteopathy will be included. Primary care physicians will include 
those who indicate they work in general, family, or internal medicine. 
Specialties were chosen based on prevalence in the United States and 
prescription drug promotional activity. Specialists will include 
cardiologists, dermatologists, endocrinologists, neurologists, 
obstetrician/gynecologists, oncologists, ophthalmologists, 
psychiatrists, rheumatologists, and urologists. The data will be 
weighted to adjust for differential coverage of select characteristics 
such as region and respondent age and gender. Pretesting with 25 
respondents will take place before the main study to evaluate the 
procedures and measures used in the main study.
    In the Federal Register of March 15, 2018 (83 FR 11539), FDA 
published a 60-day notice requesting public comment on the proposed 
collection of information. Four comments were received. One comment was 
outside the scope of the research and is not addressed further. The 
remaining three comments are addressed below. For brevity, some public 
comments are paraphrased and therefore may not reflect the exact 
language used by the commenter. We assure commenters that the entirety 
of their comments was considered even if not fully captured by our 
paraphrasing in this document. The following acronyms are used here: 
DTC = direct-to-consumer; HCP = healthcare professional; FDA and ``The 
Agency'' = Food and Drug Administration; OPDP = FDA's Office of 
Prescription Drug Promotion.
    The first public comment had 19 individual comments, to which we 
have responded.
    (Comment 1a) The exact reach of the WebMD Medscape subscriber 
network among medical professionals is unclear. With this in mind, the 
study design could introduce bias by self-selecting physicians who do 
not accurately reflect the broader physician population. For example, 
they may be more reliant on internet-based information, have seen more 
web-based pharmaceutical advertisements, and be demographically 
different than physicians outside the Medscape network.
    (Response 1a) It is true that Medscape is not an exhaustive listing 
of the entire universe of HCPs, but the evidence suggests that coverage 
is high. Table 1 below documents the number of providers subscribed to 
WebMD for the four major strata of HCPs included in the study and the 
estimated population totals. The coverage is particularly good for 
primary care physicians (over 80 percent), is reasonable for 
specialists and physicians assistants (between 60 and 70 percent), and 
not as good for nurse practitioners (about 45 percent).

[[Page 8723]]



                     Table 1--Estimated Counts and Coverage by Healthcare Professional Group
----------------------------------------------------------------------------------------------------------------
                                                                                     Estimated
                  Healthcare professional group                      WebMD \1\      population       Estimated
                                                                                       total        coverage %
----------------------------------------------------------------------------------------------------------------
Primary care physicians (PCPs)..................................         197,980     \2\ 242,800            81.5
Specialists (SPs)...............................................         465,020     \2\ 724,249            64.2
Physicians assistants...........................................          62,874      \3\ 92,000            68.3
Nurse practitioners.............................................         102,552     \4\ 220,000            46.6
----------------------------------------------------------------------------------------------------------------
\1\ WebMD estimated counts of Medscape subscribers by HCP group as of July 2017.
\2\ American Medical Association (https://www.mmslists.com/data/countspdf/AMA-SpecialtyByTOPS.pdf).
\3\ Kaiser Family Foundation (https://www.kff.org/other/state-indicator/total-physician-assistants/?currentTimeframe=0&sortModel=%7B%22colId%22:%22Location%22,%22sort%22:%22asc%22%7D).
\4\ American Association of Nurse Practitioners (https://www.aanp.org/all-about-nps/np-fact-sheet).

    The Medscape frame has a smaller frequency of out-of-scope records 
(retirees, for example, who have not been dropped from the list), and 
much better contact information (including email addresses), compared 
to other possible frames. Potential frame competitors, such as the 
American Medical Association list of providers, have higher coverage of 
PCPs and SPs, but also many out-of-scope records. Sampling these 
records would lead to ineligibles in data collection. Considering both 
coverage and ineligibility rates, Medscape is of better quality than 
the alternatives. We are planning to calibrate the weights for the 
sample providers who answer the questionnaire, using the National 
Ambulatory Medical Care Survey (NAMCS) estimates as benchmarks, based 
on gender, age, year of graduation, and practice size. Use of these 
calibrated weights will guarantee that the percentages across provider 
type, gender, age, year of graduation, and practice size match the 
NAMCS percentages, which are our best unbiased estimates of the true 
population percentages. Thus, the under-coverage from the use of the 
Medscape frame will not lead to significant imbalances in the 
distribution of these characteristics which could lead to bias. 
Calibration eliminates bias-producing imbalances for cells defined by 
the calibration characteristics, but does not eliminate imbalances 
within these cells. It may be the case that within the provider type-
gender-age-graduation year-practice size cells, the Medscape population 
differs from the universe because of their self-selection into 
Medscape. This will generate coverage biases of unknown magnitude, but 
we anticipate that the size of these biases will be small as a 
component of overall mean-squared-error in this study and will not 
materially affect the analyses.
    (Comment 1b) If specialties are planned to be analyzed 
individually, the sample size should be at least 50 respondents from 
each specialty.
    (Response 1b) Our analysis plan does not include a separate full-
scale analysis for each specialty, though specialty will be included in 
the analyses as a covariate along with other provider characteristics. 
Thus, the 50-respondent minimum per specialty is not necessary given 
the goals of this study.
    (Comment 1c) We did not have access to the full screening criteria 
and have several suggestions for the criteria: a mix of age, practice 
experience, practice setting, number of patients seen each month, and 
gender.
    (Response 1c) Our screening instrument captures the suggested 
items, including age, gender, race/ethnicity, practice setting, percent 
of time seeing patients, and clinical specialty. The survey instrument 
collects information on the number of patients seen weekly and number 
of years in practice.
    (Comment 1d) Q[uestion]2 currently asks how often physicians visit 
commercial prescription drug websites. This is a broad question, and we 
suggest adding followup questions to understand why the physician went 
to the website (i.e., interested in getting specific product 
information, patient assistance program information, etc.), what 
specific information was sought (i.e., promotional information, 
educational resources, patient support services, prescribing 
information) and how helpful was the information.
    (Response 1d) Prescription drug websites are one of several 
information sources that are asked about in the survey. The primary 
goal of our questions about sources of information is to capture the 
amount of exposure or use of various information sources by HCPs. This 
may be a good avenue for further research.
    (Comment 1e) Responses to Q3 could skew towards more frequent use 
than the average prescriber since the sample is being recruited from a 
network of physicians subscribing to a reference website (WebMD 
Medscape).
    (Response 1e) We acknowledge there may be a coverage bias from the 
use of the WebMD Medscape as a frame, but do not know exactly the 
magnitudes of bias for particular items. We will document the nature of 
our frame and the potential implications of that. See response to 
comment 1a for more details on WebMD sample.
    (Comment 1f) Q7a asks respondents to gauge the influence of various 
information sources on their colleagues' prescribing decisions. Q7b 
asks about the influence of various information sources on the 
respondent's prescribing decisions. Influence is subjective and 
respondent answers to these questions are inherently unreliable. We 
suggest asking about behavior to help understand influence. If these 
questions are retained, we suggest reordering the questions.
    (Response 1f) We are interested in HCPs' perceptions of relative 
influence of different information sources. An assessment of the actual 
influence of these sources through prescribing data is beyond the scope 
of this project. This is a valuable avenue for future research. 
Moreover, this question is designed to build on research literature 
which suggests that HCPs typically rate promotional materials as being 
more influential on colleagues than on themselves (Refs. 17 and 18). 
Thus, we ask about the influence of promotional information for both 
colleagues and the respondent. We will randomize the presentation order 
of these two questions in the survey.
    (Comment 1g) For Q9-Q10, questions and answer choices are overly 
broad to provide actionable insight. For example, respondents might 
define ``information about clinical trial designs or clinical trial 
outcomes'' differently, along with what ``Some'' versus ``Lots'' of 
information represent. We suggest revising Q9 to ``Do you need more 
clinical trial design information in order to understand or interpret 
the clinical

[[Page 8724]]

trial data and outcomes presented in promotional material?'' We suggest 
revising Q10 to ``Do you need more clinical trial outcomes information 
in order to make sound clinical decisions for your patients?''
    (Response 1g) We have made some changes to these questions as a 
result of cognitive testing. For example, we replaced ``clinical trial 
design'' with ``clinical trial methodology'' and included examples of 
what is meant by methodology in parenthesis (e.g., sample, study 
design). We also changed answer choices to make them more distinct. The 
choices are now: All information, a moderate amount, a minimal amount, 
and none.
    (Comment 1h) We suggest revising Q14 into two separate questions. 
One question about the type of training (e.g. formal school, continuing 
medical education, peers) and a separate question on how much training 
in different aspects of clinical trial design the respondent completed.
    (Response 1h) We are using the question about clinical trials 
training as a covariate to other questions in the survey about clinical 
trials. Training may influence the amount of clinical trials 
information HCPs want included in promotions or their level of comfort 
with clinical trials data. We have added the word ``formal'' to the 
question to indicate that we are referring to actual training rather 
than informal discussions with colleagues.
    (Comment 1i) Q18 assumes the physician knows whether the drugs 
prescribed are approved or not approved. We suggest including a 
selection of ``Do not know.''
    (Response 1i) We will add ``Do not know'' as a response option to 
this question.
    (Comment 1j) We have concerns that Q21 fails to define what the 
Agency means by ``promotion.'' As a result, the question as phrased may 
suggest that the Agency has broader authority than delegated by 
Congress or as permitted under the First Amendment to regulate (i.e., 
``allow'') protected manufacturer speech that is truthful and non-
misleading. We suggest revising Q21 to ask respondents if they value 
the ability of pharmaceutical companies to provide truthful and non-
misleading information about their drugs for indications not approved 
by FDA.
    (Response 1j) Q21 has been deleted.
    (Comment 1k) We agree that having an option of ``not sure'' for Q22 
is appropriate since many respondents might not be familiar with this 
approval pathway. However, this could reduce the amount of information 
this question could assess. We suggest modifying the question to 
incorporate the definition of accelerated approval and then ask the 
respondent about his/her comfort level with prescribing. This approach 
would allow the survey to collect responses from the most respondents 
possible. We also suggest adding a question prior to Q22 to ask about 
familiarity or experience with an accelerated approval drug that could 
be used to assess prior behavior as well as understand how experience 
with accelerated approval impacts comfort to use.
    (Response 1k) We have purposefully not included a definition of 
accelerated approval, as we are interested in assessing comfort with 
accelerated approval based on their own understanding of the term. We 
have added an open-ended question prior to Q22 that asks respondents to 
describe what an accelerated approval drug is in their own words.
    (Comment 1l) We recommend modifying the open-ended question (Q23) 
about scientific exchange and offering respondent components for 
consideration (i.e., criteria for who is part of exchange of 
information, description for type of scientific information, 
description of context of scientific information, and the forum or 
setting where exchange of information occurs). We also recommend adding 
question(s) to understand how often respondents engage in settings 
where scientific exchange typically occurs, such as oral presentations/
poster sessions at scientific congresses, review of articles in medical 
journals, data and clinical trial summaries on clinical trial 
registries.
    (Response 1l) The goal of this open-ended question is to assess 
general awareness/understanding of the term ``scientific exchange.'' In 
cognitive testing, we found that several HCPs had never heard this term 
before. Therefore, we need to get a broader sense of general awareness, 
which may be low, before following up with more specific questions. We 
have added the option to check ``do not know'' for this question.
    (Comment 1m) The open-ended question (Q24) seeking a description of 
biosimilars will likely result in an extremely wide range of answers 
with no ability to categorize responses based on the HCP's true 
knowledge of the term. We suggest framing the question along the lines 
of how comfortable the HCP is with prescribing biosimilars, therefore, 
the responses may help correlate knowledge of the term with a greater 
comfort level in prescribing.
    (Response 1m) The goal of this open-ended question is to assess HCP 
general awareness/knowledge of biosimilars. We have added the option to 
check ``do not know'' for this question. We also plan to code open-
ended responses to determine their level of closeness to the 
established definition: a biological product that is highly similar to 
and has no clinically meaningful differences from an existing FDA-
approved reference product (42 U.S.C. 262(i)(2)). We have also added a 
close-ended question prior to Q24 to ask HCPs how comfortable they are 
prescribing biosimilars.
    (Comment 1n) For Q25-26, we recommend including ``don't know'' or 
``it depends'' as answer options for these two questions.
    (Response 1n) While some cognitive effort is required, we believe 
the scenarios included in these questions provide sufficient 
information to allow respondents to make ratings. We also note that 
during cognitive testing, respondents did not have difficulty answering 
these questions.
    (Comment 1o) For Q28, we recommend incorporating a description or 
definition of ``REMS'' materials.
    (Response 1o) We have revised the question to spell out the term, 
Risk Evaluation or Mitigation Strategy (REMS) materials.
    (Comment 1p) For Q28a, we recommend a small modification to the 
question in order to fully capture and connect to the list from the 
previous question. For example, How often do these materials or events 
mention abuse potential?
    (Response 1p) We will revise the question to include ``events.''
    (Comment 1q) We suggest adding a followup question to Q27 and Q28 
to understand the impact of education/information about opioids on 
prescribing behaviors. For example, ``Is the number of patients you 
prescribed opioids for chronic pain in the last 3 months relative to 12 
months ago: (1) the same, (2) less or (3) more?''
    (Response 1q) We have added this question to the survey.
    (Comment 1r) We suggest an additional followup question to Q27 and 
Q28 to capture how the discussion and information on opioids and abuse 
potential has changed over recent years, rather than focusing only on 
the previous 12 months. Asking a retrospective question might capture 
how the type of information physicians receive has changed as the 
critical opioid situation has gained more widespread recognition.
    (Response 1r) The proposed followup question broadens the scope of 
the survey in a way that may prevent us from collecting the most 
relevant data. To capture the element of change in practice over time, 
as suggested, we

[[Page 8725]]

have added a question to ask HCPs whether in the last year the content 
of promotional materials for opioid products have contained more or 
less information on abuse potential.
    The second public comment responder had 13 comments, to which we 
have responded.
    (Comment 2a) The public comment responder expressed concern that 
they had difficulty obtaining the proposed survey questionnaire via 
email, but acknowledged that they were able to obtain it promptly once 
they contacted the telephone number provided in the 60-day notice. 
Among other suggestions, the commenter recommended that FDA specify a 
contact that can directly provide the survey in future notices.
    (Response 2a) We appreciate the commenter bringing their experience 
to our attention. While other commenters that requested the survey did 
not report that they experienced difficulty promptly obtaining the 
survey, we take this concern very seriously. Moving forward, in 
addition to the contact information that has been provided, we will 
also include the email address of the research team, 
DTCResearch@fda.hhs.gov, in all notices to facilitate obtaining 
information collection instruments directly from the research team.
    (Comment 2b) The proposed HCP survey is duplicative of other 
information already collected by FDA, such as the previous Healthcare 
Professional Survey of Prescription Drug Promotion (HCP I survey) and a 
project referenced on the OPDP website \1\ entitled, ``Clinical Trial 
Data in Professional Prescription Drug Promotion.''
---------------------------------------------------------------------------

    \1\ https://www.fda.gov/AboutFDA/CentersOffices/OfficeofMedicalProductsandTobacco/CDER/ucm090276.htm
---------------------------------------------------------------------------

    (Response 2b) The HCP I survey was conducted 5 years ago (summer 
2013) and focused mainly on HCPs' attitudes toward DTC advertising and 
its role in their relationship with patients (Refs. 2, 3). The current 
HCP II survey focuses on promotions directed at healthcare 
professionals. The existence of some overlapping questions does not 
constitute in itself a duplicative effort, as there is often a need to 
compare responses at multiple time points for comprehensive analysis of 
the issues at hand. Many federally funded national surveys ask the same 
or similar questions at multiple time points to detect changes and 
identify trends over time.
    We also note the study referenced on the OPDP website is 
qualitative research with a small non-representative sample, so the 
design differs considerably from this proposed study. Having multiple 
studies focusing on differing aspects of a phenomenon, using differing 
designs and modes, is in accordance with OMB standards to avoid 
unnecessary duplication of research efforts.
    (Comment 2c) The commenter recommends that FDA ask questions about 
non-opioid analgesic options, medication-assisted treatment for opioid 
deterrence, and opioid overdose-reversal agents. By asking about this 
broader range of treatments, the survey would be consistent with the 
Administration's emphasis on the whole range of medical advances that 
can help address the opioid crisis.
    (Response 2c) We have added a question to address references to 
these medical advances in prescription drug promotion.
    (Comment 2d) We recommend that FDA amend Q1b to ask how closely 
HCPs read different types of advertisements (e.g., advertisement for 
new products, or for products related to the HCPs practice).
    (Response 2d) We have replaced Q1b with two questions to capture 
how closely HCPs read the suggested types of advertisements. One will 
ask about advertisements for new products and one will ask about 
advertisements for products related to the HCP's practice.
    (Comment 2e) We recommend that FDA reword Q2 to avoid the ambiguous 
term ``commercial.'' Specifically, we recommend FDA revise the question 
to read as follows: ``How often do you visit product-specific or 
manufacturer-sponsored commercial prescription drug product websites, 
such as lipitor.com?''
    (Response 2e) In cognitive testing conducted to develop this 
survey, the word ``commercial'' was easily understood by respondents 
and is needed in this question to differentiate it from ``reference'' 
websites in the subsequent question.
    (Comment 2f) We recommend that FDA include a new question under Q2 
(i.e., 2a) that is similar to 3b (i.e., that asks how closely the HCP 
usually reads the prescription drug websites it visits).
    (Response 2f) We have added this question.
    (Comment 2g) We recommend that FDA clarify whether Q5a applies only 
to in-person visits from pharmaceutical sales representatives.
    (Response 2g) During cognitive interviews, respondents had no 
difficulty understanding that question 5a was asking only about in-
person visits. However, we have revised the question to read, ``How 
often do pharmaceutical representatives bring promotional materials to 
your practice?'' to clarify that the question refers to in-person 
visits.
    (Comment 2h) We recommend that FDA delete responses 2 (``Lunch for 
staff'') and 7 (``Personal use item'') from Q5b. It is not clear how 
these topics relate to FDA's jurisdiction. Other agencies of the 
Department of Health and Human Services, not FDA, regulate such 
practices. In addition, these responses do not seem to fall within the 
stated scope of the survey.
    (Response 2h) We have made a minor change to this question by 
replacing ``lunch for staff'' with ``food and beverages.'' The survey 
includes questions about the various types of prescription drug 
promotions and promotional practices that HCPs might be exposed to. To 
fully understand promotional practices, we also need to know what 
pharmaceutical representatives provide HCPs during an in-person visit.
    (Comment 2i) We recommend that FDA clarify what is meant by the 
term ``conference'' in Q6.
    (Response 2i) We have revised the survey to ask separate questions 
about ``pharmaceutical dinner meetings'' and ``professional 
conferences.'' This distinction should make the meaning of professional 
conference clear.
    (Comment 2j) We recommend deleting Q7, as it asks HCPs to speculate 
about colleagues' perception of promotional materials.
    (Response 2j) This question is designed to build on research 
literature which suggests that HCPs typically rate promotional 
materials as being more influential on colleagues than on themselves 
(Refs. 17, 18). Thus, we ask about the influence of promotional 
information for both colleagues and the respondent. We will randomize 
the presentation order of these two questions in the survey.
    (Comment 2k) We recommend that response 3 for Q8 be amended to 
identify both the number and type of trials: ``Number and type of 
trials conducted.''
    (Response 2k) Including number and type of trials conducted as one 
response option will be confusing for respondents and we believe that 
type of trial is captured by the second response option: ``Study design 
(e.g., blinded or not, cohort study, length of trial, etc.).''
    (Comment 2l) We recommend adding the following language to Q18 to 
ensure consistent use throughout the survey: ``How often do you 
prescribe a drug for conditions for which it is not approved (referred 
to as unapproved use below)?'' We also recommend amending Q20 to use 
the term ``unapproved use'' instead of ``off-label use,'' to correspond 
with

[[Page 8726]]

question 19 and ensure consistent terminology throughout the survey.
    (Response 2l) We determined through cognitive testing that HCPs are 
familiar with and use the term off-label use. The questions have been 
revised to use ``off-label use'' for all three questions.
    (Comment 2m) We recommend deleting Q21, as HCPs perspectives on 
whether promotion of unapproved uses should be allowed presumes that 
HCPs know the existing regulatory framework. Moreover, the relevancy of 
this question is unclear given the stated research goals.
    (Response 2m) We have deleted this question.
    (Comment 2n) Q31 asks about the respondent's Secondary Specialty. 
However, it is not clear from the survey if and where Primary Specialty 
is recorded; we recommend amending the survey to clearly identify the 
respondent's Primary Specialty.
    (Response 2n) Primary specialty is asked in the screener. We have 
removed the question about ``secondary specialty'' from the survey.
    The third public comment responder had one comment, to which we 
have responded.
    (Comment 3a) We suggest adding questions to the survey about how 
promotional materials and procedures address abuse deterrent 
formulations (ADF) for opioid products. Specifically, we suggest adding 
questions related to the following topic areas to assess HCPs' 
knowledge and understanding of these areas:
     That ADF products have not proven any less addictive than 
standard non-ADF formulations.
     That the potential for patient harm from dose-dependent 
misuse of ADF products (e.g., adverse effects resulting from patients 
taking higher doses of the product than prescribed) or for patients 
that switch to non-prescribed drugs (e.g., heroin) still remains.
     That potential methods for defeating the ``tamper-proof'' 
formulation still exist.
     That there are effective ways to protect against 
accidental ingestion of the drug or theft by others.
    (Response 3a) We address the first bullet in question 28c. Various 
aspects of the remaining bullets are addressed in question 28d. 
Although the specific points mentioned in this comment are important 
public health messages, we think these questions are more appropriate 
for an indepth study of the topic, which is beyond the scope of this 
project. Please also see our responses to Comments 1r and 2c.
    FDA estimates the burden of this collection of information as 
follows:

                                                     Table 2--Estimated Annual Reporting Burden \1\
--------------------------------------------------------------------------------------------------------------------------------------------------------
                                                                 Number of
                  Activity                       Number of     responses per   Total annual           Average burden per response           Total hours
                                                respondents     respondent       responses
--------------------------------------------------------------------------------------------------------------------------------------------------------
Pretest Study:
    HCP screener............................              63               1              63  0.08 (5 minutes)..........................               5
    Informed Consent........................              25               1              25  0.08 (5 minutes)..........................               2
    HCP Survey..............................              25               1              25  0.33 (20 minutes).........................               8
Main Study:
    HCP screener............................           5,037               1           5,037  0.08 (5 minutes)..........................             403
    Informed Consent........................           2,000               1           2,000  0.08 (5 minutes)..........................             160
    HCP Survey..............................           2,000               1           2,000  0.33 (20 minutes).........................             660
                                             -----------------------------------------------------------------------------------------------------------
        Total...............................  ..............  ..............  ..............  ..........................................           1,238
--------------------------------------------------------------------------------------------------------------------------------------------------------
\1\ There are no capital costs and maintenance costs associated with this collection of information.

II. References

    The following references marked with an asterisk (*) are on display 
at the Dockets Management Staff, OC/Office of Executive Secretariat, 
Food and Drug Administration, 5630 Fishers Lane, Rm. 1061, Rockville, 
MD 20857 and are available for viewing by interested persons between 9 
a.m. and 4 p.m., Monday through Friday; they are also available 
electronically at https://www.regulations.gov. References without 
asterisks are not on public display at https://www.regulations.gov 
because they have copyright restrictions. Some may be available at the 
website address, if listed. References without asterisks are available 
for viewing only at the Dockets Management Staff. FDA has verified the 
website addresses, as of the date this document publishes in the 
Federal Register, but websites are subject to change over time.

*1. Available at: https://www.fda.gov/AboutFDA/CentersOffices/OfficeofMedicalProductsandTobacco/CDER/ucm090276.htm. Last accessed 
February 6, 2019.
2. Betts, K.R., A.C. O'Donoghue, K.J. Aikin, et al. (2016). 
``Healthcare Professional Social Media Membership and Participation: 
Findings From a Nationally Representative Sample,'' Journal of the 
American Association of Nurse Practitioners. Doi: 10.1002/2327-
6924.12383.
3. O'Donoghue, A.C., V. Boudewyns, K.J. Aikin, et al. (2015). 
``Awareness of FDA's Bad Ad Program and Education Regarding 
Pharmaceutical Advertising: A National Survey of Prescribers in 
Ambulatory Care Settings,'' Journal of Health Communication, vol. 
20(11), pp. 1330-1336.
4. Crigger, N.J. (2005). ``Pharmaceutical Promotions and Conflict of 
Interest in Nurse Practitioner's Decision Making: The Undiscovered 
Country,'' Journal of the American Academy of Nurse Practitioners, 
vol. 17(6), pp. 207-212.
5. Fischer, M. ., M.E. Keough, J.L. Baril, et al. (2009). 
``Prescribers and Pharmaceutical Representatives: Why Are We Still 
Meeting?'' Journal of General Internal Medicine, vol. 24(7), pp. 
795-801.
6. C. Robertson, S. Rose, and A.S. Kesselheim (2012). ``Effect of 
Financial Relationships on the Behaviors of Health Care 
Professionals: A Review of the Evidence,'' The Journal of Law, 
Medicine & Ethics, vol. 40(3), pp. 452-466.
7. Srivastava, V., M. Handa, and A. Vohra (2014). ``Promotional 
Tools: Do Physicians Really Bite the Hook?'' Drishtikon: A 
Management Journal, vol. 5(2).
8. Austad, K.E., J. Avorn, J.M. Franklin, et al. (2014). 
``Association of Marketing Interactions With Medical Trainees' 
Knowledge About Evidence-Based Prescribing: Results From a National 
Survey,'' JAMA Internal Medicine, vol. 174(8), pp. 1283-1290.
*9. Cegedim Strategic Data (2013). ``2012 U.S. Pharmaceutical 
Company Promotion Spending.'' Available at: https://www.skainfo.com/health_care_market_reports/2012_promotional_spending.pdf.
10. Spurling, G.K., P.R. Mansfield, B.D. Montgomery, et al. (2010). 
``Information From Pharmaceutical Companies and the Quality, 
Quantity, and Cost of Physicians' Prescribing: A Systematic 
Review,'' PLoS Medicine, vol. 7(10), e1000352. doi: 10.1371/
jounal.pmed.

[[Page 8727]]

1000352.
11. Villanueva, P., S. Peir[oacute], J. Librero, et al. (2003). 
``Accuracy of Pharmaceutical Advertisements in Medical Journals,'' 
Lancet, vol. 361(9351), pp. 27-32.
12. Cooper, R.J. and D.L. Schriger (2005). ``The Availability of 
References and the Sponsorship of Original Research Cited in 
Pharmaceutical Advertisements,'' Canadian Medical Association 
Journal, vol. 172(4), pp. 487-491.
13. Jureidini, J.N., L.B. McHenry, and P.R. Mansfield (2008). 
``Clinical Trials and Drug Promotion: Selective Reporting of Study 
329,'' International Journal of Risk & Safety in Medicine, vol. 
20(1-2), pp. 73-81.
14. Garcia-Retamero, R. and M. Galesic (2010). ``Who Profits From 
Visual Aids: Overcoming Challenges in People's Understanding of 
Risks,'' Social Science & Medicine, vol. 70(7), pp. 1019-1025.
15. Cooper, R.J., D.L. Schriger, R.C. Wallace, et al. (2003). ``The 
Quantity and Quality of Scientific Graphs in Pharmaceutical 
Advertisements,'' Journal of General Internal Medicine, vol. 18(4), 
pp. 294-297.
16. Sah, S. and A. Fugh-Berman (2013). ``Physicians Under the 
Influence: Social Psychology and Industry Marketing Strategies,'' 
The Journal of Law, Medicine & Ethics, vol. 41(3), pp. 665-672. doi: 
10.1111/jlme.12076.
17. Carroll, A.E., R.C. Vreeman, J. Buddenbaum, et al. (2007). ``To 
What Extent Do Educational Interventions Impact Medical Trainees' 
Attitudes and Behaviors Regarding Industry Trainee and Industry-
Physician Relationships?'' Pediatrics, 120, e1528-e1535. 
doi:10.1542/peds.2007-0363.
18. Crigger, N., K. Barnes, A. Junko, et al. (2009). ``Nurse 
Practitioners' Perceptions and Participation in Pharmaceutical 
Marketing,'' Journal of Advanced Nursing, 65, 525-533. doi: 10.1111/
j.1365-2648.2008.04911.x.

    Dated: March 5, 2019.
Lowell J. Schiller,
Acting Associate Commissioner for Policy.
[FR Doc. 2019-04307 Filed 3-8-19; 8:45 am]
 BILLING CODE 4164-01-P
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.