Energy Conservation Program: Test Procedures for Cooking Products, Notification of Petition for Rulemaking, 17944-17961 [2018-08641]
Download as PDF
17944
Proposed Rules
Federal Register
Vol. 83, No. 80
Wednesday, April 25, 2018
This section of the FEDERAL REGISTER
contains notices to the public of the proposed
issuance of rules and regulations. The
purpose of these notices is to give interested
persons an opportunity to participate in the
rule making prior to the adoption of the final
rules.
DEPARTMENT OF ENERGY
10 CFR Parts 429 and 430
Energy Conservation Program: Test
Procedures for Cooking Products,
Notification of Petition for Rulemaking
Office of Energy Efficiency and
Renewable Energy, Department of
Energy.
ACTION: Notification of petition for
rulemaking; request for comment.
AGENCY:
On March 26, 2018, the
Department of Energy (DOE) received a
petition from the Association of Home
Appliance Manufacturers (AHAM) to
withdraw, and immediately stay the
effectiveness of, the conventional
cooking top test procedure. Through
this notification, DOE seeks comment
on the petition, as well as any data or
information that could be used in DOE’s
determination whether to proceed with
the petition.
DATES: Written comments and
information are requested on or before
June 25, 2018.
ADDRESSES: Interested persons are
encouraged to submit comments,
identified by ‘‘Test Procedure Cooking
Products Petition,’’ by any of the
following methods:
Federal eRulemaking Portal: https://
www.regulations.gov. Follow the
instructions for submitting comments.
Email: CookProducts2018TP0004@
ee.doe.gov. Include the docket number
and/or RIN in the subject line of the
message.
Mail: Appliance and Equipment
Standards Program, U.S. Department of
Energy, Building Technologies Office,
Mailstop EE–5B, 1000 Independence
Avenue SW, Washington, DC 20585–
0121. If possible, please submit all items
on a compact disc (CD), in which case
it is not necessary to include printed
copies.
Hand Delivery/Courier: Appliance
and Equipment Standards Program, U.S.
Department of Energy, Building
Technologies Office, 950 L’Enfant Plaza
SW, Suite 600, Washington, DC 20024.
daltland on DSKBBV9HB2PROD with PROPOSALS
SUMMARY:
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
Telephone: (202) 586–6636. If possible,
please submit all items on a CD, in
which case it is not necessary to include
printed copies.
Docket: For access to the docket to
read background documents, or
comments received, go to the Federal
eRulemaking Portal at https://
www.regulations.gov.
FOR FURTHER INFORMATION CONTACT:
Celia Sher, U.S. Department of Energy,
Office of the General Counsel, 1000
Independence Avenue SW, Washington,
DC 20585. E-mail: Celia.Sher@
hq.doe.gov; (202) 287–6122.
SUPPLEMENTARY INFORMATION: The
Administrative Procedure Act (APA), 5
U.S.C. 551 et seq., provides among other
things, that ‘‘[e]ach agency shall give an
interested person the right to petition
for the issuance, amendment, or repeal
of a rule.’’ (5 U.S.C. 553(e)) DOE
received a petition from AHAM, as
described in this document and set forth
verbatim below,1 requesting that DOE
reconsider its final rule on Test
Procedures for Cooking Products,
Docket No. EERE–2012–BT–TP–0013,
RIN 1904–AC71, 81 FR 91418 (Dec. 16,
2016) (Final Rule). In promulgating this
petition for public comment, DOE is
seeking views on whether it should
grant the petition and undertake a
rulemaking to consider the proposal
contained in the petition. By seeking
comment on whether to grant this
petition, DOE takes no position at this
time regarding the merits of the
suggested rulemaking or the assertions
in AHAM’s petition.
In its petition, AHAM requests that
DOE undertake rulemaking to withdraw
the cooking top test procedure, while
maintaining the repeal of the oven test
procedure that was part of the Final
Rule. And, in the interim, AHAM seeks
an immediate stay of the effectiveness of
the Final Rule, including the
requirement that manufacturers use the
final test procedure to make energy
related claims. Should DOE continue to
pursue a revised cooking top test
procedure, AHAM asserts that DOE
should address repeatability and
reproducibility and demonstrate,
through round robin testing, that the test
is repeatable and reproducible and, for
gas cooking tops, accurate. AHAM
1 Attachments and data submitted by AHAM with
its petition for rulemaking are available in the
docket at https://www.regulations.gov/
docket?D=EERE-2018-BT-TP-0004.
PO 00000
Frm 00001
Fmt 4702
Sfmt 4702
claims that its analyses show that the
test procedure is not representative for
gas cooking tops and, for gas and
electric cooking tops, has such a high
level of variation it will not produce
accurate results for certification or
enforcement purposes and will not
assist consumers in making purchasing
decisions based on energy efficiency.
Although DOE welcomes comments
on any aspect of the petition for
reconsideration, DOE is particularly
interested in receiving comments and
views of interested parties concerning
the following issues:
(1) The repeatability and
reproducibility of the test procedure for
conventional electric and gas cooking
tops. DOE previously presented results
from round robin testing completed by
the Department and by IEC in the docket
of the test procedure rulemaking. DOE
seeks comments on that data as well as
the new data AHAM has supplied
supporting its petition;
(2) The accuracy of determining the
simmer setting and turndown
temperature;
(3) The impact of heating element
cycling during the initial heat-up phase
of testing on the overall measured
energy consumption of electric cooking
tops, and the prevalence of such cycling
in units available on the market.
(4) The extent of any warpage which
may have been observed at the bottom
surface of test vessels during cooking
top testing;
(5) The impact of varying gas burner
and grate systems on the
representativeness of the water-heating
test method for gas cooking tops;
(6) The type of control system, heating
element, and other product redesigns
necessitated by changes in safety
standards for electric cooking tops, and
the impact of these new product designs
on the repeatability, reproducibility,
and representativeness of the electric
cooking product test procedure;
(7) Characteristics of a representative
test sample for electric and gas cooking
tops for use in any additional round
robin testing to evaluate the
applicability of the test procedure to the
conventional cooking top market as a
whole;
(8) Information on how consumers
cook differently on gas cooktops versus
electric cooktops;
(9) Information on how consumers
use the simmer setting on a gas cooktop;
and,
E:\FR\FM\25APP1.SGM
25APP1
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
(10) The test burden associated with
the test procedure for conventional
electric and gas cooking tops, including
the ability of testing laboratories to meet
the required ambient test conditions.
Submission of Comments
DOE invites all interested parties to
submit in writing by June 25, 2018
comments and information regarding
this petition.
Submitting comments via https://
www.regulations.gov. The https://
www.regulations.gov web page will
require you to provide your name and
contact information prior to submitting
comments. Your contact information
will be viewable to DOE Building
Technologies staff only. Your contact
information will not be publicly
viewable except for your first and last
names, organization name (if any), and
submitter representative name (if any).
If your comment is not processed
properly because of technical
difficulties, DOE will use this
information to contact you. If DOE
cannot read your comment due to
technical difficulties and cannot contact
you for clarification, DOE may not be
able to consider your comment.
However, your contact information
will be publicly viewable if you include
it in the comment or in any documents
attached to your comment. Any
information that you do not want to be
publicly viewable should not be
included in your comment, nor in any
document attached to your comment.
Persons viewing comments will see only
first and last names, organization
names, correspondence containing
comments, and any documents
submitted with the comments.
Do not submit to https://
www.regulations.gov information for
which disclosure is restricted by statute,
such as trade secrets and commercial or
financial information (hereinafter
referred to as Confidential Business
Information (CBI)). Comments
submitted through https://
www.regulations.gov cannot be claimed
as CBI. Comments received through the
website will waive any CBI claims for
the information submitted. For
information on submitting CBI, see the
Confidential Business Information
section.
DOE processes submissions made
through https://www.regulations.gov
before posting. Normally, comments
will be posted within a few days of
being submitted. However, if large
volumes of comments are being
processed simultaneously, your
comment may not be viewable for up to
several weeks. Please keep the comment
tracking number that https://
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
www.regulations.gov provides after you
have successfully uploaded your
comment.
Submitting comments via hand
delivery, or mail. Comments and
documents via hand delivery or mail
will also be posted to https://
www.regulations.gov. If you do not want
your personal contact information to be
publicly viewable, do not include it in
your comment or any accompanying
documents. Instead, provide your
contact information on a cover letter.
Include your first and last names, email
address, telephone number, and
optional mailing address. The cover
letter will not be publicly viewable as
long as it does not include any
comments.
Include contact information in your
cover letter each time you submit
comments, data, documents, and other
information to DOE. If you submit via
mail or hand delivery, please provide all
items on a CD, if feasible. It is not
necessary to submit printed copies. No
facsimiles (faxes) will be accepted.
Comments, data, and other
information submitted electronically
should be provided in PDF (preferred),
Microsoft Word or Excel, WordPerfect,
or text (ASCII) file format. Provide
documents that are not secured, written
in English and free of any defects or
viruses. Documents should not include
any special characters or any form of
encryption and, if possible, they should
carry the electronic signature of the
author.
Campaign form letters. Please submit
campaign form letters by the originating
organization in batches of between 50 to
500 form letters per PDF or as one form
letter with a list of supporters’ names
compiled into one or more PDFs. This
reduces comment processing and
posting time.
Confidential Business Information.
According to 10 CFR 1004.11, any
person submitting information that he
or she believes to be confidential and
exempt by law from public disclosure
should submit via email, postal mail, or
hand delivery two well-marked copies:
One copy of the document marked
confidential including all the
information believed to be confidential,
and one copy of the document marked
non-confidential with the information
believed to be confidential deleted.
Submit these documents via email or on
a CD, if feasible. DOE will make its own
determination about the confidential
status of the information and treat it
according to its determination.
Factors of interest to DOE when
evaluating requests to treat submitted
information as confidential include (1) a
description of the items, (2) whether
PO 00000
Frm 00002
Fmt 4702
Sfmt 4702
17945
and why such items are customarily
treated as confidential within the
industry, (3) whether the information is
generally known by or available from
other sources, (4) whether the
information has previously been made
available to others without obligation
concerning its confidentiality, (5) an
explanation of the competitive injury to
the submitting person which would
result from public disclosure, (6) when
such information might lost its
confidential character due to the
passage of time, and (7) why disclosure
of the information would be contrary to
the public interest.
It is DOE’s policy that all comments
may be included in the public docket,
without change and as received,
including any personal information
provided in the comments (except
information deemed to be exempt from
public disclosure).
DOE considers public participation to
be a very important part of its process
for considering rulemaking petitions.
DOE actively encourages the
participation and interaction of the
public during the comment period.
Interactions with and between members
of the public provide a balanced
discussion of the issues and assist DOE
in determining how to proceed with a
petition. Anyone who wishes to be
added to DOE mailing list to receive
future notifications and information
about this petition should contact
Appliance and Equipment Standards
Program staff at (202) 586–6636 or via
email at CookProducts2018TP0004@
ee.doe.gov.
Approval of the Office of the Secretary
The Secretary of Energy has approved
publication of this notification of
petition for rulemaking.
Signed in Washington, DC, on April 18,
2018.
Daniel Simmons,
Principal Deputy Assistant Secretary, Energy
Efficiency and Renewable Energy.
Before the
UNITED STATES DEPARTMENT OF
ENERGY
Office of Energy Efficiency and
Renewable Energy
In the Matter of: Energy Conservation
Program: Test Procedures for Cooking
Products
Docket No. EERE–2012–BT–TP–0013
RIN 1904–AC71
PETITION FOR
RECONSIDERATION
The Association of Home Appliance
Manufacturers (AHAM) respectfully
E:\FR\FM\25APP1.SGM
25APP1
17946
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
petitions the Department of Energy
(DOE) for reconsideration of its final
rule on Test Procedures for Cooking
Products, Docket No. EERE–2012–BT–
TP–0013 RIN 1904–AC71, 81 Fed. Reg.
91418 (Dec. 16, 2016) (Final Rule).
AHAM believes that, overall, the
adoption of a water-boil test procedure
for cooking products is the appropriate
procedure. And we thank DOE for
making changes to its earlier proposed
test procedure which would have used
a hybrid block after AHAM
demonstrated the practical difficulties
associated with that test. But DOE
adopted a final cooktop test procedure
too hastily, especially in light of
comments AHAM submitted that
demonstrated the test’s lack of
repeatability and reproducibility and
questioned the use of a test procedure
meant for electric cooktops for gas
cooktops. AHAM has evaluated the
Final Rule and conducted additional
testing on gas cooktops. Our analyses
show that the test procedure is not
representative for gas cooktops and, for
gas and electric cooktops, has such a
high level of variation it will not
produce accurate results for
certification or enforcement purposes
and will not assist consumers in making
purchasing decisions based on energy
efficiency.
AHAM thus requests that DOE
withdraw the cooktop test procedure.
And, in the interim, we seek an
immediate stay of the effectiveness,
including the requirement that
manufacturers use the final test
procedure to make energy related
claims, of the cooktop test procedure.
Should DOE continue to pursue an
improved cooktop test procedure, DOE
should address repeatability and
reproducibility and demonstrate,
through round robin testing, that the test
is repeatable and reproducible and, for
gas cooktops, representative.
FACTS
DOE began revisions to the cooktop
test procedure with a notice of proposed
rulemaking on January 30, 2013
(January 2013 NOPR) in which DOE
proposed amendments to Appendix I to
subpart B of 10 C.F.R. part 430
(Appendix I) that would allow for the
measuring of active mode energy
consumption of induction cooking
products. Specifically, DOE proposed to
require the use of test equipment—
hybrid test blocks comprised of an
aluminum body and a stainless steel
base—compatible with induction
technology.
AHAM objected to DOE’s proposed
amendments to the test procedure
because the amendments did not
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
enhance the accuracy and/or
representativeness of the test procedure.
See AHAM Comments on DOE’s Notice
of Proposed Rulemaking on Test
Procedures for Conventional Cooking
Products With Induction Heating
Technology (April 15, 2013). AHAM
commented that any test procedure DOE
adopts to measure induction heating
technology must be both repeatable and
reproducible. Id. AHAM cautioned that
significant further study was necessary
before DOE could adopt a test procedure
that accurately measures induction
cooktop energy efficiency. Id. More
specifically, AHAM opposed the
proposed test procedure because the
proposal had a number of technical
problems and ambiguities (e.g.,
ambiguous construction of hybrid test
block); DOE’s data did not clearly
identify one method (test block versus
water heating) as being preferable to the
other for induction units; and the
proposed procedure would treat
induction technology differently than
other technologies, thereby penalizing
it. Id. AHAM also questioned whether
the test block method in general was
representative of actual consumer use.
Id.
In response to stakeholder comments,
DOE published a supplemental notice of
proposed rulemaking modifying its
proposal. 79 Fed. Reg. 71894 (Dec. 3,
2014) (December 2014 SNOPR). DOE’s
modified proposal maintained a hybrid
test block approach despite AHAM’s
comments. DOE proposed to add a layer
of thermal grease between the stainless
steel base and aluminum body of the
hybrid test block to facilitate heat
transfer between the two pieces, and
DOE proposed additional test
equipment for electric surface units
with large diameters and gas cooking
top burners with high input rates.
AHAM’s comments on the December
2014 SNOPR raised serious concerns
about the hybrid test blocks and the
thermal grease. See AHAM Comments
on DOE’s Supplemental Notice of
Proposed Rulemaking on Test
Procedures for Conventional Cooking
Products (Feb. 2, 2015). AHAM also
raised questions about the testing of
flexible cooking zone areas, testing units
with flexible concentric burner sizes,
and the use of the smallest dimension
of a noncircular electric surface unit to
determine block size. Id.
Based on comments it received in
response to the December 2014 SNOPR
and a series of manufacturer interviews
DOE conducted in February and March
2015, DOE subsequently withdrew its
proposal for testing conventional
cooktops with a hybrid test block in yet
another supplemental notice of
PO 00000
Frm 00003
Fmt 4702
Sfmt 4702
proposed rulemaking. 81 Fed. Reg.
57374 (Aug. 22, 2016) (August 2016
SNOPR). In the August 2016 SNOPR,
DOE instead proposed to modify its
procedure to incorporate by reference
the relevant sections of EN 60350–
2:2013 ‘‘Household electric cooking
appliances Part 2: Hobs—Methods for
measuring performance,’’ which uses a
water-heating test method to measure
energy consumption of electric
cooktops. Despite the fact that the EN
test procedure DOE cited applies only to
electric cooktops, DOE also proposed to
extend that method to gas cooktops.
AHAM generally agreed and
continues to agree with DOE that the
best test method for cooktops is a water
boil test and supported DOE’s
abandoning of the hybrid test block
method. See AHAM Comments on
DOE’s SNOPR on Test Procedures for
Cooking Products (Sept. 21, 2016).
Nevertheless, AHAM commented
extensively on potential sources of
variation with DOE’s proposed
procedure that needed to be resolved
before DOE finalized a cooktop test
procedure. Id.
Prior to DOE proposing a waterheating test, AHAM conducted a round
robin based on the Second Edition of
IEC 60350–2 (2015), Household Electric
Cooking Appliances—Part 2: Hobs—
Methods for Measuring Performance. Id.
The AHAM round robin consisted of
four units encompassing a different
combination of controls and heating
elements. Id. AHAM assessed radiant,
coil, and induction heating elements as
well as infinite and step controls.
Participating labs performed at least
three full tests on the three electric
technologies. The results demonstrated
that the procedure was not reproducible
from lab to lab. AHAM data
demonstrated significant variation in
the proposed test procedure—
coefficients of variation of 9.2 percent
for electric radiant cooktops, 7.1 percent
for electric coil cooktops, and 8.4
percent for induction cooktops. Id.
Based on that testing, AHAM
commented that a significant amount of
work remained to be done to finalize a
test and to demonstrate that the final
test is repeatable and reproducible. Id.
Specifically, AHAM listed a number of
items that needed to be resolved,
including several potential sources of
test procedure variation, before DOE
could finalize the test procedure, and
requested that DOE issue a notice of
data availability or supplemental notice
of proposed rulemaking to provide
stakeholders with an opportunity to
comment:
• Lack of a tolerance on staying ‘‘as
close as possible’’ to 90° C;
E:\FR\FM\25APP1.SGM
25APP1
daltland on DSKBBV9HB2PROD with PROPOSALS
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
• Variability in energy consumption
during the simmering phase;
• Variability in determining the turn
down temperature;
• Variability in determining the turn
down setting;
• Unit cycling;
• Specifying a temperature sensor for
measuring the water temperature;
• A proposal to use a moving average
for calculating the final result;
• Limited suppliers of test pots;
• No tool or tolerance specified for
cooktop diameter measurement;
• Test pots do not accommodate all
grate designs;
• Difficulty with placement of pots on
gas cooktops;
• Impact of gas burner system,
geometry, spacing, and grates on
repeatability and reproducibility;
• Impact of using the electric test pots
on gas cooktops; and
• Overshoot temperature of the water
can reach beyond 90° C for some gas
cooktops. Id.
AHAM also requested that DOE indicate
how the changes to the test procedure
would impact the proposed standards
and allow stakeholders additional time
to comment on those proposed
standards based on the test procedure
changes. Id.
In response to AHAM’s comments,
DOE sent AHAM a request for data on
September 27, 2016. That data request
was voluminous and overlapped with
the comment period on the proposed
standards for cooking products—which
ended on November 2, 2016—and DOE
proposed in parallel with the August
2016 SNOPR. See Energy Conservation
Program: Energy Conservation
Standards for Residential Conventional
Cooking Products, Supplemental Notice
of Proposed Rulemaking; 81 Fed Reg.
60784 (Sept. 2, 2016). Nevertheless,
AHAM worked to answer DOE’s
questions and, on November 23, 2016,
filed a detailed response, including a
significant amount of raw data DOE
requested which AHAM submitted to
Navigant Consulting under a
confidentiality agreement. See AHAM
Comments on DOE’s SNOPR on Test
Procedures for Cooking Products (dated
Nov. 22, 2016).1 AHAM informed DOE
in advance that it would be submitting
the response. Despite having asked for
that data and having been informed
AHAM would be providing it, DOE
issued a final test procedure on that
same day, November 23, 2016, which it
published on December 16, 2016.
The Final Rule adopted DOE’s
proposed test procedure with some
1 We hereby incorporate into this petition by
reference all data AHAM submitted to DOE and
Navigant as part of the test procedure rulemaking.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
changes DOE believed would improve
repeatability and reproducibility. In
support of the final test procedure, DOE
conducted additional testing. DOE
conducted testing of five electric
cooktops incorporating different heating
technologies and control types. For each
unit, DOE conducted testing on surface
units capturing a range of heating
element sizes. DOE conducted two to
three tests per surface unit. For each
individual test, DOE performed the full
surface unit test method, including the
preliminary test required to determine
the turndown temperature and
simmering setting for a given surface
unit. DOE varied test operators for
surface unit tests, but did not conduct
testing in different laboratories. In
addition, DOE included test results from
previous tests of these units conducted
in support of the August 2016 SNOPR.
DOE relied on that minimal data to
determine that the final test procedure,
finalized only two months after DOE
received voluminous comments from
AHAM concerning a lack of
repeatability and reproducibility as
demonstrated through 27 tests on three
units at three different laboratories.
ARGUMENT
The Energy Policy and Conservation
Act of 1975, as amended (EPCA)
requires that test procedures be
reasonably designed to produce test
results which measure energy
efficiency, energy use, or estimated
annual operating cost of a covered
product during a representative average
use cycle and shall not be unduly
burdensome to conduct. 42 U.S.C.
§ 6293(b)(3). This requirement is
meaningless if the test procedure is not
repeatable and reproducible—only a
repeatable and reproducible test
procedure can produce accurate results
that DOE can rely on for certification
and verification purposes and that
consumers can rely on to compare
energy use or efficiency across products.
AHAM appreciates that DOE made
changes from the August 2016 SNOPR
to the Final Rule in an attempt to
address AHAM’s September 21, 2016
comments. AHAM also appreciates that
DOE conducted additional testing to
further assess the proposed and final
test procedure. But DOE did not take the
time or do the work necessary to finalize
a test procedure that fully or
satisfactorily addresses the significant
issues AHAM raised in its comments or
the data AHAM provided in response to
DOE’s request. This is further
demonstrated based on additional
testing and analysis AHAM conducted
after the Final Rule was published.
PO 00000
Frm 00004
Fmt 4702
Sfmt 4702
17947
DOE did not support the Final Rule
with sufficient data to demonstrate that
it is accurate, repeatable, and
reproducible. More specifically, as
discussed more fully below:
b DOE has not demonstrated that the
test procedure is representative for gas
products. DOE did not demonstrate that
its deviation from the international
approach—testing gas cooktops using a
different procedure than is used for
testing electric cooktops—was
warranted or would produce accurate,
representative results. And DOE tested
only a small sample that cannot be
representative of the many different
types of gas models on the market and
the result is that the test may not
adequately address the different systems
available to consumers. Thus, DOE has
not demonstrated that the test procedure
is representative or accurate for gas
products.
b DOE’s testing of electric and gas
cooktops was insufficient to evaluate
repeatability and reproducibility and,
thus, DOE’s conclusions are based on
results with a low confidence level
which is highlighted by AHAM’s
conflicting results. Accordingly, DOE
did not produce sufficient evidence to
demonstrate that its test procedure is
supported by data.
b Although DOE tried to address
variation by requiring recording of the
simmering setting selection, AHAM’s
testing demonstrates that that
requirement does not in fact reduce
variation.
b Although DOE attempted to clarify
when the simmering period starts,
DOE’s clarification does not adequately
reduce variation.
b DOE improperly dismissed unit
cycling’s contribution to variation.
b DOE did not account for the fact
that electric coil cooktops are currently
undergoing significant redesign to
comply with voluntary safety standards.
It is possible that the new products will
not respond the same way to the test.
b DOE did not investigate the impact
of pan warpage on test results. Initial
data from a study done for AHAM
shows pan warpage will contribute to
variation.
b Based on data from a round robin
AHAM conducted with gas cooktops,
the test procedure is not repeatable or
reproducible for gas cooktops. Within
unit and between unit variation also
contributes to the total variation and
DOE has not accounted for it.
In addition, the test procedure is
unduly burdensome to conduct. Based
on AHAM’s experience to date, it takes
on average 20 hours to conduct a single
test on a four burner cooktop and
requires the testing of every single
E:\FR\FM\25APP1.SGM
25APP1
17948
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
burner or element individually. And,
because the test requires the technician
to determine the turn-down temperature
before every test and the ambient
conditions are quite tight, several runs
are often required before a valid run can
be achieved. Our testing, which is
described more fully below, found that
some tests took upward of five days for
a single cooktop. Moreover, the test cost
is much higher than DOE concluded in
its Final Rule on both an up-front and
ongoing basis.
Because the final test procedure may
not be representative for gas products
and is not repeatable or reproducible for
either gas or electric cooktops, it does
not accurately measure cooktop energy
efficiency and will not allow consumers
to compare products on that basis. Thus,
because the test is also unduly
burdensome to conduct, the cooktop test
procedure as a whole does not meet
EPCA’s statutory requirement that test
procedures be reasonably designed to
produce representative results and are
not unduly burdensome to conduct.
Moreover, because DOE did not support
the conclusions in the Final Rule with
sufficient data, DOE’s Final Rule could
be determined to be arbitrary and
capricious. Accordingly, AHAM
respectfully requests that DOE withdraw
the Final Rule amending the cooktop
test procedure. And, in the interim, we
seek an immediate stay of the
effectiveness, including the requirement
that manufacturers use the final test
procedure to make energy related
claims, of the Final Rule. To be clear,
AHAM is not seeking reconsideration
regarding DOE’s decision to repeal the
oven test procedure.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
I. DOE Has Not Demonstrated That The
Test Procedure Is Representative for
Gas Cooktops.
In the August 2016 SNOPR, DOE
proposed to extend the electric test
procedure in EN 60350–2:2013
‘‘Household electric cooking appliances
Part 2: Hobs—Methods for measuring
performance’’ to gas cooktops. AHAM
commented in its September 21, 2016
comments that there is no consumer
data on the consumer representativeness
of that method for gas cooktops. AHAM
noted that DOE’s proposal, and now
Final Rule, is not harmonized with the
European approach, which uses a
different test procedure and different
test pots to test gas cooktops. DOE’s
methodology is also different than
ASTM F152, ‘‘Standard Test Methods
for Performance of Range Tops,’’ which
DOE reviewed during the test procedure
rulemaking and is used by the
commercial range industry. DOE
dismissed ASTM F1521 because of the
BTU range for commercial range tops,
and AHAM is not arguing that it is the
appropriate procedure for residential
products. But the science behind the
test setup in ASTM is similar to the EN
gas test procedure which demonstrates
that the basic methodology for testing
gas products is well established.
Accordingly, no manufacturer or third
party test laboratory—in the U.S.,
Europe, or elsewhere in the world—had
experience with DOE’s proposed test
procedure for gas cooktops other than
DOE’s minimal testing in one laboratory
prior to the publishing of the Final Rule.
Thus, neither DOE nor manufacturers
have knowledge of whether this test will
be representative for gas products.
Accordingly, DOE does not have the
necessary data to justify the use of this
method on gas cooktops in the United
PO 00000
Frm 00005
Fmt 4702
Sfmt 4702
States, especially in light of the fact that
Europe uses a different approach.
In fact, AHAM believes that the
evidence supports the opposite
conclusion—i.e., that the cooktop test
procedure is not representative for gas
cooktops. The EN and ASTM standards
use a different test procedure for gas
cooktops and do so for good reason.
Unlike electric cooktops, gas cooktops
utilize a system approach—every
component and design choice is
connected to other components and
design choices and they work together.
The cooking heat out to the pot depends
on the design of the burner, flow of gas,
mass of the grate, and height of the grate
from the burner.
Gas testing is a science, and DOE did
not do sufficient study to determine
whether the electric test procedure it
adopted would measure representative
results for gas cooktops:
1. First, the purpose behind EN
60350–2:2013 was to establish a test to
determine minimum energy for electric
cooktops. The reason that the working
group that developed the test decided to
assess simmer for electric cooktops was
to show the distinction in energy use
between the different electric
technologies, i.e. induction, radiant. For
electric cooktops, technology has an
impact on how much energy is used to
get to boil and also how much energy
it uses to keep a simmer temperature.
Thus, some technologies may appear to
be more or less efficient if just a time to
boil was assessed. For electric, the
simmer portion of the test is needed to
accurately show the cooktop’s energy
use and to allow comparison across the
product types. Figure 1 below shows
how the test distinguishes between
electric technologies.2
2 CECED,
E:\FR\FM\25APP1.SGM
2012.
25APP1
2. In an attempt to keep one test
method, DOE extended this electric
method to gas cooktops. AHAM
appreciates the attempt to reduce the
number of test methods. But, in this
case, there is no reason to use one type
of test. There are not different types of
gas technologies and so a simmer period
is not needed to differentiate between
technologies as it is in electric. The
significant added burden of including
the simmer setting (and the variation it
introduces) is not likely balanced by a
benefit in terms of energy savings.
In addition, most consumers likely
replace their cooktops with the same
fuel that is already in their home. Based
on a 2010 study conducted for AHAM,
the vast majority of consumers surveyed
replaced their cooktops and ranges with
a similar unit. According to the study,
nearly nine in ten households that
bought a freestanding single oven range
did a direct replacement. Homeowners
were even more likely to do a direct
replacement of this type of appliance, at
94 percent.3 So, it is unlikely that
3 Bellomy Research for AHAM, 2010 Major
Appliance Consumer Research Survey, Cooking
Appliances (2010).
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
consumers are comparing gas and
electric products.
3. The best comparison for comparing
gas cooktops to other gas cooktops
would be based on a simple bring to boil
test, which is what Europe and the
ASTM methods both use. DOE is the
first to reinvent the wheel and require
gas and electric cooktops to be tested in
the same way.
4. On a gas unit, there is very little
overshoot which means there is no
retained heat. Electric cooktops, on the
other hand, often have a significant
amount of retained heat. A gas cooktop’s
ability to maintain simmer in the
absence of retained heat is largely a
function of grate to burner relationships,
burner design, valve design, and pan
position. This relationship is not
accounted for in the electric cooktop
test because it does not need to be. But
it does need to be addressed in a test
applicable to gas cooktops.
5. More so than electric elements, gas
burners are designed for a specific
cooking purpose. For example:
a. Small or semi-rapid burners are
typically used for simmering. This
simmering performance is developed for
melting chocolate and fine sauces, not
keeping water simmering.
PO 00000
Frm 00006
Fmt 4702
Sfmt 4702
17949
b. Ultra rapid or rapid burners are
designed to reduce time to boil, or for
frying. Often flame stability suffers at
low rates, making simmering results
poor.
c. Other high input burners are
designed for rapid cooking (i.e. Wok)
and are not designed for simmering.
Each of these burner types have been
optimized in design to serve a particular
cooking function for consumers. Thus, it
may not make sense to apply a water
boil test to all of them. For example, a
consumer would not likely boil water
on the small/semi-rapid burner that is
meant to be used for melting chocolate
or cooking fine sauces—the time to boil
on such a burner would be extremely
long, perhaps 40 minutes. In addition to
not being representative, the test will
drive significant variation in the
assessment because DOE did not
address this in the test procedure. DOE
did, however, address this issue for
electric cooktops—the test procedure
removes certain burners from
assessment.
6. Additionally, because DOE
extended a test meant for electric
cooktops to gas cooktops, the test does
not require preheating of the gas burner.
A gas system will change rates and how
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.006
daltland on DSKBBV9HB2PROD with PROPOSALS
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
17950
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
it performs as it warms. The European
test for gas products has a 10 minute
preheat because the working group that
developed that test found that
preheating improved the
representativeness of the test results as
well as repeatability and
reproducibility. The ASTM test has a 30
minute stabilization period at 50
percent heat for the same reason. Thus,
DOE’s failure to include preheating in
the gas test ignores the wisdom
generated by other groups’ extensive
testing and experience and likely
contributes to the high degree of
variation we describe below.
7. The pots specified by the European
electric test are different than the pots
used in the European gas cooktop test.
The gas pots are Aluminum test pans
having a matt base and polished walls—
that material is of the highest level of
conduction. The electric test pans are a
very thick stainless steel plate (6 mm)
with thin stainless walls (1 mm) that are
joined by a heat resistant glue. The pan
construction is significantly different
which will have an impact on heat
transfer from the burner to the pan. The
pot spacing of the large flat corner pans
designed for electric cooktops will
perform differently with the gas burners
compared to the EN specified
Aluminum pots and will not drive
representative results. A gas flame heats
a pot differently and this should be
accounted for in the test.
DOE did not assess a sufficient variety
of gas cooktop designs to conclude that
the test procedure it adopted is
representative for gas products,
especially in light of Europe’s use of a
different procedure for residential gas
products. As highlighted above, the
residual heat loss of a gas burner on
simmer is significantly different than
simmer on electric unit where the
electric unit retains heat from the
cooktop. DOE also has specified
stainless steel pans whereas the
European procedure for gas cooktops
uses Aluminum, which has a higher
level of conduction. The pan
construction is also different which will
have an impact on heat transfer from the
burner to the pan.
AHAM has not been the only
commenter to question the
representativeness of extending the
European electric test procedure to gas
cooktops. During the test procedure
rulemaking, Southern California Gas
Company, San Diego Gas and Electric,
and Southern California Edison
(collectively, the Southern California
investor-owned utilities (SoCal IOUs))
commented that DOE should conduct a
sensitivity analysis of the impact of
ambient temperature and pressure
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
conditions on the test results for gas and
electric cooking products in order to
ensure consistent test results across
various regions, climates, and altitudes.
In addition, the SoCal IOUs commented
that validating the ambient condition
requirements would address the impact
of the proposed correction to the gas
heating value to standard temperature
and pressure conditions. DOE
responded only that it incorporated the
ambient air pressure and temperature
conditions specified in EN 60350–
2:2013 and thus believed that the results
‘‘should not’’ be impacted by tests being
conducted in different locations.4 But
DOE did not do any additional testing
to determine if that is in fact the case
and, as discussed below in Section II,
AHAM’s testing demonstrates
reproducibility issues which could be
attributed, in part, to these differences.
Moreover, efficiency for a gas cooktop
depends heavily on the external
environment, much more so than for
electric products. Simmering is, thus,
not the right parameter to measure the
ability to keep the control in this
technology. That is yet another reason
why the European gas test does not
include the simmer setting—it will be
variable and inaccurate.
In addition, the U.S. market consists
of a wide array of grate and burner
offerings to consumers and DOE did not
sufficiently assess those offerings in
developing the test procedure. DOE
itself acknowledged 283 gas
configurations.5 Yet DOE tested only
five units. The varying designs available
to consumers, most of which DOE did
not assess, have offerings of a sealed/
unsealed burner, stacked burner,
different burner shapes, a range of grate
weight and shape, and different grate
materials. DOE has not shown that the
test procedure is repeatable and
reproducible for the different designs on
the marketplace. For DOE to conclude
these issues do not exist simply because
it did not observe them in its small test
sample is illogical. DOE made
assumptions that are not supported by
sufficient data and are in direct conflict
with the technical support for the
European gas test and ASTM standard
which drove those procedures to have a
pre-heat requirement, to exclude a
simmer assessment, and to use
specifically constructed Aluminum
pans. Until and unless DOE can
demonstrate that data show the cooktop
test procedure is representative of actual
4 See Final Rule, 81 Fed. Reg. 91418, 91434 (Dec.
16, 2016).
5 Id. At 91438 (‘‘DOE surveyed 335 electric
cooking tops and 283 gas cooking tops available on
the market in the United States.’’).
PO 00000
Frm 00007
Fmt 4702
Sfmt 4702
U.S. consumer use of gas cooktops and
will deliver accurate results, DOE
should withdraw the test procedure.
Keeping it in place will very likely
result in inaccurate information to
consumers and is contrary to EPCA’s
and the Administrative Procedure Act’s
requirements.
II. DOE Has Not Demonstrated That
The Test Procedure Is Repeatable or
Reproducible For Gas Cooktops.
A. Lab to Lab Variation
Because of the short comment period
on the August 2016 SNOPR, AHAM was
not able to conduct a round robin to
assess the repeatability and
reproducibility of the test procedure for
gas products. And DOE had no data
regarding repeatability or
reproducibility upon which to rely. DOE
instead relied on a European Committee
of Domestic Equipment Manufacturers
(CECED) round robin conducted five
years ago on electric cooktops. But, that
round robin is irrelevant. As discussed
above, Europe does not extend its
electric cooktop test procedure to gas
cooktops for good reason. DOE would be
the first to do that. Thus, there is no
historical data for that test procedure.
Therefore, AHAM commented that DOE
should evaluate its proposed procedure
even more carefully and in more detail
than the electric cooktop test procedure.
Repeatability and reproducibility cannot
be established based only on DOE’s
limited within lab testing and complete
lack of lab to lab testing.
In order to address AHAM’s concerns,
DOE conducted investigative testing on
gas cooktops in support of the Final
Rule. DOE conducted testing on five gas
cooking tops that covered a range of
burner input rates, installation widths
(two 30 inch and three 36 inch), burner
quantities (two four burner, three six
burner), and grate weights. To evaluate
variation in the test, DOE conducted
two to three tests on each burner. For
each individual test, DOE performed the
full test method, including the
preliminary test required to determine
the turndown temperature and
simmering setting for a given burner.
DOE also included test results from
previous testing conducted in support of
the August 2016 SNOPR. The coefficient
of variation DOE observed for the
measured AEC for its test sample was,
on average 1.0 percent. DOE also noted
that the average per-cycle energy
consumption coefficient of variation for
each burner was 1.7 percent.
DOE based its Final Rule conclusions
regarding total variation of the entire
plethora of cooktops in the marketplace
on only this meager five unit sample
E:\FR\FM\25APP1.SGM
25APP1
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
17951
Moreover, this assessment looks at
within lab variation and not total
variation. As discussed below regarding
DOE’s electric cooktop testing, DOE’s
testing is insufficient to support a
conclusion that the test procedure for
gas cooktops is repeatable and
reproducible and, thus, is insufficient to
support the final test procedure.
Moreover, because DOE tested such a
small sample the confidence level of its
results is low (the same is true for
electric cooktops). For a sample size of
five, trying to represent the millions of
units that will be produced and the tens
of different labs that will be doing
testing this inherently has a large
margin of error as shown in Figure 2.6
Based on this sample size, results can
vary plus or minus 26 percent. We fully
understand that a larger sample size is
a function of cost and that there are
limitations on the amount of further
testing that can be done. Nevertheless,
it is important not to lose sight of
the fact that DOE’s sample size
results in as much as 50 percent in
variation on the expected results.
Thus, it is no surprise that AHAM’s
testing has shown significant variation
that DOE’s did not. This large
confidence interval, which the
difference between DOE’s and AHAM’s
test results bear out, further supports
AHAM’s request that DOE withdraw the
cooktop test procedure. A test procedure
that could be required to demonstrate
compliance with possible energy
conservation standards should not be
finalized with such a high confidence
interval, particularly when conflicting
data has been provided to highlight this
high confidence interval. At a
minimum, this demonstrates that DOE’s
data alone and when added together
with AHAM’s data raises significant
questions about whether the test is
repeatable and reproducible. Thus,
DOE’s Final Rule is not supported by
adequate data and could be considered
arbitrary and capricious.
Moreover, as with electric cooktops
and discussed more fully below, DOE
did not engage stakeholders—either
manufacturer labs or third party labs—
in its assessment of the Final Rule.
Thus, based on DOE’s testing, neither
DOE nor stakeholders have any idea
what the actual test procedure total
variation is.
In order to assess whether the final
test procedure for gas cooktops is
repeatable and reproducible, after DOE
issued the final test procedure rule,
AHAM conducted a round robin on gas
cooktops. It is likely that even more
testing would be helpful in better
understanding both the test procedure
and its variation, but these results are
enough to demonstrate that there is
sufficient doubt regarding the gas
cooktop test procedure’s accuracy such
that DOE should withdraw it.
AHAM’s gas cooktop round robin
included four units (two cooktops and
two ranges), with a range of product
types.7 Four labs tested the burners with
the highest and lowest burner input
rates (i.e., one high capacity and one
low capacity burner was tested for each
unit).8 Each burner was tested three
times each using the procedure
specified in the DOE Final Rule. Labs
recorded the simmering setting selection
for the energy test cycle and the first
laboratory marked the turn down
temperature. AHAM’s test plan is
attached in Exhibit B and AHAM
provided Navigant with raw data under
a confidentiality agreement.
We note that some of the tests could
not meet the specified ambient
temperature requirements. Specifically,
some of the laboratories were not able
to hold the ambient temperature as
required during the duration of the test.
Manufacturers ran the tests in the
tightest environments that are currently
available at +/¥5 °F in their
laboratories. The Final Rule requires
new equipment to maintain +/¥2 °F,
which is difficult or, in some cases,
impossible to do in existing laboratories.
Section IV below further discusses this
point. The labs that ran the tests have
been approved by the safety certification
bodies and Canadian Energy
Verification organization. We removed
the most errant runs and included the
test data to show the variation that was
noticeable during our tests as it is
representative of the current lab
capability. Importantly, improving the
ability to maintain ambient temperature
will involve significant upgrades to
laboratories, which will add cost and
burden for manufacturers.
As mentioned above, AHAM’s test
plan called for running the test
differently than the DOE test by having
the first laboratory mark the turn down
temperature it used. AHAM
understands that this is not fully
6 See,
e.g., www.surveysystem.com.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
7 A summary of the test unit characteristics is
attached at Exhibit B and data in Exhibit C.
PO 00000
Frm 00008
Fmt 4702
Sfmt 4702
8 Unit
E:\FR\FM\25APP1.SGM
A was tested by five labs.
25APP1
EP25AP18.007
daltland on DSKBBV9HB2PROD with PROPOSALS
and a simulated round robin. DOE’s
testing did not truly test reproducibility
from lab to lab because DOE simply
used different technicians for some of
its tests. DOE did not conduct testing on
the same units in different labs. It makes
sense that under those conditions—
using the same laboratory equipment
and test technicians trained in the same
laboratory—variation would be lower.
17952
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
consistent with DOE’s test procedure.
But, because the test procedure is
unduly burdensome to conduct, as
discussed below, this method was
necessary to reduce the test burden—
reducing the number of possible settings
for the cooktop was seen as a
worthwhile experiment. Importantly, it
was not always possible for laboratories
to use the marked temperature and so,
in several instances, laboratories
followed DOE’s test procedure to the
letter. In the end, only half of the labs
were able to follow AHAM’s test plan.
The other half ran the test according to
the DOE test procedure as written. Our
data below differentiates these methods
by referring to the tests that used the
marked turndown temperature as the
‘‘truncated test’’ or ‘‘preset.’’
The DOE test procedure tried to
address some of the variation that is not
controllable in the methodology of its
burdensome test procedure—e.g.,
heating values, different ambient
temperatures, equipment, and
technicians. AHAM’s methodology was
an effort to determine if the extra
burden aimed at reducing that variation
reduced it enough to justify the extra
time, labor, and cost. Our conclusion: it
is not. Although neither method
showed results with an acceptable
level of variation, the runs that used
the truncated test resulted in less
variation. Regardless, the results cast
significant doubt on DOE’s small
amount of supporting data for the Final
Rule and support AHAM’s request that
DOE withdraw it.
Good lab practice is that within lab
variation should clearly be less than two
percent. For current data acceptance
programs within the appliance industry,
it is common practice that data between
labs should be no more than three
percent variation. DOE’s data within its
own lab fell within the target zone for
variation for four of the five units DOE
tested. DOE did not test at different labs,
so the Final Rule is not based on any
accurate lab-to-lab data showing an
acceptable range of lab-to-lab variation.
AHAM’s round robin shows similar
results to DOE’s in terms of within lab
variation. Significantly, however, as
shown in Table 1, lab-to-lab variation
considerably exceeds the three percent
maximum lab-to-lab variation target
regardless of whether the full DOE test
was run or the truncated test was run.
TABLE 1—AHAM GAS ROUND ROBIN SUMMARY RESULTS
Width
Number of
burners
Minimum input
rate
(Btu/hr)
Maximum
input
rate
(Btu/hr)
36
........................
30
........................
30
........................
30
........................
5
........................
4
........................
4
........................
5
........................
8,000
........................
5,000
........................
5,000
........................
5,500
........................
18,000
........................
15,000
........................
15,000
........................
18,000
........................
Cooking unit
AHAM
AHAM
AHAM
AHAM
AHAM
AHAM
AHAM
AHAM
A—set ............................................
A—Preset ......................................
B ....................................................
B—Preset ......................................
C ....................................................
C—Preset ......................................
D ....................................................
D—Preset ......................................
Average
annual energy
consumption
(kBtu/yr)
936.3
918.7
1,034.1
870.1
843.1
827.9
1,077.2
1,123
Coefficient of
variation
—1 lab
(repeatability)
(%)
0.89
0.68
9.20
1.70
2.70
1.80
0.78
1.59
Coefficient of
variation across
multiple labs
(reproducibility)
(%)
3.60
2.30
17.10
13.50
12.50
7.00
12.00
12.00
having an acceptable coefficient of
variation across labs. Notably, the low
input rate on that burner is 8,000 BTU.
AHAM units B, C, and D all have low
capacity burner rates of or about 5,000
BTU. DOE only tested one of its five
units with a low capacity burner at
5,000 BTU. DOE’s coefficient of
variation for that model was 1.40
percent. Some of the best AHAM single
lab coefficients of variation for models
at that rate are 0.78, 1.59, 1.70, and 1.80
percent. The AHAM data would appear
to agree that one lab can repeat the same
results, but that is not the full story.
Focusing on the units with low
simmer rates and digging deeper into
the data, AHAM’s data show the
following:
• On all units except one, Unit B, the
repeatability on the high capacity
burner within the lab had acceptable
variation but the reproducibility across
labs did not. Overall, on the high
capacity burner, the variation was
higher using the DOE test procedure
than it was using the truncated test
and none of the variation was
within an acceptable range from
lab-to-lab.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
PO 00000
Frm 00009
Fmt 4702
Sfmt 4702
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.008
daltland on DSKBBV9HB2PROD with PROPOSALS
This highlights the significant gap in
the data DOE used to justify the rule.
DOE assumed that low variation in one
lab means repeatability and
reproducibility across labs. But AHAM’s
round robin demonstrates that this is
not the case. Our round robin shows
reproducibility is not present in the
current procedure as demonstrated by
only one of the three units, Unit A,
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
• On all units, the repeatability on the
low capacity burner was marginal—25
percent of the time the variation was
greater than the two percent maximum
target. There is a distinct difference in
the low capacity variation and the three
units that had simmer at or near 5,000
BTU had significant repeatability and
reproducibility issues. In some cases,
using the truncated test actually
improved lab-to-lab variation. This
demonstrates that the burden associated
with determining the turn down
temperature in DOE’s full test procedure
is not always justified—it does not
categorically improve repeatability and
reproducibility. Thus, not only is DOE’s
final test procedure rule unsupported by
sufficient data to demonstrate its
reproducibility, but it is also unduly
burdensome to conduct. In addition,
this highlights the weakness in the DOE
test procedure which conducts a water
boil and simmer test on small burners
that are not meant for either purpose. As
discussed above in Section I, those
burners are designed to provide a
simmer only cooking function for
melting chocolate and cooking sauces,
not for boiling or simmering water.
daltland on DSKBBV9HB2PROD with PROPOSALS
B. Within Unit And Between Unit
Variation
DOE did not evaluate or account for
variation within units. There are issues
inherent in testing gas cooktops and
ranges that contribute significantly to
within unit variation. For example,
heating value, gas pressure, and
atmospheric pressures all have an
impact. More specifically, as
atmospheric pressure changes due to
weather, test results will vary even on
the same unit from day to day. Also, gas
pressure and atmospheric pressure can
vary from run to run, and that can have
an impact on how the gas is mixing
within the burner port which then
impacts burner combustion and energy
creation. Moreover, heating values vary
within a lab on a daily basis and likely
vary greatly between labs. Thus, the
same unit tested on different days in the
same lab or in different labs will not
perform the same unless the heating
value of the gas is the same. That is
statistically unlikely because values
vary every day. It is not likely that the
heating value is 1075, so there is a
conversion from what it actually was to
1075 and this artificial adjustment
induces variation. Each of these factors,
among others, individually and
collectively contribute to variation from
test to test and DOE has made no effort
9 AHAM Comments on DOE’s SNOPR for Energy
Conservation Standards for Residential
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
17953
to understand the impact of these
factors.
This inherent variation in gas cooking
product testing has been known for
decades and is the reason the safety test,
ANSI Z21.1, requires certified
technicians to drill testing orifices. The
drilling of orifices achieves precise rates
for nominal, high, and low values.
Experience shows that certified gas
technicians can dial in the precise
values for assessment by using number
sized drills but there are also factors the
technician must manage in this process
such as burrs from the drilling. AHAM
is not suggesting that DOE require
testing orifices be drilled for purposes of
energy testing—the burden is significant
to say the least and would make the test
unduly burdensome to conduct.
Although such burden is justified for
purposes of ensuring the safety of
cooking products, which carry inherent
safety risks, it is not justified for
purposes of energy testing. And,
because safety testing is not similar to
energy testing (for example, cooktops
are tested on high for hours and
products are over-stressed in abnormal
conditions), it is not possible to re-use
the units tested for safety purposes for
energy testing.
In addition, neither DOE nor AHAM
have evaluated or accounted for the
additional variation inherent in
producing gas products, i.e., between
unit variation. This is significant
because it will add further variation on
top of the within lab variation, lab to lab
variation, and within unit variation. In
order to ensure compliance with any
future energy conservation standard,
manufacturers will have to take this
total variation into account. The result
will likely be that it becomes difficult or
impossible to meet standards because
the buffer needed to ensure accurate
ratings will require levels of efficiency
that are not economically justified or
technologically feasible. AHAM
explored this concept in more detail in
its comments on DOE’s proposed
standards, which we hereby incorporate
by reference.9
One of the test requirements that will
vary within the unit is the simmer
setting on gas products. Subsequent to
AHAM’s round robin, Lab Three
conducted some additional investigative
testing to determine whether using the
same simmering setting improves
repeatability. The lab used two different
operators to test a unit and provided
both with the same instructions, which
are identified in Exhibit A. The test plan
was as follows:
1. Operator F conducted the test and
found the simmer setting and gas flow;
2. Operator M conducted the test
independently and found a simmer
setting and gas flow;
3. Operator M repeated the test using
the Operator F simmer setting; and
4. Operator F repeated the test using
the Operator M simmer setting.
The results show that technicians are
likely to be able to work to achieve
passing results on their own efforts to
determine a simmering setting. But
when given the target setting, the results
show that it is likely that different
technicians cannot recreate a first
technician’s passing result about half of
the time.
The data also highlight that there are
more issues with finding the right
simmer setting on low capacity
burners—the Lab Three technicians
each failed the first time they tried to set
the low capacity burner. Also, see in
Exhibit A where an additional
experiment was run with one of Lab
Four’s technicians developing the
simmer setting without using the
previously provided information. This
resulted in different energy average and
lower variation values between the two
Lab 4 technicians.
According to these results, relying on
a given setting actually increased
variation and retests due to failing
performance. Thus, though recording
the turn down temperature as required
by the Final Rule may help understand
differences in results between labs, it
does not reduce variation. And it does
not seem that simply following the test
procedure to the letter, as DOE
suggested in response to AHAM’s
comments and discussed in Section II
below, reduces variation. AHAM’s test
results demonstrate that additional
efforts to reduce variation on turndown
settings were unsuccessful—even
standardizing the simmering setting
does not drive sufficient variation
reduction. (Moreover, for gas products,
it will not be possible to specify
turndown settings for gas products due
to orifice variation, which is discussed
in more detail below). Accordingly,
because DOE’s final test procedure does
not sufficiently reduce total variation,
DOE should withdraw the cooktop test
procedure.
Conventional Cooking Products; Docket No. EERE–
2014–BT–STD–0005; RIN 1904–AD15 (Nov. 2,
2016).
PO 00000
Frm 00010
Fmt 4702
Sfmt 4702
C. Full Population and Total Variation
As stated previously, DOE’s small
sample size could not address the full
population or total variation. Table 2
below lists the units have been tested to
the final test procedure as specified
E:\FR\FM\25APP1.SGM
25APP1
17954
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
from both DOE’s sample and AHAM’s
sample and Figure 3 shows the samples
and their results graphically.
TABLE 2—DOE AND AHAM TEST SAMPLES COMBINED
daltland on DSKBBV9HB2PROD with PROPOSALS
DOE 1 .........
DOE 2 .........
DOE 3 .........
DOE 4 .........
DOE 5 .........
AHAM A ......
AHAM B ......
AHAM C ......
AHAM D ......
Width
30
30
36
36
36
36
30
30
30
Number of
burners
4
4
6
6
6
5
4
4
5
Minimum
input
rate
(Btu/hr)
Maximum
input
rate
(Btu/hr)
9,000
5,000
18,000
9,200
15,000
8,000
5,000
5,000
5,500
9,000
15,000
18,000
15,000
18,500
18,000
15,000
15,000
18,000
Figure 3 shows the units tested and
what their AAEC number is versus their
lowest burner capacity rating. It
highlights how skewed the DOE
sampling was, especially as compared to
AHAM’s. As discussed above in Section
I, DOE identified that nearly half of the
models in the market had a 5,000 BTU
burner. Yet, DOE selected only one unit
with a burner of that capacity. Aside
from the fact that DOE’s sample
inadequately represents the market, this
demonstrates that DOE’s test procedure
will produce inaccurate results for most
of the gas products on the market. The
test has a high degree of variation for
those products, as shown above, and,
thus, the test will not allow consumers
to compare across products.
Neither DOE nor AHAM have
evaluated or accounted for the all of the
variation inherent in producing gas
products, i.e., total variation across the
population. It is a large task and
assuming the small amount of work
applies to the total picture is not
acceptable and further supports the
withdrawal of the test procedure.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
Burner
configuration
Grate type
open ............................
Sealed .........................
Sealed—stacked .........
Sealed—stacked .........
Sealed .........................
Sealed—stacked? .......
Sealed .........................
Sealed .........................
Sealed .........................
Steel-wire .........................
Cast Iron ..........................
Cast Iron ..........................
Cast iron—Continuous .....
Cast iron—Continuous .....
Cast iron—Continuous .....
Cast Iron ..........................
Cast Iron ..........................
Cast Iron ..........................
III. DOE Has Not Demonstrated That
The Test Procedure Is Repeatable Or
Reproducible For Electric Cooktops.
As discussed above, in response to the
August 2016 SNOPR, based on roundrobin testing, AHAM identified several
sources of potential variation that
needed to be resolved prior to DOE
finalizing a cooktop test procedure. DOE
conducted additional testing in order to
evaluate AHAM’s concerns and made
clarifications to attempt to address
many of them. Unfortunately, DOE’s
testing was not sufficient to demonstrate
that the final test procedure
significantly reduced the high degree of
total variation AHAM identified in its
comments. AHAM does not agree that
the final test procedure is sufficiently
repeatable and reproducible.
Accordingly, AHAM respectfully
requests that DOE withdraw the cooktop
test procedure.
A. DOE’s Testing
DOE did not do enough testing to
verify that its clarifications resulted in
a final test procedure that is repeatable
and reproducible and, so, the Final Rule
PO 00000
Frm 00011
Fmt 4702
Sfmt 4702
Grate
weight
per burner
lbs)
Average
annual energy
consumption
(kBtu/yr)
0.5
3.7
4.4
5.8
7
?
?
?
?
640.4
854.4
974.8
963.5
893.1
936.3
1,034.1
843.1
1,077.2
Coefficient
of variation
—1 lab
(repeatability)
(%)
2.40
1.40
0.40
0.30
0.30
0.89
9.20
2.70
0.78
Coeffiecient of
variation across
multiple labs
(reproducibility)
(%)
N/A
N/A
N/A
N/A
N/A
3.60
17.10
12. 5
12.00
is not supported by sufficient data. DOE
conducted testing of five electric
cooktops incorporating different heating
technologies (one coil element cooktop,
two radiant element cooktops, and two
induction cooktops) and control types
(four with step controls and one with
infinite). For each unit, DOE conducted
testing on surface units capturing a
range of heating element sizes. DOE
conducted two to three tests per surface
unit. For each individual test, DOE
performed the full surface unit test
method, including the preliminary test
required to determine the turndown
temperature and simmering setting for a
given surface unit. DOE varied test
operators for surface unit tests, but did
not test at different laboratories. DOE
also included test results from previous
tests of these units conducted in support
of the August 2016 SNOPR.
AHAM appreciates that DOE
conducted this testing. But it is not
enough to justify finalizing the test
procedure. DOE did not complete full
tests—it tested only two to three
burners. Although that is helpful in
assessing potential variation, AHAM is
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.009
Cooking unit
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
concerned that DOE would finalize a
rule based on the results of only partial
tests.
DOE’s testing demonstrates a low
average coefficient of variation of 1.2
percent. It is uncertain whether those
results are accurate given that DOE did
assess the full IAEC for an entire
cooktop. But, assuming that the partial
tests do give a reasonable understanding
of repeatability and reproducibility,
DOE has not identified why DOE’s
coefficient of variation was so much
lower than AHAM’s.
One potential reason is that DOE’s
testing did not truly test reproducibility
from lab to lab—DOE simply used
different technicians for some of its
tests. DOE did not conduct testing on
the same units in different labs. It makes
sense that under those conditions—
using the same laboratory equipment
and test technicians trained in the same
laboratory—variation would be lower.
DOE’s test parameters did not accurately
simulate reproducibility. The
simulation run by DOE only changed
the test technician. It is unclear from
DOE’s analysis if those technicians had
previous knowledge of the procedure or
were allowed to imprint their
interpretation on the execution of the
test. DOE did not simulate running the
test with different equipment and a
different environment, as would be run
in a true round robin.
Conversely, AHAM’s tests were
conducted on the same units in three
(now four) different laboratories. Those
laboratories have different technicians
with different training, different
equipment, and, potentially, different
interpretations of the test procedure.
These true round robin conditions are
far more likely to reveal ambiguity in
the test and sensitivities that cause
variation. They also replicate a real
scenario—one lab attempting to verify
the results of a different lab. As
discussed above in Section II, the testing
conducted to date, necessarily, has a
low confidence level and the differences
between AHAM’s and DOE’s results
demonstrate that. AHAM’s testing
resulted in significantly higher variation
than DOE’s and the large confidence
interval that results supports AHAM’s
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
request for DOE to withdraw the
cooktop test procedure.
Moreover, DOE did not engage
stakeholders—either manufacturer labs
or third party labs—in its assessment of
the Final Rule. Thus, based on DOE’s
testing, neither DOE nor stakeholders
have any idea what the actual total test
procedure variation is. The test
laboratory DOE used to run the tests in
support of the proposed and final rules
will not be a lab that regularly runs the
test procedure when reporting and/or
compliance with standards is
potentially required. (The labs that
participated in AHAM’s round robin,
will, of course, be conducting testing to
demonstrate compliance with any
potential future standards). Thus,
because DOE’s reproducibility testing is
essentially theoretical and only
simulates a round robin test, DOE’s
testing is helpful, but not enough to
determine the repeatability and
reproducibility of the test.
B. Determining the Simmering Setting
AHAM commented that there is
variability in determining the
simmering setting for the simmering
phase of the test and noted that the
simmering setting plays an important
role in the overshoot temperature and
the ability to maintain a temperature as
close as possible to 90 °C during the
simmering phase of the test.
DOE responded that it expects that
correctly following the methodology—
starting with the lowest simmering
setting and repeating the test as
necessary with the next highest setting
until the setting that maintains the
water temperature above, but as close as
possible to 90 °C, is identified—will
result in only a single appropriate
simmering setting for a given surface
unit.
DOE agreed with AHAM that the
selection of the simmering setting has a
significant impact on the overall energy
consumption of a surface unit and
amended Appendix I to require that the
simmering setting selection for the
energy test cycle of each cooking area/
zone be recorded. AHAM appreciates
that DOE required recording the
simmering setting selection—it will
PO 00000
Frm 00012
Fmt 4702
Sfmt 4702
17955
help in enforcement/verification actions
to understand differences in test results.
Unfortunately, recording the setting will
do nothing to decrease variation or
prevent false findings of potential
noncompliance.
AHAM acknowledges that in its
initial round robin, laboratories did not
start at the lowest simmering setting—
laboratories started at the lowest setting
they believed would be able to maintain
a water temperature above and as close
as possible to 90 °C. AHAM is a
proponent of conducting the test that
way in order to reduce test burden
which, as discussed further below, is
already significant.
Nevertheless, in order to understand
if variation would decrease by following
the letter of the test procedure as DOE
suggested in the Final Rule, AHAM, in
conducting a round robin on gas
cooktops, required participating
laboratories to (a) follow the DOE test
procedure for selection of the simmering
setting; (b) record their simmering
setting; and (c) for the first lab, mark the
turn down temperature on the unit
itself.10 Our data, which are discussed
above in Section II, show that following
the letter of the test procedure does not
sufficiently reduce variation. In
particular, lab-to-lab variation remains
high for gas cooktops and AHAM’s
round robin testing for electric cooktops
provided data to support a conclusion
that it is likely also high for electric
cooktops. DOE did not adequately
address AHAM’s concern in its Final
Rule and AHAM’s gas testing casts
further doubt on this question.
AHAM incorporates by reference the
data we submitted to DOE during the
rulemaking regarding our electric round
robin, which is summarized in the
below tables. These data highlight that
the simmer setting is a significant
source of variation. Because DOE has
not yet adequately addressed it, and,
thus has not sufficiently demonstrated
that its test procedure is valid, DOE
should withdraw the cooktop test
procedure.
10 Results of the AHAM gas round robin are
discussed in Section II.
E:\FR\FM\25APP1.SGM
25APP1
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
C. Spiking Temperatures When
Reaching 90 °C
AHAM commented that our round
robin demonstrated difficulty in
determining when the water
temperature first reaches 90 °C to start
the 20-minute simmering phase of the
test because, when the temperature first
reaches that temperature, it may
oscillate slightly above or below it.
DOE’s testing showed similar
fluctuations. Thus, DOE amended
Appendix I to clarify that the 20-minute
simmering period starts when the water
temperature first reaches 90 °C and does
not drop below 90 °C for more than 20
seconds after initially reaching 90 °C.
AHAM thanks DOE for making this
clarification which seems like it could
reduce variation. DOE’s testing—
completed in a single lab and with
technicians trained in the same lab—
does not, however, adequately
demonstrate that this clarification
sufficiently reduces variation and
improves reproducibility. AHAM’s
members were not able to dedicate
resources to re-performing a round robin
to verify DOE’s findings on a single unit.
Without knowing whether total
variation has, in fact, been reduced,
DOE should not have finalized the test
procedure and DOE cannot rely on
assumptions that this change will
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
reduce total variation—to do so could be
considered arbitrary and capricious.
Total variation is made up of within lab
and between lab variations AND within
and between units variations. DOE only
addressed some of the within lab
variation causes, meaning that other
causes of variation are unaddressed.
DOE does not have sufficient data to
demonstrate that the test procedure is
reproducible and should withdraw the
test.
D. Heating Element Cycling
AHAM commented that cycling of
power to the heating element is
unpredictable and causes variation in
test results. It is unknown if the surface
unit will cycle the heating element off
during a critical phase of the test—i.e.,
at the start of the simmering phase or
when determining the simmering
setting. In response to DOE’s September
27, 2016 data request, AHAM provided
further data on how this was observed
during our testing. DOE could not have
reviewed or considered that data in
drafting the Final Rule given that the
Final Rule was issued the same day
AHAM provided the data. AHAM
incorporates the data we submitted on
November 23, 2016, in this petition by
reference.
PO 00000
Frm 00013
Fmt 4702
Sfmt 4702
DOE did, however, examine its own
data. DOE indicated that it observed
only one electric smooth-radiant
cooktop in its sample for which the
heater cycled on and off during the heatup phase of the test. That particular unit
cycled back on within a few seconds of
cycling off and, as a result, the water
temperature continued to rise at a
‘‘fairly steady state.’’ Thus, DOE
concluded that it was infrequent for
heating elements to cycle during the
heat-up phase and, so, it was unlikely
that other electric smooth-radiant
cooktops would require any substantive
amount of heating element cycling to
protect the glass surface. DOE indicated
that it did not expect any measurable
impacts of heating element cycling on
the total measured per-cycle energy
consumption.
DOE based its conclusions on the
single unit in its sample and is guessing
that because only one unit in its small
sample did not cycle on and off during
the heat-up phase, it must not occur
frequently and/or if it does, it will not
have a measurable impact on the total
per-cycle energy consumption. But
AHAM also observed element cycling
during its testing. Thus, in only the
small amount of testing conducted in
the U.S. to date, unit cycling during the
heat-up phase has been observed twice.
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.012
17956
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
That is not insignificant. Almost 20
percent of units in the combined AHAM
and DOE tested sample experienced
unit cycling.
Moreover, AHAM submitted
additional data to DOE regarding the
unit cycling it observed. As mentioned
in that data submission, AHAM tested
two eight-inch coil elements on
different cooktops with the same model
number to evaluate unit to unit
variation. One cooktop cycled during
the T70 turndown test and the other did
not. The unit that cycled resulted in a
higher turn down temperature when
compared to the test that did not cycle.
The unit did not cycle on either test run
during the final T90 simmer test. The
high Tc value caused one test run to
have a higher overshoot and allowed for
a lower turn down during the simmer
phase driving unit to unit variation.
This resulted in 36 watts less power on
the unit with the lower turn down. This
is six percent of the normalized power
level. Six percent is not insignificant
and demonstrates the potential
difference between the energy measured
on two units of the same construction.
DOE should withdraw the Final Rule for
cooktops and review and consider the
data AHAM submitted. This issue must
be addressed in order to reduce total
variation.
Furthermore, DOE did not address the
arguments AHAM made about the
uncertainty regarding how unit cycling
will impact test results and test
burden—this is a significant concern
and could drive redesign of products.
Heating element cycling is key to
cooking performance for electric ranges
because the algorithm that governs
heating element cycling controls the
temperature of the food being cooked. If
the temperature is not properly
maintained, the consistency of the food
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
can change. Moreover, for smooth top
electric ranges, heating element cycling
also serves a safety function. Such
cooktops are equipped with a glass
break sensor to monitor temperature.
That sensor will dictate when a unit
needs to cycle down to avoid glass
breakage. AHAM is concerned that the
test procedure, as finalized by DOE,
could drive changes to the algorithm for
heating element cycling design. Any
such changes will result in significant
product development efforts which have
not been accounted for in DOE’s test
procedure rulemaking. A test procedure
change should not dictate this sort of
design change simply to manage
uncertainty and variation.11
For these reasons, DOE should
withdraw the cooktop test procedure
due to total variation that is not fully
understood and, from available data,
appears to be at an unacceptable level.
E. Upcoming New Cooktop Designs
As AHAM has commented to DOE
many times, Underwriters Laboratory
(UL) Standard 858 will soon require a
new test for electric coil element
cooktops. The change to the voluntary
safety standard, which AHAM
developed and proposed to UL with the
support of the Consumer Product Safety
Commission, will require electric coil
element cooktops and ranges to monitor
11 It is possible, for example, consumers often
jump from one side (rolling boil) to the other side
(boil action lost) a couple of times before they
understand where to set the dial to maintain their
desired simmering temperature. If manufacturers
make the dials more precise in order to reduce
variation in the energy test, that could result in
more settings and consumers could change back
and forth more times because they see less impact
in adjusting the knob. This could actually drive
consumers to use more energy in the field.
Accordingly, DOE should examine potential
unintended consequences of addressing this
uncertainty.
PO 00000
Frm 00014
Fmt 4702
Sfmt 4702
17957
and limit pan bottom temperature and is
aimed at reducing the incidences of
unattended cooking fires. It represents a
major redesign for all electric coil
cooktops by every manufacturer. The
change will be required to show
compliance on coil cooktops with the
updated voluntary safety standard as of
June 15, 2018.
Given the date of this requirement, it
is certain that any cooktop standard
DOE may promulgate (and AHAM
opposes any change to the existing
standards for conventional cooking
products) would apply to these newly
designed products. But, because these
products are still in development, DOE
has not done testing on products using
these controls and neither have
manufacturers. Because company
designs to comply with the UL 858
requirements may involve cycling of the
element, it is quite possible that heating
element cycling will be different than it
is for existing products. Thus, DOE’s
data, even as supplemented by AHAM’s
data, on heating element cycling may be
irrelevant because it does not represent
products that will be on the market if
the test is required to demonstrate
compliance with possible energy
conservation standards.
As shown in Figure 4, initial data,
based on testing conducted by Primaria
LLC to develop UL 858’s new
requirements, show that though time to
boil water may not increase significantly
using temperature limiting controls on
coil cooktops, the difference could be
enough to further impact the current
assumptions on variation. And, the
control cycling could be somewhat
different as well. DOE should
understand how the energy test will
respond to these new technologies.
E:\FR\FM\25APP1.SGM
25APP1
17958
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
daltland on DSKBBV9HB2PROD with PROPOSALS
Although DOE sought feedback on the
degree to which the heating element or
cookware may deform and impact the
heat transfer between the two surfaces
in its rulemaking on energy
conservation standards for cooktops,
DOE did not investigate the impact of
pan warpage on the repeatability and
reproducibility of the test procedure.
The UL 858 test for coil cooktops
initially required use of an aluminum
pan. But, based on manufacturer
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
experience doing significant testing,
AHAM proposed a cast iron alternative
to aluminum pans for the test. UL
published this update in August of
2017. The shift is to account for warping
and the variation and lack of
repeatability it is driving in the safety
assessment. There is no reason to
believe this variation will not also
extend to energy testing.
The data from the UL 858 work with
Primaira show that any variation in
pans of the same type will drive
variation that the energy testing has not
PO 00000
Frm 00015
Fmt 4702
Sfmt 4702
yet shown because the pans have yet to
warp substantially. Significantly, using
a warped stainless steel pan on a
ceramic cooktop did increase the boil
time with the cooktop fire mitigation
control active (that control cycles the
element on and off per an algorithm).
And, warpage on stainless steel pans
style will cause a difference in energy
use on units without a limiting control
as shown in Figure 5. DOE’s failure to
further investigate this issue means that
its test procedure is not adequately
supported.
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.010
F. Pan Warpage
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
IV. The Cooktop Test Procedure Is
Unduly Burdensome To Conduct.
The discussion in the sections above
highlights several significant burdens
associated with conducting DOE’s
cooktop test procedure that AHAM
believes make it unduly burdensome to
conduct. Specifically:
• The test procedure takes about 20
hours for an average four burner
cooktop and requires the testing of every
single burner or element individually.
And, because the test requires the
technician to determine the turn-down
temperature before every test and the
ambient conditions are quite tight,
several runs are often required before a
valid run can be achieved. Our testing
found that some tests took upward of
five days for a single cooktop.
• As indicated by AHAM’s truncated
gas test plan, it is burdensome to
determine the turn down temperature
for each individual test and burner. And
doing so does not serve any purpose as
it appears that it does not decrease
variation.
• The ambient temperature
requirements are incredibly tight and it
is difficult or impossible for some
laboratories to meet them without
investing in lab improvements. Some
companies had difficulty maintaining
the ambient conditions and AHAM
could not use their data in its round
robin results.
• Test pots will warp during testing
and will need to either be repaired or
replaced frequently.
• The test procedure variation means
that manufacturers will need to add a
larger than usual ‘‘buffer’’ to any
eventual energy conservation standards
ratings, which will effectively increase
the stringency of any future standard,
probably by a large amount.
In addition to the test burden itself,
there is also substantial cost associated
17959
with the test procedure. DOE
determined that the test procedure
would cost $700 per test for labor, with
a one-time investment of $2,000 for new
test equipment, which was split
between test pots and other
instrumentation. AHAM collected data
from its members on the cost of the test
procedure, both ongoing and initial
investments. This data is based on
company experience with the test
through AHAM’s round robins and in
testing in Europe, on the number of
models each company has, and on the
potential need for third party testing.
AHAM’s data show that DOE
significantly underestimated the cost
associated with running the cooktop test
procedure.
Table 3 below shows the difference
between DOE’s estimates in the Final
Rule and AHAM’s data.
TABLE 3—PER TEST COSTS (DOE ESTIMATE V. AHAM DATA)
Cooktop full product line
One time (initial year)
DOE
AHAM
DOE
AHAM
Labor Costs .....................................................................................................
Instrumentation (equipment for testing) ...........................................................
Test pots (vessels) ..........................................................................................
Testing structures ............................................................................................
Transducer (for ambient air temp.) ..................................................................
$700
15
152
8
2
$970
1,432
113
159
N/A
........................
........................
........................
........................
........................
$970
1 38
2 209
3 43
0
Total ..........................................................................................................
876
2,673
700
1,260
Note: On average, 543 tests will be required to certify companies’ full product lines.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
PO 00000
Frm 00016
Fmt 4702
Sfmt 4702
E:\FR\FM\25APP1.SGM
25APP1
EP25AP18.011
daltland on DSKBBV9HB2PROD with PROPOSALS
Per test costs (per manufacturer)
On-going (annual)
17960
1 This
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
includes equipment maintenance (new/existing and calibrations for testing equipment).
will require ongoing replacement of test pots due to warping.
includes increased/new annual costs from third party labs and/or UL and ISO (re) certification.
2 Manufacturers
3 This
One of the significant differences
between DOE’s estimate and AHAM’s
data is the total number of tests required
and the number of models to be tested.
It is difficult for manufacturers to
determine at this stage how many basic
models they would have. DOE’s
proposed energy conservation standards
for cooktops, which AHAM strongly
opposes, would be the first time
manufacturers would need to certify
compliance with standards and
determine basic models. To do that may
require testing of all models in order to
determine likely model families,
particularly because cooking products
are complex. It will be difficult to
determine which models can be
grouped together in a basic model. That
said, AHAM understands that not each
individual model will need to be tested.
Thus, it is likely that something
between DOE’s estimate and AHAM’s
data would be the actual average total
number of models tested.
Nevertheless, the difference in the
number of tests and number of models
to be tested is shown below in Table 4.
DOE cost estimations (particularly for
labor) are on a per-test basis. As
described above, it is difficult to
determine the total number of tests to be
performed in the initial year. Comparing
the DOE estimation of number of tests
to AHAM member data shows a
signficant difference or wide range. As
a result, total costs are substantially
higher when considering the average
number of tests required according to
AHAM member data.
TABLE 4—AVERAGE NUMBER OF TESTS AND MODELS TO BE TESTED
Estimated total cost
Tests/models comparison
DOE
AHAM
DOE
daltland on DSKBBV9HB2PROD with PROPOSALS
Average total number of tests required ...........................................................
Average total number of models tested ..........................................................
Another important difference is that
DOE did not address upfront
investments made in order for
manufacturers to be able to perform the
test procedure. But those costs should
not be ignored. Manufacturers identified
significant investments in specialized
equipment to perform the test procedure
successfully. For example, all
respondants to AHAM’s survey
expressed frustration in obtaining the
necessary test pots because the supplier
is overseas. Acquiring even one set is
difficult, as AHAM has discussed in
previous comments, and the cost is
about $9,500 excluding shipping and
handling. Manufacturers indicated they
would require between three and 24 sets
to do certification testing.
DOE concluded that it would cost
about $500 to fabricate existing testing
structures. But manufacturers identified
significantly higher costs. AHAM’s
members consistently cited investments
to redesign entire lab stations and
expand facility space. These changes
would be needed to control for ambient
temperature at the tight levels DOE’s
test requires, cool test units, add new
equipment, and account for much
higher volumes of testing. AHAM also
believes that third party testing (for
certification only) could cost over
$2,500 per model. Table 5 details the
comprehensive costs.
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
66
21
543
166
$46,000
58,000
AHAM
$1,100,000
1,450,000
average consumers were outweighed by
the risk that certain consumers would
not realize the savings and the adverse
Overall per
company costs loss of industry net present value,
Cooktop full product line
among other things. Thus, DOE
AHAM
prescribed standards consisting of
prescriptive design standards, not
Labor costs (annual total sal1 $272,186
energy performance standards. As we
aries) .................................
Instrumentation (equipment
have commented previously, AHAM
2 376,635
for testing) .........................
does not believe anything has changed
3 84,200
Test pots (vessels) ...............
since 2009 to justify amended
4 368,100
Testing structures .................
standards.12 The available technology
Transducer (for ambient air
options have not changed. The energy
temp.) ................................
N/A
savings opportunities remain small.
Total ..................................
1,101,121 Thus, the cooktop test procedure is not
necessary and its burden is not balanced
Note: Overall costs may not align with per- by any benefit to consumers.
test costs due to reporting measures and
Given the extraordinary regulatory
averaging.
1 Annual
salary for full-time technicians burden the cooktop test procedure will
across multiple labs (1 to 5, up to 13 stations/ place on manufacturers, the procedure
chambers).
is an ideal candidate for repeal
1 Annual
salary for full-time technicians
across multiple labs (1 to 5, up to 13 stations/ consistent with Executive Order 13771,
TABLE 5—COMPREHENSIVE COSTS
chambers).
2 Specialized
equipment
(designed/purchased) to complete test procedure.
3 Companies require on average 3 sets of
test pots to be replaced over multiple years.
4 Combination of costs from third party labs,
certifications (UL/CSA/ISO), retrofitting existing
facilities.
The test and cost burden associated
with the cooktop test procedure is not
likely justified by any balancing benefit
to consumers or the environment. In
2009, DOE determined that none of the
trial standards levels that included
efficiency standards instead of just
prescriptive design standards had
benefits that were outweighed by the
economic burden that would be placed
on consumers. DOE found that the
potential economic savings realized by
PO 00000
Frm 00017
Fmt 4702
Sfmt 4702
12 See AHAM Comments on DOE’s Energy
Conservation Standards for Residential Cooking
Products, Request for Information; Docket No.
EERE–2014–BT–STD–0005; RIN 1904–AD15 (Apr.
14, 2014) (AHAM does not, however, believe that
energy conservation standards different from those
currently in place for conventional cooking
products are technologically feasible or
economically justified. There have been no
significant changes since the existing standards for
gas cooking tops and ‘‘no standard’’ standard for
other conventional cooking products were
promulgated that would result in justified
standards. The available technology options have
not changed, the energy savings opportunity
remains small, and consumer cooking behavior still
plays a significant role in the energy use of cooking
products. In addition, AHAM believes that the
introduction of new standards for cooking products
could have a significant impact on the utility of
cooking products . . .’’).
E:\FR\FM\25APP1.SGM
25APP1
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 / Proposed Rules
Reducing Regulation and Controlling
Regulatory Costs, which requires
agencies to repeal two regulations for
every new one issued and offset the
costs. Because, as AHAM has
demonstrated above, DOE’s cooktop test
procedure may be considered arbitrary
and capricious because it is not
supported by sufficient data and likely
has a high degree of total variation, the
test procedure does not benefit
consumers. It serves only to burden
manufacturers who must comply with a
test procedure that does not adequately
represent products and, due to
variation, will require manufacturers to
make conservative claims.
DEPARTMENT OF HEALTH AND
HUMAN SERVICES
CONCLUSION
SUMMARY:
daltland on DSKBBV9HB2PROD with PROPOSALS
Because AHAM’s testing shows that
DOE did not sufficiently demonstrate
that the cooktop test procedure is
repeatable or reproducible for gas and
electric cooktops, because DOE has yet
to demonstrate—as EPCA requires it to
do—that the final test procedure is
representative for gas cooktops, and
because the test procedure is unduly
burdensome to conduct, we respectfully
request that DOE withdraw the final
cooktop test procedure while
maintaining the repeal of the oven test
procedure that was part of this same
Final Rule. Even absent an energy
conservation standard for cooktops that
requires use of the test procedure,
manufacturers are required to report
energy use via a test procedure DOE has
not demonstrated is representative of
consumer use for all product types and
AHAM has demonstrated is not
reproducible. This means that reported
energy values for some products could
be inaccurate and, for all products, will
not be directly comparable to each other
across manufacturers. Thus, consumers
could be misled when evaluating and
comparing energy claims. Accordingly,
we also seek an immediate stay of the
effectiveness of the cooktop test
procedure, including the requirement
that manufacturers use the final test
procedure to make energy related
claims.
Respectfully submitted,
Association of Home Appliance
Manufacturers By:
Jennifer Cleary,
Senior Director, Regulatory Affairs, 1111 19th
St. NW, Suite 402, Washington, DC 20036,
202-872-5955 x314.
[FR Doc. 2018–08641 Filed 4–24–18; 8:45 am]
BILLING CODE 6450–01–P
VerDate Sep<11>2014
18:10 Apr 24, 2018
Jkt 244001
Food and Drug Administration
21 CFR Part 101
[Docket No. FDA–2018–D–0075]
The Declaration of Added Sugars on
Honey, Maple Syrup, and Certain
Cranberry Products: Draft Guidance
for Industry; Extension of Comment
Period
AGENCY:
Food and Drug Administration,
HHS.
Notification of availability;
extension of comment period.
ACTION:
The Food and Drug
Administration (FDA or we) is
extending the comment period for the
notification of availability of a draft
guidance for industry entitled ‘‘The
Declaration of Added Sugars on Honey,
Maple Syrup, and Certain Cranberry
Products: Guidance for Industry’’ that
appeared in the Federal Register of
March 2, 2018. The draft guidance,
when finalized, will advise food
manufacturers of our intent to exercise
enforcement discretion related to the
use in the Nutrition Facts label of a
symbol ‘‘†’’ immediately after the added
sugars percent Daily Value information
on certain foods. The symbol would
lead the reader to truthful and nonmisleading statements outside the
Nutrition Facts label to provide
additional information regarding the
added sugars present in particular
foods. We are taking this action in
response to requests for an extension to
allow interested persons additional time
to submit comments.
DATES: We are extending the comment
period on the document that published
in the Federal Register of March 2, 2018
(83 FR 8953). Submit either electronic
or written comments by June 15, 2018.
ADDRESSES: You may submit comments
as follows:
Electronic Submissions
Submit electronic comments in the
following way:
• Federal eRulemaking Portal:
https://www.regulations.gov. Follow the
instructions for submitting comments.
Comments submitted electronically,
including attachments, to https://
www.regulations.gov will be posted to
the docket unchanged. Because your
comment will be made public, you are
solely responsible for ensuring that your
comment does not include any
confidential information that you or a
third party may not wish to be posted,
such as medical information, your or
PO 00000
Frm 00018
Fmt 4702
Sfmt 4702
17961
anyone else’s Social Security number, or
confidential business information, such
as a manufacturing process. Please note
that if you include your name, contact
information, or other information that
identifies you in the body of your
comments, that information will be
posted on https://www.regulations.gov.
• If you want to submit a comment
with confidential information that you
do not wish to be made available to the
public, submit the comment as a
written/paper submission and in the
manner detailed (see ‘‘Written/Paper
Submissions’’ and ‘‘Instructions’’).
Written/Paper Submissions
Submit written/paper submissions as
follows:
• Mail/Hand delivery/Courier (for
written/paper submissions): Dockets
Management Staff (HFA–305), Food and
Drug Administration, 5630 Fishers
Lane, Rm. 1061, Rockville, MD 20852.
• For written/paper comments
submitted to the Dockets Management
Staff, FDA will post your comment, as
well as any attachments, except for
information submitted, marked and
identified, as confidential, if submitted
as detailed in ‘‘Instructions.’’
Instructions: All submissions received
must include the Docket No. FDA–
2018–D–0075 for ‘‘The Declaration of
Added Sugars on Honey, Maple Syrup,
and Certain Cranberry Products:
Guidance for Industry.’’ Received
comments will be placed in the docket
and, except for those submitted as
‘‘Confidential Submissions,’’ publicly
viewable at https://www.regulations.gov
or at the Dockets Management Staff
between 9 a.m. and 4 p.m., Monday
through Friday.
• Confidential Submissions—To
submit a comment with confidential
information that you do not wish to be
made publicly available, submit your
comments only as a written/paper
submission. You should submit two
copies total. One copy will include the
information you claim to be confidential
with a heading or cover note that states
‘‘THIS DOCUMENT CONTAINS
CONFIDENTIAL INFORMATION.’’ The
Agency will review this copy, including
the claimed confidential information, in
its consideration of comments. The
second copy, which will have the
claimed confidential information
redacted/blacked out, will be available
for public viewing and posted on
https://www.regulations.gov. Submit
both copies to the Dockets Management
Staff. If you do not wish your name and
contact information to be made publicly
available, you can provide this
information on the cover sheet and not
in the body of your comments and you
E:\FR\FM\25APP1.SGM
25APP1
Agencies
[Federal Register Volume 83, Number 80 (Wednesday, April 25, 2018)]
[Proposed Rules]
[Pages 17944-17961]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2018-08641]
========================================================================
Proposed Rules
Federal Register
________________________________________________________________________
This section of the FEDERAL REGISTER contains notices to the public of
the proposed issuance of rules and regulations. The purpose of these
notices is to give interested persons an opportunity to participate in
the rule making prior to the adoption of the final rules.
========================================================================
Federal Register / Vol. 83, No. 80 / Wednesday, April 25, 2018 /
Proposed Rules
[[Page 17944]]
DEPARTMENT OF ENERGY
10 CFR Parts 429 and 430
Energy Conservation Program: Test Procedures for Cooking
Products, Notification of Petition for Rulemaking
AGENCY: Office of Energy Efficiency and Renewable Energy, Department of
Energy.
ACTION: Notification of petition for rulemaking; request for comment.
-----------------------------------------------------------------------
SUMMARY: On March 26, 2018, the Department of Energy (DOE) received a
petition from the Association of Home Appliance Manufacturers (AHAM) to
withdraw, and immediately stay the effectiveness of, the conventional
cooking top test procedure. Through this notification, DOE seeks
comment on the petition, as well as any data or information that could
be used in DOE's determination whether to proceed with the petition.
DATES: Written comments and information are requested on or before June
25, 2018.
ADDRESSES: Interested persons are encouraged to submit comments,
identified by ``Test Procedure Cooking Products Petition,'' by any of
the following methods:
Federal eRulemaking Portal: https://www.regulations.gov. Follow the
instructions for submitting comments.
Email: [email protected]. Include the docket number
and/or RIN in the subject line of the message.
Mail: Appliance and Equipment Standards Program, U.S. Department of
Energy, Building Technologies Office, Mailstop EE-5B, 1000 Independence
Avenue SW, Washington, DC 20585-0121. If possible, please submit all
items on a compact disc (CD), in which case it is not necessary to
include printed copies.
Hand Delivery/Courier: Appliance and Equipment Standards Program,
U.S. Department of Energy, Building Technologies Office, 950 L'Enfant
Plaza SW, Suite 600, Washington, DC 20024. Telephone: (202) 586-6636.
If possible, please submit all items on a CD, in which case it is not
necessary to include printed copies.
Docket: For access to the docket to read background documents, or
comments received, go to the Federal eRulemaking Portal at https://www.regulations.gov.
FOR FURTHER INFORMATION CONTACT: Celia Sher, U.S. Department of Energy,
Office of the General Counsel, 1000 Independence Avenue SW, Washington,
DC 20585. E-mail: [email protected]; (202) 287-6122.
SUPPLEMENTARY INFORMATION: The Administrative Procedure Act (APA), 5
U.S.C. 551 et seq., provides among other things, that ``[e]ach agency
shall give an interested person the right to petition for the issuance,
amendment, or repeal of a rule.'' (5 U.S.C. 553(e)) DOE received a
petition from AHAM, as described in this document and set forth
verbatim below,\1\ requesting that DOE reconsider its final rule on
Test Procedures for Cooking Products, Docket No. EERE-2012-BT-TP-0013,
RIN 1904-AC71, 81 FR 91418 (Dec. 16, 2016) (Final Rule). In
promulgating this petition for public comment, DOE is seeking views on
whether it should grant the petition and undertake a rulemaking to
consider the proposal contained in the petition. By seeking comment on
whether to grant this petition, DOE takes no position at this time
regarding the merits of the suggested rulemaking or the assertions in
AHAM's petition.
---------------------------------------------------------------------------
\1\ Attachments and data submitted by AHAM with its petition for
rulemaking are available in the docket at https://www.regulations.gov/docket?D=EERE-2018-BT-TP-0004.
---------------------------------------------------------------------------
In its petition, AHAM requests that DOE undertake rulemaking to
withdraw the cooking top test procedure, while maintaining the repeal
of the oven test procedure that was part of the Final Rule. And, in the
interim, AHAM seeks an immediate stay of the effectiveness of the Final
Rule, including the requirement that manufacturers use the final test
procedure to make energy related claims. Should DOE continue to pursue
a revised cooking top test procedure, AHAM asserts that DOE should
address repeatability and reproducibility and demonstrate, through
round robin testing, that the test is repeatable and reproducible and,
for gas cooking tops, accurate. AHAM claims that its analyses show that
the test procedure is not representative for gas cooking tops and, for
gas and electric cooking tops, has such a high level of variation it
will not produce accurate results for certification or enforcement
purposes and will not assist consumers in making purchasing decisions
based on energy efficiency.
Although DOE welcomes comments on any aspect of the petition for
reconsideration, DOE is particularly interested in receiving comments
and views of interested parties concerning the following issues:
(1) The repeatability and reproducibility of the test procedure for
conventional electric and gas cooking tops. DOE previously presented
results from round robin testing completed by the Department and by IEC
in the docket of the test procedure rulemaking. DOE seeks comments on
that data as well as the new data AHAM has supplied supporting its
petition;
(2) The accuracy of determining the simmer setting and turndown
temperature;
(3) The impact of heating element cycling during the initial heat-
up phase of testing on the overall measured energy consumption of
electric cooking tops, and the prevalence of such cycling in units
available on the market.
(4) The extent of any warpage which may have been observed at the
bottom surface of test vessels during cooking top testing;
(5) The impact of varying gas burner and grate systems on the
representativeness of the water-heating test method for gas cooking
tops;
(6) The type of control system, heating element, and other product
redesigns necessitated by changes in safety standards for electric
cooking tops, and the impact of these new product designs on the
repeatability, reproducibility, and representativeness of the electric
cooking product test procedure;
(7) Characteristics of a representative test sample for electric
and gas cooking tops for use in any additional round robin testing to
evaluate the applicability of the test procedure to the conventional
cooking top market as a whole;
(8) Information on how consumers cook differently on gas cooktops
versus electric cooktops;
(9) Information on how consumers use the simmer setting on a gas
cooktop; and,
[[Page 17945]]
(10) The test burden associated with the test procedure for
conventional electric and gas cooking tops, including the ability of
testing laboratories to meet the required ambient test conditions.
Submission of Comments
DOE invites all interested parties to submit in writing by June 25,
2018 comments and information regarding this petition.
Submitting comments via https://www.regulations.gov. The https://www.regulations.gov web page will require you to provide your name and
contact information prior to submitting comments. Your contact
information will be viewable to DOE Building Technologies staff only.
Your contact information will not be publicly viewable except for your
first and last names, organization name (if any), and submitter
representative name (if any). If your comment is not processed properly
because of technical difficulties, DOE will use this information to
contact you. If DOE cannot read your comment due to technical
difficulties and cannot contact you for clarification, DOE may not be
able to consider your comment.
However, your contact information will be publicly viewable if you
include it in the comment or in any documents attached to your comment.
Any information that you do not want to be publicly viewable should not
be included in your comment, nor in any document attached to your
comment. Persons viewing comments will see only first and last names,
organization names, correspondence containing comments, and any
documents submitted with the comments.
Do not submit to https://www.regulations.gov information for which
disclosure is restricted by statute, such as trade secrets and
commercial or financial information (hereinafter referred to as
Confidential Business Information (CBI)). Comments submitted through
https://www.regulations.gov cannot be claimed as CBI. Comments received
through the website will waive any CBI claims for the information
submitted. For information on submitting CBI, see the Confidential
Business Information section.
DOE processes submissions made through https://www.regulations.gov
before posting. Normally, comments will be posted within a few days of
being submitted. However, if large volumes of comments are being
processed simultaneously, your comment may not be viewable for up to
several weeks. Please keep the comment tracking number that https://www.regulations.gov provides after you have successfully uploaded your
comment.
Submitting comments via hand delivery, or mail. Comments and
documents via hand delivery or mail will also be posted to https://www.regulations.gov. If you do not want your personal contact
information to be publicly viewable, do not include it in your comment
or any accompanying documents. Instead, provide your contact
information on a cover letter. Include your first and last names, email
address, telephone number, and optional mailing address. The cover
letter will not be publicly viewable as long as it does not include any
comments.
Include contact information in your cover letter each time you
submit comments, data, documents, and other information to DOE. If you
submit via mail or hand delivery, please provide all items on a CD, if
feasible. It is not necessary to submit printed copies. No facsimiles
(faxes) will be accepted.
Comments, data, and other information submitted electronically
should be provided in PDF (preferred), Microsoft Word or Excel,
WordPerfect, or text (ASCII) file format. Provide documents that are
not secured, written in English and free of any defects or viruses.
Documents should not include any special characters or any form of
encryption and, if possible, they should carry the electronic signature
of the author.
Campaign form letters. Please submit campaign form letters by the
originating organization in batches of between 50 to 500 form letters
per PDF or as one form letter with a list of supporters' names compiled
into one or more PDFs. This reduces comment processing and posting
time.
Confidential Business Information. According to 10 CFR 1004.11, any
person submitting information that he or she believes to be
confidential and exempt by law from public disclosure should submit via
email, postal mail, or hand delivery two well-marked copies: One copy
of the document marked confidential including all the information
believed to be confidential, and one copy of the document marked non-
confidential with the information believed to be confidential deleted.
Submit these documents via email or on a CD, if feasible. DOE will make
its own determination about the confidential status of the information
and treat it according to its determination.
Factors of interest to DOE when evaluating requests to treat
submitted information as confidential include (1) a description of the
items, (2) whether and why such items are customarily treated as
confidential within the industry, (3) whether the information is
generally known by or available from other sources, (4) whether the
information has previously been made available to others without
obligation concerning its confidentiality, (5) an explanation of the
competitive injury to the submitting person which would result from
public disclosure, (6) when such information might lost its
confidential character due to the passage of time, and (7) why
disclosure of the information would be contrary to the public interest.
It is DOE's policy that all comments may be included in the public
docket, without change and as received, including any personal
information provided in the comments (except information deemed to be
exempt from public disclosure).
DOE considers public participation to be a very important part of
its process for considering rulemaking petitions. DOE actively
encourages the participation and interaction of the public during the
comment period. Interactions with and between members of the public
provide a balanced discussion of the issues and assist DOE in
determining how to proceed with a petition. Anyone who wishes to be
added to DOE mailing list to receive future notifications and
information about this petition should contact Appliance and Equipment
Standards Program staff at (202) 586-6636 or via email at
[email protected].
Approval of the Office of the Secretary
The Secretary of Energy has approved publication of this
notification of petition for rulemaking.
Signed in Washington, DC, on April 18, 2018.
Daniel Simmons,
Principal Deputy Assistant Secretary, Energy Efficiency and Renewable
Energy.
Before the
UNITED STATES DEPARTMENT OF ENERGY
Office of Energy Efficiency and Renewable Energy
In the Matter of: Energy Conservation Program: Test Procedures
for Cooking Products
Docket No. EERE-2012-BT-TP-0013
RIN 1904-AC71
PETITION FOR RECONSIDERATION
The Association of Home Appliance Manufacturers (AHAM) respectfully
[[Page 17946]]
petitions the Department of Energy (DOE) for reconsideration of its
final rule on Test Procedures for Cooking Products, Docket No. EERE-
2012-BT-TP-0013 RIN 1904-AC71, 81 Fed. Reg. 91418 (Dec. 16, 2016)
(Final Rule).
AHAM believes that, overall, the adoption of a water-boil test
procedure for cooking products is the appropriate procedure. And we
thank DOE for making changes to its earlier proposed test procedure
which would have used a hybrid block after AHAM demonstrated the
practical difficulties associated with that test. But DOE adopted a
final cooktop test procedure too hastily, especially in light of
comments AHAM submitted that demonstrated the test's lack of
repeatability and reproducibility and questioned the use of a test
procedure meant for electric cooktops for gas cooktops. AHAM has
evaluated the Final Rule and conducted additional testing on gas
cooktops. Our analyses show that the test procedure is not
representative for gas cooktops and, for gas and electric cooktops, has
such a high level of variation it will not produce accurate results for
certification or enforcement purposes and will not assist consumers in
making purchasing decisions based on energy efficiency.
AHAM thus requests that DOE withdraw the cooktop test procedure.
And, in the interim, we seek an immediate stay of the effectiveness,
including the requirement that manufacturers use the final test
procedure to make energy related claims, of the cooktop test procedure.
Should DOE continue to pursue an improved cooktop test procedure, DOE
should address repeatability and reproducibility and demonstrate,
through round robin testing, that the test is repeatable and
reproducible and, for gas cooktops, representative.
FACTS
DOE began revisions to the cooktop test procedure with a notice of
proposed rulemaking on January 30, 2013 (January 2013 NOPR) in which
DOE proposed amendments to Appendix I to subpart B of 10 C.F.R. part
430 (Appendix I) that would allow for the measuring of active mode
energy consumption of induction cooking products. Specifically, DOE
proposed to require the use of test equipment--hybrid test blocks
comprised of an aluminum body and a stainless steel base--compatible
with induction technology.
AHAM objected to DOE's proposed amendments to the test procedure
because the amendments did not enhance the accuracy and/or
representativeness of the test procedure. See AHAM Comments on DOE's
Notice of Proposed Rulemaking on Test Procedures for Conventional
Cooking Products With Induction Heating Technology (April 15, 2013).
AHAM commented that any test procedure DOE adopts to measure induction
heating technology must be both repeatable and reproducible. Id. AHAM
cautioned that significant further study was necessary before DOE could
adopt a test procedure that accurately measures induction cooktop
energy efficiency. Id. More specifically, AHAM opposed the proposed
test procedure because the proposal had a number of technical problems
and ambiguities (e.g., ambiguous construction of hybrid test block);
DOE's data did not clearly identify one method (test block versus water
heating) as being preferable to the other for induction units; and the
proposed procedure would treat induction technology differently than
other technologies, thereby penalizing it. Id. AHAM also questioned
whether the test block method in general was representative of actual
consumer use. Id.
In response to stakeholder comments, DOE published a supplemental
notice of proposed rulemaking modifying its proposal. 79 Fed. Reg.
71894 (Dec. 3, 2014) (December 2014 SNOPR). DOE's modified proposal
maintained a hybrid test block approach despite AHAM's comments. DOE
proposed to add a layer of thermal grease between the stainless steel
base and aluminum body of the hybrid test block to facilitate heat
transfer between the two pieces, and DOE proposed additional test
equipment for electric surface units with large diameters and gas
cooking top burners with high input rates.
AHAM's comments on the December 2014 SNOPR raised serious concerns
about the hybrid test blocks and the thermal grease. See AHAM Comments
on DOE's Supplemental Notice of Proposed Rulemaking on Test Procedures
for Conventional Cooking Products (Feb. 2, 2015). AHAM also raised
questions about the testing of flexible cooking zone areas, testing
units with flexible concentric burner sizes, and the use of the
smallest dimension of a noncircular electric surface unit to determine
block size. Id.
Based on comments it received in response to the December 2014
SNOPR and a series of manufacturer interviews DOE conducted in February
and March 2015, DOE subsequently withdrew its proposal for testing
conventional cooktops with a hybrid test block in yet another
supplemental notice of proposed rulemaking. 81 Fed. Reg. 57374 (Aug.
22, 2016) (August 2016 SNOPR). In the August 2016 SNOPR, DOE instead
proposed to modify its procedure to incorporate by reference the
relevant sections of EN 60350-2:2013 ``Household electric cooking
appliances Part 2: Hobs--Methods for measuring performance,'' which
uses a water-heating test method to measure energy consumption of
electric cooktops. Despite the fact that the EN test procedure DOE
cited applies only to electric cooktops, DOE also proposed to extend
that method to gas cooktops.
AHAM generally agreed and continues to agree with DOE that the best
test method for cooktops is a water boil test and supported DOE's
abandoning of the hybrid test block method. See AHAM Comments on DOE's
SNOPR on Test Procedures for Cooking Products (Sept. 21, 2016).
Nevertheless, AHAM commented extensively on potential sources of
variation with DOE's proposed procedure that needed to be resolved
before DOE finalized a cooktop test procedure. Id.
Prior to DOE proposing a water-heating test, AHAM conducted a round
robin based on the Second Edition of IEC 60350-2 (2015), Household
Electric Cooking Appliances--Part 2: Hobs--Methods for Measuring
Performance. Id. The AHAM round robin consisted of four units
encompassing a different combination of controls and heating elements.
Id. AHAM assessed radiant, coil, and induction heating elements as well
as infinite and step controls. Participating labs performed at least
three full tests on the three electric technologies. The results
demonstrated that the procedure was not reproducible from lab to lab.
AHAM data demonstrated significant variation in the proposed test
procedure--coefficients of variation of 9.2 percent for electric
radiant cooktops, 7.1 percent for electric coil cooktops, and 8.4
percent for induction cooktops. Id.
Based on that testing, AHAM commented that a significant amount of
work remained to be done to finalize a test and to demonstrate that the
final test is repeatable and reproducible. Id. Specifically, AHAM
listed a number of items that needed to be resolved, including several
potential sources of test procedure variation, before DOE could
finalize the test procedure, and requested that DOE issue a notice of
data availability or supplemental notice of proposed rulemaking to
provide stakeholders with an opportunity to comment:
Lack of a tolerance on staying ``as close as possible'' to
90[deg] C;
[[Page 17947]]
Variability in energy consumption during the simmering
phase;
Variability in determining the turn down temperature;
Variability in determining the turn down setting;
Unit cycling;
Specifying a temperature sensor for measuring the water
temperature;
A proposal to use a moving average for calculating the
final result;
Limited suppliers of test pots;
No tool or tolerance specified for cooktop diameter
measurement;
Test pots do not accommodate all grate designs;
Difficulty with placement of pots on gas cooktops;
Impact of gas burner system, geometry, spacing, and grates
on repeatability and reproducibility;
Impact of using the electric test pots on gas cooktops;
and
Overshoot temperature of the water can reach beyond
90[deg] C for some gas cooktops. Id.
AHAM also requested that DOE indicate how the changes to the test
procedure would impact the proposed standards and allow stakeholders
additional time to comment on those proposed standards based on the
test procedure changes. Id.
In response to AHAM's comments, DOE sent AHAM a request for data on
September 27, 2016. That data request was voluminous and overlapped
with the comment period on the proposed standards for cooking
products--which ended on November 2, 2016--and DOE proposed in parallel
with the August 2016 SNOPR. See Energy Conservation Program: Energy
Conservation Standards for Residential Conventional Cooking Products,
Supplemental Notice of Proposed Rulemaking; 81 Fed Reg. 60784 (Sept. 2,
2016). Nevertheless, AHAM worked to answer DOE's questions and, on
November 23, 2016, filed a detailed response, including a significant
amount of raw data DOE requested which AHAM submitted to Navigant
Consulting under a confidentiality agreement. See AHAM Comments on
DOE's SNOPR on Test Procedures for Cooking Products (dated Nov. 22,
2016).\1\ AHAM informed DOE in advance that it would be submitting the
response. Despite having asked for that data and having been informed
AHAM would be providing it, DOE issued a final test procedure on that
same day, November 23, 2016, which it published on December 16, 2016.
---------------------------------------------------------------------------
\1\ We hereby incorporate into this petition by reference all
data AHAM submitted to DOE and Navigant as part of the test
procedure rulemaking.
---------------------------------------------------------------------------
The Final Rule adopted DOE's proposed test procedure with some
changes DOE believed would improve repeatability and reproducibility.
In support of the final test procedure, DOE conducted additional
testing. DOE conducted testing of five electric cooktops incorporating
different heating technologies and control types. For each unit, DOE
conducted testing on surface units capturing a range of heating element
sizes. DOE conducted two to three tests per surface unit. For each
individual test, DOE performed the full surface unit test method,
including the preliminary test required to determine the turndown
temperature and simmering setting for a given surface unit. DOE varied
test operators for surface unit tests, but did not conduct testing in
different laboratories. In addition, DOE included test results from
previous tests of these units conducted in support of the August 2016
SNOPR. DOE relied on that minimal data to determine that the final test
procedure, finalized only two months after DOE received voluminous
comments from AHAM concerning a lack of repeatability and
reproducibility as demonstrated through 27 tests on three units at
three different laboratories.
ARGUMENT
The Energy Policy and Conservation Act of 1975, as amended (EPCA)
requires that test procedures be reasonably designed to produce test
results which measure energy efficiency, energy use, or estimated
annual operating cost of a covered product during a representative
average use cycle and shall not be unduly burdensome to conduct. 42
U.S.C. Sec. 6293(b)(3). This requirement is meaningless if the test
procedure is not repeatable and reproducible--only a repeatable and
reproducible test procedure can produce accurate results that DOE can
rely on for certification and verification purposes and that consumers
can rely on to compare energy use or efficiency across products.
AHAM appreciates that DOE made changes from the August 2016 SNOPR
to the Final Rule in an attempt to address AHAM's September 21, 2016
comments. AHAM also appreciates that DOE conducted additional testing
to further assess the proposed and final test procedure. But DOE did
not take the time or do the work necessary to finalize a test procedure
that fully or satisfactorily addresses the significant issues AHAM
raised in its comments or the data AHAM provided in response to DOE's
request. This is further demonstrated based on additional testing and
analysis AHAM conducted after the Final Rule was published.
DOE did not support the Final Rule with sufficient data to
demonstrate that it is accurate, repeatable, and reproducible. More
specifically, as discussed more fully below:
[squ] DOE has not demonstrated that the test procedure is
representative for gas products. DOE did not demonstrate that its
deviation from the international approach--testing gas cooktops using a
different procedure than is used for testing electric cooktops--was
warranted or would produce accurate, representative results. And DOE
tested only a small sample that cannot be representative of the many
different types of gas models on the market and the result is that the
test may not adequately address the different systems available to
consumers. Thus, DOE has not demonstrated that the test procedure is
representative or accurate for gas products.
[squ] DOE's testing of electric and gas cooktops was insufficient
to evaluate repeatability and reproducibility and, thus, DOE's
conclusions are based on results with a low confidence level which is
highlighted by AHAM's conflicting results. Accordingly, DOE did not
produce sufficient evidence to demonstrate that its test procedure is
supported by data.
[squ] Although DOE tried to address variation by requiring
recording of the simmering setting selection, AHAM's testing
demonstrates that that requirement does not in fact reduce variation.
[squ] Although DOE attempted to clarify when the simmering period
starts, DOE's clarification does not adequately reduce variation.
[squ] DOE improperly dismissed unit cycling's contribution to
variation.
[squ] DOE did not account for the fact that electric coil cooktops
are currently undergoing significant redesign to comply with voluntary
safety standards. It is possible that the new products will not respond
the same way to the test.
[squ] DOE did not investigate the impact of pan warpage on test
results. Initial data from a study done for AHAM shows pan warpage will
contribute to variation.
[squ] Based on data from a round robin AHAM conducted with gas
cooktops, the test procedure is not repeatable or reproducible for gas
cooktops. Within unit and between unit variation also contributes to
the total variation and DOE has not accounted for it.
In addition, the test procedure is unduly burdensome to conduct.
Based on AHAM's experience to date, it takes on average 20 hours to
conduct a single test on a four burner cooktop and requires the testing
of every single
[[Page 17948]]
burner or element individually. And, because the test requires the
technician to determine the turn-down temperature before every test and
the ambient conditions are quite tight, several runs are often required
before a valid run can be achieved. Our testing, which is described
more fully below, found that some tests took upward of five days for a
single cooktop. Moreover, the test cost is much higher than DOE
concluded in its Final Rule on both an up-front and ongoing basis.
Because the final test procedure may not be representative for gas
products and is not repeatable or reproducible for either gas or
electric cooktops, it does not accurately measure cooktop energy
efficiency and will not allow consumers to compare products on that
basis. Thus, because the test is also unduly burdensome to conduct, the
cooktop test procedure as a whole does not meet EPCA's statutory
requirement that test procedures be reasonably designed to produce
representative results and are not unduly burdensome to conduct.
Moreover, because DOE did not support the conclusions in the Final Rule
with sufficient data, DOE's Final Rule could be determined to be
arbitrary and capricious. Accordingly, AHAM respectfully requests that
DOE withdraw the Final Rule amending the cooktop test procedure. And,
in the interim, we seek an immediate stay of the effectiveness,
including the requirement that manufacturers use the final test
procedure to make energy related claims, of the Final Rule. To be
clear, AHAM is not seeking reconsideration regarding DOE's decision to
repeal the oven test procedure.
I. DOE Has Not Demonstrated That The Test Procedure Is Representative
for Gas Cooktops.
In the August 2016 SNOPR, DOE proposed to extend the electric test
procedure in EN 60350-2:2013 ``Household electric cooking appliances
Part 2: Hobs--Methods for measuring performance'' to gas cooktops. AHAM
commented in its September 21, 2016 comments that there is no consumer
data on the consumer representativeness of that method for gas
cooktops. AHAM noted that DOE's proposal, and now Final Rule, is not
harmonized with the European approach, which uses a different test
procedure and different test pots to test gas cooktops. DOE's
methodology is also different than ASTM F152, ``Standard Test Methods
for Performance of Range Tops,'' which DOE reviewed during the test
procedure rulemaking and is used by the commercial range industry. DOE
dismissed ASTM F1521 because of the BTU range for commercial range
tops, and AHAM is not arguing that it is the appropriate procedure for
residential products. But the science behind the test setup in ASTM is
similar to the EN gas test procedure which demonstrates that the basic
methodology for testing gas products is well established.
Accordingly, no manufacturer or third party test laboratory--in the
U.S., Europe, or elsewhere in the world--had experience with DOE's
proposed test procedure for gas cooktops other than DOE's minimal
testing in one laboratory prior to the publishing of the Final Rule.
Thus, neither DOE nor manufacturers have knowledge of whether this test
will be representative for gas products. Accordingly, DOE does not have
the necessary data to justify the use of this method on gas cooktops in
the United States, especially in light of the fact that Europe uses a
different approach.
In fact, AHAM believes that the evidence supports the opposite
conclusion--i.e., that the cooktop test procedure is not representative
for gas cooktops. The EN and ASTM standards use a different test
procedure for gas cooktops and do so for good reason. Unlike electric
cooktops, gas cooktops utilize a system approach--every component and
design choice is connected to other components and design choices and
they work together. The cooking heat out to the pot depends on the
design of the burner, flow of gas, mass of the grate, and height of the
grate from the burner.
Gas testing is a science, and DOE did not do sufficient study to
determine whether the electric test procedure it adopted would measure
representative results for gas cooktops:
1. First, the purpose behind EN 60350-2:2013 was to establish a
test to determine minimum energy for electric cooktops. The reason that
the working group that developed the test decided to assess simmer for
electric cooktops was to show the distinction in energy use between the
different electric technologies, i.e. induction, radiant. For electric
cooktops, technology has an impact on how much energy is used to get to
boil and also how much energy it uses to keep a simmer temperature.
Thus, some technologies may appear to be more or less efficient if just
a time to boil was assessed. For electric, the simmer portion of the
test is needed to accurately show the cooktop's energy use and to allow
comparison across the product types. Figure 1 below shows how the test
distinguishes between electric technologies.\2\
---------------------------------------------------------------------------
\2\ CECED, 2012.
---------------------------------------------------------------------------
[[Page 17949]]
[GRAPHIC] [TIFF OMITTED] TP25AP18.006
2. In an attempt to keep one test method, DOE extended this
electric method to gas cooktops. AHAM appreciates the attempt to reduce
the number of test methods. But, in this case, there is no reason to
use one type of test. There are not different types of gas technologies
and so a simmer period is not needed to differentiate between
technologies as it is in electric. The significant added burden of
including the simmer setting (and the variation it introduces) is not
likely balanced by a benefit in terms of energy savings.
In addition, most consumers likely replace their cooktops with the
same fuel that is already in their home. Based on a 2010 study
conducted for AHAM, the vast majority of consumers surveyed replaced
their cooktops and ranges with a similar unit. According to the study,
nearly nine in ten households that bought a freestanding single oven
range did a direct replacement. Homeowners were even more likely to do
a direct replacement of this type of appliance, at 94 percent.\3\ So,
it is unlikely that consumers are comparing gas and electric products.
---------------------------------------------------------------------------
\3\ Bellomy Research for AHAM, 2010 Major Appliance Consumer
Research Survey, Cooking Appliances (2010).
---------------------------------------------------------------------------
3. The best comparison for comparing gas cooktops to other gas
cooktops would be based on a simple bring to boil test, which is what
Europe and the ASTM methods both use. DOE is the first to reinvent the
wheel and require gas and electric cooktops to be tested in the same
way.
4. On a gas unit, there is very little overshoot which means there
is no retained heat. Electric cooktops, on the other hand, often have a
significant amount of retained heat. A gas cooktop's ability to
maintain simmer in the absence of retained heat is largely a function
of grate to burner relationships, burner design, valve design, and pan
position. This relationship is not accounted for in the electric
cooktop test because it does not need to be. But it does need to be
addressed in a test applicable to gas cooktops.
5. More so than electric elements, gas burners are designed for a
specific cooking purpose. For example:
a. Small or semi-rapid burners are typically used for simmering.
This simmering performance is developed for melting chocolate and fine
sauces, not keeping water simmering.
b. Ultra rapid or rapid burners are designed to reduce time to
boil, or for frying. Often flame stability suffers at low rates, making
simmering results poor.
c. Other high input burners are designed for rapid cooking (i.e.
Wok) and are not designed for simmering.
Each of these burner types have been optimized in design to serve a
particular cooking function for consumers. Thus, it may not make sense
to apply a water boil test to all of them. For example, a consumer
would not likely boil water on the small/semi-rapid burner that is
meant to be used for melting chocolate or cooking fine sauces--the time
to boil on such a burner would be extremely long, perhaps 40 minutes.
In addition to not being representative, the test will drive
significant variation in the assessment because DOE did not address
this in the test procedure. DOE did, however, address this issue for
electric cooktops--the test procedure removes certain burners from
assessment.
6. Additionally, because DOE extended a test meant for electric
cooktops to gas cooktops, the test does not require preheating of the
gas burner. A gas system will change rates and how
[[Page 17950]]
it performs as it warms. The European test for gas products has a 10
minute preheat because the working group that developed that test found
that preheating improved the representativeness of the test results as
well as repeatability and reproducibility. The ASTM test has a 30
minute stabilization period at 50 percent heat for the same reason.
Thus, DOE's failure to include preheating in the gas test ignores the
wisdom generated by other groups' extensive testing and experience and
likely contributes to the high degree of variation we describe below.
7. The pots specified by the European electric test are different
than the pots used in the European gas cooktop test. The gas pots are
Aluminum test pans having a matt base and polished walls--that material
is of the highest level of conduction. The electric test pans are a
very thick stainless steel plate (6 mm) with thin stainless walls (1
mm) that are joined by a heat resistant glue. The pan construction is
significantly different which will have an impact on heat transfer from
the burner to the pan. The pot spacing of the large flat corner pans
designed for electric cooktops will perform differently with the gas
burners compared to the EN specified Aluminum pots and will not drive
representative results. A gas flame heats a pot differently and this
should be accounted for in the test.
DOE did not assess a sufficient variety of gas cooktop designs to
conclude that the test procedure it adopted is representative for gas
products, especially in light of Europe's use of a different procedure
for residential gas products. As highlighted above, the residual heat
loss of a gas burner on simmer is significantly different than simmer
on electric unit where the electric unit retains heat from the cooktop.
DOE also has specified stainless steel pans whereas the European
procedure for gas cooktops uses Aluminum, which has a higher level of
conduction. The pan construction is also different which will have an
impact on heat transfer from the burner to the pan.
AHAM has not been the only commenter to question the
representativeness of extending the European electric test procedure to
gas cooktops. During the test procedure rulemaking, Southern California
Gas Company, San Diego Gas and Electric, and Southern California Edison
(collectively, the Southern California investor-owned utilities (SoCal
IOUs)) commented that DOE should conduct a sensitivity analysis of the
impact of ambient temperature and pressure conditions on the test
results for gas and electric cooking products in order to ensure
consistent test results across various regions, climates, and
altitudes. In addition, the SoCal IOUs commented that validating the
ambient condition requirements would address the impact of the proposed
correction to the gas heating value to standard temperature and
pressure conditions. DOE responded only that it incorporated the
ambient air pressure and temperature conditions specified in EN 60350-
2:2013 and thus believed that the results ``should not'' be impacted by
tests being conducted in different locations.\4\ But DOE did not do any
additional testing to determine if that is in fact the case and, as
discussed below in Section II, AHAM's testing demonstrates
reproducibility issues which could be attributed, in part, to these
differences. Moreover, efficiency for a gas cooktop depends heavily on
the external environment, much more so than for electric products.
Simmering is, thus, not the right parameter to measure the ability to
keep the control in this technology. That is yet another reason why the
European gas test does not include the simmer setting--it will be
variable and inaccurate.
---------------------------------------------------------------------------
\4\ See Final Rule, 81 Fed. Reg. 91418, 91434 (Dec. 16, 2016).
---------------------------------------------------------------------------
In addition, the U.S. market consists of a wide array of grate and
burner offerings to consumers and DOE did not sufficiently assess those
offerings in developing the test procedure. DOE itself acknowledged 283
gas configurations.\5\ Yet DOE tested only five units. The varying
designs available to consumers, most of which DOE did not assess, have
offerings of a sealed/unsealed burner, stacked burner, different burner
shapes, a range of grate weight and shape, and different grate
materials. DOE has not shown that the test procedure is repeatable and
reproducible for the different designs on the marketplace. For DOE to
conclude these issues do not exist simply because it did not observe
them in its small test sample is illogical. DOE made assumptions that
are not supported by sufficient data and are in direct conflict with
the technical support for the European gas test and ASTM standard which
drove those procedures to have a pre-heat requirement, to exclude a
simmer assessment, and to use specifically constructed Aluminum pans.
Until and unless DOE can demonstrate that data show the cooktop test
procedure is representative of actual U.S. consumer use of gas cooktops
and will deliver accurate results, DOE should withdraw the test
procedure. Keeping it in place will very likely result in inaccurate
information to consumers and is contrary to EPCA's and the
Administrative Procedure Act's requirements.
---------------------------------------------------------------------------
\5\ Id. At 91438 (``DOE surveyed 335 electric cooking tops and
283 gas cooking tops available on the market in the United
States.'').
---------------------------------------------------------------------------
II. DOE Has Not Demonstrated That The Test Procedure Is Repeatable or
Reproducible For Gas Cooktops.
A. Lab to Lab Variation
Because of the short comment period on the August 2016 SNOPR, AHAM
was not able to conduct a round robin to assess the repeatability and
reproducibility of the test procedure for gas products. And DOE had no
data regarding repeatability or reproducibility upon which to rely. DOE
instead relied on a European Committee of Domestic Equipment
Manufacturers (CECED) round robin conducted five years ago on electric
cooktops. But, that round robin is irrelevant. As discussed above,
Europe does not extend its electric cooktop test procedure to gas
cooktops for good reason. DOE would be the first to do that. Thus,
there is no historical data for that test procedure. Therefore, AHAM
commented that DOE should evaluate its proposed procedure even more
carefully and in more detail than the electric cooktop test procedure.
Repeatability and reproducibility cannot be established based only on
DOE's limited within lab testing and complete lack of lab to lab
testing.
In order to address AHAM's concerns, DOE conducted investigative
testing on gas cooktops in support of the Final Rule. DOE conducted
testing on five gas cooking tops that covered a range of burner input
rates, installation widths (two 30 inch and three 36 inch), burner
quantities (two four burner, three six burner), and grate weights. To
evaluate variation in the test, DOE conducted two to three tests on
each burner. For each individual test, DOE performed the full test
method, including the preliminary test required to determine the
turndown temperature and simmering setting for a given burner. DOE also
included test results from previous testing conducted in support of the
August 2016 SNOPR. The coefficient of variation DOE observed for the
measured AEC for its test sample was, on average 1.0 percent. DOE also
noted that the average per-cycle energy consumption coefficient of
variation for each burner was 1.7 percent.
DOE based its Final Rule conclusions regarding total variation of
the entire plethora of cooktops in the marketplace on only this meager
five unit sample
[[Page 17951]]
and a simulated round robin. DOE's testing did not truly test
reproducibility from lab to lab because DOE simply used different
technicians for some of its tests. DOE did not conduct testing on the
same units in different labs. It makes sense that under those
conditions--using the same laboratory equipment and test technicians
trained in the same laboratory--variation would be lower. Moreover,
this assessment looks at within lab variation and not total variation.
As discussed below regarding DOE's electric cooktop testing, DOE's
testing is insufficient to support a conclusion that the test procedure
for gas cooktops is repeatable and reproducible and, thus, is
insufficient to support the final test procedure.
Moreover, because DOE tested such a small sample the confidence
level of its results is low (the same is true for electric cooktops).
For a sample size of five, trying to represent the millions of units
that will be produced and the tens of different labs that will be doing
testing this inherently has a large margin of error as shown in Figure
2.\6\
---------------------------------------------------------------------------
\6\ See, e.g., www.surveysystem.com.
[GRAPHIC] [TIFF OMITTED] TP25AP18.007
Based on this sample size, results can vary plus or minus 26
percent. We fully understand that a larger sample size is a function of
cost and that there are limitations on the amount of further testing
that can be done. Nevertheless, it is important not to lose sight of
the fact that DOE's sample size results in as much as 50 percent in
variation on the expected results. Thus, it is no surprise that AHAM's
testing has shown significant variation that DOE's did not. This large
confidence interval, which the difference between DOE's and AHAM's test
results bear out, further supports AHAM's request that DOE withdraw the
cooktop test procedure. A test procedure that could be required to
demonstrate compliance with possible energy conservation standards
should not be finalized with such a high confidence interval,
particularly when conflicting data has been provided to highlight this
high confidence interval. At a minimum, this demonstrates that DOE's
data alone and when added together with AHAM's data raises significant
questions about whether the test is repeatable and reproducible. Thus,
DOE's Final Rule is not supported by adequate data and could be
considered arbitrary and capricious.
Moreover, as with electric cooktops and discussed more fully below,
DOE did not engage stakeholders--either manufacturer labs or third
party labs--in its assessment of the Final Rule. Thus, based on DOE's
testing, neither DOE nor stakeholders have any idea what the actual
test procedure total variation is.
In order to assess whether the final test procedure for gas
cooktops is repeatable and reproducible, after DOE issued the final
test procedure rule, AHAM conducted a round robin on gas cooktops. It
is likely that even more testing would be helpful in better
understanding both the test procedure and its variation, but these
results are enough to demonstrate that there is sufficient doubt
regarding the gas cooktop test procedure's accuracy such that DOE
should withdraw it.
AHAM's gas cooktop round robin included four units (two cooktops
and two ranges), with a range of product types.\7\ Four labs tested the
burners with the highest and lowest burner input rates (i.e., one high
capacity and one low capacity burner was tested for each unit).\8\ Each
burner was tested three times each using the procedure specified in the
DOE Final Rule. Labs recorded the simmering setting selection for the
energy test cycle and the first laboratory marked the turn down
temperature. AHAM's test plan is attached in Exhibit B and AHAM
provided Navigant with raw data under a confidentiality agreement.
---------------------------------------------------------------------------
\7\ A summary of the test unit characteristics is attached at
Exhibit B and data in Exhibit C.
\8\ Unit A was tested by five labs.
---------------------------------------------------------------------------
We note that some of the tests could not meet the specified ambient
temperature requirements. Specifically, some of the laboratories were
not able to hold the ambient temperature as required during the
duration of the test. Manufacturers ran the tests in the tightest
environments that are currently available at +/-5 [deg]F in their
laboratories. The Final Rule requires new equipment to maintain +/-2
[deg]F, which is difficult or, in some cases, impossible to do in
existing laboratories. Section IV below further discusses this point.
The labs that ran the tests have been approved by the safety
certification bodies and Canadian Energy Verification organization. We
removed the most errant runs and included the test data to show the
variation that was noticeable during our tests as it is representative
of the current lab capability. Importantly, improving the ability to
maintain ambient temperature will involve significant upgrades to
laboratories, which will add cost and burden for manufacturers.
As mentioned above, AHAM's test plan called for running the test
differently than the DOE test by having the first laboratory mark the
turn down temperature it used. AHAM understands that this is not fully
[[Page 17952]]
consistent with DOE's test procedure. But, because the test procedure
is unduly burdensome to conduct, as discussed below, this method was
necessary to reduce the test burden--reducing the number of possible
settings for the cooktop was seen as a worthwhile experiment.
Importantly, it was not always possible for laboratories to use the
marked temperature and so, in several instances, laboratories followed
DOE's test procedure to the letter. In the end, only half of the labs
were able to follow AHAM's test plan. The other half ran the test
according to the DOE test procedure as written. Our data below
differentiates these methods by referring to the tests that used the
marked turndown temperature as the ``truncated test'' or ``preset.''
The DOE test procedure tried to address some of the variation that
is not controllable in the methodology of its burdensome test
procedure--e.g., heating values, different ambient temperatures,
equipment, and technicians. AHAM's methodology was an effort to
determine if the extra burden aimed at reducing that variation reduced
it enough to justify the extra time, labor, and cost. Our conclusion:
it is not. Although neither method showed results with an acceptable
level of variation, the runs that used the truncated test resulted in
less variation. Regardless, the results cast significant doubt on DOE's
small amount of supporting data for the Final Rule and support AHAM's
request that DOE withdraw it.
Good lab practice is that within lab variation should clearly be
less than two percent. For current data acceptance programs within the
appliance industry, it is common practice that data between labs should
be no more than three percent variation. DOE's data within its own lab
fell within the target zone for variation for four of the five units
DOE tested. DOE did not test at different labs, so the Final Rule is
not based on any accurate lab-to-lab data showing an acceptable range
of lab-to-lab variation.
AHAM's round robin shows similar results to DOE's in terms of
within lab variation. Significantly, however, as shown in Table 1, lab-
to-lab variation considerably exceeds the three percent maximum lab-to-
lab variation target regardless of whether the full DOE test was run or
the truncated test was run.
Table 1--AHAM Gas Round Robin Summary Results
--------------------------------------------------------------------------------------------------------------------------------------------------------
Coefficient of Coefficient of
Average annual variation --1 variation across
Cooking unit Width Number of Minimum input Maximum input energy lab multiple labs
burners rate (Btu/hr) rate (Btu/hr) consumption (repeatability) (reproducibility)
(kBtu/yr) (%) (%)
--------------------------------------------------------------------------------------------------------------------------------------------------------
AHAM A--set......................... 36 5 8,000 18,000 936.3 0.89 3.60
AHAM A--Preset...................... .............. .............. .............. .............. 918.7 0.68 2.30
AHAM B.............................. 30 4 5,000 15,000 1,034.1 9.20 17.10
AHAM B--Preset...................... .............. .............. .............. .............. 870.1 1.70 13.50
AHAM C.............................. 30 4 5,000 15,000 843.1 2.70 12.50
AHAM C--Preset...................... .............. .............. .............. .............. 827.9 1.80 7.00
AHAM D.............................. 30 5 5,500 18,000 1,077.2 0.78 12.00
AHAM D--Preset...................... .............. .............. .............. .............. 1,123 1.59 12.00
--------------------------------------------------------------------------------------------------------------------------------------------------------
This highlights the significant gap in the data DOE used to justify
the rule. DOE assumed that low variation in one lab means repeatability
and reproducibility across labs. But AHAM's round robin demonstrates
that this is not the case. Our round robin shows reproducibility is not
present in the current procedure as demonstrated by only one of the
three units, Unit A, having an acceptable coefficient of variation
across labs. Notably, the low input rate on that burner is 8,000 BTU.
AHAM units B, C, and D all have low capacity burner rates of or about
5,000 BTU. DOE only tested one of its five units with a low capacity
burner at 5,000 BTU. DOE's coefficient of variation for that model was
1.40 percent. Some of the best AHAM single lab coefficients of
variation for models at that rate are 0.78, 1.59, 1.70, and 1.80
percent. The AHAM data would appear to agree that one lab can repeat
the same results, but that is not the full story.
Focusing on the units with low simmer rates and digging deeper into
the data, AHAM's data show the following:
[GRAPHIC] [TIFF OMITTED] TP25AP18.008
On all units except one, Unit B, the repeatability on the
high capacity burner within the lab had acceptable variation but the
reproducibility across labs did not. Overall, on the high capacity
burner, the variation was higher using the DOE test procedure than it
was using the truncated test and none of the variation was within an
acceptable range from lab-to-lab.
[[Page 17953]]
On all units, the repeatability on the low capacity burner
was marginal--25 percent of the time the variation was greater than the
two percent maximum target. There is a distinct difference in the low
capacity variation and the three units that had simmer at or near 5,000
BTU had significant repeatability and reproducibility issues. In some
cases, using the truncated test actually improved lab-to-lab variation.
This demonstrates that the burden associated with determining the turn
down temperature in DOE's full test procedure is not always justified--
it does not categorically improve repeatability and reproducibility.
Thus, not only is DOE's final test procedure rule unsupported by
sufficient data to demonstrate its reproducibility, but it is also
unduly burdensome to conduct. In addition, this highlights the weakness
in the DOE test procedure which conducts a water boil and simmer test
on small burners that are not meant for either purpose. As discussed
above in Section I, those burners are designed to provide a simmer only
cooking function for melting chocolate and cooking sauces, not for
boiling or simmering water.
B. Within Unit And Between Unit Variation
DOE did not evaluate or account for variation within units. There
are issues inherent in testing gas cooktops and ranges that contribute
significantly to within unit variation. For example, heating value, gas
pressure, and atmospheric pressures all have an impact. More
specifically, as atmospheric pressure changes due to weather, test
results will vary even on the same unit from day to day. Also, gas
pressure and atmospheric pressure can vary from run to run, and that
can have an impact on how the gas is mixing within the burner port
which then impacts burner combustion and energy creation. Moreover,
heating values vary within a lab on a daily basis and likely vary
greatly between labs. Thus, the same unit tested on different days in
the same lab or in different labs will not perform the same unless the
heating value of the gas is the same. That is statistically unlikely
because values vary every day. It is not likely that the heating value
is 1075, so there is a conversion from what it actually was to 1075 and
this artificial adjustment induces variation. Each of these factors,
among others, individually and collectively contribute to variation
from test to test and DOE has made no effort to understand the impact
of these factors.
This inherent variation in gas cooking product testing has been
known for decades and is the reason the safety test, ANSI Z21.1,
requires certified technicians to drill testing orifices. The drilling
of orifices achieves precise rates for nominal, high, and low values.
Experience shows that certified gas technicians can dial in the precise
values for assessment by using number sized drills but there are also
factors the technician must manage in this process such as burrs from
the drilling. AHAM is not suggesting that DOE require testing orifices
be drilled for purposes of energy testing--the burden is significant to
say the least and would make the test unduly burdensome to conduct.
Although such burden is justified for purposes of ensuring the safety
of cooking products, which carry inherent safety risks, it is not
justified for purposes of energy testing. And, because safety testing
is not similar to energy testing (for example, cooktops are tested on
high for hours and products are over-stressed in abnormal conditions),
it is not possible to re-use the units tested for safety purposes for
energy testing.
In addition, neither DOE nor AHAM have evaluated or accounted for
the additional variation inherent in producing gas products, i.e.,
between unit variation. This is significant because it will add further
variation on top of the within lab variation, lab to lab variation, and
within unit variation. In order to ensure compliance with any future
energy conservation standard, manufacturers will have to take this
total variation into account. The result will likely be that it becomes
difficult or impossible to meet standards because the buffer needed to
ensure accurate ratings will require levels of efficiency that are not
economically justified or technologically feasible. AHAM explored this
concept in more detail in its comments on DOE's proposed standards,
which we hereby incorporate by reference.\9\
---------------------------------------------------------------------------
\9\ AHAM Comments on DOE's SNOPR for Energy Conservation
Standards for Residential Conventional Cooking Products; Docket No.
EERE-2014-BT-STD-0005; RIN 1904-AD15 (Nov. 2, 2016).
---------------------------------------------------------------------------
One of the test requirements that will vary within the unit is the
simmer setting on gas products. Subsequent to AHAM's round robin, Lab
Three conducted some additional investigative testing to determine
whether using the same simmering setting improves repeatability. The
lab used two different operators to test a unit and provided both with
the same instructions, which are identified in Exhibit A. The test plan
was as follows:
1. Operator F conducted the test and found the simmer setting and
gas flow;
2. Operator M conducted the test independently and found a simmer
setting and gas flow;
3. Operator M repeated the test using the Operator F simmer
setting; and
4. Operator F repeated the test using the Operator M simmer
setting.
The results show that technicians are likely to be able to work to
achieve passing results on their own efforts to determine a simmering
setting. But when given the target setting, the results show that it is
likely that different technicians cannot recreate a first technician's
passing result about half of the time.
The data also highlight that there are more issues with finding the
right simmer setting on low capacity burners--the Lab Three technicians
each failed the first time they tried to set the low capacity burner.
Also, see in Exhibit A where an additional experiment was run with one
of Lab Four's technicians developing the simmer setting without using
the previously provided information. This resulted in different energy
average and lower variation values between the two Lab 4 technicians.
According to these results, relying on a given setting actually
increased variation and retests due to failing performance. Thus,
though recording the turn down temperature as required by the Final
Rule may help understand differences in results between labs, it does
not reduce variation. And it does not seem that simply following the
test procedure to the letter, as DOE suggested in response to AHAM's
comments and discussed in Section II below, reduces variation. AHAM's
test results demonstrate that additional efforts to reduce variation on
turndown settings were unsuccessful--even standardizing the simmering
setting does not drive sufficient variation reduction. (Moreover, for
gas products, it will not be possible to specify turndown settings for
gas products due to orifice variation, which is discussed in more
detail below). Accordingly, because DOE's final test procedure does not
sufficiently reduce total variation, DOE should withdraw the cooktop
test procedure.
C. Full Population and Total Variation
As stated previously, DOE's small sample size could not address the
full population or total variation. Table 2 below lists the units have
been tested to the final test procedure as specified
[[Page 17954]]
from both DOE's sample and AHAM's sample and Figure 3 shows the samples
and their results graphically.
Table 2--DOE and AHAM Test Samples Combined
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Coefficient of Coeffiecient of
Minimum Maximum Grate Average annual variation --1 variation across
Cooking unit Width Number of input rate input rate Burner configuration Grate type weight per energy lab multiple labs
burners (Btu/hr) (Btu/hr) burner lbs) consumption (repeatability) (reproducibility)
(kBtu/yr) (%) (%)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
DOE 1............................ 30 4 9,000 9,000 open................ Steel-wire.......... 0.5 640.4 2.40 N/A
DOE 2............................ 30 4 5,000 15,000 Sealed.............. Cast Iron........... 3.7 854.4 1.40 N/A
DOE 3............................ 36 6 18,000 18,000 Sealed--stacked..... Cast Iron........... 4.4 974.8 0.40 N/A
DOE 4............................ 36 6 9,200 15,000 Sealed--stacked..... Cast iron-- 5.8 963.5 0.30 N/A
Continuous.
DOE 5............................ 36 6 15,000 18,500 Sealed.............. Cast iron-- 7 893.1 0.30 N/A
Continuous.
AHAM A........................... 36 5 8,000 18,000 Sealed--stacked?.... Cast iron-- ? 936.3 0.89 3.60
Continuous.
AHAM B........................... 30 4 5,000 15,000 Sealed.............. Cast Iron........... ? 1,034.1 9.20 17.10
AHAM C........................... 30 4 5,000 15,000 Sealed.............. Cast Iron........... ? 843.1 2.70 12. 5
AHAM D........................... 30 5 5,500 18,000 Sealed.............. Cast Iron........... ? 1,077.2 0.78 12.00
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[GRAPHIC] [TIFF OMITTED] TP25AP18.009
Figure 3 shows the units tested and what their AAEC number is
versus their lowest burner capacity rating. It highlights how skewed
the DOE sampling was, especially as compared to AHAM's. As discussed
above in Section I, DOE identified that nearly half of the models in
the market had a 5,000 BTU burner. Yet, DOE selected only one unit with
a burner of that capacity. Aside from the fact that DOE's sample
inadequately represents the market, this demonstrates that DOE's test
procedure will produce inaccurate results for most of the gas products
on the market. The test has a high degree of variation for those
products, as shown above, and, thus, the test will not allow consumers
to compare across products.
Neither DOE nor AHAM have evaluated or accounted for the all of the
variation inherent in producing gas products, i.e., total variation
across the population. It is a large task and assuming the small amount
of work applies to the total picture is not acceptable and further
supports the withdrawal of the test procedure.
III. DOE Has Not Demonstrated That The Test Procedure Is Repeatable Or
Reproducible For Electric Cooktops.
As discussed above, in response to the August 2016 SNOPR, based on
round-robin testing, AHAM identified several sources of potential
variation that needed to be resolved prior to DOE finalizing a cooktop
test procedure. DOE conducted additional testing in order to evaluate
AHAM's concerns and made clarifications to attempt to address many of
them. Unfortunately, DOE's testing was not sufficient to demonstrate
that the final test procedure significantly reduced the high degree of
total variation AHAM identified in its comments. AHAM does not agree
that the final test procedure is sufficiently repeatable and
reproducible. Accordingly, AHAM respectfully requests that DOE withdraw
the cooktop test procedure.
A. DOE's Testing
DOE did not do enough testing to verify that its clarifications
resulted in a final test procedure that is repeatable and reproducible
and, so, the Final Rule is not supported by sufficient data. DOE
conducted testing of five electric cooktops incorporating different
heating technologies (one coil element cooktop, two radiant element
cooktops, and two induction cooktops) and control types (four with step
controls and one with infinite). For each unit, DOE conducted testing
on surface units capturing a range of heating element sizes. DOE
conducted two to three tests per surface unit. For each individual
test, DOE performed the full surface unit test method, including the
preliminary test required to determine the turndown temperature and
simmering setting for a given surface unit. DOE varied test operators
for surface unit tests, but did not test at different laboratories. DOE
also included test results from previous tests of these units conducted
in support of the August 2016 SNOPR.
AHAM appreciates that DOE conducted this testing. But it is not
enough to justify finalizing the test procedure. DOE did not complete
full tests--it tested only two to three burners. Although that is
helpful in assessing potential variation, AHAM is
[[Page 17955]]
concerned that DOE would finalize a rule based on the results of only
partial tests.
DOE's testing demonstrates a low average coefficient of variation
of 1.2 percent. It is uncertain whether those results are accurate
given that DOE did assess the full IAEC for an entire cooktop. But,
assuming that the partial tests do give a reasonable understanding of
repeatability and reproducibility, DOE has not identified why DOE's
coefficient of variation was so much lower than AHAM's.
One potential reason is that DOE's testing did not truly test
reproducibility from lab to lab--DOE simply used different technicians
for some of its tests. DOE did not conduct testing on the same units in
different labs. It makes sense that under those conditions--using the
same laboratory equipment and test technicians trained in the same
laboratory--variation would be lower. DOE's test parameters did not
accurately simulate reproducibility. The simulation run by DOE only
changed the test technician. It is unclear from DOE's analysis if those
technicians had previous knowledge of the procedure or were allowed to
imprint their interpretation on the execution of the test. DOE did not
simulate running the test with different equipment and a different
environment, as would be run in a true round robin.
Conversely, AHAM's tests were conducted on the same units in three
(now four) different laboratories. Those laboratories have different
technicians with different training, different equipment, and,
potentially, different interpretations of the test procedure. These
true round robin conditions are far more likely to reveal ambiguity in
the test and sensitivities that cause variation. They also replicate a
real scenario--one lab attempting to verify the results of a different
lab. As discussed above in Section II, the testing conducted to date,
necessarily, has a low confidence level and the differences between
AHAM's and DOE's results demonstrate that. AHAM's testing resulted in
significantly higher variation than DOE's and the large confidence
interval that results supports AHAM's request for DOE to withdraw the
cooktop test procedure.
Moreover, DOE did not engage stakeholders--either manufacturer labs
or third party labs--in its assessment of the Final Rule. Thus, based
on DOE's testing, neither DOE nor stakeholders have any idea what the
actual total test procedure variation is. The test laboratory DOE used
to run the tests in support of the proposed and final rules will not be
a lab that regularly runs the test procedure when reporting and/or
compliance with standards is potentially required. (The labs that
participated in AHAM's round robin, will, of course, be conducting
testing to demonstrate compliance with any potential future standards).
Thus, because DOE's reproducibility testing is essentially theoretical
and only simulates a round robin test, DOE's testing is helpful, but
not enough to determine the repeatability and reproducibility of the
test.
B. Determining the Simmering Setting
AHAM commented that there is variability in determining the
simmering setting for the simmering phase of the test and noted that
the simmering setting plays an important role in the overshoot
temperature and the ability to maintain a temperature as close as
possible to 90 [deg]C during the simmering phase of the test.
DOE responded that it expects that correctly following the
methodology--starting with the lowest simmering setting and repeating
the test as necessary with the next highest setting until the setting
that maintains the water temperature above, but as close as possible to
90 [deg]C, is identified--will result in only a single appropriate
simmering setting for a given surface unit.
DOE agreed with AHAM that the selection of the simmering setting
has a significant impact on the overall energy consumption of a surface
unit and amended Appendix I to require that the simmering setting
selection for the energy test cycle of each cooking area/zone be
recorded. AHAM appreciates that DOE required recording the simmering
setting selection--it will help in enforcement/verification actions to
understand differences in test results. Unfortunately, recording the
setting will do nothing to decrease variation or prevent false findings
of potential noncompliance.
AHAM acknowledges that in its initial round robin, laboratories did
not start at the lowest simmering setting--laboratories started at the
lowest setting they believed would be able to maintain a water
temperature above and as close as possible to 90 [deg]C. AHAM is a
proponent of conducting the test that way in order to reduce test
burden which, as discussed further below, is already significant.
Nevertheless, in order to understand if variation would decrease by
following the letter of the test procedure as DOE suggested in the
Final Rule, AHAM, in conducting a round robin on gas cooktops, required
participating laboratories to (a) follow the DOE test procedure for
selection of the simmering setting; (b) record their simmering setting;
and (c) for the first lab, mark the turn down temperature on the unit
itself.\10\ Our data, which are discussed above in Section II, show
that following the letter of the test procedure does not sufficiently
reduce variation. In particular, lab-to-lab variation remains high for
gas cooktops and AHAM's round robin testing for electric cooktops
provided data to support a conclusion that it is likely also high for
electric cooktops. DOE did not adequately address AHAM's concern in its
Final Rule and AHAM's gas testing casts further doubt on this question.
---------------------------------------------------------------------------
\10\ Results of the AHAM gas round robin are discussed in
Section II.
---------------------------------------------------------------------------
AHAM incorporates by reference the data we submitted to DOE during
the rulemaking regarding our electric round robin, which is summarized
in the below tables. These data highlight that the simmer setting is a
significant source of variation. Because DOE has not yet adequately
addressed it, and, thus has not sufficiently demonstrated that its test
procedure is valid, DOE should withdraw the cooktop test procedure.
[[Page 17956]]
[GRAPHIC] [TIFF OMITTED] TP25AP18.012
C. Spiking Temperatures When Reaching 90 [deg]C
AHAM commented that our round robin demonstrated difficulty in
determining when the water temperature first reaches 90 [deg]C to start
the 20-minute simmering phase of the test because, when the temperature
first reaches that temperature, it may oscillate slightly above or
below it. DOE's testing showed similar fluctuations. Thus, DOE amended
Appendix I to clarify that the 20-minute simmering period starts when
the water temperature first reaches 90 [deg]C and does not drop below
90 [deg]C for more than 20 seconds after initially reaching 90 [deg]C.
AHAM thanks DOE for making this clarification which seems like it
could reduce variation. DOE's testing--completed in a single lab and
with technicians trained in the same lab--does not, however, adequately
demonstrate that this clarification sufficiently reduces variation and
improves reproducibility. AHAM's members were not able to dedicate
resources to re-performing a round robin to verify DOE's findings on a
single unit. Without knowing whether total variation has, in fact, been
reduced, DOE should not have finalized the test procedure and DOE
cannot rely on assumptions that this change will reduce total
variation--to do so could be considered arbitrary and capricious. Total
variation is made up of within lab and between lab variations AND
within and between units variations. DOE only addressed some of the
within lab variation causes, meaning that other causes of variation are
unaddressed. DOE does not have sufficient data to demonstrate that the
test procedure is reproducible and should withdraw the test.
D. Heating Element Cycling
AHAM commented that cycling of power to the heating element is
unpredictable and causes variation in test results. It is unknown if
the surface unit will cycle the heating element off during a critical
phase of the test--i.e., at the start of the simmering phase or when
determining the simmering setting. In response to DOE's September 27,
2016 data request, AHAM provided further data on how this was observed
during our testing. DOE could not have reviewed or considered that data
in drafting the Final Rule given that the Final Rule was issued the
same day AHAM provided the data. AHAM incorporates the data we
submitted on November 23, 2016, in this petition by reference.
DOE did, however, examine its own data. DOE indicated that it
observed only one electric smooth-radiant cooktop in its sample for
which the heater cycled on and off during the heat-up phase of the
test. That particular unit cycled back on within a few seconds of
cycling off and, as a result, the water temperature continued to rise
at a ``fairly steady state.'' Thus, DOE concluded that it was
infrequent for heating elements to cycle during the heat-up phase and,
so, it was unlikely that other electric smooth-radiant cooktops would
require any substantive amount of heating element cycling to protect
the glass surface. DOE indicated that it did not expect any measurable
impacts of heating element cycling on the total measured per-cycle
energy consumption.
DOE based its conclusions on the single unit in its sample and is
guessing that because only one unit in its small sample did not cycle
on and off during the heat-up phase, it must not occur frequently and/
or if it does, it will not have a measurable impact on the total per-
cycle energy consumption. But AHAM also observed element cycling during
its testing. Thus, in only the small amount of testing conducted in the
U.S. to date, unit cycling during the heat-up phase has been observed
twice.
[[Page 17957]]
That is not insignificant. Almost 20 percent of units in the combined
AHAM and DOE tested sample experienced unit cycling.
Moreover, AHAM submitted additional data to DOE regarding the unit
cycling it observed. As mentioned in that data submission, AHAM tested
two eight-inch coil elements on different cooktops with the same model
number to evaluate unit to unit variation. One cooktop cycled during
the T70 turndown test and the other did not. The unit that cycled
resulted in a higher turn down temperature when compared to the test
that did not cycle. The unit did not cycle on either test run during
the final T90 simmer test. The high Tc value caused one test run to
have a higher overshoot and allowed for a lower turn down during the
simmer phase driving unit to unit variation. This resulted in 36 watts
less power on the unit with the lower turn down. This is six percent of
the normalized power level. Six percent is not insignificant and
demonstrates the potential difference between the energy measured on
two units of the same construction. DOE should withdraw the Final Rule
for cooktops and review and consider the data AHAM submitted. This
issue must be addressed in order to reduce total variation.
Furthermore, DOE did not address the arguments AHAM made about the
uncertainty regarding how unit cycling will impact test results and
test burden--this is a significant concern and could drive redesign of
products. Heating element cycling is key to cooking performance for
electric ranges because the algorithm that governs heating element
cycling controls the temperature of the food being cooked. If the
temperature is not properly maintained, the consistency of the food can
change. Moreover, for smooth top electric ranges, heating element
cycling also serves a safety function. Such cooktops are equipped with
a glass break sensor to monitor temperature. That sensor will dictate
when a unit needs to cycle down to avoid glass breakage. AHAM is
concerned that the test procedure, as finalized by DOE, could drive
changes to the algorithm for heating element cycling design. Any such
changes will result in significant product development efforts which
have not been accounted for in DOE's test procedure rulemaking. A test
procedure change should not dictate this sort of design change simply
to manage uncertainty and variation.\11\
---------------------------------------------------------------------------
\11\ It is possible, for example, consumers often jump from one
side (rolling boil) to the other side (boil action lost) a couple of
times before they understand where to set the dial to maintain their
desired simmering temperature. If manufacturers make the dials more
precise in order to reduce variation in the energy test, that could
result in more settings and consumers could change back and forth
more times because they see less impact in adjusting the knob. This
could actually drive consumers to use more energy in the field.
Accordingly, DOE should examine potential unintended consequences of
addressing this uncertainty.
---------------------------------------------------------------------------
For these reasons, DOE should withdraw the cooktop test procedure
due to total variation that is not fully understood and, from available
data, appears to be at an unacceptable level.
E. Upcoming New Cooktop Designs
As AHAM has commented to DOE many times, Underwriters Laboratory
(UL) Standard 858 will soon require a new test for electric coil
element cooktops. The change to the voluntary safety standard, which
AHAM developed and proposed to UL with the support of the Consumer
Product Safety Commission, will require electric coil element cooktops
and ranges to monitor and limit pan bottom temperature and is aimed at
reducing the incidences of unattended cooking fires. It represents a
major redesign for all electric coil cooktops by every manufacturer.
The change will be required to show compliance on coil cooktops with
the updated voluntary safety standard as of June 15, 2018.
Given the date of this requirement, it is certain that any cooktop
standard DOE may promulgate (and AHAM opposes any change to the
existing standards for conventional cooking products) would apply to
these newly designed products. But, because these products are still in
development, DOE has not done testing on products using these controls
and neither have manufacturers. Because company designs to comply with
the UL 858 requirements may involve cycling of the element, it is quite
possible that heating element cycling will be different than it is for
existing products. Thus, DOE's data, even as supplemented by AHAM's
data, on heating element cycling may be irrelevant because it does not
represent products that will be on the market if the test is required
to demonstrate compliance with possible energy conservation standards.
As shown in Figure 4, initial data, based on testing conducted by
Primaria LLC to develop UL 858's new requirements, show that though
time to boil water may not increase significantly using temperature
limiting controls on coil cooktops, the difference could be enough to
further impact the current assumptions on variation. And, the control
cycling could be somewhat different as well. DOE should understand how
the energy test will respond to these new technologies.
[[Page 17958]]
[GRAPHIC] [TIFF OMITTED] TP25AP18.010
F. Pan Warpage
Although DOE sought feedback on the degree to which the heating
element or cookware may deform and impact the heat transfer between the
two surfaces in its rulemaking on energy conservation standards for
cooktops, DOE did not investigate the impact of pan warpage on the
repeatability and reproducibility of the test procedure.
The UL 858 test for coil cooktops initially required use of an
aluminum pan. But, based on manufacturer experience doing significant
testing, AHAM proposed a cast iron alternative to aluminum pans for the
test. UL published this update in August of 2017. The shift is to
account for warping and the variation and lack of repeatability it is
driving in the safety assessment. There is no reason to believe this
variation will not also extend to energy testing.
The data from the UL 858 work with Primaira show that any variation
in pans of the same type will drive variation that the energy testing
has not yet shown because the pans have yet to warp substantially.
Significantly, using a warped stainless steel pan on a ceramic cooktop
did increase the boil time with the cooktop fire mitigation control
active (that control cycles the element on and off per an algorithm).
And, warpage on stainless steel pans style will cause a difference in
energy use on units without a limiting control as shown in Figure 5.
DOE's failure to further investigate this issue means that its test
procedure is not adequately supported.
[[Page 17959]]
[GRAPHIC] [TIFF OMITTED] TP25AP18.011
IV. The Cooktop Test Procedure Is Unduly Burdensome To Conduct.
The discussion in the sections above highlights several significant
burdens associated with conducting DOE's cooktop test procedure that
AHAM believes make it unduly burdensome to conduct. Specifically:
The test procedure takes about 20 hours for an average
four burner cooktop and requires the testing of every single burner or
element individually. And, because the test requires the technician to
determine the turn-down temperature before every test and the ambient
conditions are quite tight, several runs are often required before a
valid run can be achieved. Our testing found that some tests took
upward of five days for a single cooktop.
As indicated by AHAM's truncated gas test plan, it is
burdensome to determine the turn down temperature for each individual
test and burner. And doing so does not serve any purpose as it appears
that it does not decrease variation.
The ambient temperature requirements are incredibly tight
and it is difficult or impossible for some laboratories to meet them
without investing in lab improvements. Some companies had difficulty
maintaining the ambient conditions and AHAM could not use their data in
its round robin results.
Test pots will warp during testing and will need to either
be repaired or replaced frequently.
The test procedure variation means that manufacturers will
need to add a larger than usual ``buffer'' to any eventual energy
conservation standards ratings, which will effectively increase the
stringency of any future standard, probably by a large amount.
In addition to the test burden itself, there is also substantial
cost associated with the test procedure. DOE determined that the test
procedure would cost $700 per test for labor, with a one-time
investment of $2,000 for new test equipment, which was split between
test pots and other instrumentation. AHAM collected data from its
members on the cost of the test procedure, both ongoing and initial
investments. This data is based on company experience with the test
through AHAM's round robins and in testing in Europe, on the number of
models each company has, and on the potential need for third party
testing. AHAM's data show that DOE significantly underestimated the
cost associated with running the cooktop test procedure.
Table 3 below shows the difference between DOE's estimates in the
Final Rule and AHAM's data.
Table 3--Per Test Costs (DOE Estimate v. AHAM Data)
----------------------------------------------------------------------------------------------------------------
Cooktop full product line One time (initial year) On-going (annual)
----------------------------------------------------------------------------------------------------------------
Per test costs (per manufacturer) DOE AHAM DOE AHAM
----------------------------------------------------------------------------------------------------------------
Labor Costs..................................... $700 $970 .............. $970
Instrumentation (equipment for testing)......... 15 1,432 .............. \1\ 38
Test pots (vessels)............................. 152 113 .............. \2\ 209
Testing structures.............................. 8 159 .............. \3\ 43
Transducer (for ambient air temp.).............. 2 N/A .............. 0
---------------------------------------------------------------
Total....................................... 876 2,673 700 1,260
----------------------------------------------------------------------------------------------------------------
Note: On average, 543 tests will be required to certify companies' full product lines.
[[Page 17960]]
\1\ This includes equipment maintenance (new/existing and calibrations for testing equipment).
\2\ Manufacturers will require ongoing replacement of test pots due to warping.
\3\ This includes increased/new annual costs from third party labs and/or UL and ISO (re) certification.
One of the significant differences between DOE's estimate and
AHAM's data is the total number of tests required and the number of
models to be tested. It is difficult for manufacturers to determine at
this stage how many basic models they would have. DOE's proposed energy
conservation standards for cooktops, which AHAM strongly opposes, would
be the first time manufacturers would need to certify compliance with
standards and determine basic models. To do that may require testing of
all models in order to determine likely model families, particularly
because cooking products are complex. It will be difficult to determine
which models can be grouped together in a basic model. That said, AHAM
understands that not each individual model will need to be tested.
Thus, it is likely that something between DOE's estimate and AHAM's
data would be the actual average total number of models tested.
Nevertheless, the difference in the number of tests and number of
models to be tested is shown below in Table 4. DOE cost estimations
(particularly for labor) are on a per-test basis. As described above,
it is difficult to determine the total number of tests to be performed
in the initial year. Comparing the DOE estimation of number of tests to
AHAM member data shows a signficant difference or wide range. As a
result, total costs are substantially higher when considering the
average number of tests required according to AHAM member data.
Table 4--Average Number of Tests and Models To Be Tested
----------------------------------------------------------------------------------------------------------------
Estimated total cost
Tests/models comparison DOE AHAM -------------------------------
DOE AHAM
----------------------------------------------------------------------------------------------------------------
Average total number of tests required.......... 66 543 $46,000 $1,100,000
Average total number of models tested........... 21 166 58,000 1,450,000
----------------------------------------------------------------------------------------------------------------
Another important difference is that DOE did not address upfront
investments made in order for manufacturers to be able to perform the
test procedure. But those costs should not be ignored. Manufacturers
identified significant investments in specialized equipment to perform
the test procedure successfully. For example, all respondants to AHAM's
survey expressed frustration in obtaining the necessary test pots
because the supplier is overseas. Acquiring even one set is difficult,
as AHAM has discussed in previous comments, and the cost is about
$9,500 excluding shipping and handling. Manufacturers indicated they
would require between three and 24 sets to do certification testing.
DOE concluded that it would cost about $500 to fabricate existing
testing structures. But manufacturers identified significantly higher
costs. AHAM's members consistently cited investments to redesign entire
lab stations and expand facility space. These changes would be needed
to control for ambient temperature at the tight levels DOE's test
requires, cool test units, add new equipment, and account for much
higher volumes of testing. AHAM also believes that third party testing
(for certification only) could cost over $2,500 per model. Table 5
details the comprehensive costs.
Table 5--Comprehensive Costs
------------------------------------------------------------------------
Overall per
company costs
Cooktop full product line ---------------
AHAM
------------------------------------------------------------------------
Labor costs (annual total salaries)..................... \1\ $272,186
Instrumentation (equipment for testing)................. \2\ 376,635
Test pots (vessels)..................................... \3\ 84,200
Testing structures...................................... \4\ 368,100
Transducer (for ambient air temp.)...................... N/A
---------------
Total................................................. 1,101,121
------------------------------------------------------------------------
Note: Overall costs may not align with per-test costs due to reporting
measures and averaging.
\1\ Annual salary for full-time technicians across multiple labs (1 to
5, up to 13 stations/chambers).
\2\ Specialized equipment (designed/purchased) to complete test
procedure.
\3\ Companies require on average 3 sets of test pots to be replaced over
multiple years.
\4\ Combination of costs from third party labs, certifications (UL/CSA/
ISO), retrofitting existing facilities.
The test and cost burden associated with the cooktop test procedure
is not likely justified by any balancing benefit to consumers or the
environment. In 2009, DOE determined that none of the trial standards
levels that included efficiency standards instead of just prescriptive
design standards had benefits that were outweighed by the economic
burden that would be placed on consumers. DOE found that the potential
economic savings realized by average consumers were outweighed by the
risk that certain consumers would not realize the savings and the
adverse loss of industry net present value, among other things. Thus,
DOE prescribed standards consisting of prescriptive design standards,
not energy performance standards. As we have commented previously, AHAM
does not believe anything has changed since 2009 to justify amended
standards.\12\ The available technology options have not changed. The
energy savings opportunities remain small. Thus, the cooktop test
procedure is not necessary and its burden is not balanced by any
benefit to consumers.
---------------------------------------------------------------------------
\12\ See AHAM Comments on DOE's Energy Conservation Standards
for Residential Cooking Products, Request for Information; Docket
No. EERE-2014-BT-STD-0005; RIN 1904-AD15 (Apr. 14, 2014) (AHAM does
not, however, believe that energy conservation standards different
from those currently in place for conventional cooking products are
technologically feasible or economically justified. There have been
no significant changes since the existing standards for gas cooking
tops and ``no standard'' standard for other conventional cooking
products were promulgated that would result in justified standards.
The available technology options have not changed, the energy
savings opportunity remains small, and consumer cooking behavior
still plays a significant role in the energy use of cooking
products. In addition, AHAM believes that the introduction of new
standards for cooking products could have a significant impact on
the utility of cooking products . . .'').
---------------------------------------------------------------------------
Given the extraordinary regulatory burden the cooktop test
procedure will place on manufacturers, the procedure is an ideal
candidate for repeal consistent with Executive Order 13771,
[[Page 17961]]
Reducing Regulation and Controlling Regulatory Costs, which requires
agencies to repeal two regulations for every new one issued and offset
the costs. Because, as AHAM has demonstrated above, DOE's cooktop test
procedure may be considered arbitrary and capricious because it is not
supported by sufficient data and likely has a high degree of total
variation, the test procedure does not benefit consumers. It serves
only to burden manufacturers who must comply with a test procedure that
does not adequately represent products and, due to variation, will
require manufacturers to make conservative claims.
CONCLUSION
Because AHAM's testing shows that DOE did not sufficiently
demonstrate that the cooktop test procedure is repeatable or
reproducible for gas and electric cooktops, because DOE has yet to
demonstrate--as EPCA requires it to do--that the final test procedure
is representative for gas cooktops, and because the test procedure is
unduly burdensome to conduct, we respectfully request that DOE withdraw
the final cooktop test procedure while maintaining the repeal of the
oven test procedure that was part of this same Final Rule. Even absent
an energy conservation standard for cooktops that requires use of the
test procedure, manufacturers are required to report energy use via a
test procedure DOE has not demonstrated is representative of consumer
use for all product types and AHAM has demonstrated is not
reproducible. This means that reported energy values for some products
could be inaccurate and, for all products, will not be directly
comparable to each other across manufacturers. Thus, consumers could be
misled when evaluating and comparing energy claims. Accordingly, we
also seek an immediate stay of the effectiveness of the cooktop test
procedure, including the requirement that manufacturers use the final
test procedure to make energy related claims.
Respectfully submitted,
Association of Home Appliance Manufacturers By:
Jennifer Cleary,
Senior Director, Regulatory Affairs, 1111 19th St. NW, Suite 402,
Washington, DC 20036, 202-872-5955 x314.
[FR Doc. 2018-08641 Filed 4-24-18; 8:45 am]
BILLING CODE 6450-01-P