Answer to Commentary on “Systematic review about complementary medical hyperthermia in oncology” by Liebl et al.

Before turning to the arguments of the authors of the letter, we would like to make the scientific reader aware of the deep conflict of interest of the authors of the letter. The methods of hyperthermia we addressed in our systematic review, namely electrohyperthermia or whole-body hyperthermia (“alternative hyperthermia”), are methods, which are not within the lines of the internationally consented preconditions for hyperthermic treatment in oncology. At least in our country, these alternative methods are widespread and cancer patients have to pay for such treatments. Producing and selling the equipment as well as offering such treatment is a commercial business. Secondly, the results of our systematic review are in line with the national guideline on complementary medicine (German S3 Cancer Guideline Program) which are systematically developed and based on the highest level of current evidence. The results of the search and assessment of the studies have been evaluated and discussed by the leading experts in the field in Germany and the resulting recommendation in the guideline is (translated in English): Data are available from 2 RCTs and 2 cohort studies on the efficacy and toxicity of electrothermia and whole-body hyperthermia in oncology patients. Electrotherapy and whole-body hyperthermia should not be performed outside of studies in these patients to reduce mortality or diseaseassociated or therapy-associated morbidity. [1] Arguments 1–4

Before turning to the arguments of the authors of the letter, we would like to make the scientific reader aware of the deep conflict of interest of the authors of the letter.
The methods of hyperthermia we addressed in our systematic review, namely electrohyperthermia or whole-body hyperthermia ("alternative hyperthermia"), are methods, which are not within the lines of the internationally consented preconditions for hyperthermic treatment in oncology. At least in our country, these alternative methods are widespread and cancer patients have to pay for such treatments. Producing and selling the equipment as well as offering such treatment is a commercial business.
Secondly, the results of our systematic review are in line with the national guideline on complementary medicine (German S3 Cancer Guideline Program) which are systematically developed and based on the highest level of current evidence. The results of the search and assessment of the studies have been evaluated and discussed by the leading experts in the field in Germany and the resulting recommendation in the guideline is (translated in English): Data are available from 2 RCTs and 2 cohort studies on the efficacy and toxicity of electrothermia and whole-body hyperthermia in oncology patients. Electrotherapy and whole-body hyperthermia should not be performed outside of studies in these patients to reduce mortality or diseaseassociated or therapy-associated morbidity. [1] Arguments 1-4 Considering the topic of our systematic review we made it quite clear and transparent that we only focus on what we called "complementary hyperthermia" and we defined the included treatment methods. The argument of the authors that only a more comprehensive definition of hyperthermia would be suitable for a systematic review is incorrect and an accusation of "crude methodology" only reveals that the authors' definition on evidence-based medicine widely differs from ours. (Any systematic review on chemotherapy or any other treatment in oncology would also focus on a subset.) The subset of hyperthermic methods chosen for our review is of high interest and relevance to physicians and patients especially as they "do not meet the defined quality criteria of the European Society of Hyperthermic Oncology [Ref. 25-30 in our article]. Despite not meeting these preconditions, the methods are offered to patients and as they run under the naming of hyperthermia, even for oncologists it is hard to differentiate. Informing physicians and patients on the highly relevant difference and assessing the clinical evidence for these methods was the task in the national guideline on complementary medicine (German S3 Cancer Guideline Program [1]).
In fact, one of the authors of the commentary and author of studies included in our review writes: "Within the mEHT concept non-thermal (energy-dependent) effects are supposed to provide the dominant sensitization effects. As the temperature increase is limited and the temperature is not considered a key parameter in this concept, there is no need to measure it." (Minnaar et al.,Ref 52 in our systematic review).
Considering the terminology complementary/alternative hyperthermia: The authors of the letter use an old fashioned definition of alternative medicine as this not only comprises methods used instead of conventional treatment but also those used alongside but without evidence.

Argument 5
The authors argue that for evidence tables, combining WBH and EH in one table is not suitable as these two methods are highly different. This once again points to some deficits in the author's knowledge on evidence-based medicine. The criteria for assessment of risk of bias and evidence are internationally defined and only refer to the type of study. It is absolutely necessary to always apply these criteria. We agree that if we had had enough data from well-designed clinical studies to conduct a meta-analysis, using subgroups for WBH and EH would have been suitable. However, this data is missing.

Argument 6
For all studies, we provide comprehensive data on the type of tumor and treatment. This is also the case for side effects as in the study by Fiorentine et al. [56 of the original article).

Argument 7
The argument of selective reporting of adverse events is not valuable at all. In fact, especially in case of missing positive evidence any hint at side effects and risks is of high clinical importance for decision-making for physicians and patients.

Argument 8
We thank the authors for their list of studies they believe we missed in our search. In fact, we considered all mentioned articles in our search but excluded them due to different reasons, we add in the table. As most probably the authors got mixed up with the reference numbers, as the Reference [2] of the Letter is an unsystematic review, we corrected the numbers (Table 1).

Argument 9
In our categorization, we followed the information in the articles. We used a highly differentiated assessment for the different study types according to internationally consented rules.

Argument 10
Considering arguments in 10, we highly recommend to refer to the latest classification of level of evidence. A randomized study is not level 1b per se but only in case of high methodological quality. If this is not the case, it is considered level 2b. A minus signals, that there are some drawbacks to the study which makes it a weak candidate for the respective level. We spare the readers to discuss the accordings explanations for 11a to 11i.

Arguments 11j
Yet, patients with advanced cancer in palliative care are an especially vulnerable group. In this case, strict adherence to evidence and avoidance of any treatment offers driven by commercial interest is ethically out of question, even if the patient may have asked for and consented to it driven by false promises. This exactly is the decisive motivation in the section on hyperthermia of the guideline. Patients must be informed on the relationship of benefits and risks.

Arguments 11j
We thank the authors for approving our statement that there are no data on the temperature in the article. Their argument does not falsify our statement.

Arguments 1 to 3 (we refer to the original outline number of the commentary)
As while writing our article, we were not sure whether Minnaar et al. got mixed up in their own data and reported the wrong numbers we chose a careful wording of our criticism. First of all, but only a minor point, data on HIV-treatment are missing. More important is the intransparent reporting of patient numbers. We pointed out to missing comparison of intervention and control group and missing transparency in drop out. In fact, the authors report a drop out until the inclusion in the study. The data comparison between intervention and control is made at that point for the whole remaining study group and is well-balanced. After that, there is a substantial vanishing of patients which may lead to a high imbalance between the groups: 1. The authors start with 210 patients (Figure 1) which all received allocated intervention as they wrote. Yet, they also write "Four randomised participants did not arrive for treatment and no further data is available on these participants. They were classified as "lost to follow up"." This is contradictory. As the authors eagerly calculate all p-values but not this one, we assume that this difference is not significant. Accordingly, this study is negative! To provide some additional benefit for the readers of our scientific discussion, we made a quick update search of our review and screened the new data if there is any We do not understand why the authors of the commentary included the studies marked with " †-falsely interpreted" in a table of allegedly missed articles. Moreover, as there is no scientific argument for the allegedly false interpretation, this simply is an accusation and no scientific discourse which we cannot answer properly 1 3 newly published article which might change the results of our SR. We found that there is none.
To summarize: there is no scientific evidence that electrohyperthermia or whole body hyperthermia has any benefit for patients beyond placebo-effects.
Funding Open Access funding enabled and organized by Projekt DEAL.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.