Methods Paper of the Scientific Psychotherapy - PCE

advertisement
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 1 of 23
Methods Paper of the Scientific Psychotherapy
Council, according to §11 PsychThG
Regulations for assessing the scientific recognition
of psychotherapeutic methods and procedures.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 2 of 23
Table of Contents
I.
Basis of the assessment of scientific acknowledgement of psychotherapy methods and procedures. ........... 3
I.1
Psychotherapeutic Procedures and Methods .............................................................................................. 3
I.2
Scientific Recognition ................................................................................................................................. 5
I.3
Applications of Psychotherapy .................................................................................................................... 7
II.
Procedures of assessing the scientific recognition of Psychotherapy Methods and Procedures ...................... 8
II.1 Classification as a psychotherapy process or psychotherapy method .......................................................... 8
II.2 Compilation of Studies ............................................................................................................................... 9
II.3
II.3.1
Assessment of the Individual Trials, concerning the Efficacy of Psychotherapeutic Methods and Procedures. .............. 10
Determining the Subject of Inquiry 10
II.3.2
Assessment of the general Methodological Quality of a Study ......................................................... 10
II.3.3
Assessment of the Internal Validity of a Study .................................................................................. 11
II.3.4
Assessment of the External Validity of a Study.................................................................................. 11
II.3.5
Evaluation of the Study ...................................................................................................................... 11
II.3.6
Consideration of Single-Case Studies ................................................................................................. 12
II.3.7
Focus on Older Studies ...................................................................................................................... 12
II.4 Scientific Recognition of Psychotherapy-Methods and Procedures.......................................................... 13
III.
II.4.1
Scientific Recognition of Psychotherapy-Methods and Procedures for Individual Psychotherapy
Applications ....................................................................................................................................... 13
II.4.2
Scientific Recognition of Psychotherapy Methods for the Treatment of Eating Disorders ............... 13
Recommendations for the Training of the Psychological Child and Adolescents Psychotherapists ........... 14
III.1 Recommendations for the training to become a Psychotherapist ................................................................. 14
III.2 Recommendations for Training Children’s and Adolescents Psychotherapists .............................................. 15
Attachment .................................................................................................................................................................. 16
1.
Criteria for the assessment of Studying the Quality of Psychotherapy Studies ........................................ 16
2.
Application of Psychotherapy in Adults, as well as in Children and Adolescents ...................................... 23
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 3 of 23
I.
Basis of the assessment of scientific acknowledgement of
psychotherapy methods and procedures.
From the beginning of the Scientific Psychotherapy Council, the council has tried to set up criteria and
rules for the assessment of academically recognizing psychotherapeutic procedures, and this was
published on the website: http://www.wbpsychotherapie.de. Due the experience gained so far, the
Scientific Psychotherapy Council decided to clarify and further on develop these regulations. The reasons
for such actions are due to legal consents for scientific- and methodological development, and the
general discussion on the evidence based medical nature of psychotherapeutic treatments.
The aim of amending the rules is to establish a scientific basis for the recognition of a structured, and
transparent, process. This is to enable an identical evaluation for all possible psychotherapy-methods
and –procedures.
I.1
Psychotherapeutic Procedures and Methods
In § 8 Paragraph 3 of the psychotherapist-laws (PsychThG) it is stated that: “the training need a basic skill
in scientific depth, as well as an in-depth training in one of these method.” In § 11 of the PsychThG, it is
stated that cases that are of in doubt, will be judged and assessed by the Scientific Psychotherapy
Committee to see if it will be acknowledged or not.
In the extended publication of the psychotherapist-laws (Behnsen & Bernhardt, 1999), it is noted that as
soon an individual has entered into the psychotherapist-laws as a socially recognized therapist of
analytical psychotherapy, psychodynamic psychotherapy and/or behavioural therapy, and that person is
to follow the scientific rules defined in the PsychThG. In section B.I of the guidelines, the analytical
psychotherapy, the psychodynamic psychotherapy and the behavioural therapy are marked as
“procedures, which have a comprehensive theory of pathogenesis and for which specific treatments are
covered in their therapeutic efficacy”.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 4 of 23
In research, new treatment methods are increasingly being produced and amended, however, there still
is no comprehensive psychotherapy procedure. Due to this fact, the scientific psychotherapy council was
asked on multiple occasions to ascertain the scientific acknowledgment/recognition of
psychotherapeutic methods. This establishes the necessity to decide if a psychotherapeutic
approach/beginning is a psychotherapy procedure, or a psychotherapy method. Hence, the Scientific
Psychotherapy Council has the following understanding of psychotherapy-procedures, psychotherapymethods, and psychotherapy-techniques1:
Psychotherapy-Procedures
A suitable psychotherapy-procedure treatment is defined by:
An extensive knowledge of the theory of the origin and maintenance of illnesses, and their
treatment
And
A psychotherapeutic treatment strategy for a broad spectrum in applications, or other specific
psychotherapeutic treatment strategies that have a wide range of applications,
And
A concept for the indication, individual treatment plan, and creation of the therapeutic
relationship.
A scientific and acknowledged psychotherapy procedure must fulfil the conditions stated in points II.5
and III.
Psychotherapy-Methods
A treatment of one or more disorders with the appropriate psychotherapy-method is defined by:

A theory of the origin and maintenance of the designated disorder(s), and the theory of its
treatment,

Indication-criteria including their diagnostic acquisition.

The description of the procedure

The description of the intended treatment effect
And
A scientific and acknowledged psychotherapy method must fulfil the conditions stated in point II.5.
1
The definition of procedures, methods, and techniques occurred in the agreement with the “Gemeinsamen
Bundesausschuss.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 5 of 23
Psychotherapy-Technique
A psychotherapeutic technique is a concrete approach with which the intended psychotherapeutic goal
is to be achieved, with the appliance of psychotherapeutic methods and procedures. For example, in the
field of psychodynamic procedures: the transfer of increasing awareness of unconscious relationship
patterns, or in behavioural therapy: stimuli confrontation.
The scientific psychotherapy council checks the scientific acknowledgement of procedures and
independent psychotherapeutic methods. Methods that are categorized as a procedure, will not be
validated on behalf of their scientific acknowledgement, but simply be checked by their relation to the
procedural review.
I.2
Scientific Recognition
The scientific psychotherapy council is in accordance with its terms, and takes the assumption that
psychotherapy-procedures or psychotherapy-methods are to be based on the results that have been
achieved. It is necessary to mention that the Scientific Psychotherapy Council as an institution does not
make any research of their own, but inspects and evaluates the research-papers completed by the
national or international third party.
§ 1 paragraph 3 in the psychotherapist-laws defines the practice of psychotherapy as: “any recognized
and scientifically means of psychotherapeutic processes made to identify, cure or lessen the patients
disorder with clinical significance”. According to this definition of psychotherapy, the Scientific
Psychotherapy Council believes that the scientific recognition of a psychotherapeutic-process is
determined by the scientific implementation in the practice to cure or lessen the patients’ disorder.
The scientific research works on multiple inquiries about psychotherapy, such as; the efficacy, its effects,
the use in practice, their contribution to welfare, and more. For the assessment and recognition of
scientific psychotherapeutic-procedures and –methods, one needs enough proof to display the
effectiveness of the particular treatment in practice, with the desired effect of healing or improving
disorders. Therefore, there are a set of criteria for determination of such assessments:

Criterion 1: The use of interventions on people that suffer from disorders with clinical
significance, which leads to an observable therapeutic healing effect.
The scientific results are only taken under consideration and acknowledgeable of the treatment was
given to a person with a clinical mental disorder. Furthermore, the achieved criterion is only considered
when the “Detection, cure, or alleviation of disorders with clinical significance” has been reached (more
information is under point II.2.5).

Criterion 2: The observed therapeutic effect is inter-subjectively identifiable and replicable.
The impression that a treatment was successful, from the view of the patient and therapist, must be
tested by controlled, objective, reliable and valid measurements. Furthermore, the effect of the
psychotherapeutic-process can only be established if that certain effect can be repeated in an
independent study, also under controlled conditions (more information under II.4.2)
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 6 of 23

Criterion 3: The reached effect must have a high probability to be traceable back to the
therapeutic intervention (internal validity).
It must be observable that the desired effect was really reached through the treatment procedures, and
not through other factors – intentional or not. The rules for proving this are:
o
o
o
A controlled group is set up with patients getting a different treatment or different
therapeutic procedures. The control group may also receive no treatment, a placebotreatment, or a treatment that would usually be given but which would result in a
different outcome,
or, the group of patients receiving the investigated psychotherapeuticmethod/procedure achieve an outcome that is at least no worse than the group of
patients receiving another treatment, which is already proven to have worked,
or, a series of individual case studies who a systematic relation between the method-use
and the desired effect.
These verifications can generally be done under research-conditions, or practice-conditions (more
information in II.4.3)

Criterion 4: The investigated psychotherapeutic intervention can effectively be replicable in
practice (external validity)
Internal and external validity
The question of the internal and the external validity are different, and the answer requires the
consideration of every different methodological rule. In most cases, studies are planned and executed to
answer one of the two questions, but there are studies that permit both statements for internal, as well
as external, validity.
Further Research problems and areas
Beside the question of whether psychotherapeutic interventions have a cure or alleviation of disorders
with clinical relevance (effectiveness research), there are further psychotherapeutic issues that one can
focus on. These include aspects of the effect of psychotherapy (process research). It is of great
importance that you are aware and responsible for the coherence and development of psychotherapy.
Research concerning the efficacy and effectiveness of psychotherapy also include other research areas,
which include the procedural basis for research and health services research.
Validity and Limitations
The questions about the four criteria points can generally be used by all psychotherapists and
psychotherapy-methods, despite the therapy theory and therapy principles one may have.
The research strategy, which is necessary for evaluating the four criteria points of scientific
acknowledgement, is shown separately from the respective therapeutic approach and its justification.
This means, firstly, that the research projects must have as little influence on the subject whilst being
explored as possible. Repercussions of the research on the therapeutic approach should be with a wellplanned research project. If this is not ensured, the validity of the study is reduced, and this is adequately
reflected in the assessment of the study.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 7 of 23
I.3
Applications of Psychotherapy
The Scientific Psychotherapy Council states that the evidence of the efficacy of a psychotherapeuticprocess or method in a scope is not generally identified with the effectiveness of the entire
psychotherapeutic process/method from a different scope. In addition, the generalization of
psychotherapy-procedures/methods and efficacy in adults compared to the efficacy in children is very
limited.
From the evidence of efficacy in adults, it is not possible to conclude the same efficacy in children and
adolescents with disorders, and vice versa.
Due to this, the Scientific Psychotherapy Council decided to assess the efficacy of different
psychotherapeutic applications of adults and children separately. This does not mean that the
psychotherapeutic-procedures and their applications (diagnoses and diagnoses groups) have to be
different from one another, but assessment of the efficacy is going to be held separately.
For these concrete assessments, the Scientific Psychotherapy Council created 18 applications, in terms of
disorders, that are exclusively there for the children and adolescent psychotherapy2.
In the evaluation of psychotherapeutic-procedures, the addition of other studies with patients who do
not show a clear diagnosis from one of the 18 applications are also included (patients with complex
disorders that are represented by several ICD-diagnoses3 and/or diagnostically mixed groups of patients).
Applications of Psychotherapy in adults, children and adolescents
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
Mood Disorders (F3); including F94.1; F53
Anxiety Disorders and Obsessive-Compulsive Disorders (F40-F42; F93 and F94.0)
Somatoform Disorders and Dissociative Disorders (Conversion Disorder) (F44 – F48)
Addiction and Abuse (F1, F55)
Personality Disorder and Behavioural Problems (F6)
Adjustment and Stress Disorders (F43)
Eating Disorders (F50)
Non-Organic Sleeping Disorder (F51)
Sexual Function Disorder (F52)
Psychological and Social factors in Somatic Disorders (F54)
Schizophrenia, Schizotypal and Delusional Disorders (F2)
Organic, including symptomatic psychological disorders (F0)
Psychological and Social Factors in Mental Retardation (F7) and Developmental Disorders (F84)
Hyperkinetic Disorders (F90) and Social-Behaviour Disorders (F91, F94.2-F94.9)
Specific Developmental Disorders (F80 to F83)
Disorders of Elimination (F98.0, F98.1)
Control Disorders (F98.2)
Tic-Disorders and Stereo-types (F95 and F98.4)
The review of the criteria for the determination of scientific recognition is done separately for each
application. Psychotherapy methods are generally made to treat single disorders, so if this is the case,
2
The determination of applications were made with the consultation with the federal Joint Committee
If one study shows a diagnoses of mental disorder in accordance to the current version of the DSM-criteria, the
allocation of the application corresponding to the ICD-criteria is to be used.
3
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 8 of 23
the determination of scientific recognition is exclusive to the treated disorder, and not for wider
application.
According to § 8 paragraph 3, in-depth training of psychological psychotherapists for child and
adolescent psychotherapy must be done in a scientifically recognized process. Since a sufficient breadth
of patient care training is required, only those procedures for in-depth training in a wide range of
application will be scientifically recognized.
II.
Procedures of assessing the scientific recognition of Psychotherapy
Methods and Procedures
The Scientific Psychotherapy Council decided, at its meeting on the 08.10.2007, the following methods
for assessing the academic acknowledgment of psychotherapeutic methods and procedures.
Assessing the academic acknowledgement takes place in five consecutive steps. On this basis, it is
recommended for a training to become a psychological psychotherapist for child and adolescent
therapist and for medical training, as a sixth step.
1.
2.
3.
4.
5.
6.
Formulating Questions
Classification as a psychotherapy process or psychotherapy method
Compilation of studies
Assessment of the various scientific studies
Establishing the scientific recognition of a psychotherapy process or method
Recommendations for training to become a psychological psychotherapist for child and
adolescent psychotherapy, as well as for medical training.
The criteria for individual assessment and judgment have been operationalized as far as possible. Their
application is nevertheless not only requires appropriate methodological skills, but also an academic
psychotherapeutic knowledge and psychotherapeutic competence. The consecutive stages of the review
process will be recorded in a report-log. This protocol begins with the start of a job evaluation in order to
influence the review process by intervening.
The individual process steps are shown below.
II.1
Classification as a psychotherapy process or psychotherapy method
In the first step of the review, the classification of psychotherapeutic methods and psychotherapeutic
procedures are distinguished.
A psychotherapeutic approach is then considered as a psychotherapy procedure when:


it is understood by its own representatives as a psychotherapy procedure,
the standard theoretical explanations of the problems and methods are made on the basis of
shared assumptions,
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 9 of 23



reasonable criteria for the indication, as well as approaches for individual treatment planning
and design are formulated,
the psychotherapy procedure, or method, for treating disorders of a wide range of applications
are used,
the psychotherapy procedure has been taught through in-depth training or further education.
A psychotherapeutic approach is only then considered as an individual psychotherapy method when:





it is understood by its own representatives as a psychotherapy method,
its description includes information on how to submit data for the effect to be achieved by
others, and the indication criteria,
a theoretical explanation of the origin, and the maintenance of the treatable disorder(s), are
formulated,
the specific method factors relevant to psychotherapy and other methods of psychotherapy are
different,
the method of psychotherapy was not considered as a method of an already assessed
psychotherapy procedure.
The evaluation of psychotherapy methods can also consider studies in which techniques were applied
that were also used for other psychotherapy procedures.
II.2
Compilation of Studies
The identification of the studies that form the basis of the evaluation of scientific acknowledgement
occurs in the context of a systematic literature search in relevant databases. The Scientific
Psychotherapy Council may use a third party for help if needed. The applicant, and other members, of
the psychotherapeutic method/procedure can supplement their own literature.
The search strategy for the identification of relevant studies is proposed by the representatives of the
psychotherapeutic method/procedure, and this will be reviewed by the Scientific Psychotherapy Council,
and where appropriate, modify it.
The results of the literature research will be published on the website of the Scientific Psychotherapy
Council, and the applicant will be informed in written form. The reference list may, within four weeks
after the publication on the website, elaborated if information is needed to be added.
After the expiry of the four-week period, the Council checks whether the documents produced
supplement the relevant trail basis. Should the results of the findings of the literature search need
revision, the Council has revised further search strategies. The literature list is the supplemented on the
basis of the results of the systematic literature search using the amended search strategy.
Applicants, who have applied for the examination of the scientific recognition of a psychotherapy
procedure, or method, will be called on to submit a paper within six weeks. This has to include three
copies of the publications listed in the basic list in full text. If the individual studies are not submitted,
this has to be appropriately justified by the applicant or the concerned professional group.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 10 of 23
The concrete steps of the systematic literature search, the screening process including the definitions of
screening criteria, and the results of the systematic research with the first screening must be
documented in a report log.
II.3
Assessment of the Individual Trials, concerning the Efficacy of
Psychotherapeutic Methods and Procedures.
Basis for assessing the effectiveness of psychotherapeutic procedures and methods are empirical
studies. The assessment of the studies includes:
1.
2.
3.
4.
5.
Determining the subject of the inquiry: The study-examined psychotherapeutic approach and
therapeutic area.
General methodological assessment
Assessment of the internal validity
Assessment of the external validity
Evaluation of the investigated results
II.3.1 Determining the Subject of Inquiry
The psychotherapeutic approach is concretized by a manual, or manual-like treatment guidelines. If a
concrete description of the procedure is lacking, and only the general psychological interventions are
indicated, then the assessment and evaluation of the methodology is considered as a clinical practice.
The revised indication area is characterized by features of the patients who were studied. This primarily
concerns the diagnoses as defined in the DSM or ICD index.
Studies where most patients have complex disorders, which are represented by multiple ICD diagnoses,
so that not clear assignment can be made under section I.3 to one of the 18 applications of
psychotherapy, must also be assessed. Such studies can optionally be included in the recommendations
for the training of psychotherapists of children and adolescents.
II.3.2 Assessment of the general Methodological Quality of a Study
The methodological quality of each study is based on the “list of criteria of quality psychotherapy studies,
Part A: Criteria for evaluating the general methodological quality assessment.” In general, studies with
sufficient overall methodological qualities are identified as:
1.
2.
3.
4.
If the criteria A1 (manipulation) and A2 (diagnosis) and A8 (measurement endpoints) were
evaluated with either a 1 or 2,
If the criterion B12 (representation of the outcome measures) were evaluated with a 1 or 2,
If the criteria C1 (clinical sample) and C9 (outcome measurement) is evaluated with a 1 or 2,
And if the average of all A-Criteria (A1 – A19) is less than 2.25.
A study will be excluded as evidence of efficacy if no sufficient methodological quality was found.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 11 of 23
II.3.3 Assessment of the Internal Validity of a Study
The internal validity of each study is based on the “list of criteria of quality psychotherapy studies, Part B:
Criteria for assessing the internal validity”. In general, studies with sufficient internal validity will be
determined by:
1.
2.
when adequate overall methodological quality was detected,
and if (A) the criterion B8 (group assignment) was evaluated with a 1 or a 2, and
(B) the average grade of all the B-Criteria (B1 – B12) is less than 2.25.
II.3.4 Assessment of the External Validity of a Study
The external validity of each study is based on the “list of criteria of quality psychotherapy studies, Part
C: Criteria for assessing the external validity”. In general, studies with sufficient external validity are
determined by:
1.
2.
3.
when adequate overall methodological quality was detected,
when the criteria C1 – C9 reached an average evaluation of no more than 2.25
when the criteria C10 – C13 reached an average evaluation of no more than 2.25.
II.3.5 Evaluation of the Study
A study can be regarded as one of the required evidence of efficacy: (I) if the overall methodological
quality of the study was judged to be adequate, (II) if sufficient internal and external validity was found,
and (III) if the results of the study either show:
1.
2.
3.
4.
the intervention group shows a significant outcome measures between pre-and post treatment
which are greater than in the untreated control group, the placebo-control group or the control
group “treatment as usual”
the intervention group shows an equal outcome results between pre-and post treatment
compared with an already proven effective treatment, provided the criterion A17 (statistical
power of comparison) is evaluated with either a 1 or 2
the treatment goal or a cure or improvement in the intervention group shows significant
improvement in their problems than those in the control groups, or at least as well as those in a
group with an already proven effective treatment, proved the criterion A17 is evaluated with a 1
or 2
If there is no control group present for comparisons, the results can be considered as evidence of
efficacy is the treatment effect demonstrated significant pre-and post treatment changes that
are clinically important.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 12 of 23
II.3.6 Consideration of Single-Case Studies
Experimental case studies can be used to assess the effectiveness of psychotherapeutic methods and
procedures if they demonstrate a systematic link between the intervention and effect, and if the general
scientific criteria are met. A systematic relationship can be identified when:
1.
2.
3.
4.
Continuous measurements of the focus related behavior / experience on all relevant study
sections are made,
a sufficient baseline of the target behavior and experience is shown,
The dependent variable is sufficiently stable within the respectively defined study,
The therapeutic approach (the intervention) is described in detail (for example using a treatment
manual).
A further condition for the consideration of single case studies is that the data is given from at least two
independent research groups/organizations/institutions.
The assessment of the studies is done on the basis of the “list of criteria to assess quality psychotherapy
studies”.
II.3.7 Focus on Older Studies
The Scientific Psychotherapy Council may re-evaluate an old psychotherapy-procedure if the given
methodological standards are not up-to-date. Should a study that was published before the first of
January 1990 meet minimum requirements, than it considered as valid (as per decision of the Scientific
Psychotherapy Council meeting from 08.06.2000).
5.
6.
7.
8.
9.
10.
the sample must be adequately described
There must be a clinically relevant outcome criterion determined with reliable methods
It must be called a clinically relevant indication criterion. This can be a diagnosis but can also be a
target syndrome, provided it can be plausible that the change of such an objective criterion can
be significantly changed
It must be given a control condition
It must be made comprehensible, wherein the therapeutic intervention process is made of.
Statements to the stability of treatment success are desirable.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 13 of 23
II.4
Scientific Recognition of Psychotherapy-Methods and Procedures
II.4.1 Scientific Recognition of Psychotherapy-Methods and Procedures for
Individual Psychotherapy Applications
To assess the scientific recognition of a psychotherapy procedure or a specific psychotherapy method for
a single application, all studies are used that have been studied under the same psychotherapeutic
approach (as described in II.3.1).
The scientific recognition of a psychotherapy procedure or method alone can be done if the following is
observed:
1.
and
2.
At least three methodological appropriate and valid studies, of which at least two of these have
to be positively assessed according to internal validity criteria of II.3.3, and at least two according
to the external validity criteria of II.3.4. One of the three studies can be replaced by at least five
experimental single case studies that meet the criteria mentioned in section II.3.6, and
demonstrates the effectiveness of the psychotherapeutic-procedure or method.
If at least one methodological adequate and valid study (corresponding to the criteria of II.3.3
and II.3.4) by which the criterion B11 (Follow-Up Measurement) was rated to be at level 1 or 2,
and showing the treatment success for at least six months after the end of the treatment.
II.4.2 Scientific Recognition of Psychotherapy Methods for the Treatment of
Eating Disorders
To assess the scientific recognition of a specific psychotherapy method for a single disorder, all studies
are used that have been studied in the same psychotherapeutic approach for this disorder.
For a psychotherapy method, the scientific recognition for a single disorder is determined by the
following:
1.
If at least two independent studies, whose general methodological quality and validity were
assessed as adequate, and the psychotherapy method is demonstrated as effective. This has to
include:
 (according to criteria II.3.3) at least one of these studies has to show adequate
internal validity, and
 (According to criteria II.3.4) at least one of these studies needs to show sufficient
external validity.
One of the two studies can be replaced by at least five experimental case-studies that meet the criteria
in section II.3.6, and the effectiveness of the psychotherapeutic-procedure or method need to be
displayed.
and
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 14 of 23
2.
If at least one methodological adequate and valid study was completed with a study that fulfilled
the criterion B11 (follow-up measurement) at the level 1 or 2, and showing that the treatment
success for at least six months prior the treatment ending.
3.
Evidence of significant adverse effects of the psychotherapy method is available. This is usually
the case when at least 10% of the studies were considered adequate, in which at least 2 studies
have to be adequate in the general methodology, and the internal or external validity (according
to the given criteria mentioned in the previous sections)
III.
Recommendations for the Training of the Psychological Child and
Adolescents Psychotherapists
A psychotherapy procedure or method, in principle, has to be subject to an in-depth training of the child
and adolescents’ psychotherapist, or trainee. An application for recognition of a training institution
should be granted if for all areas of psychotherapy are scientifically recognized methods, at least for the
core areas of psychotherapy. These can assigned to the same, or different, psychotherapies. For an
application for the recognition of a training institute, applicants need to indicate which psychotherapy
methods will be taught for which applications, and which trainer/supervisors are available for the
training of the psychotherapy method.
III.1 Recommendations for the training to become a Psychotherapist
Only those procedures will be approved for psychotherapy that are in accordance with §1 paragraph 1 of
the training and examination regulation. The scientific recognition for the applications was as following:
The following two application areas:
1.
Affective Disorders (F3); including F94.1, F53
2.
Anxiety Disorders (F40 – F42, F93 and F94.0)
And either, in addition, at least one of the following applications:
3.
Somatoform Disorders and Dissociative Disorders (Conversion Disorders) (F44 – F48)
4.
Dependence and Abuse (F1, F55)
5.
Personality Disorders and Behavioral Disorders (F6)
Or, in addition, at least two of the following applications:
6.
Adjustment Disorders and Stress Disorders (F43)
7.
Eating Disorders (F50)
8.
Non-Organic Sleep Disorders (F51)
9.
Sexual Dysfunction (F52)
10.
Psychological and Social Factors in Somatic Disorders (F54)
11.
Schizophrenia, schizotypal and Delusional Disorders (F2)
12.
Organic, including symptomatic, Mental Disorders (F0)
13.
Psychological and Social Factors in Mental Retardation (F7) and Deep Developmental Disorders
(F84)
14.
Hyperkinetic Disorders (F90) and Conduct Disorders (F91, F94.2 – F94.9)
18.
Tic Disorders and Stereotypes (F95 and F98.4)
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 15 of 23
Instead of the scientific recognition in the application areas 6 to 14, or in the scope 18, individual cases
can be acknowledged if the evidence of efficacy is corresponding to studies on “mixed interference” and
if these studies fulfill the criteria under point II.3.1, and II.4.
III.2 Recommendations for Training Children’s and Adolescents
Psychotherapists
Only those psychotherapies are recognized as procedures of in-depth training on children and
adolescents according to §1 paragraph 1 of the training and examination regulation for child and
adolescent psychotherapist. The scientific recognition for such has to have at least the following
applications:
In all three of the following applications:
1.
2.
14.
Affective Disorders (F3; including F94.1, F53)
Anxiety Disorders (F40 – F42, F93 and F94.0)
Hyperkinetic Disorders (F90) and Conduct Disorders (F91; F94.2 – F94.9)
Or
At least two of the following applications:
1.
Affective Disorders (F3; including F94.1, F53)
2.
Anxiety Disorders (F40 – F42, F93 and F94.0)
14.
Hyperkinetic Disorders (F90) and Conduct Disorders (F91; F94.2 – F94.9)
And additionally at least two of the following:
3.
Somatoform Disorders and Dissociative Disorders (Conversion Disorders) (F44 – F48)
4.
Dependence and Abuse (F1, F55)
5.
Personality and Behavior Disorders (F6)
6.
Adjustment Disorders and Stress Disorders (F43)
7.
Eating Disorders (F50)
8.
Non-Organic Sleep Disorders (F51)
9.
Sexual Dysfunction (F52)
10.
Psychological and Social Factors in Somatic Disorders (F54)
11.
Schizophrenia, schizotypal and Delusional Disorders (F2)
12.
Organic, including symptomatic, Mental Disorders (F0)
13.
Psychological and Social Factors in Mental Retardation (F7) and Deep Developmental Disorders
(F84)
15.
Specific Developmental Disorders (F83)
16.
Disorders of Elimination (F98.0, F98.1)
17.
Regulatory Disorders and Feeding Disorders (F98.2)
18
Tic Disorders and Stereotypes (F95 and F98.4)
Instead of the scientific recognition in the application areas 3 to 13 or 15 to 18, individual cases can be
recognized if the evidence of efficacy corresponds to the regulations in paragraph II.3.1. Psychotherapy
procedures and psychotherapy methods for a smaller number of applications, as in III.1 and III.2, cannot
be considered under the training of psychological psychotherapist for children and adolescents.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 16 of 23
Attachment
1.
A
1.
Criteria for the assessment of Studying the Quality of
Psychotherapy Studies
Criteria for Assessing the General Methodological Quality
Manipulation of the Data
(level 3 = Exclusion Criterion)
2.
Patients
Objective and Reliable Diagnosis (by means of partially
standardized interview)
(Level 3 = Exclusion Criterion)
3.
Number of drop-out rates to treatment (if not successful)
4.
Number of drop-out rates to catamnesis (if catamnesis
conducted the survey)
5.
6.
7.
Study Design
Sample size per group
Comparison (if any) of the treatment groups to the
Measurement time points
Outcome Measurement
A priori definition of the primary and secondary endpoints
Operationalization
1) No indications pointing to
manipulation of results
3) Indication of manipulation of the
results
1) Diagnosis by means of structured
clinical interview (e.g. SCID, DIPS)
2) Diagnosis using diagnostic
checklists and comprehensible
clinical judgment
3) No adequate diagnosis
1) Drop out quote smaller than 20%
2) Drop out quote between 20% and
40%
3) Drop Out quote larger than 40%
1) Significantly better than in studies
with similar patient groups and
comparable follow up period
2) Drop-out rate compared with
studies with patient groups and
corresponding follow-up period
3)Significantly lower than in studies
with similar patient groups
1) n per group > 30
2) n per group 10-30
3) n per group < 10
Deviations from this scheme may
occur with very seldom disorders
1) a priori definition of the
comparison treatment group and
time points met
2) partially defining the post-hoc
comparisons
3) only post-hoc comparisons
defined
1) a priori defined primary and
possibly secondary endpoint
2) a priori criteria, provided the
target without differentiation in
primary and secondary outcome
measures
3) a posterior definition of objective
criteria, no information on
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 17 of 23
8.
Reliably and valid measurements of at least the primary
outcome measures
(Level 3 = Exclusion Criterion)
9.
Clinical Significance of the Outcome Measurement
10.
Multiple Information sources (e.g. patient, therapist, lab
results)
11.
External assessment procedures: external evaluators
12.
Complete presentation of the results on all outcome
measures, and to all relevant measurement time points
13.
Detection of adverse effects
14.
Statistical Methods
Requirements application for statistical models tested and
met
outcomes
1) Reliable and Valid outcome
procedures
2) Only limited reliability and/or
validity of the measurement process
3) Reliability and validity of the
measurement method does not
validate criteria for the test method
1) Clinical significance of the
therapeutic effect is detectable
2) Clinical significance of the
therapeutic effect is only partially
detectable
3) Clinical significance of the
therapeutic effect is not detectable
1) Multidimensional assessments of
objective criteria – three of more
sources of information
2) two sources of information
3) one source of information
1) Validated external assessment
procedures applied by trained,
external conditions for the groupblind raters
2) Validated external assessment
procedures applied by trained, nonblind external evaluators
3) Foreign validated assessment
method used.
1) Reported about all outcome
variables
2) Reported only for the primary
outcome measures
3) not reported for all primary
outcome measures
1) Systematic collection and
reporting of adverse events, side
effects, deterioration
2) Unsystematic collection and/or
incomplete reporting of undesired
outcomes
3) Adverse events, side effects ,
deterioration were detected and not
reported
1) Application requirements tested
and completed
2) Usage conditions tested and no
examination of the conditions
3) Significant violations of the
conditions for applying or no review
of the application requirements.
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 18 of 23
15.
Adequacy of statistical analysis (including the correction for
multiple tests)
16.
Intention to Treat – analysis performed
17.
Statistical power of comparison in comparison to the proven
treatment group
18.
Complete description of the Drop-Outs
19.
Drop-Out-Analysis
1) Adequate and comprehensive
analysis
2) Largely adequate statistical
analysis
3) Inadequate statistical analysis
1) ITT analysis performed
2) No ITT analysis at low risk of
attrition bias
3) No ITT analysis at distinct risk of
attrition bias
1) Adequate statistical power of
comparison
2) Limited power of statistical
comparison (.50 - .80)
3) Inadequate statistical power of
comparison (<.50)
1) Complete description of all dropouts, including the reasons and the
time of drop-out
2) Incomplete data on causes of
drop-outs
3) A description of drop-outs or
definitive indication of the number
of drop-outs is given
1) Drop-out analysis has no
significant differences between the
comparison group
2) Drop-out analysis has show
difference in the validity of the
results and are not substantially
impaired
3) Drop-out analysis is not carried
out or ignores relevant prognostic
characteristics
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 19 of 23
B.
1.
2.
Criteria for assessing the internal validity
Patients
Specification of inclusion and exclusion criteria
Collection of the specified inclusion and exclusion criteria
by validated methods
3.
Interventions
Operational definition of the interventions
4.
Operational definition of the controlled conditions
5.
Structural equivalence of the controlled conditions
6.
Treatment Integrity
Operationlization
1) Clear specification of inclusion
and exclusion criteria
2) Inclusion or exclusion criteria
described
3) inclusion and exclusion criteria
are not defined
1) The inclusion and exclusion
criteria are all clear and
operationalized by obtainable valid
methods
2) The validity of the inclusion or
exclusion criteria is partially
impaired
3) The validity of the inclusion or
exclusion criteria is clearly limited
and has a differential effect on the
composition of the treatment group
1) Therapy manual is comparable
and replicable
2) description of therapy, without
further specification of the
intervention
3) The intervention is not described
clearly to the designation of the
psychotherapy process.
1) Prospective identification and
extensive description of the control
conditions
2) Ex-post facto description of the
control conditions
3) No description of the control
conditions
1) The therapeutic care and the
setting conditions are equivalent to
the Control Group
2) The level of therapeutic care and
the setting conditions differ from
the CG
3) The level of therapeutic care in
the CG is significantly reduced and
the setting conditions differ from
that of the Intervention Group.
1) Manual loyalty / integrity
treatment by external observers (for
example, video based)
2) Manual loyalty / treatment
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 20 of 23
7.
8.
Eligibility, documentation and analysis of the influence of
accompanying non-randomized interventions
Study Design
Group membership
(Mandatory criterion for internal validity - <3 )
9.
Comparability of groups at baseline in terms of prognosisrelated features
10.
Definition of the measurement time points
11.
Follow-Up measurement
12.
Outcome Measurements
Amount of changes on the primary and secondary
outcome measures compared to the control group
(Level 3 = Exclusion Criterion)
integrity demonstrated by
questionnaires
3) No measures to monitor the
fidelity or references to the manual.
1) Exclusion of an accompanying
non-randomized intervention
2) Accompanied, non-randomized
interventions are permitted
3) Accompanied, non-randomized
interventions are permitted
1) Adequate randomization at
sufficient sample size n>30/group
2) Parallel or partially randomized,
or quasi-randomized, sample size
n<30/group
3) no randomized group
1) Neither statistically nor clinically
relevant differences between the
groups in terms of relevant
prognostic variables
2) Comparability with regard to
most relevant prognostic features is
largely valid
3) Lack of adequate review of the
comparability and comparison.
1) Several pre-defined times of
measurement, over the course of
the therapy, including pre-post
measurements
2) Only pre-post measurements
3) Only post-measurements
1)A high sample of adequate
catamnsis
2) A low utilization of the sample
and a reasonable catamnesis
3) No catamnesis
1) Full details of the changes
achieved on the target criteria,
including the significance, size and
extent of the effect measured
2) Presentation of the treatment
results only by changing dimensions
or achievements, or both
3) Very incomplete or inadequate
representation of the outcome
criteria
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 21 of 23
C.
1.
Criteria Assessing the External Validity
Patients
Sample of patients with symptoms and disorders
(Level 3 = exclusion criterion)
2.
Method of recruiting the samples
3.
Selection of the samples, due to the exclusion criteria
4.
Intervention
Clinical representativeness of the intervention in terms of
approach and duration
5.
Method of the Therapy-Monitoring
6.
Admissibility of accompanying interventions (e.g.
pharmacotherapy)
7.
Qualifications of the practitioner
a) Clinical activity of the therapist
Operationalization
1) Only patients with a disorder
from the ICD or DSM manuals
2) Sample of patients with probable
clinical disorders
3) Patients without any problems
are detected with clinical disorders
1) Access of patients mostly through
clinical routine; no selection effects
due to access routes
2) Access of patient mostly through
clinical routines
3) Access of Patients mainly through
calls to the researcher group (e.g.
advertising)
1) No selection effects due to the
exclusion criteria: Inclusion of all
patients
2) Medium selection effects due to
the exclusion criteria
3) Significant selection effects due
to the exclusion criteria
1) Intervention in everyday clinical
practice
2) Intervention with respect to
clinical practice sometimes changed
daily
3) Intervention compared to clinical
practice of everyday life, changed
dramatically
1) No change in behavior by the
therapist therapy monitoring
2) Average change in behavior
through therapist therapy
monitoring
3) Major change in behavior by the
therapist therapy monitoring
1) No restrictions
2) Accompanying in usual routine
interventions partly excluded
3) All associated routine practice
interventio0ns are excluded
1) Therapist is practicing as a
clinician
2) Clinical researcher, mainly
engaged in research and less in
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 22 of 23
b) Width of the clinical activity of the therapist
c) Specific training of the psychotherapist in a treatment
method for the study
8.
Study Design
Representativeness of the patient freedom in the choice
of intervention
9.
Outcome Measurements
Primary outcome measures related to patient-relevant
parameters
(Level 3 = exclusion criterion)
10.
Practice Transfer
Specification and manufacture of necessary Setting
Conditions
11.
Specification and manufacture of necessary treatment
skills
12.
Specification and understandability of relevant patient
characteristics
patient treatment; education
candidate
3) Not a clinician, or a clinician who
is not a psychotherapist
1) Therapist treats patients with
various problems within and outside
the study
2) Therapist treats patients with
similar problems
3) Therapist only treats patients
with similar problems within and
outside the study
1) No specific training for the study
2) short training for the study or
intensive training for a few
therapists
3) Intensive training before the
study
1) Patients choose for themselves
one of the available therapies
2) A proportion of patients is
randomly assigned to a certain
treatment
3) All patients are randomly
assigned for a certain treatment
1) The objective criteria are based
on several dimensions of patients,
or fault-related parameters
2) Objective criteria relate only to
one dimension
3) The objective criteria are based
solely on surrogate parameters
1) Necessary setting conditions are
produced (such as infra-structure,
cooperation team, etc)
2) Necessary setting conditions are
produced only partially
3) Necessary setting conditions are
not produced
1) Necessary treatment skills are
clearly identified and produced
2) Necessary treatment skills are
clearly identified, but only very
time-consuming to produce
3) Necessary treatment skills are not
described or not practical to
produce
1) Relevant patient characteristics
(such as age, genetic markers) are
Methods Paper of the Scientific Psychotherapy Council, according to §11 PsychThG
Page 23 of 23
13.
Specification and understandability of relevant treatment
aspects
detected
2) Relevant patient characteristics
detected only with considerable
effort
3) Relevant patient characteristics
not identified
1) Relevant treatment
characteristics (type of
interventions, order, duration) are
practically produced (e.g. manual)
2) Relevant treatment
characteristics are difficult to
manufacture
3) Relevant treatment
characteristics are not practical to
produce
2.
Application of Psychotherapy in Adults, as well as in Children and
Adolescents
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
Mood Disorders (F3); including F94.1; F53
Anxiety Disorders and Obsessive-Compulsive Disorders (F40-F42; F93 and F94.0)
Somatoform Disorders and Dissociative Disorders (Conversion Disorder) (F44 – F48)
Addiction and Abuse (F1, F55)
Personality Disorder and Behavioural Problems (F6)
Adjustment and Stress Disorders (F43)
Eating Disorders (F50)
Non-Organic Sleeping Disorder (F51)
Sexual Function Disorder (F52)
Psychological and Social factors in Somatic Disorders (F54)
Schizophrenia, Schizotypal and Delusional Disorders (F2)
Organic, including symptomatic psychological disorders (F0)
Psychological and Social Factors in Mental Retardation (F7) and Developmental Disorders (F84)
Hyperkinetic Disorders (F90) and Social-Behaviour Disorders (F91, F94.2-F94.9)
Specific Developmental Disorders (F80 to F83)
Disorders of Elimination (F98.0, F98.1)
Control Disorders (F98.2)
Tic-Disorders and Stereo-types (F95 and F98.4)
Download