Source Paper
Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data)
Susan Michie, Caroline E Wood, Marie Johnston, Charles Abraham, Jill J Francis et al.
Health Technology Assessment • 2015
Taxonomy Training and Competency Evaluation
Objective: To develop and evaluate a taxonomic method for reporting behaviour change interventions by training participants in taxonomy use and assessing changes in intercoder reliability and validity against expert consensus
Protocol Steps
Participant Recruitment and Selection
Recruit 161 participants consisting of systematic reviewers, researchers, practitioners, and policy-makers from 12 countries who are engaged in investigating, designing and/or delivering behaviour change interventions
Note: Participants were selected from a larger pool of 400 participants involved in the broader taxonomy development project
View evidence from paper
“training in use of the taxonomy (1-day workshops and distance group tutorials) (n = 161) was evaluated by changes in intercoder reliability and validity”
1-Day Workshop Training
Conduct 1-day workshops to train participants in the use of the Behaviour Change Technique Taxonomy version 1 (BCTTv1) for identifying and coding behaviour change techniques in interventions
Note: This is one of two training delivery methods evaluated in the study
View evidence from paper
“training in use of the taxonomy (1-day workshops and distance group tutorials) (n = 161)”
Distance Group Tutorial Training
Conduct distance group tutorials to train participants in the use of the Behaviour Change Technique Taxonomy version 1 (BCTTv1) for identifying and coding behaviour change techniques in interventions
Note: This is the second training delivery method evaluated in the study, conducted remotely
View evidence from paper
“training in use of the taxonomy (1-day workshops and distance group tutorials) (n = 161)”
Assess Intercoder Reliability
Evaluate changes in intercoder reliability by having trained coders independently code the same behaviour change interventions and comparing their coding agreement
Note: Intercoder reliability was assessed as one of the primary outcome measures for training effectiveness
View evidence from paper
“was evaluated by changes in intercoder reliability and validity (agreement with expert consensus)”
Assess Validity Against Expert Consensus
Evaluate validity by comparing trained coders' identification of behaviour change techniques against expert consensus coding to determine agreement with expert standards
Note: Validity was measured as agreement with expert consensus coding
View evidence from paper
“was evaluated by changes in intercoder reliability and validity (agreement with expert consensus)”
Measure Confidence in BCT Identification
Assess participant confidence in identifying behaviour change techniques in workshop settings using appropriate measurement tools
Note: Confidence was measured as an outcome of training effectiveness
View evidence from paper
“improved confidence in identifying BCTs in workshops (both p < 0.001)”