Concordance-Based Training (CBT) is an online training method that places participants in professional situations and prompts micro-judgments on questions frequently encountered in practice.
For each question the participants answer, automated feedback is established based on responses previously given by members of a reference panel.
Participants can (1) self-calibrate by discovering how their response compares to those of the panel, (2) explore the reasoning of panel members using the justifications they provided for their answers, and then (3) discover a synthesis message to deepen their understanding of one or more themes addressed in the situation.
The whole constitutes a powerful training system for which it is also easy to create a coherent evaluation system by substituting panel feedback with scores calculated from their responses. This is then an assessment method whose qualities are well-documented in the literature under the name Script Concordance Test (SCT).
How does it work?
Participants are given a case description, a hypothesis (or an option), and a piece of additional information. They then use a Likert scale to indicate the impact of this new information on the initial hypothesis. The exercise concludes with a comparison between the students' answers and the opinions of a panel of subject matter experts.
How to edit and customize SCT questions
Create a Script Concordance Test Question
First, open the course of your choice in which you want to add a Script Concordance Test type question. You can also start from scratch by creating a brand-new course.
Click on Create a question and select Script Concordance Test under Questions.
Import Questions
You can import questions from a file or from platforms like Wooclap, among others. This eliminates the need to recreate all your questions from scratch.
Customize the Script Concordance Test question
Start by describing the proposed case or situation (1). Write a hypothesis that you want to pose to your audience (2) and add other additional information if you wish (3). Finally, indicate the opinions of the experts (4).
You can modify the answers by entering a number or by clicking the arrows.
You can also add comments to each answer to provide additional information.
Learners answers are compared to answers previously given by members of an expert panel. Learners can then self-calibrate by discovering how their response compares to those of the panel and explore the experts' reasoning using the justifications they provided for their answers.
You can format your text or insert sound, an image, or a video using the formatting bar that appears when you click on a field.
Under Options, you have the possibility to create or select tags for your question. These tags will help you have a better view when reading your results.
Once your question is customized, remember to click Finish. The question will then be saved in your course. You can also click Create another question if you wish to continue working on your course.
These resources could also help you 👇