| Article Access Statistics|
| Viewed||459 |
| Printed||6 |
| Emailed||0 |
| PDF Downloaded||58 |
| Comments ||[Add] |
Click on image for details.
BRIEF RESEARCH COMMUNICATION
|Year : 2019
: 61 | Issue : 2 | Page
|Case vignette-based evaluation of psychiatric blended training program of primary care doctors
Kabir Garg1, N Manjunatha1, Channaveerachaari Naveen Kumar1, Prabhat K Chand2, Suresh Bada Math1
1 Department of Psychiatry, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
2 Centre for Addiction Medicine, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
Click here for correspondence address and
|Date of Web Publication||11-Mar-2019|
| Abstract|| |
Introduction: The need to integrate psychiatry in primary care is increasingly recognized as the favorable strategy worldwide. The contribution of primary care doctors (PCDs) is extremely important toward it. However, majority PCDs find it difficult to diagnose and treat common psychiatric disorders. Many training programs developed for PCDs, with different methods employed for posttraining evaluation. One of such program is blended psychiatric training program developed at our center.
Aim: Case vignette-based outcome evaluation of on-site section of blended psychiatric training of PCDs at the end of 2 weeks.
Materials and Methods: Two qualified psychiatrists designed the ten case vignettes after pilot use. Data were collected at baseline and at the end of 2 weeks on-site-training program. Major psychiatric diagnoses and treatments were covered. The responses to each vignette were evaluated with maximum marks 10 (5 each for diagnosis and treatment).
Results: The mean age of the 21 participants was 43.1 ± 7.3 years. The posttraining score (83.42 ± 10.38) was significant higher than the baseline score (42.4 ± 23.10).
Conclusion: Blended program for training of PCDs in psychiatric disorders significantly improves their diagnostic and treatment capabilities.
Keywords: Case vignette evaluation, primary care psychiatry, training
|How to cite this article:|
Garg K, Manjunatha N, Kumar CN, Chand PK, Math SB. Case vignette-based evaluation of psychiatric blended training program of primary care doctors. Indian J Psychiatry 2019;61:204-7
|How to cite this URL:|
Garg K, Manjunatha N, Kumar CN, Chand PK, Math SB. Case vignette-based evaluation of psychiatric blended training program of primary care doctors. Indian J Psychiatry [serial online] 2019 [cited 2019 Dec 8];61:204-7. Available from: http://www.indianjpsychiatry.org/text.asp?2019/61/2/204/253824
| Introduction|| |
The fact that primary care doctors (PCDs) come across a large body of patients presenting with psychiatric disorders has been identified for a long time. As a matter of fact, epidemiological studies done as far back as 1970s identified that up to half of total psychiatric treatment was provided by the PCDs. These findings are echoed by even the recent studies, for example, the prevalence of depressive disorders was reported to be much higher in primary care attendees than in general populations and on many occasions, the PCDs were the only doctors clients ever consult., This identification by PCDs in psychiatry, however, has always been accompanied by the fact that the PCDs have been found to be lacking in effectively managing the needs and expectations of those with psychiatric morbidities.,,,,, This may be attributable to a number of reasons such as limited time, low confidence of clinician, reluctance on part of the client to discuss symptoms, misdiagnosing somatic symptoms of illnesses as physical ailments or pressure of multiple roles expected out of a PCD, lack of proper training in psychiatry, unaware about asking right questions to elicit symptoms.,
This has resulted in a large of group of authors and policymakers to focus attention on training of the PCDs in psychiatry and attempts at systematically studying the gains made. Written postcourse tests administered to PCDs have been found to be a valid instrument of evaluation and have shown increased capabilities in diagnosing and managing psychiatric ailments.,, There is, however, a large nonuniform body of training programs all over the world, making the task of identifying the most beneficial ones arduous. Furthermore, most of these attempts have been made in developed countries while a large treatment gap exists in developing countries. For example, in India, against a weighted percentage prevalence of 10.6% for current psychiatric illness, a treatment gap between 70% and 92% across multiple disorders was identified. The authors come across few publications, for the region where effect of any training program for the PCDs on their ability to diagnose and manage common psychiatric conditions was evaluated.
Aim of this paper is to evaluate PCDs in psychiatry using case vignette method in pre- and post-design for the “2 weeks” “on-site” training phase.
| Materials and Methods|| |
The current study was done on 23 PCDs from an Indian State who were trained at a Tertiary care Neuropsychiatric Center in South India under the District Mental Health Program of India. All PCDs are working in government sector after their undergraduate medical education (MBBS). Ethical Committee of institute approved this study.
Evaluation of PCDs was done using a pre- and post-design method using case vignettes, after 2-weeks on-site training section of a proposed 1-year long NIMHANS Extension for Community Healthcare Outcomes (ECHO) training, i.e., a Hub and Spokes model of periodic tele-mentoring. As a part of NIMHANS ECHO, every fortnight the PCD (spokes) would present anonymized cases of patients from their own practice for management guidance from the NIMHANS HUB specialists and other PCPs followed by brief lecture on a disease-related topic using multipoint video conferencing technology. The typical day of on-site training program consisted of 2 hs of didactic session on a topic, followed by a 2-h visit to the outpatient department and later, interview of a suitable psychiatric patient relevant to the day's topic with discussion for up-to an hour. The physicians were also required to take two online tests during the duration of the training.
Ten case vignettes and their answer keys pertaining to common psychiatric presentations in primary care settings, were prepared by a team of public mental health professionals and psychiatrists. The vignettes included clinical scenarios involving depression, mania, psychosis, generalized anxiety disorder, panic disorder, dissociative disorder, somatization disorder, epilepsy, alcohol harmful use, and alcohol dependence syndrome. Each vignette was worth 10 marks, five each for diagnosis and management (a total score of 100). Case-vignettes are available on request from corresponding author.
The PCDs were administered the vignettes before the commencement and after the completion of the onsite training program. All entries were then scored by a single rater using the answer key. The participation in this study was optional for the PCPs and informed consent was taken.
| Results|| |
Out of the 23 participants, one was dropped as he was a qualified psychiatrist currently employed as a PCD and another withdrew consent to be the part of the study. The mean age of the participants was 43.1 ± 7.3 years. On performing paired sample t-test, the posttraining score (83.42 ± 10.38) was significant higher than the baseline score (42.4 ± 23.10) (t = −9.1, df = 20, P < 0.001).
The improvement was significant across all the vignettes [Figure 1]. The effects of training were especially pronounced in areas of diagnosing and managing mania, dissociation, and somatization disorders. Abilities in diagnosing and managing depression and epilepsy, although showed significant improvement, were found to have higher scores even at the initiation of year-long training.
Authors also mapped the pre- and post-training scores of all the individuals [Figure 2] and found that all the individuals showed improvement and while the abilities were widely separated at the beginning of the training, they seemed to converge toward a more uniform level.
| Discussion|| |
It is widely understood that an evaluation system is indispensable for any training system. This becomes even more salient when the area includes public health and large-scale implementation. There can be different ways, for example, multiple choice questions (MCQs), but these have limitations, a major one of which is the lack of information on clinical skills., Case vignettes have been shown to be a valid and good way of assessing the clinical skills of PCDs following training modules.,
As discussed earlier, the multitude of training programs make it difficult for identifying the most effective strategies, yet through review of studies over 50 years, three major determinants have been identified. These include the duration of the training module, the extent of active participation and degree of integration of new knowledge in the trainees' clinical practice.
The most common type of program has been short conferences held at a location away from the PCDs area of practice., These, however, have the issues of short duration and over indulgence in didactic style of training. Researchers in other medical disciplines have established that optimum value from teaching programs can be reaped if continuing teacher-learner relationships are maintained as a part of longitudinal follow through programs., The psychiatric blended training program at our institute comprised of a longer onsite program (2 weeks) with 11 months of online continuing education, we also used additional teaching modalities apart from didactics which may have resulted in higher posttest scores in our sample.
Similarly, it has been demonstrated that a higher degree of involvement in the teaching process is necessary for changes in abilities of physicians in psychiatry. Longer, interactive programs with active participation of trainees and case-based learning that allow opportunities to practice the skills learned, are conducive to sustained practice at primary level.,, During the training program at our center, ample opportunities for the trainees to get involved were made available. These included daily outpatient visits and interviews of patients. The end of the day also had an interactive session providing all the trainees an opportunity to interact with trainers, provide feedback and question further. Each day also started with a recap of the previous day provided by the trainees using a “teach back” approach.
The issue of clinical relevance arises as in a large majority (and even in our case), the training happens at a location far removed from the physicians usual practice area. The maximum benefit has been observed when the trainees observe the care and improvement of patients in a primary care setup., The training program followed at our center had a second phase of online fortnightly continuing education and would present clinical cases and updates of psychiatric patients seen by them and this would be followed by a discussion by their peers and the experts at the center. The effects of the second phase have not been evaluated yet as it is continuing currently.
| Conclusion|| |
The 2 weeks on-site section of psychiatric blended program for training of PCDs in psychiatric disorders including didactics, case discussions, and outpatient-based training significantly improves their diagnostic and treatment capabilities with regards to common psychiatric disorders.
The current study did not have any control group, and the postcourse evaluations were done immediately after completion of training thus recency effects may have contributed to higher scores. In addition, the PCDs' readiness and confidence to use these skills in real-world setting were not evaluated.
It would be very important to be able to evaluate the PCDs after completion of the longitudinal phase of the training program and evaluate the capabilities in the real-world practice.
A part of study was presented at “Neuropsychiatry 2018” – 11th International Congress of International Neuropsychiatry Association (TS Srinivasan and NIMHANS Knowledge Conclave- 2018) on February 15-17, 2018 at NIMHANS Convention Centre, Bengaluru.
Financial support and sponsorship
This program is being funded by NHM and State Health Society Bihar.
Conflicts of interest
There are no conflicts of interest.
| References|| |
Jones LR, Badger LW, Ficken RP, Leeper JD, Anderson RL. Mental health training of primary care physicians: An outcome study. Int J Psychiatry Med 1988;18:107-21.
Regier DA, Goldberg ID, Taube CA. The de facto US mental health services system: A public health perspective. Arch Gen Psychiatry 1978;35:685-93.
Craven MA, Bland R. Depression in primary care: Current and future challenges. Can J Psychiatry 2013;58:442-8.
Boerma WG, Verhaak PF. The general practitioner as the first contacted health professional by patients with psychosocial problems: A European study. Psychol Med 1999;29:689-96.
Cepoiu M, McCusker J, Cole MG, Sewitch M, Belzile E, Ciampi A, et al.
Recognition of depression by non-psychiatric physicians – A systematic literature review and meta-analysis. J Gen Intern Med 2008;23:25-36.
von Ammon Cavanaugh S, Elliott R. Future direction of psychiatric training for primary care physicians. Psychiatr Med 1988;6:64-86.
Jones L, Parlour R. The psychiatric role of the rural primary care practitioner. Psychiatric Services for Underserviced Rural Populations. New York: Brunner/Mazel: 1985. p. 92-102.
Goldberg D, Steele JJ, Johnson A, Smith C. Ability of primary care physicians to make accurate ratings of psychiatric symptoms. Arch Gen Psychiatry 1982;39:829-33.
Marks JN, Goldberg DP, Hillier VF. Determinants of the ability of general practitioners to detect psychiatric illness. Psychol Med 1979;9:337-53.
Picardi A, Lega I, Tarsitani L, Caredda M, Matteucci G, Zerella MP, et al.
A randomised controlled trial of the effectiveness of a program for early detection and treatment of depression in primary care. J Affect Disord 2016;198:96-101.
Avasthi A, Varma SC, Kulhara P, Nehra R, Grover S, Sharma S, et al.
Diagnosis of common mental disorders by using PRIME-MD patient health questionnaire. Indian J Med Res 2008;127:159-64.
] [Full text]
Al-Faris E, Al-Subaie A, Khoja T, Al-Ansary L, Abdul-Raheem F, Al-Hamdan N, et al.
Training primary health care physicians in Saudi Arabia to recognize psychiatric illness. Acta Psychiatr Scand 1997;96:439-44.
Gask L, McGrath G, Goldberg D, Millar T. Improving the psychiatric skills of established general practitioners: Evaluation of group teaching. Med Educ 1987;21:362-8.
Kroenke K, Taylor-Vaisey A, Dietrich AJ, Oxman TE. Interventions to improve provider diagnosis and treatment of mental disorders in primary care. A critical review of the literature. Psychosomatics 2000;41:39-52.
Gururaj GV, Benegal V, Rao GN, Pathak K, Singh LK, Mehta RY, et al
. National Mental Health Survey of India, 2015-16: Summary. NIMHANS; 2016.
Sriram TG, Chandrashekar CR, Isaac MK, Srinivasa Murthy R, Kishore Kumar KV, Moily S, et al.
Development of case vignettes to assess the mental health training of primary care medical officers. Acta Psychiatr Scand 1990;82:174-7.
Sriram TG, Moily S, Kumar GS, Chandrashekar CR, Isaac MK, Murthy RS, et al.
Training of primary health care medical officers in mental health care. Errors in clinical judgment before and after training. Gen Hosp Psychiatry 1990;12:384-9.
Arora S, Kalishman S, Thornton K, Komaromy M, Katzman J, Struminger B, et al.
Project ECHO (Project Extension for Community Healthcare Outcomes): A national and global model for continuing professional development. J Contin Educ Health Prof 2016;36 Suppl 1:S48-9.
Sriram TG, Chandrashekar CR, Moily S, Kumar K, Raghuram A, Isaac MK, et al.
Standardisation of multiple-choice questionnaire for evaluating medical officers' training in psychiatry. Soc Psychiatry Psychiatr Epidemiol 1989;24:327-31.
Hodges B, Inch C, Silver I. Improving the psychiatric knowledge, skills, and attitudes of primary care physicians, 1950-2000: A review. Am J Psychiatry 2001;158:1579-86.
Billings EG. Experiments in the psychiatric education of the primary physician. Am J Psychiatry 1971;128:92-4.
Callen KE, Davis D. The general practitioner: How much psychiatric education? Psychosomatics 1978;19:409-13.
Gallagher RM 3rd
, Chapman RJ. The medication seminar and primary care education. Gen Hosp Psychiatry 1981;3:16-23.
Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A, et al.
Impact of formal continuing medical education: Do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA 1999;282:867-74.
Wright JM. Continuing medical education in psychiatry. Aust N
Z J Psychiatry 1991;25:111-8.
Goldberg D. Teaching methods for use by psychiatrists in primary care settings. Acta Psychiatr Belg 1986;86:568-74.
Rittelmeyer LF Jr., Flynn WE. Psychiatric consultation in an HMO: A model for education in primary care. Am J Psychiatry 1978;135:1089-92.
Helz JW, Thompson TL. Consultation-liaison models for teaching psychiatry to primary care physicians. Methods in Teaching Consultation-Liaison Psychiatry. Vol. 20. Basel, Switzeland: Karger Publishers; 1990. p. 1-16.
Dr. N Manjunatha
Department of Psychiatry, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka
Source of Support: None, Conflict of Interest: None
[Figure 1], [Figure 2]