Volume 6, Issue 1 (Continuously Updated 2023)
Func Disabil J 2023, 6(1): 0-0 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Hosseini Kalej S Z, Amiri Shavaki Y, Abolghasemi J, Sadegh Jenabi M. Direct Observation of Procedural Skills for the Clinical Evaluation of Speech Therapy Students in the Assessment of Speech Organs. Func Disabil J 2023; 6 (1) : 241.1
URL: http://fdj.iums.ac.ir/article-1-203-en.html
URL: http://fdj.iums.ac.ir/article-1-203-en.html
Seyede Zahra Hosseini Kalej1 
, Younes Amiri Shavaki1 , Jamileh Abolghasemi2 , Mohammad Sadegh Jenabi * 3
, Younes Amiri Shavaki1 , Jamileh Abolghasemi2 , Mohammad Sadegh Jenabi * 3
1- Department of Speech and Language Pathology, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran.
2- Department of Biostatistics, School of Health, Iran University of Medical Sciences, Tehran, Iran.
3- Department of Speech and Language Pathology, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran. ,ms.jenabi4@gmail.com
2- Department of Biostatistics, School of Health, Iran University of Medical Sciences, Tehran, Iran.
3- Department of Speech and Language Pathology, Rehabilitation Research Center, School of Rehabilitation Sciences, Iran University of Medical Sciences, Tehran, Iran. ,
Abstract: (412 Views)
Background and Objectives: Direct observation of procedural skills (DOPS) is one of the new methods of clinical evaluation that gives feedback about students’ clinical skills. The design and psychometrics of the DOPS test tool for the clinical assessments of speech therapy students in the evaluation of speech organs have been discussed.
Methods: In the current non-interventional descriptive study, 20 speech therapy students were selected from the Faculty of Rehabilitation Sciences. The DOPS test related to the speech organs evaluation procedure and its evaluation checklist was prepared. After obtaining the consent and training, students and evaluators entered the study. The evaluators observed each student’s work with a real patient, and their judgments were recorded based on a structured checklist. Each of them was given feedback in the appropriate environment. Face validity, content, and inter-rater reliability were measured and reported.
Results: Face validity, including importance, clarity, and simplicity, was investigated for each item. The items’ impact scores for favorable face validity of >1.5 were included in the questionnaire. The content validity index for each item was over 0.8, and the content validity ratio was >0.62. All students have chosen the option of slightly satisfied to completely satisfied, and 70% have chosen the option of high satisfaction and complete satisfaction. None of the evaluators chose the options of no satisfaction to slightly satisfied. For inter-rater reliability, the intraclass correlation coefficient (ICC) was calculated using the opinions of two evaluators, and the ICC value was 0.884 with a 95% confidence interval (0.708-0.954) (P<0.001).
Conclusion: The results indicated good inter-rater agreement and reasonable reliability. According to this study, the use of DOPS to evaluate clinical skills in speech therapy students in evaluating speech organs has high validity and reliability.
Methods: In the current non-interventional descriptive study, 20 speech therapy students were selected from the Faculty of Rehabilitation Sciences. The DOPS test related to the speech organs evaluation procedure and its evaluation checklist was prepared. After obtaining the consent and training, students and evaluators entered the study. The evaluators observed each student’s work with a real patient, and their judgments were recorded based on a structured checklist. Each of them was given feedback in the appropriate environment. Face validity, content, and inter-rater reliability were measured and reported.
Results: Face validity, including importance, clarity, and simplicity, was investigated for each item. The items’ impact scores for favorable face validity of >1.5 were included in the questionnaire. The content validity index for each item was over 0.8, and the content validity ratio was >0.62. All students have chosen the option of slightly satisfied to completely satisfied, and 70% have chosen the option of high satisfaction and complete satisfaction. None of the evaluators chose the options of no satisfaction to slightly satisfied. For inter-rater reliability, the intraclass correlation coefficient (ICC) was calculated using the opinions of two evaluators, and the ICC value was 0.884 with a 95% confidence interval (0.708-0.954) (P<0.001).
Conclusion: The results indicated good inter-rater agreement and reasonable reliability. According to this study, the use of DOPS to evaluate clinical skills in speech therapy students in evaluating speech organs has high validity and reliability.
Article number: 241.1
Type of Study: Research |
Subject:
Speech Therapy
Received: 2023/02/5 | Accepted: 2024/01/3 | Published: 2023/02/15
Received: 2023/02/5 | Accepted: 2024/01/3 | Published: 2023/02/15
Contact Information
All the work in this journal are licensed under a Creative Commons
ATTRIBUTION-NONCOMMERCIAL-SHAREALIKE 4.0
INTERNATIONAL International License.
Tehran Province, Tehran, District 3, Mirdamad Ave, Nezam Ave, School of Rehabilitation Science
Tel: +98 21 22228051-2 Ext: 180
Fax98 21 22220946
All the work in this journal are licensed under a Creative Commons
ATTRIBUTION-NONCOMMERCIAL-SHAREALIKE 4.0
INTERNATIONAL International License.