Performance of "standardized examinees" in a standardized-patient examination of clinical skills

PURPOSE: As a first step in testing the utility of using trained "standardized examinees" (SEs) as a quality-assurance measure for the scoring process in a standardized-patient (SP) examination, to test whether medical residents could simulate students in an SP examination and perform consistently to specified levels under test conditions. METHOD: Fourth-year students from the Baltimore-Washington Consortium for SPs participated in a National Board of Medical Examiners Prototype Examination of clinical skills consisting of twelve 15-minute student-patient encounters in 1994-95. For this examination, internal medicine residents were trained to act as ordinary candidates and to achieve target scores by performing to a set level on specific checklist items used by SPs for recording interviewing, physical-examination, and communication skills. The "strong SEs" were trained to score 80% correct on six of the examination's 12 cases (study cases), and the "weak SEs" were trained to score 40% correct on the same six cases. The strong and weak SEs' checklist scores on the study cases were compared through independent, two-tailed t-tests. When there was less than 85% agreement on specific checklist items in each case between the SE training and the SP recording, videotapes of the cases were reviewed; in such cases an SE's performance was the final score agreed upon after review. RESULTS: Seven SEs took the SP examination and were not detected by the SPs. There was a total of 84 discrepancies between predicted and recorded checklist scores across 659 checklist items in 40 encounters scored by the SPs. After correcting the discrepancies based on videotape review, the estimated actual mean score was 77.3% for the strong SEs and 44.0% for the weak SEs, and was higher for the strong SEs in each study case. The overall fidelity of the SEs to their training was estimated to be 97%, and the overall SP accuracy was estimated to be 91%. The videotape review revealed 47 training-scoring discrepancies, most in the area of communication skills. CONCLUSION: This study suggests that SEs can be trained to specific performance levels and may be an effective internal control for a high-stakes SP examination. They may also provide a mechanism for refining scoring checklists and for exploring the validity of SP examinations.     

The development of a course in basic physical examination skills

Basic clinical skills of most medical school undergraduates continue unobserved and deficiencies have been detected in a significant number of physicians during residency. Nevertheless, our health care system is calling for competent graduates with solid basic clinical skills and a larger representation of qualified generalists in the increasingly important managed care environment. The need for a better introduction to Clinical Skills course was identified by students and clinical faculty at Ponce School of Medicine. In response to these concerns a new curriculum was developed with clear objectives, effective instructional strategies, and performance-based evaluation, with adult learning principles as its framework. The musculoskeletal examination unit of the curriculum was pilot tested and the course evaluation strategies revealed satisfaction with objectives, instructional and evaluation strategies, as well as improved confidence, and sense of usefulness for the learned skills. A curriculum in basic clinical skills that incorporates adult learning principles with solid instructional strategies can increase the confidence and skills of the learners and should lead to improved outcomes.     

The development of a clinical skills centre

Guidelines produced by the General Medical Council of Great Britain have emphasised the importance of the development of the skills and attitudes appropriate for a junior doctor. Medical schools are in the process of reforming their curricula accordingly. The development of these skills is made increasingly difficult by changes such as short admissions to hospital, increased care in the community, and reduced resources. This article outlines the development of a clinical skills centre as a multidisciplinary unit to improve clinical skills teaching with the aid of up-to-date technology and educational practices. By sharing our experience we aim to provide a practical guide for the development of such units in other medical and nursing colleges.     

New perspectives on the clinical applications of functional radiology of the liver

Preliminary results of "new clinical applications" of functional imaging of the liver are reported. In 20 healthy volunteers portal flow measurement with Doppler US at the level of right, left portal branch and main portal trunk, showed the preferential distribution in baseline conditions of portal flow to the right liver (about 68%) as compared to the left portal branch. This influenced MRI volumetry of right liver as compared to left liver. After meal intake, flow increase was significantly higher at the level of left portal branch suggestive for a "functional reserve" in left liver. Portal flow physiology was examined in preparation of portal imaging before and after portal vein embolization, a procedure performed preoperatively before enlarged hepatectomies.     

Venous thromboembolism, radiology by the organ, combined diagnostic imaging, clinical radiology

OBJECTIVE: To describe mortality and morbidity during a period of 2 years after coronary artery bypass grafting (CABG) in relation to a history of hypertension. PATIENTS: All patients in western Sweden in whom CABG was undertaken between June 1988 and June 1991 and in whom simultaneous valve surgery was not performed were included in the study. DESIGN: A prospective 2-year follow-up study. RESULTS: Patients with a history of hypertension (n = 777) differed from patients without such a history (n = 1348) in that the proportion of women was higher, they were older and more frequently had a history of congestive heart failure, diabetes mellitus, renal dysfunction, cerebro-vascular disease, intermittent claudication and obesity, and the number of smokers and patients with previous CABG was lower. They were also more likely to develop post-operative cerebrovascular complications and signs of myocardia damage. Patients with hypertension tended to have increased mortality during the first 30 days after CABG and the late mortality (between day 30 and 2 years) was significantly higher than in non-hypertensive participants. Whereas the development of myocardial infarction was similar in both groups, the hypertensive study participants more frequently developed stroke during 2 years of follow-up. In a multivariate analysis including age, sex, history of different cardiovascular diseases, smoking, ejection fraction, and the occurrence of three-vessel disease, hypertension did not emerge as an independent predictor of death in the early or late phase or during a total of 2 years of follow-up. CONCLUSION: Among CABG patients, those with a history of hypertension have a different pattern of risk factors. They have a higher mean age, include a higher proportion of women and have a higher prevalence of congestive heart failure, diabetes mellitus, renal dysfunction, cerebro-vascular disease, intermittent claudication, and obesity. They also have an increased frequency of immediate post-operative complications and an increased 2-year mortality, even if a history of hypertension was not an independent predictor of death during 2 years of follow-up.     

Physical examination and chronic lower-extremity ischemia: a critical review

OBJECTIVE: To determine the clinical utility of physical examination in patients with suspected chronic ischemia of the lower extremities. DATA SOURCES: MEDLINE search (January 1966 to January 1997), personal files, and bibliographies of textbooks on physical diagnosis, surgery, and vascular surgery. STUDY SELECTION: Both authors independently graded the studies as level 1, 2, or 3, according to predetermined criteria. Criteria deemed essential for analysis of sensitivity, specificity, and likelihood ratios were (1) clear definition of study population, (2) clear definition of physical examination maneuver, and (3) use of an acceptable criterion standard test for comparison. RESULTS: The following positive findings help clinicians diagnose the presence of peripheral arterial disease: abnormal pedal pulses, a unilaterally cool extremity, a prolonged venous filling time, and a femoral bruit. Other physical signs help determine the extent and distribution of vascular disease, including an abnormal femoral pulse, lower-extremity bruits, warm knees, and the Buerger test. The capillary refill test and the findings of foot discoloration, atrophic skin, and hairless extremities are unhelpful in diagnostic decisions. Mathematical formulas, derived from 2 studies using multivariate analysis, allow clinicians to estimate the probability of peripheral arterial disease in their patients. CONCLUSION: Certain aspects of the physical examination help clinicians make accurate judgments about the presence of peripheral arterial disease and its distribution.     

Intermediate clinical follow-up of a dual-radius acetabular component

In this study, 92 primary total hip arthroplasties were performed in 83 patients using a porous-coated, dual-radius, cementless, acetabular component. All hips underwent line-to-line dome reaming with press-fit implantation that was judged to have complete bone contact. This acetabular shell provides a 1-mm oversized peripheral rim, which adds excellent initial stability while allowing complete bone contact in all hips. No fractures occurred. In 83% of hips, adjunctive screw fixation was not necessary. At a minimum of 4 years, follow-up, there were no revisions, no acetabular migration, one case of acetabular erosion consistent with osteolysis, and the average Harris Hip Score was 95. The design features of this new acetabular component have provided excellent fixation with complete initial bone contact, resulting in satisfactory intermediate clinical and radiographic results. The design provides excellent peripheral stability and complete bone contact.     

Performance on the internal medicine second-year residency in-training examination predicts the outcome of the ABIM certifying examination

For 223 residents from eight teaching hospitals, the results of the second-year in-training examination and the first-sitting certifying examination of the American Board of Internal Medicine were highly correlated. The results of the in-training examination can serve residents as an important measure of their preparedness for certification and can be useful in identifying the need for more intensive self-study strategies during the subsequent one and a half years.     

Practice schedules and the use of component skills in problem solving.

In motor and verbal learning, random practice schedules produce poorer acquisition performance but superior retention relative to blocked practice. We extend this contextual interference effect to the case of learning cognitive procedural skills to be used in problem solving. Subjects in three experiments practiced calculation with Boolean functions. After this acquisition phase, subjects solved problems requiring these procedures. Experiments 1 and 2 demonstrated superior transfer to problem solving for skills acquired under random schedules. In Experiment 3, subjects practiced component skills in a blocked schedule, with one of four tasks—same–different judgment, mental arithmetic, short-term memory, or long-term memory—intervening between trials. For same–different judgments and mental arithmetic, transfer performance was comparable to that found for random schedules in Experiments 1 and 2. This result suggests that the differences depend on processing rather than storage demands of intertrial activity. Implications for theories of problem solving and part–whole transfer are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mammography versus clinical examination of the breasts

Using published data from screening trials, this article compares two-modality (mammography and clinical examination) and single-modality (clinical examination alone) screening by evaluating cancer detection rates, program sensitivities, mode of cancer detection in two-modality screening, nodal status at time of detection, survival 10 years post-diagnosis, and breast cancer mortality 10 years after entry. Consistently, two-modality screening achieved higher cancer detection rates and program sensitivity estimates than either modality alone; mammography alone achieved higher rates than clinical examination alone; interval cancer detection rates between screening examinations were higher following clinical examination alone than mammography alone; single-modality screening with mammography failed to detect breast cancers identified by clinical examination alone; the sensitivity of mammography was lower in younger than older women, while the reverse was true for clinical examination; and mammography identified a higher proportion of node-negative breast cancer than clinical examination. We conclude that combining clinical breast examination with mammography is desirable for women age 40-49 because mammography is less sensitive in younger than older women. Careful training and monitoring are, however, as essential with clinical examiners as with mammographers.     

RAPORT radiology system: results of clinical trials

RAPORTTM, an automated radiology management and reporting system is currently operational in more than 25 hospital departments of varying sizes and types. Data have been gathered from 19 installations in operation for 6 months or longer and four systems which failed. Findings were as follows: 1. Mark sense forms were used in 71% of cases (29% dictation) and for an average of 70% of all pathologic material. 2. Report turnaround time ranged from 0.1 to 6 hr (average 2.5 hr) depending on departmental priorties and organization. 3. Rejection of the system was based upon inadequate documentation of needs prior to installation, poor preparation of staff members, and underestimation of the impact on computer systems on existing organizations. 4. System downtime averaged 2.5 hr per month. 5. The ratio of pathologic to normal reports did not vary significantly among university, government, and private hospitals. 6. RAPORT can no longer be considered an experimental system. Properly managed, it is an effective administrative tool which can significantly improve departmental service.     

A critical analysis of directive counselling as a component of tinnitus retraining therapy

Tinnitus retraining therapy (TRT) has been presented as a new approach to tinnitus management. In this paper a number of theoretical and practical problems with TRT are identified. These problems relate to the distinction between directive counselling and cognitive therapy, the adequacy of the cognitive therapy components, the nature of the outcome data which have been presented to date, the theoretical basis for the treatment, and the conceptual clarity of terms such as perception, attention and coping. The stated goal of removal of the perception of tinnitus may lead to confusion about the likely outcome of TRT for most patients. Methodological limitations in the research which has been published to date preclude any claims about the efficacy of TRT at the present time. It is suggested that randomized, controlled studies which include no-treatment and placebo conditions need to be undertaken. Studies are required in which the efficacy of the counselling and white noise components can be clearly isolated. Suggestions are made about the role of psychologists and non-psychologists in the provision of counselling and cognitive therapy services to tinnitus patients.     

Assessing reliability: Critical corrections for a critical examination of the Rorschach Comprehensive System.

J. M. Wood et al (see records 84-17678 and 84-17679) argued that the Rorschach Comprehensive System (CS) lacked many essential pieces of reliability data and that the available evidence indicated that scoring reliability may be little better than chance. Contrary to their assertions, the author suggests why rater agreement should focus on responses rather than summary scores, how field reliability moves away from testing CS scoring principles, and how no psychometric distinction exists between a percentage correct and a percentage agreement index. Also, after reviewing problematic qualities of kappa, a meta-analysis of published data is presented indicating that the CS has excellent chance-corrected interrater reliability (Estimated κ, M?=?.86, range?=?.72–.96). Finally, the author notes that Wood et al ignored at least 17 CS studies of test-retest reliability that contain many of the important data they said were missing. The author concluded that Wood et al's erroneous assertions about the more elementary topic of reliability make suspect their assertions about the more complex topic of validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)