5. DATA
COLLECTION & INSTRUMENTS Pre-
and post-supervision expectations and benefits questionnaire: This measure
will be specifically constructed for this research. The pre-supervision version
will ask respondents about their expectations for the benefits and problems of
on-line supervision. The post-supervision version will ask respondents to rate
the actual occurrence of these benefits and problems. Each question will be Likert
scaled, and there will also be space for free text comments, in relation to each
question and at the end of the questionnaire. Topics covered will be, for example,
accessibility, privacy, technical difficulties, economy, etc. Manchester
Clinical Supervision Scale: This is the only internationally validated research
instrument to measure the effectiveness of clinical supervision, per se. The items
for the instrument were developed by Winstanley and White (2002), using qualitative
data drawn from two rich data sources: the participants of the 23 site CSEP (Butterworth,
Carson and White et al, 1997) and the findings from a set of in-depth site interviews
conducted by Professors White, Butterworth and Bishop (White et al, 1998). Initially,
a 59-item scale was piloted at 5 centres in England and Scotland, representing
a range of nursing specialities. Respondents were asked to score statements related
to the clinical supervision they received, based on a five-point Likert scale
from 'strongly disagree' to 'strongly agree'. Exploratory factor analysis was
used to identify significant factors associated with the process of clinical supervision
and reduce the number of items on the scale to those of statistical value. A full
replication study was then performed on another large sample of 467 nurses from
5 centres in the UK and the final factor analysis established a scale containing
36 items (Winstanley, 2000). Items were included on the final scale if they had
loaded on the same factor with a loading co-efficient greater than 0.4 in at least
three out of the four factor analyses performed. The final analysis indicated
a seven factor solution, accounting for 64.6% of the variance. These 7 factors,
once identified, included elements of all three components of Proctor's model
(1986). Communication process: Archived email communication
between supervisors and supervisees will be collected for qualitative analysis. Therapeutic
attitudes: These will be assessed via the Attitude to Personality Disorder
Questionnaire. This 37 item scale rates the degree to which the subject enjoys
working with difficult clients, feels secure in so doing, is accepting of them,
has a sense of purpose in doing the work, and is enthusiastic. It has good internal
consistency (Cronbach alpha 0.94) and test-retest reliability (ICC 0.66), and
has been demonstrated to relate to job performance, stress, burnout, and perceptions
of managerial authority. Previous research has indicated a correlation between
receipt of clinical supervision and positive therapeutic attitudes (Bowers 2002). Stress:
This will be assessed using the GHQ-12 (Goldberg and Williams, 1988). This is
a brief, 12-item self-administered questionnaire that takes a few minutes to complete.
It is one of the most widely used measures to assess/screen for breaks in normal
functioning and indications of mental disturbance (Goldberg, 1972). The reliability
and validity of the GHQ has been studied by comparing it to longer and more detailed
assessments, usually administered by a psychiatrist. Overall the GHQ appears to
perform well with sensitivities and specificities or about 70 to 80% in most studies. Burnout:
This will be assessed with the Maslach Burnout Inventory. The MBI-Human Services
Survey (Maslach and Jackson) is a measure of burnout as it manifests itself in
staff members in human services institutions and health care occupations. It consists
of 22-items about burnout indicators on which respondents indicate frequency of
agreement. It takes approximately 10-15 minutes to complete. The MBI address three
general scales: Emotional exhaustion measures feelings of being emotionally overextended
and exhausted by one's work. Depersonalisation measures an unfeeling and impersonal
response towards recipients of one's service, care treatment, or instruction.
Personal accomplishment measures feelings of competence and successful achievement
in one's work. MCSS: Winstanley J (2000) Clinical
Supervision: development of an evaluation instrument. Unpublished PhD thesis,
Faculty of Medicine, Dentistry and Nursing, University of Manchester APDQ: Bowers
(2002) Dangerous and Severe Personality Disorder: Response and Role of the Psychiatric
Team. London: Routledge GHQ-12: Golberg, D.P.
& Williams, P., (1988). The User's Guide to the General Health Questionnaire.
Windsor: nfer-Nelson. Goldberg, D.P., (1972) The detection of psychiatric illness
by questionnaire. Maudsley Monograph, 21, 1st ed. Oxford University Press: Oxford. MBI: Maslach
& Jackson (1981). The Maslach Burnout Inventory. Palo Alto, CA: Consulting
Psychologists Press
Click
here to go back to the main research page. online-supervision.net
research team 20 July 2003 |