Outcome measures and the NOCC - FAQs

The introduction of outcome measures is part of a national initiative attempting to measure whether a change has occurred for a consumer as a result of mental health care. Using a range of clinician-rated and consumer-rated measures, collectively known as the National Outcomes and Casemix Collection, the consumer and the clinician can map the journey of recovery over time. The information collected can also be used to help mental health services plan for improvements in service delivery.

Outcome measures contribute to the development of clinical practice, aiming to improve the quality of care for consumers of Australia’s public sector mental health services. Outcome measures can assist consumers in considering options for their care and treatment and support the development of a therapeutic relationship between the clinician and the consumer. The measures can also be used by clinicians to monitor the progress of the consumer, evaluate the effectiveness of treatments and thereby provide information that will assist decisions about clinical practices. The outcome measures can also be used by team leaders and service managers to better understand the needs of their consumers, to plan for the allocation of resources and to identify where service improvements are required. By using a range of outcome measures, consumers and clinicians can work together to map the journey of recovery over time.

The measures that comprise the National Outcomes and Casemix Collection (NOCC) are:

Health of the Nation Outcome Scales (HoNOS);

Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA);

Health of the Nation Outcome Scales 65+ (HoNOS65+);

Life Skills Profile - 16 (LSP-16);

Resource Utilisation Groups – Activities of Daily Living Scale (RUG-ADL);

Children’s Global Assessment Scale (CGAS);

Mental Health Inventory - 38 (MHI - 38);

Behavior and Symptom Identification Scale - 32 (BASIS-32);

Kessler - 10 + (K-10+);

Strengths and Difficulties Questionnaire (SDQ);

Factors Influencing Health Status (FIHS); and

Phase of Care (PoC).

The reporting requirements for the provision of the NOCC dataset by States and Territories to the Australian Government are outlined in the Mental Health National Outcomes and Casemix Collection: Technical specification of State and Territory reporting requirements. The document provides details about the:

• data content of all items included in the Mental Health National Outcomes and Casemix Collection;
• business rules to be followed in the reporting of those data items (i.e. what data are required when); and
• extract format to be used when preparing data files for submission to the Australian Government.

The HoNOS Glossary for scale 10 Problems with activities of daily living, states:

Rate the overall level of functioning in activities of daily living (ADL): e.g., problems with basic activities of self–care such as eating, washing, dressing, toilet; also, complex skills such as budgeting, organising where to live, occupation and recreation, mobility and use of transport, shopping, self–development, etc.

Include any lack of motivation for using self–help opportunities, since this contributes to a lower overall level of functioning.

Do not include lack of opportunities for exercising intact abilities and skills, rated at Item 11 and Item 12.

The Royal College of Psychiatrists (RCP) provide additional detailed guidance, adding:

Item 10, problems with activities of daily living, summarises the severity of personal and social handicap associated with problems rated at Items 1 to 9 and with the patient's motivation.

Consider the overall level of functioning achieved by the patient during the period rated. Rate the level of actual performance, not potential competence. The rating is based on the assessment of three kinds of problem:

• First, a summary of the effects on personal and social functioning of the problems rated at Items 1 to 9
• Second, a lack of opportunities in the environment to use and develop intact skills
• Third, a lack of motivation or encouragement to use opportunities that are available.

The overall level of performance rated may therefore be due to lack of competence, to lack of opportunities in the environment, to lack of motivation, or to a combination of all these.

Two levels of functioning are considered when deciding the severity of problems:

• The basic level includes self-care activities such as eating, washing, dressing, toileting and simple occupations. If performance is moderately or seriously low, rate 3 or 4.
• The complex level includes the use of higher-level skills and abilities in occupational and recreational activities, money management, household shopping, child care, etc., as appropriate to the patient's circumstances.  If these are normal or as adequate as they can be, rate 0 or 1.  Ratings of 2 and 3 are intermediate.

The AMHOCN online training module advises that you “Do not rate lack of opportunities for exercising intact abilities or skills,” which is taken straight from the HoNOS glossary.

Should lack of opportunities be rated at Scale 10?

There has been some confusion that the additional advice provided by the Royal College of Psychiatrists is confusing and contradictory.

Scale 10 is rating actual performance, not potential competence, within existing environmental constraints. Scales 11 and 12 are rating the person’s environment and the limits that the environment may have on supporting skills development or preventing skills deterioration.  At Scale 10 you are rating what the person is actually doing, while at 11 and 12 you are rating the environment and its provision of access and opportunity to improve or maintain skills.

For example, the patient may currently reside in long-term residential accommodation for people with severe and chronic mental illness. This environment affords them little opportunity to demonstrate complex skills such as undertaking housework or washing and ironing their own clothes. At Scale 10 you are rating the patient’s actual performance. The constraints of the environment mean that the patient’s potential competence cannot be demonstrated. This means that actual performance attracts a higher rating given the patient’s inability to demonstrate complex activities of daily living. However, if environmental modifications could lead to improvements in actual performance (such as providing training in household duties) then the extent of the need for environmental modifications are rated at Scales 11 and 12 with the increasing need for environmental modification attracting higher ratings.

Scale 11 Problems with living conditions This scale requires a knowledge of the patient’s usual domestic environment during the period rated, whether at home or in some other residential setting. If this information is not available (usually because someone is in an acute setting who has not previously been in contact with services), rate 9 (not known). Where a patient is in a longer term placement such as a long stay rehabilitation setting, if the plan of care is for that person to remain in that setting for at least 6 months then it is that environment that should be rated. Consider the overall level of performance this patient could reasonably be expected to achieve given appropriate help in an appropriate domestic environment. Take into account the balance of skills and disabilities. How far does the environment restrict, or support, the patient’s optimal performance and quality of life? Do staff know (as they should) what the patient’s capacities are? The rating must be realistic, taking into account the overall problem level during the period, ratings on scales 1-10, and information on the following points: * are the basics provided for – heat, light, food, money, clothes, security and dignity? If the basic level conditions are not met, rate 4; * consider the quality and training of staff relationships with staff or with relatives or friends at home; degree of opportunity and encouragement to improve motivation and maximise skills, including: interpersonal problems; provision for privacy and indoor recreation; problems with other residents; helpfulness of neighbours. Is the atmosphere welcoming! Are there opportunities to demonstrate and use skills: e.g. to cook, manage money, exercise talents and choice, and maintain individuality? If full autonomy has been achieved, i.e. the residential environment does not restrict optimum performance overall, rate 0; * a less full but adequate regime is rated 1. Between these poles, an overall judgement is required as to how far the environment restricts achievable autonomy during the period – 2 indicates moderate restriction and 3 substantial.

Scale 12 Problems with occupation and activities The principles considered at scale 11 also apply to the outside environment. This scale requires a knowledge of the patient’s usual day time environment during the period rated, whether at home or in some other residential setting. If this information is not available (usually because someone is in an acute setting who has not previously been in contact with services), rate 9 (not known). Where a patient is in a longer term placement such as a long stay rehab setting, if the plan of care is for that person to remain in that setting for at least 6 months then it is the environment around that placement that should be rated. Consider arrangements for encouraging activities such as: shopping; using local transport; amenities such as libraries; understanding local geography; possible physical risks in some areas; use of recreational facilities. Take into account accessibility, hours of availability, and suitability of the occupational environment provided for this patient at day hospital, drop-in or day centre, sheltered workshop, etc. Are specific (e.g. educational) courses available to correct deficits or provide new skills and interests? Is a sheltered outside space available if the patient is vulnerable in public (e.g. because of odd mannerisms, talking to self, etc.)? For how long is the patient unoccupied during the day? Do staff know what the patient’s capacities are? The rating is based on an overall assessment of the extent to which the daytime environment brings out the best abilities of the patient during the period rated, whatever the level of disability rated at scale 10. This requires a judgement as to how far changing the environment is likely to improve performance and quality of life and whether any lack of motivation can be overcome. * If the level of autonomy in daytime activities is not restricted, rate 0. A less full but adequate regime is rated 1. * If minimal conditions for daytime activities are not met (with the patient severely neglected and/or with virtually nothing constructive to do), rate 4. * Between these poles, a judgement is required as to how far the environment restricts achievable autonomy – 2 indicates moderate restriction and 3 substantial.

No - the consumer does not have to be present. The Health of the Nation Outcome Scales (HoNOS) - including also the family of measures the HoNOS65+ and the HoNOSCA - is not a clinical interview. Mental health staff gather information from all sources available to them to complete the measure including: collateral information from key informants, review of the medical records, previous HoNOS ratings, as well as interview and observation. There are occasions when some information is not readily available; but be that as it is, mental health staff are still undertaking an assessment and making clinical decisions regarding the best approach to initial or ongoing management of the consumer based on that assessment. Given this clinical process, the HoNOS can still provide a summary of the clinician’s assessment based on the best available information. As a result, the reality is that the HoNOS, and other members of the HoNOS family, can be completed during telephone triage and discharge processes, including lost to care and other occasions when the consumer is not present.

The Child and Adolescent Mental Health Information Development Expert Advisory Panel (CAMHIDEAP) updated the Frequently Asked Questions: The Clinician's FAQ to HoNOSCA in Australia. This resource aims to provide clinicians with guidance around the specific items identified by the NOCC Strategic Directions report plus other common issues that may not be answered in the HoNOSCA glossary.