Australian Mental Health Outcomes and Classification Network
Sharing Information to Improve Outcomes

Skip to content | A+ | A- | Reset

Current Size: 136%

Of interest to:

NOCC Rating Validity

An important issue in the analysis and reporting of the NOCC measures is to determine when a measure is ‘valid’ with respect to the clinical ratings provided.

Outcome measures such as the HoNOS family are referred to here as measures (elsewhere, these have been variously referred to as scales, instruments). Some measures comprise multiple components, such as items (these have been variously referred to as scales). Items can be aggregated into subscales and total scores (these have been variously referred to as summary and total scores). Ratings of items can be described in terms of three mutually exclusive categories:

  1. valid ‘clinical’ ratings that typically indicate levels of problem severity;

  2. valid ‘non-clinical’ ratings that typically indicate reasons why problem severity was not rated; and

  3. invalid values such as ‘nulls’ or values outside of the range for 1 and 2 above.

The validity of a measure is derived from consideration of the validity of the items that comprises that measure. Valid scores can be estimated either when all of the items are clinically valid OR when a sufficient number of items are clinically valid. Two issues to consider are:

  1. How many items need to have a valid clinical rating in order for the overall measure to be considered valid?

  2. If one or more of the items does not have a valid clinical rating, how does this impact on the scoring of subscale and total scores?

The following table shows the criteria used to determine whether a NOCC measure had been validly completed for the purposes of subsequent statistical reporting:

Completion criteria for each of the NOCC measures

NOCC Measure Age Group Completion Criteria
HoNOSCA C&A At least 11 of the first 13 HoNOSCA items have Valid Clinical Ratings
CGAS C&A Any Valid Clinical Rating
FIHS C&A At least 6 of the 7 FIHS items have Valid Clinical Ratings
SDQ - all versions C&A At least 20 of the first 25 items have Valid Clinical Ratings
Age C&A Aged at least 1 day to less than 25 years inclusive
HoNOS / 65+ A&OP At least 10 items have Valid Clinical Ratings
LSP-16 A&OP At least 14 items have Valid Clinical Ratings
BASIS-32 A&OP At least 27 items have Valid Clinical Ratings***
K10+ A&OP At least 9 items have Valid Clinical Ratings
MHI-38 A&OP At least 30 items have Valid Clinical Ratings
Age A Aged between 15 and 110 years inclusive
RUG-ADL OP All 4 items have Valid Clinical Ratings
Age OP Aged between 55 and 110 years inclusive
PoC All Any Valid Clinical Rating
Principal Diagnosis All Any Valid Mental Health Diagnosis Summary Group
MHLS All Either Voluntary or Involuntary Status recorded
Sex All Either Male or Female Sex recorded
Explanatory Notes:  
*** BASIS-32 items 2, 3 & 4 only count as one item
C&A Child & Adolescent Collection Age Group
A&OP Adult AND Older Person Collection Age Group
A Adult Collection Age Group
OP Older Person Collection Age Group