Factsheet

NSW Health NGO AOD performance indicator fact sheet

This fact sheet relates to data analysis and trend reports. A data analysis and trend report is a summary and interpretation of data which has been collected over time to show changes or patterns during the reporting period and which can be used to improve services and practices. Three of the AOD core performance indicators have a recent data analysis and trend report listed as part of the reporting requirements.

Last updated: 19 June 2019
Download

Tips for creating a recent data analysis and trend report

A data analysis and trend report is a summary and interpretation of data which has been collected over time to show changes or patterns during the reporting period and which can be used to improve services and practices. Three of the AOD core performance indicators have a recent data analysis and trend report listed as part of the reporting requirements.

Key points about data analysis and trend reports

  • Trend reports present data which has been collected over a defined period of time to demonstrate changes or patterns that have occurred throughout the reporting period.
  • Trend reports may contain a combination of tables, graphs and text to present and interpret data.
  • Text in trend reports should explain the nature of the changes or patterns identified in the data and provide a narrative around why these changes or patterns are occurring within the service.
  • Trend reports should describe how an organisation is responding to the trends or patterns it identifies, including improvements planned or made to its services and practices.

Practice tips for creating a data analysis and trend report

  • Clearly state the goal of each trend report, including what data is being collected and analysed, and why.
  • Clearly define the reporting period by including the date range in which data was collected.
  • Identify any changes or patterns observed in the data. Use descriptive terms to explain the nature of the trend observed. For example, a trend may be upward, downward, erratic or stable. If no changes have occurred, state this.
  • Explain the key factors influencing the changes or patterns.
  • Describe any actions taken as a result of the data observed and the outcomes of those actions, highlighting any service or practice improvements.

Which AOD core performance indicators require a data analysis and trend report?

NGOs funded by NSW Health to deliver AOD treatment services are required to provide three trend reports for reporting against the below core performance indicators. Example reports and a blank trend report template is provided in the attached PDF.

AOD-Core 3: Client reported experience

Requires data analysis and trend report. Note: to be presented with a current client reported experience measure and protocol/s.

AOD-Core 4: Clinical incident management

Requires recent clinical incident data analysis and trend report and improvement plans. Note: to be presented with a current clinical incident policy and protocol/s.

AOD-Core 5: Client discharge and transfer of care

Requires a client file audit report identifying percentage of clients with a planned or known discharge/transfer of care, which had a discharge/transfer of care plan documented. Note: to be presented with a client discharge and transfer of care policy and protocol/s

Example data analysis and trend reports

Trend report for NSW Health AOD-Core 3: Client reported experience

Goal of the report

This report aims to identify trends in the rate of client reported experiences collected and the level of client satisfaction with services; to discuss key factors influencing those trends; and to inform service improvements in response to identified trends.

Data

Provide data on the percentage of client experiences collected and the average percentage client reported experience of satisfication over six months.data on the percentage of client experiences collected and the average percentage client reported experience of satisfication over each six month reporting period.

Briefly describe the changes of trends identified in the data

For example, the rate of clients completing a client reported experience measure at 4 weeks and at exit has increased steadily, while the average reported level of client satisfaction has also increased.

Discuss key factors which influenced this change/trend

For example, the steady increase in completed client feedback surveys can be attributed to the implementation of the newly developed Client Reported Feedback Guidelines for staff in July 2018. Previously, the service did not have a consolidated process for analysing and taking action on clients’ feedback.

As a result, the guidelines emphasise that feedback provided by clients is collected, analysed and staff take action on the results to improve the quality of the service. Also, the guidelines recommend that staff may distribute feedback surveys for clients to complete at various points of their recovery, and thus make changes to clients’ treatment plans, if necessary. This is to provide staff with information about clients’ experience and their level of satisfaction with the service.

Actions and outcomes as a result of data and trend analysis

Since implementing these Guidelines, clients are highly satisfied with the service and feel their feedback is being reflected in the care they’re receiving. This is shown in the increased level of client satisfaction observed in the data. Similarly, staff have expressed increased work satisfaction because they can directly observe the positive impact of requesting and acting on client feedback in the increased level of client satisfaction being reported. The service is pleased with the positive incremental changes to the client reported feedback process and hopes to reach 100% reported experience by all clients by the next 2019/2020 financial year while continuing to maintain a high level of reported client satisfaction.

Trend report for NSW Health AOD-Core 4:Clinical incident management

Goal of the report

This report aims to identify trends in the rate and types of clinical incidents occurring during service delivery; to discuss key factors influencing those trends; and to inform service improvements in response to identified trends.

Data

Provide data on the number of clinical incidents, rate of clinical incidents as a proportion of service episodes and incident categories over each six month reporting period.

Briefly describe the changes or trends identified in the data shown

For example, Two incidents were recorded during the most recent reporting period. This follows three incidents recorded in the previous reporting period and one in the initial reporting period. While the number of incidents recorded per reporting period is low, we note that the rate of incidents as a proportion of service episodes has increased over the last two reporting periods. We also note that client aggression has been the most common incident type reported over the previous two reporting periods.

Discuss key factors which influenced this change/trend

For example, since the beginning of this year we have observed an increase in clients with stimulants as their principle drug of concern utilising the service. This may account for both the increase in the rate of incidents and the emergence of client aggression as the dominant clinical incident type.

Actions, outcomes and improvement plans as a result of data and trend analysis

Several strategies have been implemented aiming to decrease the number of behaviour incidents, including comprehensive education courses to assist staff in the management of behavioural issues; introduction of patient safety plans; the establishment of sensory modulation ("quiet/chill out") rooms; and the establishment of zero tolerance programs and enhanced communication programs. We hope to observe a reduction in the number of clinical incidents, specifically incidents relating to client aggression as a result of these strategies, and will continue to monitor this trend in the coming reporting periods.

Trend report for NSW AOD-Core Indicator 5: Client discharge and transfer of care

Goal of the report

This report aims to document the percentage of clients with a discharge/transfer of care plan documented, and to provide a review of changes to the service’s client discharge and transfer of care process during the reporting period.

Data

Provide data on the percentage of clients with a planned or known discharge/transfer of care, who had a discharge/transfer of care plan documented, over each six month reporting period.

Briefly describe changes to the service's transfer of care/discharge processes

For example, since the last reporting period, the service has been able to increase the number of documented transfer of care/discharge plans to 100% completed.

Discuss the key factors which influence this change

For example, ensuring that transfer of care/discharge plans were completed for all clients was prompted by the implementation of the Client Reported Feedback Guidelines which saw clients’ goals change during the course of their treatment. Therefore, these changes needed to be reflected in the discharge plans.

At exit, the majority of clients followed through with their goals and intentions documented in the discharge plans.

As a result of these changes, staff have adopted a flexible approach to developing transfer of care/discharge plans, in an effort to move towards applying a client-empowered care approach.

Discuss actions taken as a result of identifying this trend

Staff are keen to continue the momentum of having 100% completed discharge plans. This result is very reassuring to the service as it demonstrates that the guideline is working and staff and clients are equally satisfied with the changes as well as the move towards client-empowered care.

Further information about the NGO AOD performance indicator resources

Feedback on safety and quality for NSW Health funded AOD services

NSW Ministry of Health Clinical Safety and Quality team