Outcome monitoring Empowerment of clients and their local and national representatives Chris Nas Senior policy advisor
[email protected]
WHO Collaborating Centre for Research and Training Lille, January 31th 2014
About GGZ Nederland Dutch Association of Mental Health and Addiction Care • Chris Nas – Between 2009 – 2011 leading the nationwide programme for ROM in Mental Health (joint programme of client organisations, professional associations and service providers)
• works for GGZ Nederland – – – – –
Sector organisation in the Netherlands for mental healthcare. With more than 100 member organisations Providing 95% of specialist mental healthcare in the Netherlands To 815,800 unique clients (children and adults) Services are prevention, addiction care, outpatient care, acute clinical care, sheltered housing/assisted living, forensic care. – For which they employ 89,500 staff – Turnover € 5.4 billion (10.6 % of Dutch healthcare expenditure) GGZ Nederland (2013), GGZ in de Zorgverzekeringswet
2
When you leave this room, I hope you will take this home with you Outcome monitoring empowers clients and their representatives, because it facilitates: • shared decision making in treatment on the level of clients and professionals; • professional reflection on the level of teams, departments and/or providers; • transparency on relevance and effectiveness of treatments and guidelines; • transparency on effectiveness of mental health care organisations. 3
Outcome measurement is primarily an aid for clients and mental health workers Clients fill in questionnaires at the beginning, during and end of treatment or support.
Measuring: • reduction of symptoms • functioning in daily life • quality of life 4
Quality of Life questionnaire (QoL+) Could you please tell how satisfied you are with …..
1) 2) 3) 4) 5) 6) 7) 8)
…. your housing situation? …. your relations with people? …. your physical health? …. your mental health? …. your financial situation? …. your work? …. your life in general? …. the support you receive?
1234567 1234567 1234567 1234567 1234567 1234567 1234567 1234567
What does this QoL+ scores tell us about the quality of life of a person? 56
8
6
What does 2nd QoL+ base line say about recovery of a person? 56
8
7
Outcome measurement provides a base for shared decision making 56
8
8
Collecting and analysing outcome data is possible and meaningful … Clinical recovery (according to RCI) % Recovered % Reliable improved % No change % Reliable aggravated
A
B
C
D
31% 11% 55% 4%
39% 13% 43% 6%
23% 19% 50% 9%
28% 21% 43% 8%
Results of pilot in 2011 of 4 mental health services providers in long term mental health care on the basis of HONOS questionnaires. Not corrected or standardised for case mix. RCI = Reliable Change Index (RCI). 9
… as shown by this comparison of the aggregated outcomes. Clinical recovery (according to RCI) % Recovered % Reliable improved % No change % Reliable aggravated
A
B
C
D
31% 11% 55% 4%
39% 13% 43% 6%
23% 19% 50% 9%
28% 21% 43% 8%
Results of pilot in 2011 of 4 mental health services providers in long term mental health care on the basis of HONOS questionnaires. Not corrected or standardised for case mix. RCI = Reliable Change Index (RCI). 10
Internal benchmark of mental health provider in child and youth psychiatry Uitstroom
Instroom IOG-EV
IOG-EV
IOG 13/18
IOG 13/18
PMTO
PMTO
IOG 6/12
IOG 6/12
IOG 0/5
IOG 0/5
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100 %
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100 %
Geen problemen
Geen problemen
Matige problemen
Matige problemen
Ernstige problemen
Ernstige problemen
11
Accumulation of outcome data are opportunity to discuss performance • National Benchmark Institute collects anonymous outcome data nationwide. • LPGGZ (national client platform) is board member and therefore in the position to influence criteria performance assessment. • Local client organisations are able to assess the performance of their service provider and discuss results with board of directors. 12
In the nationwide project ROM MH, clients participated in various ways • Full member Steering Committee • Co-author of statement “Vision on Outcome Monitoring in Mental Health” • Initiating projects: – Meetings with client and family councils – Client expert groups on ROM – 8 short movies for clients, family and client councils about questionnaires – Critical appraisal of existing questionnaires 13
Meetings with client and family councils with over 100 participants • • • • •
What is ROM exactly? Who makes these questionnaries? Who uses the outcomes? What is in it for us? How do we get the case worker to discuss my personal outcomes?
14
Eight short movies on ROM (in Dutch without subtitles): http://www.youtube.com/user/ROMindeggz?feature=watch
15
Room for improvement: develop questionnaires with peer experts Checklist ROM-instrumentarium voor de doelgroep Kinderen & Jeugd Instrument ASEBA (CBCL voor ouders/fam, TRF voor leerkrachten, YSR voor jeugdigen)
Kwaliteit Goed
Meetpretentie Ernst van de problematiek
Inspanning cliënt CBCL: 15-20 minuten, beoordelingslijst ouders TRF: 15-20 minuten, beoordelingslijst leerkracht YSR: 10-20 minuten, zelfinvullijst kind Waardering gebruik: onbekend
Voldoende tot goed
Ernst van de problematiek (met aan-vulling op dagelijks functioneren)
Dagelijks functioneren
120 + 20 items
SDQ Diverse versies tbv leeftijd kind 25 items + schaal en 8 items HoNOSCA
Voldoende tot goed;
15 items
Papier & potlood: 5 minuten, zelfinvullijst kind of observatielijst oudere/familie of leerkracht Waardering gebruik: onbekend Meest gebruikt als observatielijst – geen activiteit door cliënt Waardering gebruik: onbekend
Inspanning behandelaar Scoring & intepretatie: plm. 10 minuten Terugkoppeling aan cliënt: ‘betrekkelijk snel en efficiënt’ Geen specifieke training nodig. Algemeen: kennis over gestandaardiseerde diagnostische onderzoeksmethoden en opleiding gericht op werken met ouders en kinderen Scoring & intepretatie: 15 minuten Terugkoppeling aan cliënt: onbekend Training: 1 uur vertrouwd raken met materiaal, instructies en handleiding. Geen herhaling noodzakelijk. Afnameduur: 10 -15 minuten Terugkoppeling aan cliënt: onbekend Training: 1x training, 1x hertraining en daarna jaarlijkse supervisie bijeenkomsten
Normering Ja
Kosten € 7,- per 10 stuks
Ja
Paper & pencil: gratis downloaden; Online afname of digitalisering: € 0,15 per afname
Nee
Engelse versie gratis te downloaden
• Questionnaires made by experts for research • Appreciation clients was lacking completely • Reduction of symptoms instead of recovery 16
Outcome monitoring: driver for client empowerment • shared decision making in treatment on the level of clients and professionals; • professional reflection on the level of teams, departments and/or providers; • transparency on relevance and effectiveness of treatments and guidelines; • transparency on effectiveness of mental health care organisations.
17
