Response shift results of quantitative research using patient-reported outcome measures: a descriptive systematic review.
Effect sizes
Patient-reported outcomes
Prevalence
Response shift
Systematic review
Journal
Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation
ISSN: 1573-2649
Titre abrégé: Qual Life Res
Pays: Netherlands
ID NLM: 9210257
Informations de publication
Date de publication:
13 Sep 2023
13 Sep 2023
Historique:
accepted:
21
07
2023
medline:
13
9
2023
pubmed:
13
9
2023
entrez:
13
9
2023
Statut:
aheadofprint
Résumé
The objective of this systematic review was to describe the prevalence and magnitude of response shift effects, for different response shift methods, populations, study designs, and patient-reported outcome measures (PROM)s. A literature search was performed in MEDLINE, PSYCINFO, CINAHL, EMBASE, Social Science Citation Index, and Dissertations & Theses Global to identify longitudinal quantitative studies that examined response shift using PROMs, published before 2021. The magnitude of each response shift effect (effect sizes, R-squared or percentage of respondents with response shift) was ascertained based on reported statistical information or as stated in the manuscript. Prevalence and magnitudes of response shift effects were summarized at two levels of analysis (study and effect levels), for recalibration and reprioritization/reconceptualization separately, and for different response shift methods, and population, study design, and PROM characteristics. Analyses were conducted twice: (a) including all studies and samples, and (b) including only unrelated studies and independent samples. Of the 150 included studies, 130 (86.7%) detected response shift effects. Of the 4868 effects investigated, 793 (16.3%) revealed response shift. Effect sizes could be determined for 105 (70.0%) of the studies for a total of 1130 effects, of which 537 (47.5%) resulted in detection of response shift. Whereas effect sizes varied widely, most median recalibration effect sizes (Cohen's d) were between 0.20 and 0.30 and median reprioritization/reconceptualization effect sizes rarely exceeded 0.15, across the characteristics. Similar results were obtained from unrelated studies. The results draw attention to the need to focus on understanding variability in response shift results: Who experience response shifts, to what extent, and under which circumstances?
Identifiants
pubmed: 37702809
doi: 10.1007/s11136-023-03495-x
pii: 10.1007/s11136-023-03495-x
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Canada Research Chairs
ID : CRC-2017-00268
Informations de copyright
© 2023. The Author(s).
Références
Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2, 14.
pubmed: 15023229
pmcid: 408464
doi: 10.1186/1477-7525-2-14
Sprangers, M. A., Cull, A., Bjordal, K., Groenvold, M., & Aaronson, N. K. (1993). The European organization for research and treatment of cancer. approach to quality of life assessment: Guidelines for developing questionnaire modules. Eortc Study Group on Quality of Life. Quality of Life Research, 2(4), 287–295.
pubmed: 8220363
doi: 10.1007/BF00434800
Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science & Medicine, 48(11), 1531–1548.
doi: 10.1016/S0277-9536(99)00047-7
Oort, F. J., Visser, M. R., & Sprangers, M. A. (2009). Formal definitions of measurement bias and explanation bias clarify measurement and conceptual perspectives on response shift. Journal of Clinical Epidemiology, 62(11), 1126–1137.
pubmed: 19540722
doi: 10.1016/j.jclinepi.2009.03.013
Kwon, J.-Y., Russell, L., Coles, T., Klaassen, R. J., Schick-Makaroff, K., Sibley, K. M., Mitchell, S. A., & Sawatzky, R. (2022). Patient-reported outcomes measurement in radiation oncology: Interpretation of individual scores and change over time in clinical practice. Current Oncology, 29(5), 3093–3103.
pubmed: 35621641
pmcid: 9139498
doi: 10.3390/curroncol29050251
Sawatzky, R., Kwon, J. Y., Barclay, R., Chauhan, C., Frank, L., Van Den Hout, W. B., Nielsen, L. K., Nolte, S., & Sprangers, M. A. G. (2021). Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures. Quality of Life Research, 30(12), 3343–3357.
pubmed: 33651278
pmcid: 8602130
doi: 10.1007/s11136-021-02766-9
Sajobi, T. T., Brahmbatt, R., Lix, L. M., Zumbo, B. D., & Sawatzky, R. (2018). Scoping review of response shift methods: Current reporting practices and recommendations. Quality of Life Research, 27(5), 1133–1146.
pubmed: 29210014
doi: 10.1007/s11136-017-1751-x
Sébille, V., Lix, L. M., Ayilara, O. F., Sajobi, T. T., Janssens, A. C. J. W., Sawatzky, R., Sprangers, M. A. G., & Verdam, M. G. E. (2021). Critical examination of current response shift methods and proposal for advancing new methods. Quality of Life Research, 30(12), 3325–3342.
pubmed: 33595827
pmcid: 8602164
doi: 10.1007/s11136-020-02755-4
Sawatzky, R., Sajobi, T. T., Brahmbhatt, R., Chan, E. K., Lix, L., & Zumbo, B. D. (2017). Longitudinal change in response processes: A response shift perspective. In B. D. Zumbo & A. M. Hubley (Eds.), Understanding and investigating response processes in validation research (pp. 251–276). New York: Springer.
doi: 10.1007/978-3-319-56129-5_14
Ortega-Gomez, E., Vicente-Galindo, P., Martin-Rodero, H., & Galindo-Villardon, P. (2022). Detection of response shift in health-related quality of life studies: A systematic review. Health and Quality of Life Outcomes, 20(1), 20.
pubmed: 35123496
pmcid: 8818219
doi: 10.1186/s12955-022-01926-w
Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14(3), 587–598.
pubmed: 16022054
doi: 10.1007/s11136-004-0830-y
Oort, F. J., Visser, M. R., & Sprangers, M. A. (2005). An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Quality of Life Research, 14(3), 599–609.
pubmed: 16022055
doi: 10.1007/s11136-004-0831-x
Schwartz, C. E., Bode, R., Repucci, N., Becker, J., Sprangers, M. A., & Fayers, P. M. (2006). The clinical significance of adaptation to changing health: A meta-analysis of response shift. Quality of Life Research, 15(9), 1533–1550.
pubmed: 17031503
doi: 10.1007/s11136-006-0025-9
Ilie, G., Bradfield, J., Moodie, L., Lawen, T., Ilie, A., Lawen, Z., Blackman, C., Gainer, R., & Rutledge, R. D. H. (2019). The role of response-shift in studies assessing quality of life outcomes among cancer patients: A systematic review. Frontiers in Oncology, 9, 783–783.
pubmed: 31482068
pmcid: 6710367
doi: 10.3389/fonc.2019.00783
Powden, C. J., Hoch, M. C., & Hoch, J. M. (2018). Examination of response shift after rehabilitation for orthopedic conditions: A systematic review. Journal of Sport Rehabilitation, 27(5), 469–479.
pubmed: 28605312
doi: 10.1123/jsr.2017-0104
Sprangers, M. A. G., Sajobi, T., Vanier, A., Mayo, N. E., Sawatzky, R., Lix, L. M., Oort, F. J., & Sebille, V. (2021). Response shift in results of patient-reported outcome measures: A commentary to the response shift-in sync working group initiative. Quality of Life Research, 30, 3299–3308.
pubmed: 33481193
pmcid: 8602228
doi: 10.1007/s11136-020-02747-4
Vanier, A., Oort, F. J., Mcclimans, L., Ow, N., Gulek, B. G., Böhnke, J. R., Sprangers, M., Sébille, V., & Mayo, N. (2021). Response shift in patient-reported outcomes: Definition, theory, and a revised model. Quality of Life Research, 30(12), 3309–3322.
pubmed: 33909187
pmcid: 8602159
doi: 10.1007/s11136-021-02846-w
Sawatzky, R., Sajobi Tolulope, T., Russell, L., Awasoga, A. O., Ademola, A., Bohnke, J. R., Lawal, O., Brobbey, A., Lix, L. M., Anota, A., Sebille, V., Sprangers Mirjam, A. G., & Verdam Mathilde, G. E. (2022). A synthesis of response shift effects in quantitative health research: A systematic review and meta-regression protocol. Inplasy Protocol 202290033. https://Inplasy.com/Inplasy-2022-9-0033/
Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). The handbook of research synthesis and meta-analysis. Russell Sage Foundation.
doi: 10.7758/9781610448864
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hrobjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., Mcdonald, S., … Mckenzie, J. E. (2021). Prisma 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ, 372, N160.
pubmed: 33781993
pmcid: 8005925
doi: 10.1136/bmj.n160
Thomas, J., Graziosi, G., Brunton, J., Ghouze, Z., Odriscoll, P., Bond, M. H., & Koryakina, A. (2022). Eppi-reviewer: Advanced software for systematic reviews, maps and evidence synthesis. Eppi-Centre, Ucl Social Research Institute, University College London.
Wan, X., Wang, W., Liu, J., & Tong, T. (2014). Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Medical Research Methodology, 14, 135.
pubmed: 25524443
pmcid: 4383202
doi: 10.1186/1471-2288-14-135
Verdam, M. G. E., Oort, F. J., & Sprangers, M. A. G. (2017). structural equation modeling-based effect-size indices were used to evaluate and interpret the impact of response shift effects. Journal of Clinical Epidemiology, 85, 37–44.
pubmed: 28342903
doi: 10.1016/j.jclinepi.2017.02.012
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
pubmed: 19565683
doi: 10.1037/0033-2909.112.1.155
Ibm Corp. (2021). Ibm Spss statistics for windows, Version 28.0. Ibm Corp.
Wickham, H. (2016). Ggplot2: Elegant graphics for data analysis. https://Ggplot2.Tidyverse.org/
Gibbons, C., Porter, I., Gonçalves-Bradley, D. C., Stoilov, S., Ricci-Cabello, I., Tsangaris, E., Gangannagaripalli, J., Davey, A., Gibbons, E. J., Kotzeva, A., et al. (2021). Routine provision of feedback from patient-reported outcome measurements to healthcare providers and patients in clinical practice. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.CD011589.pub2
doi: 10.1002/14651858.CD011589.pub2
pubmed: 34928503
pmcid: 8686684
Hartog, I. D., Willems, D. L., Van Den Hout, W. B., Scherer-Rath, M., Oreel, T. H., Henriques, J. P. S., Nieuwkerk, P. T., Van Laarhoven, H. W. M., & Sprangers, M. A. G. (2019). Influence of response shift and disposition on patient-reported outcomes may lead to suboptimal medical decisions: A medical ethics perspective. BMC Medical Ethics, 20(1), 61.
pubmed: 31510994
pmcid: 6737596
doi: 10.1186/s12910-019-0397-3
Sprangers, M. A. G., Sawatzky, R., Vanier, A., Bohnke, J. R., Sajobi, T., Mayo, N. E., Lix, L. M., Verdam, M. G. E., Oort, F. J., & Sebille, V. (2023). Implications of the syntheses on definition, theory, and methods conducted by the Response Shift - In Sync Working Group. Quality of Life Research, 32, 2165–2178.
pubmed: 36757572
pmcid: 10329073
doi: 10.1007/s11136-023-03347-8
Reeve, B. B. (2010). An opportunity to refine our understanding of “response shift” and to educate researchers on designing quality research studies: Response to Ubel, Peeters, And Smith. Quality of Life Research, 19(4), 473–475.
pubmed: 20336490
doi: 10.1007/s11136-010-9612-x
Oort, F. J. (2005). Towards a formal definition of response shift (In Reply To G.W. Donaldson). Quality of Life Research, 14(10), 2353–2355.
pubmed: 16328916
doi: 10.1007/s11136-005-3978-1
Howard George, S., & Dailey Patrick, R. (1979). Response-shift bias: A source of contamination of self-report measures. Journal of Applied Psychology, 64, 144–150.
doi: 10.1037/0021-9010.64.2.144
Edelaar-Peeters, Y., & Stiggelbout, A. M. (2013). Anticipated adaptation or scale recalibration? Health and Quality of Life Outcomes, 11, 171.
pubmed: 24139246
pmcid: 4016565
doi: 10.1186/1477-7525-11-171
Ring, L., Hofer, S., Heuston, F., Harris, D., & O’boyle, C. A. (2005). Response shift masks the treatment impact on patient reported outcomes (Pros): The example of individual quality of life in edentulous patients. Health and Quality of Life Outcomes, 3, 55.
pubmed: 16146573
pmcid: 1236951
doi: 10.1186/1477-7525-3-55
Dempster, M., Carney, R., & Mcclements, R. (2010). Response shift in the assessment of quality of life among people attending cardiac rehabilitation. British Journal of Health Psychology, 15(2), 307–319.
pubmed: 19594987
doi: 10.1348/135910709X464443
Echteld, M. A., Deliens, L., Ooms, M. E., Ribbe, M. W., & Van Der Wal, G. (2005). Quality of life change and response shift in patients admitted to palliative care units: A pilot study. Palliative Medicine, 19(5), 381–388.
pubmed: 16111061
doi: 10.1191/0269216305pm1029oa
Höfer, S., Pfaffenberger, N., Renn, D., Platter, M., & Ring, L. (2010). Coronary intervention improves disease specific health-related quality of life but not individualised quality of life: A potential response shift effect? Applied Research in Quality of Life, 6(1), 81–90.
doi: 10.1007/s11482-010-9117-3
Echteld, M. A., Van Zuylen, L., Bannink, M., Witkamp, E., & Van Der Rijt, C. C. D. (2007). Changes in and correlates of individual quality of life in advanced cancer patients admitted to an academic unit for palliative care. Palliative Medicine, 21(3), 199–205.
pubmed: 17641073
doi: 10.1177/1352458507077404
Sharpe, L., Butow, P., Smith, C., Mcconnell, D., & Clarke, S. (2005). Changes in quality of life in patients with advanced cancer: Evidence of response shift and response restriction. Journal of Psychosomatic Research, 58(6), 497–504.
pubmed: 16125516
doi: 10.1016/j.jpsychores.2005.02.017
Aburub, A. S., Gagnon, B., Ahmed, S., Rodríguez, A. M., & Mayo, N. E. (2018). Impact of reconceptualization response shift on rating of quality of life over time among people with advanced cancer. Supportive Care in Cancer, 26(9), 3063–3071.
pubmed: 29564622
doi: 10.1007/s00520-018-4156-7
Ahmed, S., Mayo, N. E., Wood-Dauphinee, S., Hanley, J. A., & Cohen, S. R. (2005). Using the patient generated index to evaluate response shift post-stroke. Quality of Life Research, 14(10), 2247–2257.
pubmed: 16328904
doi: 10.1007/s11136-005-8118-4
Tavernier, S. S., Beck, S. L., Clayton, M. F., Pett, M. A., & Berry, D. L. (2011). Validity of the patient generated index as a quality-of-life measure in radiation oncology. Oncology Nursing Forum, 38(3), 319–329.
pubmed: 21531682
doi: 10.1188/11.ONF.319-329
Ahmed, S., Mayo Nancy, E., Wood-Dauphinee, S., Hanley James, A., & Cohen, S. R. (2005). The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. Journal of Clinical Epidemiology, 58(11), 1125–1133.
pubmed: 16223655
doi: 10.1016/j.jclinepi.2005.03.003
Machuca, C., Vettore, M. V., & Robinson, P. G. (2020). How peoples’ ratings of dental implant treatment change over time? Quality of Life Research, 29(5), 1323–1334.
pubmed: 31907871
pmcid: 7190585
doi: 10.1007/s11136-019-02408-1
Visser, M. R., Oort, F. J., & Sprangers, M. A. (2005). Methods to detect response shift in quality of life data: A convergent validity study. Quality of Life Research, 14(3), 629–639.
pubmed: 16022057
doi: 10.1007/s11136-004-2577-x
Dabakuyo, T. S., Guillemin, F., Conroy, T., Velten, M., Jolly, D., Mercier, M., Causeret, S., Cuisenier, J., Graesslin, O., Gauthier, M., & Bonnetain, F. (2013). Response shift effects on measuring post-operative quality of life among breast cancer patients: A multicenter cohort study. Quality of Life Research, 22(1), 1–11.
pubmed: 22383104
doi: 10.1007/s11136-012-0135-5
Rapkin, B. D., Garcia, I., Michael, W., Zhang, J., & Schwartz, C. E. (2017). Distinguishing appraisal and personality influences on quality of life in chronic illness: Introducing the quality-of-life appraisal profile version 2. Quality of Life Research, 26(10), 2815–2829.
pubmed: 28593531
doi: 10.1007/s11136-017-1600-y
Jansen, S. J., Stiggelbout, A. M., Nooij, M. A., Noordijk, E. M., & Kievit, J. (2000). Response shift in quality of life measurement in early-stage breast cancer patients undergoing radiotherapy. Quality of Life Research, 9(6), 603–615.
pubmed: 11236851
doi: 10.1023/A:1008928617014
Abolhassani, N., Santos-Eggimann, B., Bula, C., Goy, R., Guessous, I., & Henchoz, Y. (2019). Temporal changes in importance of quality of life domains: A longitudinal study in community-dwelling Swiss older people. Quality of Life Research, 28(2), 421–428.
pubmed: 30178431
doi: 10.1007/s11136-018-1983-4
Hinz, A., Karoff, J., Kittel, J., Brähler, E., Zenger, M., Schmalbach, B., & Kocalevent, R.-D. (2020). Associations between self-rated health and the assessments of anchoring vignettes in cardiovascular patients. International Journal of Clinical and Health Psychology, 20(2), 100–107.
pubmed: 32550849
pmcid: 7296254
doi: 10.1016/j.ijchp.2020.04.001
Preiss, M., Friedrich, M., Stolzenburg, J. U., Zenger, M., & Hinz, A. (2019). Response shift effects in the assessment of urologic cancer patients’ quality of life. European Journal of Cancer Care (England), 28(4), E13027.
doi: 10.1111/ecc.13027
Anota, A., Bascoul-Mollevi, C., Conroy, T., Guillemin, F., Velten, M., Jolly, D., Mercier, M., Causeret, S., Cuisenier, J., Graesslin, O., Hamidou, Z., & Bonnetain, F. (2014). Item response theory and factor analysis as a mean to characterize occurrence of response shift in a longitudinal quality of life study in breast cancer patients. Health and Quality of Life Outcomes, 12, 32.
pubmed: 24606836
pmcid: 4016038
doi: 10.1186/1477-7525-12-32
Schwartz, C. E., Feinberg, R. G., Jilinskaia, E., & Applegate, J. C. (1999). An evaluation of a psychosocial intervention for survivors of childhood cancer: Paradoxical effects of response shift over time. Psycho-Oncology, 8(4), 344–354.
pubmed: 10474852
doi: 10.1002/(SICI)1099-1611(199907/08)8:4<344::AID-PON399>3.0.CO;2-T
Schwartz, C., Sprangers, M. A., Carey, A., & Reed, G. (2004). Exploring response shift in longitudinal data. Psychology & Health, 19(1), 51–69.
doi: 10.1080/0887044031000118456
Chen, P. Y., & Yang, C. M. (2020). Consequences of ignoring the response-shift and measure non-invariant items in sleep studies: An empirical data based simulation of the treatment effect of Cbt-I on dysfunctional sleep beliefs. Sleep Medicine, 74, 99–108.
pubmed: 32841853
doi: 10.1016/j.sleep.2020.05.010
Chen, P. Y., Jan, Y. W., & Yang, C. M. (2017). Are the insomnia severity index and Pittsburgh sleep quality index valid outcome measures for cognitive behavioral therapy for insomnia? Inquiry from the perspective of response shifts and longitudinal measurement invariance in their Chinese versions. Sleep Medicine, 35, 35–40.
pubmed: 28619180
doi: 10.1016/j.sleep.2017.04.003
De Beurs, D. P., Fokkema, M., De Groot, M. H., De Keijser, J., & Kerkhof, A. J. (2015). Longitudinal measurement invariance of the beck scale for suicide ideation. Psychiatry Research, 225(3), 368–373.
pubmed: 25571773
doi: 10.1016/j.psychres.2014.11.075
Mayo, N. E., Scott, S. C., & Ahmed, S. (2009). Case management poststroke did not induce response shift: The value of residuals. Journal of Clinical Epidemiology, 62(11), 1148–1156.
pubmed: 19595568
doi: 10.1016/j.jclinepi.2009.03.020
Murray, A. L., Mckenzie, K., Murray, K., & Richelieu, M. (2020). Examining response shifts in the clinical outcomes in routine evaluation-outcome measure (Core-Om). British Journal of Guidance & Counselling, 48(2), 276–288.
doi: 10.1080/03069885.2018.1483007
Smith, D., Woodman, R., Harvey, P., & Battersby, M. (2016). Self-perceived distress and impairment in problem gamblers: A study of pre- to post-treatment measurement invariance. Journal of Gambling Studies, 32(4), 1065–1078.
pubmed: 26971101
doi: 10.1007/s10899-016-9598-6
Rapkin, B. D. (2000). Personal goals and response shifts: understanding the impact of illness and events on the quality of life of people living with aids. In Adaptation to changing health: Response shift in quality-of-life research (pp. 53–71). American Psychological Association.
Schwartz, C. E., Stucky, B. D., Michael, W., & Rapkin, B. D. (2020). Does Response shift impact interpretation of change even among scales developed using item response theory? Journal of Patient-Reported Outcomes, 4(1), 8.
pubmed: 31975159
pmcid: 6977794
doi: 10.1186/s41687-019-0162-x
Zhang, X.-H., Li, S.-C., Xie, F., Lo, N.-N., Yang, K.-Y., Yeo, S.-J., Fong, K.-Y., & Thumboo, J. (2012). An exploratory study of response shift in health-related quality of life and utility assessment among patients with osteoarthritis undergoing total knee replacement surgery in a tertiary hospital in Singapore. Value in Health, 15(1), S72–S78.
pubmed: 22265071
doi: 10.1016/j.jval.2011.11.011
Bastianelli, A., Gius, E., & Cipolletta, S. (2016). Changes over time in the quality of life, prolonged grief and family strain of family caregivers of patients in vegetative state: A pilot study. Journal of Health Psychology, 21(5), 844–852.
pubmed: 24984718
doi: 10.1177/1359105314539533