Effects of Virtual Reality-Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study.

bird search task neglect, multimodal cueing search task stroke virtual reality

Journal

JMIR serious games
ISSN: 2291-9279
Titre abrégé: JMIR Serious Games
Pays: Canada
ID NLM: 101645255

Informations de publication

Date de publication:
25 May 2022
Historique:
received: 17 11 2021
accepted: 07 04 2022
revised: 17 02 2022
entrez: 25 5 2022
pubmed: 26 5 2022
medline: 26 5 2022
Statut: epublish

Résumé

Virtual reality (VR) devices are increasingly being used in medicine and other areas for a broad spectrum of applications. One of the possible applications of VR involves the creation of an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention (so-called hemispatial neglect). One approach to ameliorate neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one, eg, auditory and tactile) to guide visual attention toward the neglected space. So far, no study has investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients. This pilot study aimed to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a 3D VR setting, in patients with neglect, and obtain preliminary results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions. Patients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at 4 different presentation angles (lateral and paracentral on the left and right sides), and with (auditory, tactile, or audio-tactile cue) or without (no cue) a spatially meaningful cue. The task usability and feasibility, and 2 simple in-task measures (performance and early orientation) were assessed in 12 right-hemispheric stroke patients with neglect (5 with and 7 without additional somatosensory impairment). The new VR setup showed high usability (mean score 10.2, SD 1.85; maximum score 12) and no relevant side effects (mean score 0.833, SD 0.834; maximum score 21). A repeated measures ANOVA on task performance data, with presentation angle, cue type, and group as factors, revealed a significant main effect of cue type (F Overall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on method that supports attentional orientation during established therapeutic approaches.

Sections du résumé

BACKGROUND BACKGROUND
Virtual reality (VR) devices are increasingly being used in medicine and other areas for a broad spectrum of applications. One of the possible applications of VR involves the creation of an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention (so-called hemispatial neglect). One approach to ameliorate neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one, eg, auditory and tactile) to guide visual attention toward the neglected space. So far, no study has investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients.
OBJECTIVE OBJECTIVE
This pilot study aimed to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a 3D VR setting, in patients with neglect, and obtain preliminary results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions.
METHODS METHODS
Patients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at 4 different presentation angles (lateral and paracentral on the left and right sides), and with (auditory, tactile, or audio-tactile cue) or without (no cue) a spatially meaningful cue. The task usability and feasibility, and 2 simple in-task measures (performance and early orientation) were assessed in 12 right-hemispheric stroke patients with neglect (5 with and 7 without additional somatosensory impairment).
RESULTS RESULTS
The new VR setup showed high usability (mean score 10.2, SD 1.85; maximum score 12) and no relevant side effects (mean score 0.833, SD 0.834; maximum score 21). A repeated measures ANOVA on task performance data, with presentation angle, cue type, and group as factors, revealed a significant main effect of cue type (F
CONCLUSIONS CONCLUSIONS
Overall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on method that supports attentional orientation during established therapeutic approaches.

Identifiants

pubmed: 35612894
pii: v10i2e34884
doi: 10.2196/34884
pmc: PMC9178455
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e34884

Informations de copyright

©Samuel Elia Johannes Knobel, Brigitte Charlotte Kaufmann, Nora Geiser, Stephan Moreno Gerber, René M Müri, Tobias Nef, Thomas Nyffeler, Dario Cazzoli. Originally published in JMIR Serious Games (https://games.jmir.org), 25.05.2022.

Références

J Biomed Inform. 2009 Apr;42(2):377-81
pubmed: 18929686
Accid Anal Prev. 2006 Sep;38(5):988-96
pubmed: 16697344
J Am Acad Orthop Surg. 2022 Jan 15;30(2):84-90
pubmed: 34520419
Cortex. 2022 Mar;148:152-167
pubmed: 35176552
Front Hum Neurosci. 2020 May 25;14:180
pubmed: 32528265
J Neurosci Nurs. 2019 Apr;51(2):101-105
pubmed: 30649091
J Anxiety Disord. 2009 Jun;23(5):563-74
pubmed: 19282142
J Exp Psychol Hum Percept Perform. 2008 Oct;34(5):1053-65
pubmed: 18823194
Atten Percept Psychophys. 2010 Aug;72(6):1654-65
pubmed: 20675808
JMIR Serious Games. 2021 Jul 2;9(3):e29182
pubmed: 34255653
Neuropsychologia. 2010 Jul;48(9):2758-63
pubmed: 20433859
Cortex. 1978 Mar;14(1):129-33
pubmed: 16295118
Front Neurosci. 2020 Jan 22;13:1412
pubmed: 32038129
Behav Modif. 1999 Oct;23(4):507-25
pubmed: 10533438
Age Ageing. 1993 Jan;22(1):46-52
pubmed: 8438666
Annu Int Conf IEEE Eng Med Biol Soc. 2018 Jul;2018:1-4
pubmed: 30440283
Sci Rep. 2017 Oct 16;7(1):13228
pubmed: 29038450
J Neurosci. 2007 Jul 11;27(28):7498-507
pubmed: 17626211
Front Hum Neurosci. 2015 Dec 11;9:660
pubmed: 26696869
Surg Endosc. 2001 Oct;15(10):1076-9
pubmed: 11727073
Neuropsychol Rehabil. 2021 Jun;31(5):710-730
pubmed: 32102605
PLoS One. 2018 Jan 2;13(1):e0190677
pubmed: 29293637
Neuropsychologia. 2004;42(9):1203-11
pubmed: 15178172
Ergonomics. 2013;56(5):729-38
pubmed: 23510197
Neuropsychol Rehabil. 2021 Oct;31(9):1410-1443
pubmed: 32558611
Ann N Y Acad Sci. 2008;1129:193-9
pubmed: 18591480
J Cogn. 2018 Jan 12;1(1):8
pubmed: 31517182
J Neurol Neurosurg Psychiatry. 2002 Aug;73(2):160-6
pubmed: 12122175
Arch Phys Med Rehabil. 1987 Feb;68(2):98-102
pubmed: 3813864
Appl Neuropsychol Adult. 2020 Sep 18;:1-21
pubmed: 32945702
Stroke. 1999 Jun;30(6):1196-202
pubmed: 10356099
Pract Neurol. 2015 Oct;15(5):333-9
pubmed: 26023203
Prog Brain Res. 2003;142:257-71
pubmed: 12693266
J Cogn Neurosci. 2002 Jan 1;14(1):62-9
pubmed: 11798387
Brain Commun. 2020 Dec 26;3(1):fcaa220
pubmed: 33501424
Neuropsychologia. 2013 Aug;51(10):1867-77
pubmed: 23800681
Arch Neurol. 1990 May;47(5):573-6
pubmed: 2334306
J Clin Psychol Med Settings. 2011 Jun;18(2):176-87
pubmed: 21553133
Annu Int Conf IEEE Eng Med Biol Soc. 2020 Jul;2020:3192-3195
pubmed: 33018683
J Biomed Inform. 2019 Jul;95:103208
pubmed: 31078660
Restor Neurol Neurosci. 2006;24(4-6):209-15
pubmed: 17119299
Technol Health Care. 2005;13(4):245-60
pubmed: 16055973
Phys Ther. 2002 Aug;82(8):782-97
pubmed: 12147008
Harv Rev Psychiatry. 2017 May/Jun;25(3):103-113
pubmed: 28475502
Cortex. 2019 Oct;119:61-73
pubmed: 31075552
Hum Factors. 2010 Feb;52(1):41-53
pubmed: 20653224
Arthrosc Sports Med Rehabil. 2021 Aug 26;3(5):e1343-e1348
pubmed: 34712972
J Med Syst. 2018 Feb 1;42(3):50
pubmed: 29392522

Auteurs

Samuel Elia Johannes Knobel (SEJ)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.

Brigitte Charlotte Kaufmann (BC)

Sorbonne Université, Institut du Cerveau - Paris Brain Institute (ICM), Inserm, Centre national de la recherche scientifique, Hôpital de la Pitié-Salpêtrière, Paris, France.

Nora Geiser (N)

Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland.

Stephan Moreno Gerber (SM)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.

René M Müri (RM)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.
Perception and Eye Movement Laboratory, Departments of Neurology and BioMedical Research, Inselspital, Bern University Hospital, Bern, Switzerland.
Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland.

Tobias Nef (T)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.
Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland.
ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland.

Thomas Nyffeler (T)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.
Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland.
Perception and Eye Movement Laboratory, Departments of Neurology and BioMedical Research, Inselspital, Bern University Hospital, Bern, Switzerland.
Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland.

Dario Cazzoli (D)

Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland.
Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland.
Institute of Psychology, University of Bern, Bern, Switzerland.

Classifications MeSH