Figures
Abstract
Background
Functional exercise is crucial for breast cancer patients after surgery, and the use of virtual reality technology to assist patients with postoperative upper limb functional rehabilitation has gradually attracted the attention of researchers. However, the usability of the developed rehabilitation system is still unknown to a large extent. The purpose of this study was to develop a virtual reality upper limb rehabilitation system for patients after breast cancer surgery and to explore its usability.
Methods
We built a multidisciplinary team based on virtual reality and human-computer interaction technology and designed and developed an upper limb function rehabilitation system for breast cancer patients after surgery. Breast cancer patients were recruited from a grade III-a general hospital in Changchun city for the experiment. We used the System Usability Scale to evaluate the system availability, the Presence Questionnaire scale to measure the immersive virtual reality scene, and the Simulator Sickness Questionnaire subjective measurement scale for simulator sickness symptoms.
Results
This upper limb rehabilitation system hardware consisted of Head-mounted Display, a control handle and notebook computers. The software consisted of rehabilitation exercises and game modules. A total of 15 patients were tested on this system, all of whom were female. The mean age was 54.73±7.78 years, and no patients were excluded from the experiment because of adverse reactions such as dizziness and vomiting. The System Usability Scale score was 90.50±5.69, the Presence Questionnaire score was 113.40±9.58, the Simulator Sickness Questionnaire-nausea score was 0.93±1.16, the Simulator Sickness Questionnaire-oculomotor score was 0.80±1.27, the Simulator Sickness Questionnaire-disorientation score was 0.80±1.27, and the Simulator Sickness Questionnaire total score was 2.53±3.40.
Conclusions
This study fills in the blanks regarding the upper limb rehabilitation of breast cancer patients based on virtual reality technology system usability research. As the starting point of research in the future, we will improve the system’s function and design strictly randomized controlled trials, using larger samples in the promotion, to evaluate its application in breast cancer patients with upper limbs and other physiological functions and the feasibility and effects of rehabilitation.
Citation: Zhou Z, Li J, Wang H, Luan Z, Li Y, Peng X (2021) Upper limb rehabilitation system based on virtual reality for breast cancer patients: Development and usability study. PLoS ONE 16(12): e0261220. https://doi.org/10.1371/journal.pone.0261220
Editor: Alessandro de Sire, University of Catanzaro: Universita degli Studi Magna Graecia di Catanzaro, ITALY
Received: August 7, 2021; Accepted: November 27, 2021; Published: December 15, 2021
Copyright: © 2021 Zhou et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: This study is funded by Jilin University. The project name is: Jilin University Bethune Plan Project (2020B38), and author Xin Peng is the main leader of the project. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: BRCL, Breast Cancer Related Lymphedema; HMD, Head-mounted Display; PQ, Presence Questionnaire; SD, Standard Deviation; SSQ, Simulator Sickness Questionnaire; SUS, System Usability Scale; VR, Virtual Reality
Introduction
Breast cancer is the most common malignancy threatening women’s health. The latest report of the International Agency for Research on Cancer shows that in 2018, the number of new cases of breast cancer increased by approximately 2.09 million worldwide, accounting for 24.2% of all cases of female cancer [1], while the number of new cases in China accounted for approximately 37% of all cases of female cancer [2].
Surgery is the main treatment for breast cancer [3–5]. Patients will have different degrees of symptoms, such as swelling, pain, numbness, and raising difficulty, post-traumatic stress disorder, axillary web syndrome, cancer-related fatigue, become long-term health problems for patients [6–16]. Postoperative upper limb functional exercise can gradually replace the role of armpit tissue by enhancing muscle strength, fully activating deltoid muscle, deep scapular muscle and latissimus dorsi muscle, etc., and can effectively reduce the incidence of postoperative complications such as subcutaneous blood and fluid accumulation in the affected limb, necrosis of the skin flap and severe upper limb edema, which can prevent the functional recovery of the operative side limb [17, 18]. Rehabilitation exercise can improve muscle pump, promote lymphatic fluid flow, aerobic training can increase intra-abdominal pressure, to promote chest duct pump blood, improve lymphatic reflux [19]. It is safe and effective for patients at risk of breast cancer–related lymphedema and those with BCRL at all points in the life trajectory [14, 20, 21]. In addition, rehabilitation exercise can stimulate the release of β -endorphin, exciting the patient’s central nervous system, relieve their pain while improving sleep and mood, also can make nervous system release inhibition muscle tension and mental depression of the micro electrical stimulation, in order to eliminate or reduce fatigue [22, 23], improve exercise compliance [24], its role in reducing breast cancer-related fatigue has been demonstrated [25, 26]. In addition, after upper limb exercise and muscle relaxation training, the affected shoulder function and health-related quality of life were significantly improved, and early rehabilitation treatment (including range of motion of shoulder and intensive exercise) could improve the range of motion of shoulder after breast cancer surgery [26, 27]. Therefore, it is very important to develop a scientific functional exercise plan for breast cancer patients after surgery and urge them to carry out gradual functional exercise for the recovery of upper limb and shoulder joint function and reduce the incidence of complications.
VR technology refers to the use of computer systems and sensor technology to generate a three-dimensional environment and to create a new pathway of man-machine communication by mobilizing users’ various senses (vision, hearing, touch, smell, etc.) to enjoy a more real, immersive feeling. VR is characterized by immersion, imagination and interaction [28]. It has been a breakthrough in the field of artificial intelligence; medical care, rehabilitation, nursing and other fields have been spreading [29–31], especially in the prevention and control of the COVID-19 normalized background. Through development platforms based on VR home rehabilitation of breast cancer patients with postoperative management, hospital nursing care and rehabilitation management continue to help patients recover with their families because home rehabilitation management is of great significance.
At present, VR technology has been carried out in the field of rehabilitation of breast cancer patients. With the development and diversification of technology, an increasing number of studies are combining it with robots, 3D motion-sensing cameras, machine learning and other technologies to provide process data feedback on the rehabilitation time limit and connotation quality to make the rehabilitation process more accurate and achieve remarkable effects.
Usability evaluation is an indispensable link in the process of medical product development and one of the key factors for the successful implementation of telemedicine [32]. The International Standardization Organization 9241–11 international standard defines usability as the effectiveness, efficiency and user subjective satisfaction of a product when it is used for a specific purpose by a specific user in a specific use environment [33]. Usability expert Jakob Nielsen believes that usability testing is carried out at all stages of the product design and development process, including early paper prototypes, rapid prototyping, and postproduction [34]. Usability evaluation can bring great value for the patient, increase productivity, enhance user well-being, avoid pressure, increase accessibility and reduce injury risk; therefore, scholars have suggested that before large clinical trials, it is necessary to invest a certain amount of time and resources in usability evaluation. Due to the three characteristics of VR: Immersion, Imagination and Interaction, the connotation of product usability developed based on this technology and its derivative technology has been supplemented and updated. Presence is a subjective feeling rather than an objective reality, which is exactly what the VR system aims to achieve so that the "virtual" can achieve a "real" effect. Cybersickness is one of the most common side effects in VR applications, Statistics show that more than 60% of users will experience screen sickness when using VR devices, which will bring an unpleasant experience to users and reduce the time and frequency of using VR devices [35]. The degree of presence and the severity of cybersickness was gradually covered in usability study. To the best of our knowledge, at present, there is still no research on the usability of upper limb rehabilitation for breast cancer based on VR.
This study aims at VR technology and computer graphics technology, human-computer interaction technology, simulation technology, multimedia technology, sensor technology, network technology to develop a system for exercising upper limb function for breast cancer patients and performs usability study to provide a basis for iterative development and maintenance in the future. In this way, the efficiency and quality of the whole rehabilitation system can be improved, and an effective reference can be provided for data-driven intelligent home rehabilitation.
Methods
Formation of a multidisciplinary team
Ten people were involved in a multidisciplinary team, including a breast surgeon (1 person), rehabilitation therapists (2 people), nurses (2 people), postgraduates (3 people) and technical engineers (2 people), on the basis of consulting and summarizing the contents of the guidelines, in accordance with scientific, innovative, practical and feasible principles. Combined with the results of previous research and literature research, the content of the upper limb rehabilitation system was preliminarily conceived, and the functional details were further determined through discussion and brainstorming.
System development
Hardware side: The hardware of the system is an HTC VIVE Pro2.0 device (including 2 handle controllers, 2 infrared base stations and 1 HMDs device), and the helmet is connected to a computer (Dell Ravener G15 laptop, 3060 graphics card, Intel Core i7 processor, Windows 10 operating system). The handle controller and HMDs use Csharp programming language for secondary development, based on an 850-nm infrared optical orientation method, through the base station to capture the patient’s head and control the handle position and to track the coordinates of the upper limb activity information. The upper limb activity trajectory was calculated and compared with the preset movements of rehabilitation training in the movement database to identify the movements and send the data to the cloud server in real time.
Software side: The virtual simulation was developed with the Unity3D game engine and written in C # script language. Component design is completely independent of the hardware and operating system development environment, and the application platform module is relatively independent and convenient for secondary development.
We put the code for the experiment on the github open source site for easy access: https://github.com/2202jasmine1024/breast-cancer
System function design
A VR-based postoperative rehabilitation system for breast cancer was preliminarily constructed and was mainly presented in the form of web pages and C/S structures, including rehabilitation exercise modules and puzzle game modules.
In the rehabilitation exercise module, the rehabilitation exercises were set by the hospital rehabilitation therapists and nurses; they covered making a fist, screw lifting of the wrist, elbow flexion and around the shoulders, touching the ear, climbing a wall, back-handing, and outreach, comprising 10 rehabilitation actions according to the situation of patients with different clinical multidisciplinary teams set in two different mode of rehabilitation (for details, see Table 1). Each section must be completed in eight beats, and after 32 reps, the program will automatically jump to the next section. During the completion of each session, when the progress reaches 50% and 100%, there will be an encouraging voice prompt, such as: Come on, victory is in sight! Very good, you have completed the action of this section! Congratulations you have completed all the training!
In addition to the rehabilitation exercise scene, we embedded a puzzle game, which is set in an orchard and plays soothing music in the ear. Figs 1 and 2 show a user’s view of the hands of their virtual characters, which are controlled by their movements. Patients complete the game after picking 32 apples.
Usability study
Subjects and sampling method.
From June 12, 2021, to June 27, 2021, breast cancer patients in the Breast Surgery Department of a Grade A hospital in Changchun City, Jilin Province were randomly sampled. The inclusion and exclusion criteria are shown in Table 2.
Sample size calculation.
According to the number of participants and the problems identified in the percentage relationship curve [36], 10 patients were able to identify 80% of usability problems, and 15 participants were able to identify 100% of usability problems; therefore, this study’s sample size was in the range of 10 to 15 people.
Permissions and ethics approval.
All patients signed an informed consent form. This study was approved by the Ethics Committee of the Nursing College of Jilin University, registration number: 2020091805.
Experimental design.
In a room with an area size of 5 m * 5 m, the room temperature was kept at 22~24 °C and weak light. Each participant was asked to fast for two hours prior to the experiment, which was designed to distinguish between postprandial exercise and cybersickness. A doctor (Zijun Zhou) and a nurse (He Wang) from the multidisciplinary team introduced the purpose of the study, the inherent characteristics of the system, module functions and matters needing attention to the participants in the ward, the two researchers demonstrated the login and use methods and informed the participants of the tasks to be completed later. Subjects performed a basic warm-up 10 minutes before the experiment to prevent injuries during the exercise. After the experience, participants rested in the ward for 15 minutes while filling out a questionnaire provided by another researcher. Two postgraduate students (Jiaxin Li and Ze Luan) from the multidisciplinary team, guided the participants in filling out the scale, and conducted unified training for postgraduate students before the survey to make them understand the research objectives and methods During the investigation, two postgraduate students issued questionnaires and guided patients to fill in the scale by themselves with unified guidance language. If there was any doubt about the content of the scale, they explained it in consistent language. Researchers paid close attention to the whole process of the experiment to ensure the patients’ personal safety. Fig 3 shows a patient using the rehabilitation system in the ward.
Outcome indicators.
We used a general information questionnaire to collect the patients’ age, nationality, marital status, educational level, pathological staging, pathological type, treatment and other information.
The SUS is used to evaluate the usability of the system [37], which is a validated measurement method of learnability and user satisfaction and is used to subjectively evaluate the usability of interface technology. This survey has excellent reliability (0.85). Each item is scored on a 5-point Likert scale, ranging from 1 (strongly disagree) to 5 (strongly agree). For odd items, the score is reduced by 1, and for even items, the score is reduced by 5. Therefore, the score for each item ranges from 0 to 4, the score is summed and multiplied by 2.5, and the final score ranges from 0 to 100.
The SSQ was used to evaluate users’ symptoms of cybersickness [38]. The SSQ has been shown to be reliable in healthy adults (0.80). It contains 16 small symptoms, including nausea, oculomotor nerve discomfort and disorientation as 3 significant symptoms, with all events scored on a 4-point Likert scale: 0 (no symptoms), 1 (minor), 2 (medium), and 3 (severe), with scores multiplied by the corresponding weight. To evaluate the three major symptoms, the higher the total score, the higher the degree of motion sickness.
The PQ was used to evaluate users’ sense of presence and immersion [39], which emphasized the characteristics of involvement and immersion in the simulation environment. This survey has excellent reliability (0.88) and included 17 items. Each item was scored on a 7-point Likert scale, ranging from 1 to 7. The higher the score, the better the user’s sense of presence and presence.
Statistical method
Microsoft Excel 2019 and SPSS 24.0 statistical software were used for data analysis. Descriptive statistical methods were used in this study was descriptive analysis: frequency and constituent ratio were used to describe the general information treatment status and other data. Median and quartile spacing were used to describe the SUS score, SSQ score, PQ score.
Results
A total of 15 patients were recruited in this study, all female, with an average age of 54.73±7.78 years. See Table 3 for the general demographic information.
As shown in Table 4, the SUS score was 90.50±5.69, the PQ score was 113.40±9.58, the SSQ-N score was 0.93±1.16, the SSQ-O score was 0.80±1.27, the SSQ-D score was 0.80±1.27, the PQ score was 113.40±9.58, and the SSQ total score was (2.53±3.40).
During the trial, no adverse events were reported, and no patients withdrew for any reason.
Discussion
Using VR technology arm rehabilitation exercise is a new kind of method for the postoperative rehabilitation of breast cancer. When experiencing a new environment, novelty, immediacy and uniqueness can make people more excited. People can give more attention to completing a task or experience using VR devices through multisensory interactive approaches such as seeing, hearing [40, 41]. Patients can be motivated to participate by adding fun and gamification, in addition, game design elements and game principles can be added to the task to increase patient exercise compliance. According to the characteristics of movement disorders of patients, a flexible and personalized rehabilitation design makes it possible to provide step-by-step rehabilitation treatment. Low-cost virtual rehabilitation systems can be used as adjuvants to regular rehabilitation with less direct supervision by doctors or can be considered remote or home rehabilitation tools. The use of motion sensors in conjunction with a VR system for rehabilitation allows the functional assessment and digital tracking of patients, which adds beneficial elements to current rehabilitation strategies. To our knowledge, this is the first study to explore the development and availability of a breast cancer rehabilitation exercise system, which has not been previously reported.
There are many rehabilitation systems based on VR and its derivative technologies to assist breast cancer patients to recover their upper limb function, quality of life and psychological state. Such as House et al. [42] developed a virtual robot rehabilitation system platform, Brightarm Duo, which provides patients with multisensory stimulation through nine sports games and puzzle games for passive shoulder movement, motion control, single-hand gripping strength training, and emotional and cognitive training. After intervention, the patients showed improvements in upper limb strength, upper limb function, pain level, emotion management and cognitive function. Feyzio G Lu et al. [43] used an Xbox 360 Kinect, a 3D motion camera matched with a VR system, to move patients off of the handgrip during training and to implement task-based sports programs combined with shoulder passive motion. There were significant decreases in pain level and fear of exercise in the test group. The upper limb function score and shoulder joint range of motion increased. Axenie et al. [44] combined VR and machine learning technology to develop a sensorimotor function rehabilitation system for multiple neuropathies caused by chemotherapy. Virtual characters on the screen increased the patient’s sense of existence and identity and combined the accurate mapping of motor characteristics and multimodal perception with the consistency and effectiveness of internal model prediction. Park et al. [45] developed a digital healthcare system based on augmented reality technology and motion sensor technology, through tracking and positioning 25 joints of upper and lower limbs, using Xbox One Kinect for Windows records and feedback the number of repetitions and precision of exercise tasks in real time. Doctors can remotely prescribe exercise prescriptions to users by referring to uploaded data, which can be modified and calibrated according to patients’ recovery and exercise effects. Participants can carry out daily exercise according to doctors’ prescriptions. But the technology used in this study mainly focused on the positioning of joint angles Tracking the trajectory, rather than placing the patient in an immersive world, remains fundamentally different from our focus.
In addition, VR and its derivative technologies have been widely used in the diagnosis of complications [13], palliative care [46, 47], pain relief [48], reduction of chemotherapy side effects [49], psychological intervention [41, 50]. Such as A. de Sire et al. [14] and Invernizzi et al. [13] used an augmented reality tool 3D laser Scanner, which uses a triangulation mechanism to project a laser point onto the upper limb to be measured. The sensor measures the distance to the surface of the object to detect THE PATIENT’s BRCL, achieving an accurate, repeatable, reliable and economical diagnosis. Helene Buche et al. [51] confirmed that no matter immersive or participatory VR, it is different from traditional emotion regulation tools (such as music, Yoga), can be provided to the patients engaged, through visual will be isolated from the medical environment, patients with change the users’ perception of time, a distraction from the tense unpleasant stimulus, are titer induced mood, improve the well-being, reduce anxiety, it allows the individual’s attention on the virtual experience, scattered from the tense environment unpleasant stimulus.
SUS was originally designed to evaluate the usability of products and services, including hardware, software, mobile devices, websites, and applications. Due to the combination of certain elements of the rehabilitation system developed in this study, and the increasing number of studies using SUS to test medical devices and products [32, 52, 53], we chose SUS to facilitate comparisons with similar and different products or devices. An SUS score above 70 is considered acceptable usability, and a score above 85 is considered excellent usability. A score above 90 is considered truly excellent usability, while a score below 50 indicates an unacceptable usability [37]. The SUS study scored an average of 90.50±5.69, although it is still in its early development stage, but compared with other systems, the SUS system scored higher than the average [54], indicating that the system of usability, ease of use and learnability and confidence was acceptable, but there was still room for improvement. Possibly due to the higher number of women diagnosed with breast cancer in the region Women are often less likely to use Internet electronic products in the age range of 40–70 years because their cultural level is low, their learning ability is weak, and they have conservative and cautious attitudes when accepting new things; therefore, the next step in the process of improvement should consider the characteristics of the audience and the patients’ attitudes and preferences as the basis of iterative improvement.
The VR system uses hardware devices such as HMDs, Cave Automatic Virtual Environment ™ and good software design to build a sense of presence, which allows individuals to focus on the virtual experience. Such participation in immersive tasks is called interactive potential [55], and the strength of presence is also an important indicator to measure the usability of VR systems. The PQ score of this study (113.40±9.58) was close to the full score, which was at a high level. Studies have shown that a high sense of presence and immersive participation can enhance users’ ability to interact with the virtual environment, and the quality of immersion, degree of interaction and personal participation are key parameters that affect system availability [51, 55, 56].
Cybersickness is unavoidable in the use of VR. When visual response processing for user input interaction is delayed, the signals from the eyes, the vestibular system of the inner ear and proprioceptive receptors to the brain conflict with each other, and motion sickness is triggered [57]. Halo screen symptoms may include system characteristics (for example, head tracking, rendering, vision, optical), user interaction factors (lack of motion control, visual acceleration or deceleration, VR experience for a longer duration and frequent head movements in VR games), and personal perception factors (gender, age, history of motion sickness, lack of VR experience) [58]. Therefore, when designing VR scenes and animations, the experience of cybersickness can be reduced according to the influencing factors of cybersickness [59]: (1) the user actively controls his viewpoint and adjusts it; (2) avoid or limit linear or angular acceleration or deceleration to reduce stimulation of the vestibular organs; (3) display visual indicators or movement tracks to users; and (4) dynamically blur the unimportant areas.
The higher the SSQ score is, the more serious the cybersickness is, and a score over 20 indicates that the user has obvious discomfort [38, 60]. Analysis of the total SSQ score shows that the rehabilitation system developed in this study does not cause cybersickness or has a small impact. The SSQ scores were 0.93±1.16, 0.80±1.27 and 0.80±1.27, respectively, among which the nausea score was the highest, which might be related to the patient’s recent chemotherapy, but none of the symptoms were significant. Therefore, in future experiments and applications, the time after chemotherapy should be avoided to distinguish the causes of these symptoms and prevent adverse reactions to chemotherapy from leading to poor use experience of the system. The sweating symptoms of some patients are related to hot weather in summer and the heavy weight of the helmet. Therefore, considering the active exercise undertaken during rehabilitation exercise, in the improvement process, HMDs should be as light, comfortable to wear, stable in position and able to dissipate heat as possible. The device used in this study was an immersive HMDs, which gives the best immersive experience to patients compared with other devices [61] and can cooperate with the handle sensor for action recognition and interaction with virtual objects. Studies have shown that compared to using desktop computers and projectors and other nonimmersive devices, wearing HMDs can cause head pressure, eye fatigue, physical fatigue and halo screen symptoms more easily [62]. Therefore, in this study, some patients showed discomfort of the oculomotor nerve and fatigue, thereby targeting issues for improvement in the future. We will consider using surface TVs instead of HMDs to ensure a sense of immersion and reduce sweating, dizziness, oculomotor nerve discomfort and other symptoms.
In addition, some studies have found that presence scores are inversely correlated with cybersickness symptoms. The more a patient feels in a virtual world, the more likely he or she is to experience motion sickness. This study focuses on usability research, with a sample size that is too small and insufficient data collected to support the exploration of the relationship between SSQ and PQ scores. Therefore, the sample size can be increased in future studies to explore the correlation between SSQ and PQ scores.
Limitations
First, in terms of participant recruitment, usability study adopts a convenient sampling method with a relatively small sample size, but this is not uncommon in development iterations [63], and participants come from one region, which may lead to selection bias. Second, the patients included in this study were exposed to this VR rehabilitation system for the first time, and the results may have been influenced by novelty effects. Third, only questionnaires were used in this paper to judge the availability of the system and the response to the use of VR equipment, and immediate and objective results could not be recorded. In the future, more comprehensive and scientific measurement methods (such as respiration, heart rate, and electroencephalogram) should be used to quantify the symptoms of cybersickness and immersion in real time. Finally, this paper only conducted a usability study without effect evaluation. In the next step, a strict randomized controlled experiment should be designed to evaluate the application effect of the system platform.
Conclusion
This study is the first step in the new field of VR-based rehabilitation for breast cancer patients to evaluate the usability and feasibility of the newly developed system, to learn from the results of the study and to provide a reference for future research and development projects in this field. The results show that the VR rehabilitation system is available, feasible and easy to learn for breast cancer patients. Through various human-computer interaction methods, such as sight, hearing and touch, participants adapted to the difficulty level according to the selection of rehabilitation mode based on the state of the affected limb and enjoyed the stimulating, diverse and interesting experience of sports games, which presented both physical and psychological cognitive challenges. The system developed in this study is not applied to commercial promotion; in contrast, it is designed to be used as a starting point in other clinical researchers’ potential, immersive VR and interactive technology to explore the potential for the treatment and rehabilitation of breast cancer postoperative rehabilitation purposes. We look forward to the contributions of other researchers in this field.
Acknowledgments
The authors would like to thank Dr. Peng Xin (School of Nursing, Jilin University) for providing advice and guidance in the process of thesis writing and Dr. Zhou Zijun and Wang He, head nurse (Jilin Cancer Hospital), for providing great help in the process of data acquisition. The authors would also like to thank the patients who participated in the study and provided valuable and detailed feedback.
References
- 1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394–424. pmid:30207593
- 2. Feng RM, Zong YN, Cao SM, Xu RH. Current cancer situation in China: good or bad news from the 2018 Global Cancer Statistics? Cancer communications (London, England). 2019;39(1):22. pmid:31030667
- 3. Casella D, Di Taranto G, Marcasciano M, Sordi S, Kothari A, Kovacs T, et al. Nipple-sparing bilateral prophylactic mastectomy and immediate reconstruction with TiLoop(®) Bra mesh in BRCA1/2 mutation carriers: A prospective study of long-term and patient reported outcomes using the BREAST-Q. Breast. 2018;39:8–13. pmid:29455110
- 4. Kaciulyte J, Losco L, Maruccia M, Delia G, Lo Torto F, Di Taranto G, et al. Postsurgical antithrombotic therapy in microsurgery: our protocol and literature review. Eur Rev Med Pharmacol Sci. 2019;23(10):4448–57. pmid:31173322
- 5. Ciudad P, Maruccia M, Orfaniotis G, Weng HC, Constantinescu T, Nicoli F, et al. The combined transverse upper gracilis and profunda artery perforator (TUGPAP) flap for breast reconstruction. Microsurgery. 2016;36(5):359–66. pmid:26440546
- 6. McCredie MR, Dite GS, Porter L, Maskiell J, Giles GG, Phillips KA, et al. Prevalence of self-reported arm morbidity following treatment for breast cancer in the Australian Breast Cancer Family Study. Breast (Edinburgh, Scotland). 2001;10(6):515–22. pmid:14965632
- 7. Engel J, Kerr J, Schlesinger-Raab A, Sauer H, Hölzel D. Axilla surgery severely affects quality of life: results of a 5-year prospective study in breast cancer patients. Breast cancer research and treatment. 2003;79(1):47–57. pmid:12779081
- 8. Hayes SC, Johansson K, Stout NL, Prosnitz R, Armer JM, Gabram S, et al. Upper-body morbidity after breast cancer: incidence and evidence for evaluation, prevention, and management within a prospective surveillance model of care. Cancer. 2012;118(8 Suppl):2237–49. pmid:22488698
- 9. Mortenson MM, Schneider PD, Khatri VP, Stevenson TR, Whetzel TP, Sommerhaug EJ, et al. Immediate breast reconstruction after mastectomy increases wound complications: however, initiation of adjuvant chemotherapy is not delayed. Arch Surg. 2004;139(9):988–91. pmid:15381618
- 10. Invernizzi M, Corti C, Lopez G, Michelotti A, Despini L, Gambini D, et al. Lymphovascular invasion and extranodal tumour extension are risk indicators of breast cancer related lymphoedema: an observational retrospective study with long-term follow-up. BMC Cancer. 2018;18(1):935. pmid:30268112
- 11. Invernizzi M, Lopez G, Michelotti A, Venetis K, Sajjadi E, De Mattos-Arruda L, et al. Integrating Biological Advances Into the Clinical Management of Breast Cancer Related Lymphedema. Front Oncol. 2020;10:422. pmid:32300557
- 12. Michelotti A, Invernizzi M, Lopez G, Lorenzini D, Nesa F, De Sire A, et al. Tackling the diversity of breast cancer related lymphedema: Perspectives on diagnosis, risk assessment, and clinical management. Breast. 2019;44:15–23. pmid:30580170
- 13. Invernizzi M, Runza L, De Sire A, Lippi L, Blundo C, Gambini D, et al. Integrating Augmented Reality Tools in Breast Cancer Related Lymphedema Prognostication and Diagnosis. J Vis Exp. 2020(156). pmid:32090996
- 14. de Sire A, Losco L, Cigna E, Lippi L, Gimigliano F, Gennari A, et al. Three-dimensional laser scanning as a reliable and reproducible diagnostic tool in breast cancer related lymphedema rehabilitation: a proof-of-principle study. Eur Rev Med Pharmacol Sci. 2020;24(8):4476–85. pmid:32373985
- 15. Yang S, Chu S, Gao Y, Ai Q, Liu Y, Li X, et al. A Narrative Review of Cancer-Related Fatigue (CRF) and Its Possible Pathogenesis. Cells. 2019;8(7).
- 16. Torres Lacomba M, Mayoral Del Moral O, Coperias Zazo JL, Yuste Sánchez MJ, Ferrandez JC, Zapico Goñi A. Axillary web syndrome after axillary dissection in breast cancer: a prospective study. Breast Cancer Res Treat. 2009;117(3):625–30. pmid:19306057
- 17. Klein I, Kalichman L, Chen N, Susmallian S. Effect of physical activity levels on oncological breast surgery recovery: a prospective cohort study. Scientific reports. 2021;11(1):10432. pmid:34002007
- 18. McNeely ML, Campbell K, Ospina M, Rowe BH, Dabbs K, Klassen TP, et al. Exercise interventions for upper-limb dysfunction due to breast cancer treatment. The Cochrane database of systematic reviews. 2010(6):Cd005211. pmid:20556760
- 19. Cohen SR, Payne DK, Tunkel RS. Lymphedema: strategies for management. Cancer. 2001;92(4 Suppl):980–7. pmid:11519024
- 20. Campbell KL, Winters-Stone KM, Wiskemann J, May AM, Schwartz AL, Courneya KS, et al. Exercise Guidelines for Cancer Survivors: Consensus Statement from International Multidisciplinary Roundtable. Med Sci Sports Exerc. 2019;51(11):2375–90. pmid:31626055
- 21. Ryans K, Perdomo M, Davies CC, Levenhagen K, Gilchrist L. Rehabilitation interventions for the management of breast cancer-related lymphedema: developing a patient-centered, evidence-based plan of care throughout survivorship. J Cancer Surviv. 2021. pmid:33481161
- 22. Invernizzi M, de Sire A, Lippi L, Venetis K, Sajjadi E, Gimigliano F, et al. Impact of Rehabilitation on Breast Cancer Related Fatigue: A Pilot Study. Front Oncol. 2020;10:556718. pmid:33194622
- 23. Mijwel S, Backman M, Bolam KA, Jervaeus A, Sundberg CJ, Margolin S, et al. Adding high-intensity interval training to conventional training modalities: optimizing health-related outcomes during chemotherapy for breast cancer: the OptiTrain randomized controlled trial. Breast Cancer Res Treat. 2018;168(1):79–93. pmid:29139007
- 24. Witlox L, Velthuis MJ, Boer JH, Steins Bisschop CN, Wall EV, Meulen W, et al. Attendance and compliance with an exercise program during localized breast cancer treatment in a randomized controlled trial: The PACT study. PLoS One. 2019;14(5):e0215517. pmid:31067223
- 25. Meneses-Echávez JF, González-Jiménez E, Ramírez-Vélez R. Effects of supervised exercise on cancer-related fatigue in breast cancer survivors: a systematic review and meta-analysis. BMC Cancer. 2015;15:77. pmid:25885168
- 26. Wang R, Nakshatri H. Systemic Actions of Breast Cancer Facilitate Functional Limitations. Cancers (Basel). 2020;12(1). pmid:31941005
- 27. Ribeiro IL, Moreira RFC, Ferrari AV, Alburquerque-Sendín F, Camargo PR, Salvini TF. Effectiveness of early rehabilitation on range of motion, muscle strength and arm function after breast cancer surgery: a systematic review of randomized controlled trials. Clin Rehabil. 2019;33(12):1876–86. pmid:31480855
- 28. Li L, Yu F, Shi D, Shi J, Tian Z, Yang J, et al. Application of virtual reality technology in clinical medicine. American journal of translational research. 2017;9(9):3867–80. pmid:28979666
- 29. Karamians R, Proffitt R, Kline D, Gauthier LV. Effectiveness of Virtual Reality- and Gaming-Based Interventions for Upper Extremity Rehabilitation Poststroke: A Meta-analysis. Archives of physical medicine and rehabilitation. 2020;101(5):885–96. pmid:31821799
- 30. Ayed I, Ghazel A, Jaume ICA, Moyà-Alcover G, Varona J, Martínez-Bueso P. Vision-based serious games and virtual reality systems for motor rehabilitation: A review geared toward a research methodology. International journal of medical informatics. 2019;131:103909. pmid:31557701
- 31. Perez-Marcos D. Virtual reality experiences, embodiment, videogames and their dimensions in neurorehabilitation. Journal of neuroengineering and rehabilitation. 2018;15(1):113. pmid:30477527
- 32. Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst. 2015;39(2):1. pmid:25600193
- 33.
ISO 9241. International Organisation for Standardization. 2019 [https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en.
- 34. He X, Zhang H, Bian J. User-centered design of a web-based crowdsourcing-integrated semantic text annotation tool for building a mental health knowledge base. Journal of biomedical informatics. 2020;110:103571. pmid:32961307
- 35. Regan EC, Price KR. The frequency of occurrence and severity of side-effects of immersion virtual reality. Aviation, space, and environmental medicine. 1994;65(6):527–30. pmid:8074626
- 36. Virzi RA. Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Human Factors. 1992;34(4):457–68.
- 37. Brooke J. SUS—A quick and dirty usability scale. Usability Evaluation in Industry. 1996;189.
- 38. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. International Journal of Aviation Psychology. 1993;3(3):203–20.
- 39.
Witmer Bob G, Singer Michael J. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators Virtual Environments. 1998.
- 40. Zeng Y, Zhang JE, Cheng ASK, Cheng H, Wefel JS. Meta-Analysis of the Efficacy of Virtual Reality-Based Interventions in Cancer-Related Symptom Management. Integrative cancer therapies. 2019;18:1534735419871108. pmid:31441352
- 41. Chirico A, Maiorano P, Indovina P, Milanese C, Giordano GG, Alivernini F, et al. Virtual reality and music therapy as distraction interventions to alleviate anxiety and improve mood states in breast cancer patients during chemotherapy. Journal of cellular physiology. 2020;235(6):5353–62. pmid:31957873
- 42. House G, Burdea G, Grampurohit N, Polistico K, Roll D, Damiani F, et al. A feasibility study to determine the benefits of upper extremity virtual rehabilitation therapy for coping with chronic pain post-cancer surgery. Br J Pain. 2016;10(4):186–97. pmid:27867508
- 43. Feyzioğlu Ö, Dinçer S, Akan A, Algun ZC. Is Xbox 360 Kinect-based virtual reality training as effective as standard physiotherapy in patients undergoing breast cancer surgery? Support Care Cancer. 2020;28(9):4295–303. pmid:31907649
- 44. Axenie C, Kurz D. Role of Kinematics Assessment and Multimodal Sensorimotor Training for Motion Deficits in Breast Cancer Chemotherapy-Induced Polyneuropathy: A Perspective on Virtual Reality Avatars. Front Oncol. 2020;10:1419. pmid:32903366
- 45. Park HY, Nam KE, Lim JY, Yeo SM, In Lee J, Hwang JH. Real-time interactive digital healthcare system for post-operative breast cancer patients: study protocol for a randomized controlled trial. Trials. 2021;22(1):549. pmid:34412658
- 46. Niki K, Okamoto Y, Maeda I, Mori I, Ishii R, Matsuda Y, et al. A Novel Palliative Care Approach Using Virtual Reality for Improving Various Symptoms of Terminal Cancer Patients: A Preliminary Prospective, Multicenter Study. J Palliat Med. 2019;22(6):702–7. pmid:30676847
- 47. Johnson T, Bauler L, Vos D, Hifko A, Garg P, Ahmed M, et al. Virtual Reality Use for Symptom Management in Palliative Care: A Pilot Study to Assess User Perceptions. J Palliat Med. 2020;23(9):1233–8. pmid:31895637
- 48. Bani Mohammad E, Ahmad M. Virtual reality as a distraction technique for pain and anxiety among patients with breast cancer: A randomized control trial. Palliat Support Care. 2019;17(1):29–34. pmid:30198451
- 49. Chirico A, Lucidi F, De Laurentiis M, Milanese C, Napoli A, Giordano A. Virtual Reality in Health System: Beyond Entertainment. A Mini-Review on the Efficacy of VR During Cancer Treatment. J Cell Physiol. 2016;231(2):275–87. pmid:26238976
- 50. Sharifpour S, Manshaee G, I. S. Effects of virtual reality therapy on perceived pain intensity, anxiety, catastrophising and self-efficacy among adolescents with cancer. Counselling and Psychotherapy Research. 2020;21(1):218–26.
- 51. Buche H, Michel A, Piccoli C, Blanc N. Contemplating or Acting? Which Immersive Modes Should Be Favored in Virtual Reality During Physiotherapy for Breast Cancer Rehabilitation. Front Psychol. 2021;12:631186. pmid:33897539
- 52. Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. International journal of medical informatics. 2019;126:95–104. pmid:31029270
- 53. Zhang T, Booth R, Jean-Louis R, Chan R, Yeung A, Gratzer D, et al. A Primer on Usability Assessment Approaches for Health-Related Applications of Virtual Reality. JMIR serious games. 2020;8(4):e18153. pmid:33112243
- 54. Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction. 2008;24(6):574–94.
- 55. Ahmadpour N, Keep M, Janssen A, Rouf AS, Marthick M. Design Strategies for Virtual Reality Interventions for Managing Pain and Anxiety in Children and Adolescents: Scoping Review. JMIR serious games. 2020;8(1):e14565. pmid:32012042
- 56. Cummings JJ, Bailenson JN. How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence. Media Psychology. 2015:1–38.
- 57. Oman CM. Motion sickness: a synthesis and evaluation of the sensory conflict theory. Canadian journal of physiology and pharmacology. 1990;68(2):294–303. pmid:2178753
- 58. Keshavarz B, Ramkhalawansingh R, Haycock B, Shahab S, Campos JL. Comparing simulator sickness in younger and older adults during simulated driving under different multisensory conditions. Transportation Research Part F Traffic Psychology Behaviour. 2018;54(APR.):47–62.
- 59. Hussain R, Chessa M, Solari F. Mitigating Cybersickness in Virtual Reality Systems through Foveated Depth-of-Field Blur. Sensors (Basel, Switzerland). 2021;21(12). pmid:34200616
- 60. Dużmańska N, Strojny P, Strojny A. Can Simulator Sickness Be Avoided? A Review on Temporal Aspects of Simulator Sickness. Frontiers in psychology. 2018;9:2132. pmid:30459688
- 61. Kim WS, Cho S, Ku J, Kim Y, Lee K, Hwang HJ, et al. Clinical Application of Virtual Reality for Upper Limb Motor Rehabilitation in Stroke: Review of Technologies and Clinical Evidence. Journal of clinical medicine. 2020;9(10). pmid:33096678
- 62. Lee N, Choi W, Lee S. Development of an 360-degree virtual reality video-based immersive cycle training system for physical enhancement in older adults: a feasibility study: Development of immersive virtual cycle for older adults. BMC geriatrics. 2021;21(1):325. pmid:34022789
- 63.
Albert W, Tullis T. Measuring the User Experience. Elsevier/Morgan Kaufmann.