{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,21]],"date-time":"2024-09-21T04:21:45Z","timestamp":1726892505119},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["5U2COD0231 96"],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"Abstract<\/jats:title>\n \n Objective<\/jats:title>\n To evaluate the use of patient portal messaging to recruit individuals historically underrepresented in biomedical research (UBR) to the All of Us Research Program (AoURP) at a single recruitment site.<\/jats:p>\n <\/jats:sec>\n \n Materials and Methods<\/jats:title>\n Patient portal-based recruitment was implemented at Columbia University Irving Medical Center. Patient engagement was assessed using patient\u2019s electronic health record (EHR) at four recruitment stages: Consenting to be contacted, opening messages, responding to messages, and showing interest in participating. Demographic and socioeconomic data were also collected from patient\u2019s EHR and univariate logistic regression analyses were conducted to assess patient engagement.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Between October 2022 and November 2023, a total of 59\u00a0592 patients received patient portal messages inviting them to join the AoURP. Among them, 24\u00a0445 (41.0%) opened the message, 8983 (15.1%) responded, and 3765 (6.3%) showed interest in joining the program. Though we were unable to link enrollment data with EHR data, we estimate about 2% of patients contacted ultimately enrolled in the AoURP. Patients from underrepresented race and ethnicity communities had lower odds of consenting to be contacted and opening messages, but higher odds of showing interest after responding.<\/jats:p>\n <\/jats:sec>\n \n Discussion<\/jats:title>\n Patient portal messaging provided both patients and recruitment staff with a more efficient approach to outreach, but patterns of engagement varied across UBR groups.<\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n Patient portal-based recruitment enables researchers to contact a substantial number of participants from diverse communities. However, more effort is needed to improve engagement from underrepresented racial and ethnic groups at the early stages of the recruitment process.<\/jats:p>\n <\/jats:sec>","DOI":"10.1093\/jamia\/ocae135","type":"journal-article","created":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T21:15:44Z","timestamp":1719350144000},"page":"2328-2336","source":"Crossref","is-referenced-by-count":0,"title":["Using patient portals for large-scale recruitment of individuals underrepresented in biomedical research: an evaluation of engagement patterns throughout the patient portal recruitment process at a single site within the All of Us Research Program<\/i>"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-4649-255X","authenticated-orcid":false,"given":"Maura","family":"Beaton","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1944-6526","authenticated-orcid":false,"given":"Xinzhuo","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"http:\/\/orcid.org\/0009-0003-2987-3542","authenticated-orcid":false,"given":"Elise","family":"Minto","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5934-5562","authenticated-orcid":false,"given":"Chun Yee","family":"Lau","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Lennon","family":"Turner","sequence":"additional","affiliation":[{"name":"Center for Precision Medicine and Genomics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-2664-7614","authenticated-orcid":false,"given":"George","family":"Hripcsak","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"given":"Kanchan","family":"Chaudhari","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-9066-9431","authenticated-orcid":false,"given":"Karthik","family":"Natarajan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center , New York, NY 10032, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,6,25]]},"reference":[{"issue":"7","key":"2024092007525596900_ocae135-B1","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1056\/NEJMsr1809937","article-title":"The \u201cAll of Us\u201d research program","volume":"381","author":"Denny","year":"2019","journal-title":"N Engl J Med"},{"issue":"9","key":"2024092007525596900_ocae135-B2","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1056\/NEJMp1500523","article-title":"A new initiative on precision medicine","volume":"372","author":"Collins","year":"2015","journal-title":"N Engl J Med"},{"issue":"7","key":"2024092007525596900_ocae135-B3","doi-asserted-by":"crossref","first-page":"e0234962","DOI":"10.1371\/journal.pone.0234962","article-title":"Diversity and inclusion for the All of Us research program: a scoping review","volume":"15","author":"Mapes","year":"2020","journal-title":"PLoS ONE"},{"year":"2021","author":"Investigators AoURP","key":"2024092007525596900_ocae135-B4"},{"issue":"4","key":"2024092007525596900_ocae135-B5","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1111\/cts.12759","article-title":"Approach to high volume enrollment in clinical research: Experiences from an All of Us research program site","volume":"13","author":"Ilori","year":"2020","journal-title":"Clin Transl Sci"},{"key":"2024092007525596900_ocae135-B6","first-page":"602","article-title":"Implementation of informatics to support the NIH All of Us Research Program in a healthcare provider organization","volume":"2019","author":"Turner","year":"2019","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"1","key":"2024092007525596900_ocae135-B7","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1093\/aje\/kwac169","article-title":"The impact of COVID-19 on the All of Us research program","volume":"192","author":"Hedden","year":"2023","journal-title":"Am J Epidemiol"},{"issue":"1","key":"2024092007525596900_ocae135-B8","doi-asserted-by":"crossref","first-page":"129","DOI":"10.7326\/M20-3026","article-title":"Reduced in-person and increased telehealth outpatient visits during the COVID-19 pandemic","volume":"174","author":"Baum","year":"2021","journal-title":"Ann Intern Med"},{"issue":"7","key":"2024092007525596900_ocae135-B9","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1001\/jamasurg.2021.0979","article-title":"Use of telehealth by surgical specialties during the COVID-19 pandemic","volume":"156","author":"Chao","year":"2021","journal-title":"JAMA Surg"},{"year":"2023","author":"American Medical Association","key":"2024092007525596900_ocae135-B10"},{"issue":"1","key":"2024092007525596900_ocae135-B11","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1111\/j.1748-720X.2010.00466.x","article-title":"Ethics, information technology, and public health: new challenges for the clinician-patient relationship","volume":"38","author":"Goodman","year":"2010","journal-title":"J Law Med Ethics"},{"issue":"1","key":"2024092007525596900_ocae135-B12","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1111\/bioe.12382","article-title":"Reconsidering paternalism in clinical research","volume":"32","author":"Jansen","year":"2018","journal-title":"Bioethics"},{"issue":"11","key":"2024092007525596900_ocae135-B13","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1080\/15265161.2015.1088978","article-title":"Gatekeeping by professionals in recruitment of pediatric research participants: indeed an undesirable practice","volume":"15","author":"Tromp","year":"2015","journal-title":"Am J Bioeth"},{"issue":"1","key":"2024092007525596900_ocae135-B14","doi-asserted-by":"crossref","first-page":"e90","DOI":"10.1017\/cts.2022.428","article-title":"Screening for participants in the ISCHEMIA trial: Implications for clinical research","volume":"6","author":"Rodriguez","year":"2022","journal-title":"J Clin Transl Sci"},{"issue":"10","key":"2024092007525596900_ocae135-B15","doi-asserted-by":"crossref","first-page":"1647","DOI":"10.1007\/s00228-022-03366-3","article-title":"Perception of clinical research among patients and healthy volunteers of clinical trials","volume":"78","author":"Bergmann","year":"2022","journal-title":"Eur J Clin Pharmacol"},{"issue":"2","key":"2024092007525596900_ocae135-B16","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/23294515.2017.1305007","article-title":"Primary care physicians' views about gatekeeping in clinical research recruitment: A qualitative study","volume":"8","author":"Guillemin","year":"2017","journal-title":"AJOB Empir Bioeth"},{"issue":"11","key":"2024092007525596900_ocae135-B17","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1093\/jamia\/ocz168","article-title":"Electronic medical record\u2013based cohort selection and direct-to-patient, targeted recruitment: early efficacy and lessons learned","volume":"26","author":"Miller","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"12","key":"2024092007525596900_ocae135-B18","doi-asserted-by":"crossref","first-page":"e005654","DOI":"10.1136\/bmjopen-2014-005654","article-title":"Developing a new model for patient recruitment in mental health services: a cohort study using electronic health records","volume":"4","author":"Callard","year":"2014","journal-title":"BMJ Open"},{"issue":"5","key":"2024092007525596900_ocae135-B19","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1136\/medethics-2013-101765","article-title":"Implementation of a consent for chart review and contact and its impact in one clinical centre","volume":"41","author":"Druce","year":"2015","journal-title":"J Med Ethics"},{"issue":"1","key":"2024092007525596900_ocae135-B20","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1186\/s12874-019-0843-4","article-title":"Can a \u2018consent to contact\u2019 community help research teams overcome barriers to recruitment? The development and impact of the \u2018research for the future\u2019 community","volume":"19","author":"Grady","year":"2019","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"2024092007525596900_ocae135-B21","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1093\/jamia\/ocy138","article-title":"Recruiting for a pragmatic trial using the electronic health record and patient portal: Successes and lessons learned","volume":"26","author":"Pfaff","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024092007525596900_ocae135-B22","doi-asserted-by":"crossref","first-page":"e24003","DOI":"10.2196\/24003","article-title":"Patient recruitment into a multicenter clinical cohort linking electronic health records from 5 health systems: Cross-sectional analysis","volume":"23","author":"Bennett","year":"2021","journal-title":"J Med Internet Res"},{"issue":"8","key":"2024092007525596900_ocae135-B23","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1177\/0193945920970229","article-title":"Evaluating recruitment strategies for a randomized clinical trial with heart failure patients","volume":"43","author":"Conley","year":"2021","journal-title":"West J Nurs Res"},{"issue":"7","key":"2024092007525596900_ocae135-B24","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1007\/s10916-021-01749-0","article-title":"Association between patient portal use and office visits","volume":"45","author":"Silver","year":"2021","journal-title":"J Med Syst"},{"issue":"1","key":"2024092007525596900_ocae135-B25","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1055\/s-0038-1677528","article-title":"How patients use a patient portal: An institutional case study of demographics and usage patterns","volume":"10","author":"Tsai","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"6","key":"2024092007525596900_ocae135-B26","doi-asserted-by":"crossref","first-page":"e26022","DOI":"10.2196\/26022","article-title":"Using the computer-based health evaluation system (CHES) to support self-management of symptoms and functional health: Evaluation of hematological patient use of a web-based patient portal","volume":"23","author":"Lehmann","year":"2021","journal-title":"J Med Internet Res"},{"issue":"26","key":"2024092007525596900_ocae135-B27","doi-asserted-by":"crossref","first-page":"2456","DOI":"10.1056\/NEJMp1802313","article-title":"Making neighborhood-disadvantage metrics accessible\u2013The neighborhood atlas","volume":"378","author":"Kind","year":"2018","journal-title":"N Engl J Med"},{"year":"2023","author":"Federal Office of Rural Health Policy","key":"2024092007525596900_ocae135-B28"},{"issue":"1","key":"2024092007525596900_ocae135-B29","doi-asserted-by":"crossref","first-page":"e30941","DOI":"10.2196\/30941","article-title":"Using a patient portal to increase enrollment in a newborn screening research study: Observational study","volume":"5","author":"Gehtland","year":"2022","journal-title":"JMIR Pediatr Parent"},{"issue":"12","key":"2024092007525596900_ocae135-B30","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1093\/jamia\/ocz157","article-title":"Challenges and opportunities using online portals to recruit diverse patients to behavioral trials","volume":"26","author":"Tabriz","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2024092007525596900_ocae135-B31","doi-asserted-by":"crossref","first-page":"559","DOI":"10.3122\/jabfm.2022.03.210486","article-title":"Disparities in use of patient portals among adults in family medicine","volume":"35","author":"Tuan","year":"2022","journal-title":"J Am Board Fam Med"},{"issue":"2","key":"2024092007525596900_ocae135-B32","doi-asserted-by":"crossref","first-page":"e14410","DOI":"10.2196\/14410","article-title":"Characteristics of patients using different patient portal functions and the impact on primary care service utilization and appointment adherence: retrospective observational study","volume":"22","author":"Zhong","year":"2020","journal-title":"J Med Internet Res"},{"issue":"4","key":"2024092007525596900_ocae135-B33","doi-asserted-by":"crossref","first-page":"ooac091","DOI":"10.1093\/jamiaopen\/ooac091","article-title":"Using a patient portal as a recruitment tool to diversify the pool of participants in COVID-19 vaccine clinical trials","volume":"5","author":"Yuh","year":"2022","journal-title":"JAMIA Open"},{"key":"2024092007525596900_ocae135-B34","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1177\/1740774519873657","article-title":"Recruitment of trial participants through electronic medical record patient portal messaging: A pilot study","volume":"17","author":"Plante","year":"2020","journal-title":"Clin Trials"},{"issue":"2","key":"2024092007525596900_ocae135-B35","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1093\/jamiaopen\/ooy034","article-title":"Research participation preferences as expressed through a patient portal: Implications of demographic characteristics","volume":"1","author":"Obeid","year":"2018","journal-title":"JAMIA Open"},{"issue":"4","key":"2024092007525596900_ocae135-B36","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/S0033-3549(04)50262-5","article-title":"Race and trust in the health care system","volume":"118","author":"Boulware","year":"2003","journal-title":"Public Health Rep"},{"issue":"3","key":"2024092007525596900_ocae135-B37","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.pec.2014.06.003","article-title":"Impact of sociodemographic factors and previous interactions with the health care system on institutional trust in three racial\/ethnic groups","volume":"96","author":"Schwei","year":"2014","journal-title":"Patient Educ Couns"},{"issue":"18","key":"2024092007525596900_ocae135-B38","doi-asserted-by":"publisher","first-page":"3280","DOI":"10.3390\/ijerph16183280","article-title":"Understanding multilevel factors related to urban community trust in healthcare and research","volume":"16","author":"Webb Hooper","year":"2019","journal-title":"Int J Environ Res Public Health"},{"issue":"1","key":"2024092007525596900_ocae135-B39","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1370\/afm.2632","article-title":"Discrimination and medical mistrust in a racially and ethnically diverse sample of California adults","volume":"19","author":"Bazargan","year":"2021","journal-title":"Ann Fam Med"},{"issue":"2","key":"2024092007525596900_ocae135-B40","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1097\/MLR.0b013e31827310a1","article-title":"Prior experiences of racial discrimination and racial differences in health care system distrust","volume":"51","author":"Armstrong","year":"2013","journal-title":"Med Care"},{"issue":"4","key":"2024092007525596900_ocae135-B41","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1080\/15265161.2018.1431328","article-title":"Trust, precision medicine research, and equitable participation of underserved populations","volume":"18","author":"Sabatello","year":"2018","journal-title":"Am J Bioeth"},{"issue":"4","key":"2024092007525596900_ocae135-B42","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1080\/15265161.2018.1431327","article-title":"The role of the health care provider in building trust between patients and precision medicine research programs","volume":"18","author":"Persaud","year":"2018","journal-title":"Am J Bioeth"},{"issue":"4","key":"2024092007525596900_ocae135-B43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/15265161.2018.1431322","article-title":"Beyond consent: building trusting relationships with diverse populations in precision medicine research","volume":"18","author":"Kraft","year":"2018","journal-title":"Am J Bioeth"},{"issue":"7","key":"2024092007525596900_ocae135-B44","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1038\/gim.2016.183","article-title":"The precision medicine initiative\u2019s all of us research program: an agenda for research on its ethical, legal, and social issues","volume":"19","author":"Sankar","year":"2017","journal-title":"Genet Med"},{"issue":"6","key":"2024092007525596900_ocae135-B45","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.cell.2021.01.015","article-title":"Precision medicine in 2030\u2014seven ways to transform healthcare","volume":"184","author":"Denny","year":"2021","journal-title":"Cell"},{"issue":"11","key":"2024092007525596900_ocae135-B46","doi-asserted-by":"crossref","first-page":"1085","DOI":"10.1001\/jama.2022.14791","article-title":"The US Medicaid program: coverage, financing, reforms, and implications for health equity","volume":"328","author":"Donohue","year":"2022","journal-title":"JAMA"},{"issue":"8","key":"2024092007525596900_ocae135-B47","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1007\/s10995-012-1162-0","article-title":"Racial disparities in economic and clinical outcomes of pregnancy among Medicaid recipients","volume":"17","author":"Zhang","year":"2013","journal-title":"Matern Child Health J"},{"issue":"9","key":"2024092007525596900_ocae135-B48","doi-asserted-by":"crossref","first-page":"e160","DOI":"10.1016\/j.clon.2019.05.003","article-title":"Generalisability of common oncology clinical trial eligibility criteria in the real world","volume":"31","author":"Karim","year":"2019","journal-title":"Clin Oncol (R Coll Radiol)"},{"key":"2024092007525596900_ocae135-B49","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1200\/EDBK_156686","article-title":"The role of clinical trial participation in cancer research: Barriers, evidence, and strategies","volume":"36","author":"Unger","year":"2016","journal-title":"Am Soc Clin Oncol Educ Book"},{"issue":"27","key":"2024092007525596900_ocae135-B50","doi-asserted-by":"crossref","first-page":"2061","DOI":"10.1056\/NEJM199912303412706","article-title":"Underrepresentation of patients 65 years of age or older in cancer-treatment trials","volume":"341","author":"Hutchins","year":"1999","journal-title":"N Engl J Med"},{"issue":"4","key":"2024092007525596900_ocae135-B51","doi-asserted-by":"crossref","first-page":"291","DOI":"10.3747\/co.25.3978","article-title":"Are clinical trial eligibility criteria an accurate reflection of a real-world population of advanced non-small-cell lung cancer patients?","volume":"25","author":"Al-Baimani","year":"2018","journal-title":"Current Oncology"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2328\/59206343\/ocae135.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2328\/59206343\/ocae135.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T07:53:36Z","timestamp":1726818816000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/10\/2328\/7699037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,25]]},"references-count":51,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,6,25]]},"published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae135","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2024,10]]},"published":{"date-parts":[[2024,6,25]]}}}