{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T20:11:54Z","timestamp":1724357514866},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2019,3,14]],"date-time":"2019-03-14T00:00:00Z","timestamp":1552521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000062","name":"National Institute of Diabetes and Digestive and Kidney Diseases","doi-asserted-by":"publisher","award":["K25 DK097279"],"id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"publisher"}]},{"name":"U.S. Department of Education Institute of Education Sciences","award":["R305D150003"]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1TR001117"],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,5,1]]},"abstract":"Abstract<\/jats:title>Objective<\/jats:title>Participants enrolled into randomized controlled trials (RCTs) often do not reflect real-world populations. Previous research in how best to transport RCT results to target populations has focused on weighting RCT data to look like the target data. Simulation work, however, has suggested that an outcome model approach may be preferable. Here, we describe such an approach using source data from the 2\u2009\u00d7\u20092 factorial NAVIGATOR (Nateglinide And Valsartan in Impaired Glucose Tolerance Outcomes Research) trial, which evaluated the impact of valsartan and nateglinide on cardiovascular outcomes and new-onset diabetes in a prediabetic population.<\/jats:p><\/jats:sec>Materials and Methods<\/jats:title>Our target data consisted of people with prediabetes serviced at the Duke University Health System. We used random survival forests to develop separate outcome models for each of the 4 treatments, estimating the 5-year risk difference for progression to diabetes, and estimated the treatment effect in our local patient populations, as well as subpopulations, and compared the results with the traditional weighting approach.<\/jats:p><\/jats:sec>Results<\/jats:title>Our models suggested that the treatment effect for valsartan in our patient population was the same as in the trial, whereas for nateglinide treatment effect was stronger than observed in the original trial. Our effect estimates were more efficient than the weighting approach and we effectively estimated subgroup differences.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>The described method represents a straightforward approach to efficiently transporting an RCT result to any target population.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocy188","type":"journal-article","created":{"date-parts":[[2018,12,20]],"date-time":"2018-12-20T04:21:29Z","timestamp":1545279689000},"page":"429-437","source":"Crossref","is-referenced-by-count":7,"title":["An outcome model approach to transporting a randomized controlled trial results to a target population"],"prefix":"10.1093","volume":"26","author":[{"given":"Benjamin A","family":"Goldstein","sequence":"first","affiliation":[{"name":"Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina, USA"},{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"}]},{"given":"Matthew","family":"Phelan","sequence":"additional","affiliation":[{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"}]},{"given":"Neha J","family":"Pagidipati","sequence":"additional","affiliation":[{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"},{"name":"Department of Medicine, Duke Clinical Research Institute, Center for Predictive Medicine, Duke University, Durham, North Carolina, USA"}]},{"given":"Rury R","family":"Holman","sequence":"additional","affiliation":[{"name":"Endocrinology and Metabolism, University of Oxford, Oxford, United Kingdom"}]},{"given":"Michael J","family":"Pencina","sequence":"additional","affiliation":[{"name":"Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina, USA"},{"name":"Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina, USA"}]},{"given":"Elizabeth A","family":"Stuart","sequence":"additional","affiliation":[{"name":"Department of Biostatistics John Hopkins University, Baltimore, Maryland, USA"},{"name":"Department of Mental Health, John Hopkins University, Baltimore, Maryland, USA"}]}],"member":"286","published-online":{"date-parts":[[2019,3,14]]},"reference":[{"issue":"3","key":"2020110613063554400_ocy188-B1","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/DCR.0b013e318197d13c","article-title":"Differences between clinical trial participants and patients in a population-based registry: the German Rectal Cancer Study vs. the Rostock Cancer Registry","volume":"52","author":"Kalata","year":"2009","journal-title":"Dis Colon Rectum"},{"issue":"2","key":"2020110613063554400_ocy188-B2","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1513\/pats.200701-009GC","article-title":"Population issues in clinical trials","volume":"4","author":"Mosenifar","year":"2007","journal-title":"Proc Am Thorac Soc"},{"issue":"2","key":"2020110613063554400_ocy188-B3","doi-asserted-by":"crossref","first-page":"463","DOI":"10.4338\/ACI-2013-12-RA-0105","article-title":"A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records","volume":"5","author":"Weng","year":"2014","journal-title":"Appl Clin Inform"},{"issue":"4","key":"2020110613063554400_ocy188-B4","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1111\/rssa.12357","article-title":"Generalizing evidence from randomized trials using inverse probability of sampling weights","volume":"181","author":"Buchanan","year":"2018","journal-title":"J R Stat Soc Ser A Stat Soc"},{"issue":"1","key":"2020110613063554400_ocy188-B5","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1093\/aje\/kwq084","article-title":"Generalizing evidence from randomized clinical trials to target populations: the ACTG 320 trial","volume":"172","author":"Cole","year":"2010","journal-title":"Am J Epidemiol"},{"issue":"4","key":"2020110613063554400_ocy188-B6","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1093\/aje\/kwx287","article-title":"Generalizing randomized clinical trial results: implementation and challenges related to missing data in the target population","volume":"187","author":"Hong","year":"2018","journal-title":"Am J Epidemiol"},{"issue":"2","key":"2020110613063554400_ocy188-B7","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1467-985X.2010.00673.x","article-title":"The use of propensity scores to assess the generalizability of results from randomized trials","volume":"174","author":"Stuart","year":"2001","journal-title":"J R Stat Soc Ser A Stat Soc"},{"issue":"5","key":"2020110613063554400_ocy188-B8","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1177\/1049731517720730","article-title":"Generalizability of randomized trial results to target populations: design and analysis possibilities","volume":"28","author":"Stuart","year":"2018","journal-title":"Res Soc Work Pract"},{"issue":"10","key":"2020110613063554400_ocy188-B9","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1002\/sim.7238","article-title":"Generalizability analysis for clinical trials: a simulation study","volume":"36","author":"Wang","year":"2017","journal-title":"Stat Med"},{"issue":"1","key":"2020110613063554400_ocy188-B10","first-page":"103","article-title":"Assessing methods for generalizing experimental impact estimates to target populations","volume":"9","author":"Kern","year":"2016","journal-title":"J Res Educ Eff"},{"issue":"6","key":"2020110613063554400_ocy188-B11","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1177\/1740774506073464","article-title":"Generalizing results of randomized trials to clinical practice: reliability and cautions","volume":"3","author":"Flather","year":"2006","journal-title":"Clin Trials"},{"issue":"20","key":"2020110613063554400_ocy188-B12","doi-asserted-by":"crossref","first-page":"3552","DOI":"10.1002\/sim.5802","article-title":"The use of propensity scores and observational data to estimate randomized controlled trial generalizability bias","volume":"32","author":"Pressler","year":"2013","journal-title":"Statist Med"},{"issue":"8","key":"2020110613063554400_ocy188-B13","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1093\/aje\/kwx164","article-title":"Transportability of trial results using inverse odds of sampling weights","volume":"186","author":"Westreich","year":"2017","journal-title":"Am J Epidemiol"},{"key":"2020110613063554400_ocy188-B14"},{"issue":"22","key":"2020110613063554400_ocy188-B15","doi-asserted-by":"crossref","first-page":"2397","DOI":"10.1001\/jama.2016.7041","article-title":"Implementing MACRA: implications for physicians and for physician leadership","volume":"315","author":"Clough","year":"2016","journal-title":"JAMA"},{"issue":"1","key":"2020110613063554400_ocy188-B16","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/10618600.2017.1356325","article-title":"Estimating individual treatment effect in observational data using random forest methods","volume":"27","author":"Lu","year":"2018","journal-title":"J Comput Graph Stat"},{"issue":"1","key":"2020110613063554400_ocy188-B17","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"key":"2020110613063554400_ocy188-B18","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1080\/01621459.2017.1319839","article-title":"Estimation and inference of heterogeneous treatment effects using random forests","volume":"113","author":"Wager","year":"2018","journal-title":"J Am Stat Assoc"},{"key":"2020110613063554400_ocy188-B19","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/1472-6947-13-37","article-title":"Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence","volume":"13","author":"K\u00f6pcke","year":"2013","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"2020110613063554400_ocy188-B20","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/j.ahj.2008.05.017","article-title":"Prevention of diabetes and cardiovascular disease in patients with impaired glucose tolerance: rationale and design of the Nateglinide and Valsartan in Impaired Glucose Tolerance Outcomes Research (NAVIGATOR) Trial","volume":"156","author":"Califf","year":"2008","journal-title":"Am Heart J"},{"issue":"16","key":"2020110613063554400_ocy188-B21","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1056\/NEJMoa1001121","article-title":"Effect of valsartan on the incidence of diabetes and cardiovascular events","volume":"362","author":"NAVIGATOR Study Group","year":"2010","journal-title":"N Engl J Med"},{"issue":"16","key":"2020110613063554400_ocy188-B22","doi-asserted-by":"crossref","first-page":"1463","DOI":"10.1056\/NEJMoa1001122","article-title":"Effect of nateglinide on the incidence of diabetes and cardiovascular events","volume":"362","author":"NAVIGATOR Study Group","year":"2010","journal-title":"N Engl J Med"},{"issue":"9","key":"2020110613063554400_ocy188-B23","doi-asserted-by":"crossref","first-page":"1608","DOI":"10.1377\/hlthaff.2012.1199","article-title":"Geographic health information systems: a platform to support the \u201ctriple aim.\u201d","volume":"32","author":"Miranda","year":"2013","journal-title":"Health Aff (Millwood)"},{"issue":"17","key":"2020110613063554400_ocy188-B24","doi-asserted-by":"crossref","first-page":"2750","DOI":"10.1002\/sim.7308","article-title":"A comparison of risk prediction methods using repeated observations: an application to electronic health records for hemodialysis","volume":"36","author":"Goldstein","year":"2017","journal-title":"Statist Med"},{"issue":"28","key":"2020110613063554400_ocy188-B25","doi-asserted-by":"crossref","first-page":"4514","DOI":"10.1002\/sim.7144","article-title":"The use of repeated blood pressure measures for cardiovascular risk prediction: a comparison of statistical models in the ARIC study","volume":"36","author":"Sweeting","year":"2017","journal-title":"Statist Med"},{"issue":"4","key":"2020110613063554400_ocy188-B26","doi-asserted-by":"crossref","first-page":"899","DOI":"10.2337\/dc17-2530","article-title":"Risk of cardiovascular disease and death in individuals with prediabetes defined by different criteria: The Whitehall II Study","volume":"41","author":"Vistisen","year":"2018","journal-title":"Diabetes Care"},{"issue":"1","key":"2020110613063554400_ocy188-B27","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/00031305.1985.10479383","article-title":"Constructing a control group using multivariate matched sampling methods that incorporate the propensity score","volume":"39","author":"Rosenbaum","year":"1985","journal-title":"Am Stat"},{"issue":"3","key":"2020110613063554400_ocy188-B28","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1214\/08-AOAS169","article-title":"Random survival forests","volume":"2","author":"Ishwaran","year":"2008","journal-title":"Ann Appl Stat"},{"issue":"5","key":"2020110613063554400_ocy188-B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v039.i05","article-title":"Regularization paths for Cox\u2019s proportional hazards model via coordinate descent","volume":"39","author":"Simon","year":"2011","journal-title":"J Stat Softw"},{"issue":"2","key":"2020110613063554400_ocy188-B30","first-page":"25","article-title":"Random survival forests for R","volume":"7","author":"Ishwaran","year":"2007","journal-title":"R News"},{"key":"2020110613063554400_ocy188-B31","first-page":"569","article-title":"Assessing the collective population representativeness of related type 2 diabetes trials by combining public data from ClinicalTrials.gov and NHANES","volume":"216","author":"He","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2020110613063554400_ocy188-B32","first-page":"1472","article-title":"Sick patients have more data: the non-random completeness of electronic health records","volume":"2013","author":"Weiskopf","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2020110613063554400_ocy188-B33","first-page":"22","article-title":"Illustrating informed presence bias in electronic health records data: how patient interactions with a health system can impact inference","volume":"5","author":"Phelan","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"2020110613063554400_ocy188-B34","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"Elements of Statistical Learning","author":"Hastie","year":"2009","edition":"2nd ed"},{"key":"2020110613063554400_ocy188-B35","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1186\/s13063-015-1023-4","article-title":"A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results","volume":"16","author":"Kennedy-Martin","year":"2015","journal-title":"Trials"},{"issue":"1","key":"2020110613063554400_ocy188-B36","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1214\/16-AOAS1001","article-title":"Sensitivity analysis for an unobserved moderator in RCT-to-target-population generalization of treatment effects","volume":"11","author":"Nguyen","year":"2017","journal-title":"Ann Appl Stat"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/5\/429\/34151459\/ocy188.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/5\/429\/34151459\/ocy188.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,13]],"date-time":"2024-07-13T13:54:21Z","timestamp":1720878861000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/5\/429\/5380689"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,14]]},"references-count":36,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,3,14]]},"published-print":{"date-parts":[[2019,5,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy188","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,5]]},"published":{"date-parts":[[2019,3,14]]}}}