{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T11:07:31Z","timestamp":1740136051208,"version":"3.37.3"},"reference-count":23,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T00:00:00Z","timestamp":1673827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"IBM Research Africa"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,3,16]]},"abstract":"Abstract<\/jats:title>Background<\/jats:title>The onset of COVID-19 and related policy responses made it difficult to study interactive health informatics solutions in clinical study settings. Instrumented log and event data from interactive systems capture temporal details that can be used to generate insights about care continuity during ongoing pandemics.<\/jats:p><\/jats:sec>Objective<\/jats:title>To investigate user interactions with a digital health wallet (DHW) system for addressing care continuity challenges in chronic disease management in the context of an ongoing pandemic.<\/jats:p><\/jats:sec>Materials and methods<\/jats:title>We analyzed user interaction log data generated by clinicians, nurses, and patients from the deployment of a DHW in a feasibility study conducted during the COVID-19 pandemic in Kenya. We used the Hamming distance from Information Theory to quantify deviations of usage patterns extracted from the events data from predetermined workflow sequences supported by the platform.<\/jats:p><\/jats:sec>Results<\/jats:title>Nurses interacted with all the user interface elements relevant to triage. Clinicians interacted with only 43% of elements relevant to consultation, while patients interacted with 67% of the relevant user interface elements. Nurses and clinicians deviated from the predetermined workflow sequences by 42% and 36%, respectively. Most deviations pertained to users going back to previous steps in their usage workflow.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>User interaction log analysis is a valuable alternative method for generating and quantifying user experiences in the context of ongoing pandemics. However, researchers should mitigate the potential disruptions of the actual use of the studied technologies as well as use multiple approaches to investigate user experiences of health technology during pandemics.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocad004","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T13:36:49Z","timestamp":1673876209000},"page":"674-682","source":"Crossref","is-referenced-by-count":2,"title":["Analysis of user interactions with a digital health wallet for enabling care continuity in the context of an ongoing pandemic"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0891-7596","authenticated-orcid":false,"given":"Charles","family":"Wachira","sequence":"first","affiliation":[{"name":"IBM Research Africa , Nairobi, Kenya"}]},{"given":"William","family":"Ogallo","sequence":"additional","affiliation":[{"name":"IBM Research Africa , Nairobi, Kenya"}]},{"given":"Sharon","family":"Okwako","sequence":"additional","affiliation":[{"name":"IBM Research Africa , Nairobi, Kenya"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2332-6890","authenticated-orcid":false,"given":"Sekou Lionel","family":"Remy","sequence":"additional","affiliation":[{"name":"IBM Research Africa , Nairobi, Kenya"}]},{"given":"Zipporah","family":"Bukania","sequence":"additional","affiliation":[{"name":"Centre for Public Health\u2014Kenya Medical Research Institute (KEMRI) , Nairobi, Kenya"}]},{"given":"Mercy Karimi","family":"Njeru","sequence":"additional","affiliation":[{"name":"Centre for Public Health\u2014Kenya Medical Research Institute (KEMRI) , Nairobi, Kenya"}]},{"given":"Moses","family":"Mwangi","sequence":"additional","affiliation":[{"name":"Centre for Public Health\u2014Kenya Medical Research Institute (KEMRI) , Nairobi, Kenya"}]},{"given":"Sharon","family":"Mokua","sequence":"additional","affiliation":[{"name":"Centre for Public Health\u2014Kenya Medical Research Institute (KEMRI) , Nairobi, Kenya"}]},{"given":"Wycliffe","family":"Omwanda","sequence":"additional","affiliation":[{"name":"Lwala Community Alliance , Migori, Kenya"}]},{"given":"Daniele","family":"Ressler","sequence":"additional","affiliation":[{"name":"Lwala Community Alliance , Migori, Kenya"}]},{"given":"Aisha","family":"Walcott-Bryant","sequence":"additional","affiliation":[{"name":"IBM Research Africa , Nairobi, Kenya"}]}],"member":"286","published-online":{"date-parts":[[2023,1,16]]},"reference":[{"author":"Osebe","key":"2023031607563531800_","first-page":"1"},{"issue":"1","key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2009.07.002","article-title":"The technology acceptance model: its past and its future in health care","volume":"43","author":"Holden","year":"2010","journal-title":"J Biomed Inform"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s10209-014-0348-1","article-title":"Technology acceptance model: a literature review from 1986 to 2013","volume":"14","author":"Maranguni\u0107","year":"2015","journal-title":"Univ Access Inf Soc"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11892-014-0534-9","article-title":"Getting a technology-based diabetes intervention ready for prime time: a review of usability testing studies","volume":"14","author":"Lyles","year":"2014","journal-title":"Curr Diab Rep"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s11036-007-0014-4","article-title":"Usability and feasibility of PmEB: a mobile phone application for monitoring real time caloric balance","volume":"12","author":"Tsai","year":"2007","journal-title":"Mob Netw Appl"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"227","DOI":"10.4018\/978-1-59904-974-8.ch012","volume-title":"Handbook of Research on Web Log Analysis","author":"Muresan","year":"2009"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1007\/s10618-011-0228-8","article-title":"Web log analysis: a review of a decade of studies about information acquisition, inspection and interpretation of user interaction","volume":"24","author":"Agosti","year":"2012","journal-title":"Data Min Knowl Discov"},{"year":"2016","author":"Sarikaya","key":"2023031607563531800_"},{"first-page":"145","article-title":"Medication management companion (MMC) for a rural Kenyan community","author":"Oduor","key":"2023031607563531800_"},{"issue":"2","key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"e18899","DOI":"10.2196\/18899","article-title":"Addressing care continuity and quality challenges in the management of hypertension: case study of the private health care sector in Kenya","volume":"23","author":"Walcott-Bryant","year":"2021","journal-title":"J Med Internet Res"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1111\/j.1530-9290.2008.00015.x","article-title":"The Sankey diagram in energy and material flow management: part II: methodology and current applications","volume":"12","author":"Schmidt","year":"2008","journal-title":"J Ind Ecol"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","DOI":"10.1201\/9781315371993","volume-title":"Introduction to Coding Theory","author":"Bierbrauer","year":"2016"},{"first-page":"668","volume-title":"Encyclopedia of Biometrics","year":"2009","key":"2023031607563531800_"},{"key":"2023031607563531800_","first-page":"1595","article-title":"Exploring rural community practices in HIV management for the design of technology for hypertensive patients living with HIV","author":"Oduor","year":"2019"},{"issue":"3","key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"ooaa070","DOI":"10.1093\/jamiaopen\/ooaa070","article-title":"Workflow analysis for design of an electronic health record-based tobacco cessation intervention in community health centers","volume":"4","author":"Gibson","year":"2021","journal-title":"JAMIA Open"},{"issue":"2","key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"ooab018","DOI":"10.1093\/jamiaopen\/ooab018","article-title":"EHR \u201cSWAT\u201d teams: a physician engagement initiative to improve electronic health record (EHR) experiences and mitigate possible causes of EHR-related burnout","volume":"4","author":"Sequeira","year":"2021","journal-title":"JAMIA Open"},{"key":"2023031607563531800_","first-page":"43","article-title":"Was it worth the hassle? Ten years of mobile HCI research discussions on lab and field evaluations","author":"Kjeldskov","year":"2014"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1207\/S15327590IJHC1304_03","article-title":"Criteria for evaluating usability evaluation methods","volume":"13","author":"Hartson","year":"2001","journal-title":"Int J Hum Comput Interact"},{"key":"2023031607563531800_","first-page":"361","volume-title":"An Approach to Identifying What Has Gone Wrong in a User Interaction","author":"Marrella","year":"2019"},{"key":"2023031607563531800_","first-page":"40","article-title":"Disco: discover your processes","volume":"940","author":"G\u00fcnther","year":"2012","journal-title":"BPM (Demos)"},{"key":"2023031607563531800_","first-page":"328","volume-title":"Fuzzy Mining\u2014Adaptive Process Simplification Based on Multi-Perspective Metrics","author":"G\u00fcnther","year":"2007"},{"key":"2023031607563531800_","first-page":"2269","volume-title":"Informatik 2014","author":"Thaler","year":"2014"},{"key":"2023031607563531800_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12913-021-06726-4","article-title":"Indirect health effects of the COVID-19 pandemic in Kenya: a mixed methods assessment","volume":"21","author":"Barasa","year":"2021","journal-title":"BMC Health Serv Res"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocad004\/48724114\/ocad004.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/4\/674\/49524389\/ocad004.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/4\/674\/49524389\/ocad004.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T21:46:20Z","timestamp":1679348780000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/4\/674\/6988035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,16]]},"references-count":23,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,1,16]]},"published-print":{"date-parts":[[2023,3,16]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad004","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2023,4,1]]},"published":{"date-parts":[[2023,1,16]]}}}