Article Text

Download PDFPDF

Digital pathology and artificial intelligence will be key to supporting clinical and academic cellular pathology through COVID-19 and future crises: the PathLAKE consortium perspective
  1. Lisa Browning1,2,
  2. Richard Colling3,
  3. Emad Rakha4,
  4. Nasir Rajpoot5,6,
  5. Jens Rittscher2,7,
  6. Jacqueline A James8,9,
  7. Manuel Salto-Tellez8,9,
  8. David R J Snead6,
  9. Clare Verrill2,3
  1. 1 Cellular Pathology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
  2. 2 NIHR Oxford Biomedical Research Centre, Oxford, Oxfordshire, UK
  3. 3 Nuffield Department of Surgical Sciences, Oxford University, Oxford, Oxfordshire, UK
  4. 4 School of Medicine, University of Nottingham, Nottingham, Nottinghamshire, UK
  5. 5 Tissue Image Analytics Laboratory, Department of Computer Science, University of Warwick, Coventry, West Midlands, UK
  6. 6 Department of Pathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, West Midlands, UK
  7. 7 Department of Engineering Science and Big Data Institute, Oxford University, Oxford, Oxfordshire, UK
  8. 8 Precision Medicine Centre of Excellence, Patrick G Johnston Centre for Cancer Research, Queen’s University Belfast, Belfast, Belfast, UK
  9. 9 Cellular Pathology, Belfast Health and Social Care Trust, Belfast, Belfast, UK
  1. Correspondence to Associate Professor Clare Verrill, Nuffield Department of Surgical Sciences, Oxford University, John Radcliffe Hospital, Oxford OX3 9DU, UK; Clare.Verrill{at}OUH.nhs.uk

Abstract

The measures to control the COVID-19 outbreak will likely remain a feature of our working lives until a suitable vaccine or treatment is found. The pandemic has had a substantial impact on clinical services, including cancer pathways. Pathologists are working remotely in many circumstances to protect themselves, colleagues, family members and the delivery of clinical services. The effects of COVID-19 on research and clinical trials have also been significant with changes to protocols, suspensions of studies and redeployment of resources to COVID-19. In this article, we explore the specific impact of COVID-19 on clinical and academic pathology and explore how digital pathology and artificial intelligence can play a key role to safeguarding clinical services and pathology-based research in the current climate and in the future.

  • pathology, surgical
  • computer systems
  • image processing, computer-assisted
https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Cellular pathology services in the clinical and academic setting before the COVID-19 pandemic

Pathology is a vital part of cancer and other diagnostic pathways, being a core component in 70% of clinical interventions.1 Prior to the COVID-19 pandemic, cellular pathology (histopathology) capacity was not keeping pace with year-on-year increases in demand. The 2016 Cancer Research UK (CRUK) report ‘Testing Times to Come’ highlights increasing demand due to increasing cancer incidence, an ageing population and efforts to improve outcomes. Capacity has been further compounded by factors such as a preponderance of near retirement age pathologists.2 The CRUK report also describes the impact on pathology research with pathologists deprioritising this to focus on clinical work. The deprioritisation of research may become more acute as we see a resumption of clinical diagnostic and therapeutic services as the number of COVID-19 cases declines, with the subsequent increase in demand within our diagnostic laboratories. Digital pathology (DP) is seen as a key tool to enable more efficient use of the current workforce and digital enabled care is a core component of the National Health Service (NHS) long-term plan.3 In addition, the UK Government’s Industrial Life Sciences Strategy highlighted pathology as being ripe for innovation by the use of DP and artificial intelligence (AI).4

The PathLAKE consortium is one of the UK government’s 5 AI centres of excellence established in 2018 and funded by UK Research and Innovation (UKRI). PathLAKE features university and NHS partners from Coventry, Warwick, Belfast, Nottingham and Oxford. The aims include the creation of fully digital cellular pathology laboratories, the creation of an ethically approved datalake of anonymous scanned slide images and development of AI algorithms. The NHS laboratories have all now implemented DP technology as part of the programme, for example, with Oxford now scanning all slides generated in the diagnostic lab. The platforms have provided real time solutions to issues faced over the COVID-19 pandemic5 and will continue to do so with social distancing and other measures to contain the virus likely to be with us for some time.

COVID-19 and clinical and academic cellular pathology

In March 2020, WHO characterised COVID-19 as a pandemic. Clinical services have seen significant alterations during this outbreak due to the novel severe acute respiratory syndrome-coronavirus (SARS-CoV-2) virus, and there have been logistical issues to consider in order to maintain cellular pathology services. Cancer pathways have been partly suspended or altered to reflect new risk–benefit profiles when determining how to treat and who to treat (and when). Medical and surgical societies, national and international authorities have issued revised guidelines on cancer care and the UK was one of several countries to suspend elective surgery during the worst parts of the crisis.6 This, together with the temporary cessation of national screening programmes has affected the volume and types of samples entering cellular pathology laboratories with direct consequences for research and training. Research programmes and clinical trials were paused or limited to only the most essential—in many institutions either those that are COVID-19 related or that would directly affect clinical care. As many institutions seek to reinstate some activity and on-site working, the challenges around maintaining social distancing in laboratories are significant. Levels of future funding for research due to reduced charitable income are also now in doubt.

Alongside the logistical issues with maintaining cellular pathology services during the pandemic, when a ‘new normal’ service begins, patterns of patient presentation, clinical prioritisation and volumes of work are likely to have changed. Modelling for cancer surgery delays and disruption for up to 2 years due to COVID-19 have, for example, predicted that a 6-month delay to cancer surgery across the population of the UK would result in 10 760 attributable deaths.7 As cancer pathways start to reopen, it is anticipated that those who did not seek help due to fears of burdening health services or catching this novel coronavirus in hospitals will present at a more advanced stage than they may have otherwise.8 A strategic push for early diagnosis in cancer will almost inevitably have been hampered by these factors.

In this article, we present the argument for DP and AI playing a key role in resilience for both academic pathology and diagnostic pathology services and that these should form an essential component of future planning. The article does not seek to cover cytology or postmortem practice, which have their own separate considerations. The issues are discussed in the context of the UK, but many will be applicable worldwide.

Digital pathology and routine pathology services

For diagnostic purposes, the term ‘DP’ relates to the viewing on a computer workstation of digital whole slide images taken from high resolution scans of glass slides.9 Referred to as ‘the third pending revolution in pathology’,10 the benefits of DP as a potential solution to long-term workforce issues and the quality benefits are well described.9 11 DP represents an attractive option to increase resilience within often small and highly specialised teams, as well as departments, pathology networks and across the NHS. It can enable pathologists who are shielding or in self-isolation to continue to participate remotely in diagnostic services. In our practice, we have seen real-time solutions to workforce issues due to COVID-19.5 For example, digital double reporting and reducing transmission risk to remaining pathologists when several team members are in isolation. Pathologists who were previously reluctant to transition to DP are now supportive of fast adoption of the technology and in many cases, are the ones championing their way through the process. Within a wider context, several External Quality Assurance schemes are moving to full digitisation and removing glass slide circulations.

DP with entirely digital workflows including scanned request forms enables secure efficient remote working solutions, avoiding the need to transport glass slides and the inherent logistical problems and data governance risk this poses. Digital has health and safety benefits, with no physical movement of slides, avoiding potential for damage or (within this current crisis) infection transmission.

Reported time efficiency savings with DP12 13 will be important if labs are to cope with an anticipated backlog of cases due to deferment of surgery during this crisis period. Although the potential efficiencies are only likely to be realised with full digital deployments, smaller deployments of technology can provide solutions to specific problems to enable service continuity or may work for particular teams within a department without digitisation of the entire department. DP opens the door to other ways of reorganising work such as outsourcing cases to well-staffed departments and facilitating access to expert opinion, with some of these expert pathologists reporting from home. Frozen section diagnosis is another specific solution that can be provided by DP remotely. Seemingly overnight, healthcare institutions have rapidly adapted to this crisis, bringing in technologies such as video conferencing to allow team meetings and multidisciplinary team (MDT) or tumour board meetings. And thus, while the advice remains to work at home if at all possible, it would seem that there is little that the surgical pathologist would need to attend the hospital for, beyond cut up—and this can in many circumstances be undertaken by biomedical scientists.

With digitisation, the ability to run AI tools that can support pathologists by pre-screening, expediting workflow or providing a double check of the case is starting to become a reality.14 There are several AI tools on the ‘roadmap’ to full diagnostic use and some have regulatory clearance for such use, for example, in prostate cancer detection.15 With further evidence, AI could provide double reporting such as has been outlined as a possibility in mammography screening,16 providing resilience to services when pathologists are not available, and creating further efficiency gains. Collation of evidence to support and validate such tools does however require a digital workflow, and pathologists with time and facility to support such validation processes and integration of such tools into the routine pathology workflow.

Professional bodies play a key role in revisiting guidance and issuing urgent situation specific guidance. The Royal College of Pathologists issued ‘Guidance for remote reporting of DP slides during periods of exceptional service pressure’ in March 2020.17 This has described a risk mitigation approach to support temporary remote reporting with DP in this time of clinical and service necessity. The risk mitigation approach describes that primary diagnosis, double reporting, MDT review or quick review to determine if additional tests are needed each entail a different level of risk. And this needs to be considered alongside pathologist confidence and whether they been through formal DP validation. The College of American Pathologists have issued remote sign out guidance, including the use of digital platforms and concluded that remote working would ensure pathologist’s professional interpretations and diagnoses would continue during the crisis. Denying remote access to expert pathologists to provide the most accurate diagnoses would have potentially serious repercussions long after the current crisis.18

Digital pathology and research

Many of the described advantages around flexibility and resilience in DP also apply to research and clinical trials.19 Restrictions to the research environment have been experienced during the COVID-19 pandemic. Standard of care guidelines have changed, limiting availability of samples and sample types for research. This affects not just cancer research, but any type of research where patients or samples are needed. Transplantation research, for example, may be disrupted by travel restrictions.6 The previous push for formalin free theatres to increase the availability of fresh samples for DNA/RNA/whole genome sequencing is now extremely challenging in view of the potential infection risk associated with the collection and processing of fresh tissue. While to date there are no reports of laboratory-acquired infection with SARS-CoV-2, this has been previously reported with SARS-CoV, although only in those labs in which the virus is propagated.20 Several guidance documents are now available addressing the handling of fresh or unfixed histopathological specimens using a risk-based approach to samples, including that which been published by Public Health England.20

Researchers who would normally use fresh or fresh frozen material may therefore have to defer to using formalin-fixed paraffin-embedded material where virus is thought to be inactivated and fixation may need to be prolonged, further damaging DNA. This may be less optimal, for example, in whole genome sequencing where high quality nuclear acids are required. Biobanking has looked quite different during the COVID-19 pandemic in some instances,21 for example face-to-face consenting, the previous norm, often replaced with remote consent procedures such as over the telephone with virtual signature.

Several research articles covering the interplay between cancer and COVID-19 have been published, many from China and Italy, and they focus mainly on four areas: the effect of cancer therapy in COVID-19, epidemiological/clinical/radiological/pathological features, outcomes of patients with cancer with COVID-19 and strategies for risk reduction and management.22 According to an analysis of 355 Italian patients, 20% of those who died from COVID-19 had active cancer.23 However overall, further evidence for the effect of COVID-19 on patients with cancer are needed.24 Pathologists are key here in helping to describe the changes in this essentially new disease and DP enables cases to be shared with the leading experts in the field.25–27 The Worldwide DP Alliance has established a global resource of postmortem whole slide images aimed at supporting understanding of the pathology of this new disease and accelerating access to samples for research.28 There are also new online image repositories being established by the National Institutes of Health and RCPath.29 30

As cohorts build, existing expertise in AI can be repurposed to search for novel features. As these resources grow to the cohort sizes usually associated with AI, they will become extremely valuable. Setting these resources up and ensuring the appropriate governance and data sharing arrangements are in place may pave the way for future joined up working and the potential reduction in ‘wastage’ of research resources. Given the impact that post-mortem research had in the previous SARS Co-V pandemic31 this concept of DP/AI facilitating the use of material for research purposes is important and may go some way to addressing the current concerns of autopsies not playing a vital role in COVID-19 research.32

AI lends itself well to interpretation of immuno-oncology sections stained for multiple immune markers either on serial sections or by multiplex technology, establishing novel insights into cell subpopulation densities and topographical relationships between cells and other structures. This kind of expertise can be quickly repurposed to support similar studies of immune populations in COVID-19.33 34 Another example of the redeployment of AI expertise is the use of machine learning to improve the efficiency of COVID-19 testing, ensuring optimal use of resources.35

We have seen the disruptive effect of the COVID-19 pandemic on clinical trials, with immediate and delayed consequences. Clinical trial staff have in many cases been redeployed to other clinical areas and many clinical trials have been suspended to recruitment with trials into COVID-19 being prioritised. There has been disruption to almost every aspect of trial process, which may require protocol deviations. Examples include, the inability to conduct participant protocol-mandated visits, staff training, site monitoring visits and interruptions to supply chains of drugs. These interruptions may result in overall delays to trial delivery and drug development and COVID-19 deaths may potentially disrupt the endpoints of trials. Urgent guidance has been issued by the US Food and Drug Administration and the European Medicines Agency on clinical trial conduct during the pandemic.36 37

Clinical trials may be more heavily affected by COVID-19 in particular settings, for example in some areas of oncology practice. In haematology oncology, patients are often immunosuppressed due to illness or treatment or both and are highly susceptible to severe complications if infected with COVID-1938 leading to a serious and disruptive effect on haematology oncology trials.24 Patients with lung cancer represent another highly vulnerable group as other pre-existing pulmonary diseases such as chronic obstructive pulmonary disease, cardiovascular disease and old age contribute to the effects of the virus.38 The effects on immunotherapy trials and the complex potential interplay between such agents and COVID-19 is currently the subject of debate.39

As pathologists, we deliver and support clinical trials, and quality assurance of the pathology input is key to assessing baseline tests and endpoints. Quality is determined by setting up study specific pathology working groups, training and standardisation events and double/central reporting of parameters.40 All of these are now logistically challenging, but this is where DP provides a timely opportunity to enable these to continue remotely and may accelerate the move towards this model of working in the future.41 Other vital clinical trial activities such as block selection can be easily done remotely by DP. Trial monitoring by regulators could also still be enabled although data sharing restrictions may apply. We should expedite opportunities to use AI to assess trial endpoints. AI makes better use of pathologists’ time and standardises assessments, such as scoring or grading that might traditionally have been undertaken by pathologists with inherent problems of human observer subjectivity.

The availability of tissue samples on which to assess exploratory trial endpoints may be reduced by optional study-specific biopsies not being undertaken. Logistical challenges around different geographic locations, for example, the use of COVID-19 free cancer hubs or clinical trial sites being unavailable may mean that alternative laboratories may be analysing samples. If this occurs, DP presents an opportunity to move images around to the relevant trial pathologists with the necessary expertise or to enable AI interpretation. This ensures standardisation of baseline tests such as biomarker test for entry, or interpretation of primary or secondary endpoints.

Digital pathology and education

Another important application of DP that can be exploited at this time is in the maintenance of education and training. With consultant histopathologists encouraged to work remotely, it is easy to imagine that those in training may consequently find it more challenging to review clinical cases with a consultant, potentially impacting on training opportunities. The importance of this has been noted by other recent authors42 who identify DP as a means of access to clinical cases for continued training of pathologists during this period. Indeed, this is the case within our own practice whereby face-to-face contact with our trainees has significantly reduced outside of the cut-up room. We have found that DP is of benefit in this setting, with trainees able to access digitally and discuss cases remotely with supervisors, either live through screen sharing on a secure videoconferencing facility, on the telephone, or through email exchange, with trainees and consultants annotating or manipulating digital slides live. One suspects that contrary to expectations of this having a negative impact on learning, that being able to focus very specifically on certain annotated details may actually improve the educational value of reviewing cases. Dedicated teaching sessions have been undertaken by our teams through the use of secure videoconferencing facilities, opening the opportunity to teach across departments, and to reach out to those unable to attend the workplace. While these measures show great potential, we must be mindful of the potential impact on training that working remotely may have and as trainers we need to consider ways to fully include trainees in our daily working patterns.

Challenges

While the benefits of DP are apparent, the challenges are not insignificant. In addition to logistical challenges of setting up digital pathology services within the diagnostic laboratory, there are challenges further down the line with the development and exploitation of ancillary tools such as AI. These include the regulatory path to use of AI, public perception of data sharing, and the many technological challenges, including lack of a standard image format. We must learn lessons from other healthcare settings, build trust in these new technologies and encourage routine adoption. For example, video consultations have been adopted by hospital doctors and general practitioners to reduce face-to-face interactions,43 but several factors have had to be considered in order to scale this technology such as improved dependability and reasonable cost.43 Reported issues which delay uptake in this setting include inappropriate platforms with potential for data breaches and lack of bandwidth. It must be clear that change cannot be achieved by simply deploying technology. We are introducing and sustaining major changes to a complex system, which we need to acknowledge is often difficult, can be resource intensive and needs to be championed by respected opinion leaders.43

We should also share experience with our colleagues working with other applications of AI in medical sciences, for example, the imaging community who have been working with AI longer than those in the pathology community. AI has, for example, been used in radiology in order to diagnose chest X-ray images as COVID-19 with an overall accuracy of 89.6% when compared with normal or pneumonia (bacterial or viral)44 and quantify opacification on lung CT in order to determine clinical severity of COVID-19.45

Conclusion

We have described the great potential of digital technologies in pathology, and how DP can provide immediate solutions to service delivery, research, clinical trial and training issues in a pandemic crisis. With no instant exit from the current measures that are in place to reduce transmission of COVID-19, DP is likely to continue to prove its worth in providing the necessary flexibility and resilience for cellular pathology. Pathology networks and academic departments should be encouraged to evaluate where the technology fits into their contingency plans. Although adoption of such technology was already being encouraged, COVID-19 has fortuitously pushed DP into the spotlight. Moreover, we can learn from the implementation of DP in these settings during this acute crisis, to allow us to identify and champion its value, and to recognise any potential pitfalls, and with the necessary ‘hoops’ to implementation in these settings already resolved. The COVID-19 crisis has actually given us an opportunity to take advantage of providing, as with other aspects of healthcare, a catalyst to reorganise dated working practices within pathology, embracing the advantages technological advancements provide to deliver safer and more efficient services. However, let us not forget that the vast majority of cellular departments in the UK have limited or no access to this technology for diagnostic purposes.46 Now is the time to realise the potential of DP and for us to call for more investment in this technology. This should not only be investment in intradepartmental infrastructure but technological and infrastructural support for pathologists at home.

Take home messages

  • The measures to control the COVID-19 outbreak will likely remain a feature of our working lives until a suitable vaccine or treatment is found.

  • Digital pathology (DP) is seen as a key tool to enable more efficient use of the current workforce and digital enabled care is a core component of the National Health Service (NHS) long term plan.

  • Digital pathology and artificial intelligence can play a key role to safeguarding clinical services, training and pathology-based research in the current climate and in the future.

Ethics statements

Ethics approval

PathLAKE is a Research Ethics Committee (REC) approved research database, reference 19/SC/0363.

Acknowledgments

CV and LB are part funded by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

References

Footnotes

  • Handling editor Runjan Chetty.

  • Contributors All authors were involved in writing the paper and had final approval of the submitted and published versions.

  • Funding This paper is supported by the PathLAKE Centre of Excellence for digital pathology and artificial intelligence which is funded from the Data to Early Diagnosis and Precision Medicine strand of the government’s Industrial Strategy Challenge Fund, managed and delivered by Innovate UK on behalf of UK Research and Innovation (UKRI).Views expressed are those of the authors and not necessarily those of the PathLAKE Consortium members, the NHS, Innovate UK or UKRI. Grant ref: File Ref 104689 / application number 18181. All authors are members of the PathLAKE consortium. CV and LB receive research support from the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) Molecular Diagnostics Theme.

  • Competing interests PathLAKE is one of the UK Government’s 5 AI Centres of Excellence and has received in kind industry investment from Philips for digital pathology equipment, software and other services. All authors are part of the consortium. JR is a cofounder of Ground Truth Labs.

  • Provenance and peer review Not commissioned; internally peer reviewed.