2. The Fundamentals of Artificial Intelligence and Machine Learning
This section offers a journey through complex developments of AI and ML, sketching their historical trajectory and explaining the distinctive yet interconnected terminologies of AI, ML, and Deep Learning (DL). It also sheds light on the key ML algorithms and techniques that have shaped the technological landscape, underscoring the indelible imprint they have left on it.
2.1. Chronicle of Artificial Intelligence: Milestones and Breakthroughs
The compelling development of AI, spanning from antiquity—marked by folklore and tales of artificial beings—to the current era of sophisticated AI systems, has roots in the philosophical depictions of human cognition as a mechanistic process (
Figure 21). The inception of modern AI concepts is largely accredited to the development of the programmable digital computer in the 1940s, reaching a milestone with the field’s official establishment at the 1956 Dartmouth Conference
[23][7].
Figure 21.
Significant milestones in the evolution of artificial intelligence.
The 1970s saw a significant leap forward with the emergence of rule-based expert systems like MYCIN, a seminal creation by Buchanan and Shortliffe
[23,24][7][8]. These expert systems, designed to replicate human expertise by leveraging knowledge bases and inference engines, laid the foundation for AI’s influential role in medical diagnosis and clinical decision-making.
Machine learning algorithms, which surfaced in subsequent years, spearheaded a novel paradigm for data-driven predictions and classification. Decision trees introduced in 1986, support vector machines in 1995, and neural networks in 1986, collectively broadened the AI horizon in healthcare
[25,26,27][9][10][11]. These algorithms propelled the analysis of extensive datasets, thereby inaugurating a novel epoch of pattern recognition and predictive modelling in healthcare.
The turn of the century witnessed a paradigm shift with the advent of deep learning approaches, particularly convolutional neural networks (CNNs). Surpassing previous methodologies in image recognition tasks, CNNs, architecturally modelled on structure and function of the human brain, precipitated major advancements in medical image classification, segmentation, and detection, due to their capacity to learn hierarchical representations from vast amounts of labelled data
[28,29][12][13].
The accelerated progression of AI in recent years is a by-product of the synergistic interplay of two factors: the surge in big data and advancements in computational power. The widespread dissemination of electronic health records (EHRs), medical imaging archives, and annotated datasets provide ample training data, while progress in hardware, including graphical processing units (GPUs) and distributed computing, have expedited the deployment of computationally demanding AI algorithms
[30][14].
The rapid advancement of AI language models, such as GPT-4, has led to unique applications and implications across a multitude of discplines, including healthcare and medical imaging
[31][15]. These models, whilst capable of generating human-like text and facilitating communication, have raised salient concerns. The potential for these models to contribute substantially to medical research and patient care is undeniable; however, experts express reservations about their limitations and potential to inadvertently engender inequities or disseminate misinformation, thus emphasising the need for robust strategies to manage these risks responsibly. These strategies include increasing transparency about potential harms, promoting early detection of issues, and implementing regulatory measures and peer reviews
[32][16]. By doing so, the goal is to ensure that AI technologies, including language models, are utilised optimally and ethically, contributing positively to medical imaging and healthcare outcomes.
The intertwining of rule-based systems, traditional machine learning algorithms, and the transformative influence of deep learning techniques has laid the foundation for the current state-of-the-art AI applications in radiology and other medical specialties.
2.2. Decoding the Terminology: AI, ML, and DL
The computational intelligence landscape is an expansive system, constituted of distinct yet interconnected systems, with each sector playing a specific role and interacts uniquely within the data science sphere (
Figure 32).
Artificial intelligence is defined as the replication of human intelligence in machines that are programmed to emulate human cognition and actions, encompassing learning, problem-solving, reasoning, and perception. AI can be classified into two major types: narrow AI, which is designed for specific tasks (e.g., facial recognition or voice commands), and general AI, which mimics a broader spectrum of human intellect. AI aims to develop systems with autonomous intelligent functionality, capable of problem-solving, decision-making, and performing tasks typically requiring human intelligence
[33][17].
Machine learning, a subset of AI, is centred around the development of software that learns autonomously from accessed data. The learning process is derived from the analysis of observations or data to identify patterns and make informed future decisions based on these observations. Its fundamental objective is to enable computers to adapt their actions autonomously without human intervention. The primary categories of ML algorithms are supervised learning, which predicts or classifies new data based on examples, and unsupervised learning, which identifies inherent patterns and structures within the data without guidance from pre-established outputs
[34][18].
Deep learning, an ML subset, utilises multilayered artificial neural networks (aptly coined “deep”), enabling DL algorithms to model and understand complex data patterns. These algorithms are especially effective for tasks where manual feature extraction proves challenging, such as image or speech recognition. It is noteworthy that these feature layers are data-learned, not human-engineered, embodying an architecture inspired by the human brain and have proven successful in visual recognition tasks, even outperforming human performance
[28][12].
Recognising the nuanced interrelationships between AI, ML, and DL aids in conceptualising each subfield’s contribution and progression within the broader AI narrative. AI lays the foundation for ML and DL. ML amplifies AI’s potential by enabling machine data learning, and DL further deepens these capabilities with neural networks that decipher complex data patterns. Each field enriches the wider AI domain, culminating in the modern AI landscape where each layer contributes to the evolution of intelligent systems.
Figure 32. Schematic illustration of artificial intelligence and machine learning frameworks [35]. Schematic illustration of artificial intelligence and machine learning frameworks [19].
2.3. Machine Learning Foundations: Algorithms and Techniques
Machine learning is anchored by a plethora of algorithms and techniques that enable computers to learn from data. The two primary types of machine learning, supervised and unsupervised learning, lie at the heart of this field.
Supervised learning, a dominant machine learning variant, harnesses pre-established examples or training data, consisting of input-output pairs. The objective is to formulate a function that maps input data to corresponding outputs, enabling accurate predictions or classifications for unfamiliar data. Central to supervised learning are algorithms such as linear regression, logistic regression, and decision trees
[36][20].
In contrast, unsupervised learning navigates the data space autonomously to uncover inherent patterns, structures, or relationships devoid of predefined outputs. Its focus is on discovering intrinsic data structures, thus offering insights that could potentially solve complex problems. Notable unsupervised learning algorithms include clustering techniques like k-means, hierarchical clustering, and dimensionality reduction methods such as principal component analysis (PCA)
[37][21].
Artificial Neural Networks (ANNs) simulate the operational framework of the human brain, executing intricate tasks via a network of interconnected artificial neurons arranged in layers. The backpropagation algorithm, a vital cog in ANN operations, exhibits high fault tolerance, ensuring the system’s functionality despite occasional neuronal failures
[38][22]. ANNs facilitate feature extraction and sophisticated pattern recognition, crucial for machine learning, which enhance data representation or class differentiation by aiding raw data pre-processing for feature extraction or selection
[39][23].
Developments in ANNs have given rise to complex structures like deep learning models comprising multilayer neurons. Notably, CNNs employ convolution in lieu of standard matrix multiplication in certain layers. Tailored for processing pixel data, CNNs excel in tasks related to pattern recognition in images, audio, or text, substantially contributing to computer vision and Natural Language Processing (NLP) by simplifying complex patterns into abstract representations through layers of features
[40][24].
3. Integrating AI into Medical Imaging: The Dawn of Radiology 2.0
This section delves into the remarkable role of AI within medical imaging, spotlighting the revolutionary shifts it catalyses in the world of radiology. Its multifaceted potential, from revolutionising image acquisition to reshaping radiological analyses, and from streamlining reporting to crafting personalised medical narratives, positions AI at the epicentre of the ongoing healthcare revolution. Beyond radiology, this transformation extends to other areas of healthcare—such as pathology, cardiology, genomics, drug discovery, and healthcare delivery—where the impactful strides of AI are being increasingly recognised. Concluding this exploration is the emergent paradigm of AI-facilitated personalised medicine, underscoring a more proactive, patient-oriented, and holistic patient care approach.
3.1. A Paradigm Shift in Radiology
AI has instigated a profound metamorphosis in the field of radiology, redefining traditional workflows and elevating the radiologist’s role (
Figure 43). In the realm of image acquisition, AI augments scanning procedures, optimises image fidelity, and fosters sophisticated image reconstruction across MRI, CT, and PET modalities. Foremost among these advancements, deep learning accelerates MRI scanning, harmonising efficiency and quality, with commensurate progress witnessed in CT and PET image reconstruction
[41][25].
Figure 43.
A streamlined workflow diagram illustrating the role of artificial intelligence in radiological practice.
AI significantly streamlines the acquisition of radiologist analyses on chest X-rays, as evidenced by a study wherein an AI system reduced interpretation delivery times from 11.2 days to a mere 2.7 days, reinforcing the potency of automated triaging systems in streamlining healthcare workflows and amplifying patient care standards
[42][26].
As one of the pioneering healthcare specialties to adopt digital technology, radiology has capitalised on machine learning in CAD tools for over two decades, demonstrating robust performance in sensitivity and specificity
[43][27]. Although clinical adoption has been slow due to various challenges, AI is posited as a pivotal tool to surmount these, enhancing CAD performance, streamlining radiology services, and fostering the development of integrated diagnostic services.
The integration of AI into radiology reporting has structured and annotated data to bolster report uniformity and streamlining patient history tracking. These cutting-edge tools generate comprehensive task lists, incorporating pertinent information from the patient’s history into EHRs, with the prime objective of enhancing report accessibility and integration into care pathways
[44][28].
Beyond AI’s transformative influence on reporting and imaging procedures, these state-of-the-art systems play a pivotal role in maintaining continuity in provider communication and patient care, validating correlations between imaging diagnoses, radiological reports, and treatment plans, alerting providers to any discrepancies. Moreover, AI optimises personnel allocation and scanner usage and reduces radiation exposure, thereby boosting efficiency and quality of care
[45][29]. By virtue of its broad-spectrum capabilities, AI is redefining the landscape of radiology, cementing its indispensable status within the discipline.
3.2. Beyond Radiology: Broader Applications of AI in Healthcare
AI has indelibly altered several healthcare areas, demonstrating its capability to enhance clinical practice beyond radiology via improvements in diagnostics, genomics, drug discovery, and healthcare delivery optimisation.
Pathology has witnessed the successful application of AI algorithms in tissue analysis, markedly enhancing diagnostic accuracy and speed. Automated image analysis tools enable pathologists to scrutinise tissues microscopically, identifying subtle histopathological attributes often overlooked by the human eye
[46][30]. AI also accelerates the move towards digital pathology, converting traditional glass slides into digital scans for remote diagnostics and collaborative work—both of which are vital in the digital age of telemedicine
[47][31].
AI shows considerable promise in cardiology, particularly in interpreting electrocardiograms and echocardiograms. Sophisticated ML algorithms detect complex cardiac patterns and abnormalities, accurately predicting conditions such as atrial fibrillation and myocardial infarction
[48][32]. Its exponential growth in echocardiography is evident, with automated algorithms aiding in the interpretation of cardiac structure parameters, mitigating interobserver variability, and enhancing diagnostic precision
[49][33].
The complex nature of genomics renders it an ideal candidate for AI intervention. DL techniques decipher genomic data, aiding in identifying genetic variants linked to disease susceptibility, and opening avenues for tailored treatment strategies based on individual genetic profiles
[50][34].
AI has proven invaluable in the field of drug discovery by expediting the search for potent therapeutic compounds, and subsequently, accelerating the drug development process. For example, AI can predict the pharmacokinetic and pharmacodynamic properties of novel compounds, pinpoint potential drug targets, and simulate clinical trials, substantially reducing both time and costs associated with drug development
[51][35].
Additionally, AI’s ability to optimise healthcare delivery is remarkable. AI-driven predictive analytics can enhance hospital workflows, accurately predicting patient admission rates, and optimising resource allocation
[52][36]. AI applications in cost reduction have also emerged, with machine learning algorithms identifying inefficiencies in healthcare systems, thus enabling cost-effective care (SHAH 2021). The overarching aim of these AI applications is to improve patient outcomes by streamlining diagnostic processes and personalising treatment plans.
3.3. A New Era of Personalised Medicine
AI has catalysed a paradigm shift in the arena of personalised medicine. With its unparalleled capacity for processing vast amounts of complex data, AI is broadening the scope of personalised medicine, venturing into previously uncharted territories.
One of the most significant contributions of AI to personalised medicine is its potential to unlock the treasure trove of information embedded in EHRs. By harnessing the power of advanced machine learning algorithms, AI can discern patterns within EHRs, which can provide critical insights into specific disease states or risk factors. This process enables a proactive approach to patient care, allowing healthcare providers to foresee potential health risks and intervene accordingly
[4]. In a landmark study by Rajkomar et al. (2018), AI was successfully utilised to predict medical events using data from EHRs, underlining its instrumental role in preventative medicine
[53][37].
By integrating various sources of patient data—ranging from medical imaging and EHRs to genomic data—AI enables a more holistic approach to healthcare. This unification allows for personalised treatment plans, precise disease risk prediction, and improved monitoring of treatment responses. AI systems also enhance clinical decision-making by harmonising patient-specific data with up-to-date scientific discoveries, generating clinically relevant recommendations
[54][38]. However, it is vital to ensure that AI’s implementation is patient-centric and ethical considerations such as data privacy, security, and algorithmic bias are rigorously adhered to. This vigilance guarantees the equitable application of AI technologies, respecting the rights and needs of all patients
[4].
In conclusion, AI is shaping a new era of truly personalised patient care. However, it is paramount to acknowledge the necessity for continuous research and meticulous validation to ensure the safe and effective deployment of AI in healthcare. Multidisciplinary collaborations, involving specialists from AI, radiology, genomics, and clinical practice, are crucial for fine-tuning AI-driven models and technologies. Such partnerships will help maximise the potential benefits of AI, leading to enhanced patient outcomes and propelling the field of medicine into the future.
4. Practical Applications of AI in Radiology Practice
This section critically examines the practical applications of AI in the field of radiology, elaborating on the novel approaches it brings to imaging techniques, diagnosis, and patient care. By navigating through AI-driven methodologies like DL and CNNs, the section illuminates how AI is redefining the way image segmentation and classification, and diagnostics are conducted. Moreover, it explores the prognostic power of radiomics and predictive potential of AI in optimising workflows. Throughout the discourse, the section also confronts the inherent challenges and bottlenecks in the integration of AI within radiology, underpinning the critical need for interpretability, validation, standardisation, and the need to preserve the human element in healthcare.
4.1. Image Segmentation and Classification
DL has ignited a significant shift within radiology that is particularly noticeable in the domains of image segmentation and classification, where substantial strides have been made. The advancements brought about by these AI-centric methods have amplified the precision and speed of diagnosis, thereby amplifying the competency of radiologists and raising the bar of patient care. Nevertheless, the assimilation of AI brings about numerous challenges that need to be overcome to facilitate its optimal integration and application within radiology.
CNNs, given their inherent ability to learn complex patterns through backpropagation, have emerged as formidable tools for computational visual tasks, including various radiological applications. Their distinct architectural layers, from calculations in convolutional layers to the generation of predictions in fully connected layers, all converge to form a proficient object detection system. These networks have demonstrated remarkable proficiency in object detection tasks, thanks to their integrated capabilities of feature extraction, semantic segmentation, and the handling of multi-scale features. The efficiency and effectiveness of CNNs can be further amplified through the application of transfer learning, which allows for the reuse of pre-existing models. This, in turn, enhances accuracy, facilitates efficient training even with limited datasets, and minimises the need for labour-intensive and error-prone manual segmentation
[40,55][24][39].
Illustrating CNNs’ potential, the segmentation of lung nodules from CT scans using AI has shown superior performance in the early detection and treatment of lung cancer, achieving an area under the receiver operating characteristic curve (AUROC) of 94.4% and outperforming six radiologists in the task
[56][40]. Similarly, CNNs have played a pivotal role in the segmentation of brain tumours from MRI scans and the analysis of retinal images for early symptoms of diabetic retinopathy, further underlining AI’s broad applicability and versatility of AI in the sphere of medical imaging
[40,55][24][39].
Image classification, an equally critical application of AI in radiology, leverages CNNs to differentiate between normal and pathological findings. AI models have been engineered to distinguish between benign and malignant tumours in mammography, achieving performance metrics comparable to human radiologists, thus facilitating early detection of breast cancer
[57][41].
Notwithstanding these significant strides, integrating AI within radiology invites a suite of challenges that need to be addressed. The construction of robust and reliable AI models necessitates access to extensive datasets and thorough validation, both of which can be challenging due to privacy concerns and the heterogeneous nature of medical imaging data. Second, ensuring the interpretability and explicability of the “black-box” dilemma in deep learning models is paramount to garner trust and adoption from both radiologists and patients. Lastly, integrating AI into existing clinical workflows and fostering a harmonious human-AI collaboration are essential to fully realise the potential of AI in radiology and translate these technological advances into tangible enhancements in patient care.
4.2. Advancing Diagnostics with AI and CAD Systems
The third wave of AI, notably the integration of deep learning technology into CAD systems, has propelled radiology into a digital era. The emergence of AI-integrated CAD (AI-CAD) systems has revolutionised radiology services, underpinning transformative changes in the landscape of diagnostics. These systems have redefined how radiologists interpret images, increasing diagnostic accuracy, reducing false positives, and significantly improving workflow efficiencies.
AI-CAD systems’ merit lies in their substantial reduction of false positives, enhancing dependability in clinical settings. This is corroborated by a study comparing AI-CAD and traditional CAD software, where the AI system outperformed by decreasing the false-positive marks per image (FPPI) by a significant 69%. It specifically excelled in identifying microcalcifications and masses, reducing false positives by 83% and 56% respectively. Such reductions optimise radiologists’ efficiency, potentially cutting their case reading time by an estimated 17%, and mitigate socioeconomic issues like patients’ unnecessary emotional stress and financial burden
[58][42].
Employing ensemble learning methodologies can hone CAD systems further, as evidenced by a recent study deploying a calibrated ensemble of deep learners for the task of detecting abnormalities in musculoskeletal radiographs. This ensemble model excelled over individual models, even outperforming expert radiologists in three out of the seven upper extremity anatomical regions (with an AUC of 0.93, Accuracy of 0.87, and Precision of 0.93). These results lend compelling support to the utility of the calibrated ensemble approach in identifying abnormalities in musculoskeletal X-rays
[59][43].
AI has also shown remarkable promise in equalling, and in some cases surpassing, the performance of radiologists in breast screening through the deployment of AI algorithms for automated patient triage and predicting treatment outcomes—tasks that extend beyond human capabilities
[60][44]. However, to fully exploit the benefits of AI in routine breast imaging fully, there’s a need to ensure sufficient data availability for testing and monitoring AI algorithms pre and post-integration into healthcare systems
[60][44]. Yet, the dawn of a new AI epoch has presented a promising avenue that is anticipated to spur the next major transformation in radiology: the growth of radiomics—a field seeking to unify data from radiology, pathology, and genomics to offer a comprehensive diagnostic service
[20][45].
4.3. Prognostics with Radiomics and Predictive Analytics
Radiomics is an emerging field within medicine, predicated on the extraction of high-dimensional data from radiological images and harbours immense potential for the landscape of medical diagnostics, prognosis, and the evaluation of disease response to treatment. However, radiomics still faces challenges, including the need for standardisation and validation to ensure reliable and reproducible outcomes. The main strength of radiomics lies in its ability to complement traditional clinical practice with precise, quantitative information, thereby revolutionising medical decision-making processes
[61][46].
The rapid exponential growth of medical imaging data has fostered a conducive environment for the application of ML and data-driven science. Radiomics-based decision-support systems for precision diagnosis and treatment are poised to become integral tools in the armamentarium of modern medicine. This, however, is not to say that the journey of radiomics towards full clinical applicability is without challenges. The field currently grapples with a lack of standardisation and validation that are quintessential for ensuring reliable and reproducible outcomes
[61,62][46][47].
In this milieu, the advent of AI presents promising avenues for overcoming these challenges and unlocking the full potential of radiomics. Through modelling high-dimensional data, AI-driven analytics enable accurate predictions pertaining to disease progression, treatment response, or patient survival. This significant stride offers clinicians an unprecedented wealth of information that vastly transcends the limitations of human perception. Particularly within oncology, radiomics has proven instrumental in identifying molecular phenotypes and lymph node metastases, appraising treatment response, and prognosticating disease survival
[61][46].
It is crucial to acknowledge that the amalgamation of AI into radiomics remains in its infancy. To fully harness its potential in medical imaging, a concerted effort towards research and development is crucial. A key facet of this development will be the facilitation of large-scale data sharing, the establishment of standardised data collection protocols, clear evaluation criteria, and robust reporting guidelines. These elements are fundamental to the maturation and widespread adoption of radiomics as a discipline, opening the door to a new era of precision medicine.
4.4. Workflow Optimisation Using AI
AI is gaining traction in radiology, aiming to optimise workflows and enhance non-interpretative tasks’ efficacy. When coupled with NLP, AI can automate the triage of imaging studies, prioritising urgent cases based on the retrieval and analysis of key data from patients’ EHR. This expedites patient triage, radiology reporting, and managing incidental finding follow-ups
[20][45].
AI significantly enhances the radiology process by automating triage and improving report generation. It swiftly sorts and prioritises radiological studies like CT scans and MRIs based on urgency, highlighting critical cases for immediate review. This automation aids in consistently detecting severe conditions such as stroke, haemorrhage, and malignancy, reducing errors. The use of AI, particularly NLP, in non-interpretative tasks alleviates tedious aspects of the workflow, potentially mitigating radiologist burnout
[4].
Furthermore, AI enhances the generation and interpretation of radiology reports. Deep Learning algorithms address the limitations of traditional reporting, including fatigue-induced errors or inconsistencies due to varied expertise levels. They detect and characterise findings to improve consistency, facilitate standardised report creation, and reduce errors. This additional analysis layer streamlines the workflow and augments report clarity, significantly contributing to the quality of radiology services
[63][48].
The incorporation of AI transcends the limits of purely diagnostic capabilities, profoundly amplifying interdisciplinary collaboration and patient-radiologist communication. AI platforms serve as a vital conduit that nurtures a collective understanding of imaging results among disparate healthcare professionals as they possess the potential to demystify the complexity of medical terminologies for patients. This transparency aids in establishing a strong rapport between the patient and the radiologist while also cultivating a higher degree of patient involvement in their personal health
[61][46].
As strides are made towards AI integration in radiology, it’s crucial to recognise that as of 2021, only 30% of radiologists reported clinical AI use, with over 70% expressing reluctance to invest in AI. Many perceived AI as offering negligible benefits, hinting at the field of radiology being in the “trough of disillusionment” phase in the AI adoption process
[64][49]. This disillusionment emanates from factors such as scepticism about AI performance and applicability, a perceived lack of necessity, inadequate workflows for efficient AI utilisation, and a dearth of scalable AI-supporting infrastructure.
To transition into the “slope of enlightenment”, the field must establish infrastructure that supports optimal AI functionality, involving the redefinition and disruption of existing systems such as image management and PACS for intelligent workflow orchestration
[65][50]. Notwithstanding AI’s potential, the importance of preserving the human element in patient care cannot be overstated, underlining that while AI can augment the work of radiologists, it is not a substitute for the nuanced judgement and empathetic communication that are at the heart of patient care.