Automated Blood Vessel Detection in Cancer: Comparison
Please note this is a comparison between Version 1 by Anatoly Shekhter and Version 2 by Rita Xu.

The analysis of the microvasculature and the assessment of angiogenesis have significant prognostic value in various diseases, including cancer. The search for invasion into the blood and lymphatic vessels and the assessment of angiogenesis are important aspects of oncological diagnosis. These features determine the prognosis and aggressiveness of the tumor. Traditional manual evaluation methods are time consuming and subject to inter-observer variability. Blood vessel detection is a perfect task for artificial intelligence, which is capable of rapid analyzing thousands of tissue structures in whole slide images.

  • artificial intelligence
  • cancer
  • blood vessel detection
  • digital pathology
  • computational pathology

1. Introduction

Histopathological examination of tissue samples, particularly histological slides, is a critical component of diagnosing and understanding the biological behavior of various malignancies. One of the most significant aspects of histopathological analysis is the evaluation of blood vessels, which play a crucial role in tumor growth, metastasis and response to treatment [1]. Blood vessels within and surrounding the tumor microenvironment contribute to the delivery of essential nutrients and oxygen, facilitating tumor growth and progression. Furthermore, they serve as a route for cancer cells to disseminate from the primary tumor to other sites in the body, leading to metastasis [1][2][1,2].
Vascular invasion is indicated as an important prognostic factor in the TNM 8 classification and is present in the College of American Pathologists (CAP) cancer protocol templates [3][4][3,4]. The accurate detection and characterization of blood vessels in histological slides is essential for determining tumor stage, predicting prognosis and guiding treatment decisions. One of the commonly used scoring methods is microvessel density (MVD), which measures the number of blood vessels in each area of the tumor. This can be achieved by staining the tissue sample for markers that are specific to blood vessels, such as CD31 or CD34, and then counting the number of stained areas under a microscope [1][2][1,2]. High MVD generally indicates a high level of angiogenesis and is often associated with more aggressive tumors and poorer prognosis. Methods include counting vessels in ‘hotspots’ under the microscope or quantifying the expression of angiogenic factors such as VEGF (Vascular Endothelial Growth Factor) by immunohistochemistry (IHC). Some anticancer therapies target angiogenesis, aiming to cut off the tumor’s blood supply and starve it of nutrients [4]. The use of IHC markers of the vascular wall makes the process of searching for blood vessels more visual and faster in high-workflow conditions, reducing the number of errors, while also having disadvantages in the form of the high cost of consumables, a long wait time for staining results, and additional skill requirements for laboratory assistants. Blood vessels possess significant prognostic and predictive value, defined by their role in tumor growth and metastasis.
The presence of lymphovascular invasion (LVI), which refers to the infiltration of tumor cells into the lymphatic or blood vessels, is considered an adverse prognostic factor in many malignancies, including breast, lung and gastrointestinal cancers [5]. LVI has been associated with higher rates of lymph node metastasis, increased risk of distant metastasis and poorer overall survival. The search for lymphatic vessels on a stained hematoxylin and eosin (H&E) preparation is more difficult than the search for blood vessels due to their extremely thin walls and the absence of specific IHC markers, but it is extremely important, for example, in breast cancer to assess the risk of lymphatic metastases.
Despite the importance of blood vessel detection and characterization in histological slides, the manual evaluation of these features by pathologists is a time-consuming and labor-intensive process, often prone to inter-observer variability and subjectivity. Moreover, the assessment of blood vessels in histological slides can be challenging due to their complex and heterogeneous morphology, as well as the presence of artifacts and other confounding factors [4]. Automated search for blood vessels and regions of vascular invasion of tumors can provide a fast and reliable solution for optimization of the routine work (Figure 1).
Figure 1. Automated detection of blood vessels makes it possible to investigate a range of morphological features to address clinical problems: (1) recognizing morphological structures and patterns (“Morphology” in the figure stands for blood vessels—arteries and veins); (2) identifying pathological changes in blood vessels (“Pathology” in the figure stands for sclerosis (indicated by arrows)); (3) detection of cancer vascular invasion (the arrow shows tumor cells in the vessel lumen); (4) assessment of the tumor vascularization pattern for the purpose of personalized therapy (“Personalized therapy based on cancer vascularization pattern” stands for microvessel proliferation in the glioblastoma); (5) AI-assisted calculation of prognostic histological biomarkers (“Additional prognostic value” stands for glioblastoma tumor cells palisading (indicated by arrows) around a central necrosis); (6) 3D reconstruction on the cellular level for investigation of tumor growth and its connection to the blood vessel system.

2. Automated Blood Vessel Detection in Cancer

2.1. Breast Cancer

Breast cancer is considered the leading cause of death worldwide among women. The incidence of commonly diagnosed cancers worldwide is 2.26 million cases, or 11.7% [6][35]. The accurate detection and analysis of morphometric features in lymphatic and blood vessel invasion (LBVI) are essential for understanding the progression of breast cancer and predicting lymph node metastases (LNM) [3][4][3,4]. A reliable sign of the vascular invasion of cancer is the presence of tumor cells in the lumen of the vessel. Currently, pathologists, when assessing the presence of vascular invasion of breast cancer cells, adhere to a clear distinction between lymphatic and blood vessels, since invasion in the former represents an increased risk of LNM, and in the latter a worse prognosis for survival and the risk of distant metastases [7][8][9][9,36,37]. Invasion is assessed both on the basis of biopsy specimens and in the surgical material, where the presence of invasion is conditionally designated as LBVI1, and the absence of its reliable signs as LBVI0 [3][4][7][3,4,9]. The morphometric features of LVI can provide important prognostic information that may not be readily apparent through manual assessment [10][11][12][6,38,39]. The expert experience embedded knowledge transfer learning (EEKT) model enables the extraction of these features by segmenting LBVIs in breast cancer histopathological images. The predictive value of morphometric features in LNM also extends to the location of LBVI within the tumor [7][9]. Peritumoral and intratumoral LBVIs have been found to exhibit distinct morphological characteristics, with peritumoral LBVIs being more commonly associated with cancer cell dissemination [7][9]. The EEKT model can quantify the location of LBVIs by calculating the distance between the LBVI center and the tissue center and margin. This information can provide further insight into the biological behavior of breast cancer and the probability of LNM. In a different approach, the problem was solved as a direct detection of pathological LVI regions in whole slide images. The model segmented blood vessels with the presence of tumor cells in lumens lined with endothelial cells. The described model demonstrated the ability to predict the occurrence of LNM in a group of LBVI-positive patients. Currently, the presence of LBVI has been demonstrated to possess high prognostic value in LNM prediction, and is routinely evaluated in combination with category T in TNM8, Ki-67 index, histologic grade (G) and immunophenotype. The model made it possible to obtain additional prognostic value from the shape features of LBVI areas: solidity, short-to-long-side ratio of the minimum rectangle, and LBVI-to- minimum-rectangle-area ratio [7][9]. Another finding of the study was that the count of the LBVI areas did not have the same predictive value as their morphology [7][9]. The use of this model means for the pathologist a quick and accurate search for LVI, helps to increase the efficiency of the work, and reduces the number of errors in the search for an important factor for predicting the disease [12][39]. For the patient, this means the selection of more personalized effective tactics for further observation and treatment [13][20].

2.2. Lung Adenocarcinoma

The combined mortality caused by lung cancer is higher than for any other tumor (worldwide statistics: 1.79 million deaths; 18% incidence of death) [6][35]. In the case of lung cancer, including adenocarcinoma, there is no methodological separation of tumor invasion into lymphatic and blood vessels [14][40]. The assessment of vascular invasion (LV1 in the presence of invasion or LV0 in the absence of it) and microvascular density (MVD) in the tumor is important for the prediction of tumor metastasis and survival in histologic specimens [3][4][3,4]. To speed up the workflow and improve the accuracy of diagnosis, it is necessary to automate the search for vessels with the presence of tumor invasion, as well as the calculation of MVD. The application of AI and deep learning techniques has shown great potential in the analysis of histopathological images for various malignancies, including lung adenocarcinoma [15][16][10,11]. One such approach is the use of CNNs for microvessel detection in hematoxylin and eosin (H&E)-stained images of lung adenocarcinoma tissue [16][11]. This automated method can provide valuable insights into tumor angiogenesis, which plays a critical role in tumor growth, progression and metastasis (Figure 2).
Figure 2. Prognostic impact of the evaluation of lymphovascular invasion in lung cancer.
The use of fully CNNs for microvessel detection has demonstrated promising results. Yi et al. [15][10] developed a fully CNN that could accurately detect microvessels in H&E images of lung adenocarcinoma. The model was trained on a dataset of manually annotated images and was able to generalize well to new, unseen data. By detecting and quantifying the microvessels within the tumor tissue, the model provided valuable information on the tumor’s angiogenic activity, which has been linked to prognosis and treatment response. The model was first trained on whole slide images from the TCGA database, and then the model was tested on micropreparation images of patients from the CHCAMS cohort. Segmentation masks were obtained, in which mainly the lumen of the vessel was captured, often with blood cells, sometimes leading to incorrect results and the identification of all structures with erythrocytes in the lumen (mostly, alveolas) as vessels. To increase the accuracy of the neural network, the algorithm was subsequently tested on micropreparation whole slide images that had additional IHC staining for CD34 (vascular endothelial marker) [15][10]. Despite these advantages, there are some limitations and challenges associated with the use of fully CNNs for microvessel detection in lung adenocarcinoma [15][10]. One key challenge is the inherent heterogeneity of tumor-associated microvessels, which can exhibit a wide range of cellular origins and morphological characteristics. This can make it difficult for the CNN to accurately differentiate between true microvessels and other similar structures, such as lymphatic vessels or stromal clefts [15][10]. To address this issue, further research is needed to improve the model’s ability to recognize and distinguish between different types of vessels and to develop more robust training datasets that capture the full spectrum of microvessel morphologies [15][10]. The fully CNN can be easily adapted and fine-tuned for the analysis of other malignancies or histopathological features. By leveraging transfer learning techniques, the pre-trained model can be fine-tuned on new datasets with minimal additional training, making it a versatile tool for the analysis of various cancer types and histopathological markers [15][10]. The described algorithm can be used in routine practice to automatically calculate angiogenesis in a tumor. The problem of recognizing “false structures” can be solved through a larger number of trainings with the presence of micropreparations of vessels of various calibers in the whole slide images [15][10].

2.3. Oral Squamous Cell Carcinoma

Oral squamous cell carcinoma (OSCC) is a prevalent and aggressive malignancy with a complex microvascular network [10][6]. The total incidence is 2%, and the total percentage of deaths is 1.8% [6][35]. Hypoxia is commonly seen in many solid tumors, including OSCC, due to rapid tumor growth that outstrips the supply of oxygen from existing blood vessels. Hypoxia can influence the behavior of tumor cells and contribute to angiogenesis and metastasis. Tumors often induce angiogenesis in order to supply themselves with the nutrients they need to grow. An increased number of blood vessels in and around the tumor might therefore be indicative of a more aggressive tumor. According to TNM 8 and CAP cancer protocols, lymphovascular invasion (LVI) and tumor angiogenesis have a strong correlation with cancer recurrence, metastasis and poor patient survival [3][4][3,4]. The accurate segmentation of microvessels in histological specimens can be considered a preliminary step in the objective identification of LVI and tumor angiogenic analysis [10][6]. The uncertainty-driven pooling deep learning architecture was applied for the segmentation of microvessels in H&E-stained images of OSCC tissue [10][6]. This novel approach incorporates uncertainty estimation into the learning process, allowing the model to better adapt to the inherent variability and noise present in histopathological images. This is particularly relevant for microvessel segmentation in OSCC, as the tumor-associated microvessels can exhibit a wide range of morphologies, sizes and staining characteristics, making them challenging to accurately detect and delineate [10][6]. The trained model was designed to incorporate spatial and morphological information from different pooling scales, enabling it to capture both fine-grained details and larger contextual information. By combining this multi-scale information with an uncertainty estimation mechanism, the model was able to adaptively adjust its predictions based on the local context and the degree of uncertainty in the image. The model achieved high accuracy and consistency, outperforming other state-of-the-art methods in terms of segmentation performance. By providing automated and objective measurements of microvessel density and distribution, the model has the potential to improve prognostic and predictive assessments in OSCC patients [10][6]. The same research group later reported the FABnet model, which was compared with the most popular neural networks in pathology tasks [17][12]. The FABnet segmentation model predicted uncertainty maps of nerves and microvessels. The prediction heatmaps obtained by FCN-8, U-Net, Segnet, DeepLabv3+ and the FABnet were shown as overlays on the original images. FABnet demonstrated a precision of 89.35%. The FABnet segmentation mask included only the vessel lumen with blood cell elements, which could limit its efficacy in cases where cancer cells invade the blood vessel wall [17][12]. The same group of researchers created a more advanced ResNeXt model for the detection of blood vessels and nerves, which showed 99.26% specificity. ResNeXt segmented both vessel lumens and walls, giving it a practical advantage over FABnet [17][18][12,13].

2.4. Colorectal Cancer

Colorectal cancer (CRC) accounts for more than 1.85 million cases (9.8% of total cancer cases) and causes 850,000 deaths (9.2% of total cancer-related deaths) annually. CRC is the third-most common cause of cancer mortality worldwide [6][35]. During the colorectal cancer histological specimen examination for predicting tumor metastasis and determining the degree of its aggressiveness, parameters such as vascular density, angiogenesis and LVI are evaluated [3]. In addition, there is an instruction to separate parameters such as budding (tumor buds that are separated from the primary tumor), tumor satellites (these are tumor nests or nodes (macro- or microscopic) that are localized within 2 cm of the primary tumor) and deposits (isolated tumor foci not associated with the primary tumor and lymph node tissue) [3][4][3,4]. AI-based methods have been utilized to detect and quantify tumor blood vessels in CRC, and can provide valuable information regarding tumor aggressiveness, metastatic potential and survival prognosis [19][14]. Both vascular and lymphatic invasion are assessed, denoted by the single abbreviation LV1 [3][19][3,14]. A continuous hot spot probability map has been proposed to evaluate whole slide images. First, the preparations are additionally stained for the endothelial marker CD34, and the vessels in the tumor are extracted from the slides by segmentation (“hot spots”). Each such point is taken as a probability. This value gives the probability that an angiogenic hot spot is present at the corresponding location in the original image. The method gives three main results: first, it indicates whether the blood vessels in each tissue sample are randomly distributed or form statistically significant hot spots. Secondly, these hotspots can be accurately located in the image. Thirdly, each point is assigned an exact probability value [19][14]. Adipose tissue served as a strict control in the study, and no significant angiogenic points could be found in it. This method has prospective application in vessel segmentation and the statistical comparison of distributions in two- and three-dimensional space, making it possible to obtain a 3D heatmap of microvasculature [19][14]. Moving from microscopic structures, such as individual small vessels, to angiogenic hot spots of a certain size and distribution, it seems possible to change the measurement scale from micrometers to millimeters. Therefore, histological vascular patterns can be correlated with radiological findings (e.g., tumor perfusion) [19][14].

2.5. Gastric Cancer

The total incidence of gastric cancer is 5.6%, and the total percentage of deaths is 7.7% [6][35]. In gastric cancer, the depth of invasion is an important prognostic factor that guides the course of treatment. Tumors that have invaded blood vessels may suggest a deeper and more advanced stage of disease. By assessing the involvement of blood vessels in the tumor tissue, pathologists can help determine the depth of invasion of the cancer. Lymphovascular invasion (LVI) is one of the most important prognostic factors in gastric cancer, as it indicates a higher probability of lymph node metastasis and a poorer overall outcome for the patient [20][15]. Both vascular and lymphatic invasion are assessed, denoted by the single abbreviation LV1 [4][15][4,10]. The blood vessels were segmented using an AI model for the purpose of LVI detection. The study used 88 whole slide images of histological specimens of gastric adenocarcinoma, which were additionally stained for CD34 and D2-40 vessel markers in a group of LVI+ patients. The ResNet 50, EfficeientNet B3, ConViT (Small) models were fine-tuned on the LVI datasets (Figure 3). For simultaneous localization of LVI regions, a single-stage YOLO object detection model was used, which significantly increased the accuracy of diagnosis. As a result, all LVI(+) patients were identified by the program [20][15]. This ensemble deep learning model was demonstrated to be robust and accurate, and it can be used as a valuable tool for pathologists in diagnosing gastric cancer and may help improve the accuracy of diagnosis and prognosis of the disease. This approach can be considered an alternative to traditional methods, and as a step toward computer-aided diagnosis systems in histopathology [15][20][10,15].
Figure 3. (a,b) Blood vessel detection by the RENFAST algorithm and (c) CNN cellular structure detection (yellow: nuclei; cyan: lumen). (d,e) Predictive LVI foci (marked with a red box) detection by dual filter (the ConVit and YOLOX models).

2.6. Glioblastoma

Glioblastoma is a highly aggressive brain tumor with poor prognosis. The total incidence of glioblastoma is 1.6%, the total percentage of deaths is 2.5% [6][35]. A characteristic feature of glioblastoma is pseudopalisading necrosis, which consists of zones of dead cells that appear to line up around areas of vascular necrosis. This pattern is related to the unique way these tumors grow by co-opting the brain’s blood vessels and then causing them to die. Glioblastoma is known for its ability to stimulate angiogenesis. A highly vascularized tumor is characterized by rapid growth and an aggressive course and requires the use of anti-angiogenetic drugs, such as bevacizumab [8][36]. Glioblastomas often exhibit microvascular proliferation with multiple layers of endothelial cells forming haphazardly arranged, thickened, and distorted vessels. The evaluation of blood vessels, along with other features, helps in grading the tumor, which is important for determining treatment plans and prognostication. In whole slide images with stains for CD31 and CD34 of glioblastoma histological preparations, microvasculature vessels were detected by creating segmentation masks. Remarkably, the model correctly detected vessels with and without slit-like lumen [21][16]. AI-based methods have shown the ability to accurately detect microvessels and assess their morphological features in glioblastoma, which can be associated with patient survival and response to therapy [22][23][17,18]. In both studies, CNNs were applied to classify glioma and glioblastoma biopsy images according to their grade of malignancy. The trained algorithm reached 96% accuracy, providing reliable support in decision making for pathologists when diagnosing tumor type [22][23][17,18]. A more difficult task for artificial intelligence was to determine the cellular subtypes of gliomas: oligodendrocytoma, anaplastic oligodendroma, astrocytoma, anaplastic astrocytoma and glioblastoma. The accuracy achieved was 87%, and the algorithm itself did not contain a mechanism for interpreting the obtained results [22][23][17,18]. One of the key benefits of using machine learning in oncological pathology is the integration of different types of data. A neural network was developed for predicting patient survival based on an analysis of the histological and genetic profiles of the tumor.

2.7. Renal Cell Carcinoma

Renal cell carcinoma (RCC) is the most common type of kidney cancer, and it typically manifests as a highly vascular tumor. The total incidence of RCC is 2.2%, and the total percentage of deaths is 1.8% [6][35]. The presence, shape and size of blood vessels can help in distinguishing between different subtypes of RCC. For example, clear-cell RCC often has a rich network of tiny, thin-walled blood vessels, while papillary RCC might exhibit less vascularization [24][19]. AI-based methods have been employed to segment and quantify blood vessels in RCC tissue samples, demonstrating their ability to accurately detect microvessels and assess their morphological features. These findings can be associated with tumor stage, grade and patient survival, and can potentially inform treatment decisions and patient management strategies [24][19]. Leveraging the power of artificial intelligence, the proposed multi-task semi-supervised learning model achieved significant advancements in the area of blood vessel detection. By incorporating both labeled and unlabeled data, this model was able to minimize the dependency on the manual annotation of vascular networks, thereby streamlining the process of automatic segmentation. The model showcased an impressive performance, surpassing that of fully supervised learning models, and exhibited flexibility in its application across various types of tumor, including RCC. The model’s application accuracy for RCC stood at 0.78. The minor loss experienced was likely attributable to the intricate detection of smaller branches of blood vessels and slight variations in blood vessel thickness. The bulk of research in the digital pathology of kidneys that involves the segmentation of blood vessels addresses the problem of non-tumor diseases. It is important to detect blood vessels, distinguish elements such as the endothelium, measure wall thickness and hyalinosis level, and determine the presence or absence of inflammatory cells in a range of kidney pathologies [25][26][27][26,41,42]. These features are strictly necessary in order to perform a diagnosis of acute or chronic transplant rejection, some glomerulo- and vasculopathies, and level of kidney failure in patients with long-term primary of symptomatic hypertension (Figure 3 and Figure 4). In addition, a possible promising task may be the definition of arteritis and the degree of its severity [28][29][30][27,29,30].
Figure 4. (a) An example of kidney structure segmentation by the DeepLab V3+ model. (b,c) nnU-Net kidney structure segmentation. (d) kidney blood vessel detection by the RENFAST algorithm.

2.8. Pancreatic Cancer

The total incidence of pancreatic cancer is 2.6%, and the total percentage of deaths is 4.7% [6][35]. In pancreatic cancer, the invasion of major blood vessels (e.g., the superior mesenteric artery or vein) can be a factor that makes the disease unresectable, meaning it cannot be completely removed by surgery [3][4][3,4]. This would typically be associated with a worse prognosis. Specific histologic subtypes of pancreatic cancer may have characteristic patterns of vascular invasion or angiogenesis. Identifying these can help in confirming the diagnosis. An important prognostic marker is the presence or absence of lymphovascular invasion: the tumor spreads along the collagen fibers of the stroma to the membranes of the vessels, and then into their lumen through the bloodstream. There are frequent cases of the detection of tumor cells in the tunica media and tunica adventitia in the absence of tumor emboli. For a reliable and accurate assessment of vascular invasion of carcinoma in such cases, the CODA model was proposed, which can restore large gaps in ductal and vascular structures in 3D format [31]. The principle of operation of the model is universal and can be applied in the diagnosis of other malignant tumors, such as breast cancer [31][32][31,32]. CODA stands for “Cellular Object Detection, Segmentation, and Classification”. It is a framework or methodology used to analyze and interpret digital pathology images with the goal of automating or assisting in the detection, segmentation, and classification of cellular objects within the images. CODA makes it possible to assess the extent of vascular or perineural invasion and precancerous lesions of the pancreas [31]. CODA gives the pathologist a spatial perspective of the course of blood vessels and their branching, and also allows the prediction of the direction of tumor growth into the walls of the blood vessels. Visualization of the bloodstream allows more objective measurements compared to the values of microvessel density. In addition, CODA makes complicated pathological features significantly more understandable, such as leaking vessels [31][32][31,32].
Video Production Service