Multiplex spatial analysis methods have recently been developed; these have offered insight into how cellular crosstalk dynamics and heterogeneity affect cancer prognoses and responses to treatment. Multiplex (imaging) technologies and computational analysis methods allow for the spatial visualization and quantification of cell–cell interactions and properties. These technological advances allow for the discovery of cellular interactions within the tumor microenvironment and provide detailed single-cell information on properties that define cellular behavior.
1. Introduction
Tumors and their microenvironments often comprise complex and heterogeneous tissues made up of multiple cell types, mainly tumor cells, immune cells, fibroblasts, and endothelial cells. Interactions between these heterogeneous subsets in the tumor microenvironment (TME) are required for stepwise tumor evolution and tumor progression
[1]. In recent years, insights into the TME have increased rapidly due to the development of single-cell multiplex measurements, such as single-cell transcriptomics and proteomics
[2]. Many single-cell proteome and transcriptome studies have been performed on single-cell suspensions from dissociated tumors in order to analyze the heterogeneity of the immune microenvironment and how it relates to therapy responses
[3]. For example, multiple single-cell studies, employing RNA sequencing and flow cytometry of isolated tumor infiltrating T cells, have demonstrated that T cell exhaustion in the TME can predict the response to immune checkpoint inhibition
[4][5][4,5]. These single-cell approaches have led to the discovery of various tumor-specific cell types and activated transcriptional programs in the TME relevant to cancer evolution, cancer progression, or patients’ treatment responses. While these studies bring valuable and novel insights, single-cell isolation can cause the loss of cell types and proteins that are sensitive to dissociation methods, and disregards the extracellular matrix. Moreover, single-cell suspension analyses inevitably overlook tissue organization and specific cell–cell interactions in pathology. To overcome these limitations, spatial analysis technologies have been developed over the last decade to analyze the intact TME, which have, for example, revealed B cell and T cell co-localization in organized tertiary lymphoid structures (TLS)
[6]. Some of the multiplex spatial technologies that have been developed utilize fluorescence-based microscopy
[7][8][9][7,8,9], and others make use of antibody-targeted sequencing
[10] or mass spectrometry-based detection to generate spatial expression data
[11][12][13][11,12,13]. Spatial data has opened up new possibilities for studying specific tissue regions and cell subtypes, local cellular behavior marked by active signal transduction or receptor expression, and interactions between diverse cell types in the TME
(Figure 1).
Figure 1. Spatial analysis of the tumor microenvironment (TME). Methods, results, and implications in cancer research. AThis review provides an overview of technologies that are used for TME spatial analyses in cancer research was provided. These technologies employ microscopy (PhenoImager, PhenoCycler), mass-spectrometry (imaging mass cytometry (IMC)), multiplexed ion beam imaging by time-of-flight (MIBI), and (matrix-assisted laser desorption ionization mass spectrometry imaging (MALDI-MS)), or digital spatial profiling (DSP). PhenoImager, PhenoCycler, IMC, and MIBI can be used to investigate single cells and to explore the cellular composition, heterogeneity, and cellular interactions of the TME. MALDI-MSI can be employed to investigate the TME metabolome in specific regions, and DSP can be used to explore the transcriptome in bulk cells of up to three different subsets. These multiplex spatial methods have provided novel insights into specific biomarkers and TME spatial hallmarks that can be used for tumor subtype classification. Moreover, these methods have uncovered which TME characteristics are related to tumor evolution and progression to advanced stages, clinical prognosis parameters such as overall survival (OS) and progression-free survival (PFS), and prediction of therapy responses.
2. Discoveries within the TME Using Multiplex Imaging Methods
In recent years, novel technologies have allowed for the development of spatial multiplex imaging, which enables the simultaneous analysis of >5 markers of interest on a tissue slide while conserving the spatial context. Multiplex spatial imaging methods allow the generation of large datasets containing clinically relevant biological data, consisting of multi-layered information. A schematic overview of each discussed method is provided in
Figure 2,
Figure 3,
Figure 4,
Figure 5,
Figure 6 and
Figure 7. These multiplex spatial methods facilitate in-depth investigation of TME heterogeneity within and between various cancer types. Reports of multiplex spatial imaging studies often provide detailed descriptions of differences in cellular composition, novel cellular phenotypes, or co-localization of specific cell types. Finally, data of these multiplex spatial imaging methods are used for tumor classification and grading, clinical outcomes, therapeutic responses to immune checkpoint inhibitors, or other therapies like chemotherapy, radiotherapy, or chemoradiotherapy.
2.1. Development of the Imaging Field
The first key studies used immunohistochemistry to analyze a limited number of markers simultaneously
[14][19]. Immunohistochemistry has contributed to the development of the ‘immunoscore’, which showed for the first time that, compared to histopathological analysis, immunological imaging data of T cells in tumors provide a better predictor of the clinical outcome in patients with colorectal cancer (CRC). Besides immunohistochemistry, multiplex immunofluorescence is routinely used to stain the TME. Multiplex immunofluorescence is a method combining one to five different antibodies coupled with fluorophores. This method allowed for the first identification of distinct cellular phenotypes within the TME and is routinely used in diagnostics. The advantage of this method is that fluorophores can be imaged simultaneously, and the signal has a large linear range which allows quantification. These fluorophores must be chosen carefully to prevent signal spillover, and fluorophore combinations are limited.
2.2. PhenoImager
To minimize spillover in other channels, a multispectral imaging approach is required. A decade ago, the multispectral imager, PhenoImager, formerly known as Vectra (
Figure 2), became commercially available to study the TME. This method allows the use of four to seven primary antibodies plus one nuclear counterstain. The antibody staining is performed in repetitive cycles of one primary antibody, secondary horseradish peroxidase (HRP)-labeled antibody, followed by addition of an opal polymer. This HRP converts the opal fluorophore with a short half-life. The primary and secondary antibodies are stripped, the following staining cycle begins, and finally the tissue slide is imaged using the PhenoImager. This method has been used to study tumor heterogeneity
[15][41], cell–cell interactions
[16][28], the spatial localization of subsets
[9][17][18][9,29,45], prognosis prediction,
[19][20][21][22][23][33,34,46,47,48], evaluation of therapeutic responses to immune checkpoint inhibition (ICPI), and changes in the immune landscape after chemotherapy with or without radiotherapy
[24][25][26][27][49,63,64,72].
Figure 2. PhenoImager (Vectra) workflow. PhenoImager allows for the use of up to six primary antibodies (or eight in case of the high throughput version) and a nuclear stain. Antibody staining is performed in repetitive cycles of one primary antibody, a secondary horseradish peroxidase (HRP)-labeled antibody, followed by the addition of an opal polymer. HRP converts the opal fluorophore when peroxidase is present. Next, the primary and secondary antibodies are stripped by heat treatment, followed by the next staining cycle, and finally the tissue slide is analyzed using the PhenoImager microscopy system, resulting in data images. Cells in these images can be segmented and downstream analysis can be performed (e.g., cell type mapping and marker expression).
2.3. PhenoCycler
PhenoCycler, formerly known as CO-Detection by Indexing (CODEX), is a commercially available multiplex tissue imaging platform that uses oligonucleotide conjugated antibodies to detect up to one hundred markers in the same tissue (
Figure 3). Initial antibody staining is followed by hybridization cycles with three reporter oligonucleotides containing spectrum-separable fluorophores. These reporter oligonucleotides hybridize with the unique antisense oligonucleotide that is conjugated to the primary antibody. After each cycle, a microscopy image is acquired, followed by removing the fluorophores and a novel hybridization cycle. Upon the completion of all cycles, the images are compiled and aligned to achieve a multiplex image
[7]. This cycle-dependent approach drastically increased the number of potential markers, and opened opportunities for detailed characterization and spatial exploration of the TME
[28][29][20,42].
Figure 3. PhenoCycler (CODEX) workflow. Tissue is labeled using oligonucleotide-conjugated antibodies to detect up to one hundred markers simultaneously. Initial antibody staining is followed by hybridization cycles with three reporter oligonucleotides containing spectrum-separable fluorophores, which hybridize with the unique antisense oligonucleotide conjugated to the primary antibody (left). After each cycle, a microscopy image is acquired (imaging with PhenoCycler). Next, reporters are removed; this is followed by the next reporter hybridization cycle. Images from all cycles are compiled and registered to generate multiplex data images. During imaging analysis, these images can be processed into single-cell expression data and downstream analysis is performed (e.g., cell type mapping, clustering, marker expression).
Characterization and Spatial Exploration of the TME
One of the first studies to explore the spatial characterizations of the TME using PhenoCycler was performed in a stage III-IV CRC cohort. This study employed a fifty-six-marker panel to investigate differences between thirty-five colorectal tumors with de novo TLS at the invasive front, compared to tumors that lacked TLSs but contained a diffuse tumor infiltrate
[29][42]. The single-cell data were visualized as cellular neighborhoods and revealed certain differences. For example, cellular neighborhoods enriched for granulocytes and PD-1
+CD4
+ T cells were positively correlated with overall survival for patients with colorectal tumors that displayed diffuse infiltrates. Moreover, overall survival in these patients was associated with cellular neighborhoods containing high CD4
+ T cells frequencies and CD4
+/CD8
+ T cell ratios. In contrast, frequencies outside these cellular neighborhoods did not influence the overall survival rate.
More recently, PhenoCycler has also been used to elucidate the role of the S100A7/cytosolic phospholipase A2 (cPLA2)/Prostaglandin E2 (PGE2) signaling pathway in breast cancer; it was found that S100A7 is associated with tumor growth and metastasis
[28][20]. Breast cancer-bearing mice that overexpressed S100A7 were treated with the cPLA2 inhibitor, and the analysis revealed changes in T cell composition and cellular interactions. Cluster analysis revealed that cPLA2 inhibitor treatment promoted infiltration of activated CD4
+ T cells and CD8
+ T cells within the tumor. Furthermore, the highest degree of interaction among CD4
+ and CD8
+ T subsets was observed after cPLA2 inhibitor treatment. Studying these anti-tumor responses in relation to tumor-infiltrated T cells during treatment is essential for establishing whether the number of infiltrating immune cells is correlated with the anti-tumor response. Additionally, studies that focus on immunological changes within the TME will help to uncover biological mechanisms induced by the treatment, and enable biomarker discovery to predict clinical responses.
2.4. Multiplexed Ion Beam Imaging by Time-of-Flight
Multiplexed ion beam imaging by time-of-flight (MIBI-TOF,
Figure 4) can theoretically utilize up to 100 primary antibodies, each of which can be coupled to unique metal isotopes. A multiplex antibody panel is incubated on a tissue section, and a primary oxygen duoplasmatron ion beam applies a raster to the sample surface. Next, the beam ionizes the metal-conjugated antibody-containing rasters, which are subsequently detected as secondary ions separated by mass and charge by time-of-flight mass spectrometry. The mass spectrometry data are integrated with the single-cell images to generate a tabular chart that contains single-cell data, which can be used to generate spatial profiles
[12]. MIBI-TOF is used to study tumor spatial heterogeneity
[30][31][32][17,21,35] and tumor progression
[33][80].
Figure 4. Multiplexed ion beam imaging by time-of-flight (MIBI-TOF) workflow. Tissues are first labeled with a multiplex panel of antibodies conjugated with heavy metals containing polymers. Next, these are directly ionized to generate secondary ions. Ions are filtered and detected by time-of flight mass spectrometry. Next, multiplex images are generated, containing images depicting expressions for each separate antibody–metal conjugate. These images can be processed into single-cell expression data. During imaging analysis, these images can be processed into single-cell expression data and downstream analysis is performed (e.g., cell type mapping, clustering, marker expression).
2.5. Imaging Mass Cytometry
Imaging mass cytometry (IMC,
Figure 5) uses a pulsed ultraviolet laser to ablate tissue labeled with metal-labeled antibodies from a glass slide
[13]. The ablated tissue is taken up into an argon gas flow and ionized by the plasma, forming ion clouds. These ion clouds pass a filter to enrich the reporter ions and remove common biological elements, after which the signal is quantified by time-of-flight mass spectrometry. The data table integrates single ion signals per pixel, after which image and single cell segmentation can be converted to single-cell data for downstream analysis. In cancer research, IMC is used to discover novel phenotypes and biomarkers, or to study TME heterogeneity
[34][35][36][37][38][39][40][41][42][43][44][22,23,24,25,30,31,32,36,43,44,50]. IMC is also used to predict prognosis and therapy responses in humans or in mice
[35][38][45][46][47][48][49][50][51][52][23,30,51,65,66,67,68,73,74,75].
Figure 5. Imaging mass cytometry (IMC) workflow. Tissues are first labeled with a multiplex panel of antibodies conjugated with heavy metal containing polymers. Next, the slide is inserted into the imaging mass cytometer (IMC) and regions of interest (ROI) are selected. Small pieces of 1 uM
2 of labeled tissue are consecutively ablated with a UV-laser and ionized. Ions are filtered and detected by time-of flight mass spectrometry. Next, multiplex images are generated, containing images depicting expressions for each separate antibody–metal conjugate. During imaging analysis, these images can be processed into single-cell expression data and downstream analysis is performed (e.g., cell type mapping, clustering, marker expression). The Hyperion cartoon was acquired from BioRender.
2.6. Matrix-Assisted Laser Desorption Ionization Mass Spectrometry Imaging
Matrix-assisted laser desorption ionization mass spectrometry imaging (MALDI-MSI,
Figure 6) is a labeling-free method for two-dimensional and three-dimensional quantitative spatial analysis of the molecular distribution of molecules, such as proteins, lipids, metabolites, and glycans in tissue
[53][18]. The microscope slide containing either formalin-fixed paraffin-embedded (FFPE) or fresh frozen (FF) tissue sections is processed, and a matrix is applied. After matrix deposition, the slide is inserted into the MALDI-MSI, and a laser creates a 10–150 micrometer raster. The laser beam ionizes a spot in each raster, and the ionized analytes from the raster are transferred into the mass spectrometer for compound identification. In parallel, an image is created by combining the data of the spot location with the corresponding measured mass spectrum. In the field of cancer research, MALDI-MSI has been used to analyze drug (metabolite) distribution in the TME, tumor subtyping, tumor grading, or biomarker discovery
[54][55][56][57][58][59][55,76,77,78,79,81]. MALDI-MSI is also used to predict tumor progression and clinical outcomes
[60][61][56,69].
Figure 6. Matrix-assisted laser desorption ionization mass spectrometry imaging (MALDI-MSI) workflow. Tissue sections are processed, and a matrix is applied (matrix deposition). Next, a laser in the MALDI-MSI creates a 10–150 micrometer raster (Raster Application). The laser beam ionizes a spot in each raster (laser ablation), and the ionized analytes from the raster are transferred into the mass spectrometer for compound identification (mass spectra). In parallel, an image is created by combining the data of the spot location with the corresponding measured mass spectrum (images of single
m/z values).
2.7. Digital Spatial Analysis
Digital spatial analysis (DSP,
Figure 7) is a commercially available technique that enables RNA or protein quantification from FFPE or FF tissue by counting targets that are linked to unique indexing oligonucleotides
[10]. These indexing oligonucleotides are covalently bound with a UV-photocleavable (PC) linker to a mRNA hybridization probe or to a primary antibody. Tissue slides are first hybridized with mRNA probes or stained with PC-linked primary antibodies. After this first staining, the same slide can be stained with one to four fluorescent labeled antibodies, which allows for the identification of specific tissue structures or cellular subsets of interest. The tissue slide is inserted into the DSP and an image is produced, based on the signal from the fluorescent labeled antibodies. These overview images enable the selection of a region of interest (ROI) of any shape. After the ROI is selected, the digital micromirror device illuminates the ROI, which causes the PC-linked mRNA or primary antibody to be released from the tissue. The photocleaved indexing oligonucleotides are aspirated with a microcapillary and collected in a 96-well plate. The collected photocleaved indexing oligonucleotides are analyzed either by next generation sequencing or by an nCounter system.
Figure 7. Digital Spatial Profiling (DSP) workflow. Tissue sections are labeled with antibodies and/or in situ hybridization with mRNA probes, which are linked with UV-cleavable oligo-tags. Slides are labeled with fluorescence-conjugated antibodies to determine cell subsets and select regions of interests and masks for bulk cell subsets for directed UV-cleavage of the oligo-tags. The cleaved oligos are collected with a microcapillary and transferred to a 96-well plate. Next, the oligos are quantified by digital counting (nCounter) or next-generation sequencing. Differential expression of specific mRNA or proteins between ROIs and cell subsets are next analyzed (data analysis).
DSP has been used in the field of cancer research to search for TME transcriptional profiling, and to identify predictive markers for prognosis, therapy response prediction, or clinical outcomes
[62][63][64][65][66][67][68][69][70][71][26,57,58,59,60,61,62,70,71,82]. Furthermore, DSP has been utilized to investigate TME heterogeneity
[72][73][74][75][76][77][78][79][27,37,38,39,40,83,84,85].
Immunotherapy Response Prediction
DSP has been widely used to predict immunotherapy responses or to identify prognostic markers. Three different studies have investigated which markers are related to ICPI treatment response.
The first study examined seventeen resectable stage III melanoma baseline biopsies, which were treated with adjuvant or neoadjuvant ipilimumab and nivolumab, before or after complete regional lymph node dissection
[70][71]. Samples were analyzed with twenty-nine oligo-conjugated antibodies directed to immune-related surface antigens. Low expression of CD3, B2M, and PD-L1, and a low IFNγ signature within the tumor were correlated with relapse after adjuvant or neoadjuvant ipilimumab and nivolumab. Meanwhile, tumors with an intermediate or high IFNγ signature did not relapse.
A second study included resectable Melanoma stage III or oligometastatic stage IV tumors that were treated with neoadjuvant nivolumab monotherapy or a combination of nivolumab and ipilimumab
[62][26]. Immunohistochemistry showed that the tumors of responding patients expressed elevated PD-L1 expression in tumor cells, increased lymphocyte marker expression (granzyme B, CD4, FoxP3, CD20, and PD-1), and elevated proportions of CD8
+ TILs. Furthermore, higher expression of CD45RO, B2M, CD3, CD8, CD19, CD20, and Ki67 in the CD45
+ immune cell infiltrate correlated with ICPI response. Meanwhile, the T cell receptor sequencing showed that tumors of responders had a larger T cell clone diversity than tumors of non-responders.
The third study investigated which immune cell makers were correlated with ICPI treatment outcomes. Seven samples, taken from patients with metastatic head and neck squamous cell carcinoma that had been treated with nivolumab and pembrolizumab, were analyzed with a 44-marker panel
[67][61]. The immune cell profiling panel revealed that expression of CD4, CD45RO, CD68, IDO-1, P-ERK, Ki67, PD-L1 PD-1, Granzyme B, CD45, OX40, STAT3, P-STAT3, CD44, STING, CD66b, P-AKT, and PTEN was associated with progressive disease. Additionally, in contrast to the second study of melanoma, CD8 expression was not predictive for the ICPI treatment outcome here.
Two studies used immunofluorescent antibodies to identify specific compartments within the TME. The first study included immunotherapy-treated melanoma samples. These samples were stained with a 44-plex antibody cocktail that was mainly directed towards the immune-related surface antigens of leukocytes and macrophages
[65][59]. Additionally, some markers to identify the tumor cells were included. These markers were used to identify three compartments: melanocytes (S100
+ and HMB45
+), macrophage (CD68
+), and leukocyte (CD45
+) compartments. Analysis of these compartments revealed that high CD8
+ counts within the macrophage compartment were associated with progression-free survival, as well as immunotherapy response and prolonged overall survival. CD8
+ numbers within the tumor compartment were associated with favorable outcomes, whereas CD8
+ numbers in the leukocyte compartment were not. In total, eleven markers and fifteen markers were found to correlate with progression-free survival and overall survival, respectively. However, in the multivariate analysis, only PD-L1 expression in the macrophage compartment was significantly associated with progression-free survival and overall survival.
The second study included eighty-one NSCLC patients (stage III-stage IV) who were treated with either nivolumab, pembrolizumab, or atezolizumab
[66][60]. Three different compartments within these tumors were analyzed: tumor cells (pan keratin
+), immune cells (CD45
+), and macrophages (CD68
+). Multivariate analysis showed that high levels of CD56 and CD4 in the immune cell compartment are predictive of longer progression-free survival, prolonged overall survival, and durable benefit, while high VISTA levels and CD127 levels in the tumor compartment were predictive of non-durable benefit and shorter progression-free survival.