- Please check and comment entries here.
Semantic Support of Cultural Heritage
The usage of semantics is not new in cultural heritage disciplines. They are commonly used to define standards for meta-, para-, and provenance information for documenting and archiving. Examples of such standards are LIDO and MIDAS Heritage. These XML schema standards are still used in cultural heritage. In recent years, however, the emergence of the Semantic Web has provided the much-required boost to semantic frameworks and technologies. It also dictates how semantics are defined and used today. Techniques and tools that formalize semantics through formalized knowledge representations have become the norm in different fields applying semantics.
The signature of the 2019 Declaration of Cooperation on advancing the digitization of cultural heritage in Europe shows the important role that the 3D digitization process plays in the safeguard and sustainability of cultural heritage. The digitization also aims at sharing and presenting cultural heritage. However, the processing steps of data acquisition to its presentation requires an interdisciplinary collaboration, where understanding and collaborative work is difficult due to the presence of different expert knowledge involved. This study proposes an end-to-end method from the cultural data acquisition to its presentation thanks to explicit semantics representing the different fields of expert knowledge intervening in this process. This method is composed of three knowledge-based processing steps: (i) a recommendation process of acquisition technology to support cultural data acquisition; (ii) an object recognition process to structure the unstructured acquired data; and (iii) an enrichment process based on Linked Open Data to document cultural objects with further information, such as geospatial, cultural, and historical information. The proposed method was applied in two case studies concerning the watermills of Ephesos terrace house 2 and the first Sacro Monte chapel in Varallo. These application cases show the proposed method’s ability to recognize and document digitized cultural objects in different contexts thanks to the semantics.
Data acquisition guided by a recommendation system for acquisition technologies.
Data processing and structuring through knowledge-guided object recognition.
Data presentation with cultural information thanks to an enrichment process from Linked Open Data.
Data acquisition, which allows the digitization of a cultural object and produces unstructured data;
Data processing, which produces a structured data thanks to the segmentation, classification, and analysis of unstructured data;
Data enrichment, which consists of enriching the structured data with cultural heritage information and knowledge related to the structured data;
Data presentation, which allows the visualization of the structured and enriched data.
2.2. Related Work
The entry is from 10.3390/rs13112226
- Yang, F.; Xu, F.; Zhang, K.; Bu, X.; Hu, H.; Anokye, M. Characterisation of Terrain Variations of an Underwater Ancient Town in Qiandao Lake. Remote Sens. 2020, 12, 268.
- Janowski, L.; Kubacka, M.; Pydyn, A.; Popek, M.; Gajewski, L. From acoustics to underwater archaeology: Deep investigation of a shallow lake using high-resolution hydroacoustics—The case of Lake Lednica, Poland. Archaeometry 2021.
- Majcher, J.; Quinn, R.; Plets, R.; Coughlan, M.; McGonigle, C.; Sacchetti, F.; Westley, K. Spatial and temporal variability in geomorphic change at tidally influenced shipwreck sites: The use of time-lapse multibeam data for the assessment of site formation processes. Geoarchaeology 2021, 36, 429–454.
- Coburn, E.; Light, R.; McKenna, G.; Stein, R.; Vitzthum, A. LIDO-lightweight information describing objects version 1.0. In Proceedings of the ICOM International Committee of Museums, Shanghai, China, 7–12 November 2010.
- Heritage, M. The UK Historic Environment Data Standard. 2012. Available online: (accessed on 18 March 2021).
- Berners-Lee, T.; Hendler, J.; Lassila, O. The semantic web. Sci. Am. 2001, 284, 34–43.
- Singh, M.P.; Huhns, M.N. Web Ontology Language: OWL. In Service-Oriented Computing; Springer: Berlin/Heidelberg, Germany, 2006; pp. 137–162.
- Omerovic, S.; Milutinovic, V.; Tomazic, S. Concepts, Ontologies, and Knowledge Representation; Springer: Berlin/Heidelberg, Germany, 2001.
- Doerr, M. The CIDOC Conceptual Reference Module: An Ontological Approach to Semantic Interoperability of Metadata. AI Mag. 2003, 24, 75.
- Pieraccini, M.; Guidi, G.; Atzeni, C. 3D digitizing of cultural heritage. J. Cult. Herit. 2001, 2, 63–70.
- Omar, T.; Nehdi, M.L. Data acquisition technologies for construction progress tracking. Autom. Constr. 2016, 70, 143–155.
- Boochs, F.; Bentkowska-Kafel, A.; Degrigny, C.; Karaszewski, M.; Karmacharya, A.; Kato, Z.; Picollo, M.; Sitnik, R.; Trémeau, A.; Tsiafaki, D.; et al. Colour and Space in Cultural Heritage: Interdisciplinary Approaches to Documentation of Material Culture. Int. J. Herit. Digit. Era 2014, 3, 713–730.
- Karmacharya, A.; Wefers, S. Structuring spectral and spatial recording strategies of cultural heritage assets. Background, state of affairs, and future perspectives. In Digital Techniques for Documenting and Preserving Cultural Heritage. Collection Development, Cultural Heritage and Digital Humanities; Arc Humanities Press: Ghent, Belgium, 2017; pp. 157–172.
- Grilli, E.; Menna, F.; Remondino, F. A review of point clouds segmentation and classification algorithms. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences—ISPRS Archives, Nafplio, Greece, 1–3 March 2017; Volume 42, pp. 339–344.
- Fang, H.; Lafarge, F.; Pan, C.; Huang, H. Floorplan generation from 3D point clouds: A space partitioning approach. ISPRS J. Photogramm. Remote Sens. 2021, 175, 44–55.
- Anguelov, D.; Taskar, B.; Chatalbashev, V.; Koller, D.; Gupta, D.; Heitz, G.; Ng, A. Discriminative learning of Markov random fields for segmentation of 3D scan data. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, San Diego, CA, USA, 20–25 June 2005; Volume II, pp. 169–176.
- Triebel, R.; Schmidt, R.; Mozos, O.M.; Burgard, W. Instance-based AMN classification for improved object recognition in 2D and 3D laser range data. In IJCAI International Joint Conference on Artificial Intelligence; Morgan Kaufmann Publishers Inc.: San Francisco, CA, USA, 2007; pp. 2225–2230.
- Lawin, F.J.; Danelljan, M.; Tosteberg, P.; Bhat, G.; Khan, F.S.; Felsberg, M. Deep projective 3D semantic segmentation. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer International Publishing: Cham, Switzerland, 2017; pp. 95–107.
- Shelhamer, E.; Long, J.; Darrell, T. Fully Convolutional Networks for Semantic Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 640–651.
- Nguyen, A.; Le, B. 3D point cloud segmentation: A survey. In Proceedings of the 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), Manila, Philippines, 12–15 November 2013; pp. 225–230.
- Qi, C.R.; Yi, L.; Su, H.; Guibas, L.J. PointNet++: Deep hierarchical feature learning on point sets in a metric space. Adv. Neural Inf. Process. Syst. 2017, 30, 5100–5109.
- Guo, Y.; Wang, H.; Hu, Q.; Liu, H.; Liu, L.; Bennamoun, M. Deep learning for 3D point clouds: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 2019, 1.
- Torralba, A.; Murphy, K.P.; Freeman, W.T. Using the forest to see the trees: Exploiting context for visual object detection and localization. Commun. ACM 2010, 53, 107–114.
- Hoiem, D.; Efros, A.A.; Hebert, M. Geometric context from a single image. In Proceedings of the IEEE International Conference on Computer Vision, Beijing, China, 17–21 October 2005; Volume I, pp. 654–661.
- De Luca, L. 3D Modelling and Semantic Enrichment in Cultural Heritage. Photogrammetric Week’13; Fritsch, D., Ed.; Wichmann/VDE Verlag: Berlin, Germany, 2013; pp. 323–333.
- Markhoff, B.; Nguyen, T.B.; Niang, C. When It Comes to Querying Semantic Cultural Heritage Data. In New Trends in Databases and Information Systems; Kirikova, M., Nørvåg, K., Papadopoulos, G.A., Gamper, J., Wrembel, R., Darmont, J., Rizzi, S., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 384–394.
- Garozzo, R.; Murabito, F.; Santagati, C.; Pino, C.; Spampinato, C. CulTO: An ontology-based annotation tool for data curation in cultural heritage. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2017, 42, 267–274.
- Durand, N.; Derivaux, S.; Forestier, G.; Wemmert, C.; Gançarski, P.; Boussaïd, O.; Puissant, A. Ontology-based object recognition for remote sensing image interpretation. In Proceedings of the International Conference on Tools with Artificial Intelligence, ICTAI, Patras, Greece, 29–31 October 2007; Volume 1, pp. 472–479.
- Maillot, N.; Thonnat, M.; Hudelot, C. Ontology based object learning and recognition: Application to image retrieval. In Proceedings of the International Conference on Tools with Artificial Intelligence, ICTAI, Boca Raton, FL, USA, 15–17 November 2004; pp. 620–625.
- Ponciano, J.J.; Boochs, F.; Trémeau, A. Knowledge-based object recognition in point clouds and image data sets. GIS Sci. Die Z. Fur Geoinform. 2017, 3, 97–104.
- Ponciano, J.J.; Roetner, M.; Reiterer, A.; Boochs, F. Object Semantic Segmentation in Point Clouds—Comparison of a Deep Learning and a Knowledge-Based Method. ISPRS Int. J. Geo-Inf. 2021, 10, 256.
- Georgiadis, H.; Papanoti, A.; Paschou, M.; Roubani, A.; Hardouveli, D.; Sachini, E. The semantic enrichment strategy for types, chronologies and historical periods in searchculture. gr. In Research Conference on Metadata and Semantics Research; Springer: Berlin/Heidelberg, Germany, 2017; pp. 211–223.
- Vlachidis, A.; Bikakis, A.; Kyriaki-Manessi, D.; Triantafyllou, I.; Padfield, J.; Kontiza, K. Semantic representation and enrichment of cultural heritage information for fostering reinterpretation and reflection on the European history. In Digital Cultural Heritage; Springer: Berlin/Heidelberg, Germany, 2018; pp. 91–103.
- Munnelly, G.; Lawless, S. Constructing a knowledge base for entity linking on Irish cultural heritage collections. Procedia Comput. Sci. 2018, 137, 199–210.
- Munnelly, G.; Pandit, H.J.; Lawless, S. Exploring linked data for the automatic enrichment of historical archives. In European Semantic Web Conference; Springer: Berlin/Heidelberg, Germany, 2018; pp. 423–433.
- Mouromtsev, D.; Haase, P.; Cherny, E.; Pavlov, D.; Andreev, A.; Spiridonova, A. Towards the Russian linked culture cloud: Data enrichment and publishing. In European Semantic Web Conference; Springer: Berlin/Heidelberg, Germany, 2015; pp. 637–651.
- Maietti, F.; Di Giulio, R.; Piaia, E.; Medici, M.; Ferrari, F. Enhancing Heritage fruition through 3D semantic modelling and digital tools: The INCEPTION project. In Proceedings of the IOP Conference Series: Materials Science and Engineering, Florence, Italy, 16–18 May 2018; IOP Publishing Ltd.: Bristol, UK; Volume 364, p. 012089.
- Maietti, F.; Medici, M.; Ferrari, F.; Ziri, A.E.; Bonsma, P. Digital cultural heritage: Semantic enrichment and modelling in BIM environment. In Digital Cultural Heritage; Springer: Berlin/Heidelberg, Germany, 2018; pp. 104–118.
- Quattrini, R.; Pierdicca, R.; Morbidoni, C. Knowledge-based data enrichment for HBIM: Exploring high-quality models using the semantic-web. J. Cult. Herit. 2017, 28, 129–139.