A new study published in Big Earth Data proposes a switching-based pervasive augmented reality (AR) framework that integrates location-based AR (LBAR), deep learning (DL), and context-awareness to improve landmark recognition and cultural heritage engagement in smart cities. Through end-to-end implementation and real-world testing in Tehran, the framework significantly enhanced landmark detection accuracy compared with conventional LBAR systems, while demonstrating high user satisfaction and potential for sustainable urban planning. The dataset used in this study is not shared publicly due to copyright restrictions. However, to support reproducibility, all source code developed for data preprocessing, model training, and evaluation has been made openly available at https://github.com/mhvahidnia/tehran-img-classification-webapp/.
Citation
Vahidnia, M. H., & Shafiei, M. (2026). Context-aware landmark recognition in location-based augmented reality: A switching framework with a MobileNet backbone for cultural heritage engagement. Big Earth Data, 1–40. https://doi.org/10.1080/20964471.2026.2649432
Abstract
City landmarks play a pivotal role in fostering a deeper understanding of urban environments and in supporting navigation, wayfinding, and cultural education and engagement. One of the primary objectives of sustainable and smart city management is the design of pervasive computing infrastructures that enable the discovery and retrieval of spatial and non-spatial information from landmarks and points of interest (POIs) in any given context. A promising solution lies in location-based augmented reality (LBAR) platforms for smartphones. Previous research has typically adopted two separate approaches: first, location and inertia sensors-based LBAR systems, which face limitations such as GPS errors, narrow fields of view, and sensor malfunctions; and second, image-based deep learning (DL) systems, typically demand large datasets, impose heavy computational loads, and may introduce latency in real-time applications. To address these gaps, we propose a switching-based pervasive AR design that combines LBAR, DL, and context-awareness. This framework is a complementary switching mechanism in which DL serves as a fallback when LBAR fails to identify a landmark. For this purpose, convolutional neural network (CNN) methods and their lightweight pre-trained variants, such as MobileNetV2, were employed. In addition, we propose a high level of context-awareness for cultural heritage engagement, by incorporating parameters such as time of day, user age, ongoing events, and spatial distance. Importantly, our study adopts an end-to-end approach encompassing dataset creation, web-service development, mobile application implementation, and real-world field testing. Experiments conducted on ten well-known landmarks in Tehran, using images curated from social media and the Internet, confirm the effectiveness of the integrated system. MobileNetV2 achieved reliable real-time landmark detection with 0.9100 ± 0.0215 accuracy and 0.9010 ± 0.0249 macro-F1. The switching LBAR–DL framework improved detection accuracy by approximately 34% compared with LBAR alone, yielding meaningful statistical results for the ablation analysis. User-centered evaluations with volunteers indicated that 90% of respondents were satisfied with overcoming LBAR limitations, and 68% reported a positive experience in context-aware understanding from landmarks. Finally, a GIS-assisted sustainable development analysis in Tehran demonstrated the potential of the proposed system in smart and sustainable city planning.
#geoscience #remote sensing #earth observation #GIS #data analysis #Big Data #visualization #landuse
Big Earth Data is an interdisciplinary Open Access journal which aims to provide an efficient and high-quality platform for promoting the sharing, processing and analyses of Earth-related big data, thereby revolutionizing the cognition of the Earth's systems. The journal publishes a wide range of content, including Research Articles, Review Articles, Data Notes, Technical Notes, and Perspectives. It is now included in ESCI, Scopus, Ei Compendex, GEOBASE, and Inspec. Starting from 2023, Big Earth Data has announced a new award series for authors: Best and Outstanding Paper Awards.
