TY - GEN
T1 - Semantic Segmentation and Spatial Relationship Modeling in Hyperspectral Imagery Using Deep Learning and Graph-Based Representations
AU - Yenni, Ravikumar
AU - Arun, P. V.
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024/1/1
Y1 - 2024/1/1
N2 - The effective analysis of spatial data from diverse sources, such as satellite imagery and aerial views, remains pivotal for informed decision-making across various domains. This paper presents a novel framework for semantic segmentation and spatial relationship modeling in hyperspectral imagery using advanced deep learning techniques and graph-based representations. Our methodology integrates state-of-the-art models including U-Net, SegNet, and ResUNet to achieve precise object segmentation in high-resolution images, leveraging their capabilities in capturing fine details and intricate boundaries. By preprocessing data from datasets like the Dubai dataset for semantic segmentation and drone datasets for spatial analysis, we standardize and enhance image quality, preparing them for robust model training. Following segmentation, we employ a relation network model based on LSTM and GRU architectures to extract semantic relationships between identified object pairs within the segmented images. This approach draws on principles from scene graph generation, enhancing scene understanding by structuring spatial relationships into interpretable graph representations. The framework's versatility is demonstrated through applications in urban planning, environmental monitoring, and disaster response, where the visualization of spatial interactions as graphs facilitates intuitive decision-making processes. Through rigorous evaluation and comparison with benchmark methods, we validate the effectiveness of our approach in accurately capturing spatial relationships and deriving actionable insights from complex satellite imagery datasets.
AB - The effective analysis of spatial data from diverse sources, such as satellite imagery and aerial views, remains pivotal for informed decision-making across various domains. This paper presents a novel framework for semantic segmentation and spatial relationship modeling in hyperspectral imagery using advanced deep learning techniques and graph-based representations. Our methodology integrates state-of-the-art models including U-Net, SegNet, and ResUNet to achieve precise object segmentation in high-resolution images, leveraging their capabilities in capturing fine details and intricate boundaries. By preprocessing data from datasets like the Dubai dataset for semantic segmentation and drone datasets for spatial analysis, we standardize and enhance image quality, preparing them for robust model training. Following segmentation, we employ a relation network model based on LSTM and GRU architectures to extract semantic relationships between identified object pairs within the segmented images. This approach draws on principles from scene graph generation, enhancing scene understanding by structuring spatial relationships into interpretable graph representations. The framework's versatility is demonstrated through applications in urban planning, environmental monitoring, and disaster response, where the visualization of spatial interactions as graphs facilitates intuitive decision-making processes. Through rigorous evaluation and comparison with benchmark methods, we validate the effectiveness of our approach in accurately capturing spatial relationships and deriving actionable insights from complex satellite imagery datasets.
KW - Decision support systems
KW - Deep learning
KW - Disaster response
KW - Environmental monitoring
KW - GRU
KW - Graph-based representation
KW - LSTM
KW - Relation network models
KW - ResUNet
KW - Satellite imagery
KW - Scene understanding
KW - SegNet
KW - Spatial relationship modeling
KW - U-Net
KW - Urban planning
UR - https://www.scopus.com/pages/publications/86000248215
U2 - 10.1109/WHISPERS65427.2024.10876420
DO - 10.1109/WHISPERS65427.2024.10876420
M3 - Conference contribution
AN - SCOPUS:86000248215
T3 - Workshop on Hyperspectral Image and Signal Processing, Evolution in Remote Sensing
BT - 2024 14th Workshop on Hyperspectral Imaging and Signal Processing
PB - Institute of Electrical and Electronics Engineers
T2 - 14th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, WHISPERS 2024
Y2 - 9 December 2024 through 11 December 2024
ER -