Semantic Segmentation and Spatial Relationship Modeling in Hyperspectral Imagery Using Deep Learning and Graph-Based Representations

Ravikumar Yenni, P. V. Arun

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

The effective analysis of spatial data from diverse sources, such as satellite imagery and aerial views, remains pivotal for informed decision-making across various domains. This paper presents a novel framework for semantic segmentation and spatial relationship modeling in hyperspectral imagery using advanced deep learning techniques and graph-based representations. Our methodology integrates state-of-the-art models including U-Net, SegNet, and ResUNet to achieve precise object segmentation in high-resolution images, leveraging their capabilities in capturing fine details and intricate boundaries. By preprocessing data from datasets like the Dubai dataset for semantic segmentation and drone datasets for spatial analysis, we standardize and enhance image quality, preparing them for robust model training. Following segmentation, we employ a relation network model based on LSTM and GRU architectures to extract semantic relationships between identified object pairs within the segmented images. This approach draws on principles from scene graph generation, enhancing scene understanding by structuring spatial relationships into interpretable graph representations. The framework's versatility is demonstrated through applications in urban planning, environmental monitoring, and disaster response, where the visualization of spatial interactions as graphs facilitates intuitive decision-making processes. Through rigorous evaluation and comparison with benchmark methods, we validate the effectiveness of our approach in accurately capturing spatial relationships and deriving actionable insights from complex satellite imagery datasets.

Original languageEnglish
Title of host publication2024 14th Workshop on Hyperspectral Imaging and Signal Processing
Subtitle of host publicationEvolution in Remote Sensing, WHISPERS 2024
PublisherInstitute of Electrical and Electronics Engineers
ISBN (Electronic)9798331513139
DOIs
StatePublished - 1 Jan 2024
Event14th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, WHISPERS 2024 - Helsinki, Finland
Duration: 9 Dec 202411 Dec 2024

Publication series

NameWorkshop on Hyperspectral Image and Signal Processing, Evolution in Remote Sensing
ISSN (Print)2158-6276

Conference

Conference14th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, WHISPERS 2024
Country/TerritoryFinland
CityHelsinki
Period9/12/2411/12/24

Keywords

  • Decision support systems
  • Deep learning
  • Disaster response
  • Environmental monitoring
  • GRU
  • Graph-based representation
  • LSTM
  • Relation network models
  • ResUNet
  • Satellite imagery
  • Scene understanding
  • SegNet
  • Spatial relationship modeling
  • U-Net
  • Urban planning

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Semantic Segmentation and Spatial Relationship Modeling in Hyperspectral Imagery Using Deep Learning and Graph-Based Representations'. Together they form a unique fingerprint.

Cite this