On aligning SAM to remote sensing data

Rajat Sahay; Andreas Savakis

doi:10.1117/12.3014163

10 June 2024 On aligning SAM to remote sensing data

Rajat Sahay, Andreas Savakis

Proceedings Volume 13037, Geospatial Informatics XIV; 1303703 (2024) https://doi.org/10.1117/12.3014163
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

The Segment Anything Model (SAM) has demonstrated exceptional capabilities for object segmentation in various settings. In this work, we focus on the remote sensing domain and examine whether SAM’s performance can be improved for overhead imagery and geospatial data. Our evaluation indicates that directly applying the pretrained SAM model to aerial imagery does not yield satisfactory performance due to the domain gap between natural and aerial images. To bridge this gap, we utilize three parameter-efficient fine-tuning strategies and evaluate SAM’s performance across a set of diverse benchmarks. Our results show that while a vanilla SAM model lacks the intrinsic ability to generate accurate masks for smaller objects often found in overhead imagery, fine-tuning greatly improves performance and produces results comparable to current state-of-the-art techniques.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Rajat Sahay and Andreas Savakis "On aligning SAM to remote sensing data", Proc. SPIE 13037, Geospatial Informatics XIV, 1303703 (10 June 2024); https://doi.org/10.1117/12.3014163

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available