Jump to content

GSFC Data Science Group Releases Innovative Foundation Model: SatVision Top-Of-Atmosphere (TOA)


Recommended Posts

  • Publishers
Posted

At Goddard Space Flight Center, the GSFC Data Science Group has completed the testing for their SatVision Top-of-Atmosphere (TOA) Foundation Model, a geospatial foundation model for coarse-resolution all-sky remote sensing imagery. The team, comprised of Mark Carroll, Caleb Spradlin, Jordan Caraballo-Vega, Jian Li, Jie Gong, and Paul Montesano, has now released their model for wide application in science investigations.

Foundation models can transform the landscape of remote sensing (RS) data analysis by enabling the pre-training of large computer-vision models on vast amounts of remote sensing data. These models can be fine-tuned with small amounts of labeled training and applied to various mapping and monitoring applications. Because most existing foundation models are trained solely on cloud-free satellite imagery, they are limited to applications of land surface or require atmospheric corrections. SatVision-TOA is trained on all-sky conditions which enables applications involving atmospheric variables (e.g., cloud or aerosol).

SatVision TOA is a 3 billion parameter model trained on 100 million images from Moderate Resolution Imaging Spectroradiometer (MODIS). This is, to our knowledge, the largest foundation model trained solely on satellite remote sensing imagery. By including “all-sky” conditions during pre-training, the team incorporated a range of cloud conditions often excluded in traditional modeling. This enables 3D cloud reconstruction and cloud modeling in support of Earth and climate science, offering significant enhancement for large-scale earth observation workflows.

With an adaptable and scalable model design, SatVision-TOA can unify diverse Earth observation datasets and reduce dependency on task-specific models. SatVision-TOA leverages one of the largest public datasets to capture global contexts and robust features. The model could have broad applications for investigating spectrometer data, including MODIS, VIIRS, and GOES-ABI. The team believes this will enable transformative advancements in atmospheric science, cloud structure analysis, and Earth system modeling.

The model architecture and model weights are available on GitHub and Hugging Face, respectively. For more information, including a detailed user guide, see the associated white paper: SatVision-TOA: A Geospatial Foundation Model for Coarse-Resolution All-Sky Remote Sensing Imagery

Examples of image reconstruction by SatVision-TOA. Left: MOD021KM v6.1 cropped image chip using MODIS bands [1, 3, 2]. Middle: The same images with randomly applied 8 × 8 mask patches, masking 60% of the original image. Right: The reconstructed images produced by the model, along with their respective Structural Similarity Index Measure (SSIM) scores. These examples illustrate the model’s ability to preserve structural detail and reconstruct heterogeneous features, such as cloud textures and land-cover transitions, with high fidelity.
Examples of image reconstruction by SatVision-TOA. Left: MOD021KM v6.1 cropped image chip using MODIS bands [1, 3, 2]. Middle: The same images with randomly applied 8×8 mask patches, masking 60% of the original image. Right: The reconstructed images produced by the model, along with their respective Structural Similarity Index Measure (SSIM) scores. These examples illustrate the model’s ability to preserve structural detail and reconstruct heterogeneous features, such as cloud textures and land-cover transitions, with high fidelity.
NASA

View the full article

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Similar Topics

    • By NASA
      3 min read
      Preparations for Next Moonwalk Simulations Underway (and Underwater)
      The G-IV aircraft flies overhead in the Mojave Desert near NASA’s Armstrong Flight Research Center in Edwards, California. Baseline flights like this one occurred in June 2024, and future flights in service of science research will benefit from the installment of the Soxnav navigational system, developed in collaboration with NASA’s Jet Propulsion Laboratory in Southern California and the Bay Area Environmental Research Institute in California’s Silicon Valley. This navigational system provides precise, economical aircraft guidance for a variety of aircraft types moving at high speeds.NASA/Carla Thomas NASA and its partners recently tested an aircraft guidance system that could help planes maintain a precise course even while flying at high speeds up to 500 mph. The instrument is Soxnav, the culmination of more than 30 years of development of aircraft navigation systems.
      NASA’s G-IV aircraft flew its first mission to test this navigational system from NASA’s Armstrong Flight Research Center in Edwards, California, in December 2024. The team was composed of engineers from NASA Armstrong, NASA’s Jet Propulsion Laboratory in Southern California, and the Bay Area Environmental Research Institute (BAERI) in California’s Silicon Valley.
      “The objective was to demonstrate this new system can keep a high-speed aircraft within just a few feet of its target track, and to keep it there better than 90% of the time,” said John Sonntag, BAERI independent consultant co-developer of Soxnav.
      With 3D automated steering guidance, Soxnav provides pilots with a precision approach aid for landing in poor visibility. Previous generations of navigational systems laid the technical baseline for Soxnav’s modern, compact, and automated iteration.
      “The G-IV is currently equipped with a standard autopilot system,” said Joe Piotrowski Jr., operations engineer for the G-IV. “But Soxnav will be able to create the exact level flight required for Next Generation Airborne Synthetic Aperture Radar (AirSAR-NG) mission success.”
      Jose “Manny” Rodriguez adjusts the Soxnav instrument onboard the G-IV aircraft in December 2024. As part of the team of experts, Rodriguez ensures that the electronic components of this instrument are installed efficiently. His expertise will help bring the innovative navigational guidance of the Soxnav system to the G-IV and the wider airborne science fleet at NASA. Precision guidance provided by the Soxnav enables research aircraft like the G-IV to collect more accurate, more reliable Earth science data to scientists on the ground.NASA/Steve Freeman Guided by Soxnav, the G-IV may be able to deliver better, more abundant, and less expensive scientific information. For instance, the navigation tool optimizes observations by AirSAR-NG, an instrument that uses three radars simultaneously to observe subtle changes in the Earth’s surface. Together with the Soxnav system, these three radars provide enhanced and more accurate data about Earth science.
      “With the data that can be collected from science flights equipped with the Soxnav instrument, NASA can provide the general public with better support for natural disasters, tracking of food and water supplies, as well as general Earth data about how the environment is changing,” Piotrowski said.
      Ultimately, this economical flight guidance system is intended to be used by a variety of aircraft types and support a variety of present and future airborne sensors. “The Soxnav system is important for all of NASA’s Airborne Science platforms,” said Fran Becker, project manager for the G-IV AirSAR-NG project at NASA Armstrong. “The intent is for the system to be utilized by any airborne science platform and satisfy each mission’s goals for data collection.”
      In conjunction with the other instruments outfitting the fleet of airborne science aircraft, Soxnav facilitates the generation of more abundant and higher quality scientific data about planet Earth. With extreme weather events becoming increasingly common, quality Earth science data can improve our understanding of our home planet to address the challenges we face today, and to prepare for future weather events.
      “Soxnav enables better data collection for people who can use that information to safeguard and improve the lives of future generations,” Sonntag said.
      Share
      Details
      Last Updated Feb 07, 2025 EditorDede DiniusContactErica HeimLocationArmstrong Flight Research Center Related Terms
      Airborne Science Armstrong Flight Research Center B200 Earth Science Jet Propulsion Laboratory Explore More
      5 min read NASA CubeSat Finds New Radiation Belts After May 2024 Solar Storm
      Key Points The largest solar storm in two decades hit Earth in May 2024. For…
      Article 24 hours ago 2 min read Wind Over Its Wing: NASA’s X-66 Model Tests Airflow
      Article 2 days ago 3 min read NASA’s Cloud-based Confluence Software Helps Hydrologists Study Rivers on a Global Scale
      Rivers and streams wrap around Earth in complex networks millions of miles long, driving trade,…
      Article 3 days ago Keep Exploring Discover More Topics From NASA
      Armstrong Flight Research Center
      Earth Science
      Aircraft Flown at Armstrong
      Armstrong Science Projects
      View the full article
    • By Space Force
      Memorandum on Revocation of Officer Source of Commission Applicant Pool Goals.
      View the full article
    • By NASA
      Credit: NASA The Aerospace Safety Advisory Panel (ASAP), an advisory committee that reports to NASA and Congress, issued its 2024 annual report Thursday examining the agency’s safety performance, accomplishments, and challenges during the past year.
      The report highlights 2024 activities and observations on NASA’s work, including:
      strategic vision and agency governance Moon to Mars management future of U.S. presence in low Earth orbit health and medical risks in human space exploration “Over the past year, NASA has continued to make meaningful progress toward meeting the intent of the broad-ranging recommendations the panel has made over the last several years,” said retired U.S. Air Force Lt. Gen. Susan J. Helms, chair of ASAP. “We believe that the agency’s careful attention to vision, strategy, governance, and program management is vital to the safe execution of NASA’s complex and critical national mission.”
      This year’s report reflects the panel’s continued focus on NASA’s strategies for risk management and safety culture in an environment of growing space commercialization. Specifically, the panel cites its 2021 recommendations for NASA on preparing for future challenges in a changing landscape, including the need to evaluate NASA’s approach to safety and technical risk and to evolve its role, responsibilities, and relationships with private sector and international partners.
      Overall, the panel finds NASA is continuing to make progress with respect to the agency’s strategic vision, approach to governance, and integrated program management. The NASA 2040 new agencywide initiative is working to operationalize the agency’s vision and strategic objectives across headquarters and centers. With the establishment of NASA’s Moon to Mars Program Office in 2023, it finds NASA has implemented safety and risk management as a key focus for NASA’s Artemis campaign.
      The 2024 report provides details on the concrete actions the agency should take to fulfill its previous recommendations and spotlights its recommendations for the agency moving ahead. It addresses safety assessments for Moon to Mars and current International Space Station operations, as well as risk-related issues surrounding NASA’s planned transition to commercial low Earth orbit destinations.
      It covers relevant areas of human health and medicine in space and the impact of budget constraints and uncertainty on safety.
      The annual report is based on the panel’s 2024 fact-finding and quarterly public meetings; direct observations of NASA operations and decision-making; discussions with NASA management, employees, and contractors; and the panel members’ experiences.
      Congress established the panel in 1968 to provide advice and make recommendations to the NASA administrator on safety matters after the 1967 Apollo 1 fire claimed the lives of three American astronauts.
      To learn more about the ASAP, and view annual reports, visit:
      https://www.nasa.gov/asap
      -end-
      Jennifer Dooren / Elizabeth Shaw
      Headquarters, Washington
      202-358-1600
      jennifer.m.dooren@nasa.gov / elizabeth.a.shaw@nasa.gov
      Share
      Details
      Last Updated Feb 06, 2025 EditorJessica TaveauLocationNASA Headquarters Related Terms
      Aerospace Safety Advisory Panel View the full article
    • By Space Force
      Memorandum on Limited Facilities-Based Exemption for Return to In-Person Work in compliance with Secretary of Defense Memorandum Initial Department of Defense Implementation Guidance, Return to In-Person Work.
      View the full article
    • By NASA
      2 min read
      Preparations for Next Moonwalk Simulations Underway (and Underwater)
      NASA’s Sustainable Flight Demonstrator project concluded wind tunnel testing in the fall of 2024. Tests on a Boeing-built X-66 model were completed at NASA’s Ames Research Center in California’s Silicon Valley in its 11-Foot Transonic Unitary Plan Facility. The model underwent tests representing expected flight conditions to obtain engineering information to influence design of the wing and provide data for flight simulators.NASA/Brandon Torres Navarrete NASA’s Sustainable Flight Demonstrator (SFD) project recently concluded wind tunnel tests of its X-66 semi-span model in partnership with Boeing. The model, designed to represent half the aircraft, allows the research team to generate high-quality data about the aerodynamic forces that would affect the actual X-66.
      Test results will help researchers identify areas where they can refine the X-66 design – potentially reducing drag, enhancing fuel efficiency, or adjusting the vehicle shape for better flying qualities.
      Tests on the Boeing-built X-66 semi-span model were completed at NASA’s Ames Research Center in California’s Silicon Valley in its 11-Foot Transonic Unitary Plan Facility. The model underwent tests representing expected flight conditions so the team could obtain engineering information to influence the design of the aircraft’s wing and provide data for flight simulators.
      NASA’s Sustainable Flight Demonstrator project concluded wind tunnel testing in the fall of 2024. Tests on a Boeing-built X-66 model were completed at NASA’s Ames Research Center in California’s Silicon Valley in its 11-Foot Transonic Unitary Plan Facility. Pressure points, which are drilled holes with data sensors attached, are installed along the edge of the wing and allow engineers to understand the characteristics of airflow and will influence the final design of the wing.NASA/Brandon Torres Navarrete Semi-span tests take advantage of symmetry. The forces and behaviors on a model of half an aircraft mirror those on the other half. By using a larger half of the model, engineers increase the number of surface pressure measurements. Various sensors were placed on the wing to measure forces and movements to calculate lift, drag, stability, and other important characteristics.
      The semi-span tests follow earlier wind tunnel work at NASA’s Langley Research Center in Hampton, Virginia, using a smaller model of the entire aircraft. Engineers will study the data from all of the X-66 wind tunnel tests to determine any design changes that should be made before fabrication begins on the wing that will be used on the X-66 itself.
      The SFD project is NASA’s effort to develop more efficient aircraft configurations as the nation moves toward aviation that’s more economically, societally, and environmentally sustainable. The project seeks to provide information to inform the next generation of single-aisle airliners, the most common aircraft in commercial aviation fleets around the world.  Boeing and NASA are partnering to develop the X-66 experimental demonstrator aircraft.
      Share
      Details
      Last Updated Feb 05, 2025 EditorDede DiniusContactSarah Mannsarah.mann@nasa.govLocationArmstrong Flight Research Center Related Terms
      Armstrong Flight Research Center Aeronautics Ames Research Center Green Aviation Tech Langley Research Center Sustainable Aviation Explore More
      5 min read NASA Demonstrates Software ‘Brains’ Shared Across Satellite Swarms  
      Article 1 day ago 2 min read NASA Awards Contract for Airborne Science Flight Services Support
      Article 2 days ago 3 min read NASA Radar Imagery Reveals Details About Los Angeles-Area Landslides
      Article 5 days ago Keep Exploring Discover More Topics From NASA
      Armstrong Flight Research Center
      Aeronautics
      Green Aviation Tech
      Aircraft Flown at Armstrong
      View the full article
  • Check out these Videos

×
×
  • Create New...