ApacheCon NA 2013

Portland, Oregon

February 26th – 28th, 2013

Register Now!

Wednesday 11:15 a.m.–12:15 p.m.

Case Study: Apache OODT Framework Application for Support to the Joint Polar Satellite System (JPSS)

Richard Ullman, Peyush Jain

Track:
Apache in Science
Audience level:
Intermediate

Description

Does OODT scale to very large data volume missions? We will describe our experience in applying OODT to the design of a high volume science data system at NASA’s Goddard Space Flight Center. We will describe the data system concept; an overview of our requirements; how we applied OODT components to our design; and the testing and tailoring we performed to gain confidence in OODT performance.

Abstract

The Joint Polar Satellite System (JPSS) will address the nation’s requirements to provide global environmental data necessary to monitor the Earth, manage resources, support the Nation’s economy, and protect lives and property. Developed by the National Aeronautics and Space Administration (NASA) for the National Oceanic and Atmospheric Administration (NOAA), the JPSS program integrates a series of polar-orbiting environmental satellites with a single Common Ground System (CGS). This new satellite and ground system represents a major upgrade to the satellites that combined have served for nearly 50 years. The JPSS precursor satellite, Suomi National Polar Partnership (S-NPP) was launched in October 2011 and provides nearly 5 TB of observational products every day to enhance our ability to perform weather forecast, disaster response and environmental modeling.

A critical component of ground data processing for environmental satellites is the derivation of environmental parameters from the raw observations. This translation from photons to products uses science algorithms validated against known conditions. We are using OODT to provide the framework for a high-volume science data system to support algorithm development, science validation, operational algorithm support and data product quality monitoring. In this talk, we will describe our application of components from the OODT, what custom tailoring we required and how we have gained confidence in system performance.