Developing an Integrated Climate Research Environment

Developing an Integrated Climate Research Environment

By

JayaramanGaneshmani,

NishanthKommidi,

Stephan Mazzucco,

Anupam Tambi

CS 5332 Information Retrieval Syllabus (Fall 2012)

October 15, 2012

Contents

1. INTRODUCTION 3

2. LITERATURE REVIEW 5

2.1 NASA's Climate Simulation Data Management System 5

a. iRODS Overview 6

2.2 Distributed Data management System 7

2.3 Unidata's Internet Data Distribution (IDD) System 8

2.4 The Climate-G testbed: towards large scale distributed data management for climate change 10

3. Preliminary Design 12

3.1 Design Decisions 12

3.2 Conceptual Model – Acquisition and Storage 12

3.3 Conceptual Model – Retrieval 13

3.4 Realization of Conceptual Model using iRODS – Acquisition and Storage 13

3.5 Realization of Conceptual Model using iRODS – Retrieval 14

4. Expected Iterations and Deliverables 14

5. Development Plan 14

6. Proposal Tasks by Team Member 14

1. INTRODUCTION

Weather data today are spatially distributed; a GIS could offer a practical and relevant working environment for the integration, analysis and visualization of these data together with other spatial data sources.

Environment and climate scientists have a need to accesslarge geographically and temporally varying datasets, often from a variety of sources, in order to carry out their research. There are large amounts of critical multi-variate data that have been or are being generated. These new data offer great potentials for researchers to discover new climatic findings/ relationships and to make better forecasts if the data are made accessible and retrievable promptly and appropriately for climate studies. However, these large-scale heterogeneous datasets are presented, over time, with very different structures and formats that require substantial efforts to process in order to be able to make any effective use of them, even with a number of current