Presentation - Computational Information Systems
Transcription
Presentation - Computational Information Systems
Climate Modeling at the Center for Ocean-LandAtmosphere Studies Jim Kinter, COLA Center of Ocean-LandAtmosphere Studies Computing in the Atmospheric Sciences Annecy, France September Jim Kinter 14 - Computing in the Atmospheric2009 Sciences || Annecy, France || 14 September 2009 Institute of Global Environment and Society (IGES) IGES Board Board of of Directors Directors President: President: J. J. Shukla Shukla Executive Committee Scientific Adv. Comm. Business Office COLA Information Systems CREW Center -LandOcean Land-Atmosphere Center for for OceanOcean-Land-Atmosphere Studies Studies (established (established 1993) 1993) Director: J. Kinter (2005) Director: J. Kinter (2005) Center Center for for Research Research on on Environment Environment and and Water Water (established (established 2005) 2005) Director: L. Gates (2009) Director: L. Gates (2009) JAMES JAMES Journal Journal of of Advances Advances in in Modeling Modeling of of Earth Earth Systems Systems Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 http://adv-model-earth-syst.org/ Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Institute of Global Environment and Society (IGES) IGES Board Board of of Directors Directors President: President: J. J. Shukla Shukla Executive Committee Scientific Adv. Comm. Business Office COLA Information Systems CREW Center -LandOcean Land-Atmosphere Center for for OceanOcean-Land-Atmosphere Studies Studies (established (established 1993) 1993) Director: J. Kinter (2005) Director: J. Kinter (2005) Center Center for for Research Research on on Environment Environment and and Water Water (established (established 2005) 2005) Director: L. Gates (2009) Director: L. Gates (2009) JAMES JAMES Journal Journal of of Advances Advances in in Modeling Modeling of of Earth Earth Systems Systems Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Vision and Mission VISION Global Society Benefits from Basic and Applied Research and Education on Climate Variability and Predictability and the Free Access to Data and Research Tools MISSION Explore, Establish and Quantify the Predictability and Prediction of Sub-Seasonal to Decadal Variability in a Changing Climate Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 “Omnibus” Funding COLA is supported by NSF (lead), NOAA and NASA through a single jointly-peer-reviewed*, jointly-funded five-year proposal. * Thanks to our peers and the agencies 2009-2014 Predictability of the Physical Climate System (awarded 9/1/2009) Funding: ~$4M / yr (NSF - 52%; NOAA - 36%; NASA - 12%) Principal Investigator: Kinter Co-Investigators: DelSole, Dirmeyer, Huang, Kirtman, Klinger, Krishnamurthy, Lu, Schneider, Shukla, Straus 2004-2008 Predictability of Earth’s Climate Funding: ~$3.25M / yr (NSF - 46%; NOAA - 39%; NASA - 15%) Principal Investigator: Shukla Co-Investigators: DelSole, Dirmeyer, Huang, Kinter, Kirtman, Klinger, Krishnamurthy, Misra, Schneider, Schopf, Straus 1999-2003 Predictability and Variability of the Present Climate Funding: ~$2.75M / yr Principal Investigator: Co-PIs: Co-investigators: 1994-1998 Predictability and Variability of the Present Climate Funding: $2.25M /yr Principal Investigator: Co-PIs: Center of Ocean-LandAtmosphere Studies J. Shukla J. Kinter, E. Schneider, P. Schopf, D. Straus P. Dirmeyer, B. Huang, B. Kirtman J. Shukla J. Kinter, E. Schneider, D. Straus Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Core Staff (1983-1993: University of Maryland; 1993-present: IGES) Scientist J. L. Kinter III * Highest Degree Ph.D. Princeton (1984) Joined 1984 Dir. COLA (2005-present); Exec. Dir. COLA (1993-2004) T. DelSole * P. A. Dirmeyer B. E. Doty * M. J. Fennessy B. Huang * V. Krishnamurthy * J. Lu * L. Marx D. A. Paolino E. K. Schneider * J. Shukla * D. M. Straus * Ph.D. Harvard (1993) 1997 Ph.D. Maryland (1992) 1991 B.S. N. Illinois (1978) 1984 M.S. SUNY-Albany (1980) 1984 Ph.D. Maryland (1992) 1991 Ph.D. M.I.T. (1985) 1983 Ph.D. Dalhousie (2003) 2008 M.S. MIT (1977) 1983 M.S. Illinois (1980) 1984 Ph.D. Harvard (1976) 1984 Sc.D. MIT (1976); Ph.D. BHU (1971) 1983 Pres., IGES (1993-present); Dir. COLA (1993-2004) Ph.D. Cornell (1977) 1983 * also affiliated with George Mason University Your most precious possessions are the people you have working there, and what they carry around in their heads, and their ability to work together. Center of Ocean-LandAtmosphere Studies - Robert Reich Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Scientific Staff Scientist D. Achuthavarier B. Cash E. Jin * Z. Guo Z. Hu B. Klinger * J. Lu * J. Manganello X. Pan C. Stan J. Wei R. Wu X. Yang L. Zhang Highest Degree Joined Ph.D. George Mason (2009) Ph.D. Penn State (2000) Ph.D. Seoul National (2005) Ph.D. Ohio State (2002) Ph.D. Beijing (1991) Ph.D. MIT-WHOI (1992) Ph.D. Dalhousie (2003) Ph.D. GMU (2004) Ph.D. George Mason (2009) Ph.D. Colorado State (2004) Ph.D. Georgia Tech (2007) Ph.D. Hawaii (1999) Ph.D. SUNY-Albany (2006) Ph.D. Texas A&M (2005) 2009 2002 2006 2002 2000 2000 2008 2006 2009 2005 2007 2002 2006 2007 * also affiliated with George Mason University Your most precious possessions are the people you have working there, and what they carry around in their heads, and their ability to work together. Center of Ocean-LandAtmosphere Studies - Robert Reich Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Technical and IT Staff Scientist J. Adams E. Altshuler C. Steinmetz, Dir. T. Wakefield Highest Degree M.S. Washington (1993) M.S. Maryland (1996) Ph.D. Purdue (1991) B.S. Maryland (2004) Joined 1999 1998 1998 2000 Your most precious possessions are the people you have working there, and what they carry around in their heads, and their ability to work together. Center of Ocean-LandAtmosphere Studies - Robert Reich Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 GrADS and GDS • GrADS has O(104) users worldwide with O(104) of copies of the S/W downloaded • GrADS figures are frequently found in weather and climate journals, e.g. up to a third of J. Climate graphics • GrADS is used to generate figures on dozens of NOAA, NASA, university and non-US weather and climate data web pages (www.iges.org/grads/gotw.html) • GDS serves thousands of unique users (millions of hits) monthly from NOAA/NOMADS, NASA/LIS, CEOP etc. • COLA GDS (including NCAR dataportal) 2003-2007: – > 100 million hits (80 million data requests) – > 4.5 TB sent – Averaging > 1,200 unique IPs/month Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 2005 Edition Figures made with GrADS Courtesy of Jennifer Adams, COLA Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 COLA Computing Facility Lustre Filesystem 1.8 M “compute” CPU-hrs/y ~80 TB online storage 80 TB Storage Network (switched 1Gb/s) Infiniband 10Gb/s Compute Cluster Compute Nodes Login/Analysis Nodes 176 CPUs 64 CPUs 10 CPUs Tape Archival Desktop Network (switched 100Mb/s) Desktops Network Printing World Wide Web Web Services ~90 GB/mo I2 & T1 >1 Gb/s capacity NCAR SCD Community Computing NCAR SCD Climate Simulation Lab NSF TeraGrid NASA Ames NAS Facility 0.8 M CPU-hrs/y 1.8 M CPU-hrs/y 35 M CPU-hrs 2.3 M CPU-hrs/y Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Balancing Future Demands on Computing Power 1/120 Resolution EO, Data Assimilation Computing Resources Dur Center of Ocean-LandAtmosphere Studies ity x e l p C om atio na nd/ or E n sem ble size Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Overarching Scientific Questions What limits predictability at all time scales from days to decades? Is there a fundamental limit? What is the role of model error? Initial conditions error? What contributes to predictability at different time scales in the initial state, the coupling of system components, and the changes in external forcing? What aspects of the total climate system (global troposphere, stratosphere, world oceans, sea ice, land surface state, vegetation, snow) are predictable in which geographic regions, for which seasons, and how does that change in the future? For the current generation of climate models and observing systems? Future generations? What is the optimal combination of models to predict means? Extremes? Current models have huge limitations, e.g. for regional water cycle ⇒ need to develop a multimodel ensemble combination that produces the best forecast Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Representative Projects Omnibus: I-S-I Predictability Studies with CCSM and CFS (NCAR CSL) PetaApps: Climate Models Representation of Unpredictable Noise in the Atmosphere, Ocean or Sea Ice (TeraGrid Ranger and Kraken) Multiscale Modeling Framework: Superparameterization Cloud-System Resolving Model for Coupled Climate Simulation (Collaboration with CSU CMMAP; NCAR Community Computing) Project Athena: An International, Dedicated High-End Computing Project to Revolutionize Climate Modeling (Dedicated XT4 at NICS) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Representative Projects Omnibus: I-S-I Predictability Studies with CCSM and CFS (NCAR CSL) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Multi-Model with US National Models Institutional Collaborations • Community Climate System Model (CCSM; NSF) – Leading effort to correct tropical biases – Adaptation as seasonal predictability research tool • Climate Forecast System (CFS; NOAA - Climate Test Bed) – Participation in external and internal CTB planning – Predictability research with NCEP CFS – Work toward multi-model prediction capability • Modeling, Analysis and Prediction (MAP) (GEOS; NASA) – New ESMF-based model (GEOS-5) in multi-model ensemble – Utilizing NASA satellite data for predictability and prediction research focused on characterizing role of noise and initialization Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Pacemaker Strategy: Overcoming Shortcomings of Coupled Models Observed Observed Pacemaker JJA Rainfall Composite (El Nino - La Nina) Pacemaker design: specified SST regions Pacemaker DJF SST Composite (El Nino - La Nina) The “pacemaker” strategy, recently adopted by the International C20C Project, permits a consistent air-sea energy balance while simultaneously including the time sequence of climate-driver events, such as ENSO. Teleconnections from the eastern tropical Pacific to remote tropical and extratropical regions are well represented in pacemaker runs, e.g., phenomena that are at once driven by and independent of ENSO, like the Asian monsoon. Cash et al. 2007 Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 CCSM3.0 Jan 1982 IC CFS Jan 1982 IC Courtesy of Ben Kirtman Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 CCSM3.0 Jan 1988 IC CFS Jan 1988 IC Courtesy of Ben Kirtman Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Land-Atmosphere Interactions over the Great Plains a) Coupling strength from Koster, Dirmeyer, Guo et al. (2004) showing “hotspots” for land-atmosphere coupling b) Estimate of “GLACE diagnostic”* from 12 land surface models (Guo et al. 2007) c) COLA GCM (10-year integration with specified observed SST) anomaly correlation of Ts (horizontal scale) and change in correlation when observed vegetation properties are specified (vertical scale; Gao et al. 2007) * Evaporation variability times a land-atmospheric flux connection function based on the tightness of the dependence of surface fluxes on soil moisture Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 CCSM Re-Forecasts with Land ICs Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Influence of Systematic Error on CFS Forecast Skill NINO3: Warm minus Cold composite CORR. with respect to lead month based on 1st SEOF mode of SST Correlation SST anomalies 1 0.9 0.8 0.7 (Hindcast composite) Observation CFS long run ¾ Warm composite (82/83, 86/87, 91/92, 97/98) Cold composite (84/85, 88/89, 98/99, 99/00) ¾ Dashed lines denote composite for Hindcasts at different lead times Center of Ocean-LandAtmosphere Studies 1 2 3 4 5 6 7 8 9 Forecast lead month Correlation between 1st PCs based on observation and hindcasts at different lead times Correlation between 1st PCs based on long run and hindcasts at different lead times Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Representative Projects PetaApps: Climate Models Representation of Unpredictable Noise in the Atmosphere, Ocean or Sea Ice (TeraGrid Ranger and Kraken - Cray XT-5) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Peta-Apps Team • • • • • • • • • • • • • Ahearn, NCAR Bitz, U. Washington Bryan, NCAR (interested party) Collins, UC Berkeley (co-PI) Dennis, NCAR Kinter, COLA (PI) Kirtman, U. Miami (co-PI) Loft, NCAR (co-PI) Min, U. Miami Nolan, UC Berkeley (grad student) Siquiera, U. Miami (grad student) Stan, COLA Yelick, LBL (co-PI) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Peta-Apps Hypotheses • Goal: Quantifying/reducing uncertainty from: – Initial conditions – Model physics • Extending the interactive ensemble – Atmospheric noise • High-res IE test - qualitatively different? • Synthetic noise from external source (high-res AMIP) – Noise in other climate system components • Ocean • Land • Sea ice – Stochastic physics Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Ensemble of N AGCMs all receive same SST(x,y,t) AGCM1 AGCM2 Response1 Response2 AGCMN ••• ResponseN Ensemble Mean Response Average N members’ responses Observed SST AMIP/GOGA Ensemble Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 AGCM1 AGCM2 Sfc Fluxes1 Sfc Fluxes2 ••• AGCMN Sfc FluxesN SST1 SST2 SSTN OGCM1 OGCM2 OGCMN Coupled Model Ensemble Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Ensemble of N AGCMs all receive same OGCM-output SST each day AGCM1 AGCM2 Sfc Fluxes1 Sfc Fluxes2 AGCMN ••• Sfc FluxesN average (1, …, N) Average N members’ surface fluxes each day Ensemble Mean Sfc Fluxes OGCM receives ensemble average of AGCM output fluxes each day SST OGCM Interactive Ensemble Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Ensemble of N AGCMs all receive same OGCM-output SST each day AGCM1 AGCM2 Sfc Fluxes1 Sfc Fluxes2 ••• AGCMN Sfc FluxesN rand (1, …, N) Randomly select surface fluxes from 1 member each day Selected Member’s Sfc Fluxes OGCM receives output of single, randomly-selected AGCM each day SST OGCM Random Interactive Ensemble Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 PetaApps NSF PetaApps proposal funded - three-year research and development effort, aimed at enabling a broad climate science capability for petascale systems • Interactive ensembles using CCSM/CPL7 • Incorporate and examine use of PGAS language (Titanium) in CCSM time Driver CAM CAM CAM CAM CLM CICE POP Interactive ensembles will be used to understand how oceanic and atmospheric weather noise impacts climate variability Titanium will be used in the flux coupler to examine impact of PGAS language approach to performance and memory footprint processors Courtesy Mariana Vertenstein, NCAR Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 0.5° 0.1° Courtesy John Dennis, NCAR Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Representative Projects Multiscale Modeling Framework: Superparameterization Cloud-System Resolving Model for Coupled Climate Simulation (Collaboration with CSU CMMAP; NCAR Community Computing) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Accuracy / Resolution Issues in the Atmosphere Convective parameterization - when does it help? hurt? Convective parameterization tends to reduce strength of tropical storms, cloud time scale is key parameter; may be better off without CU parameterization (GMAO finding) 35-km resolution needed to get seasonal cycle of tropical storm frequency (NCEP finding) Crossover resolution at which no CU parameterization is better may be ~ 20 km (GFDL hypothesis) Evidence that cloud-resolving models are qualitatively different … 50-km or even 25-km resolution is needed to get statistics of extratropical winter storms right (ECMWF finding) 17-km resolution may be required to get important extreme events in extratropics right (ECMWF finding) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Today, scalable dycores can’t break 1 simulated year per day even at 12.5 km… Full CAM Physics/HOMME Dycore on Blue Gene/L Parallel I/O library used for physics aerosol input and input data ( work COULD NOT have been done without Parallel IO) Work underway to couple to other CCSM components 5 years/day 1 year/day Courtesy Mark Taylor, SNL Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 What is MMF*? AGCM domain CRM domain TOA N ΔXCRM E Center of Ocean-LandAtmosphere Studies ΔXAGCM, ΔYAGCM * M. Khairoutdinov and D. Randall Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Model Configurations SP-CCSM Ctl-CCSM HR-CCSM (PetaApps Proj) 1 Horiz. Res. T42 (sld1) T42 (sld1) 0.47x0.63 (fv2) Vert. levels 30 26 26 Deep conv. CRM3 ZM ZM_New4 Shallow conv. CRM3 Hack Hack Horiz. Res. gx3v5 gx3v5 tx0.1v2 Vert. levels 25 25 40 Ice model CSIM4 CSIM4 CICE4.0 Land model CLM3.0 CLM3.0 CLM3.5 semi-Lagrangian dynamical core 2 finite-volume Center of Ocean-LandAtmosphere Studies dynamical core 3 M. Khairoutdinov and D. Randall 4 Neale et al., 2008 Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 ENSO Simulation Nino 3 (5S–5N,150W–90W) SP-CCSM (0002–0023) NCEP Rean. (1979–2001) Ctl-CCSM (0002–0023) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 ENSO Simulation NINO3.4 (5S-5N,170W-120W) 48 months 30 months 24 months Courtesy Cristiana Stan, COLA Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 SSTA Regression with NINO3.4 SP-CCSM (0002–0023) HadlSST (1948–1998) Ctl-CCSM (0002–0023) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 ENSO-Monsoon Relationship IMR (JJA), SSTA(DJF+1) SP-CCSM (0002–0023) HadlSST/ GPCP (1951–2004) Ctl-CCSM (0002–0023) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 MJO Simulation Precipitation Ctl-CCSM GPCP SP-CCSM courtesy of C. DeMott Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 MJO Simulation Phase composites of the OLR dominant MJO mode (models: 0004–0023; NOAA: 1979–2007) Ctl-CCSM NOAA SP-CCSM W/m2 6 4.5 3 1.5 0 -1.5 -3 -4.5 -6 courtesy of V. Krishnamurthy Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Predictability of the Physical Climate System Representative Projects Project Athena: An International, Dedicated High-End Computing Project to Revolutionize Climate Modeling (Dedicated Cray XT-4 at NICS) Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Collaborating Groups • • • • • COLA - Center for Ocean-Land-Atmosphere Studies, USA ECMWF - European Center for Medium-range Weather Forecasts, UK FRCGC - Frontier Research Center for Global Change of the Japan Agency for Marine-Earth Science and Technology (JAMSTEC), Japan University of Tokyo, Japan National Institute for Computational Studies (NICS), USA Codes • • NICAM: IFS: Center of Ocean-LandAtmosphere Studies Nonhydrostatic Icosahedral Atmospheric Model ECMWF Integrated Forecast System Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Science Goals • Increasing weather and climate model resolution to accurately resolve mesoscale phenomena in the atmosphere and ocean can dramatically improve the fidelity of the models in simulating the mean climate, the distribution of variances and covariances, and the representation of extreme events. • Simulating the effect of increased greenhouse gases on regional aspects of climate, such as precipitation and storminess, may, for some regions, depend critically on the resolution of the underlying climate model. • Explicitly resolving important processes in the atmosphere and ocean, without parameterization, can even further improve the fidelity of the models, especially in describing the regional structure of weather and climate. Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 NICAM - Global Cloud-System Resolving Model • • QuickTime™ and a YUV420 codec decompressor are needed to see this picture. http://nicam.jp/hiki/?About+NICAM Center of Ocean-LandAtmosphere Studies Real-time simulation of a Madden-Julian Oscillation event with NICAM at 3.5 km horizontal resolution It is the only global atmospheric model capable of resolving clouds 3.5km = 10x211+2 grid points Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Greenland Tip Jet Events: ECMWF D+1 Forecasts at Various Resolutions TL95L91 TL255L91 (a) SLP and Turbulent Heat Fluxes: 20041226 12z FC+24h (T95) TL799L91 (b) SLP and Turbulent Heat Fluxes: 20041226 12z FC+24h (T255) 1250 1000 900 900 900 800 800 800 2004 00 10 1250 1000 1000 970 700 700 970 600 500 980 500 990 400 990 400 1000 300 1000 300 200 101 0 102 0 600 980 102 0 100 1010 200 102 100 1250 1000 1000 900 900 900 800 800 700 700 700 600 600 980 990 400 10 10 1020 (f) SLP and Turbulent Heat Fluxes: 20050116 12z FC+24h (T799) 1250 500 1010 100 1000 70 1000 1010 1250 960 960 9 0 17 km (e) SLP and Turbulent Heat Fluxes: 20050116 12z FC+24h (T255) 800 2005 400 300 1000 50 km (d) SLP and Turbulent Heat Fluxes: 20050116 12z FC+24h (T95) 500 990 200 140 km 10 30 700 970 600 980 (c) SLP and Turbulent Heat Fluxes: 20041226 12z FC+24h (T799) 1250 0 97 980 990 1000 300 200 100 10 30 102 0 600 0 96 500 980 400 300 200 1010 100 0 97 10 30 10 20 500 400 990 300 1000 200 1010 100 Jung and Rhines, JAS Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Process-Resolving Models • NSF Petascale Applications (PetaApps) project – – – – • Project Athena – – – – • COLA NCAR U. Miami UC Berkeley COLA ECMWF JAMSTEC and U. Tokyo NICS PRAC: Blue Waters – – – – COLA CSU NCAR U. Miami Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Working on Climate Scalability Requires Big Interdisciplinary Teams • Contributors: D. Bader (ORNL) D. Bailey (NCAR) C. Bitz (U Washington) F. Bryan (NCAR) T. Craig (NCAR) A. St. Cyr (NCAR) C. Demott (CSU) J. Dennis (NCAR) J. Edwards (IBM) B. Fox-Kemper (MIT,CU) E. Hunke (LANL) B. Kadlec (CU) D. Ivanova (LLNL) E. Jedlicka (ANL) E. Jessup (CU) R. Jacob (ANL) P. Jones (LANL) J. Kinter (COLA) • S. Mishra (NCAR) S. Peacock (NCAR) K. Lindsay (NCAR) W. Lipscomb (LANL) R. Loy (ANL) J. Michalakes (NCAR) A. Mirin (LLNL) M. Maltrud (LANL) J. McClean (LLNL) R. Nair (NCAR) M. Norman (NCSU) T. Qian (NCAR) D. Randall (CSU) C. Stan (COLA) M. Taylor (SNL) H. Tufo (NCAR) M. Vertenstein (NCAR) P. Worley (ORNL) M. Zhang (SUNYSB) Funding: – • • • • – – – – • DE-FC03-97ER62402 DE-PS02-07ER07-06 DE-FC02-07ER64340 B&R KP1206000 DOE-ASCR • B&R KJ0101030 NSF Cooperative Grant NSF01 NSF PetaApps NSF PRAC Computer Time: – – – Center of Ocean-LandAtmosphere Studies DOE-BER CCPP Program Grant Blue Gene/L time: NSF MRI Grant NCAR University of Colorado IBM (SUR) program BGW Consortium Days IBM research (Watson) LLNL Stony Brook & BNL CRAY XT time: NICS/ORNL NERSC Sandia BlueWaters IBM P7 time?? Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009 Scale of the Enterprise • Computational Power – Petaflops/sec • Data Volumes – Petabytes Exabytes • Model re-coding for massively parallel architectures → O(100) dedicated person-years • Climate data assimilation, initialisation and reanalysis → O(100) dedicated person-years • Sufficient expertise in climate and Earth system processes Challenge will be securing critical capability in all these areas. Is it beyond the capacity of a single country? Is it time to tackle this together and avoid duplication of effort? Courtesy of Julia Slingo World Modeling Summit, May 2008, Reading, UK Center of Ocean-LandAtmosphere Studies Jim Kinter - Computing in the Atmospheric Sciences || Annecy, France || 14 September 2009