Notur Application Form http://www.notur.no/application/application.php?POST Notur Application Form Userna me: bjornhs@rnd.feide.no Applica tion id: 824 Project title: Adva nced Modeling of Atmospheric Chemistry, Ra dia tion a nd Circula tion Applica tion la st sa ved: 2011-08-17 09:50:20 Summary page Below you find the information that you provided. Please check that this information is correct. Errors or missing information are marked in red and should be corrected first by modifying the appropriate question(s), saving the application, and returning to the Summary page. In case you believe that some of the listed information differs from what you specified, please first try to correct this by modifying the appropriate question(s) and saving the application again. If the problem persists, contact sigma@uninett.no. In case the information below is correct and does not contain errors (marked in red), you can submit the application by pushing the "Submit"-button. By submitting this application, the applicant states that he/she has completed the form to the best of his/her knowledge and will send any additional information that becomes available after submission and that is relevant for the evaluation of the application to sigma@uninett.no. Applications that are incomplete, contain wrong information or insufficient information for a proper evaluation are likely to be rejected. After you have submitted the application, it can no longer be edited. << Page 7 Submit Page 1: Personalia, project leader 1. Account responsible*: 1 of 7 Bjørn H. Samset 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST 2. Job title/position: Senior Research Fellow 3. E-mail address*: b.h.samset@cicero.uio.no 4. Phone no*: +4722858787 5. Cell-phone number +4792051998 6. Institution*: CICERO 7. Faculty (if any): 8. Department (if any): 9. Street address*: P.b. 1129 Blindern 10. Post code*: 0318 11. Post office/City*: Oslo 12. Country*: Norway 13. You have indicated that you hold a permanent position at your institution. Page 2: Project details and funding 1. Title for this application*: Advanced Modeling of Atmospheric Chemistry, Radiation and Circulation 1a. Notur Account number: NN9188K 1b. Project acronym: AMACRaC 1c. Project summary (This summary can be used for dissemination purposes. No more than 250 words. The summary should be understandable to a wide audience, including researchers and engineers, users of the national infrastructure, university management, funding angencies - e.g., research council, etc. The summary should include objectives, a description of the problem and its scientific and/or socio-economic relevance, the main scientific methods and algorithms used, the challenges in particular with respect to computation and data management, and expected results)*: How does the atmosphere react to changes in composition, e.g. emissions of climate gases and aerosols? Studying this requires uniting geophysics, physics and chemistry through heavy computer models, which must have both high resolution and level of detail. This project performs state-of-the-art modeling of the atmosphere, from emissions through chemical interactions, to radiation balance and global atmospheric circulation. 2. Field(s) of science*: 2 of 7 Geosciences 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST 3. If other field of science, please specify: 4. For projects funded by the Research NORKLIMA, Council of Norway, specify the name of OTHER, the programme(s): RENERGI 5. If the Research Council of Norway programme is not listed here, please specify: SLAC (newly fundes NFR SIS), ARCACT (under NORKLIMA), TEMPO (under RENERGI) 6. If the project is financed by the Research Council of Norway or by the Ministry of Education and Research (KD), specify the title and contract number of the project: 7. The project is (fully or in part) funded by your institution: No / Not entered 8. In case the project is supported from other sources (e.g., EU, industry, ...), please provide details: Additional funding through EU and NORFORSK programmes. 9. Select the allocation periods for which you wish to apply*: 2011.2 (2011-10-01 2012-03-31) 2012.1 (2012-04-01 2012-09-30) Page 3: Software details 1. User developed software*: OsloCTM2, disort 2. Public domain software*: None 3. Software obtained from collaborative partners*: NCAR CESM 1.0 4. Library software*: None 5. Commercial software*: ifort, pgf 6. Other software on which your application software depends and that must be available/preinstalled on the system(s), e.g. system libraries, numerical libraries, performance libraries and so on. Examples are BLAS, LAPACK, ScaLAPACK, FFTW, PetSC, Perl, Python, Java, ...*: python, netcdf Page 4: Project hardware properties 3 of 7 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST 1. Largest number of cores for a single 33-64 job* 2. Memory per processor core* 1-2GB 3. I/O intensive* Mixed 4. Expected total need for storage of home directories 5. Expected total need for tape storage 6. Processor core hours requested on resource (click resource name for details)*: Resource / Period 2010.2 2011.1 2011.2 2012.1 2012.2 hexagon hours njord hours stallo hours titan 300000 300000 hours 7. Please motivate the amount of hours requested for each system under question 6. Applications for a large amount of hours are strongly encouraged to provide a justification. Here, one can for example consider the expected number of jobs and individual job sizes, project history, etc. Applications that do not provide a justification are more likely to be rejected or reduced in size. List the resources that can also be used, but for which no hours are requested. (This question can be left empty if the project is in a start-up phase or intended for testing purposes only.): The project has three subcategories with varying needs: - Chemical modelling with OsloCTM2. Each full yearly simulation requires ~1k CPUh on titan, and each modeler will need to run up to 20 simulations through the period. Hence, for five modelers, we need OsloCTM2: 100k CPUh - Radiative transfer calculations with disort. Again a full year requires approx 1kCPUh per study, and we estimate the need for ten individual studies. Hence: Disort: 100k CPUh - CESM1.0 running: The CESM is a global circulation model, running with high spatial and temporal resolution. It requires 500 CPUh per simulated year, and we need to run 10 cases for 50 years, and three cases for 100 years. The total becomes CESM1.0: 400k CPUh Total need: 600k CPUh (All numbers are from test runs on titan, amd processors only.) 8. Describe the need for your project to apply for allocations on the Notur compute resources*: 4 of 7 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST The computing resources available at CICERO and MetOS are sufficient for the analysis of the output of major simulations, but not for the simulations themselves. To be able to fulfull our obligations to NFR, EU and other financers, we are dependent on time allocations on Notur resources. 9. Each new user obtains a home directory of default size on the HPC systems. In case the default size is insufficient, the user must submit a request for increased area to the system administration of the HPC system in question with sufficient justification. The project can apply for project area on one or more HPC systems. This area is shared by all users connected to the project. 4 TB Please provide sufficient explanation for the requested project area and its size. Also specify on which system(s) you need this project area. Note that storage capacity on the NorStore resources must be requested separately*: CICERO and MetOS(UiO) have private disks for long term storage, but for project running some disk space beyond the user accounts will be necesseary. Page 5: Additional project properties 1. Describe the feasibility of using the requested resource(s). Include a description of the characteristics of the software and simulations that may limit the choice of the systems that can be used (e.g., memory, disk, I/O requirements, and 3rd party software). E.g., why is a shared-memory platform needed and not a distributed-memory cluster? Please state the risk of not being able to use an allocation. Also state the reasons for not having used previous allocations, if any: The project members have previously been running the same software under project nr. nn4701k, which has been over-used. The first allocation period of the present project (nn9188k) has at the time of writing utilized 200k of a 350k hour allocation, with significant amounts of work being planned for the month leading up to the end of the period. The applications are only moderately demanding in terms of I/O and memory, and most commonly run on either 8 or 64 cores via OpenMPI. 5 of 7 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST 2. In case the applicant also has local quota on the facility at his/her home institution for this project, the corresponding project account number and project title must be provided: None 3. Detail the expected measurable output in number of publications and students (master and PhD) in the requested period. For new applications, less emphasis will be put on this question.*: Based on previous experience, the AMACRaC collaborators publish approx. five papers in peer-reviewed journals per six months, based on simulations like the ones planned here. In addition there is an active science outreach activity based on the results. Several PhD students are currently involved in the project. Page 6: Files 1. Project description*: AMACRaC description 2011_02.pdf Size: 345kb 2. CV: cv_general_2011.pdf Size: 606kb 3. Other file: None Page 7: Extra information required for large applications 1. Describe the experience of using the HPC resources by the applicant and the users connected to the application The main applicant and several project members are highly experienced HPC users, both on titan and other computing facilites (e.g. CERN). All software is already running on titan, set up for parallell running either by the project members, by the original developers, or previously by Hans Eide. 2. Describe the efficiency of the software in terms of sustained singleprocessor single-core performance, or scalability in case the project envisages to run parallel simulations with many cores. A detailed description can be uploaded on "Page 6", but please provide a summary here: All software runs in parallel via OpenMPI. Two of the three activities usually run on 8 cores on a single node, while the GCM part normally runs on 64 cores over several nodes. 3. Suggest 3-4 referees to review this application. The referees must have competence with HPC within this application area. Referees should not have recent or ongoing collaborations with any members of the research group or any other possible conflicts of interest 6 of 7 08/17/2011 09:51 AM Notur Application Form http://www.notur.no/application/application.php?POST (Name, title, affiliation, and email address are required): 4. The duration of a LARGE project can span 1, 2, or 4 allocation periods (6, 12 or 24 months). In case processor core hours are requested for several allocation periods, specify below how the requested processor core hours are divided over these allocation periods: sigma@uninett.no 7 of 7 08/17/2011 09:51 AM