Abstract
As the complexity of multi-physics simulations increases, there is a need for efficient flow of information between components. Discrete 'coupler' codes can abstract away this process, improving solver interoperability. One such multi-physics problem is modelling a gas turbine aero engine, where instances of rotor/stator CFD and combustion simulations are coupled. Allocating resources correctly and efficiently during production simulations is a significant challenge due to the large HPC resources required and the varying scalability of specific components, a result of differences between solver physics. In this research, we develop a coupled mini-app simulation and an accompanying performance model to help support this process. We integrate an existing Particle-In-Cell mini-app, SIMPIC, as a 'performance proxy' for production combustion codes in industry, into a coupled mini-app CFD simulation using the CPX mini-coupler. The bottlenecks of the workload are examined, and the performance behavior are replicated using the mini-app. A selection of optimizations are examined, allowing us to estimate the workload's theoretical performance. The coupling of mini-apps is supported by an empirical performance model which is then used to load balance and predict the speedup of a full-scale compressor-combustor-turbine simulation of 1.2Bn cells, a production representative problem size. The model is validated on 40K-cores of an HPE-Cray EX system, predicting the runtime of the mini-app work-flow with over 75% accuracy. The developed coupled mini-apps and empirical model combination demonstrates how rapid design space and run-time setup exploration studies can be carried out to obtain the best performance from full-scale Combustion-CFD coupled simulations.
Original language | English |
---|---|
Title of host publication | 2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS) |
Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
Pages | 579-589 |
Number of pages | 11 |
ISBN (Electronic) | 9798350337662 |
ISBN (Print) | 9798350337679 (PoD) |
DOIs | |
Publication status | Published - 18 Jul 2023 |
Event | 37th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2023 - St. Petersburg, United States Duration: 15 May 2023 → 19 May 2023 |
Publication series
Name | Proceedings - IEEE International Parallel and Distributed Processing Symposium |
---|---|
Publisher | IEEE |
ISSN (Print) | 1530-2075 |
ISSN (Electronic) | 1530-2075 |
Conference
Conference | 37th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2023 |
---|---|
Country/Territory | United States |
City | St. Petersburg |
Period | 15/05/23 → 19/05/23 |
Bibliographical note
Funding Information:This research is supported by Rolls-Royce plc., and by the UK EPSRC (EP/S005072/1 - Strategic Partnership in Computational Science for Advanced Simulation and Modelling of Engineering Systems - ASiMoV). Gihan Mudalige was supported by the Royal Society Industry Fellowship Scheme (INF/R1/1800 12). We would also like to thank Chris Goddard at Rolls-Royce for their guidance for this work
Publisher Copyright:
© 2023 IEEE.
Keywords
- CFD
- Combustion
- Coupling
- Mini-App
- Performance model
ASJC Scopus subject areas
- Artificial Intelligence
- Computer Networks and Communications
- Hardware and Architecture
- Information Systems