Abstract
SEANERGYS creates an integrated European software solution that optimises resource utilisation and reduces the energy used for real-world workload mixes. It therefore improves the throughput of HPC systems, generating more R&D; results for a given energy budget. The solution consists of a comprehensive monitoring infrastructure (CMI), an Artificial Intelligence data analytics system (AIDAS), and a dynamic scheduling and resource management system (DSRM). The CMI gathers data from hardware and software sensors, and correlates it with scheduler information to identify jobs that do not fully utilize allocated resources. Users receive automatic feedback on energy and resource use for each run, plus information on how to optimize these. The DAIS leverages AI models trained with a vast set of operational data of the participating HPC sites. It fingerprints resource usage patterns, predicts future job behaviour, and identifies complementary job profiles for potential co-scheduling. Finally, the DSRM utilizes these insights to develop scheduling policies that maximize resource utilization and energy efficiency, and supports jobs/applications with dynamic and adaptable resource profiles. The SEANERGYS solution will be ready for deployment up to Exascale level. To ensure production-quality, the project builds on results from European projects, the competency of well-established research groups and companies, and widely used open-source codes. These are input for an integrated software system that achieves the functionality, performance and stability needed by European HPC centres, defined by KPIs and acceptance criteria and processes established at the project start. An agile, professional software development method based on Continuous Integration/Continuous Deployment (CI/CD) is complemented by a staged testing and validation process, with functionality tests on single-nodes, scaling tests on mid-sized platforms, and finally acceptance tests on production supercomputers.
Project details
Unibo Team Leader: Andrea Bartolini
Unibo involved Department/s:
Dipartimento di Ingegneria dell'Energia Elettrica e dell'Informazione "Guglielmo Marconi"
Dipartimento di Informatica - Scienza e Ingegneria
Coordinator:
Forschungszentrum Jülich GmbH(Germany)
Other Participants:
ALMA MATER STUDIORUM - Università di Bologna
(Italy)
Total Eu Contribution: Euro (EUR) 16.828.699,42
Project Duration in months: 48
Start Date:
01/06/2025
End Date:
31/05/2029
This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101177590