37th HiRSE Seminar
On December 12, 2024, 2pm CET, Dirk Brömmel from Jülich Supercomputing Centre (Forschungszentrum Jülich) will talk in the HiRSE Seminar about Integrated Continuous Benchmarking.
Abstract:
When developing software, it is often relevant to track its performance. As foundation for research where available time can be a limiting factor, this should hold even more true for research software. It is even vital when targeting high-performance computing (HPC). Since changes to the software itself, the used toolchains, or the system setup should not compromise how fast users obtain their results, benchmarking should be an integral part of testing, in particular for HPC codes.
Ideally, performance or scalability should only ever increase. At the same time, up-to-date benchmarks that are publicly available can advertise the code and inform users how to set-up the software in the most ideal way or whether they are achieving the expected performance. To limit the burden on developers, the aforementioned steps should be automated within continuous integration (CI) practices, introducing continuous benchmarking (CB) to it.
We show our approach that works standalone without additional services and combines results over time to enable further processing or for the generation of webpages. Via a fully authenticated runner on HPC systems, it also adds the possibility of benchmarks up to system scale.
The talk will be held online. The connection details will be posted here:
- HiRSE_PS-internal HiRSE Mattermost channel,
- HIFIS Mattermost channel,
- Helmholtz Open Science Mattermost Channel
- FZJ-internal #rse Rocket.Chat channel,
- de-RSE mailing list and de-RSE Mattermost channel,
- FG RSE mailing list
- Helmholtz Open Science Pro Mailinglist
- RSE mailing lists of the HiRSE partners (if any).
If you would like to attend, but think you may not get the connection details through these channels, please write to hirse@fz-juelich.de. Slides will be published at the HiRSE Zenodo Community.
Location: virtual