Skip to content

{2026.06}[GCC/15.2.0,foss/2026.1,gfbf/2026.1] SuiteSparse 7.12.2, Hypre 3.1.0, PETSc 3.25.0, libxc 7.0.0, Boost.Python-NumPy 1.90.0 - #1772

Open
HaoZeke wants to merge 7 commits into
EESSI:mainfrom
HaoZeke:2026.06-solvers
Open

HaoZeke wants to merge 7 commits into
EESSI:mainfrom
HaoZeke:2026.06-solvers

Conversation

@HaoZeke

@HaoZeke HaoZeke commented Oct 11, 2026

Copy link
Copy Markdown
Contributor

Adds SuiteSparse-7.12.2-gfbf-2026.1, Hypre-3.1.0-foss-2026.1, PETSc-3.25.0-foss-2026.1, libxc-7.0.0-GCC-15.2.0, Boost.Python-NumPy-1.90.0-gfbf-2026.1 to 2026.06. Recipes after the EasyBuild 5.4.0 release are pinned with from-commit to their merge commit on develop.

@HaoZeke

HaoZeke commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen4
bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=aarch64/generic

@eessi-bot-aws

eessi-bot-aws Bot commented Oct 11, 2026 •

Copy link
Copy Markdown

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: amd-zen4
Building for: x86_64/amd/zen4
Job dir: /project/def-users/SHARED/jobs/2026.10/pr_1772/206287

date job status comment
Oct 11 18:36:11 UTC 2026 submitted job id 206287 awaits release by job manager
Oct 11 18:36:23 UTC 2026 released job awaits launch by Slurm scheduler
Oct 11 18:44:07 UTC 2026 running job 206287 is running
Oct 11 22:13:03 UTC 2026 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-206287.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.* created!
Artefacts
eessi-2026.06-software-linux-x86_64-amd-zen4-17917566900.tar.zstsize: 105 MiB (110368828 bytes)
entries: 8985
modules under 2026.06/software/linux/x86_64/amd/zen4/modules/all
Hypre/3.1.0-foss-2026.1.lua
PETSc/3.25.0-foss-2026.1.lua
SuiteSparse/7.12.2-gfbf-2026.1.lua
SuperLU_DIST/9.2.1-foss-2026.1.lua
software under 2026.06/software/linux/x86_64/amd/zen4/software
Hypre/3.1.0-foss-2026.1
PETSc/3.25.0-foss-2026.1
SuiteSparse/7.12.2-gfbf-2026.1
SuperLU_DIST/9.2.1-foss-2026.1
reprod directories under 2026.06/software/linux/x86_64/amd/zen4/reprod
Hypre/3.1.0-foss-2026.1/20261011_190343UTC
PETSc/3.25.0-foss-2026.1/20261011_203728UTC
SuiteSparse/7.12.2-gfbf-2026.1/20261011_190212UTC
SuperLU_DIST/9.2.1-foss-2026.1/20261011_191331UTC
other under 2026.06/software/linux/x86_64/amd/zen4
no other files in tarball
Oct 11 22:13:03 UTC 2026 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 expected failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-206287.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@eessi-bot-aws

eessi-bot-aws Bot commented Oct 11, 2026 •

Copy link
Copy Markdown

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: generic
Building for: aarch64/generic
Job dir: /project/def-users/SHARED/jobs/2026.10/pr_1772/206289

date job status comment
Oct 11 18:36:16 UTC 2026 submitted job id 206289 awaits release by job manager
Oct 11 18:37:41 UTC 2026 released job awaits launch by Slurm scheduler
Oct 11 19:32:24 UTC 2026 running job 206289 is running
Oct 12 02:39:04 UTC 2026 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-206289.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.* created!
Artefacts
eessi-2026.06-software-linux-aarch64-generic-17917725730.tar.zstsize: 272 MiB (285661295 bytes)
entries: 26451
modules under 2026.06/software/linux/aarch64/generic/modules/all
Boost.Python-NumPy/1.90.0-gfbf-2026.1.lua
Hypre/3.1.0-foss-2026.1.lua
libxc/7.0.0-GCC-15.2.0.lua
PETSc/3.25.0-foss-2026.1.lua
SuiteSparse/7.12.2-gfbf-2026.1.lua
SuperLU_DIST/9.2.1-foss-2026.1.lua
software under 2026.06/software/linux/aarch64/generic/software
Boost.Python-NumPy/1.90.0-gfbf-2026.1
Hypre/3.1.0-foss-2026.1
libxc/7.0.0-GCC-15.2.0
PETSc/3.25.0-foss-2026.1
SuiteSparse/7.12.2-gfbf-2026.1
SuperLU_DIST/9.2.1-foss-2026.1
reprod directories under 2026.06/software/linux/aarch64/generic/reprod
Boost.Python-NumPy/1.90.0-gfbf-2026.1/20261012_023152UTC
Hypre/3.1.0-foss-2026.1/20261011_195545UTC
libxc/7.0.0-GCC-15.2.0/20261012_022740UTC
PETSc/3.25.0-foss-2026.1/20261011_211628UTC
SuiteSparse/7.12.2-gfbf-2026.1/20261011_195410UTC
SuperLU_DIST/9.2.1-foss-2026.1/20261011_195813UTC
other under 2026.06/software/linux/aarch64/generic
no other files in tarball
Oct 12 02:39:04 UTC 2026 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 expected failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-206289.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@casparvl

Copy link
Copy Markdown
Collaborator

#1772 (comment) failed to build libxc, likely with an OOM error:

gcc: fatal error: Killed signal terminated program cc1
compilation terminated.
make[2]: *** [CMakeFiles/xc.dir/build.make:3456: CMakeFiles/xc.dir/src/mgga_x_br89.c.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[2]: Leaving directory '/tmp/bot/easybuild/build/libxc/7.0.0/GCC-15.2.0/easybuild_obj'
make[1]: *** [CMakeFiles/Makefile2:130: CMakeFiles/xc.dir/all] Error 2
make[1]: Leaving directory '/tmp/bot/easybuild/build/libxc/7.0.0/GCC-15.2.0/easybuild_obj'
make: *** [Makefile:149: all] Error 2

This was already a know issue, as we've limited parallelism before (see https://github.com/EESSI/software-layer-scripts/blob/608fb40c88152a9b9aaefa6634c5e39526236212/eb_hooks.py#L2729 ), but apparently that's not enough here.

I'll trigger a rebuild, just to see how consistent this is.

Assuming that fails (again): @HaoZeke can you make a PR to software-layer-scripts that limits the parallelism for libxc builds even further? It's annoying, since this is already a build that takes very long (this one was going for 1h20min when it crashed at 86%), so let's not limit it more than we have to. I'm not exactly sure how the divider works, and how it rounds - maybe you can try dividing by 2.5 or 3. That would result in 6 or 5 cores respectively on our AWS build cluster. If all else fails, we could go for a divider of 4 (and thus 4 cores), but let's not start there...

You can then update this PR to point to a commit in software-layer-scripts in which you've made that change. I'll trigger a rebuild here after you made that change.

bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen4

@eessi-bot-aws

eessi-bot-aws Bot commented Oct 26, 2026

Copy link
Copy Markdown
error: easystacks/software.eessi.io/2026.06/eessi-2026.06-eb-5.4.0-2026.1.yml: patch does not apply

Unable to download or merge changes between the source branch and the destination branch.
Tip: This can usually be resolved by syncing your branch and resolving any merge conflicts.

@casparvl

Copy link
Copy Markdown
Collaborator

bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen4

@eessi-bot-aws

eessi-bot-aws Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: amd-zen4
Building for: x86_64/amd/zen4
Job dir: /project/def-users/SHARED/jobs/2026.10/pr_1772/216331

date job status comment
Oct 26 15:46:14 UTC 2026 submitted job id 216331 awaits release by job manager
Oct 26 15:46:54 UTC 2026 released job awaits launch by Slurm scheduler
Oct 26 15:47:59 UTC 2026 running job 216331 is running
Oct 26 18:37:05 UTC 2026 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job216331.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Oct 26 18:37:05 UTC 2026 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job216331.test does not exist in job directory or reading it failed.

@casparvl

Copy link
Copy Markdown
Collaborator
[casparvl@login1 ~]$ scontrol show job 216331
slurm_load_jobs error: Invalid job id specified
[casparvl@login1 ~]$ sacct -j 216331
JobID           JobName  Partition    Account  AllocCPUS      State ExitCode
------------ ---------- ---------- ---------- ---------- ---------- --------
216331             prod x86-64-am+  def-users         16  NODE_FAIL      0:0
216331.batch      batch             def-users         16  CANCELLED
216331.exte+     extern             def-users         16  CANCELLED

Log doesn't really show anything, just stops at some point, abruptly. I guess it could be another OOM... not sure. I'll try one more time...

@casparvl

Copy link
Copy Markdown
Collaborator

bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen4

@eessi-bot-aws

eessi-bot-aws Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: amd-zen4
Building for: x86_64/amd/zen4
Job dir: /project/def-users/SHARED/jobs/2026.10/pr_1772/216357

date job status comment
Oct 26 19:29:35 UTC 2026 submitted job id 216357 awaits release by job manager
Oct 26 19:30:30 UTC 2026 released job awaits launch by Slurm scheduler
Oct 26 19:36:43 UTC 2026 running job 216357 is running
Oct 26 23:12:40 UTC 2026 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-216357.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.* created!
Artefacts
eessi-2026.06-software-linux-x86_64-amd-zen4-17930561920.tar.zstsize: 105 MiB (110338505 bytes)
entries: 8985
modules under 2026.06/software/linux/x86_64/amd/zen4/modules/all
Hypre/3.1.0-foss-2026.1.lua
PETSc/3.25.0-foss-2026.1.lua
SuiteSparse/7.12.2-gfbf-2026.1.lua
SuperLU_DIST/9.2.1-foss-2026.1.lua
software under 2026.06/software/linux/x86_64/amd/zen4/software
Hypre/3.1.0-foss-2026.1
PETSc/3.25.0-foss-2026.1
SuiteSparse/7.12.2-gfbf-2026.1
SuperLU_DIST/9.2.1-foss-2026.1
reprod directories under 2026.06/software/linux/x86_64/amd/zen4/reprod
Hypre/3.1.0-foss-2026.1/20261026_195928UTC
PETSc/3.25.0-foss-2026.1/20261026_213426UTC
SuiteSparse/7.12.2-gfbf-2026.1/20261026_195750UTC
SuperLU_DIST/9.2.1-foss-2026.1/20261026_200918UTC
other under 2026.06/software/linux/x86_64/amd/zen4
no other files in tarball
Oct 26 23:12:40 UTC 2026 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 expected failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-216357.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@casparvl

Copy link
Copy Markdown
Collaborator

Same killed gcc process in #1772 as we had before. This is clearly and consistently running OOM. We need to limit parallelism further.

options:
# see https://github.com/easybuilders/easybuild-easyconfigs/pull/26508
from-commit: 04360d07f2e6d6f1f699bf70ff86088a157b6502
- libxc-7.0.0-GCC-15.2.0.eb

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will need a companion PR in software-layer-scripts to limit parallelism further.

…-NumPy to EB 5.4.2 easystack

EasyBuild 5.4.1 ships easybuild-easyconfigs#26508, so Hypre and PETSc no longer need from-commit.
…78506e55a446d3b

The libxc-parallelism-divide-by-3 branch merged with main, to rebuild libxc 7.0.0 for x86_64/amd/zen4.
The new scripts commit has the libxc divider of 3 on current main.
This is to rebuild libxc 7.0.0 for x86_64/amd/zen4.
@casparvl

casparvl commented Nov 2, 2026

Copy link
Copy Markdown
Collaborator

bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen4

@eessi-bot-aws

eessi-bot-aws Bot commented Nov 2, 2026 •

Copy link
Copy Markdown

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: amd-zen4
Building for: x86_64/amd/zen4
Job dir: /project/def-users/SHARED/jobs/2026.11/pr_1772/221273

date job status comment
Nov 02 12:20:43 UTC 2026 submitted job id 221273 awaits release by job manager
Nov 02 12:21:48 UTC 2026 released job awaits launch by Slurm scheduler
Nov 02 12:23:18 UTC 2026 running job 221273 is running

@casparvl

casparvl commented Nov 2, 2026

Copy link
Copy Markdown
Collaborator

Let's see how this goes with an even further reduced core count in #1772 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants