fix LLVM easyconfigs as required by revamped custom easyblock for LLVM + add `lit` and `git` as build dependencies by Crivella · Pull Request #20902 · easybuilders/easybuild-easyconfigs

Crivella · 2024-06-25T14:23:50Z

EC files to compile LLVMcore (clang + flang-new + optional projects)

Requires EB from PR (enhance LLVM easyblock for compilation of clang/flang + other llvm-projects easybuild-easyblocks#3373)

More notes on the EB PR

…tion

Co-authored-by: ocaisa <[email protected]>

boegel · 2024-07-31T15:30:43Z

@boegelbot please test @ generoso
CORE_CNT=16
EB_ARGS="--include-easyblocks-from-pr 3373 --installpath /tmp/$USER/pr20902"

boegelbot · 2024-07-31T15:35:08Z

@boegel: Request for testing this PR well received on login1

PR test command 'EB_PR=20902 EB_ARGS="--include-easyblocks-from-pr 3373 --installpath /tmp/$USER/pr20902" EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20902 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 13985

Test results coming soon (I hope)...

Details

- notification for comment with ID 2260799985 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

Crivella · 2024-08-13T08:33:01Z

@boegel
Is it normal the job has been there for 2 weeks? Just to make sure the build process is not stuck somewhere and wasting resources

branfosj · 2024-08-13T08:48:52Z

ERROR: Missing dependencies: lit/18.1.2-GCCcore-12.2.0, git/2.42-GCCcore-13.2.0 (no easyconfig file or existing module found)

Crivella · 2024-08-13T09:06:26Z

@branfosj Thanks! I've fixed this with 6d35631

branfosj · 2024-08-13T09:11:23Z

@boegelbot please test @ generoso
CORE_CNT=16
EB_ARGS="--include-easyblocks-from-pr 3373 --installpath /tmp/$USER/pr20902"

boegelbot · 2024-08-13T09:15:08Z

@branfosj: Request for testing this PR well received on login1

PR test command 'EB_PR=20902 EB_ARGS="--include-easyblocks-from-pr 3373 --installpath /tmp/$USER/pr20902" EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20902 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 14052

Test results coming soon (I hope)...

Details

- notification for comment with ID 2285756812 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-08-13T17:42:28Z

Test report by @boegelbot
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3373
FAILED
Build succeeded for 16 out of 21 (21 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/5d2fa9a94fea54443c6efb24cd74661b for a full test report.

boegel

Extensively tested with easybuilders/easybuild-easyblocks#3373, so time to finally merge this.

@Crivella Thanks a lot for all your efforts on this, and sorry for the holdup...

boegel · 2025-03-07T07:47:28Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3373
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3506.doduo.os - Linux Rocky Linux 8.10, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/boegel/70a222efa6817f148396e32fc363682a for a full test report.

…abled by default now

boegel · 2025-03-07T07:56:32Z

Test report by @boegel
SUCCESS
Build succeeded for 7 out of 7 (7 easyconfigs in total)
node3623.doduo.os - Linux RHEL 9.4, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.9.18
See https://gist.github.com/boegel/b9cd59dc76efb68f646ec1d12d6b9328 for a full test report.

Crivella · 2025-03-07T09:42:58Z

I think the failure in the CI was due to Mesa-24.1.3 depending on LLVM-18.1.8-GCCcore-13.3.0 which has now been suffixed with minimal

I've updated the dependency in 66b29d9

Thyre · 2025-03-07T10:58:47Z

Is there a reason why we have both easybuild/easyconfigs/l/lit/lit-18.1.7-GCCcore-13.3.0.eb and easybuild/easyconfigs/l/lit/lit-18.1.8-GCCcore-13.3.0.eb for GCCcore/13.3.0? easybuild/easyconfigs/l/LLVM/LLVM-18.1.8-GCCcore-13.3.0-minimal.eb is only using the latter.

Crivella · 2025-03-07T11:03:16Z

Umh, i think it is a leftover from the fact that i first build around 18.1.7 and than updated to 18.1.8.
It does not seems to still be used so it can probably be removed (or just left there in case someone would ever want it)

boegel · 2025-03-07T19:11:17Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3623.doduo.os - Linux RHEL 9.4, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.9.18
See https://gist.github.com/boegel/0582b42046cb9eb598a4df265fce6ba4 for a full test report.

boegel · 2025-03-07T21:43:28Z

Test report by @boegel
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in total)
node3621.doduo.os - Linux Rocky Linux 8.10, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/boegel/e20a5f3be17311f8a26729d9a55ca585 for a full test report.

boegel · 2025-03-08T08:46:53Z

Going in, thanks @Crivella!

Flamefire · 2025-04-07T08:32:39Z

Was it an intended change to remove build_shared_libs from the GCCcore 10.3 toolchains or an oversight? It breaks the Mesa build for me

Crivella · 2025-04-07T08:42:05Z

@Flamefire Might be unintended, or atleast i do not remember having particular problem with old builds that would've caused em to disable it.

Thyre · 2025-04-07T08:42:07Z

Was it an intended change to remove build_shared_libs from the GCCcore 10.3 toolchains or an oversight? It breaks the Mesa build for me

Given that LLVM 14.x.x+ still have build_shared_libs, I'd guess that this was just an oversight.

Crivella added 3 commits June 12, 2024 10:24

Added EC for bootstrapped build of all LLVM components

17f725d

Added EC for 18.1.7 for system toolchain with working openmp installa…

799aeef

…tion

Working bootstrapped builds witt/wo full_llvm

4caab66

Crivella mentioned this pull request Jun 25, 2024

RFC: Implementing a proper Clang toolchain easybuilders/easybuild#640

Closed

Crivella added 11 commits July 4, 2024 18:17

Testeed more configuration and enabled tests

442e879

Cleanup comments

720859d

Fix for python bindings

5c9643e

Added Z3 to non full version

80886cf

Merge branch 'develop' into feature-LLVM_unified

920517b

Rename and modify new 18.1.8

e160473

Added new 18.1.8 gcc and full ECs

a21eefa

Modified >=14 to work with new EB

a74a524

Adjust checksums and made changes up to 11.1.0

eafac8d

Added lit 18.1.8

e7a4e4b

Removed LLVMcore files

24ca95c

ocaisa reviewed Jul 18, 2024

View reviewed changes

Comment thread easybuild/easyconfigs/l/LLVM/LLVM-18.1.8.eb Outdated

Crivella and others added 5 commits July 18, 2024 14:55

Update easybuild/easyconfigs/l/LLVM/LLVM-18.1.8.eb

a189d2a

Co-authored-by: ocaisa <[email protected]>

Wrong rename

63155a3

Fixed version numbers

82581ae

Fixed wrong build options

011d7d5

Fixed number of allowed test failures

9ba2c71

Fixed missing/wrong dep

6d35631

boegel previously approved these changes Mar 7, 2025

View reviewed changes

don't explicitly enable use_pip and sanity_pip_check since they're en…

133a7de

…abled by default now

boegel dismissed their stale review via 133a7de March 7, 2025 07:47

get rid of redefined checksums parameter in LLVM 14.0.3 easyconfig

e217195

Thyre mentioned this pull request Mar 7, 2025

{compiler,lang}[GCCcore/13.3.0,foss/2024a] LLVM v14.0.6, numba v0.60.0 w/ llvmlite #22489

Merged

Updated Mesa-24.1.3 to depend on -minimal

66b29d9

Crivella mentioned this pull request Mar 7, 2025

Flaky llvm-mt tests reported in #20902 #22491

Closed

use non-bare Python build dependency for LLVM 11.1.0 and 12.0.1

826b970

Merge branch '5.0.x' into feature-LLVM_unified

ad40d83

boegel added this to the 5.0.0 milestone Mar 8, 2025

boegel approved these changes Mar 8, 2025

View reviewed changes

boegel merged commit a90842d into easybuilders:5.0.x Mar 8, 2025

boegel removed this from EasyBuild v5.0 Mar 8, 2025

Crivella deleted the feature-LLVM_unified branch March 10, 2025 09:13

Crivella added a commit to Crivella/easybuild-easyconfigs that referenced this pull request Mar 10, 2025

Same patch as easybuilders#20902

6b8f991

Flamefire mentioned this pull request Apr 7, 2025

Re-add build of shared libs for LLVM [GCCcore 10.3.0] #22720

Merged

Crivella added a commit to Crivella/easybuild-easyconfigs that referenced this pull request Apr 9, 2025

Same patch as easybuilders#20902

d3a3d0e

WilleBell mentioned this pull request Apr 22, 2025

{bio}[GCC/13.3.0] Jellyfish v2.3.1, kallisto v0.51.1, RSEM v1.3.3, ... #22714

Merged

Thyre mentioned this pull request Aug 8, 2025

add explicit libxml2 and libffi dependencies to LLVM 11.x/12.x/14.x #23603

Merged

Conversation

Crivella commented Jun 25, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

boegel commented Jul 31, 2024

Uh oh!

boegelbot commented Jul 31, 2024

Uh oh!

Crivella commented Aug 13, 2024

Uh oh!

branfosj commented Aug 13, 2024

Uh oh!

Crivella commented Aug 13, 2024

Uh oh!

branfosj commented Aug 13, 2024

Uh oh!

boegelbot commented Aug 13, 2024

Uh oh!

boegelbot commented Aug 13, 2024

Uh oh!

boegel left a comment

Choose a reason for hiding this comment

Uh oh!

boegel commented Mar 7, 2025

Uh oh!

boegel commented Mar 7, 2025

Uh oh!

Crivella commented Mar 7, 2025

Uh oh!

Thyre commented Mar 7, 2025

Uh oh!

Crivella commented Mar 7, 2025

Uh oh!

boegel commented Mar 7, 2025

Uh oh!

boegel commented Mar 7, 2025

Uh oh!

boegel commented Mar 8, 2025

Uh oh!

Flamefire commented Apr 7, 2025

Uh oh!

Crivella commented Apr 7, 2025

Uh oh!

Thyre commented Apr 7, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Crivella commented Jun 25, 2024 •

edited

Loading