{tools,lib}[system/system,GCCcore/13.3.0] slirp4netns v1.3.3, Twisted v25.5.0 by bedroesb · Pull Request #24625 · easybuilders/easybuild-easyconfigs

bedroesb · 2025-11-19T08:31:26Z

Open OnDemand apps that do not have any authentication method can make use of slirp4nets and Twisted to authenticate against a private network namespace as demonstrated in the example:

https://github.com/OSC/bc_osc_tensorboard

These modules would take away the need to install these dependencies on all workernodes.

I have tested and used the proposed recipes on our cluster for this specific tensorboard example.

bedroesb · 2025-11-19T09:11:58Z

Hmm when I remove use_pip = True as suggetsed by the GitHub Actions I get:

== 2025-11-19 10:08:25,485 run.py:247 INFO running cmd:  /mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python setup.py build  
== 2025-11-19 10:08:25,537 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): cmd " /mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python setup.py build " exited with exit code 2 and output:
/mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python: can't open file '/data/groups/technologies/data.core/bert.droesbeke/easybuild/build/Twisted/25.5.0/GCCcore-13.3.0/twisted-25.5.0/setup.py': [Errno 2] No such file or directory
 (at easybuild/tools/run.py:682 in parse_cmd_output)
== 2025-11-19 10:08:25,537 filetools.py:2013 INFO Removing lock /data/groups/technologies/data.core/bert.droesbeke/easybuild/software/.locks/_data_groups_technologies_data.core_bert.droesbeke_easybuild_software_Twisted_25.5.0-GCCcore-13.3.0.lock...
== 2025-11-19 10:08:25,545 filetools.py:383 INFO Path /data/groups/technologies/data.core/bert.droesbeke/easybuild/software/.locks/_data_groups_technologies_data.core_bert.droesbeke_easybuild_software_Twisted_25.5.0-GCCcore-13.3.0.lock successfully removed.
== 2025-11-19 10:08:25,548 filetools.py:2017 INFO Lock removed: /data/groups/technologies/data.core/bert.droesbeke/easybuild/software/.locks/_data_groups_technologies_data.core_bert.droesbeke_easybuild_software_Twisted_25.5.0-GCCcore-13.3.0.lock
== 2025-11-19 10:08:25,551 easyblock.py:4291 WARNING build failed (first 300 chars): cmd " /mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python setup.py build " exited with exit code 2 and output:
/mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python: can't open file '/data/groups/technologies/data.core/bert.droesbeke/easybuild/build/Twisted/25.5

Any suggestions?

branfosj

Can you try these changes and see if they fix the issue.

Co-authored-by: Simon Branford <[email protected]>

bedroesb · 2025-11-19T09:52:46Z

@branfosj Thank you for your swift review!

Locally I get:

== 2025-11-19 10:50:59,964 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:126 in __init__): cmd " /mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python setup.py build " exited with exit code 2 and output:
/mnt/modules/easybuild/software/Python/3.12.3-GCCcore-13.3.0/bin/python: can't open file '/data/groups/technologies/data.core/bert.droesbeke/easybuild/build/Twisted/25.5.0/GCCcore-13.3.0/incremental/incremental-24.7.1/setup.py': [Errno 2] No such file or directory
 (at easybuild/tools/run.py:682 in parse_cmd_output)

branfosj · 2025-11-19T10:02:42Z

Test report by @branfosj
SUCCESS
Build succeeded for 2 out of 2 (total: 52 secs) (2 easyconfigs in total)
bear-pg0210u03a - Linux RHEL 8.10, x86_64, Intel(R) Xeon(R) Platinum 8480CL (sapphirerapids), Python 3.6.8
See https://gist.github.com/branfosj/a1c3d03303c5a6c626d6c7fbebbe4d90 for a full test report.

bedroesb · 2025-11-19T10:12:47Z

I realise now that we are on our cluster using EasyBuild 4.9.1 (framework: 4.9.1, easyblocks: 4.9.1) so a comparison with GitHub Action is difficult.

bedroesb · 2025-11-19T10:35:00Z

@branfosj with the latest version of easybuild, the latest commit works for me locally 🤔

bedroesb · 2025-11-19T16:31:24Z

Found the problem! and I think it is solved :)

bedroesb · 2025-11-21T14:41:29Z

@branfosj anything else I can do to help ?

smoors · 2025-11-22T07:44:08Z

@boegelbot please test @ jsc-zen3

boegelbot · 2025-11-22T07:50:11Z

@smoors: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=24625 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_24625 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:

Submitted batch job 8879

Test results coming soon (I hope)...

Details

- notification for comment with ID 3565960576 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2025-11-22T07:53:26Z

Test report by @boegelbot
SUCCESS
Build succeeded for 2 out of 2 (total: 2 mins 59 secs) (2 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.6, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.21
See https://gist.github.com/boegelbot/5fe3f8e3572b41c7fce92db5eb42c218 for a full test report.

smoors

lgtm

smoors · 2025-11-22T07:56:01Z

Going in, thanks @bedroesb!

add slirp4nets and twisted

c5ebc3a

github-actions Bot added 2024a issues & PRs related to 2024a common toolchains new labels Nov 19, 2025

bedroesb added 2 commits November 19, 2025 09:44

add checksums foe extensions

0c66b3f

capitalise

51a5d95

bedroesb changed the title ~~{tools,lib}[system/system,GCCcore/13.3.0] slirp4netns v1.3.3, twisted v25.5.0~~ {tools,lib}[system/system,GCCcore/13.3.0] slirp4netns v1.3.3, Twisted v25.5.0 Nov 19, 2025

branfosj reviewed Nov 19, 2025

View reviewed changes

bedroesb and others added 9 commits November 19, 2025 10:48

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

337f16e

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

ce02fe0

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

79cf653

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

d76e663

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

ea612af

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

5d29381

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

5303bee

Co-authored-by: Simon Branford <[email protected]>

Update easybuild/easyconfigs/t/Twisted/Twisted-25.5.0-GCCcore-13.3.0.eb

bc96450

Co-authored-by: Simon Branford <[email protected]>

fix tuple

b73663c

fix style

0010d31

bedroesb mentioned this pull request Nov 19, 2025

{devel}[system/system] code-cli v1.105.1 #24591

Merged

add binutils

cf6a3a5

smoors added this to the next release (5.2.0?) milestone Nov 22, 2025

smoors approved these changes Nov 22, 2025

View reviewed changes

smoors merged commit 2a29498 into easybuilders:develop Nov 22, 2025
8 checks passed

Conversation

bedroesb commented Nov 19, 2025

Uh oh!

bedroesb commented Nov 19, 2025

Uh oh!

branfosj left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bedroesb commented Nov 19, 2025

Uh oh!

branfosj commented Nov 19, 2025

Uh oh!

bedroesb commented Nov 19, 2025

Uh oh!

bedroesb commented Nov 19, 2025

Uh oh!

bedroesb commented Nov 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroesb commented Nov 21, 2025

Uh oh!

smoors commented Nov 22, 2025

Uh oh!

boegelbot commented Nov 22, 2025

Uh oh!

boegelbot commented Nov 22, 2025

Uh oh!

smoors left a comment

Choose a reason for hiding this comment

Uh oh!

smoors commented Nov 22, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

bedroesb commented Nov 19, 2025 •

edited

Loading