Skip to content

{ai}[foss/2023a] vLLM v0.4.0, xformers v0.0.23.post1 w/ CUDA 12.1.1#21901

Merged
laraPPr merged 2 commits intoeasybuilders:developfrom
pavelToman:20241122130705_new_pr_vLLM040
Dec 20, 2024
Merged

{ai}[foss/2023a] vLLM v0.4.0, xformers v0.0.23.post1 w/ CUDA 12.1.1#21901
laraPPr merged 2 commits intoeasybuilders:developfrom
pavelToman:20241122130705_new_pr_vLLM040

Conversation

@pavelToman
Copy link
Copy Markdown
Collaborator

@pavelToman pavelToman commented Nov 22, 2024 •
edited
Loading

(created using eb --new-pr)
resolves vscentrum/vsc-software-stack#257

@github-actions github-actions Bot added the new label Nov 22, 2024
@pavelToman pavelToman mentioned this pull request Nov 22, 2024
Closed
2 tasks
@pavelToman
Copy link
Copy Markdown
Collaborator Author

pavelToman commented Nov 22, 2024

@boegelbot please test @ generoso

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

@pavelToman: Request for testing this PR well received on login1

PR test command 'EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 14752

Test results coming soon (I hope)...

Details

- notification for comment with ID 2493620067 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

Test report by @boegelbot
FAILED
Build succeeded for 0 out of 2 (2 easyconfigs in total)
cns1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/c97058e8b2491ceb904fdd671f791454 for a full test report.

@pavelToman
Copy link
Copy Markdown
Collaborator Author

pavelToman commented Nov 22, 2024

Test report by @pavelToman
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in total)
node4001.donphan.os - Linux RHEL 8.8, x86_64, Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz, 1 x NVIDIA NVIDIA A2, 545.23.08, Python 3.6.8
See https://gist.github.com/pavelToman/d5b5907f00d8d1931aa79ff621a4f9db for a full test report.

@pavelToman
Copy link
Copy Markdown
Collaborator Author

pavelToman commented Nov 22, 2024

@boegelbot please test @ jsc-zen3

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 5319

Test results coming soon (I hope)...

Details

- notification for comment with ID 2493684897 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegel
Copy link
Copy Markdown
Member

boegel commented Nov 22, 2024

@boegelbot please test @ generoso
CORE_CNT=16

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

@boegel: Request for testing this PR well received on login1

PR test command 'EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 14753

Test results coming soon (I hope)...

Details

- notification for comment with ID 2493710277 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

Test report by @boegelbot
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/9c98bffcb2adae325abb631c71d593b9 for a full test report.

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

Test report by @boegelbot
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/4473799ad4a42541481840893d2f4100 for a full test report.

@pavelToman
Copy link
Copy Markdown
Collaborator Author

pavelToman commented Nov 22, 2024

Test report by @boegelbot FAILED Build succeeded for 0 out of 2 (2 easyconfigs in total) cns1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8 See https://gist.github.com/boegelbot/c97058e8b2491ceb904fdd671f791454 for a full test report.

For compiling of xformers you need more memory than default one on generoso

@pavelToman
Copy link
Copy Markdown
Collaborator Author

pavelToman commented Nov 22, 2024

@boegelbot please test @ jsc-zen3-a100

@boegelbot
Copy link
Copy Markdown
Collaborator

boegelbot commented Nov 22, 2024

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21901 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21901 --ntasks=8 --partition=jsczen3g --gres=gpu:1 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 5322

Test results coming soon (I hope)...

Details

- notification for comment with ID 2493823588 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@laraPPr
Copy link
Copy Markdown
Contributor

laraPPr commented Dec 20, 2024

Test report by @laraPPr
SUCCESS
Build succeeded for 3 out of 3 (2 easyconfigs in total)
node4007.donphan.os - Linux RHEL 8.8, x86_64, Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz, 1 x NVIDIA NVIDIA A2, 545.23.08, Python 3.11.3
See https://gist.github.com/laraPPr/a692142cab5a0892bfae9d5fca606f4a for a full test report.

@laraPPr laraPPr added this to the 4.x milestone Dec 20, 2024
laraPPr
laraPPr approved these changes Dec 20, 2024
View reviewed changes
Copy link
Copy Markdown
Contributor

@laraPPr laraPPr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@laraPPr
Copy link
Copy Markdown
Contributor

laraPPr commented Dec 20, 2024

Going in, thanks @pavelToman!

@laraPPr laraPPr merged commit 884b086 into easybuilders:develop Dec 20, 2024
@laraPPr laraPPr modified the milestones: 4.x, release after 4.9.4 Dec 20, 2024
@boegel boegel modified the milestones: release after 4.9.4, 5.0.0 Mar 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@laraPPr laraPPr laraPPr approved these changes

Assignees

No one assigned

Labels

new

Projects

None yet

Milestone

5.0.0

Development

Successfully merging this pull request may close these issues.

vLLM + ray

4 participants

@pavelToman @boegelbot @boegel @laraPPr