Skip to content

{toolchain}[pomkl/2016.04] HPL 2.1 (REVIEW)#3044

Merged
boegel merged 5 commits intoeasybuilders:developfrom
boegel:pomkl_201604
May 15, 2016
Merged

{toolchain}[pomkl/2016.04] HPL 2.1 (REVIEW)#3044
boegel merged 5 commits intoeasybuilders:developfrom
boegel:pomkl_201604

Conversation

@boegel
Copy link
Copy Markdown
Member

@boegel boegel commented May 11, 2016

PGI-based toolchain for latest PGI 16.4 on top of GCC 5.3.0 and binutils 2.26

requires easybuilders/easybuild-easyblocks#916 and easybuilders/easybuild-framework#1761

@boegel boegel added this to the v2.8.0 milestone May 11, 2016
@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 11, 2016

@bartoldeman, @ocaisa, @damianam, @rjeschmi: please review?

# needs to include -ldl or else we get
# .../libmkl_core.a(mkl_memory_patched.o): undefined reference to symbol 'dlsym@@GLIBC_2.2.5'
import os
os.environ['LIBS'] = '-ldl'
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bartoldeman I'd like to figure this out and get it fixed in the toolchain support in framework, rather this via this 'hack'...

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see also #2900 (comment)

@hpcugentbot
Copy link
Copy Markdown

Easyconfigs unit test suite PASSed (see https://jenkins1.ugent.be/job/easybuild-easyconfigs-pr-builder/7999/console for more details).

This pull request is now ready for review/testing.

Please try and find someone who can tackle this; contact @boegel if you're not sure what to do.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 8 out of 8 (8 easyconfigs in this PR)
node2608.swalot.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz, Python 2.7.5
See https://gist.github.com/9c0a6be25c85de3bf5acac1cbfa4fb76 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 8 out of 8 (8 easyconfigs in this PR)
node2159.delcatty.os - Linux SL 6.7, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/edc07360756827960a7bf4433bd3e913 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Jenkins: test this please

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 9 out of 9 (9 easyconfigs in this PR)
node2608.swalot.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz, Python 2.7.5
See https://gist.github.com/311019df7a178724652e36956d8a855b for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 9 out of 9 (9 easyconfigs in this PR)
node2159.delcatty.os - Linux SL 6.7, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/a85b14b07b3b3657599b787ddf063f68 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
FAILED
Build succeeded for 7 out of 9 (9 easyconfigs in this PR)
node2608.swalot.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz, Python 2.7.5
See https://gist.github.com/f5dfc6edecbcf32237c0ec1caa91c4cf for a full test report.

edit: failing test caused by outdated easyblock for Intel MKL, please ignore, will retest with imkl easyblock in develop (required for PGI support, cfr. easybuilders/easybuild-easyblocks#866)

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 9 out of 9 (9 easyconfigs in this PR)
node2608.swalot.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz, Python 2.7.5
See https://gist.github.com/7aea33e4f6a9586903ceb3820696c610 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

Test report by @boegel
SUCCESS
Build succeeded for 9 out of 9 (9 easyconfigs in this PR)
node2129.delcatty.os - Linux SL 6.7, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/a09a232f4bad59ccd9251605260d64bc for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

tested on top of easybuilders/easybuild-framework@67abf99

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 12, 2016

I'd love to get some feedback on this from @rjeschmi, @bartoldeman, @damianam or @ocaisa before this goes in...

source_urls = ['http://www.open-mpi.org/software/hwloc/v%(version_major_minor)s/downloads/']
sources = [SOURCE_TAR_GZ]

# numactl is a direct dependency of PGI
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even if numactl is a direct dependency of PGI, I think it doesn't hurt to have it here also (at least if you are using minimal toolchains). In my opinion if we reference $EBROOTSOMETHING this something should be a dependency or an intrinsic part of the toolchain (compiler/mpi/math), specially if all the other versions that package have it as a dependency. Otherwise I see it as error prone (if PGI drops numactl as a dependency for instance).

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe include it as ('numactl', '2.0.11', '', ('GCCcore', gccver))?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree that it would be better to include numactl as an explicit dependency, but then again hardcoding a subtoolchain (which would be required in this case) will mess up things like --try-toolchain.
On the other hands, without including numactl as an explicit dep, you'll run into problems too with --try-toolchain, since you would have to go and dive in and add the numactl dependency for it to work. Hmm. :-)

Since we're screwed either way, I feel including numactl as an explicit dep is better, indeed.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 13, 2016

Test report by @boegel
SUCCESS
Build succeeded for 10 out of 10 (10 easyconfigs in this PR)
node2159.delcatty.os - Linux SL 6.7, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/b0ffa20fd443643199868a7c61cb1ef2 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 13, 2016

last test was on top of easybuilders/easybuild-easyblocks#919

@bartoldeman
Copy link
Copy Markdown
Contributor

I can confirm that it works here, and I am fine with the explicit numactl dependency.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 13, 2016

Thanks for the feedback @bartoldeman!

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 14, 2016

Test report by @boegel
SUCCESS
Build succeeded for 10 out of 10 (10 easyconfigs in this PR)
node2014.delcatty.os - Linux SL 6.7, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/8425943e4a5c171b8c66c7f453d0bf5d for a full test report.

edit: tested on top of easybuilders/easybuild-framework#1764

@boegel boegel changed the title {toolchain}[pompi/2016.04] HPL 2.1 (REVIEW) {toolchain}[pomkl/2016.04] HPL 2.1 (REVIEW) May 14, 2016
@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 15, 2016

Test report by @boegel
SUCCESS
Build succeeded for 17 out of 17 (10 easyconfigs in this PR)
node2572.golett.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/3069e7776d445e8e75a51669ceac06f6 for a full test report.

@boegel
Copy link
Copy Markdown
Member Author

boegel commented May 15, 2016

Going in, thanks for the feedback @bartoldeman , @damianam and @rjeschmi!

@boegel boegel merged commit 6c67a7e into easybuilders:develop May 15, 2016
@boegel boegel deleted the pomkl_201604 branch May 15, 2016 20:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants