Skip to content

Create a goolfc toolchain using CUDA 8.0.44#3666

Merged
boegel merged 4 commits intoeasybuilders:developfrom
akesandgren:goolfc-with-cuda8
Oct 28, 2016
Merged

Create a goolfc toolchain using CUDA 8.0.44#3666
boegel merged 4 commits intoeasybuilders:developfrom
akesandgren:goolfc-with-cuda8

Conversation

@akesandgren
Copy link
Copy Markdown
Contributor

@akesandgren akesandgren commented Oct 11, 2016

Create a goolfc toolchain using CUDA 8.0.44 and the latest versions of the dependencies.

CUDA 8.0.44
GCC 5.4.0-2.26 (Cuda still doesn't support any newer GCC compiler)
FFTW 3.3.5
OpenBLAS 0.2.19/Lapack 3.6.1
OpenMPI 2.0.1
Scalapack 2.0.2

@akesandgren
Create a goolfc toolchain using CUDA 8.0.44 and the latest versions o…
1fbe2a8 
…f the dependencies.

CUDA 8.0.44
GCC 5.4.0-2.26 (Cuda still doesn't support any newer GCC compiler)
FFTW 3.3.5
OpenBLAS 0.2.19/Lapack 3.6.1
OpenMPI 2.0.1
Scalapack 2.0.2
@akesandgren
Add numactl-2.0.11-gcccuda-2016.10.0.eb config for the goo9lfc-2016.10.0
5ccc895 
toolchain.
@boegel boegel added this to the 3.0 milestone Oct 13, 2016
boegel
boegel requested changes Oct 13, 2016
View reviewed changes
Comment thread easybuild/easyconfigs/o/OpenMPI/OpenMPI-2.0.1-gcccuda-2016.10.0.eb Outdated
#patches = [
# 'OpenMPI-%(version)s_common-cuda-lib.patch',
# 'OpenMPI-%(version)s-vt_cupti_events.patch',
#]
Copy link
Copy Markdown
Member

@boegel boegel Oct 13, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@akesandgren I guess this commented out block can be removed?

Copy link
Copy Markdown
Contributor Author

@akesandgren akesandgren Oct 24, 2016 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe, I didn't look at the patches properly. I'll do that and see if they are still needed or not.

Copy link
Copy Markdown
Contributor Author

@akesandgren akesandgren Oct 24, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The are not needed and have been removed.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 13, 2016

Test report by @boegel
FAILED
Build succeeded for 7 out of 10 (10 easyconfigs in this PR)
node2135.delcatty.os - Linux SL 6.8, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/ca2a77f24c5f753fef171e9acfc930d1 for a full test report.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 13, 2016

ah, I should fix this in the ScaLAPACK easyblock in develop...

== 2016-10-13 17:08:36,190 easyblock.py:2178 INFO Running method configure_step part of step configure
== 2016-10-13 17:08:36,190 fancylogger.py:269 WARNING DEPRECATED (since v3.0) functionality used: EB_ScaLAPACK.configure_step uses hardcoded list of LAPACK libs; see http://easybuild.readthedocs.org/en/latest/Deprecated-functionality.html for more information
== 2016-10-13 17:08:36,630 build_log.py:163 ERROR DEPRECATED (since v3.0) functionality used: EB_ScaLAPACK.configure_step uses hardcoded list of LAPACK libs; see http://easybuild.readthedocs.org/en/latest/Deprecated-functionality.html for more information (at vsc/utils/fancylogger.py:321 in raiseException)

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 13, 2016

Test report by @boegel
FAILED
Build succeeded for 8 out of 10 (10 easyconfigs in this PR)
node2656.swalot.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz, Python 2.7.5
See https://gist.github.com/d4eec2014037807a126f905fb0c57bb7 for a full test report.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 14, 2016

required updates for ScaLAPACK easyblock to make it work again with EasyBuild v3.x implemented in easybuilders/easybuild-easyblocks#1014

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 23, 2016

Test report by @boegel
FAILED
Build succeeded for 8 out of 10 (10 easyconfigs in this PR)
node1213.muk.os - Linux SL 6.8, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/35601811c79bb29e640ff1694f9f600f for a full test report.

@akesandgren
The patches block in OpenMPI for cuda is no longer needed.
8335ca8 
This is true from OpeMPI versions 1.10 and upwards.
@akesandgren
Copy link
Copy Markdown
Contributor Author

akesandgren commented Oct 24, 2016

The avx2 failure on Sandybridge is obvious, but is there a way to easily find out what features are available and add the respective build flags?

@akesandgren
For the time being, drop --enable-avx2 from the configopts of FFTW.
3a05c4b 
Need to have a way to detect available features of the cpu used for
building and add flags accordingly.
@akesandgren
Copy link
Copy Markdown
Contributor Author

akesandgren commented Oct 24, 2016

Dropped the enable-avx2 flags for FFTW for the time being.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 25, 2016

@akesandgren I think the only solution is to create an easyblock for FFTW that checks the processor features of the system it is being installed on, unless instructed otherwise.

See also the discussion on the EasyBuild mailing list recently (https://lists.ugent.be/wws/arc/easybuild/2016-10/msg00000.html).

@boegel boegel mentioned this pull request Oct 27, 2016
Merged
@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 28, 2016

Test report by @boegel
SUCCESS
Build succeeded for 10 out of 10 (10 easyconfigs in this PR)
node1099.muk.os - Linux SL 6.8, Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, Python 2.6.6
See https://gist.github.com/cd7de0351a8602d4812f8331427ba4e1 for a full test report.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 28, 2016

Test report by @boegel
SUCCESS
Build succeeded for 10 out of 10 (10 easyconfigs in this PR)
node2301.phanpy.os - Linux centos linux 7.2.1511, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/37554d155ff4d48b3c97783a7dca469b for a full test report.

@boegel
Copy link
Copy Markdown
Member

boegel commented Oct 28, 2016

Good to go now, thanks @akesandgren!

@boegel boegel merged commit 6035f5f into easybuilders:develop Oct 28, 2016
@akesandgren akesandgren deleted the goolfc-with-cuda8 branch November 4, 2016 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@boegel boegel boegel approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

3.0

Development

Successfully merging this pull request may close these issues.

2 participants

@akesandgren @boegel