add support for --dump-env-script by boegel · Pull Request #1624 · easybuilders/easybuild-framework

boegel · 2016-02-19T12:52:25Z

Example usage:

$ eb --dump-env-script GCC-4.9.2.eb OpenMPI-1.6.4-GCC-4.7.2.eb FFTW-3.3.3-gompi-1.4.10.eb
== temporary log file in case of crash /tmp/eb-yDmmIN/easybuild-ZFlM8G.log
Script to set up build environment for /example/GCC-4.9.2.eb dumped to GCC-4.9.2.env
Script to set up build environment for /example/OpenMPI-1.6.4-GCC-4.7.2.eb dumped to OpenMPI-1.6.4-GCC-4.7.2.env
Script to set up build environment for /example/FFTW-3.3.3-gompi-1.4.10.eb dumped to FFTW-3.3.3-gompi-1.4.10.env
== Temporary log file(s) /tmp/eb-yDmmIN/easybuild-ZFlM8G.log* have been removed.
== Temporary directory /tmp/eb-yDmmIN has been removed.

$ eb --dump-env-script GCC-4.9.2.eb                                                      
== temporary log file in case of crash /tmp/eb-_x72Fd/easybuild-ZvClAa.log
ERROR: One or more scripts already exists, not overwriting them (unless forced): GCC-4.9.2.env

$ eb --dump-env-script GCC-4.9.2.eb --force
== temporary log file in case of crash /tmp/eb-C4mBUJ/easybuild-_tFgst.log
Script to set up build environment for /example/GCC-4.9.2.eb dumped to GCC-4.9.2.env
== Temporary log file(s) /tmp/eb-C4mBUJ/easybuild-_tFgst.log* have been removed.
== Temporary directory /tmp/eb-C4mBUJ has been removed.

$ cat OpenMPI-1.6.4-GCC-4.7.2.env
#!/bin/bash
# script to set up build environment as defined by EasyBuild v2.7.0.dev0 for OpenMPI-1.6.4-GCC-4.7.2.eb
# usage: source OpenMPI-1.6.4-GCC-4.7.2.env

# toolchain & dependency modules
module load GCC/4.7.2
module load hwloc/1.6.2-GCC-4.7.2

# build environment
export CC='gcc'
export CFLAGS='-O2'
export CPPFLAGS=''
export CXX='g++'
export CXXFLAGS='-O2'
export F77='gfortran'
export F90='gfortran'
export F90FLAGS='-O2'
export FC='gfortran'
export FCFLAGS='-O2'
export FFLAGS='-O2'
export FLIBS='-lgfortran'
export LDFLAGS=''
export LIBS='-lm -lpthread'
export OPTFLAGS='-O2'
export PRECFLAGS=''

boegel · 2016-02-19T12:52:40Z

@molden: is this what you had in mind?

@wpoely86: please review?

hpcugentbot · 2016-02-19T12:59:40Z

EasyBuild framework unit test suite FAILed.

See https://jenkins1.ugent.be/job/easybuild-framework-pr-builder/2733/console for more details.

Please fix the reported issues by pushing additional commits to the branch corresponding with this pull request; contact @boegel if you're not sure what to do.

molden · 2016-02-19T13:04:47Z

So this will only set the environment if I'm not mistaken. What about a 'dump-installation-script'? Will this also be included?

boegel · 2016-02-19T13:09:24Z

@molden: which would do what exactly?

The procedure as spit out by extended dry run is always going to be incomplete, that's why we have easyblocks...

With some effort, you may be able to get it to work for 80% of the installations, but making it perfect... You might as well rewrite everything in bash imho.

molden · 2016-02-19T13:23:10Z

@boegel : true, I maybe misunderstood that the extended dry run function would be rewritten in script format.

boegel · 2016-02-19T13:28:46Z

@molden: well, that's doable, but what would you be using that for? You'd still have to go and check the easyblock (potentially) to verify that all actions are actually reflected in the output of extended dry run.

Making that airtight is very hard, I think.

molden · 2016-02-19T13:48:02Z

@boegel I see, maybe these issues should be discussed here: #1584

hpcugentbot · 2016-02-19T14:02:30Z

EasyBuild framework unit test suite PASSed (see https://jenkins1.ugent.be/job/easybuild-framework-pr-builder/2734/console for more details).

This pull request is now ready for review/testing.

Please try and find someone who can tackle this; contact @boegel if you're not sure what to do.

wpoely86 · 2016-02-20T12:35:20Z

                raise EasyBuildError("Applying patch %s failed", patch['name'])

-    def prepare_step(self):
+    def prepare_step(self, start_dir=True):


hpcugentbot · 2016-02-21T15:38:14Z

EasyBuild framework unit test suite PASSed (see https://jenkins1.ugent.be/job/easybuild-framework-pr-builder/2745/console for more details).

This pull request is now ready for review/testing.

Please try and find someone who can tackle this; contact @boegel if you're not sure what to do.

hpcugentbot · 2016-03-09T16:29:50Z

EasyBuild framework unit test suite FAILed.

See https://jenkins1.ugent.be/job/easybuild-framework-pr-builder/2846/console for more details.

Please fix the reported issues by pushing additional commits to the branch corresponding with this pull request; contact @boegel if you're not sure what to do.

boegel · 2016-03-09T17:27:02Z

Jenkins: test this please

hpcugentbot · 2016-03-09T18:33:18Z

EasyBuild framework unit test suite PASSed (see https://jenkins1.ugent.be/job/easybuild-framework-pr-builder/2849/console for more details).

This pull request is now ready for review/testing.

Please try and find someone who can tackle this; contact @boegel if you're not sure what to do.

boegel added 7 commits February 19, 2016 11:46

implement support for --dump-env-script

0f4ebfd

wrap env var values in single quotes

857642d

add test for --dump-env-script

6ca2fab

restore environment + guard quering toolchain modules/env vars

7054a56

more extensive test for --dump-env-script

87bd332

better header in .env script

3923a74

fix test

0b554e7

boegel added this to the v2.7.0 milestone Feb 19, 2016

add bad accidentally removed import in options.py test module

1f4808f

wpoely86 reviewed Feb 20, 2016
View reviewed changes

boegel added 2 commits February 21, 2016 15:50

fix remarks

ef5d7dc

Merge branch 'develop' into dump_env_script

60e80a7

Merge branch 'develop' into dump_env_script

5883b1b

Conversation

boegel commented Feb 19, 2016

Uh oh!

boegel commented Feb 19, 2016

Uh oh!

hpcugentbot commented Feb 19, 2016

Uh oh!

molden commented Feb 19, 2016

Uh oh!

boegel commented Feb 19, 2016

Uh oh!

molden commented Feb 19, 2016

Uh oh!

boegel commented Feb 19, 2016

Uh oh!

molden commented Feb 19, 2016

Uh oh!

hpcugentbot commented Feb 19, 2016

Uh oh!

wpoely86 Feb 20, 2016

Choose a reason for hiding this comment

Uh oh!

hpcugentbot commented Feb 21, 2016

Uh oh!

hpcugentbot commented Mar 9, 2016

Uh oh!

boegel commented Mar 9, 2016

Uh oh!

hpcugentbot commented Mar 9, 2016

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants