Skip to content

Initial set of OHPC module meta data for EasyBuild#2392

Merged
boegel merged 1 commit intoeasybuilders:developfrom
crbaird:develop
Feb 24, 2018
Merged

Initial set of OHPC module meta data for EasyBuild#2392
boegel merged 1 commit intoeasybuilders:developfrom
crbaird:develop

Conversation

@crbaird
Copy link
Copy Markdown
Contributor

@crbaird crbaird commented Feb 1, 2018

Signed-off-by: Reese Baird [email protected]

@boegel boegel added this to the next release (3.5.2 or 3.6.0) milestone Feb 2, 2018
@boegel
Copy link
Copy Markdown
Member

boegel commented Feb 2, 2018

@crbaird This looks great, thanks a look for looking into this!
(upstream ref: openhpc/ohpc#110)

I'm happy to merge this as is, but I'd like to get a better idea on how we move forward from here first...

Do we consider this to be sufficient, or do we want to take this a step further, e.g. by defining custom ohpc toolchains in EasyBuild that could leverage some of these external modules?
For example, gnu + openmpi + openblas + fftw could form foss-ohpc with it's own versioning scheme, probably tied to the OpenHPC release version.

And that could be taken even a step further, since EasyBuild also supports creating RPM packages by leveraging FPM (see http://easybuild.readthedocs.io/en/latest/Packaging_support.html).

Also, how was this metadata file created, how can we ensure this is easy to update in the future for upcoming OpenHPC releases?

One thing to keep in mind is that since we don't know which OpenHPC version EasyBuild will be used on, we should avoid blowing away old modules in this metadata file...

@crbaird
Copy link
Copy Markdown
Contributor Author

crbaird commented Feb 2, 2018

I think OHPC toolchains would be great, it just seemed like the module metadata was the lowest hanging fruit. I can take another look at what would be required for that.

There was some human intervention in creation of this version. The OHPC module/version pairs are easy to generate programmatically, but I didn't see a 1-1 mapping to the EasyBuild software names. Knowing that this file might be useful I can put some more effort in to automation, as well as adding in older modules.

@boegel
Copy link
Copy Markdown
Member

boegel commented Feb 22, 2018

@crbaird How shall we proceed here? Shall I include this as is, and revisit this later with upcoming OpenHPC releases?

I think it's important to try and come up with an automated process to update this file, otherwise it's going to be a maintenance nightmare, which will boil down to the file going stale I think...

@boegel boegel modified the milestones: 3.5.2, 3.6.0 Feb 23, 2018
@crbaird
Copy link
Copy Markdown
Contributor Author

crbaird commented Feb 23, 2018

Sorry, @boegel, I haven't gotten a chance to dive in to toolchain integration. If you feel the module stuff is useful on it's own, please feel free to include just this for now. I agree an eye needs to be keep on automating maintenance. We already have some internal tools to generate manifests and the like-- I bet we can modify something in there to help out.

@boegel boegel modified the milestones: 3.6.0, 3.5.2 Feb 24, 2018
@boegel
Copy link
Copy Markdown
Member

boegel commented Feb 24, 2018

@crbaird I see no reason not to include this, it's a good starting point. I'm merging this in, will be included with the next EasyBuild release (v3.5.2).

@boegel boegel merged commit 2306e98 into easybuilders:develop Feb 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants