add patches to fix installation of R 3.6.2 on POWER by Flamefire · Pull Request #9830 · easybuilders/easybuild-easyconfigs

Flamefire · 2020-02-05T07:49:47Z

(created using eb --new-pr)

For build in Power9 requires:

change Mesa 19.1.7 + 19.2.1 easyconfigs to use custom easyblock for Mesa #9764
- Change options based on arch for Mesa easybuild-easyblocks#1892
Update config.guess for all R packages easybuild-easyblocks#1949
Removing intel-specific sanity check for libdrm #9694

boegel · 2020-02-08T15:03:27Z

@Flamefire Does this depend on other PRs, or did you accidentally mess up the test environment?

Flamefire · 2020-02-08T15:23:48Z

Depends. It fixes compilation of R as-is. The extensions aren't fixed yet. E.g. liquidSVM needs to be removed: https://github.com/easybuilders/easybuild-easyconfigs/pull/9544/files#r365531097

I updated the initial description with the dependencies for Power9

Flamefire · 2020-02-12T13:31:03Z

@boegel Regarding liquidSVM: It seems it won't use the std flag for cuda which would solve the issue (tried patching it manually)

So either we patch their https://github.com/liquidSVM/liquidSVM/blob/da19280562f443ab2b1fca898862f76c4ebc0bbd/bindings/R/liquidSVM/configure somehow or remove liquidSVM indeed, but that would be hard to argue for (as it works for most). I'm also concerned about it "Using target: generic" (see logs) but that might be R...

Flamefire · 2020-02-25T00:59:50Z

Test report by @Flamefire
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
taurusml18 - Linux RHEL 7.6, 8335-GTX, Python 2.7.5
See https://gist.github.com/c9b22d0613fb88f1f8670a2bfaf3bb40 for a full test report.

Flamefire · 2020-02-25T08:11:53Z

@boegel Can this (and the related PRs) be addressed soonish? As per my last test report this makes R build on Power9, so IMO those are good to go :)

@edmondac You might want to give this a spin too. You already have most of the dependencies so you only need the rpackage EB to test this.

verdurin · 2020-02-25T10:50:22Z

@Flamefire Would be good to see a test from another POWER9 machine if possible.
I suppose a test from an x86_64 machine would be good too, to show this doesn't break anything there.

Flamefire · 2020-02-25T11:51:27Z

Working on a x86 report. @edmondac can probably provide one from another Power9

Flamefire · 2020-02-26T18:26:21Z

Test report by @Flamefire
SUCCESS
Build succeeded for 5 out of 5 (2 easyconfigs in this PR)
taurusi5070.taurus.hrsk.tu-dresden.de - Linux RHEL 7.7, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/65afd0342680641802988cc9d5f87d0e for a full test report.

edmondac · 2020-02-28T12:46:51Z

Test reports running now...

edmondac · 2020-02-28T20:30:32Z

Test report by @bear-rsg
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
bear-pg0212u17a.bear.cluster - Linux centos linux 7.7.1908, Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz, Python 2.7.5
See https://gist.github.com/7f3f795746c684a2983b96c7860cebe6 for a full test report.

edmondac · 2020-02-28T22:57:28Z

Test report by @bear-rsg
SUCCESS
Build succeeded for 10 out of 10 (2 easyconfigs in this PR)
bear-pg0305u11a.bear.cluster - Linux RHEL 7.6, 8335-GTX, Python 2.7.5
See https://gist.github.com/1900f4ff92c3d36fa98c111f5609c16a for a full test report.

edmondac · 2020-03-02T13:08:10Z

@verdurin I've added a test report for x86_64 and another for ppc64le

Flamefire · 2020-03-03T12:40:13Z

@migueldiascosta Can this be merged? Pending the other PRs for fully building, but it does improve it and does not break anything. It just errors at different stages on Power without the other PRs. (Of course would be great to have them merged too, but some are not fully ready yet)

migueldiascosta · 2020-03-04T14:32:37Z

Test report by @migueldiascosta
FAILED
Build succeeded for 1 out of 2 (2 easyconfigs in this PR)
generoso-3 - Linux centos linux 7.6.1810, Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz, Python 3.6.8
See https://gist.github.com/8a5c596b2809d6ca011024ae3e45d7d5 for a full test report.

Flamefire · 2020-03-04T14:52:17Z

@migueldiascosta Failed to remove the folder? The error is way to generic. Better: easybuilders/easybuild-framework#3228

zao · 2020-03-18T19:46:26Z

Test report by @zao
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
freja - Linux ubuntu 18.04, Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz, Python 2.7.17
See https://gist.github.com/d4adc9e70e01a3252af3b8db1f34448b for a full test report.

Flamefire · 2020-04-14T13:21:12Z

Rebased to develop, running tests on x86 and Power9 without easybuilders/easybuild-easyblocks#1949 now

Flamefire · 2020-04-14T17:18:03Z

Test report by @Flamefire
FAILED
Build succeeded for 8 out of 10 (2 easyconfigs in this PR)
taurusml30 - Linux RHEL 7.6, 8335-GTX, Python 2.7.5
See https://gist.github.com/f722a02ccf19048a97508bd1247bf3ce for a full test report.

Flamefire · 2020-04-15T00:06:26Z

Test report by @Flamefire
SUCCESS
Build succeeded for 5 out of 5 (2 easyconfigs in this PR)
taurusi6309.taurus.hrsk.tu-dresden.de - Linux RHEL 7.7, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/274c03dba2a5a5a6a50032783b38f6c7 for a full test report.

Flamefire · 2020-04-15T06:41:31Z

x86 succeeded and Power failed (as expected)

Running tests with easybuilders/easybuild-easyblocks#1949 now

branfosj · 2020-04-15T07:30:13Z

I've also set off x86 and Power tests of this PR using easybuilders/easybuild-easyblocks#1949

branfosj · 2020-04-15T10:34:01Z

Test report by @branfosj
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in this PR)
bear-pg0211u03a.bear.cluster - Linux centos linux 7.7.1908, Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz (cascadelake), Python 3.6.8
See https://gist.github.com/0767337ba743adc8ac8a4aa8a4549a60 for a full test report.

branfosj · 2020-04-15T14:23:11Z

Test report by @branfosj
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
bear-pg0212u15b.bear.cluster - Linux centos linux 7.7.1908, Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz (broadwell), Python 3.6.8
See https://gist.github.com/5df1b40a1564ecb3130cd1a937ed2680 for a full test report.

branfosj · 2020-04-15T15:18:47Z

Test report by @branfosj
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
bear-pg0305u19a.bear.cluster - Linux RHEL 7.6, 8335-GTX (power9le), Python 3.6.8
See https://gist.github.com/51cb983cfd451cd01b2929c5b920d3d6 for a full test report.

Flamefire · 2020-04-15T16:24:46Z

Test report by @Flamefire
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
taurusi6205.taurus.hrsk.tu-dresden.de - Linux RHEL 7.7, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/42bc22a9e2bcc12a99c5d06e8af14bee for a full test report.

Flamefire · 2020-04-15T17:32:52Z

Test report by @Flamefire
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
taurusml22 - Linux RHEL 7.6, 8335-GTX, Python 2.7.5
See https://gist.github.com/826a9107bb839d56f1c094020d4a192d for a full test report.

lexming · 2020-04-25T22:50:32Z

Test report by @lexming
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
node154.hydra.os - Linux centos linux 7.7.1908, x86_64, Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz, Python 2.7.5
See https://gist.github.com/92fa6ee533c96608923ab2103da3d0fd for a full test report.

…asyconfigs into 20200205084938_new_pr_R362

lexming · 2020-04-26T14:26:54Z

Test report by @lexming
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in this PR)
node150.hydra.os - Linux centos linux 7.7.1908, x86_64, Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz, Python 2.7.5
See https://gist.github.com/2e6e7a4283aa4be7c9503eb36ac4e6a8 for a full test report.

lexming

Synced to develop and everything built fine.

LGTM

lexming · 2020-04-26T16:19:24Z

Going in, thanks @Flamefire !

Flamefire · 2020-04-27T09:03:58Z

Great! Now only easybuilders/easybuild-easyblocks#1949 is missing for Power support of R. Added the change I was talking about there so should be ready to merge after CI ran through.

Flamefire mentioned this pull request Feb 5, 2020

Changes to support building R-keras and dependencies on POWER9 #9544

Closed

boegel added the bug fix label Feb 8, 2020

boegel added this to the 4.x milestone Feb 8, 2020

Flamefire force-pushed the 20200205084938_new_pr_R362 branch from 8cd9d58 to 4d256d9 Compare February 10, 2020 12:32

Flamefire force-pushed the 20200205084938_new_pr_R362 branch from c551157 to 621c946 Compare February 21, 2020 07:50

Flamefire force-pushed the 20200205084938_new_pr_R362 branch from 621c946 to 9e30ba7 Compare March 23, 2020 14:59

boegel modified the milestones: 4.x, release after 4.2.0 (4.2.1?) Apr 14, 2020

Flamefire added 2 commits April 14, 2020 15:20

[R 3.6.2] Fix build on Power9

339d403

[liquidSVM] Fix building on Power9

f22e33f

Flamefire force-pushed the 20200205084938_new_pr_R362 branch from 9e30ba7 to f22e33f Compare April 14, 2020 13:20

This was referenced Apr 16, 2020

Update config.guess for all R packages easybuilders/easybuild-easyblocks#1949

Merged

also mention CPU architecture (x86_64, POWER) in comment for test reports easybuilders/easybuild-framework#3281

Merged

Merge branch 'develop' of https://github.com/easybuilders/easybuild-e…

22719f9

…asyconfigs into 20200205084938_new_pr_R362

lexming approved these changes Apr 26, 2020

View reviewed changes

lexming merged commit b41b4cc into easybuilders:develop Apr 26, 2020

Flamefire deleted the 20200205084938_new_pr_R362 branch April 27, 2020 06:48

branfosj mentioned this pull request Apr 29, 2020

Fix R 3.6.3 on Power9 #10531

Merged

boegel changed the title ~~[R 3.6.2] Fix build on Power9~~ add patches to fix installation of R 3.6.2 on POWER Apr 29, 2020

Conversation

Flamefire commented Feb 5, 2020 • edited by boegel Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

boegel commented Feb 8, 2020

Uh oh!

Flamefire commented Feb 8, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Flamefire commented Feb 12, 2020

Uh oh!

Flamefire commented Feb 25, 2020

Uh oh!

Flamefire commented Feb 25, 2020

Uh oh!

verdurin commented Feb 25, 2020

Uh oh!

Flamefire commented Feb 25, 2020

Uh oh!

Flamefire commented Feb 26, 2020

Uh oh!

edmondac commented Feb 28, 2020

Uh oh!

edmondac commented Feb 28, 2020

Uh oh!

edmondac commented Feb 28, 2020

Uh oh!

edmondac commented Mar 2, 2020

Uh oh!

Flamefire commented Mar 3, 2020

Uh oh!

migueldiascosta commented Mar 4, 2020

Uh oh!

Flamefire commented Mar 4, 2020

Uh oh!

zao commented Mar 18, 2020

Uh oh!

Flamefire commented Apr 14, 2020

Uh oh!

Flamefire commented Apr 14, 2020

Uh oh!

Flamefire commented Apr 15, 2020

Uh oh!

Flamefire commented Apr 15, 2020

Uh oh!

branfosj commented Apr 15, 2020

Uh oh!

branfosj commented Apr 15, 2020

Uh oh!

branfosj commented Apr 15, 2020

Uh oh!

branfosj commented Apr 15, 2020

Uh oh!

Flamefire commented Apr 15, 2020

Uh oh!

Flamefire commented Apr 15, 2020

Uh oh!

lexming commented Apr 25, 2020

Uh oh!

lexming commented Apr 26, 2020

Uh oh!

lexming left a comment

Choose a reason for hiding this comment

Uh oh!

lexming commented Apr 26, 2020

Uh oh!

Flamefire commented Apr 27, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Flamefire commented Feb 5, 2020 •

edited by boegel

Loading

Flamefire commented Feb 8, 2020 •

edited

Loading