enhance PETSc easyblock to run tests in parallel#2601
enhance PETSc easyblock to run tests in parallel#2601boegel merged 2 commits intoeasybuilders:developfrom
Conversation
…th 64 cores, where it speeds up the test suite from about 3.5 hours to about 30 mins.
|
This should probably be synced with easybuilders/easybuild-framework#3842 although I'm not sure if it has an impact or not. |
|
Test report by @boegel Overview of tested easyconfigs (in order)
Build succeeded for 7 out of 7 (7 easyconfigs in total) |
|
Test report by @boegel Overview of tested easyconfigs (in order)
Build succeeded for 3 out of 3 (3 easyconfigs in total) |
|
@akesandgren : I'd probably not make this PR dependend on what is decided in easybuilders/easybuild-framework#3842 , it would delay integration of this block until a decision has been taken in that other PR. Also: the notion in that PR (for now) is not to break EasyBlocks that use |
|
Test report by @boegel Overview of tested easyconfigs (in order)
Build succeeded for 4 out of 4 (4 easyconfigs in total) |
The PETSc test suite can run in parallel by passing a
-j <n>(see https://petsc4py.readthedocs.io/en/stable/manual/tests/) but the previous EasyBlock would just run things serially.I've tested with 64 tasks (on a 128 core node), which speeds up the test suite from about 3.5 hours to about 30 mins. On another 16-core node, with 16 tasks, it was even down to 17 minutes (probably faster filesystem)