Disable superpmi tests on Mono by Copilot · Pull Request #125007 · dotnet/runtime

Copilot · 2026-02-28T09:33:21Z

Description

Mono AOT builds fail with No merged runner found for test script .../JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh because the superpmi test's _BuildSpmiTestProjectScripts target generates sub-test .sh scripts that are picked up by GetListOfTestCmds validation but have no merged runner or OutOfProcessTest marker. This validation only runs during Mono AOT (via MonoAotCompileTests), so CoreCLR builds are unaffected.

Two changes to disable superpmi tests for Mono:

superpmicollect.csproj: Added <MonoAotIncompatible>true</MonoAotIncompatible> — superpmi tests are CoreCLR-specific tooling, not useful for Mono platforms. This causes a .NoMonoAot marker file to be generated, which the existing build.proj logic already uses to exclude assemblies from Mono AOT compilation.
runtime-llvm.yml: Removed -tree:JIT/superpmi from the LLVM AOT job's testBuildArgs parameter list so superpmi tests are no longer built or run in Mono LLVM AOT pipelines.

Original prompt

This section details on the original issue you should resolve

<issue_title>[Build Error][Mono] "No merged runner found for test script" for superpmi sub-test scripts in LLVMFULLAOT_RuntimeTests</issue_title>
<issue_description>## Build Information
Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1310017
Build error leg or test failing: AOT compile CoreCLR tests
/__w/1/s/src/tests/build.proj(170,5): error : No merged runner found for test script /__w/1/s/artifacts/tests/coreclr/linux.x64.Release/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh
Possibly caused by #123110 cc: @jkoritzinsky
We could possibly skip the superpmi tests for Mono completely.

Error Message

Fill the error message using step by step known issues guidance.
{
  "ErrorPattern": "error : No merged runner found for test script.*JIT\\/superpmi\\/superpmicollect\\/Bytemark\\/Bytemark\\.sh",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1310017
Error message validated: [error : No merged runner found for test script.*JIT\/superpmi\/superpmicollect\/Bytemark\/Bytemark\.sh]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/26/2026 10:48:27 AM UTC

Report

Build Definition Step Name Console log Pull Request

1313593 dotnet/runtime AOT compile CoreCLR tests Log

1313075 dotnet/runtime AOT compile CoreCLR tests Log

1312558 dotnet/runtime AOT compile CoreCLR tests Log

1311779 dotnet/runtime AOT compile CoreCLR tests Log

1311582 dotnet/runtime AOT compile CoreCLR tests Log

1310767 dotnet/runtime AOT compile CoreCLR tests Log

1310017 dotnet/runtime AOT compile CoreCLR tests Log

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count

2 7 7

<agent_instructions>Disable the superpmi tests on Mono</agent_instructions>

Comments on the Issue (you are @copilot in this section)
@jkoritzinsky @matouskozak the correct fix here is to disable the superpmi tests completely for Mono. They're not useful for Mono platforms.

Fixes [Build Error][Mono] "No merged runner found for test script" for superpmi sub-test scripts in LLVMFULLAOT_RuntimeTests #124890

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Add MonoAotIncompatible to superpmicollect.csproj since superpmi tests are CoreCLR-specific. Fix build.proj GetListOfTestCmds to exclude scripts under OutOfProcessTest directories from the merged runner validation, as they are components of the out-of-process test rather than standalone tests. Co-authored-by: matouskozak <[email protected]>

src/tests/build.proj

…llect.csproj Co-authored-by: matouskozak <[email protected]>

matouskozak · 2026-03-02T11:24:32Z

/azp run runtime-llvm

azure-pipelines · 2026-03-02T11:24:39Z

Azure Pipelines could not run because the pipeline triggers exclude this branch/path.

matouskozak · 2026-03-02T14:13:16Z

@copilot also remove the superpmi from the AOT job parameter list

Co-authored-by: matouskozak <[email protected]>

Copilot · 2026-03-02T14:17:10Z

@copilot also remove the superpmi from the AOT job parameter list

Removed -tree:JIT/superpmi from the AOT job testBuildArgs in runtime-llvm.yml in 4e77b94.

dotnet-policy-service · 2026-03-02T14:20:52Z

Tagging subscribers to this area: @akoeplinger, @matouskozak, @simonrozsival
See info in area-owners.md if you want to be subscribed.

Copilot

Pull request overview

Disables the SuperPMI test tree for Mono LLVM AOT pipelines to avoid Mono AOT validation failures caused by SuperPMI’s generated sub-test scripts lacking merged runners.

Changes:

Marked superpmicollect as MonoAotIncompatible to emit a .NoMonoAot marker for Mono AOT exclusion.
Removed -tree:JIT/superpmi from the Mono LLVMFULLAOT runtime test build arguments so those tests are no longer built/run in that pipeline.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File	Description
src/tests/JIT/superpmi/superpmicollect.csproj	Adds `MonoAotIncompatible` marker to exclude this assembly from Mono AOT compilation inputs.
eng/pipelines/runtime-llvm.yml	Stops building/running the `JIT/superpmi` test tree in the Mono LLVMFULLAOT runtime tests job.

Comments suppressed due to low confidence (1)

src/tests/JIT/superpmi/superpmicollect.csproj:30

Setting MonoAotIncompatible generates a .NoMonoAot marker (used to exclude assemblies from the AOT compilation list), but it does not prevent this project from being built nor prevent _BuildSpmiTestProjectScripts from emitting extra runnable .sh scripts. Since GetListOfTestCmds validates that every runnable script has a merged runner or OutOfProcess marker, building this project during Mono AOT flows can still reproduce the original “No merged runner found for test script …/Bytemark.sh” failure. Consider also disabling this project’s build when $(MonoAot)/$(MonoFullAot) is enabled (or otherwise gating _BuildSpmiTestProjectScripts in those modes) so the scripts aren’t generated in the first place.

    <!-- This test is very specific to RyuJIT tooling. -->
    <DisableProjectBuild Condition="'$(RuntimeFlavor)' != 'coreclr'">true</DisableProjectBuild>
    <NativeAotIncompatible>true</NativeAotIncompatible>
    <MonoAotIncompatible>true</MonoAotIncompatible>
  </PropertyGroup>

Initial plan

e2c96f9

Copilot AI assigned Copilot and matouskozak Feb 28, 2026

Copilot started work on behalf of matouskozak February 28, 2026 09:33 View session

github-actions bot added the area-Infrastructure-coreclr label Feb 28, 2026

github-project-automation bot added this to Runtime Infra Feb 28, 2026

Copilot AI changed the title ~~[WIP] Fix build error for superpmi sub-test scripts~~ Disable superpmi tests on Mono and fix OutOfProcessTest sub-script validation Feb 28, 2026

Copilot finished work on behalf of matouskozak February 28, 2026 09:48

matouskozak reviewed Mar 2, 2026

View reviewed changes

src/tests/build.proj Outdated Show resolved Hide resolved

Copilot started work on behalf of matouskozak March 2, 2026 11:13 View session

Revert build.proj change, keep only MonoAotIncompatible in superpmico…

fc080bf

…llect.csproj Co-authored-by: matouskozak <[email protected]>

Copilot AI changed the title ~~Disable superpmi tests on Mono and fix OutOfProcessTest sub-script validation~~ Disable superpmi tests on Mono Mar 2, 2026

Copilot finished work on behalf of matouskozak March 2, 2026 11:17

Copilot started work on behalf of matouskozak March 2, 2026 14:13 View session

Remove superpmi from AOT job tree list in runtime-llvm.yml

4e77b94

Co-authored-by: matouskozak <[email protected]>

Copilot finished work on behalf of matouskozak March 2, 2026 14:18

matouskozak approved these changes Mar 2, 2026

View reviewed changes

matouskozak marked this pull request as ready for review March 2, 2026 14:19

matouskozak requested review from Copilot and jkoritzinsky March 2, 2026 14:19

matouskozak added os-linux Linux OS (any supported distro) area-Infrastructure-mono and removed area-Infrastructure-coreclr labels Mar 2, 2026

matouskozak enabled auto-merge (squash) March 2, 2026 14:20

Copilot started reviewing on behalf of matouskozak March 2, 2026 14:20 View session

Copilot AI reviewed Mar 2, 2026

View reviewed changes

akoeplinger approved these changes Mar 2, 2026

View reviewed changes

matouskozak merged commit e0d7d73 into main Mar 2, 2026
186 of 190 checks passed

matouskozak deleted the copilot/fix-build-error-superpmi-tests branch March 2, 2026 17:38

github-project-automation bot moved this to Done in Runtime Infra Mar 2, 2026

build-analysis bot mentioned this pull request Mar 2, 2026

[android][clr] No peer certificates when executing System.Net.Http.Functional.Tests on Android emulator #124526

Open

dotnet-maestro bot mentioned this pull request Mar 3, 2026

[main] Source code updates from dotnet/runtime dotnet/dotnet#5186

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Disable superpmi tests on Mono#125007

Disable superpmi tests on Mono#125007
matouskozak merged 4 commits intomainfrom
copilot/fix-build-error-superpmi-tests

Copilot AI commented Feb 28, 2026 •

edited

Loading

Uh oh!

Uh oh!

matouskozak commented Mar 2, 2026

Uh oh!

azure-pipelines bot commented Mar 2, 2026

Uh oh!

matouskozak commented Mar 2, 2026

Uh oh!

Copilot AI commented Mar 2, 2026

Uh oh!

dotnet-policy-service bot commented Mar 2, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Build	Definition	Step Name	Console log
1313593	dotnet/runtime	AOT compile CoreCLR tests	Log
1313075	dotnet/runtime	AOT compile CoreCLR tests	Log
1312558	dotnet/runtime	AOT compile CoreCLR tests	Log
1311779	dotnet/runtime	AOT compile CoreCLR tests	Log
1311582	dotnet/runtime	AOT compile CoreCLR tests	Log
1310767	dotnet/runtime	AOT compile CoreCLR tests	Log
1310017	dotnet/runtime	AOT compile CoreCLR tests	Log

Conversation

Copilot AI commented Feb 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Error Message

Known issue validation

Report

Summary

Comments on the Issue (you are @copilot in this section)

Uh oh!

Uh oh!

matouskozak commented Mar 2, 2026

Uh oh!

azure-pipelines bot commented Mar 2, 2026

Uh oh!

matouskozak commented Mar 2, 2026

Uh oh!

Copilot AI commented Mar 2, 2026

Uh oh!

dotnet-policy-service bot commented Mar 2, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Copilot AI commented Feb 28, 2026 •

edited

Loading